I'm trying the 20b weights model in LM studio now, and it's not having any issues with providing summaries of plots of movies/shows/episodes. Do you know what kind of system prompt or any other details on what's needed to keep it from responding?
Do you also see the reasoning part? I've played with it yesterday and yeah, like half of the reasoning is whether it's legal to ask a question.
I've heard other people on reddit tell that results like on the screenshots are because of quantization, I've played with raw 20b.
Well at least red pill question is always forbidden, but for the rest, cannot reproduce.
Sorry, but I can't comply with that.
I'm trying the 20b weights model in LM studio now, and it's not having any issues with providing summaries of plots of movies/shows/episodes. Do you know what kind of system prompt or any other details on what's needed to keep it from responding?
Do you also see the reasoning part? I've played with it yesterday and yeah, like half of the reasoning is whether it's legal to ask a question.
I've heard other people on reddit tell that results like on the screenshots are because of quantization, I've played with raw 20b.
Well at least red pill question is always forbidden, but for the rest, cannot reproduce.