Pygmalion 2 (the trick to using it in Oobabooga [without code mods] is to add the special tokens to the chat character profile sections. I can’t type the tokens directly in Lemmy because the way Lemmy is coded, but you should be able to figure this out. The readme for the model has the special token syntax. Put the user and character (model) tokens in front of the names in the top boxes, then start the context with the system token. Don’t use the user or model tokens in the context, use the names instead. This isn’t perfect, like you can’t also use Silero TTS with this method, but it will work.)
GPT4chan sourcing instructions and links are in the main Oobabooga readme.
Technical/general/code - Llama2 70B GGUF Q5k_M instruct
Learning - Llama2 70B GGUF Q5k_M chat
Chat/Roleplay