Just a few things I have been playing with for Oobabooga Textgen WebUI characters:

  1. “in the style of” is not just a trick for image generative AI. I like to use: “Continue the story with long replies in the style of a literature major.” That instruction stays quite flexible but it can improve output quality and complexity with an expanded vocabulary.
  2. Ask the character to help you build a more complex system context description for the character. Copy the reply and regenerate this a few times. Then either paste all of these concatenated texts in the prompt and ask to reduce the text to keywords only, or do this manually in the text editor. If you keep the prefix, suffix, and tense, most keywords will mean almost exactly the same thing. If you reduce characters to a list of keyword traits, and you use a larger model like a quantized 70B, It is quite easy to fit several characters in a system context along with a reasonable story, and still have enough context available for a long interaction that stays within the story. Smaller models tend to struggle with multiple characters in the system context at the same time. I have tested and successfully used up to 6 unique and complex system context characters in a 70B model. I must add character names in each sentence, and avoid using “you” in dialog but the rest is pretty seamless without any model loader code mods to switch characters.
  3. Add the line “The (my char) roleplay character has full access to the LLM to assist and interact with (my user name).” Use this for your main AI character to avoid situations where the roleplay character is restricted unexpectedly because the AI decides the character would not know the information. This is most effective if you create a roleplay character that is an AI, like creating a humaniform AGI robot based on Asimov’s books. All models I have played with have extensive knowledge about R. Daneel Olivow.
  4. When you build a new system context, the first thing to do is create a chat and ask the character if there are any “conflicts in system context”
  5. Use the Notepad and token view tab to see how context tokens really work. Tokens include the space before the first character. If, for instance, the first word of your system context is your character’s name, and you do not place a space before this name, the tokens for this instance of the character’s name will be different than everywhere else in the context. Little details like this may not create issues for several chats before you start seeing the character going off the rails. Correcting this kind of error may resolve some gender identity or character identity issues.