I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai

  • @pavnilschanda
    link
    English
    55 months ago

    SillyTavern is a fork of TavernAI that lets you do more things. Perhaps look into that? Also you can just adjust the system prompt to have the LLM assume that you’re not a boy.

    • @[email protected]OP
      link
      fedilink
      English
      15 months ago

      I tried SillyTavern but the ui looked terrible. Do i put “i am a girl” in the prompt? How will it know im talking about me not the character

      • @pavnilschanda
        link
        English
        35 months ago

        If you use the persona system, you can put “<insert persona name> is a girl”, otherwise “Refer to me as a girl throughout the conversation” would be fine

        • @[email protected]OP
          link
          fedilink
          English
          25 months ago

          It worked. Thanks. Another question, how do i stop the random person who says get a room and similar?

          • @pavnilschanda
            link
            English
            15 months ago

            What kind of LLM are you using? Depending on its effectiveness, you can put “this is a chat between you and me” (or whatever you and AI identify as) in the system prompt.

            • @[email protected]OP
              link
              fedilink
              English
              25 months ago

              I am using DavidAU/Psyonic-Cetacean-Ultra-Quality-20b in koboldai horde. I plan to selfhost tho when i get my 3090 installed

              • @pavnilschanda
                link
                English
                15 months ago

                OK, I gave it a look and it said that it’s good at following instructions, so the aforementioned advice would still apply

  • @[email protected]
    link
    fedilink
    English
    3
    edit-2
    5 months ago

    It would probably be more effective to put an explicit mention in the system prompt. “Your interlocutor is a <gendered term> and will be greatly offended to be refered to as a boy or a man.”

  • projectmoon
    link
    fedilink
    English
    25 months ago

    KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.