Love that we’re getting new voices joining our little circle :-)

Share some of the sexy or non-sexy naughty fun you’ve been up to!

  • @j4k3
    link
    English
    4
    edit-2
    11 months ago

    I discovered it is possible to use a Mixtral 8x7b offline AI model to process entire literotica stories up to 12k words tested so far. I accidentally set the rope scaling variable to max one time on mobile and forgot about it, and later wanted to see just how well this model could handle super long contexts. I had to back off the GPU layers setting massively, and it takes like 10 minutes to initially load, but it can full on take a 12k word long story and continue it fairly well. It isn’t the best model for complex multi character dynamics like a Llama2 70B, but it does all right if you’re willing to edit out the occasional gender fluidity and name butchering. This is a current favorite story. I just stopped the text after Victoria takes her turn with Andrew and the rest can be played out however. You can do almost anything you’d like playing with Julie and Jasmine as they are not defined in the story much at all except by name. https://www.literotica.com/s/all-five-senses-2

    Mixtral 8×7B Dolphin has 32k total context available. https://huggingface.co/TheBloke/dolphin-2.7-mixtral-8x7b-GGUF

    • @[email protected]OP
      link
      fedilink
      English
      411 months ago

      Wow that’s a pretty impressive story! Also a fun read :-)

      Do you mean the AI wrote up until Victoria’s turn?

      • @j4k3
        link
        English
        3
        edit-2
        11 months ago

        No. I have no connection to whomever wrote it. I just chose to cut off the story and roleplay with AI from this point forward, skipping the rest of the story. It can take over the rest of the story, but it leaves off at a point that is not very compelling. That story has pretty good development of complexity and is quite dense, so it makes a good jumping off point by stopping it at Victoria’s turn. It also tells me a lot about the model by handing over the story at this point. The LLM really likes Mrs C., but lacks a complex understanding of how Allie and Jane’s rivalry works out as a relationship in practice. It seems to think they are best friends most of the time. Roleplaying with Name-1 (human) and Name-2 (bot) set to various characters can be quite interesting too. It shows many facets of what the model really understands.