I recently set up a LLM to run locally on my desktop. Now that the novelty of setting it up and playing with different settings has worn off, I’m struggling to come up with actual uses for it. What do you use it for when not doing work stuff?

  • @Jarix
    link
    29 months ago

    How do you use it for that purpose? Cannot imagine how that works

    • @[email protected]
      link
      fedilink
      39 months ago

      I use a frontend called Silly Tavern to create a group with several “Personas” that I write a character definition for, in which I also outline the ruleset of the rpg framework I’m using. I then either run an LLM locally, or plug in an API Key for a cloud-based provider.

      I then present them with the plot as Game Master and have them react, while doing their throws myself. Works surprisingly well, and is less dry than just going through the adventure you’ve written step by step.

      • dolphin
        link
        19 months ago

        I’m still trying to get Silly Tavern to run. I want to try what you are doing

        • @[email protected]
          link
          fedilink
          19 months ago

          What problems are you having? For me it was pretty straightforward. Just had to clone the git repo, run the start.sh script, and visit localhost:8000 in a browser.

      • @Jarix
        link
        19 months ago

        Okay if you ever post this process where i can watch it ide watch it.

        Im officially old now i think.

        This sucks

        • @[email protected]
          link
          fedilink
          19 months ago

          Honestly, I know the feeling, and I’m not really all that old. I’m kinda busy at the moment, but I’ll try to remember pinging you if I make a proper post.

          • @Jarix
            link
            19 months ago

            Oh damn, i was just despairing a bit. I didnt really think you would do it. So no pressure to do it friend!