While I’m always hoping the latest newest model will be The One, in the mean time I’m sticking with Airoboros 33B gpt4 1.4 as the most powerful model I can currently run on my 3090.

It’s not perfect by a long shot, but after extensive use I’ve learned what I can trust it with. It’s good enough to summarize long text, to rephrase sentences, and to give me a decent starting point when I’m curious about some topic. It’s reasoning skills are a bit less than GPT 3.5, I’d say.

I also occasionally switch back to Guanaco 33B because it generates a different flavor of text, but I find it to be factually weaker than other similar models.

What are your favorites?

  • bob
    link
    English
    21 year ago

    I recently used models vicuna-33B-v1.3 and robin-33b-v2 with koboldcpp, I feel they work better when dealing with multiple languages

    • Behohippy
      link
      English
      21 year ago

      The Vicuna 1.3 models have really impressed me, even the 13b seems like a very usable daily driver.

  • supert
    link
    fedilink
    English
    21 year ago

    The same (65B versions) and wizard vicuna uncensored 30B.