While I’m always hoping the latest newest model will be The One, in the mean time I’m sticking with Airoboros 33B gpt4 1.4 as the most powerful model I can currently run on my 3090.
It’s not perfect by a long shot, but after extensive use I’ve learned what I can trust it with. It’s good enough to summarize long text, to rephrase sentences, and to give me a decent starting point when I’m curious about some topic. It’s reasoning skills are a bit less than GPT 3.5, I’d say.
I also occasionally switch back to Guanaco 33B because it generates a different flavor of text, but I find it to be factually weaker than other similar models.
What are your favorites?
I recently used models
vicuna-33B-v1.3androbin-33b-v2with koboldcpp, I feel they work better when dealing with multiple languagesThe Vicuna 1.3 models have really impressed me, even the 13b seems like a very usable daily driver.
The same (65B versions) and wizard vicuna uncensored 30B.
