Got Ollama set up with an 8GB AMD graphics card at my disposal. Any recommendations for the most unhinged model I can run on this? i.e. I can ask it how to annoy my neighbors and it won’t go on a rant about morals or its supposed purpose as an LLM?
Got Ollama set up with an 8GB AMD graphics card at my disposal. Any recommendations for the most unhinged model I can run on this? i.e. I can ask it how to annoy my neighbors and it won’t go on a rant about morals or its supposed purpose as an LLM?
They do, but the smaller ones and the distilled ones still struggle with some censorship. Methinks it has to do with more parameters = more ability to decide what is and isn’t disinformation, however I doubt they’re gonna self host the 18b model on 8b brand to get around that