I am seeking recommendations for alternative free and privacy-focused AI chatbots that can be accessed via a web browser or utilized as offline software with a user-friendly installation process, not requiring extensive coding knowledge.
Specifically, I am interested in exploring options similar to DuckDuckGo or Venice, which prioritize user data protection and anonymity. Additionally, I would appreciate suggestions for offline AI chatbots that can be easily installed on various operating systems without requiring technical expertise.
It is notable that while there are numerous resources available for evaluating proxies and privacy-focused software, there appears to be a lack of comprehensive lists or reviews specifically focused on free AI chatbots that prioritize user privacy. If such resources exist, I would appreciate any guidance or recommendations.
Probably a bit too technical but I wrote (and keep on updating) https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence which does include some of those, as mentioned here by others, e.g. GPT4All, LMStudio ,tlm, localAI, Ollama, etc.
If I can somehow clarify this to help you, please do ask.
LMStudio is what I use, extremely simple and runs well
I’m trying to switch to this from Ollama after seeing the benchmarks, so much faster. But it has given me nothing but issues with CUDA incompatibility where Ollama runs smooth as butter. Hopefully I get some feedback on my repo discussion. Same docker setup as working Ollama, but Ollama has a lot more detailed docs.Ignore that, thought you said LMDeploy.
Indeed, very convenient. Just noticed they also now provide a JS/TS way to access models https://github.com/lmstudio-ai/lmstudio.js so might try that soon, especially if they conveniently support RAG.