What are your thoughts on #privacy and #itsecurity regarding the #LocalLLMs you use? They seem to be an alternative to ChatGPT, MS Copilot etc. which basically are creepy privacy black boxes. How can you be sure that local LLMs do not A) “phone home” or B) create a profile on you, C) that their analysis is restricted to the scope of your terminal? As far as I can see #ollama and #lmstudio do not provide privacy statements.

  • @Deckweiss
    link
    519 hours ago

    I’m running gpt4all on AMD. Had to figure out which packages to install, which took a while, but since then it runs fine just fine

      • @Deckweiss
        link
        3
        edit-2
        14 hours ago

        arch wiki and gpt4all github & issues