I understand the sentiments against AI, tech oligarchs investing in data centers, and etc.

But could local LLMs, be used to empower people, and ignite more startup projects?

I use an LLM to draft all sorts of writing. It’s not perfect, but it’s an easy way to flesh out my ideas in an outline or rough draft. Other open source projects like “openclaw” is a great way to create a personal assistant.

Neural networking is here, and isn’t going away anytime soon. It’ll probably get better over time.

Should people be thinking about “how I can use local AI to help me” than “anti-AI”?

  • 𞋴𝛂𝛋𝛆English
    1·
    6 days ago

    I have not gone through the software stack to be sure there is no mechanism of logging or communications. It works offline, sure, but I’m only mostly confident it does not communicate at all. Pytorch and transformers are huge libraries, and while the Nvidia driver is open source, the nvcc compiler required to create the binary is proprietary. Every machine also runs the background OS native to the hardware and inaccessible like Intel ME. Everything has one of these systems. I also think it is likely that GitHub is the way such a connection would be practical. Or through discord or YT. Not saying it is just that it is technically possible.