Hellfire103 to linuxmemesEnglish • 1 month agoDistro Focuseslemmy.caimagemessage-square228fedilinkarrow-up1973arrow-down114
arrow-up1959arrow-down1imageDistro Focuseslemmy.caHellfire103 to linuxmemesEnglish • 1 month agomessage-square228fedilink
minus-square@[email protected]linkfedilinkEnglish6•1 month agoi tried living in the terminal but i had no one to talk to
minus-square@Zachariahlink8•1 month agoWe’re in your terminal: https://github.com/LunaticHacker/lemmy-terminal-viewer
minus-square@[email protected]linkfedilinkEnglish4•1 month agosadly based on the latest issues submitted and my experience, the app no longer works: https://github.com/LunaticHacker/lemmy-terminal-viewer/issues/11
minus-squareLucy :3linkfedilink1•1 month agoIf you have a decent GPU or CPU, you can just set up ollama with ollama-cuda/ollama-rocm and run llama3.1 or llama3.1-uncensored.
minus-square@[email protected]linkfedilinkEnglish2•1 month agoI have a ryzen 5 laptop. not really decent enough for that workload. and im not crazy about AI.
minus-squareLucy :3linkfedilink1•1 month agoI bet even my Pi Zero W could run such a model* * with 1 character per hour or so
minus-square@[email protected]linkfedilinkEnglish2•1 month agointeresting, well it’s something to look into, but id like a place to communicate with like minded people.
Who doesn’t?
I mean version 2.9.2 just came out in May.
i tried living in the terminal but i had no one to talk to
We’re in your terminal: https://github.com/LunaticHacker/lemmy-terminal-viewer
sadly based on the latest issues submitted and my experience, the app no longer works: https://github.com/LunaticHacker/lemmy-terminal-viewer/issues/11
😍
If you have a decent GPU or CPU, you can just set up ollama with ollama-cuda/ollama-rocm and run llama3.1 or llama3.1-uncensored.
I have a ryzen 5 laptop. not really decent enough for that workload. and im not crazy about AI.
I bet even my Pi Zero W could run such a model*
* with 1 character per hour or so
interesting, well it’s something to look into, but id like a place to communicate with like minded people.