@baatliwala to memes • 3 days agoThe AI revolution is comingimagemessage-square77arrow-up1322arrow-down138
arrow-up1284arrow-down1imageThe AI revolution is coming@baatliwala to memes • 3 days agomessage-square77
minus-square@[email protected]linkfedilink1•1 day agoAs someone who is rather new to the topic: I have a GPU with 16 GB VRAM and only recently installed Ollama. Which size should I use for Deepseek R1?🤔
minus-square@kyojilink2•19 hours agoI also have 16gb vram and the 32b version runs ok. Anything larger would take too long I think
minus-squareLurkerlinkfedilink2•1 day agoYou can try from lowest to bigger. You probably can run biggest too but it will be slow.
Deepseek is good locally.
As someone who is rather new to the topic: I have a GPU with 16 GB VRAM and only recently installed Ollama. Which size should I use for Deepseek R1?🤔
I also have 16gb vram and the 32b version runs ok. Anything larger would take too long I think
You can try from lowest to bigger. You probably can run biggest too but it will be slow.