@cm0002 to Free Open-Source Artificial IntelligenceEnglish • 5 days agoOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.comexternal-linkmessage-square9arrow-up132arrow-down12
arrow-up130arrow-down1external-linkOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.com@cm0002 to Free Open-Source Artificial IntelligenceEnglish • 5 days agomessage-square9
minus-squarehendriklinkfedilinkEnglish9•5 days agoYeah, my computer also runs a game at 200fps. But I’m not saying if it’s Minesweeper or a recent AAA game…
minus-squareffheinlinkEnglish4•5 days agoYea… it’s not quite the same thing to actually run DeepSeek R1, a 671B model, and for example DeepSeek-R1-Distill-Qwen-1.5B
minus-squaresuokolinkfedilinkEnglish2•5 days agoA recent i7 on CPU only can manage qwen 1.5 in a satisfactory way, comparable to big online players. Curious about recent ultra Intel and snapdragons
minus-squarehendriklinkfedilinkEnglish1•5 days agoMy old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That’s a bit slower than I can read. I wonder what my new phone does.
Yeah, my computer also runs a game at 200fps. But I’m not saying if it’s Minesweeper or a recent AAA game…
Yea… it’s not quite the same thing to actually run DeepSeek R1, a 671B model, and for example DeepSeek-R1-Distill-Qwen-1.5B
A recent i7 on CPU only can manage qwen 1.5 in a satisfactory way, comparable to big online players. Curious about recent ultra Intel and snapdragons
My old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That’s a bit slower than I can read. I wonder what my new phone does.