suoko to [email protected] • 17 days agoCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comexternal-linkmessage-square24fedilinkarrow-up167arrow-down12file-textcross-posted to: technology[email protected][email protected]
arrow-up165arrow-down1external-linkCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comsuoko to [email protected] • 17 days agomessage-square24fedilinkfile-textcross-posted to: technology[email protected][email protected]
minus-square@[email protected]linkfedilink2•17 days agoHow much vram does your TI pack? Is that the standard 8gb ddr6? I will because I’m surprised and impressed that a 14b model runs smoothly. Thanks for the insights!
minus-squarejohantlinkfedilink2•15 days agosorry it should have said 3080 ti which has 12 GB of Vram. Also I guess the model is Q4.
minus-square@[email protected]linkfedilink2•10 days agoi dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.
How much vram does your TI pack? Is that the standard 8gb ddr6?
I will because I’m surprised and impressed that a 14b model runs smoothly.
Thanks for the insights!
sorry it should have said 3080 ti which has 12 GB of Vram. Also I guess the model is Q4.
No worries, thank you!
i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.