suoko to [email protected] • 1 day agoCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comexternal-linkmessage-square21fedilinkarrow-up161arrow-down12file-textcross-posted to: technology[email protected][email protected]
arrow-up159arrow-down1external-linkCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comsuoko to [email protected] • 1 day agomessage-square21fedilinkfile-textcross-posted to: technology[email protected][email protected]
minus-square@normalexitlink1•5 hours agoThe cost is a function of running an LLM at scale. You can run small models on consumer hardware, but the real contenders are using massive amounts of memory and compute on GPU arrays (plus electricity and water for cooling). ChatGPT is reportedly losing money on their $200/mo pro subscription plan.
The cost is a function of running an LLM at scale. You can run small models on consumer hardware, but the real contenders are using massive amounts of memory and compute on GPU arrays (plus electricity and water for cooling).
ChatGPT is reportedly losing money on their $200/mo pro subscription plan.