@[email protected] to TechnologyEnglish • 9 months ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square36fedilinkarrow-up1120arrow-down115cross-posted to: [email protected]
arrow-up1105arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.org@[email protected] to TechnologyEnglish • 9 months agomessage-square36fedilinkcross-posted to: [email protected]
minus-square@davidgrolinkEnglish9•9 months agoBut since it takes 10% of the space (vram, etc.) sounds like they could just start with a larger model and still come out ahead
But since it takes 10% of the space (vram, etc.) sounds like they could just start with a larger model and still come out ahead