@ooli to TechnologyEnglish • 1 year agoGPU's rival? What is Language Processing Unit (LPU)www.turingpost.comexternal-linkmessage-square15arrow-up1100arrow-down111
arrow-up189arrow-down1external-linkGPU's rival? What is Language Processing Unit (LPU)www.turingpost.com@ooli to TechnologyEnglish • 1 year agomessage-square15
minus-square@FinadillinkEnglish1•1 year agoThat with a fp16 model? Don’t be scared to try even a 4 bit quantization, you’d be surprised at how little is lost and how much quicker it is.
That with a fp16 model? Don’t be scared to try even a 4 bit quantization, you’d be surprised at how little is lost and how much quicker it is.