ikiddM to Artificial IntelligenceEnglish · 2 months ago15000 TPS on a hardcoded ASIC with Llama3.1-8Bchatjimmy.aiexternal-linkmessage-square0linkfedilinkarrow-up12arrow-down10 cross-posted to: [email protected][email protected]
arrow-up12arrow-down1external-link15000 TPS on a hardcoded ASIC with Llama3.1-8Bchatjimmy.aiikiddM to Artificial IntelligenceEnglish · 2 months agomessage-square0linkfedilink cross-posted to: [email protected][email protected]
