@Wilshire to TechnologyEnglish • 6 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square61arrow-up1215arrow-down117cross-posted to: tech@programming.dev
arrow-up1198arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.com@Wilshire to TechnologyEnglish • 6 months agomessage-square61cross-posted to: tech@programming.dev
minus-squaresunzulinkfedilink2•6 months agoI guess time to buy some ram after spending decade at 16gb
Afaik you need about 40GB of vram for a 70b model.
Can’t you offload some of it to RAM?
Same requirements, but much slower.
I guess time to buy some ram after spending decade at 16gb