Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?
Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?
I don’t know about you but my M1 Pro is a hellovalot faster than my 5800x in llama.cpp.
These CPUs benchmark similarly across a wide range of other tasks.
deleted by creator
*No consumer Intel hardware is on that list.
The only widely available consumer hardware with AVX512 support is AMD’s Zen4 (7000 series).
I think just about the only Apple computer that supports AVX512 is the 2019 mac pro.
deleted by creator