…Both Intel and AMD optimized their software stacks to get massive speedups in generative AI which has seen AMD’s RTX 7900 XTX get higher performance per dollar than an NVIDIA RTX 4080 in generative AI (specifically Stable Diffusion with A111/Xformers). Considering Stable Diffusion accounts for the vast majority of non-SaaS, localized generative AI right now - this is a major milestone and finally offers some competition to NVIDIA.
I just want better support from developers. I’m fine with AMD being slower, but a ton of projects just don’t even run with AMD hardware. I wish there was a psuedo-vulkan style interface for AI, so that GPU makers and developers could target that in the same way game developers target vulkan/opengl.
Blame the dominance of cuda in college cs.