I am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
NVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
enabling unmodified CUDA applications to run on AMD GPUs at near-native performance, the ZLUDA atop AMD HIP code was made available and open-source following the end of the AMD contract
Trouble is… HIP doesn’t support all of AMDs GPUs. It’s only 7900s in the consumer line-up.
Me too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.
I hope this becomes a thing so we can have more competition