so my old GPU died a few days ago and I was thinking which brand of GPU to get next. AMD or Nvidia? I’ve heard Nvidia drivers are very annoying with Linux but I’ve never had an AMD GPU before. Which would be better? I’ll sometimee switch to Windows to play specific games as well.
deleted by creator
I was running a LLM earlier this evening and my 3090 started to make a ticking noise everytime a token was generated. Panicing, I look for the first time in years at AMD’s lineup. A 7900 XTX goes for $1400 CDN, but a 4090 is almost $2500.
I also use Daz Studio/Iray to render characters before feeding them to Stable Diffusion, because it’s a lot easier to get exactly what you want without spending hours tweaking prompts and seeds and hoping for the best.
An extra grand isn’t really that bad when you factor in the lifetime of the card.
If it’s a ZOTAC card it might just click when the fans start and stop. My ZOTAC 3060 makes a click when the fans start and stop. It’s a good way to know when my PC wakes itself up lol
Naw this was a click everytime a token was generated, and they were generating really slowly so I knew something was wrong. I think it was bouncing off the 24GB memory limit and something was being tripped, so I changed the loader from AutoGPQ to ExLlama_HF and everything works fine now.
How does it work for ML and AI tasks with AMD and their ROCm? I really despise Nvidia as a company but unfortunately when it comes to AI/ML and other productivity tasks AMD is just much inferior to Nvidia’s offering. Otherwise I would have definitely been very interested in the AMD 7900XTX, that has everything for pretty much half the price of 4090.
Install the ROCm version of packages and it mostly works (at least on Arch, and I assume Ubuntu since it has official packages from AMD.)
I am also using arch anyway, even though I am thinking of switching to Void now. I am just a bit worried about the “mostly” part. I was toying with the idea of getting 4060Ri with 16Gb of RAM, because of the VRAM. The other two cards are 4080 and 4090 I was considering but both are overpriced, especially the 4080.