Hello yall, currently I have an RTX 2060, which I’ll be passing down to slap a 1060 into my server, but I’d like to weigh some options first.
The 2060 has been pretty good with Linux thus far, I’m a little worried about going to the 30 series - so I’ll be accepting affirmations - but I am curious what any of you think about AMD cards and which one to get. Also if there’s any reason not to use a 1060 for jellyfin and such that would be very helpful
Edit: thanks yall! Settled on an RX6600, runs local LLMs like nothing compared to my ol 2060
NVidia is great in a server, drivers are a pain but do-able. I have a 3000 series that I use regularly and pass into my kubernetes cluster. NVidia on a gaming rig linux is fine, but there is more overhead with the drivers.
AMD is great in gaming servers, but doesn’t have CUDA, so it’s not as useful in a server environment in my experience - if you’re thinking of doing CUDA workloads like hosting LLMs.
1060 will be a noticeable step in Jellyfin
I didn’t even realize CUDA had a weight on LLMs, thank you!
Oh yeah, critical component. And vram, in fact I would only consider LLMs on a 3000+ card right now, they require quite a bit of vram