I’m sure there would be a few, surely? Multi-million dollar lottery win; finding an old USB key with a bunch of bitcoin; discovering an oil/gas reserve on your property; finding a suspicious unattended briefcase filled with unmarked bills; an unexpected inheritance from a previously unknown great-aunt, provided you spend a night in her haunted manor…
…yoy know, just those usual circumstances that happen to all of us!
I self host my own llms and home assistant voice, having multiple models loaded at once is appealing. I am the exceedingly rare use case - and even I think it’s too much. For the same price I could get two 3000 series cards that would do what I would need.
There is no likely scenario in which I would pay $2,000 for a video card.
I’m sure there would be a few, surely? Multi-million dollar lottery win; finding an old USB key with a bunch of bitcoin; discovering an oil/gas reserve on your property; finding a suspicious unattended briefcase filled with unmarked bills; an unexpected inheritance from a previously unknown great-aunt, provided you spend a night in her haunted manor…
…yoy know, just those usual circumstances that happen to all of us!
No, and you probably wouldn’t need one either since very few people actually need that type of computation power today.
The only argument here is that you have a special use case.
I self host my own llms and home assistant voice, having multiple models loaded at once is appealing. I am the exceedingly rare use case - and even I think it’s too much. For the same price I could get two 3000 series cards that would do what I would need.