They need to be substantially cheaper and (more importantly) they need loads more memory.
The problem is that everyone (chiefly nvidia, but not only) is afraid to hurt their professional offerings by introducing consumer grade ML cards. They are not afraid of Joe having to use a smaller model to do AI on his security cameras, they are afraid of large companies ditching all their A100 cards for consumer equipment.
So they try and segment the market any way they can think of and Joe gets screwed.
The bizarre thing about this is that AMD’s workstation card volume is comically small, and Intel’s is probably nonexistant.
On the high end… Intel literally discontinued their HPC GPUs. The AMD MI300X is doing OK, but clearly suffering from a lack of grassroots software support.
They need to be substantially cheaper and (more importantly) they need loads more memory.
The problem is that everyone (chiefly nvidia, but not only) is afraid to hurt their professional offerings by introducing consumer grade ML cards. They are not afraid of Joe having to use a smaller model to do AI on his security cameras, they are afraid of large companies ditching all their A100 cards for consumer equipment.
So they try and segment the market any way they can think of and Joe gets screwed.
It’s classic market failure really.
The bizarre thing about this is that AMD’s workstation card volume is comically small, and Intel’s is probably nonexistant.
On the high end… Intel literally discontinued their HPC GPUs. The AMD MI300X is doing OK, but clearly suffering from a lack of grassroots software support.
WTF are they afraid of losing?