Who actually uses “local AI” beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don’t give a shit about
The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.
The only consumer use case I see in the wild with some real momentum behind it is role play.
All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.
People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.
To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.
I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.
Who actually uses “local AI” beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don’t give a shit about
The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.
The only consumer use case I see in the wild with some real momentum behind it is role play.
All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.
People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.
To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.
I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.