Who actually uses “local AI” beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don’t give a shit about
The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.
The only consumer use case I see in the wild with some real momentum behind it is role play.
All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.
People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.
To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.
I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.
local AI is cool and all, but neither the hardware nor the models are really ready for your average consumer
Who actually uses “local AI” beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don’t give a shit about
The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.
The only consumer use case I see in the wild with some real momentum behind it is role play.
All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.
People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.
To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.
I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.