This one will be controversial but maybe some people will find this cool
Local AI has gotten really good. I love checking out ways to integrate smaller AIs in my software and workflows (whisper for example, captioning or image semantics).
I am the singer of a band and I already made a speech to text thing so that I can hold a button and say a thing and it changes my Autotune key as soon as it recognizes the song name. It’s awesome. I am currently looking into switching to a faster model so that maybe I can do this live with more effects and use it to reassign foot triggers and pedals etc.
I also love the idea that open source models are incredibly good already. That thing where you say “AI please turn the lights on”, you could build that reliably already with a good agent I model and a formatted tool calls. It’s incredible. And you don’t have to subscribe or anything, it all runs at home.
I have this hope that we are getting so good with AI that paid models become redundant and everyone can just use local AI models willy nilly.
That is extremely cool. Maybe in the future instead of Serial Experiments Lain style building computers to be highly customized it’s primarily in the software. Less aesthetically interesting maybe but still amazing DIY.
I’m curious about local models. How much storage does it take to give them a good library of data? And are you able to curate that or do they just come with a dataset that’s community made?
This one will be controversial but maybe some people will find this cool
Local AI has gotten really good. I love checking out ways to integrate smaller AIs in my software and workflows (whisper for example, captioning or image semantics).
I am the singer of a band and I already made a speech to text thing so that I can hold a button and say a thing and it changes my Autotune key as soon as it recognizes the song name. It’s awesome. I am currently looking into switching to a faster model so that maybe I can do this live with more effects and use it to reassign foot triggers and pedals etc.
I also love the idea that open source models are incredibly good already. That thing where you say “AI please turn the lights on”, you could build that reliably already with a good agent I model and a formatted tool calls. It’s incredible. And you don’t have to subscribe or anything, it all runs at home.
I have this hope that we are getting so good with AI that paid models become redundant and everyone can just use local AI models willy nilly.
That is extremely cool. Maybe in the future instead of Serial Experiments Lain style building computers to be highly customized it’s primarily in the software. Less aesthetically interesting maybe but still amazing DIY.
I’m curious about local models. How much storage does it take to give them a good library of data? And are you able to curate that or do they just come with a dataset that’s community made?