Anything like that should absolutely be left up to the user. The distro should not decide that for you. If you want it, install it and set it up yourself.
I dont see any harm in including support for running models built into the distro and then providing easy access to a pre-selected list of models to use with that if the user wants.
Sure, I agree with that. But that should, at the very least, not be included in a general purpose distro aimed at beginners unless they offer it as a seperate download or something. I feel like this kind of thing should be a seperate edition of the distro or something for people who actually want it.
Hopefully the distros integrate ollama or similar so users don’t have to think about it. And it all runs locally.
Anything like that should absolutely be left up to the user. The distro should not decide that for you. If you want it, install it and set it up yourself.
I dont see any harm in including support for running models built into the distro and then providing easy access to a pre-selected list of models to use with that if the user wants.
Sure, I agree with that. But that should, at the very least, not be included in a general purpose distro aimed at beginners unless they offer it as a seperate download or something. I feel like this kind of thing should be a seperate edition of the distro or something for people who actually want it.
It’s already in the AUR. And someone could just set up a PPA for DEB-based distros.
How about no. Users can install apps like Alpaca if they want AI. Right now there are zero Foss models anyway and there are many copyright issues.