• @[email protected]
    link
    fedilink
    126 months ago

    I do self host several AI applications for myself on a low end device and I think for most lowend even mid devices local AI is unfeasible. Nowadays is too much resource heavy and times are too long without high end devices.

    For my computer generating a description of a picture (one of the firefox new features) could easily take up to 5-10 minutes with the cpu at 100%. That’s just not viable for doing while browsing.

    Anyway I would love for firefox to open source the server side of this. So in case someone have s computer powerful enough they could do it locally if they want to.