• @pycorax
    link
    English
    135 months ago

    Android phone makers are shipping on device LLMs?

    Do people actually want these?

    • @[email protected]
      link
      fedilink
      English
      28
      edit-2
      5 months ago

      Yes, in fact that is the only kind of ai i would ever use and entrust my data to. Not the apple one, but an open source model that is running only on my device and answering only to me; using the data I provide only for my interests? That one I would use.

      • Shawdow194
        link
        fedilink
        25 months ago

        I bet these LLM models wont be 100% locally hosted. I imagine some form of data will be piped back to a cloud server

          • @Cryophilia
            link
            English
            65 months ago

            “secure” meaning “apple sees all your data”

          • @Glytch
            link
            English
            55 months ago

            Is that why there are so many celebrity iCloud leaks floating around the internet?

            • @lepinkainen
              link
              English
              35 months ago

              It wasn’t a software issue, but a human issue. People got scammed and gave their logins away.

              This system is built so that nobody can access it and they’ve went to extreme lengths to make it so. It’s also available for auditing, it hardware and software.

            • @lepinkainen
              link
              English
              05 months ago

              “It’s a very thoughtful design. Indeed, if you gave an excellent team a huge pile of money and told them to build the best “private” cloud in the world, it would probably look like this.”

              • Matthew D Green, cryptography teacher at Josh Hopkins

              You can go argue with him if you disagree.

    • @[email protected]
      link
      fedilink
      English
      165 months ago

      LLM is AI correct? If my phone is going to do AI at all, I prefer it be done on device for sure. For privacy reasons if nothing else. But it’s not anything I’ve really looked into. I have the S24 and the only AI feature I use is the Circle to search… which I don’t consider to be AI.

      • @[email protected]
        link
        fedilink
        English
        25 months ago

        LLM is a form of AI, specifically the text AIs like ChatGPT that have suddenly made “AI” a dinner table term. AI in some form or another is almost definitely being used in your device - even for things like filling in gaps in low-quality voice calls, and probably has been for a while. But the problem is that unlike those “old” AIs, LLMs require some significant power to run, so running them on phones will probably require meaningful trade-offs. But the increased security is also a meaningful benefit.

      • @[email protected]
        link
        fedilink
        English
        15 months ago

        They add a kinda nifty “copy subject” option that is supposedly local AI stuff to the samsung gallery, fun to mess with