• @[email protected]
    link
    fedilink
    English
    191 year ago

    I want to like assistants like this, but I can’t see myself using one regularly until I can run it locally on my device.

    • @[email protected]
      link
      fedilink
      English
      51 year ago

      Yep. My next phone is going to have at least 16GB of RAM so I can run a modestly capable LLM on it.

      I hope LLMs encourage vendors to stop being so skimpy with storage and RAM. 8/128 has been the norm for like 4 years now. Why is it not advancing?!?

      And it’s even worse on the iPhone side. 6GB…

    • @Wilzax
      link
      English
      11 year ago

      Mycroft can run on your own linux device, including a raspberry pi if you have one, but the native android version is still a work in progress. You could configure a remote connection to your own self hosted instance of it though