• krimson
    link
    fedilink
    arrow-up
    3
    ·
    11 days ago

    Not now, but I’d expect LLMs to be much more efficient in a couple of years.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      3
      ·
      11 days ago

      I expect so as well, and my prediction is that we’ll have LLMs that are roughly as capable as the current frontier that can be run locally within a year or two. At that point, it’s just going to be good enough for vast majority of tasks most people need to do.

      • sudoer777@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 days ago

        They already are, DeepSeek/GLM/Qwen are great models and can run on 2 DGX Sparks