• eicker
    link
    fedilink
    English
    arrow-up
    21
    ·
    2 hours ago

    We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.

    • Vlyn@lemmy.zip
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 hour ago

      DeepSeek has really led the way here, especially as they are a bit more hardware constrained. Plus they openly publish their findings and release open source models, so high hopes there.

      It’s probably China’s play to pop the AI bubble, but I’m all for it (: