• Optional
    link
    English
    338 days ago

    “The economics are likely to be grim,” Marcus wrote on his Substack. “Sky high valuation of companies like OpenAI and Microsoft are largely based on the notion that LLMs will, with continued scaling, become artificial general intelligence.”

    “As I have always warned,” he added, “that’s just a fantasy.”

    • Pennomi
      link
      English
      1
      edit-2
      8 days ago

      Even Zuckerberg admits that trying to scale LLMs larger doesn’t work because the energy and compute requirements go up exponentially. There must exist a different architecture that is more efficient, since the meat computers in our skulls are hella efficient in comparison.

      Once we figure that architecture out though, it’s very likely we will be able to surpass biological efficiency like we have in many industries.

      • @[email protected]
        link
        fedilink
        English
        77 days ago

        That’s a bad analogy. We weren’t able to surpass biological efficiency in industry sector because we figured out human anatomy and how to improve it. It’s simply alternative ways to produce force like electricity and motors which had absolutely no relation to how muscles works.

        I imagine it would be the same for computers, simply another, better method to achieve something but it’s so uncertain that it’s barely worth discussing about.

        • Pennomi
          link
          English
          47 days ago

          Of course! It’s not like animals have jet engines!

          Human brains are merely the proof that such energy efficiencies are possible for intelligence. It’s likely we can match or go far beyond that, probably not by emulating biology directly. (Though we certainly may use it as inspiration while we figure out the underlying principles.)

    • sunzu2
      link
      fedilink
      17 days ago

      Microsoft shit is a mega corp… AI is based on their revenue lol