“In 10 years, computers will be doing this a million times faster.” The head of Nvidia does not believe that there is a need to invest trillions of dollars in the production of chips for AI::Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that

  • @BetaDoggo_
    link
    English
    32
    edit-2
    1 year ago

    This isn’t necessarily about just hardware. Current ML architectures and inference engines are far from being at peak efficiency. Just last year we saw 20x speedups for llm inference on some hardware. “a million times” is obviously hyperpole though.

    • @NegativeInf
      link
      English
      71 year ago

      Literally reading preprint papers daily on more efficient implementations of self attention approximations.