“In 10 Years, Computers Will Be Doing This A Million Times Faster.” The Head Of Nvidia Does Not Believe That There Is A Need To Invest Trillions Of Dollars In The Production Of Chips For AI - Gadget Tendency
gadgettendency.com
Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that

“In 10 years, computers will be doing this a million times faster.” The head of Nvidia does not believe that there is a need to invest trillions of dollars in the production of chips for AI::Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that

  • @BuddahrifficEnglish
    17•9 months ago

    Even if he is accurate, specialist hardware will outperform generic hardware at what it is specialized for.

    I remember a story sometime in the 00s about PCs finally getting to the point where they were as fast as one of the WWII code breaking computers (or something like that). It wasn’t because we backtracked in computer speeds after WWII, but because even that ancient hardware was able to get good performance when it was purpose-built, but it couldn’t do anything else and likely would have required a lot of work to adjust to a different kind of cypher scheme, if it could be adapted at all.

    So GP compute might be a million times faster in a decade, but specialist AI chips might be a million times faster than that.

    A hardware neural net might be able to eliminate memory latency by giving each neuron fast resisters to handle all their memory needs. If it doesn’t need to change connections, each connection could be hard wired. A GPU wouldn’t have a chance at keeping up no matter how wide that memory bus gets or how many channels it gets split into. It might even use way less power (though with the elimination of memory latency, it could go fast enough to use way more, too).