The massive computer clusters powering artificial intelligence consume vast quantities to answer the world’s queries, but how is Big Tech redressing the balance?

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

  • @bandwidthcrisisEnglish
    0•1 month ago

    It’s true, I don’t know how large the models are that are being accessed in data centers. Although if the article’s estimate is correct, it’s sad that such excessively-demanding models are always being used for use-cases that could often be handled with much lower power usage.

    • ddhEnglish
      4•1 month ago

      This seems a big waste of energy if that 140Wh (504,000 joules) number is correct. That amount of energy is about 2,000 times what it would take to do a very similar thing on a home PC.

      Writing a 100 word email with a 7B model would take my PC about 5 seconds, times an increased power use of 50 watts, so 250 joules.

      I get that they might be using a much larger model, but the e-mail is not going to be 2,000 times better.