The massive computer clusters powering artificial intelligence consume vast quantities to answer the world’s queries, but how is Big Tech redressing the balance?

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

  • @MonsieurmoucheEnglish
    1•2 hours ago

    Is this for inferencing only? Do you include training?

    • @[email protected]English
      1•1 hour ago

      Inference only. I’m looking into doing some fine tuning. Training from scratch is another story.