Generative AIs start churning out nonsense when trained on synthetic data — a problem that could put a ceiling on their ability to improve.
    • Draconic NEOEnglish
      -2•3 months ago

      Second law of thermodynamics:

      II. Total amount of entropy in a closed system always increases with time. Entropy can never be negative.

      Entropy and disorder tends to increase with time.