Generative AIs start churning out nonsense when trained on synthetic data — a problem that could put a ceiling on their ability to improve.
  • Draconic NEOEnglish
    -2•2 months ago

    Second law of thermodynamics:

    II. Total amount of entropy in a closed system always increases with time. Entropy can never be negative.

    Entropy and disorder tends to increase with time.