Generative AIs start churning out nonsense when trained on synthetic data — a problem that could put a ceiling on their ability to improve.
    • Draconic NEOEnglish
      1•10 months ago

      Second law of thermodynamics:

      II. Total amount of entropy in a closed system always increases with time. Entropy can never be negative.

      Entropy and disorder tends to increase with time.