The rise and fall of robots.txt
www.theverge.com
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
  • Ithi@lemmy.caEnglish
    6·
    1 year ago

    Only if you’re already rich or in the right social circles though. Everyone else gets fined/jail time of course.

    • afraid_of_zombiesEnglish
      11·
      1 year ago

      Meh maybe. I know plenty of people who get away with all kinds of crap without money or connections.