• Ghostalmedia
    link
    English
    341 year ago

    Those big AI companies will never get past a text file that I wrote “please don’t crawl” on.

    • @FlatFootFoxOP
      link
      English
      11 year ago

      I know you’re just joking, but for folks who are interested, OpenAI recently published details on how to request via robots.txt that future models not crawl your site. Won’t do anything for their existing models or their competitors, but there’s that.

    • teft
      link
      fedilink
      English
      11 year ago

      I wonder if people can poison the data by adding white marks or something?