RSS BotMB to Hacker [email protected]English • 1 month agoAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square3fedilinkarrow-up122arrow-down11file-textcross-posted to: [email protected]technology[email protected][email protected]
arrow-up121arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comRSS BotMB to Hacker [email protected]English • 1 month agomessage-square3fedilinkfile-textcross-posted to: [email protected]technology[email protected][email protected]
minus-square@TootSweetlinkEnglish3•1 month agoI imagine AI scrapers fetching the robots.txt, reading, ingesting, reflecting on, considering, rereading, and finally throwing it straight in the trash before scraping all your data. Because fuck you, that’s why.
I imagine AI scrapers fetching the robots.txt, reading, ingesting, reflecting on, considering, rereading, and finally throwing it straight in the trash before scraping all your data. Because fuck you, that’s why.