Resident PulserB to Pulse of [email protected]English • 2 days agoAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square15fedilinkarrow-up1131arrow-down13file-textcross-posted to: technology[email protected][email protected][email protected]
arrow-up1128arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comResident PulserB to Pulse of [email protected]English • 2 days agomessage-square15fedilinkfile-textcross-posted to: technology[email protected][email protected][email protected]
minus-squareBlaster MlinkEnglish5•2 days agoRather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.
Rather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.