Luu Tuyen to TechnologyEnglish • 15 hours agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square63arrow-up1365arrow-down15cross-posted to: [email protected]
arrow-up1360arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen to TechnologyEnglish • 15 hours agomessage-square63cross-posted to: [email protected]
minus-square@MojavelinkEnglish8•5 hours agoThey obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you
They obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you