Luu Tuyen to TechnologyEnglish • 13 hours agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square63arrow-up1350arrow-down14cross-posted to: [email protected]
arrow-up1346arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen to TechnologyEnglish • 13 hours agomessage-square63cross-posted to: [email protected]
minus-square@Melvin_FerdlinkEnglish4•5 hours agoIsn’t there a way to limit requests so that traffic isn’t bringing down your servers
minus-square@MojavelinkEnglish6•3 hours agoThey obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you
Isn’t there a way to limit requests so that traffic isn’t bringing down your servers
They obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you