shish_mish to TechnologyEnglish • 2 months agoGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coexternal-linkmessage-square35arrow-up1191arrow-down18cross-posted to: searchengines[email protected]reddit
arrow-up1183arrow-down1external-linkGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coshish_mish to TechnologyEnglish • 2 months agomessage-square35cross-posted to: searchengines[email protected]reddit
minus-square@reddig33linkEnglish9•2 months agoWhat isn’t the norm is to serve one robots.txt to one company, and a different robots.txt to everyone else. Which is what Reddit is doing here.
What isn’t the norm is to serve one robots.txt to one company, and a different robots.txt to everyone else. Which is what Reddit is doing here.