@gedaliyah to TechnologyEnglish • 5 months agoReddit blocking all major search engines, except Googlereadwrite.comexternal-linkmessage-square185arrow-up1680arrow-down118
arrow-up1662arrow-down1external-linkReddit blocking all major search engines, except Googlereadwrite.com@gedaliyah to TechnologyEnglish • 5 months agomessage-square185
minus-square@gedaliyahOPlinkEnglish21•5 months ago“We always obey the robots.txt” A bunch of corporations that have no accountability and plenty of incentive to just ignore it and have all been caught training AI on off-limits data.
“We always obey the robots.txt”