shish_mish to TechnologyEnglish • 2 months agoGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coexternal-linkmessage-square35arrow-up1191arrow-down18cross-posted to: searchengines[email protected]reddit
arrow-up1183arrow-down1external-linkGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coshish_mish to TechnologyEnglish • 2 months agomessage-square35cross-posted to: searchengines[email protected]reddit
minus-square@reddig33linkEnglish5•edit-22 months agoI also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.
minus-square@EvotechlinkEnglish1•2 months agoYou can just require a log in to view content, or just flat out auto ban indexing robots.
Are they though?
I don’t know of any law that says that they can’t.
I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.
You can just require a log in to view content, or just flat out auto ban indexing robots.