Andy Reid to TechnologyEnglish • 9 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square199arrow-up11.09Karrow-down115cross-posted to: [email protected][email protected][email protected]
arrow-up11.08Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid to TechnologyEnglish • 9 months agomessage-square199cross-posted to: [email protected][email protected][email protected]
minus-square@[email protected]linkfedilinkEnglish17•9 months agoWhat social contract? When sites regularly have a robots.txt that says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.
minus-square@[email protected]linkfedilinkEnglish17•9 months agoI had a one-eared rabbit. He was a monolopy.
minus-square@[email protected]linkfedilinkEnglish1•9 months agoI was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
minus-squareCosmic ClericlinkEnglish5•9 months ago When sites regularly have a robots.txt that says “only Google may crawl” Is that actually true? If so, why would they do that?
What social contract? When sites regularly have a
robots.txtthat says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.I had a one-eared rabbit. He was a monolopy.
Sounds like a Pal name lol
Only if its model is a Lopunny missing an ear
I was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
Is that actually true?
If so, why would they do that?