Fake4000 to TechnologyEnglish • 1 year agoReddit started doing what they always wanted to do, sell user content to AI.www.reuters.commessage-square201arrow-up11.11Karrow-down115cross-posted to: technology
arrow-up11.09Karrow-down1external-linkReddit started doing what they always wanted to do, sell user content to AI.www.reuters.comFake4000 to TechnologyEnglish • 1 year agomessage-square201cross-posted to: technology
minus-square@[email protected]linkfedilinkEnglish6•1 year agoAfaik the OpenAI bot may choose to ignore it? At least that’s what another user claimed it does.
minus-squareJohnEdwalinkfedilinkEnglish12•1 year agoRobots.txt has been always ignored by some bots, it’s just a guideline originally meant to prevent excessive bandwidth usage by search indexing bots and is entirely voluntary. Archive.org bot for example has completely ignored it since 2017.
Afaik the OpenAI bot may choose to ignore it? At least that’s what another user claimed it does.
Robots.txt has been always ignored by some bots, it’s just a guideline originally meant to prevent excessive bandwidth usage by search indexing bots and is entirely voluntary.
Archive.org bot for example has completely ignored it since 2017.