@fne8w2ah to TechnologyEnglish • 1 year agoThe Internet is not forever after all: CNET deletes old articles to game Googlearstechnica.comexternal-linkmessage-square23arrow-up1267arrow-down110cross-posted to: [email protected]
arrow-up1257arrow-down1external-linkThe Internet is not forever after all: CNET deletes old articles to game Googlearstechnica.com@fne8w2ah to TechnologyEnglish • 1 year agomessage-square23cross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish30•1 year ago Unfortunately, we are penalized by the modern Internet for leaving all previously published content live on our site Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?
Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?
That wouldn’t generate news hype
Removed by mod