@fne8w2ah@lemmy.world to Technology@lemmy.worldEnglish • 2 years agoThe Internet is not forever after all: CNET deletes old articles to game Googlearstechnica.comexternal-linkmessage-square24fedilinkarrow-up1253cross-posted to: technology@beehaw.org
arrow-up1253external-linkThe Internet is not forever after all: CNET deletes old articles to game Googlearstechnica.com@fne8w2ah@lemmy.world to Technology@lemmy.worldEnglish • 2 years agomessage-square24fedilinkcross-posted to: technology@beehaw.org
minus-square@skankhunt42@lemmy.calinkfedilinkEnglish30•2 years ago Unfortunately, we are penalized by the modern Internet for leaving all previously published content live on our site Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?
Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?
That wouldn’t generate news hype
Removed by mod