lemmyreader@lemmy.ml to Security@lemmy.mlEnglish · 1 year agoAmazon storing classified US government documents improperlylemmy.mlimagemessage-square68linkfedilinkarrow-up1508arrow-down125file-text
arrow-up1483arrow-down1imageAmazon storing classified US government documents improperlylemmy.mllemmyreader@lemmy.ml to Security@lemmy.mlEnglish · 1 year agomessage-square68linkfedilinkfile-text
minus-squareAmbiguousProps@lemmy.todaylinkfedilinkEnglisharrow-up7·1 year agorobots.txt doesn’t have to be followed. It doesn’t block crawling.
robots.txt doesn’t have to be followed. It doesn’t block crawling.