shellsharksM to [email protected]English • 7 months agoWhat are You Working on Wednesdaymessage-square3fedilinkarrow-up15arrow-down11file-text
arrow-up14arrow-down1message-squareWhat are You Working on WednesdayshellsharksM to [email protected]English • 7 months agomessage-square3fedilinkfile-text
minus-square@[email protected]linkfedilinkEnglish3•7 months agoPrivate project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn’t find any recent/regularly updated stats on this.
Private project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn’t find any recent/regularly updated stats on this.