• kronisk
    link
    121 month ago

    Would this interfere with legitimate crawlers as well, the Internet Archive for instance?

    • @RememberTheApollo_
      link
      11 month ago

      Could you list specific crawlers to be automatically blocked by the iocaine site?