We have paused all crawling as of Feb 6th, 2025 until we implement robots.txt support. Stats will not update during this period.

  • SwizzleStick
    link
    fedilink
    English
    116 hours ago

    It would be better if the server could detect bots and send them down a rabbit hole

    Already possible: Nepenthes.

    • Semi-Hemi-Lemmygod
      link
      English
      106 hours ago

      ANY SITE THIS SOFTWARE IS APPLIED TO WILL LIKELY DISAPPEAR FROM ALL SEARCH RESULTS.

      I’m sold