• NeuronOP
      link
      fedilink
      English
      11 year ago

      Thanks! I’ll remember that trick for next time

      • TychoOrdo
        link
        fedilink
        21 year ago

        Works on a lot of news sites. I think they let web crawlers get the full text in order to improve their search ranking, however it also lets in crawlers with other purposes like archiving.