• NeuronOP
    link
    fedilink
    English
    12 years ago

    Thanks! I’ll remember that trick for next time

    • TychoOrdo
      link
      fedilink
      22 years ago

      Works on a lot of news sites. I think they let web crawlers get the full text in order to improve their search ranking, however it also lets in crawlers with other purposes like archiving.