• NeuronOP
    link
    fedilink
    English
    11 year ago

    Thanks! I’ll remember that trick for next time

    • TychoOrdo
      link
      fedilink
      21 year ago

      Works on a lot of news sites. I think they let web crawlers get the full text in order to improve their search ranking, however it also lets in crawlers with other purposes like archiving.