• rip_art_bell
    link
    fedilink
    arrow-up
    13
    ·
    2 years ago

    From what I understand, web crawlers see a totally different version of the site than users do

    • TeamDman
      link
      fedilink
      arrow-up
      13
      arrow-down
      1
      ·
      2 years ago

      Only due to using a different user agent, it’s totally possible to build a for-the-people pagerank that would see what we see and deprioritize stuff like ads and fluff on recipe pages

      • rip_art_bell
        link
        fedilink
        arrow-up
        2
        arrow-down
        14
        ·
        2 years ago

        it’s totally possible to build a for-the-people pagerank that would see what we see and deprioritize stuff like ads and fluff on recipe pages

        Why haven’t you built it then?