• @Aeri
      link
      665 months ago

      oh no, Reddit is like, the only way to have google still be useful.

      • @[email protected]
        link
        fedilink
        545 months ago

        Funnily enough, google is also the only way to have Reddit be useful.

        Their own search function has been nothing but garbage.

      • @[email protected]
        link
        fedilink
        435 months ago

        That’s the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine

        • vortic
          link
          275 months ago

          Tell me that there is an anti trust suit over this.

          • FurblandOP
            link
            265 months ago

            There’s a suit over google in general so this may well be part of it

        • @TriflingToad
          link
          35 months ago

          really? ddg will show me reddit links, did they have to make a webscraper or something

      • @riodoro1
        link
        315 months ago

        We fucked the internet. It’s proprietary now.

        • FurblandOP
          link
          15 months ago

          That’s bad news, that means the internet is dying

    • FurblandOP
      link
      95 months ago

      Perhaps, likely depends on the crawler though

      • @[email protected]
        link
        fedilink
        125 months ago

        Yeah i dont think ignoring robots.txt is even illegal. They can ofcourse just block your crawlers IP but that would be a cat and mouse game that they would lose in the end.