• @running_ragged
    link
    English
    4112 days ago

    Google (used to) scrapes the specific details authorized by robots.txt and uses it to make your content visible.

    OpenAI scrapes everything it can technically see, ignoring robots.txt and feeds i to a black box and regurgitates it claiming it’s something new, that it deserves to be paid for.

    Quite different actually.

    • @[email protected]
      link
      fedilink
      English
      -2012 days ago

      So if OpenAI complies with Robots.txt files then there’s no issue right?

      Because then they’re identical. Open AI spent a bunch of money building a powerful system they feed those results to, as did Google.

      • @_bcron
        link
        English
        30
        edit-2
        12 days ago

        No, the issue is that anything AI creates is by definition derivative. Google doesn’t whip up generative content, it points you to content.

        OpenAI is claiming that they can’t do shit without scraping copyrighted works and we all know that’s a load of BS because we’re adrift in a sea of royalty-free text. Critical mass happened well over a decade ago. The amount of new random crap hosted on the internet in the past 30 days would probably take 500 years for one person to digest. Bear at a stream watching an impossibly large amount of salmon jumping

        • @Zarxrax
          link
          English
          812 days ago

          Actually Google tries their hardest NOT to point you to content. They scrape the data from sites and display it directly in the search results so that you don’t need to visit any site except Google. Their new AI answers that they are pushing on users are just another step in that direction.

          • @Z3k3
            link
            English
            912 days ago

            Which is why Google is no longer my default browser. I’d be quite happy if it reverted Back to don’t be evil or just ceased ro exist

        • @[email protected]
          link
          fedilink
          English
          -1712 days ago

          Literally every page Google shows you, where it also shows you those ads it makes money from, is Google’s content and it is derived from the data it gets scraping the web.

          • @grue
            link
            English
            1612 days ago

            What the fuck are you even talking about? Making a list of website identifiers (names and URLs) so that people can go to them isn’t even slightly the same as making a derived work of the websites’ contents.

              • @breadsmasher
                link
                English
                812 days ago

                ok thanks google ceo. please explain

                • @[email protected]
                  link
                  fedilink
                  English
                  -412 days ago

                  Google has to scrape and process the entire webpage and analyze the content to figure out which links to provide you. The end result of them presenting you with those links is from them copying and processing all your site’s data, including when you aren’t listed in the search results.

          • @_bcron
            link
            English
            13
            edit-2
            12 days ago

            No, anything Google shows you is kosher and totally symbiotic. A website being shown on Google is at the site owner’s discretion - if they allow search engines to crawl they get the benefit of exposure, and the search engine gets the benefit of having relevant hits and ad revenue and all that. Most sites want click-throughs so it’s usually in their best interest to let search engines list their sites.

            Google isn’t exploiting anyone, kinda the opposite, since site owners don’t pay for any ads or exposure (but that exposure has so much value that they’ll pay for SEO). Site owners can decline and Google abides. Anything on Google is on Google with consent.