• @MrMcGasion
    link
    English
    376 months ago

    Meanwhile, their robots.txt doesn’t disallow GPTBot or Google Bard. So apparently they’re okay with content being stolen by for-profit companies.

    • strawberry
      link
      fedilink
      216 months ago

      you think either of those companies pays attention to robots.txt? its not legally binding or anythjng

      • @MrMcGasion
        link
        English
        86 months ago

        At the executive level, no I don’t think they care or pay attention, but considering both have said “here’s how to block our crawler,” I do hope that that some mistreated developer did actually program a check in to the crawler. I still think it’s worth doing, even though I don’t fully trust them.

    • @VubDapple
      link
      English
      56 months ago

      I feel sorry for the guy now. He’s in over his head and trying to defend himself ineffectively. And now a bunch of lemmings are mocking him too, which I get, but it’s still fucked up. Humans suck.

      • @EmeraldOP
        link
        English
        66 months ago

        i don’t feel bad dunking on this guys site. doing this is a dick move for accessibility reasons

      • @MrMcGasion
        link
        English
        56 months ago

        Yeah, based on his robots.txt it seems to be a Wordpress site, so he’s probably just installed an ineffective plugin to prevent copying. At least he can take solace in the fact that most of us probably aren’t any more relevant than he is.