• @SzethFriendOfNimi
    link
    227 months ago

    Probably what they’re targeting. Such as sites like safereddit, etc.

    • @rockSlayer
      link
      387 months ago

      Well that’s part of the thing. Web scraping doesn’t get covered by policies. Like, they could ban your ip or any accounts you have, but web scraping itself will always be acceptable. It’s why projects like NewPipe and Invidious don’t care about YouTube cease and desist letters.

      • @werefreeatlast
        link
        37 months ago

        Oops look like this community hasn’t been reviewed. Login if you still want to see the content.

        • @rockSlayer
          link
          37 months ago

          Yea, I’ve seen those pop-ups when trying to find something out. It sucks but isn’t a significant barrier to web scraping

          • @werefreeatlast
            link
            17 months ago

            I tried that on my desktop. So long as you are not actually logged in you cannot see the communities that are too small for a review or too adult after a review.

        • folkrav
          link
          fedilink
          17 months ago

          Parsing absolutely comes with a lot more overhead. Especially since many websites integrate a lot of JS interactivity nowadays, you oftentimes don’t get the full contents you’re looking for straight out of the HTML you’re getting out of your HTTP request, depending on the site.

        • @[email protected]
          link
          fedilink
          English
          17 months ago

          In what way?

          HTML definitely provides more overhead than json if you only care about the data.

    • @[email protected]
      link
      fedilink
      English
      97 months ago

      Still waiting for the news that they took down old.reddit. Without the third party apps, that was the only way it could still be usable.