Similar vibes than Reddit api pricing

  • @CheeseNoodle
    link
    English
    32 months ago

    Is it illegal to scrape? I mean most companies and governments scrape huge amounts of data all the time without getting anyones permission, hell the entire business of a search engine is basically WeScrape4U.

    • @lemonskate
      link
      English
      62 months ago

      If you extract a key from a proprietary client to decrypt a private API, it definitely is illegal. If you do this as a corporation, it would also be easy to detect by abnormal usage patterns tied to your account and presents you as a nice big set of pockets to get sued.

      Just screen scraping isn’t illegal, but is fragile as fuck and will break at the worst time and you have no ability to implement version control to manage it.

      • @[email protected]
        link
        fedilink
        English
        22 months ago

        Personally I wouldn’t want to be the guy forced to write scrapers with how much they break on any modern site