Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they’re a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues’ new research, available as a pre-print paper, focuses on Google’s ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an “invisible” reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low “human” confidence rating.

  • @[email protected]
    link
    fedilink
    English
    38
    edit-2
    2 hours ago

    This is actually a good sign for self driving. Google was using this data as a training set for Waymo. If AI is accurately identifying vehicles and traffic markings, it should be able to process interactions with them easier.

    • @[email protected]
      link
      fedilink
      English
      272 hours ago

      As I understand it, the point of those captchas was never really “bots can’t identify these things” (though you’re right on that it was used to train). They use cursor movement, clicks, and other behaviours while you’re solving it to detect if you are a bot or not.

      • @Grimy
        link
        English
        317 minutes ago

        The image choosing was always just to train their own bots

      • @[email protected]
        link
        fedilink
        English
        4
        edit-2
        1 hour ago

        Its never been confirmed by Google, so I may be wrong. It still tracks that the data harvesting company with a AI self driving car project would use free human labor to identify road hazards.

        • Arthur Besse
          link
          fedilink
          English
          -2
          edit-2
          50 minutes ago

          I was referring to the “This is actually a good sign for self driving” part of their comment.

          The captcha circumvention arms race has been going on for over two decades, and every new type of captcha has and will continue to be broken as soon as it’s widely deployed enough that someone is motivated to spend the time to.

          So, the notion that an academic paper about breaking the current generation of traffic-related captchas (something which the captcha solving industry has been doing for years with a pretty high success rate already) is “good news” for the autonomous vehicle industry (who has also been able to identify such objects well enough to continue existing and getting more regulatory approval for years now) is…

          fry not sure meme template, no text

          • @[email protected]
            link
            fedilink
            English
            8
            edit-2
            47 minutes ago

            Not really. I’m not even sure what you’re disagreeing with based on the above comment.

            My point is that if bog standard AI can accurately identify all of the road information from pictures, that is good news for self driving.

            What was once a nearly impossible task for computers is now mundane, and can be used to improve safety/utility for self driving, especially for FOSS projects like comma.ai

    • @[email protected]
      link
      fedilink
      English
      059 minutes ago

      Afaik this is precisely what the captcha data was intended for - training AI models. Originally leveraged machine learning. LLMs are a slightly different paradigm but same purpose and results here.

  • @samus12345
    link
    English
    101 hour ago

    So can we stop using those damn things? They’re super annoying!

    • ohellidk
      link
      fedilink
      English
      251 minutes ago

      I’m kind of hoping the AI permanently beats them. I hate them too.

  • @TommySoda
    link
    English
    61 hour ago

    I mean, we literally train them by completing the CAPTCHAs. Why do you think you were picking things like bikes, traffic lights, cars, and busses? The only question now is what’s next…

      • @sensiblepuffin
        link
        English
        13 minutes ago

        In order to pay your utility bill, you have to beat the Undertale Sans fight in Genocide mode

  • Yer Ma
    link
    fedilink
    English
    101 hour ago

    But, I cannot pass those 50% of the time… what does that mean?

    • @hOrni
      link
      English
      41 hour ago

      Ever watched Bladerunner?

    • Odigo2020
      link
      fedilink
      English
      258 minutes ago

      It means Rick Deckard won’t be coming for you any time soon.

  • the post of tom joad
    link
    fedilink
    English
    4
    edit-2
    1 hour ago

    Thank God this means i can stop wondering if i should click on the… the 13 pixels from the fucking bike in that one corner square or wondering if i should count the scooter as a motorcycle fuck i am so tired of that shit

  • XNX
    link
    fedilink
    English
    125 minutes ago

    Unless this was something people could use i dont rly see it becoming much of a problem. Most people dont even use adblockers

  • @[email protected]
    link
    fedilink
    English
    22
    edit-2
    2 hours ago

    Wait, so if a visitor fails the v3 Captcha, v2 is used as a fallback?
    That makes absolutely no sense.

    • @[email protected]
      link
      fedilink
      English
      152 hours ago

      Not quite: it’ll drop a v2 captcha for you to solve when a v3 one can’t clearly classify you one way or another.

      So if v3 isn’t entirely sure you’re human, it’ll make you do a v2.

      • @NateNate60
        link
        English
        102 hours ago

        And if you fail the V2, it’ll just take your word on it and let you pass anyway.

  • @hOrni
    link
    English
    21 hour ago

    Great, so now can I get an add-on to my browser that skips these?

    • Sabata
      link
      fedilink
      English
      4
      edit-2
      59 minutes ago

      As someone who can not decide if 3 pixels of a motorcycle counts as a correct square, I need this add on.