The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.
  • noughtnautEnglish
    2•4 months ago

    Asking because I’ve never had the experience: how does one write anything while wearing a VR set? Please don’t tell me it’s one-finger “Fliegender Adler” on a giant floaty image of a keyboard?

    This would utterly kill the comfort, convenience, and speed of touch typing, would it not? Ahh, progress… Even in Minority Report they had (friggin’ sweet-looking!) keyboards alongside their fancy futuristic FAUI*.

    ^((* FAUI - flailing arms UI)^)

    • @[email protected]English
      2•4 months ago

      Flying Adler approach works and is the solution for noobs. Pros either use a real world keyboard or just look at the letter they want to type and snap 🫰 like this to type that letter. You can type pretty fast with the look’n’snap technic.

    • subignition
      1•4 months ago

      From the article:

      Your eyes are your mouse when using the Vision Pro. When typing, you look at a virtual keyboard that hovers around, and can be moved and resized. When you’re looking at the right letter, tapping two fingers together works as a click.

      So they were working backwards to determine the inputs based off of the observed eye motion.

      I have a much less modern VR headset and you can definitely still type on a regular keyboard while you’re wearing it. You can’t see the keyboard though, so you need to be skilled enough to touch type. I can’t find any reliable-looking statistics on it with a quick search, but it seems like that is not a very common skill

      • noughtnautEnglish
        2•4 months ago

        … Like what is not a very common skill? Touch typing in general? Or doing it under VR specifically?

        • The latter would be quite niche I suppose.
        • The former? I cry for the current and future generations. It really is not very hard to learn, realistic to master, and incredibly useful in daily (professional and personal) life.
        • subignition
          1•4 months ago

          Touch typing. Like I said I cannot find any reputable statistics. touchtypeit.co.uk claims “according to research” it’s less than 20%, but does not actually link any specific research. There are some other sites like it that are trying to sell you a product and list a low percentage, but I can’t find any actual studies or statistics

      • @[email protected]English
        1•4 months ago

        Vision pro renders the keyboard into your virtual environment, like it does with your arms/hands