Can commodity products detect which pixel you’re looking at on a screen?

For a number of years, I’ve wanted a system that eliminates mouse pointer devices. In my imaginary system, there are hotkeys bound to left & right mouse clicks, and what gets clicked is whatever you’re looking at.

When I’ve looked at this before, the tech field tends to suffer in granularity and/or physical limitations, like needing to limit gross head movements. Most products talk about what they can do, but avoid talking about their limitations. It can be hard to find out what devices are capable of - accuracy, working with corrective eyewear, speed, head movement, software (OS) support, etc. Many products are geared at research, leading me to believe the tech isn’t there yet.

Anyone have, or used a device that would be able to replace a mouse?

  • @Num10ck
    link
    English
    47 months ago

    apples vision pro reportedly has it nailed down. meta occulus has been hacked where its reasonably good. in a controlled lab setting with substantial training i’ve read of desktop computers doing ok at it with dedicated hardware etc.

    what hardware/software/settings/training are you hoping for?

    • Daily desktop use; I’d like to eliminate the repetitive stress and time it takes to move my hands off the home row, use a pointing device, and re-acquire the home row.

      Also, I think Factorio would be fantastic if I could use both hands for hotkeys.

      Headsets are probably not going top work for what I’d like to accomplish; a remote bar-style (some look little more than web cams, although I can’t imagine how they track without wide-set binocular cameras) that doesn’t require wearing a device would be optimal.