The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.
The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.
Yes and no, it’s not really as accurate, 1 - if the guy do not watch his keyboard at all. 2 - if the guy is watching a bit his keyboard but only to the approximate place of the letter and remember the position after. BUT this could be counter by training an AI to extrapolate the results to get something more precise
Seems like this was done by working out passwords based on figuring out where people were looking and gesturing, rather than looking directly at the keyboard.
As a person using an uncommon keyboard layout, I reckon this would make it harder to hack my typing.
IF I could even get such a layout on wherever VR system I would theoretically be using… 😬
just don’t input passwords while on call/streaming? anyway, looks like it’s easy to fix, just disable avatar eye movement mapping when inputing a password, also I doubt if it’s real vector of attack, more of a proof of concept maybe?
Asking because I’ve never had the experience: how does one write anything while wearing a VR set? Please don’t tell me it’s one-finger “Fliegender Adler” on a giant floaty image of a keyboard?
This would utterly kill the comfort, convenience, and speed of touch typing, would it not? Ahh, progress… Even in Minority Report they had (friggin’ sweet-looking!) keyboards alongside their fancy futuristic FAUI*.
Don’t if it’s a good idea or not but the solution is this case should be to have something like stars passwords or randomized eye movements. Artificial movements basically
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world
This is a most excellent place for technology news and articles.
Couldn’t you theoretically do the same thing by tracking someone’s eye movements on video chat, if they look at their keyboard while typing?
Yes and no, it’s not really as accurate, 1 - if the guy do not watch his keyboard at all. 2 - if the guy is watching a bit his keyboard but only to the approximate place of the letter and remember the position after. BUT this could be counter by training an AI to extrapolate the results to get something more precise
you’d have to move your eyes from letter to letter, like Vision Pro users
Maybe but I’m guessing most cameras don’t have as high of a res of your pupil?
New
fearworry unlocked…Seems like this was done by working out passwords based on figuring out where people were looking and gesturing, rather than looking directly at the keyboard.
As a person using an uncommon keyboard layout, I reckon this would make it harder to hack my typing.
IF I could even get such a layout on wherever VR system I would theoretically be using… 😬
just don’t input passwords while on call/streaming? anyway, looks like it’s easy to fix, just disable avatar eye movement mapping when inputing a password, also I doubt if it’s real vector of attack, more of a proof of concept maybe?
Asking because I’ve never had the experience: how does one write anything while wearing a VR set? Please don’t tell me it’s one-finger “Fliegender Adler” on a giant floaty image of a keyboard?
This would utterly kill the comfort, convenience, and speed of touch typing, would it not? Ahh, progress… Even in Minority Report they had (friggin’ sweet-looking!) keyboards alongside their fancy futuristic FAUI*.
^((* FAUI - flailing arms UI)^)
Don’t if it’s a good idea or not but the solution is this case should be to have something like stars passwords or randomized eye movements. Artificial movements basically