The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.

cross-posted from: https://lemmy.zip/post/22604748

The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.

Archived version: https://web.archive.org/web/20240912100207/https://www.wired.com/story/apple-vision-pro-persona-eye-tracking-spy-typing/

@AbouBenAdhem@lemmy.world
link
fedilink
English
4
edit-2
1M

Couldn’t you theoretically do the same thing by tracking someone’s eye movements on video chat, if they look at their keyboard while typing?

@TrickDacy@lemmy.world
link
fedilink
English
21M

Maybe but I’m guessing most cameras don’t have as high of a res of your pupil?

you’d have to move your eyes from letter to letter, like Vision Pro users

foremanguy
link
fedilink
English
11M

Yes and no, it’s not really as accurate, 1 - if the guy do not watch his keyboard at all. 2 - if the guy is watching a bit his keyboard but only to the approximate place of the letter and remember the position after. BUT this could be counter by training an AI to extrapolate the results to get something more precise

Create a post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


  • 1 user online
  • 175 users / day
  • 576 users / week
  • 1.37K users / month
  • 4.48K users / 6 months
  • 1 subscriber
  • 7.41K Posts
  • 84.7K Comments
  • Modlog