Eye Tracking is coming to iOS/iPadOS as accessibility feature!

kirmesteggno

Powered by artificial intelligence, Eye Tracking gives users a built-in option for navigating iPad and iPhone with just their eyes. Designed for users with physical disabilities, Eye Tracking uses the front-facing camera to set up and calibrate in seconds, and with on-device machine learning, all data used to set up and control this feature is kept securely on device, and isn’t shared with Apple.

Eye Tracking works across iPadOS and iOS apps, and doesn’t require additional hardware or accessories. With Eye Tracking, users can navigate through the elements of an app and use Dwell Control to activate each element, accessing additional functions such as physical buttons, swipes, and other gestures solely with their eyes.

https://www.apple.com/newsroom/2024/05/apple-announces-new-accessibility-features-including-eye-tracking/

This could be a game changer for controlling virtual gear when the thing you look at is selected for input. Potentially great for one knob midi controllers and similar!

Tarekith

Huh, will you look at that, amazing.

HolyMoses

@kirmesteggno said:

Powered by artificial intelligence, Eye Tracking gives users a built-in option for navigating iPad and iPhone with just their eyes. Designed for users with physical disabilities, Eye Tracking uses the front-facing camera to set up and calibrate in seconds, and with on-device machine learning, all data used to set up and control this feature is kept securely on device, and isn’t shared with Apple.

Eye Tracking works across iPadOS and iOS apps, and doesn’t require additional hardware or accessories. With Eye Tracking, users can navigate through the elements of an app and use Dwell Control to activate each element, accessing additional functions such as physical buttons, swipes, and other gestures solely with their eyes.

https://www.apple.com/newsroom/2024/05/apple-announces-new-accessibility-features-including-eye-tracking/

This could be a game changer for controlling virtual gear when the thing you look at is selected for input. Potentially great for one knob midi controllers and similar!

Instead of rolling the dials, we will roll our eyes!

reasOne

@HolyMoses said:

@kirmesteggno said:

Powered by artificial intelligence, Eye Tracking gives users a built-in option for navigating iPad and iPhone with just their eyes. Designed for users with physical disabilities, Eye Tracking uses the front-facing camera to set up and calibrate in seconds, and with on-device machine learning, all data used to set up and control this feature is kept securely on device, and isn’t shared with Apple.

Eye Tracking works across iPadOS and iOS apps, and doesn’t require additional hardware or accessories. With Eye Tracking, users can navigate through the elements of an app and use Dwell Control to activate each element, accessing additional functions such as physical buttons, swipes, and other gestures solely with their eyes.

https://www.apple.com/newsroom/2024/05/apple-announces-new-accessibility-features-including-eye-tracking/

This could be a game changer for controlling virtual gear when the thing you look at is selected for input. Potentially great for one knob midi controllers and similar!

Instead of rolling the dials, we will roll our eyes!

I already do that anyway 🤣

kirmesteggno

@reasOne said:

@HolyMoses said:

@kirmesteggno said:

Powered by artificial intelligence, Eye Tracking gives users a built-in option for navigating iPad and iPhone with just their eyes. Designed for users with physical disabilities, Eye Tracking uses the front-facing camera to set up and calibrate in seconds, and with on-device machine learning, all data used to set up and control this feature is kept securely on device, and isn’t shared with Apple.

Eye Tracking works across iPadOS and iOS apps, and doesn’t require additional hardware or accessories. With Eye Tracking, users can navigate through the elements of an app and use Dwell Control to activate each element, accessing additional functions such as physical buttons, swipes, and other gestures solely with their eyes.

https://www.apple.com/newsroom/2024/05/apple-announces-new-accessibility-features-including-eye-tracking/

This could be a game changer for controlling virtual gear when the thing you look at is selected for input. Potentially great for one knob midi controllers and similar!

Instead of rolling the dials, we will roll our eyes!

I already do that anyway 🤣

Haha yeah you won't move knobs or faders with your eyes, just select stuff. Vision pro users seem to like it, if it works it shouldn't stress the eyes beyond of normal screen use.

realdawei

This is no doubt the beginning of minority-report like flat screens from Apple

michael_m

@realdawei said:
This is no doubt the beginning of minority-report like flat screens from Apple

Or we’ll all end up being Stephen Hawking.