Thanks Accessibility — Sincerely Vision Pro
Apple has always been a strong advocate for ensuring that their products are built for everyone. Accessibility is integrated into everything they create, and they have developed tools and frameworks to help developers do the same. With each software and device update, Apple includes accessibility features to make the world more accessible to those who need it.
At the WWDC 2023, Apple finally took the stage to showcase the long-awaited headset. The set provided a glimpse into the future, with underlying magic that felt familiar to some.
Apple built Accessibility so that Accessibility could build the Vision Pro.
Hand Gestures
One notable feature of the Vision Pro, compared to other headsets, is the absence of handheld controllers. Instead, users interact with the headset using their hands and fingers to press, pinch, and swipe.
The recent introduction of Double Tap on the new Apple Series 9 watch, where users pinch two fingers together, is actually an accessibility functionality called AssistiveTouch that was released a few watchOS versions ago. (Many tech writers pointed this out when showcasing the “new” functionality.) The research conducted on the finger interaction accessibility feature paved the way for Double Tab on the Series 9. Which in turn helped in the development of the Vision Pro. Or did the development into the Vision Pro help the Watch 🤔, it’s easy to forget as a consumer how much time and development goes into something that seems magical when released.
In addition, we have all been swiping on our Apple products, even before the introduction of multi-touch, with the trackpad on the Mac. Therefore, the research and development of gestures in the air could only be possible due to the progress made in touch gestures over the years as well.
Eye Tracking
Eye Tracking is another key feature of the Vision Pro. It has an array of 16 cameras that track the user’s gaze, their hands, and the objects in front of them. Apple has supported eye tracking before, such as with the “Require Attention for Face ID” feature that requires users to look directly at the camera to confirm and unlock Face ID. Apple also has supported accessible eye tracking third-party technology since iOS 15, allowing users to use their eyes as a cursor to interact with the system. While Mac and iOS have had some third-party solutions, the Vision Pro integrates this feature for those who require it, while also benefiting others with the technology and research developed for accessibility first.
Sound Recognition
Apple has made significant progress in their accessibility features related to sound over the years. They have utilized data from various sources, including devices such as phones, headphones, and even HomePods. For example, many Apple devices can inform deaf individuals if they detect sounds like fire alarms or carbon monoxide alarms. Sound recognition also supports detecting door knocks, buzzing appliances, and even crying babies. These interactions may seem trivial to most people, but for someone who is deaf, being able to receive notifications about their surroundings can be life-changing.
The safety aspect of sound recognition becomes even more apparent when using the Vision Pro. In the keynote, Apple demonstrates wearing the headset and being immersed in a movie, the surrounding area is blacked out. Using accessibility sound recognition, everyone can be informed of a knock on the door or a fire alarm going off during a loud and intense scene.
Motion Sickness
There is already a huge backlog of accessibility features that Apple have support and just like every other system, the Vision Pro leverages them as well. These extensions allow users to control things like reduced animations or slower transitional effects. Which ironically, these already help mitigate against motion sickness. A common concern with all headsets and a feature already built into the devices operating system.
Years of data collection from accessibility software features and the use of real human data have contributed to the creation of the most personalized and user-friendly accessible product. The Vision Pro is the result of this extensive work, and it aligns with Apple’s continued commitment to accessibility.
For more references:
Help support me, by keeping me up all night and buying a coffee…
