In a significant leap towards inclusivity, Apple has announced a suite of innovative accessibility updates designed to empower users with disabilities through the capabilities of Apple Intelligence. Among the standout features is the ability for Vision Pro users to control compatible wheelchairs using only their gaze, marking an unprecedented advance in assistive technology.
With the technology set to be showcased ahead of Google's highly anticipated annual developer conference, Apple’s new features include enhancements to existing tools like VoiceOver and real-time video captioning. The updated VoiceOver functionality now incorporates advanced image recognition, allowing it to provide detailed descriptions of various images, such as bills, photographs, and personal documents, thereby enriching user experience and independence.
The innovation doesn't stop there. Users can seamlessly activate the Live Recognition feature via their iPhones, which utilizes the camera to identify and describe content within their environment. Additionally, low-vision users are empowered to customize their experience further with high-contrast interfaces and intuitive voice commands, such as "zoom in" or "turn on flashlight." 
Apple's commitment to making technology more accessible extends to the Reader app, which has been refined to handle complex documents—such as scientific papers with multiple columns and images—while offering AI-generated summaries and the option to read text in various languages with customized visual settings. This enhancement is particularly beneficial for individuals with dyslexia and other visual impairments.
In a notable expansion of usability, Apple will also introduce AI-generated subtitles for videos lacking pre-existing captions. This feature will span multiple Apple devices, including the iPhone, iPad, Mac, Apple TV, and Vision Pro, allowing users to customize the appearance of subtitles according to their preferences.
Moreover, the highly anticipated wheelchair control feature is designed to function efficiently in varying lighting conditions, eliminating the need for recalibration. Initial partnerships with Tolt and LUCI alternative drive systems in the United States will support both Bluetooth and wired connections, significantly widening the accessibility landscape.
Apple's new feature set also includes enhancements to the name recognition feature, which now alerts users with hearing impairments when their name is spoken, supporting 50 languages. Additionally, future updates to tvOS will incorporate large text support, while Made for iPhone hearing aids will benefit from improved device handoff capabilities.
These groundbreaking features are slated for rollout later this year, likely coinciding with the launch of iOS 27, heralding a new era of accessibility in technology.
Source: TechCrunch
