Apple Enhances Accessibility with AI on iPhone and Vision Pro

Apple recently announced a series of accessibility updates for its devices, integrating artificial intelligence to enhance the user experience for people with disabilities. These improvements, unveiled ahead of Global Accessibility Awareness Day, aim to strengthen digital inclusion and access to technology for everyone. The updates concern several features, including VoiceOver, Magnifier, and video captions, and will be rolled out later this year. This initiative is part of a broader trend where companies like Google, Microsoft, and Amazon are also using AI to make their products more accessible.

VoiceOver and Magnifier: Enhanced Descriptions

Apple's VoiceOver and Magnifier features are receiving significant updates thanks to Apple Intelligence. VoiceOver, a screen reader, now offers more detailed descriptions for objects such as photographs, scanned invoices, and personal documents. This enhancement aims to help blind or visually impaired individuals navigate their devices more easily. Additionally, the Live Recognition feature allows users to quickly obtain information about their surroundings using their iPhone's camera. By simply pointing the camera at an object, users can ask follow-up questions to get additional details.

Magnifier, which helps visually impaired individuals zoom in and detect objects, now allows users to ask questions about what the camera sees. For example, by pointing the phone at a recipe, the user can inquire about how many servings it provides or how long it takes to cook, and the device will provide this information using large, high-contrast text.

Voice Control and Natural Language

Apple Intelligence also extends to Voice Control, which allows navigation on iPhone or iPad by voice. This feature now supports natural language, simplifying the selection of on-screen items without the need for a numbered grid. Users can simply say what they want to select, such as a specific file name or folder color. It is also possible to indicate to the device where to zoom by specifying which word or image to enlarge. Voice Control with Apple Intelligence will be available in English in the United States, Canada, the United Kingdom, and Australia.

Accessibility Reader and Video Captions

Apple's Accessibility Reader, launched last year, is becoming more customizable. This tool allows users to personalize text and adjust font, color, and spacing, making reading easier for certain individuals, such as those with low vision or dyslexia. Now, Accessibility Reader can handle more complex materials like scientific articles, which tend to format text into multiple columns alongside various images and tables. Users can also remove headers and page numbers for a simpler interface and generate summaries for a quick overview before diving into the content. Additionally, it is possible to translate text into the user's preferred language.

Automatically generated captions will be available for videos without subtitles, using on-device voice recognition to ensure privacy. These captions will appear in videos recorded from an iPhone, sent by friends and family, or streamed online. Users can customize elements like font and text background in the video playback menu or settings. The generated captions will be available in English in the United States and Canada.

Vision Pro and Wheelchair Control

Apple's Vision Pro introduces a wheelchair control feature via eye tracking, allowing users to steer their wheelchair without a joystick. This innovation is particularly useful for individuals with limited mobility. Eye tracking on Vision Pro does not require regular calibration and can function in a variety of lighting conditions. The feature will be compatible with alternative driving systems from Tolt Technologies and Luci in the United States, with support for Bluetooth and wired accessory connections. Apple states that it will work with developers to expand access to more wheelchairs.

Blair Casey, CEO of Team Gleason, stated: "Over the last decade, we have seen eye-controlled wheelchair systems evolve tremendously. Leveraging the eye-tracking capabilities of the Apple Vision Pro in this way is a significant step forward. Team Gleason is proud to support this initiative and looks forward to seeing the benefits it can bring to individuals using electric wheelchairs."

Expansion of the Hikawa Grip and Stand

Finally, Apple launched the Hikawa Phone Grip and Stand at the end of last year for the iPhone. This adaptive and ergonomic accessory was designed with the help of individuals with various disabilities, including those affecting dexterity, grip, and hand control. Now, as part of a collaboration between Hikawa and PopSockets, the accessory is available for sale worldwide for the first time, and in three new colors. It is available today on Apple's website.