Apple Intelligence is coming to the company’s industry-leading accessibility tools, including upgraded vision, captions, and machine learning-enhanced mobility features.
To commemorate World Accessibility Awareness Day on May 21st, the tech giant announced a series of new AI-powered features for the Apple ecosystem, covering its most popular accessibility products including VoiceOver, Magnifier, Voice Control, and Reader.
Microsoft Teams no longer puts everyone in a virtual room. There is no longer a feeling of being “together”.
“Apple’s approach to accessibility is different, and now with Apple Intelligence, we’re introducing powerful new features to our accessibility capabilities while maintaining our fundamental commitment to privacy by design,” said CEO Tim Cook.
Upgraded access tools
Many of the new upgrades apply to Apple’s visual and voice control tools. These tools are designed for users who are visually impaired, visually impaired, and users with varying ranges of motion.
Image Explorer, part of Apple’s gesture-based screen reader known as VoiceOver, allows users to get a more detailed description of their device’s display and content. VoiceOver’s live recognition feature can be activated with your iPhone’s action button and respond to detailed follow-up questions.
mashable light speed
Credit: Apple
Rather than relying on memorizing specific commands or positions on the screen, iPhone and iPad users will now be able to use natural language commands to interact with their devices using on-device tools like voice controls and Magnifier. This means users can simply tell their device to “tap on the orange folder” or “zoom in on that word” and the device will respond. Apple calls it the power to “say what you see.”
A new way to caption your content
Apple’s AI can also automatically generate subtitles on-device for videos without captions, including content captured by Apple users on their devices, videos sent to users without captions, and even videos streamed.
The company’s Accessibility Reader tool has been upgraded to help users navigate complex texts such as scientific studies with columns, images, and tables, provide more on-demand summaries, and translate languages without changing custom formatting.
Apple Vision Pro for power wheelchair users
Last but not least, Apple is adding functionality to Apple Vision Pro that allows power wheelchair users to operate their mobility devices using only a virtual reality headset.
The company explained that the feature leverages the device’s eye tracking (a technology already used in alternative driving controls, device navigation, and communication tools for people with various disabilities), but requires less frequent adjustments than typical driving control devices. However, Apple still recommends that users only use the Apple Vision Pro headset in controlled environments, free of potential obstructions and inclement weather.
Credit: Apple
Additionally, Apple makes it easier to pair and hand off Made for iPhone hearing aids when switching devices, and to add a human ASL interpreter to ongoing FaceTime calls. Apple tvOS gains large text support for people with low vision, and name recognition is expanded to 50 languages.
Apple said the upgraded tools and features will be rolled out later this year. The company also said it will expand its collaborative Hikawa Grip & Stand line, a third-party accessibility accessory designed by artist Bailey Hikawa and released for a limited time last year.
