On May 19, Apple officially announced a series of new AI-assisted features powered by Apple Intelligence, and introduced a revolutionary eye-controlled wheelchair function through the Apple Vision Pro, marking a major breakthrough in its accessibility technology. This update deeply integrates edge-side artificial intelligence technology, upgrading multiple core accessibility features at the system level while ensuring user privacy.
Among them, the "VoiceOver" image browser uses AI to provide more detailed descriptions of visual images such as bills and photos, and allows users to ask multiple rounds of natural language questions about the content in the camera viewfinder using the "Action" button; the "Magnifier" also supports voice control and quick Q&A.
In terms of interaction logic, the new "Voice Control" introduces natural language recognition, freeing users from the previous need to memorize exact commands, allowing them to intuitively and precisely control screen controls with spoken descriptions. For text and media experiences, the smarter "Accessibility Reader" not only efficiently parses complex scientific documents with multiple columns and tables, but also adds on-demand summaries and built-in translation features; meanwhile, "Auto-Generated Subtitles" based on edge-side speech recognition achieves private real-time transcription for videos without subtitles across all platforms.
In terms of hardware integration, the Apple Vision Pro, with its high-precision eye-tracking system, has collaborated with Tolt and LUCI alternative drive systems to introduce an eye-controlled wheelchair function that does not require frequent calibration in the United States.
At a time when global tech giants are accelerating their AI arms race, Apple's move clearly shows that it is shifting the focus of AI applications from simple chatbots to more socially valuable system-level ecosystem empowerment. By deeply redefining the accessibility experience, Apple not only demonstrates its professional depth in advancing core technologies behind the scenes, but also signals that the upcoming WWDC26 will release more key insights into its artificial intelligence strategy.
