Apple officially released the new Apple Intelligence today, featuring a completely restructured Siri AI. This new version of Siri has personal context understanding, broad world knowledge, screen content awareness, and more extensive system-level application operations. Starting today, it is available as an English beta with the 2027 system update, and next month it will expand to French, Japanese, Korean, Portuguese, and Spanish.

The most intuitive change in the Siri AI is "understanding you." With personal context understanding, it can find what you need from messages, emails, and photos: for example, if you ask about an activity suggested by a family member during a visit, Siri will look through the chat history for clues that the person wanted to bake a family recipe together, then retrieve the cooking steps from that relative's previous emails, and finally add the required ingredients to the shopping list reminder. System-level operations have also expanded permissions, allowing it to handle tasks like writing a letter from scratch or editing and sharing a set of photos. In the third-party ecosystem, it can now send messages via WhatsApp, play audiobooks on Audible, and soon it will be able to draft emails in Microsoft Outlook, search for homework in Notability, and add restaurant recommendations in Tripsy.

image.png

Screen awareness is another key feature. When browsing a favorite team's website, you can ask Siri to find all home games and directly add them to your calendar; combined with comprehensive world knowledge, it can provide accurate answers for checking scores, planning vacations, and finding local coffee shops in a new city. The activation methods have also been expanded: on iPhone, besides "Hey Siri," you can press the side button or swipe down from the Dynamic Island; on iPad and Mac, it is integrated into Spotlight, and by holding down Control and clicking, you can ask questions about images, files, or text on the screen; on Apple Vision Pro, it appears as a 3D visualization interface that can be placed anywhere in space, and by looking at it and speaking, you can activate it. The new dedicated Siri app uses iCloud private synchronization to continue conversations across devices, so you can start on an iPhone and continue on a Mac, iPad, Apple Watch, or Vision Pro.

image.png

Voice and visual capabilities have also been upgraded. The on-device model AFM Core Advanced brings a more expressive voice, allowing users to customize expressiveness and speed; speech recognition accuracy has significantly improved, automatically handling capitalization, punctuation, and formatting while speaking. Visual intelligence has expanded from iPhone to iPad, Mac, and Vision Pro: iPad integrates into the screenshot experience, Mac has dedicated keyboard shortcuts, Vision Pro allows you to ask questions by looking at physical objects, and iPhone adds a Siri mode in the Camera app, where seeing a music festival poster allows you to ask about the performance time and add it to your calendar.

The writing tool is now usable almost anywhere text can be input, quickly generating drafts from scratch or describing editing suggestions. While writing emails or messages, Siri can adapt to the punctuation and tone that fits each recipient's habits, and Apple Intelligence will automatically proofread across the system, covering most third-party applications. In daily use, photos now have spatial reconstruction, expansion, and stronger "cleaning" tools; Image Playground supports photo-realistic styles using a new generation of generative models on Private Cloud Compute, and in the future, it will identify AI-generated or edited images through SynthID. Safari can automatically organize tabs by theme, remind you of stock or price drops via Notify Me, and generate custom extensions based on descriptions. Calls now include contextual awareness, allowing it to proactively retrieve verification codes or reservation numbers. Calendar entries can be added or removed by speaking. Shortcuts can generate complex automations by describing needs. The Home app can understand related notifications as a single activity and search for clips across cameras.

This year, audio intelligence and health features will also be introduced. Apple Watch Series 12 and Ultra 4, powered by the S11 chip, bring sound recognition, real-time playback (double-tap the crown to display the last 15 seconds of conversation text), Siri Review (auto-generate conversation titles and highlights), and faster Shazam. Privacy is the foundation of these features: Secure Exclave hardware isolation compartments process audio and immediately delete it without creating or storing any recordings. Real-time playback will emit an audible prompt and display a full-screen animation and microphone indicator. Text fragments and summaries are end-to-end encrypted when synchronized via iCloud. The Health app has also been redesigned around Apple Intelligence, adding an "Insights" tab that transforms metrics like sleep and peak VO2max into personalized guidance.

In terms of architecture, the new Apple Foundation Models were custom-built in collaboration with Google and its Gemini models, running on both device and Private Cloud Compute servers. Siri calls core capabilities like Spotlight index and App Toolbox through the system orchestrator and is executed entirely on the device. Availability-wise, Apple Intelligence is included in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27, covering iPhone 16 and newer models, iPhone 15 Pro/Pro Max, iPad mini (A17 Pro), M1 and newer iPads, MacBook Neo, and M1 and newer Macs.

However, there are clear limitations: initially, Siri AI will not be available on iOS, iPadOS, and watchOS in the EU, and functions relying on it will also be absent; Apple states it is seeking a feasible path that balances privacy and security. During the period when Apple addresses relevant regulatory requirements, Siri AI and other new Apple Intelligence features will not be launched in China either. Additionally, server-side model-dependent functions are limited by daily quotas, and future paid expansion options will be available. Moreover, Siri AI is not available to users under 13 years old.