At the recent Google I/O conference, Google and Volvo jointly announced an important collaboration: the AI assistant Gemini will be officially integrated with the external camera hardware of Volvo's upcoming all-electric SUV, the EX60. This move marks that Gemini is accelerating to acquire visual and mobility perception capabilities, and the deep integration of AI large models with smart car hardware has achieved a substantive breakthrough.

gemini, Google

This technological upgrade was made possible by Volvo's choice of vehicle operating system, which originally features Google's embedded in-vehicle system, Android Automotive OS. By accessing system-level permissions, Gemini can directly access the data stream from the vehicle's external cameras, thus achieving real-time perception and intelligent collaboration with the surrounding physical environment of the vehicle.

According to official plans, the first application scenario of this feature focuses on frequent parking challenges, where Gemini will accurately translate and interpret complex parking signs for owners. Building on this, Google outlines a more imaginative vision for in-vehicle AI: in the future, Gemini with visual perception capabilities will be able to actively identify road markings, interpret traffic signs, and conduct interactive Q&A about nearby landmarks or restaurants. The system can further combine context to proactively inform drivers about specific time limits for parking, permit requirements, and other restrictions in certain areas. Patrick Brady, Vice President of Google's Android Automotive division, stated that Gemini, by deepening its understanding of the driving environment, will significantly enhance driving convenience.

From an industry perspective, the combination of large models with in-vehicle cameras is upgrading traditional "co-pilot assistants" that rely on text or voice interaction into "AI in-car companions" with spatial perception capabilities, providing a new multimodal paradigm for the evolution of smart cabins.