According to AIbase, ByteDance's AI assistant "Doubao" has recently formed a strategic partnership with the Pudong Art Museum in Shanghai, officially becoming the official AI tour guide for two major international exhibitions: "The Wonder of Patterns: Masterpieces of Art from the Louvre in India, Iran, and the Ottoman Empire" and "Very Picasso: A New Perspective by Paul Smith." This is the first time an AI product has officially participated in the museum tour scenario, marking the deep implementation of the "AI + Art" experience.

Doubao, Grace, ByteDance

First video call tour, solving the "face blindness" problem

This collaboration significantly improved the model's accuracy in identifying artworks through exclusive data integration and targeted search optimization. During the exhibition, visitors can simply use Doubao App's "video call" or photo function to get multidimensional interpretations including art style, historical background, and cultural significance. For artifacts with highly similar appearances (such as a 15th-century Persian peony-patterned plate and Ming blue-and-white porcelain), Doubao can accurately distinguish them based on details. In addition, the system also provides two interpretation styles: "general" and "family-friendly," which can accurately respond even to quiet questions, meeting the needs of different groups of visitors.

From "one-way delivery" to "empathetic dialogue"

At the launch event, Zhu Jun, Vice President of ByteDance, and veteran media host Chen Luyu discussed the deeper value of AI-led tours. Zhu Jun emphasized that the essence of AI interaction with users is the experience of dialogue. Doubao not only provides knowledge but also aims to engage the audience's personal perception and experience through empathetic questions and thought-provoking conversations, turning art appreciation into a more participatory two-way interaction.

Continuously deepening digitalization in cultural relics and museums

This collaboration with the Pudong Art Museum is not Doubao's first attempt in the field of cultural relics and museums. Previously, Doubao has collaborated with seven national-level museums, including the National Museum of China and Nanjing Museum, to create digital experience areas. Becoming an official tour guide is another important verification of its technical application capability in complex offline scenarios.