Xplore Museum: StorageChat Collection

StorageChat Collection is an AI-powered interactive museum learning support service that provides personalized responses to visitors' inquiries based on the National Museum of Modern and Contemporary Art’s (MMCA) collection. Unlike conventional chatbot systems, this project features a custom LLM (Large Language Model) trained specifically on MMCA’s collection data, enabling in-depth and contextually relevant interactions about artworks.

To begin the experience, visitors approach a tablet located in front of the media wall and select an artwork of interest. Once selected, the system presents related information, and users can ask any questions or explore suggested queries to gain deeper insights. Additionally, the system continuously recommends related artworks, encouraging visitors to further engage with MMCA’s collection and the broader world of contemporary art.

Group Project

My role: C#, Unity Developer

Team: 1 3D UX/UI Designer, 1 iOS Developer, 2 LLM Engineers

Technology & Tools

This project involved LLM development, Swift development, Unity development, and 3D design, integrating various AI-driven features such as Speech-to-Text (STT) and Text-to-Speech (TTS) for a seamless conversational experience.

Functions

1. Personalized AI Conversations

Visitors can freely ask questions about artworks, and the AI provides context-aware responses based on MMCA’s collection. Suggested questions allow for deeper exploration.

2. AI-Powered Artwork Selection

Users select an artwork through the tablet, and the system provides detailed descriptions and generates interactive discussions.

3. Continuous Artwork Recommendations

The AI suggests related artworks, keeping visitors engaged with MMCA’s collection and encouraging further exploration.

4. Voice-Enabled Interaction

With STT and TTS integration, visitors can have natural conversations with the AI, making the learning experience more immersive.

5. Media Wall & Tablet Synchronization

The selected artwork and conversation flow are displayed on the interactive media wall, enhancing the visual engagement of the exhibition space.

Page updated

Google Sites

Report abuse