When it snows (2024)

The project was developed in Unity and incorporates interactive 3D elements. An external weather API was connected to dynamically influence the visuals.

• Unity was used for development and interactivity.

• 3D modeling was used to create three traditional Ainu patterns.

• Weather API integration was used to adjust the density of visual elements based on snowfall in Hokkaido.

• Audio processing was implemented to extract Ainu greetings from existing recordings and integrate them into an interactive system.

1. Interactive Ainu Symbols

Three traditional Ainu patterns were modeled in 3D and placed randomly in the space. Clicking on these symbols triggers the playback of Ainu greetings, allowing users to hear the voices and language of the Ainu people. The symbols respond to sound input by expanding and contracting dynamically.

2. Totemistic Bear Visualization

The Ainu people historically practiced totemism, with the bear being a sacred animal. To represent this, I used particles to form a floating bear shape, resembling stars in the sky. The density of the bear’s shape changes dynamically based on real-time snowfall data from Hokkaido, reinforcing the connection between nature and Ainu beliefs.

3. Reactive Ainu Musical Strings

Ainu traditional instruments were visualized as virtual strings positioned at the bottom of the space. These strings react to music played on Ainu instruments, creating a real-time visualization of the sound. The vibration and movement of these strings reflect the characteristics of traditional Ainu music.

4. Sound and Memory Visualization

A key motivation for this project was the concept of visualizing sound as a way to preserve memories. Since sound is invisible, visual elements help represent fading cultural aspects, making them more tangible. The interactive symbols, reactive musical elements, and dynamic snowfall all contribute to reinforcing the presence of Ainu identity in the digital space.