Back
I See what you hear
Royal Danish Academy
The project is an interactive installation that explores the connection between sound and space, creating an immersive and dynamic environment. The sounds produced by users generate 3D clouds of matter that shift based on interaction.
“I See What You Hear” is an innovative exploration that transforms sounds produced by users, such as speaking, singing, or clapping, into clouds of 3D matter, like insects, fish, and leaves, which continuously change based on interaction. The goal is to highlight the connection between all the senses. This project was conceived to make hearing visible: it allows anyone to perceive and better understand sounds through sight, stimulating reflection on inclusivity and sensory perception. By using advanced graphic and visual techniques for its time, the project creates a new way of experiencing information, promoting accessibility for everyone and challenging traditional sensory boundaries.
Like a snowstorm, space is a condition rather than a limitation, defined by the quality and deliberations of the interaction.
As users learn to control the parameters of interaction, they learn to generate spaces of singular objects or mix together different objects of choice. The environment is presented stereoscopically, allowing the user to be placed within the spatial density.