Synesthesia
- Institution
Media University Stuttgart - Year
2018 - Type
Interactive Installation - Software
VVVV - My Part
Concept
Media Technology Planing
Physical Prototyping
Implementation
This project is an interactive experience room which deals with
Synesthesia. Synesthesia is a perceptual phenomenon in which certain
imposes automatically and involuntarily trigger a second unrelated
sensory impression. It is awarded with renowned national and international
prizes and is the most successful installation of
the course “Event Media” ever.
The installation boasted several key elements, including a pressure-sensitive
LED panel on the ground, 2000 LED balls that formed three of the four walls,
and the central control unit known as the "Synesthesizer."
The elements are playing role in representing different forms of synesthesia.
The first form explored the correlation between shape and color. By stepping on specific
shapes on the LED panels, they would move outward and transform into vibrant colors
when reaching the walls. The second form depicted the correlation between
sound and hand movements. By moving their hands over designated areas, visitors would
trigger sound effects similar to playing a piano. In addition those movements creating
colorful patterns on the walls.
Within our group of eight individuals, I actively participated in the planning and design
phases. However, my main focus revolved around directing the programming and media control
aspects of the project. I was responsible for the development, design, and implementation of
the Synesthesizer, a process that involved intensive physical prototyping using various hand
tracking sensors. Additionally, I ensured a seamless interaction between the sensors, sound
effects, and color transformations.
