Arts Track

Seeing Aural - An Installation Transferring the Materials You Gaze to Sounds You Hear
Yi-Ching Huang, National Taiwan University, Taiwan
Kuan-Ying Wu, National Chiao-Tung University, Taiwan
Mon-Chu Chen, University of Madeira, Portugal
Time: Mon 10:30 - Wed 16:00 | Session: Arts Track | Location: Art, Demos and Posters Area

We present an audio installation allowing participants to create sounds by looking at different parts of surfaces or objects in various color and texture. By hacking a desktop eye tracker to track gaze points in 3D space, and deploying a webcam to pick up the hue, saturation and brightness of gazed material, we create an experimental musical instrument that can be played by eye gaze. Users have the freedom of choosing different raw materials and explore ways of seeing as a mean of self-expression to create a unique audio experience.

TEI 2014 Proceedings in the ACM Digital Library.

Keynote Speakers

Opening Keynote
Chris Harrison
The Rich-Touch Revolution is Coming
Closing Keynote
Eric Paulos
Hybrid Ecologies: New Stratagems for Computing Culture

Important Dates

ACM Logo
SIGCHI Logo
LMU Logo

Platinum Supporter

DFG Logo

Gold Supporter

Fujifilm Dimatix Logo
Ravensburger Logo
Visionair Logo

Silver Supporter

City of Munich Logo
Microsoft Research Logo
Tangible Display Logo