LAYERED MOTION AND GESTURE SONIFICATION IN AN INTERACTIVE INSTALLATION
LAYERED MOTION AND GESTURE SONIFICATION IN AN INTERACTIVE INSTALLATION
Author(s): Grigore Burloiu, Valentin Mihai, Stefan DamianSubject(s): Theatre, Dance, Performing Arts
Published by: Universitatea de Teatru si Film »I.L. Caragiale« (UNATC)
Keywords: sound installation; 3D; motion capture; SoundThimble;
Summary/Abstract: SoundThimble is an interactive sound installation based on the relationship between human motion and virtual objects in 3D space. A Vicon infrared motion capture system and custom software are used to track, interpret and sonify the movement and gestures of a performer relative to a virtual object. We define three possible interaction dynamics, centred around ob- ject search, manipulation and arrangement. We explore the resulting possibilities for layered structures and extended perception and expression, in internal tests as well as a public demo. Experimental evaluation reveals an average object search time of around 60s, as well as thresh- olding ranges for effective gesture spotting. The underlying software platform is open source and portable to similar hardware systems, leaving room for extension and variation.
Journal: Concept
- Issue Year: 2018
- Issue No: 1-2
- Page Range: 168-183
- Page Count: 16
- Language: Romanian