Ircam - Centre Georges-Pompidou Équipe Analyse/Synthèse


Next: Sound in Hands - Up: ICMC'97 - Abstracts from Previous: A Multimedia environment for

A Gesture interface controlled by the oral cavity, by N. Orio

Abstract:

In this paper it is proposed a new gesture interface which reveals and maps postures of the oral cavity: the user has only to change the inner shape of the mouth. The interface puts a white noise inside the oral cavity and picks the filtered signal up with a system of two acoustical waveguides. The oral cavity filter parameters are estimated with an analysis of the recorded signal. Then the Principal Component Algorithm is used to extract independent parameters which are used for control. The interface needs a short training phase in which a new user assumes all the postures he/she wants to use for the control. Even if the interface was designed for musical application, it can be used also in other fields; for example as a mouse for people with disabilities, or as an aid tool in phonetics. A prototype of the interface was built. It gives a three-dimensional output value, on a MIDI device, every 0.1 seconds.


* CSC, Università di Padova, Italy


Marcelo Wanderley
Thu Jan 22 16:18:30 MET 1998