Mouthbrush
- 5 November 2003
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 277-280
- https://doi.org/10.1145/958432.958482
Abstract
We present a novel multimodal interface which permits users to draw or paint using coordinated gestures of hand and mouth. A headworn camera captures an image of the mouth and the mouth cavity region is extracted by Fisher discriminant analysis of the pixel colour information. A normalized area parameter is read by a drawing or painting program to allow read-time gestural control of pen/brush parameters by mouth gesture while sketching with a digital pen/tablet. A new performance task, the Radius Control Task, is proposed as a means of systematic evaluation of performance of the interface. Data from preliminary experiments show that with some practice users can achieve single pixel radius control with ease. A trial of the system by a professional artist shows that it is ready for use as a novel tool for creative artistic expression.Keywords
This publication has 3 references indexed in Scilit:
- Facing the musicPublished by Association for Computing Machinery (ACM) ,2001
- Automatic analysis of facial expressions: the state of the artPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- An isometric tongue pointing devicePublished by Association for Computing Machinery (ACM) ,1997