A real-time head nod and shake detector
- 15 November 2001
- proceedings article
- Published by Association for Computing Machinery (ACM)
Abstract
Head nods and head shakes are non-verbal gestures used often to communicate intent, emotion and to perform conversational functions. We describe a vision-based system that detects head nods and head shakes in real time and can act as a useful and basic interface to a machine. We use an infrared sensitive camera equipped with infrared LEDs to track pupils. The directions of head movements, determined using the position of pupils, are used as observations by a discrete Hidden Markov Model (HMM) based pattern analyzer to detect when a head nod/shake occurs. The system is trained and tested on natural data from ten users gathered in the presence of varied lighting and varied facial expressions. The system as described achieves a real time recognition accuracy of 78.46% on the test dataset.Keywords
This publication has 6 references indexed in Scilit:
- Detecting and tracking eyes by using their physiological properties, dynamics, and appearancePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Embodied Conversational AgentsPublished by MIT Press ,2000
- Neural network-based face detectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- Feature extraction from faces using deformable templatesInternational Journal of Computer Vision, 1992
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- The expression of the emotions in man and animals.Published by American Psychological Association (APA) ,1872