A framework for motion recognition with applications to American sign language and gait recognition
- 11 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Human motion recognition has many important applications, such as improved human-computer interaction and surveillance. A big problem that plagues this research area is that human movements can be very complex. Managing this complexity is difficult. We turn to American sign language (ASL) recognition to identify general methods that reduce the complexity of human motion recognition. We present a framework for continuous 3D ASL recognition based on linguistic principles, especially the phonology of ASL. This framework is based on parallel hidden Markov models (HMMs), which are able to capture both the sequential and the simultaneous aspects of the language. Each HMM is based on a single phoneme of ASL. Because the phonemes are limited in number, as opposed to the virtually unlimited number of signs that can be composed from them, we expect this framework to scale well to larger applications. We then demonstrate the general applicability of this framework to other human motion recognition tasks by extending it to gait recognition.Keywords
This publication has 11 references indexed in Scilit:
- A real-time continuous gesture recognition system for sign languagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methodsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Coupled hidden Markov models for complex action recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Framework for Recognizing the Simultaneous Aspects of American Sign LanguageComputer Vision and Image Understanding, 2001
- Real-time American sign language recognition using desk and wearable computer based videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- Factorial Hidden Markov ModelsMachine Learning, 1997
- Kinematic determinants of human locomotion.The Journal of Physiology, 1996
- Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Isolated ASL sign recognition system for deaf personsIEEE Transactions on Rehabilitation Engineering, 1995
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989