Visual recognition of continuous hand postures
- 7 November 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 13 (4) , 983-994
- https://doi.org/10.1109/tnn.2002.1021898
Abstract
This paper describes GREFIT (Gesture REcognition based on FInger Tips), a neural network-based system which recognizes continuous hand postures from gray-level video images (posture capturing). Our approach yields a full identification of all finger joint angles (making, however, some assumptions about joint couplings to simplify computations). This allows a full reconstruction of the three-dimensional (3-D) hand shape, using an articulated hand model with 16 segments and 20 joint angles. GREFIT uses a two-stage approach to solve this task. In the first stage, a hierarchical system of artificial neural networks (ANNs) combined with a priori knowledge locates the two-dimensional (2-D) positions of the finger tips in the image. In the second stage, the 2-D position information is transformed by an ANN into an estimate of the 3-D configuration of an articulated hand model, which is also used for visualization. This model is designed according to the dimensions and movement possibilities of a natural human hand. The virtual hand imitates the user's hand to an remarkable accuracy and can follow postures from gray scale images at a frame rate of 10 Hz.Keywords
This publication has 19 references indexed in Scilit:
- Hand gesture estimation and model refinement using monocular camera-ambiguity limitation by inequality constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Model-based tracking of self-occluding articulated objectsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Visual interpretation of hand gestures for human-computer interaction: a reviewPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- An appearance-based approach to gesture-recognitionPublished by Springer Nature ,1997
- Rapid learning with parametrized self-organizing mapsNeurocomputing, 1996
- Model-based analysis of hand postureIEEE Computer Graphics and Applications, 1995
- Towards an American Sign Language interfaceArtificial Intelligence Review, 1994
- Parametrized Self-Organizing MapsPublished by Springer Nature ,1993
- The self-organizing mapProceedings of the IEEE, 1990
- Perception of American Sign Language in dynamic point-light displays.Journal of Experimental Psychology: Human Perception and Performance, 1981