3D hand pose reconstruction using specialized mappings
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 378-385
- https://doi.org/10.1109/iccv.2001.937543
Abstract
A system for recovering 3D hand pose from monocular color sequences is proposed. The system employs a non-linear supervised learning framework, the specialized mappings architecture (SMA), to map image features to likely 3D hand poses. The SMA's fundamental components are a set of specialized forward mapping functions, and a single feedback matching function. The forward functions are estimated directly from training data, which in our case are examples of hand joint configurations and their corresponding visual features. The joint angle data in the training set is obtained via a CyberGlove, a glove with 22 sensors that monitor the angular motions of the palm and fingers. In training, the visual features are generated using a computer graphics module that renders the hand from arbitrary viewpoints given the 22 joint angles. The viewpoint is encoded by two real values, therefore 24 real values represent a hand pose. We test our system both on synthetic sequences and on sequences taken with a color camera. The system automatically detects and tracks both bands of the user, calculates the appropriate features, and estimates the 3D hand joint angles and viewpoint from those features. Results are encouraging given the complexity of the task.Keywords
This publication has 22 references indexed in Scilit:
- Statistical color models with application to skin detectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Multiple-hand-gesture tracking using multiple camerasPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Towards 3D hand tracking using a deformable modelPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Hand gesture estimation and model refinement using monocular camera-ambiguity limitation by inequality constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A method for recognizing a sequence of sign language words represented in a Japanese sign language sentencePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Estimation and prediction of evolving color distributions for skin segmentation under varying illuminationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Towards detection of human motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Real-time American sign language recognition using desk and wearable computer based videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- A Hierarchical Community of ExpertsPublished by Springer Nature ,1998
- Hierarchical Mixtures of Experts and the EM AlgorithmNeural Computation, 1994