Real-time input of 3D pose and gestures of a user's hand and its applications for HCI
- 13 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 18, 79-86
- https://doi.org/10.1109/vr.2001.913773
Abstract
In this paper, we introduce a method for tracking a user's hand in 3D and recognizing the hand's gesture in real-time without the use of any invasive devices attached to the hand. Our method uses multiple cameras for determining the position and orientation of a user's hand moving freely in a 3D space. In addition,the method identifies predetermined gestures in a fast and robust manner by using a neural network which has been properly trained beforehand. This paper also describes results of user study of our proposed method and its application for several types of applications, including 3D object handling for a desktop system and 3D walk-through for a large immersive display system.Keywords
This publication has 16 references indexed in Scilit:
- Shadow gestures: 3D hand pose estimation using a single cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Perceptual user interfaces (introduction)Communications of the ACM, 2000
- GestureComputer – History, Design and ApplicationsPublished by Cambridge University Press (CUP) ,1998
- A kinetic and 3D image input devicePublished by Association for Computing Machinery (ACM) ,1998
- Computer vision for interactive computer graphicsIEEE Computer Graphics and Applications, 1998
- Visual interpretation of hand gestures for human-computer interaction: a reviewPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- A survey of glove-based inputIEEE Computer Graphics and Applications, 1994
- Visual tracking of high DOF articulated structures: An application to human hand trackingPublished by Springer Nature ,1994
- A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lensesIEEE Journal on Robotics and Automation, 1987
- Direct Manipulation: A Step Beyond Programming LanguagesComputer, 1983