Integrated face and gait recognition from multiple views
- 25 August 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (10636919)
- https://doi.org/10.1109/cvpr.2001.990508
Abstract
We develop a view-normalization approach to multi-view face and gait recognition. An image-based visual hull (IBVH) is computed from a set of monocular views and used to render virtual views for tracking and recognition. We determine canonical viewpoints by examining the 3D structure, appearance (texture), and motion of the moving person. For optimal face recognition, we place virtual cameras to capture frontal face appearance; for gait recognition we place virtual cameras to capture a side-view of the person. Multiple cameras can be rendered simultaneously, and camera position is dynamically updated as the person moves through the workspace. Image sequences from each canonical view are passed to an unmodified face or gait recognition algorithm. We show that our approach provides greater recognition accuracy than is obtained using the unnormalized input sequences, and that integrated face and gait recognition provides improved performance over either modality alone. Canonical view estimation, rendering, and recognition have been efficiently implemented and can run at near real-time speeds.Keywords
This publication has 16 references indexed in Scilit:
- Low level recognition of human motion (or how to get your man without finding his body parts)Published by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Photorealistic scene reconstruction by voxel coloringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Image-based visual hullsPublished by Association for Computing Machinery (ACM) ,2000
- A theory of shape by space carvingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Face recognition by elastic bunch graph matchingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- The visual hull concept for silhouette-based image understandingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- View-based and modular eigenspaces for face recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Analyzing and recognizing walking figures in XYTPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Deformable Templates for Face RecognitionJournal of Cognitive Neuroscience, 1991