Robust 3D head tracking under partial occlusion
- 7 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 176-182
- https://doi.org/10.1109/afgr.2000.840631
Abstract
This paper describes a novel system for 3D head tracking under partial occlusion from 2D monocular image sequences. In this system, The Extended Superquadric (ESQ) is used to generate a geometric 3D face model in order to reduce the shape ambiguity. Optical flow is then employed with this model to estimate the 3D rigid motion. To deal with occlusion, a new motion segmentation algorithm using motion residual error analysis is developed. The occluded areas are successfully detected and discarded as noise by the system. Also, a new post-regularization process based on edge flow heavily reduces accumulation error. This makes the system more stable over long occlusion image sequences. To show the accuracy, the system is applied on a synthetic occlusion sequence and comparisons with the ground truth are reported. To show the robustness, experiments on long occlusion image sequences, including synthetic and real ones, are reported.Keywords
This publication has 11 references indexed in Scilit:
- Fast, reliable head tracking under varying illuminationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Head tracking via robust registration in texture map imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Parametrized structure from motion for 3D adaptive feedback tracking of facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- LAFTER: lips and face real time trackerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The integration of optical flow and deformable models with applications to human face shape and motion estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Motion regularization for model-based head trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Computing spatio-temporal representations of human facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Visually controlled graphicsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Edge-based 3-D camera motion estimation with application to video codingIEEE Transactions on Image Processing, 1993