A robust model-based approach for 3D head tracking in video sequences
- 7 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 169-174
- https://doi.org/10.1109/afgr.2000.840630
Abstract
We present a generic and robust method for model-based global 3D head pose estimation in monocular and non-calibrated video sequences. The proposed method relies on a 3D/2D matching between 2D image features estimated throughout the sequence and 3D object features of a generic head model. Specifically, it combines motion and texture features in an iterative optimization procedure based on the downhill simplex algorithm. A proper initialization of the pose parameters, based on a block matching procedure, is performed at each frame in order to take into account large amplitude motions. For the same reason, we have developed a nonlinear optical flow-based interpolation algorithm for increasing the frame rate. Experiments demonstrate that this method is stable over extended sequences including large head motions, occlusions, various head postures and lighting variations. The estimation accuracy is related to the head model, as established by using an ellipsoidal model and an ad hoc synthesized model. The proposed method is general enough to be applied to other tracking applications.Keywords
This publication has 6 references indexed in Scilit:
- Automatic adaptation of a face model using action units for semantic coding of videophone sequencesIEEE Transactions on Circuits and Systems for Video Technology, 1998
- Facial feature localization and adaptation of a generic face model for model-based codingSignal Processing: Image Communication, 1995
- Model-based image coding advanced video coding techniques for very low bit-rate applicationsProceedings of the IEEE, 1995
- 3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequencesIEEE Transactions on Circuits and Systems for Video Technology, 1994
- 3-D motion estimation in model-based facial image codingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- The 'orthogonal algorithm' for optical flow detection using dynamic programmingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1992