Resynthesizing facial animation through 3D model-based tracking
- 1 January 1999
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 143-150 vol.1
- https://doi.org/10.1109/iccv.1999.791210
Abstract
Given video footage of a person's face, we present new techniques to automatically recover the face position and the facial expression from each frame in the video sequence. A 3D face model is fitted to each frame using a continuous optimization technique. Our model is based on a set of 3D face models that are linearly combined using 3D morphing. Our method has the advantages over previous techniques of fitting directly a realistic 3-dimensional face model and of recovering parameters that can be used directly in an animation system. We also explore many applications, including performance-driven animation (applying the recovered position and expression of the face to a synthetic character to produce an animation that mimics the input video), relighting the face, varying the camera position, and adding facial ornaments such as tattoos and scars.Keywords
This publication has 19 references indexed in Scilit:
- Robust face feature analysis for automatic speechreading and character animationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Modeling, tracking and interactive animation of faces and heads//using input from videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Automatic recognition of human facial expressionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A unified approach to coding and interpreting face imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Making facesPublished by Association for Computing Machinery (ACM) ,1998
- Coding, analysis, interpretation, and recognition of facial expressionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- Real-time tracking of image regions with changes in geometry and illuminationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Analysis and synthesis of facial image sequences in model-based image codingIEEE Transactions on Circuits and Systems for Video Technology, 1994
- 3-D motion estimation in model-based facial image codingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993