Analyzing facial expressions for virtual conferencing
- 1 January 1998
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 18 (5) , 70-78
- https://doi.org/10.1109/38.708562
Abstract
We present a method for estimating 3D motion from 2D image sequences showing head and shoulder scenes typical of video telephone and teleconferencing applications. Our 3D model specifies the color and shape of the person in the video. Additionally, the model constrains facial motion and deformation to a set of facial expressions represented by the facial animation parameters (FAPs) defined by the MPEG-4 standard. Using this model, we obtain a description of both global and local 3D head motion as a function of the unknown facial parameters. Combining the 3D information with the optical flow constraint leads to a robust and linear algorithm that estimates the facial animation parameters from two successive frames with low computational complexity. Experimental results on synthetic and real data confirm the technique's applicability and show that image sequences of head and shoulder scenes can be encoded at bit rates below 0.6 Kbits.Keywords
This publication has 11 references indexed in Scilit:
- The integration of optical flow and deformable models with applications to human face shape and motion estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Developments in model-based video codingProceedings of the IEEE, 1995
- Model-based image coding advanced video coding techniques for very low bit-rate applicationsProceedings of the IEEE, 1995
- Modeling and animation of facial expressions based on B-SplinesThe Visual Computer, 1994
- Object-based analysis-synthesis coding (OBASC) based on the source model of moving flexible 3-D objectsIEEE Transactions on Image Processing, 1994
- 3-D motion estimation in model-based facial image codingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Dynamic 3-D scene analysis through synthesis feedback controlPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Modeling with triangular B-splinesPublished by Association for Computing Machinery (ACM) ,1993
- Model-based coding of videophone imagesElectronics & Communication Engineering Journal, 1991
- Parameterized Models for Facial AnimationIEEE Computer Graphics and Applications, 1982