Separability of pose and expression in facial tracking and animation
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 323-328
- https://doi.org/10.1109/iccv.1998.710738
Abstract
We explore the application of facial tracking to automated re-animation. To this end, it is necessary to recover both head-pose and facial expression from the facial movement of a performer. However, both effects are coupled. This is a serious problem, which previous studies haven't fully considered. The solution to this interaction problem proposed here is to solve explicitly, at each timestep, for pose and expression variables. In principle this is a nonlinear inverse problem. However, appropriate parameterisation of pose in terms of affine transformations with parallax, and of expression in terms of key-frames, reduces the problem to a bilinear one. This can then be solved directly by Singular Value Decomposition. Thus actor-driven animation has ben implemented in real-time, at video field-rate, using two Indy desktop workstations.Keywords
This publication has 10 references indexed in Scilit:
- Learning bilinear models for two-factor problems in visionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Facial expression recognition using a dynamic model and motion energyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and Synthesizing Facial Motions with Dynamic ContoursReal-Time Imaging, 1996
- Real-time lip tracking for audio-visual speech recognition applicationsPublished by Springer Nature ,1996
- Learning to track the visual motion of contoursArtificial Intelligence, 1995
- Analysis and synthesis of facial image sequences using physical and anatomical modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992
- Affine structure from motionJournal of the Optical Society of America A, 1991
- Recognition by linear combinations of modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991