A vision system for observing and extracting facial action parameters
- 1 January 1994
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 76-83
- https://doi.org/10.1109/cvpr.1994.323813
Abstract
We describe a computer vision system for observing the "action units" of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial patterning of facial shape and a parametric representation of the independent muscle action groups, responsible for the observed facial motions. These muscle action patterns may then be used for analysis, interpretation, and synthesis. Thus, by interpreting facial motions within a physics-based optimal estimation framework, a new control model of facial movement is developed. The newly extracted action units (which we name "FACS+") are both physics and geometry-based, and extend the well-known FACS parameters for facial expressions by adding temporal information and non-local spatial patterning of facial motion.<>Keywords
This publication has 9 references indexed in Scilit:
- Shape and nonrigid motion estimation through physics-based synthesisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- 3-D motion estimation in model-based facial image codingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Analysis and synthesis of facial image sequences using physical and anatomical modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Facial expressions of emotion: an old controversy and new findingsPhilosophical Transactions Of The Royal Society B-Biological Sciences, 1992
- Interactive graphics for plastic surgeryPublished by Association for Computing Machinery (ACM) ,1992
- Modelling and animating faces using scanned dataThe Journal of Visualization and Computer Animation, 1991
- Closed-form solutions for physically based shape modeling and recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Automatic lipreading by optical‐flow analysisSystems and Computers in Japan, 1991
- Animating facial expressionsACM SIGGRAPH Computer Graphics, 1981