The integration of optical flow and deformable models with applications to human face shape and motion estimation
- 1 January 1996
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 231-238
- https://doi.org/10.1109/cvpr.1996.517079
Abstract
We present a formal methodology for the integration of optical flow and deformable models. The optical flow constraint equation provides a non-holonomic constraint on the motion of the deformable model. In this augmented system, forces computed from edges and optical flow are used simultaneously. When this dynamic system is solved, a model-based least-squares solution for the optical flow is obtained and improved estimation results are achieved. The use of a 3-D model reduces or eliminates problems associated with optical flow computation. This approach instantiates a general methodology for treating visual cues as constraints on deformable models. We apply this framework to human face shape and motion estimation. Our 3-D deformable face model uses a small number of parameters to describe a rich variety of face shapes and facial expressions. We present experiments in extracting the shape and motion of a face from image sequences.Keywords
This publication has 11 references indexed in Scilit:
- Design of multi-dimensional derivative filtersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Probability distributions of optical flowPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Facial expression recognition using a dynamic model and motion energyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A unified approach to coding and interpreting face imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Blended deformable modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Computing spatio-temporal representations of human facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- 3-D motion estimation in model-based facial image codingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Analysis and synthesis of facial image sequences using physical and anatomical modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Closed-form solutions for physically based shape modeling and recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991