Classifying facial actions
- 1 October 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 21 (10) , 974-989
- https://doi.org/10.1109/34.799905
Abstract
The facial action coding system (FAGS) is an objective method for quantifying facial movement in terms of component actions. This paper explores and compares techniques for automatically recognizing facial actions in sequences of images. These techniques include: analysis of facial motion through estimation of optical flow; holistic spatial analysis, such as principal component analysis, independent component analysis, local feature analysis, and linear discriminant analysis; and methods based on the outputs of local filters, such as Gabor wavelet representations and local principal components. Performance of these systems is compared to naive and expert human subjects. Best performances were obtained using the Gabor wavelet representation and the independent component representation, both of which achieved 96 percent accuracy for classifying 12 facial actions of the upper and lower face. The results provide converging evidence for the importance of using local filters, high spatial frequencies, and statistical independence for classifying facial actions.Keywords
This publication has 40 references indexed in Scilit:
- Separation of texture and shape in images of faces for image coding and synthesisJournal of the Optical Society of America A, 1997
- Linear object classes and image synthesis from a single example imagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- Image Representations for Visual LearningScience, 1996
- Recognizing human facial expressions from long image sequences using optical flowPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Human expression recognition from motion using a radial basis function network architectureIEEE Transactions on Neural Networks, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- Distortion invariant object recognition in the dynamic link architectureIEEE Transactions on Computers, 1993
- Face recognition: features versus templatesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Automated coding of facial behavior in human-computer interactions with facsJournal of Nonverbal Behavior, 1992
- Smiles when lying.Journal of Personality and Social Psychology, 1988