Automated facial expression recognition based on FACS action units
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 390-395
- https://doi.org/10.1109/afgr.1998.670980
Abstract
Automated recognition of facial expression is an important addition to computer vision research because of its relevance to the study of psychological phenomena and the development of human-computer interaction (HCI). We developed a computer vision system that automatically recognizes individual action units or action unit combinations in the upper face using hidden Markov models (HMMs). Our approach to facial expression recognition is based an the Facial Action Coding System (FACS), which separates expressions into upper and lower face action. We use three approaches to extract facial expression information: (1) facial feature point tracking; (2) dense flow tracking with principal component analysis (PCA); and (3) high gradient component detection (i.e. furrow detection). The recognition results of the upper face expressions using feature point tracking, dense flow tracking, and high gradient component detection are 85%, 93% and 85%, respectively.Keywords
This publication has 11 references indexed in Scilit:
- Human emotion recognition from motion using a radial basis function network architecturePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Analysis of facial images using physical and anatomical modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Learning parameterized models of image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Visual learning and recognition of 3-d objects from appearanceInternational Journal of Computer Vision, 1995
- Computing spatio-temporal representations of human facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Automatic lipreading by optical‐flow analysisSystems and Computers in Japan, 1991
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991
- Application of the Karhunen-Loeve procedure for the characterization of human facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990
- An introduction to hidden Markov modelsIEEE ASSP Magazine, 1986
- Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face.Journal of Personality and Social Psychology, 1979