Feature-point tracking by optical flow discriminates subtle differences in facial expression
- 27 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 396-401
- https://doi.org/10.1109/afgr.1998.670981
Abstract
Current approaches to automated analysis have focused on a small set of prototypic expressions (e.g., joy or anger). Prototypic expressions occur infrequently in everyday life, however, and emotion expression is far more varied. To capture the full range of emotion expression, automated discrimination of fine-grained changes in facial expression is needed. We developed and implemented an optical-flow based approach (feature point tracking) that is sensitive to subtle changes in facial expression. In image sequences from 100 young adults, action units and action unit combinations in the brow and mouth regions were selected for analysis if they occurred a minimum of 25 times in the image database. Selected facial features were automatically tracked using a hierarchical algorithm for estimating optical flow. Images sequences were randomly divided into training and test sets. Feature point tracking demonstrated high concurrent validity with human coding using the Facial Action Coding System (FACS).Keywords
This publication has 9 references indexed in Scilit:
- Human emotion recognition from motion using a radial basis function network architecturePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Facial expressions in Hollywood's protrayal of emotion.Journal of Personality and Social Psychology, 1997
- A vision system for observing and extracting facial action parametersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Computing spatio-temporal representations of human facesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Facial expression and emotion.American Psychologist, 1993
- Automatic lipreading by optical‐flow analysisSystems and Computers in Japan, 1991
- Effect of contingent changes in mothers' affective expression on the organization of behavior in 3-month-old infantsInfant Behavior and Development, 1988
- The neuropsychology of facial expression: A review of the neurological and psychological mechanisms for producing facial expressions.Psychological Bulletin, 1984
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960