View-invariant representation and learning of human action
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Automatically understanding human actions from video sequences is a very challenging problem. This involves the extraction of relevant visual information from a video sequence, representation of that information in a suitable form, and interpretation of visual information for the purpose of recognition and learning. We first present a view-invariant representation of action consisting of dynamic instants and intervals, which is computed using spatiotemporal curvature of a trajectory. This representation is then used by our system to learn human actions without any training. The system automatically segments video into individual actions, and computes a view-invariant representation for each action. The system is able to incrementally, learn different actions starting with no model. It is able to discover different instances of the same action performed by different people, and in different viewpoints. In order to validate our approach, we present results on video clips in which roughly 50 actions were performed by five different people in different viewpoints. Our system performed impressively by correctly interpreting most actions.Keywords
This publication has 8 references indexed in Scilit:
- Finding skin in color imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Learning patterns of activity using real-time trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- Action Recognition Using Temporal TemplatesPublished by Springer Nature ,1997
- View-Invariant Analysis of Cyclic MotionInternational Journal of Computer Vision, 1997
- Algorithmic characterization of vehicle trajectories from image sequences by motion verbsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Scale-space and edge detection using anisotropic diffusionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990
- Invariant surface characteristics for 3D object recognition in range imagesComputer Vision, Graphics, and Image Processing, 1986
- A framework for visual motion understandingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1980