Learning patterns of activity using real-time tracking
Top Cited Papers
- 1 January 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 22 (8) , 747-757
- https://doi.org/10.1109/34.868677
Abstract
Our goal is to develop a visual monitoring system that passively observes moving objects in a site and learns patterns of activity from those observations. For extended sites, the system will require multiple cameras. Thus, key elements of the system are motion tracking, camera coordination, activity classification, and event detection. In this paper, we focus on motion tracking and show how one can use observed motion to learn patterns of activity in a site. Motion segmentation is based on an adaptive background subtraction method that models each pixel as a mixture of Gaussians and uses an on-line approximation to update the model. The Gaussian distributions are then evaluated to determine which are most likely to result from a background process. This yields a stable, real-time outdoor tracker that reliably deals with lighting changes, repetitive motions from clutter, and long-term scene changes. While a tracking system is unaware of the identity of any object it tracks, the identity remains the same for the entire tracking sequence. Our system leverages this information by accumulating joint co-occurrences of the representations within a sequence. These joint co-occurrence statistics are then used to create a hierarchical binary-tree classification of the representations. This method is useful for classifying sequences, as well as individual instances of activities in a site.Keywords
This publication has 12 references indexed in Scilit:
- Adaptive background mixture models for real-time trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Towards robust automatic traffic scene analysis in real-timePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A $1000 active stereo vision systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Fast lighting independent background subtractionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Using adaptive tracking to classify and monitor activities in a sitePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A real-time computer vision system for measuring traffic parametersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Monitoring activities from multiple video streams: establishing a common coordinate framePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- A Bayesian computer vision system for modeling human interactionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- Pfinder: real-time tracking of the human bodyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- Learning the distribution of object trajectories for event recognitionImage and Vision Computing, 1996