Real-time Person Tracking in High-resolution Panoramic Video for Automated Broadcast Production
- 1 November 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
For enabling immersive user experiences for interactive TV services and automating camera view selection and framing, knowledge of the location of persons in a scene is essential. We describe an architecture for detecting and tracking persons in high-resolution panoramic video streams, obtained from the Omni Cam, a panoramic camera stitching video streams from 6 HD resolution tiles. We use a CUDA accelerated feature point tracker, a blob detector and a CUDA HOG person detector, which are used for region tracking in each of the tiles before fusing the results for the entire panorama. In this paper we focus on the application of the HOG person detector in real-time and the speedup of the feature point tracker by porting it to NVIDIA's Fermi architecture. Evaluations indicate significant speedup for our feature point tracker implementation, enabling the entire process in a real-time system.Keywords
This publication has 12 references indexed in Scilit:
- Reasoning for video-mediated group communicationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Automatic Inter-image Homography Estimation from Person DetectionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Trajectory Association and Fusion across Partially Overlapping CamerasPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Sport players detection and tracking with a mixed network of planar and omnidirectional camerasPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Fast gain-adaptive KLT tracking on the GPUPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- GPU-Accelerated KLT Tracking with Monte-Carlo-Based Feature ReselectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Active Shape Model-Based Object Tracking in Panoramic VideoPublished by Springer Nature ,2006
- People detection and tracking in high resolution panoramic video mosaicPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Consistent Labeling for Multi-camera Object TrackingPublished by Springer Nature ,2005
- Human tracking in multiple camerasPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002