Recovery of dynamic scene structure from multiple image sequences
- 24 December 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 305-312
- https://doi.org/10.1109/mfi.1996.572192
Abstract
Despite significant progress in automatic recovery of static scene structure from range images, little effort has been made toward extending these approaches to dynamic scenes. This disparity is in large part due to the lack of range sensors with the high sampling rates needed to accurately capture dynamic scenes. We have developed a system that overcomes this problem by exploiting video cameras, which easily capture images of dynamic scenes, and image-based stereo, which estimates scene structure based on correspondences among the images from different cameras. Our system uses a synchronized multi-camera recording system to capture live video of the scene and a software implementation of image-based stereo to compute range images off-line. By combining this system with multi-image fusion, we created a novel system for dynamic structure recovery, with many applications including telepresence, training, and entertainment. Development of this system has also revealed the potential use of fusion as both a multi-view and multi-resolution integration process for stereo.Keywords
This publication has 15 references indexed in Scilit:
- Multi-resolution surface modeling from multiple range viewsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Multiple perspective interactive videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Virtualized reality: concepts and early resultsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Reconstructing complex surfaces from multiple stereo viewsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- An integral approach to free-form object modelingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- A volumetric method for building complex models from range imagesPublished by Association for Computing Machinery (ACM) ,1996
- Ridges for image analysisJournal of Mathematical Imaging and Vision, 1994
- Piecewise smooth surface reconstructionPublished by Association for Computing Machinery (ACM) ,1994
- A multiple-baseline stereoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- Marching cubes: A high resolution 3D surface construction algorithmACM SIGGRAPH Computer Graphics, 1987