Spacetime stereo: shape recovery for dynamic scenes
- 22 December 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2 (10636919)
- https://doi.org/10.1109/cvpr.2003.1211492
Abstract
This paper extends the traditional binocular stereo problem into the spacetime domain, in which a pair of video streams is matched simultaneously instead of matching pairs of images frame by frame. Almost any existing stereo algorithm may be extended in this manner simply by replacing the image matching term with a spacetime term. By utilizing both spatial and temporal appearance variation, this modification reduces ambiguity and increases accuracy. Three major applications for spacetime stereo are proposed in this paper. First, spacetime stereo serves as a general framework for structured light scanning and generates high quality depth maps for static scenes. Second, spacetime stereo is effective for a class of natural scenes, such as waving trees and flowing water, which have repetitive textures and chaotic behaviors and are challenging for existing stereo algorithms. Third, the approach is one of very few existing methods that can robustly reconstruct objects that are moving and deforming over time, achieved by use of oriented spacetime windows in the matching procedure. Promising experimental results in the above three scenarios are demonstrated.Keywords
This publication has 12 references indexed in Scilit:
- Spacetime stereo: a unifying framework for depth from triangulationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Rapid shape acquisition using color structured light and multi-pass dynamic programmingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- 3D photography on your deskPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Better optical triangulation through spacetime analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Multi-view scene capture by surfel sampling: from video streams to non-rigid 3D motion, shape and reflectancePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Stripe boundary codes for real-time structured-light range scanning of moving objectsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A step towards sequence-to-sequence alignmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Three-dimensional scene flowPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- A stereo matching algorithm with an adaptive window: theory and experimentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994