High-quality video view interpolation using a layered representation
Top Cited Papers
- 1 August 2004
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 23 (3) , 600-608
- https://doi.org/10.1145/1015706.1015766
Abstract
The ability to interactively control viewpoint while watching a video is an exciting application of image-based rendering. The goal of our work is to render dynamic scenes with interactive viewpoint control using a relatively small number of video cameras. In this paper, we show how high-quality video-based rendering of dynamic scenes can be accomplished using multiple synchronized video streams combined with novel image-based modeling and rendering algorithms. Once these video streams have been processed, we can synthesize any intermediate view between cameras at any time, with the potential for space-time manipulation.In our approach, we first use a novel color segmentation-based stereo algorithm to generate high-quality photoconsistent correspondences across all camera views. Mattes for areas near depth discontinuities are then automatically extracted to reduce artifacts during view synthesis. Finally, a novel temporal two-layer compressed representation that handles matting is developed for rendering at interactive rates.This publication has 17 references indexed in Scilit:
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- On-the-Fly Processing of Generalized LumigraphsComputer Graphics Forum, 2001
- Video segmentation by MAP labeling of watershed segmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- A flexible new technique for camera calibrationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- Stereo Matching with Transparency and MattingInternational Journal of Computer Vision, 1999
- Virtualized reality: constructing virtual worlds from real scenesIEEE MultiMedia, 1997
- The lumigraphPublished by Association for Computing Machinery (ACM) ,1996
- Modeling and rendering architecture from photographsPublished by Association for Computing Machinery (ACM) ,1996
- Light field renderingPublished by Association for Computing Machinery (ACM) ,1996
- Scale-space and edge detection using anisotropic diffusionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990