Dynamosaicing: Mosaicing of Dynamic Scenes
- 27 August 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 29 (10) , 1789-1801
- https://doi.org/10.1109/tpami.2007.1091
Abstract
This paper explores the manipulation of time in video editing, which allows us to control the chronological time of events. These time manipulations include slowing down (or postponing) some dynamic events while speeding up (or advancing) others. When a video camera scans a scene, aligning all the events to a single time interval will result in a panoramic movie. Time manipulations are obtained by first constructing an aligned space-time volume from the input video, and then sweeping a continuous 2D slice (time front) through that volume, generating a new sequence of images. For dynamic scenes, aligning the input video frames poses an important challenge. We propose to align dynamic scenes using a new notion of "dynamics constancy," which is more appropriate for this task than the traditional assumption of "brightness constancy." Another challenge is to avoid visual seams inside moving objects and other visual artifacts resulting from sweeping the space-time volumes with time fronts of arbitrary geometry. To avoid such artifacts, we formulate the problem of finding optimal time front geometry as one of finding a minimal cut in a 4D graph, and solve it using max-flow methods.Keywords
This publication has 25 references indexed in Scilit:
- Interactive digital photomontageACM Transactions on Graphics, 2004
- What energy functions can be minimized via graph cuts?Published by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Automated mosaics via topology inferenceIEEE Computer Graphics and Applications, 2002
- Fast approximate energy minimization via graph cutsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- Omnistereo: panoramic stereo imagingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphsIEEE Transactions on Information Theory, 2001
- Texture mixing and texture movie synthesis using statistical learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- MLESAC: A New Robust Estimator with Application to Estimating Image GeometryComputer Vision and Image Understanding, 2000
- Mosaicing on adaptive manifoldsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- A survey of image registration techniquesACM Computing Surveys, 1992