Video repairing under variable illumination using cyclic motions
- 20 March 2006
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 28 (5) , 832-839
- https://doi.org/10.1109/tpami.2006.108
Abstract
This paper presents a complete system capable of synthesizing a large number of pixels that are missing due to occlusion or damage in an uncalibrated input video. These missing pixels may correspond to the static background or cyclic motions of the captured scene. Our system employs user-assisted video layer segmentation, while the main processing in video repair is fully automatic. The input video is first decomposed into the color and illumination videos. The necessary temporal consistency is maintained by tensor voting in the spatio-temporal domain. Missing colors and illumination of the background are synthesized by applying image repairing. Finally, the occluded motions are inferred by spatio-temporal alignment of collected samples at multiple scales. We experimented on our system with some difficult examples with variable illumination, where the capturing camera can be stationary or in motion.Keywords
This publication has 21 references indexed in Scilit:
- Lazy snappingACM Transactions on Graphics, 2004
- Video tooningACM Transactions on Graphics, 2004
- Inference of segmented color and texture description by tensor votingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Graphcut texturesPublished by Association for Computing Machinery (ACM) ,2003
- Fragment-based image completionACM Transactions on Graphics, 2003
- Layered representation for motion analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust real-time periodic motion detection, analysis, and applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- Video texturesPublished by Association for Computing Machinery (ACM) ,2000
- Image inpaintingPublished by Association for Computing Machinery (ACM) ,2000
- Estimating optical flow in segmented images using variable-order parametric models with local deformationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996