Layer extraction from multiple images containing reflections and transparency
- 7 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 246-253
- https://doi.org/10.1109/cvpr.2000.855826
Abstract
Many natural images contain reflections and transparency, i.e., they contain mixtures of reflected and transmitted light. When viewed from a moving camera, these appear as the su- perposition of component layer images moving relative to each other. The problem of multiple motion recovery has been pre- viously studied by a number of researchers. However, no one has yet demonstrated how to accurately recover the compo- nent images themselves. In this paper we develop an opti- mal approach to recovering layer images and their associated motions from an arbitrary number of composite images. We develop two different techniques for estimating the compo- nent layer images given known motion estimates. The first approach uses constrained least squares to recover the layer images. The second approach iteratively refines lower and upper bounds on the layer images using two novel composit- ing operations, namely minimum- and maximum-composites of aligned images. We combine these layer extraction tech- niques with a dominant motion estimator and a subsequent motion refinement stage. This results in a completely auto- mated system that recovers transparent images and motions from a collection of input images.Keywords
This publication has 16 references indexed in Scilit:
- Accurate computation of optical flow by using layered motion representationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Unified computational theory for motion transparency and motion boundaries based on eigenenergy analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A layered approach to stereo reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Smoothness in layers: Motion segmentation using nonparametric mixture estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Separation of Reflection Components Using Color and PolarizationInternational Journal of Computer Vision, 1997
- Skin and bones: multi-layer, locally affine, optical flow and regularization with transparencyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Compact representations of videos through dominant and multiple motion estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Computing occluding and transparent motionsInternational Journal of Computer Vision, 1994
- Representing moving images with layersIEEE Transactions on Image Processing, 1994
- Hierarchical model-based motion estimationPublished by Springer Nature ,1992