Three dimensional transparent structure segmentation and multiple 3D motion estimation from monocular perspective image sequences
- 16 December 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
A three dimensional scene can be segmented using different cues, such as boundaries, texture, motion, discontinuities of the optical flow, stereo, models for structure, etc. We investigate segmentation based upon one of these cues, namely three dimensional motion. If the scene contain transparent objects, the two dimensional (local) cues are inconsistent, since neighboring points with similar optical flow can correspond to different objects. We present a method for performing three dimensional motion-based segmentation of (possibly) transparent scenes together with recursive estimation of the motion of each independent rigid object from monocular perspective images. Our algorithm is based on a recently proposed method for rigid motion reconstruction and a validation test which allows us to initialize the scheme and detect outliers during the motion estimation procedure. The scheme is tested on challenging real and synthetic image sequences. Segmentation is performed for the Ullmann's experiment of two transparent cylinders rotating about the same axis in opposite directions.Keywords
This publication has 17 references indexed in Scilit:
- Performance of optical flow techniquesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Factorization-based segmentation of motionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Motion estimation on the essential manifoldPublished by Springer Nature ,1994
- Motion segmentation and qualitative dynamic scene analysis from an image sequenceInternational Journal of Computer Vision, 1993
- Motion and structure factorization and segmentation of long multiple motion image sequencesPublished by Springer Nature ,1992
- Relative orientation revisitedJournal of the Optical Society of America A, 1991
- Estimating the kinematics and structure of a rigid object from a sequence of monocular imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Kalman filter-based algorithms for estimating depth from image sequencesInternational Journal of Computer Vision, 1989
- A computer algorithm for reconstructing a scene from two projectionsNature, 1981
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960