Pose estimation, model refinement, and enhanced visualization using video
- 7 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (10636919) , 488-495
- https://doi.org/10.1109/cvpr.2000.855859
Abstract
In this paper we present methods for exploitation and enhanced visualization of video given a prior coarse untextured polyhedral model of a scene. Since it is necessary to estimate the 3D poses of the moving camera, we develop an algorithm where tracked features are used to predict the pose between frames and the predicted poses are refined by a coarse to fine process of aligning projected 3D model line segments to oriented image gradient energy pyramids. The estimated poses can be used to update the model with information derived from video, and to re-project and visualize the video from different points of view with a larger scene context. Via image registration, we update the placement of objects in the model and the 3D shape of new or erroneously modeled objects, then map video texture to the model. Experimental results are presented for long aerial and ground level videos of a large-scale urban scene.Keywords
This publication has 15 references indexed in Scilit:
- Feature extraction from faces using deformable templatesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Direct recovery of shape from multiple views: a parallax based approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Registration of video to geo-referenced imageryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- VideoBrush/sup TM/: experiences with consumer video mosaicingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust real-time visual tracking using a 2D-3D model-based approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Interactive 3D Modeling from Multiple Images Using Scene RegularitiesPublished by Springer Nature ,1998
- Computer-intensive methods in statistical analysisIEEE Signal Processing Magazine, 1998
- Modeling and rendering architecture from photographsPublished by Association for Computing Machinery (ACM) ,1996
- 3D pose estimation by fitting image gradients directly to polyhedral modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1995
- Robust model-based motion tracking through the integration of search and estimationInternational Journal of Computer Vision, 1992