True multi-image alignment and its application to mosaicing and lens distortion correction
- 1 March 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 21 (3) , 235-243
- https://doi.org/10.1109/34.754589
Abstract
Multiple images of a scene are related through 2D/3D view transformations and linear and non-linear camera transformations. In the traditional techniques to compute these transformations, especially the ones relying on direct intensity gradients, one image and its coordinate system have been assumed to be ideal and distortion free. In this paper, we present an algorithm for true multi-image alignment that does not rely on the measurements of a reference image being distortion free. The algorithm is developed to specifically align and mosaic images using parametric transformations in the presence of lens distortion. When lens distortion is present, none of the images can be assumed to be ideal. In our formulation, all the images are modeled as intensity measurements represented in their respective coordinate systems, each of which is related to an ideal coordinate system through an interior camera transformation and an exterior view transformation. The goal of the accompanying algorithm is to compute an image in the ideal coordinate system while solving for the transformations that relate the ideal system with each of the data images. Key advantages of the technique presented in this paper are: (i) no reliance on one distortion free image, (ii) ability to register images and compute coordinate transformations even when the multiple images are of an extended scene with no overlap between the first and last frame of the sequence, and (iii) ability to handle linear and non-linear transformations within the same framework. Results of applying the algorithm are presented for the correction of lens distortion, and creation of video mosaics.Keywords
This publication has 21 references indexed in Scilit:
- Accurate computation of optical flow by using layered motion representationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Image mosaicing for tele-reality applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Influence of global constraints and lens distortion on pose and appearance recovery from a purely rotating cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Photorealistic scene reconstruction by voxel coloringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Lens distortion calibration using point correspondencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encodingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Model-based 2D&3D dominant motion estimation for mosaicing and video representationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Mosaic based representations of video sequences and their applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- In defence of the 8-point algorithmPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lensesIEEE Journal on Robotics and Automation, 1987