Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time
- 1 August 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 6 (8) , 1064-1076
- https://doi.org/10.1109/83.605404
Abstract
Printing from an NTSC source and conversion of NTSC source material to high-definition television (HDTV) format are some of the applications that motivate superresolution (SR) image and video reconstruction from low-resolution (LR) and possibly blurred sources. Existing methods for SR image reconstruction are limited by the assumptions that the input LR images are sampled progressively, and that the aperture time of the camera is zero, thus ignoring the motion blur occurring during the aperture time. Because of the observed adverse effects of these assumptions for many common video sources, this paper proposes (i) a complete model of video acquisition with an arbitrary input sampling lattice and a nonzero aperture time, and (ii) an algorithm based on this model using the theory of projections onto convex sets to reconstruct SR still images or video from an LR time sequence of images. Experimental results with real video are provided, which clearly demonstrate that a significant increase in the image resolution can be achieved by taking the motion blurring into account especially when there exists large interframe motion.Keywords
This publication has 20 references indexed in Scilit:
- Virtual bellows: constructing high quality stills from videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Bayesian approach to image expansion for improved definitionIEEE Transactions on Image Processing, 1994
- Very high resolution imaging scheme with multiple different-aperture camerasSignal Processing: Image Communication, 1993
- Motion Analysis for Image Enhancement: Resolution, Occlusion, and TransparencyJournal of Visual Communication and Image Representation, 1993
- Signal-processing based method for acquiring very high resolution images with multiple cameras and its theoretical analysisIEE Proceedings I Communications, Speech and Vision, 1993
- A three-frame algorithm for estimating two-component image motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1992
- High-resolution image reconstruction from lower-resolution image sequences and space-varying image restorationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1992
- Improving resolution by image registrationCVGIP: Graphical Models and Image Processing, 1991
- High-resolution image recovery from image-plane arrays, using convex projectionsJournal of the Optical Society of America A, 1989
- The Landweber iteration and projection onto convex setsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985