Iterative kernel principal component analysis for image modeling
Top Cited Papers
- 25 July 2005
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 27 (9) , 1351-1366
- https://doi.org/10.1109/tpami.2005.181
Abstract
In recent years, kernel principal component analysis (KPCA) has been suggested for various image processing tasks requiring an image model such as, e.g., denoising or compression. The original form of KPCA, however, can be only applied to strongly restricted image classes due to the limited number of training examples that can be processed. We therefore propose a new iterative method for performing KPCA, the kernel Hebbian algorithm, which iteratively estimates the kernel principal components with only linear order memory complexity. In our experiments, we compute models for complex image classes such as faces and natural images which require a large number of training examples. The resulting image models are tested in single-frame super-resolution and denoising applications. The KPCA model is not specifically tailored to these tasks; in fact, the same model can be used in super-resolution with variable input resolution, or denoising with unknown noise characteristics, in spite of this, both super-resolution and denoising performance are comparable to existing methods.Keywords
This publication has 37 references indexed in Scilit:
- The Pre-Image Problem in Kernel MethodsIEEE Transactions on Neural Networks, 2004
- Probability models for clutter in natural imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- Image compression via joint statistical characterization in the wavelet domainIEEE Transactions on Image Processing, 1999
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Global convergence of Oja's subspace algorithm for principal component extractionIEEE Transactions on Neural Networks, 1998
- Prior learning and Gibbs reaction-diffusionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- A statistical analysis of natural images matches psychophysically derived orientation tuning curvesProceedings Of The Royal Society B-Biological Sciences, 1991
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982
- Cubic convolution interpolation for digital image processingIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981