The Pre-Image Problem in Kernel Methods
Top Cited Papers
- 8 November 2004
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 15 (6) , 1517-1525
- https://doi.org/10.1109/tnn.2004.837781
Abstract
In this paper, we address the problem of finding the pre-image of a feature vector in the feature space induced by a kernel. This is of central importance in some kernel applications, such as on using kernel principal component analysis (PCA) for image denoising. Unlike the traditional method in which relies on nonlinear optimization, our proposed method directly finds the location of the pre-image based on distance constraints in the feature space. It is noniterative, involves only linear algebra and does not suffer from numerical instability or local minimum problems. Evaluations on performing kernel PCA and kernel clustering on the USPS data set show much improved performance.Keywords
This publication has 5 references indexed in Scilit:
- The Pre-Image Problem in Kernel MethodsIEEE Transactions on Neural Networks, 2004
- Mercer kernel-based clustering in feature spaceIEEE Transactions on Neural Networks, 2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Adding a point to vector diagrams in multivariate analysisBiometrika, 1968