Dimension Reduction by Local Principal Component Analysis
- 1 October 1997
- journal article
- Published by MIT Press in Neural Computation
- Vol. 9 (7) , 1493-1516
- https://doi.org/10.1162/neco.1997.9.7.1493
Abstract
Reducing or eliminating statistical redundancy between the components of high-dimensional vector data enables a lower-dimensional representation without significant loss of information. Recognizing the limitations of principal component analysis (PCA), researchers in the statistics and neural network communities have developed nonlinear extensions of PCA. This article develops a local linear approach to dimension reduction that provides accurate representations and is fast to compute. We exercise the algorithms on speech and image data, and compare performance with PCA and with neural network implementations of nonlinear PCA. We find that both nonlinear techniques can provide more accurate representations than PCA and show that the local linear techniques outperform neural network implementations.Keywords
This publication has 19 references indexed in Scilit:
- Replicator Neural Networks for Universal Optimal Source CodingScience, 1995
- Topology and Geometry of Single Hidden Layer Network, Least Squares Weight SolutionsNeural Computation, 1995
- Optimally adaptive transform codingIEEE Transactions on Image Processing, 1995
- On Langevin Updating in Multilayer PerceptronsNeural Computation, 1994
- Characterizing attractors using local intrinsic dimensions calculated by singular-value decomposition and information-theoretic criteriaPhysical Review A, 1990
- Principal CurvesJournal of the American Statistical Association, 1989
- Principal CurvesJournal of the American Statistical Association, 1989
- On the approximate realization of continuous mappings by neural networksNeural Networks, 1989
- Locally Weighted Regression: An Approach to Regression Analysis by Local FittingJournal of the American Statistical Association, 1988
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982