Natural power method for fast subspace tracking
- 1 January 1999
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 176-185
- https://doi.org/10.1109/nnsp.1999.788136
Abstract
Elaborates on a natural version of the power method for fast estimation and tracking of principal subspace or/and principal components of a vector sequence. The natural power method has the fastest convergence rate among a class of power-based methods such as the Oja method, the projection approximation subspace tracking (PAST) method, and the novel information criterion (NIC) method. Like the above three methods, the natural power method can also be implemented with only O(np) flops of computation at each iteration but maintain the fastest convergence rate, where n is the dimension of the vector sequence and p is the dimension of the principal subspace. Also like other power-based methods, the natural power method can be easily adopted for principal components tracking, constrained subspace tracking, and detection of the dimension of the principal subspace. In great contrast to non-power-based methods such as MALASE and OPERA, the natural power method is globally convergent.Keywords
This publication has 12 references indexed in Scilit:
- Fast, accurate subspace tracking using operator restriction analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Fast adaptive eigenvalue decomposition: a maximum likelihood approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A New Look at the Power Method for Fast Subspace TrackingDigital Signal Processing, 1999
- Global convergence of Oja's subspace algorithm for principal component extractionIEEE Transactions on Neural Networks, 1998
- Projection approximation subspace trackingIEEE Transactions on Signal Processing, 1995
- Adaptive Principal component EXtraction (APEX) and applicationsIEEE Transactions on Signal Processing, 1994
- Global analysis of Oja's flow for neural networksIEEE Transactions on Neural Networks, 1994
- Least mean square error reconstruction principle for self-organizing neural-netsNeural Networks, 1993
- NEURAL NETWORKS, PRINCIPAL COMPONENTS, AND SUBSPACESInternational Journal of Neural Systems, 1989
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982