A Fast Fixed-Point Algorithm for Independent Component Analysis
- 1 October 1997
- journal article
- Published by MIT Press in Neural Computation
- Vol. 9 (7) , 1483-1492
- https://doi.org/10.1162/neco.1997.9.7.1483
Abstract
We introduce a novel fast algorithm for independent component analysis, which can be used for blind source separation and feature extraction. We show how a neural network learning rule can be transformed into a fixedpoint iteration, which provides an algorithm that is very simple, does not depend on any user-defined parameters, and is fast to converge to the most accurate solution allowed by the data. The algorithm finds, one at a time, all nongaussian independent components, regardless of their probability distributions. The computations can be performed in either batch mode or a semiadaptive manner. The convergence of the algorithm is rigorously proved, and the convergence speed is shown to be cubic. Some comparisons to gradient-based algorithms are made, showing that the new algorithm is usually 10 to 100 times faster, sometimes giving the solution in just a few iterations.Keywords
This publication has 6 references indexed in Scilit:
- Learning the higher-order structure of a natural soundNetwork: Computation in Neural Systems, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- Adaptive blind separation of independent sources: A deflation approachSignal Processing, 1995
- Independent component analysis, A new concept?Signal Processing, 1994
- Super-exponential methods for blind deconvolutionIEEE Transactions on Information Theory, 1993
- Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architectureSignal Processing, 1991