Generalised independent component analysis through unsupervised learning with emergent Bussgang properties
- 22 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3, 1788-1791
- https://doi.org/10.1109/icnn.1997.614168
Abstract
We utilise an information theoretic criterion for exploratory projection pursuit (EPP) and have shown that maximisation by natural gradient ascent of the divergence of a multivariate distribution from normality, using the negentropy as a distance measure, yields a generalised independent component analysis (ICA). By considering a Gram-Charlier approximation of the latent probability density functions (PDF) we develop a generalised neuron nonlinearity which can be considered as a conditional mean estimator of the underlying independent components. The unsupervised learning rule developed is shown to asymptotically exhibit the Bussgang property and as such produces output data with independent components, irrespective of whether the independent latent variables are sub-gaussian or super-gaussian. Improved convergence speeds are reported when momentum terms are introduced into the learning.Keywords
This publication has 8 references indexed in Scilit:
- A new composite criterion for adaptive and iterative blind source separationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Blind source separation using least-squares type adaptive algorithmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Kurtosis extrema and identification of independent components: a neural network approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- Independent component analysis, A new concept?Signal Processing, 1994
- Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architectureSignal Processing, 1991
- Exploratory Projection PursuitJournal of the American Statistical Association, 1987
- What is Projection Pursuit?Journal of the Royal Statistical Society Series A: Statistics in Society, 1987