Blind Source Separation Using Temporal Predictability
- 1 July 2001
- journal article
- Published by MIT Press in Neural Computation
- Vol. 13 (7) , 1559-1574
- https://doi.org/10.1162/089976601750265009
Abstract
A measure of temporal predictability is defined and used to separate linear mixtures of signals. Given any set of statistically independent source signals, it is conjectured here that a linear mixture of those signals has the following property: the temporal predictability of any signal mixture is less than (or equal to) that of any of its component source signals. It is shown that this property can be used to recover source signals from a set of linear mixtures of those signals by finding an un-mixing matrix that maximizes a measure of temporal predictability for each recovered signal. This matrix is obtained as the solution to a generalized eigenvalue problem; such problems have scaling characteristics of O(N3), where N is the number of signal mixtures. In contrast to independent component analysis, the temporal predictability method requires minimal assumptions regarding the probability density functions of source signals. It is demonstrated that the method can separate signal mixtures in which each mixture is a linear combination of source signals with supergaussian, subgaussian, and gaussian probability density functions and on mixtures of voices and music.Keywords
This publication has 9 references indexed in Scilit:
- Unsupervised discovery of invariancesNetwork: Computation in Neural Systems, 1997
- Learning Perceptually Salient Visual Parameters Using Spatiotemporal Smoothness ConstraintsNeural Computation, 1996
- Randomness and degrees of irregularity.Proceedings of the National Academy of Sciences, 1996
- A Canonical Microfunction for Learning Perceptual InvariancesPerception, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- A learning rule for extracting spatio-temporal invariancesNetwork: Computation in Neural Systems, 1995
- Separation of a mixture of independent signals using time delayed correlationsPhysical Review Letters, 1994
- Self-organizing neural network that discovers surfaces in random-dot stereogramsNature, 1992
- Exploratory Projection PursuitJournal of the American Statistical Association, 1987