Exact expectation analysis of the LMS adaptive filter for correlated Gaussian input data
- 1 January 1993
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3 (15206149) , 519-522 vol.3
- https://doi.org/10.1109/icassp.1993.319549
Abstract
The author presents a method for deriving a set of linear update equations that can be used to predict the exact statistical behavior of a finite-impulse-response (FIR) least-mean-square (LMS) adaptive filter operating on finite-time-correlated input data. Using this method, one can derive exact bounds on the LMS step size to guarantee mean and mean-square convergence. The equation-deriving procedure is recursive and algorithmic, and a program written in the MAPLE symbolic-manipulation software package that automates the derivation for arbitrarily long adaptive filters operating on correlated data is described. Extensive computer simulations indicate that the exact analysis is much more accurate than previous analysis in predicting adaptation behavior under correlated data conditions. The results also indicate that analysis based on the commonly used independence assumption can be inaccurate in predicting the transient behavior of adaptive filters, even in slow adaptation situations.Keywords
This publication has 9 references indexed in Scilit:
- Exact expectation analysis of the sign-data LMS algorithm for i.i.d. input dataPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Exact expectation analysis of the LMS adaptive filter without the independence assumptionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1992
- Performance analysis of the LMS algorithm with a tapped delay line (two-dimensional case)IEEE Transactions on Acoustics, Speech, and Signal Processing, 1986
- Convergence analysis of LMS filters with uncorrelated Gaussian dataIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985
- Learning characteristics of stochastic-gradient-descent algorithms: A general study, analysis, and critiqueSignal Processing, 1984
- Second-order convergence analysis of stochastic adaptive linear filteringIEEE Transactions on Automatic Control, 1983
- Tracking properties of adaptive signal processing algorithmsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981
- On the Independence Theory of Equalizer ConvergenceBell System Technical Journal, 1979
- Stationary and nonstationary learning characteristics of the LMS adaptive filterProceedings of the IEEE, 1976