Linear Estimation in an Unknown Quasi-Stationary Environment
- 1 July 1971
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. SMC-1 (3) , 216-222
- https://doi.org/10.1109/tsmc.1971.4308288
Abstract
Linear estimation under a minimum mean-square-error criterion in a quasi-stationary environment is considered. A generalized form of the Widrow-Hoff algorithm is employed for the estimation. Performance is measured by the excess error over the minimum meansquare error. A Gaussian assumption is used to determine this performance and determine simple bounds. The transient solution for the algorithm is investigated and a convergence rate determined. These results are used to optimize the algorithm parameters and bound the performance as a function of the environmental rate of change. The Robbins-Monro algorithm for finding the root of a linear regression function suggests the use of fixed step size stochastic approximation algorithms to solve more general quasi-stationary estimation problems.Keywords
This publication has 7 references indexed in Scilit:
- Steady-state error in adaptive mean-square minimizationIEEE Transactions on Information Theory, 1970
- Stochastic Learning of Time-Varying Parameters in Random EnvironmentIEEE Transactions on Systems Science and Cybernetics, 1969
- Adaptive Equalization of Highly Dispersive Channels for Data TransmissionBell System Technical Journal, 1969
- Stochastic Approximation Algorithms for System Identification, Estimation, and Decomposition of MixturesIEEE Transactions on Systems Science and Cybernetics, 1969
- A Dynamic Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1965
- ADAPTIVE SWITCHING CIRCUITSPublished by Defense Technical Information Center (DTIC) ,1960
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951