A result on the mean square error obtained using general tracking algorithms
- 1 July 1991
- journal article
- research article
- Published by Wiley in International Journal of Adaptive Control and Signal Processing
- Vol. 5 (4) , 231-248
- https://doi.org/10.1002/acs.4480050402
Abstract
Tracking time‐varying properties is of crucial importance in all adaptive algorithms. In this contribution we study a fairly general algorithm for tracking properties of model parameters that can be described in a linear regression form (including AR models and the like). An explicit expression for the mean square error between the estimated and the true (time‐varying) parameter is established. For slow adaptation this expression can be arbitrarily well approximated by a much simpler expression. The treatment differs from other related studies using weak convergence theory, averaging, etc. in that the results are not asymptotic in nature and are applicable also to the transient phase as well as over unbounded time intervals.Keywords
This publication has 12 references indexed in Scilit:
- Adaptation and tracking in system identification—A surveyAutomatica, 1990
- Nonstationary learning characteristics of the LMS algorithmIEEE Transactions on Circuits and Systems, 1987
- Design of adaptive algorithms for the tracking of time‐varying systemsInternational Journal of Adaptive Control and Signal Processing, 1987
- Optimization of adaptive identification for time-varying filtersIEEE Transactions on Automatic Control, 1986
- Tracking error bounds of adaptive nonstationary filteringAutomatica, 1985
- Learning characteristics of stochastic-gradient-descent algorithms: A general study, analysis, and critiqueSignal Processing, 1984
- Recursive Estimation and Time-Series AnalysisPublished by Springer Nature ,1984
- Second-order convergence analysis of stochastic adaptive linear filteringIEEE Transactions on Automatic Control, 1983
- Tracking properties of adaptive signal processing algorithmsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981
- Asymptotic Properties of Stochastic Approximations with Constant CoefficientsSIAM Journal on Control and Optimization, 1981