Adaptive control with the stochastic approximation algorithm: Geometry and convergence
- 1 April 1985
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 30 (4) , 330-338
- https://doi.org/10.1109/tac.1985.1103963
Abstract
New geometric properties possessed by the sequence of parameter estimates are exhibited, which yield valuable insight into the behavior of the stochastic approximation based algorithm as it is used in minimum variance adaptive control. In particular, these geometric properties, together with certain probabilistic arguments, prove that if the system does not have a reduced-order minimum variance controller, then the parameter estimates converge to a random multiple of the true parameter. An explicit expression for the limiting parameter estimate is also available. With strictly positive probability, the limiting parameter estimate is not the true parameter, and in some cases differs from the true parameter with probability one. If the system possesses reduced-order minimum variance controllers, then convergence to a minimum variance controller in a Cesaro sense is shown. The geometry of the limit set is described. Sufficient conditions are also given for some of these results to hold for parameter estimation schemes other than stochastic approximation.Keywords
This publication has 10 references indexed in Scilit:
- Adaptive control with recursive identification for stochastic linear systemsIEEE Transactions on Automatic Control, 1984
- Stochastic adaptive control using a modified least squares algorithmAutomatica, 1982
- Least Squares Estimates in Stochastic Regression Models with Applications to Identification and Control of Dynamic SystemsThe Annals of Statistics, 1982
- Analytical verification of undesirable properties of direct model reference adaptive control algorithmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1981
- Discrete Time Stochastic Adaptive ControlSIAM Journal on Control and Optimization, 1981
- The convergence of AMLIEEE Transactions on Automatic Control, 1979
- On positive real transfer functions and the convergence of some recursive schemesIEEE Transactions on Automatic Control, 1977
- Analysis of recursive stochastic algorithmsIEEE Transactions on Automatic Control, 1977
- On self tuning regulatorsAutomatica, 1973
- Local Convergence of Martingales and the Law of Large NumbersThe Annals of Mathematical Statistics, 1965