Stochastic Learning of Time-Varying Parameters in Random Environment
- 1 July 1969
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems Science and Cybernetics
- Vol. 5 (3) , 237-246
- https://doi.org/10.1109/TSSC.1969.300266
Abstract
The problem of learning in nonstationary environment is formulated as that of estimating time-varying parameters of a probability distribution which characterizes the process under study. Dynamic stochastic approximation algorithms are proposed to estimate the unknown time-varying parameters in a recursive fashion. Both supervised and nonsupervised learning schemes are discussed and their convergence properties are investigated. An accelerated scheme for the possible improvement of the dynamic algorithm is given. Numerical examples and an application of the proposed algorithm to a problem in weather forecasting are presented.Keywords
This publication has 7 references indexed in Scilit:
- On Bayesian Learning and Stochastic ApproximationIEEE Transactions on Systems Science and Cybernetics, 1967
- A Dynamic Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1965
- A note on learning for Gaussian propertiesIEEE Transactions on Information Theory, 1965
- Learning to recognize patterns in a random environmentIEEE Transactions on Information Theory, 1962
- Accelerated Stochastic ApproximationThe Annals of Mathematical Statistics, 1958
- Stochastic Estimation of the Maximum of a Regression FunctionThe Annals of Mathematical Statistics, 1952
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951