Adaptive estimation and identification for discrete systems with Markov jump parameters
- 1 October 1982
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 27 (5) , 1054-1065
- https://doi.org/10.1109/tac.1982.1103061
Abstract
Linear discrete-time stochastic dynamical systems with parameters which may switch among a finite set of values are considered. The switchings are modeled by a finite state ergodic Markov chain whose transition probability matrix is unknown and is assumed to belong to a compact set. A novel scheme, called truncated maximum likelihood estimation, is proposed for consistent estimation of the transition probabilities given noisy observations of the system output variables. Conditions for strong consistency are investigated assuming that the measurements are taken after the system has achieved a statistical steady state. The case when the true transition matrix does not belong to the unknown transition matrix set is also considered. The truncated maximum likelihood procedure is computationally feasible, whereas the standard maximum likelihood procedure is not, given large observation records. Finally, using the truncated ML algorithm, a suboptimal adaptive state estimator is proposed and its asymptotic behavior is analyzed.Keywords
This publication has 36 references indexed in Scilit:
- Detection and estimation for abruptly changing systemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1981
- A detection-estimation scheme for state estimation in switching environmentsAutomatica, 1979
- Model approximations via prediction error identificationAutomatica, 1978
- Towards fault-tolerant optimal controlPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1978
- On reliable control system designs with and without feedback reconfigurationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1978
- Random sampling approach to state estimation in switching environmentsAutomatica, 1977
- Prediction error estimators: Asymptotic normality and accuracyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1976
- Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculationsIEEE Transactions on Automatic Control, 1974
- Optimal simultaneous state estimation and parameter identification in linear discrete-time systemsIEEE Transactions on Automatic Control, 1972
- On estimation of discrete processes under multiplicative and additive noise conditionsInformation Sciences, 1971