Multilayer control of large Markov chains
- 1 April 1978
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 23 (2) , 298-305
- https://doi.org/10.1109/tac.1978.1101707
Abstract
The computational burden associated with controlling a plant modeled as a Markov chain with a large number of states is addressed by proposing a two-layer feedback control structure. At the lower layer a regulator continuously monitors the plant. When the state of the plant reaches an extreme value, the supervisor at the higher layer intervenes to reset the regulator. It is shown that the plant dynamics and cost originally defined at the lower layer can be "lifted" to the supervisor layer and that the supervisor's control task can be defined in a way that permits wide flexibility in the design of the regulator.Keywords
This publication has 5 references indexed in Scilit:
- Multilevel Systems Control and Applications: A SurveyIEEE Transactions on Systems, Man, and Cybernetics, 1977
- On the periodic coordination of linear stochastic systemsAutomatica, 1976
- Denumerable Markov ChainsPublished by Springer Nature ,1976
- A finite-state, finite-memory minimum principlePublished by Institute of Electrical and Electronics Engineers (IEEE) ,1975
- Economic tradeoffs associated with a multilayer control strategy for a class of static systemsIEEE Transactions on Automatic Control, 1972