Dual effect, certainty equivalence, and separation in stochastic control
- 1 October 1974
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 19 (5) , 494-500
- https://doi.org/10.1109/tac.1974.1100635
Abstract
In this paper the various policies in fixed end-time stochastic control are discussed first. The emphasis is on the difference between the feedback and closed-loop policies. It is shown how the closed-loop policy has the important property that it can be actively adaptive, while the feedback policy can only be passively adaptive. The feature of being actively adaptive is possible when the control has a dual effect, i.e., in addition to its effect on the state it affects the state uncertainty. The intimate connection between the neutrality (lack of dual effect) and certainty equivalence properties for a class of problems is proved. This new result is then used to widen the class of problems for which it was previously known that the certainty equivalence property holds.Keywords
This publication has 22 references indexed in Scilit:
- An actively adaptive control for linear systems with random parameters via the dual control approachIEEE Transactions on Automatic Control, 1973
- Adaptive control of linear stochastic systemsAutomatica, 1973
- Dynamic programming for stochastic control of discrete systemsIEEE Transactions on Automatic Control, 1971
- Separability, neutrality and certainty equivalence†International Journal of Control, 1971
- Separation of estimation and control for discrete time systemsProceedings of the IEEE, 1971
- Optimum Control of Non-Gaussian Linear Stochastic Systems with Inaccessible State VariablesSIAM Journal on Control, 1969
- On the Separation Theorem of Stochastic ControlSIAM Journal on Control, 1968
- On pole assignment in multi-input controllable linear systemsIEEE Transactions on Automatic Control, 1967
- A General Solution for Linear, Sampled-Data ControlJournal of Basic Engineering, 1963
- On linear control theoryTransactions of the American Institute of Electrical Engineers, Part II: Applications and Industry, 1961