Discrete-time entropy formulation of optimal and adaptive control problems
- 1 July 1992
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 37 (7) , 1083-1088
- https://doi.org/10.1109/9.148379
Abstract
The discrete-time version of the entropy formulation of optimal control of problems developed by G.N. Saridis (1988) is discussed. Given a dynamical system, the uncertainty in the selection of the control is characterized by the probability distribution (density) function which maximizes the total entropy. The equivalence between the optimal control problem and the optimal entropy problem is established, and the total entropy is decomposed into a term associated with the certainty equivalent control law, the entropy of estimation, and the so-called equivocation of the active transmission of information from the controller to the estimator. This provides a useful framework for studying the certainty equivalent and adaptive control laws.Keywords
This publication has 4 references indexed in Scilit:
- Optimal policies for passive learning controllersAutomatica, 1989
- Optimal control of unknown parameter systemsIEEE Transactions on Automatic Control, 1989
- Entropy formulation of optimal and adaptive controlIEEE Transactions on Automatic Control, 1988
- Information Theory and Statistical MechanicsPhysical Review B, 1957