Optimal control of a hybrid system with pathwise average cost
- 24 August 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1061-1066 vol.1
- https://doi.org/10.1109/cdc.1992.371554
Abstract
The authors study the ergodic control problem of switching diffusions of representing a typical hybrid system that arises in numerous applications such as fault-tolerant control systems and flexible manufacturing systems. Under certain conditions, they establish the existence of a stable Markov nonrandomized policy which is almost certainly optimal for the pathwise long-run average cost criterion. They they study the corresponding Hamilton-Jacobi-Bellman (HJB) equation and establish the existence of a unique solution in a certain class. Using this, they characterize the optimal policy as a minimizing selector of the Hamiltonian associated with the HJB equations. They apply these results to a failure-prone manufacturing system and show that the optimal production rate is of the hedging point type.<>Keywords
This publication has 9 references indexed in Scilit:
- An optimal control problem arising in flexible manufacturing systemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Optimal Control of Switching Diffusions with Application to Flexible Manufacturing SystemsSIAM Journal on Control and Optimization, 1993
- Controlled diffusions with constraintsJournal of Mathematical Analysis and Applications, 1990
- Ergodic control of multidimensional diffusions, II: Adaptive controlApplied Mathematics & Optimization, 1990
- Optimality of Zero-Inventory Policies for Unreliable Manufacturing SystemsOperations Research, 1988
- Ergodic Control of Multidimensional Diffusions I: The Existence ResultsSIAM Journal on Control and Optimization, 1988
- Optimal control of production rate in a failure prone manufacturing systemIEEE Transactions on Automatic Control, 1986
- Criteria for Recurrence and Existence of Invariant Measures for Multidimensional DiffusionsThe Annals of Probability, 1978
- Markov ProcessesPublished by Springer Nature ,1965