Average cost semi-markov decision processes
- 1 April 1970
- journal article
- research article
- Published by Cambridge University Press (CUP) in Journal of Applied Probability
- Vol. 7 (03) , 649-656
- https://doi.org/10.1017/s0021900200110617
Abstract
The semi-Markov decision model is considered under the criterion of long-run average cost. A new criterion, which for any policy considers the limit of the expected cost incurred during the first n transitions divided by the expected length of the first n transitions, is considered. Conditions guaranteeing that an optimal stationary (non-randomized) policy exist are then presented. It is also shown that the above criterion is equivalent to the usual one under certain conditions.Keywords
This publication has 4 references indexed in Scilit:
- Arbitrary State Markovian Decision ProcessesThe Annals of Mathematical Statistics, 1968
- Non-Discounted Denumerable Markovian Decision ModelsThe Annals of Mathematical Statistics, 1968
- Denumerable State Markovian Decision Processes-Average Cost CriterionThe Annals of Mathematical Statistics, 1966
- Discounted Dynamic ProgrammingThe Annals of Mathematical Statistics, 1965