Recurrence conditions for Markov decision processes with Borel state space: A survey
- 1 December 1991
- journal article
- Published by Springer Nature in Annals of Operations Research
- Vol. 28 (1) , 29-46
- https://doi.org/10.1007/bf02055573
Abstract
No abstract availableKeywords
This publication has 27 references indexed in Scilit:
- Controlled semi-Markov models under long-run average rewardsJournal of Statistical Planning and Inference, 1989
- Semi-Markov decision processes with a reachable state-subsetOptimization, 1989
- Necessary and sufficient conditions for a bounded solution to the optimality equation in average reward Markov decision chainsSystems & Control Letters, 1988
- SUR UN MODÉLE AUTORÉGRESSIF NON LINÉAIRE, ERGODICITÉ ET ERGODICITÉ GÉOMÉTRIQUEJournal of Time Series Analysis, 1987
- Geometric ergodicity of Harris recurrent Marcov chains with applications to renewal theoryStochastic Processes and their Applications, 1982
- Invariant Distributions and the Limiting Behavior of Markovian Economic ModelsEconometrica, 1982
- A note on simultaneous recurrence conditions on a set of denumerable stochastic matricesJournal of Applied Probability, 1978
- Criteria for classifying general Markov chainsAdvances in Applied Probability, 1976
- Arbitrary State Markovian Decision ProcessesThe Annals of Mathematical Statistics, 1968
- Denumerable State Markovian Decision Processes-Average Cost CriterionThe Annals of Mathematical Statistics, 1966