Nonstationary Markov decision problems with converging parameters

This publication has 26 references indexed in Scilit:

• Contraction mappings underlying undiscounted Markov decision problems
  Journal of Mathematical Analysis and Applications, 1978
• A general markov decision method II: Applications
  Advances in Applied Probability, 1977
• Note—A Test for Nonoptimal Actions in Undiscounted Finite Markov Decision Chains
  Management Science, 1976
• Technical Note—Elimination of Suboptimal Actions in Markov Decision Problems
  Operations Research, 1973
• Tests for Suboptimal Actions in Discounted Markov Programming
  Management Science, 1973
• An Optimal Policy for Operating a Multipurpose Reservoir
  Operations Research, 1972
• Some Bounds for Discounted Sequential Decision Processes
  Management Science, 1971
• On Finding the Maximal Gain for Markov Decision Processes
  Operations Research, 1969
• Letter to the Editor—A Test for Suboptimal Actions in Markovian Decision Problems
  Operations Research, 1967
• Markov-Renewal Programming. I: Formulation, Finite Return Models
  Operations Research, 1963