Contraction mappings underlying undiscounted Markov decision problems

This publication has 17 references indexed in Scilit:

• The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
  Mathematics of Operations Research, 1977
• Exponential convergence of products of stochastic matrices
  Journal of Mathematical Analysis and Applications, 1977
• Optimal decision procedures for finite Markov chains. Part II: Communicating systems
  Advances in Applied Probability, 1973
• Iterative solution of the functional equations of undiscounted Markov renewal programming
  Journal of Mathematical Analysis and Applications, 1971
• On Finding the Maximal Gain for Markov Decision Processes
  Operations Research, 1969
• Multichain Markov Renewal Programs
  SIAM Journal on Applied Mathematics, 1968
• Contraction Mappings in the Theory Underlying Dynamic Programming
  SIAM Review, 1967
• A modified dynamic programming method for Markovian decision problems
  Journal of Mathematical Analysis and Applications, 1966
• On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process
  The Annals of Mathematical Statistics, 1965
• Dynamic programming, Markov chains, and the method of successive approximations
  Journal of Mathematical Analysis and Applications, 1963