Numerical methods for infinite Markov processes
- 28 May 1980
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 9 (2) , 277-282
- https://doi.org/10.1145/1009375.806174
Abstract
The estimation of steady state probability distributions of discrete Markov processes with infinite state spaces by numerical methods is investigated. The aim is to find a method applicable to a wide class of problems with a minimum of prior analysis. A general method of numbering discrete states in infinite domains is developed and used to map the discrete state spaces of Markov processes into the positive integers, for the purpose of applying standard numerical techniques. A method based on a little used theoretical result is proposed and is compared with two other algorithms previously used for finite state space Markov processes.Keywords
This publication has 3 references indexed in Scilit:
- On computing certain elements of the inverse of a sparse matrixCommunications of the ACM, 1975
- Computation of the stationary distribution of a markov chainJournal of Statistical Computation and Simulation, 1975
- The calculation of limit probabilities for denumerable Markov processes from infinitesimal propertiesJournal of Applied Probability, 1973