Iterative Bounds on the Equilibrium Distribution of a Finite Markov Chain
- 1 January 1987
- journal article
- research article
- Published by Cambridge University Press (CUP) in Probability in the Engineering and Informational Sciences
- Vol. 1 (1) , 117-131
- https://doi.org/10.1017/s0269964800000334
Abstract
This article presents a new iterative method for computing the equilibrium distribution of a finite Markov chain, which has the significant advantage of providing good upper and lower bounds for the equilibrium probabilities. The method approximates the expected number of visits to each state between two successive visits to a given reference state. Numerical examples indicate that the performance of this method is quite good.Keywords
This publication has 1 reference indexed in Scilit:
- Zur Extrapolation in Markoffschen Entscheidungsmodellen mit DiskontierungMathematical Methods of Operations Research, 1974