On ergodicity and recurrence properties of a Markov chain by an application to an open jackson network
- 1 June 1992
- journal article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 24 (2) , 343-376
- https://doi.org/10.2307/1427696
Abstract
This paper gives an overview of recurrence and ergodicity properties of a Markov chain. Two new notions for ergodicity and recurrence are introduced. They are called μ -geometric ergodicity and μ -geometric recurrence respectively. The first condition generalises geometric as well as strong ergodicity. Our key theorem shows that μ -geometric ergodicity is equivalent to weak μ -geometric recurrence. The latter condition is verified for the time-discretised two-centre open Jackson network. Hence, the corresponding two-dimensional Markov chain is μ -geometrically and geometrically ergodic, but not strongly ergodic. A consequence of μ -geometric ergodicity with μ of product-form is the convergence of the Laplace-Stieltjes transforms of the marginal distributions. Consequently all moments converge.Keywords
This publication has 24 references indexed in Scilit:
- The existence of moments for stationary Markov chainsJournal of Applied Probability, 1983
- Hitting-time and occupation-time bounds implied by drift analysis with applicationsAdvances in Applied Probability, 1982
- Criteria for ergodicity, exponential ergodicity and strong ergodicity of Markov processesJournal of Applied Probability, 1981
- A characterization of geometric ergodicityProbability Theory and Related Fields, 1979
- Criteria for strong ergodicity of Markov chainsJournal of Applied Probability, 1978
- A note on simultaneous recurrence conditions on a set of denumerable stochastic matricesJournal of Applied Probability, 1978
- RECURRENCE CONDITIONS IN DENUMERABLE STATE MARKOV DECISION PROCESSESPublished by Elsevier ,1978
- Criteria for classifying general Markov chainsAdvances in Applied Probability, 1976
- GEOMETRIC ERGODICITY IN DENUMERABLE MARKOV CHAINSThe Quarterly Journal of Mathematics, 1962
- On the Stochastic Matrices Associated with Certain Queuing ProcessesThe Annals of Mathematical Statistics, 1953