The robustness of positive recurrence and recurrence of Markov chains under perturbations of the transition probabilities
- 1 December 1975
- journal article
- Published by Cambridge University Press (CUP) in Journal of Applied Probability
- Vol. 12 (4) , 744-752
- https://doi.org/10.2307/3212725
Abstract
In many Markov chain models, the immediate characteristic of importance is the positive recurrence of the chain. In this note we investigate whether positivity, and also recurrence, are robust properties of Markov chains when the transition laws are perturbed. The chains we consider are on a fairly general state space : when specialised to a countable space, our results are essentially that, if the transition matrices of two irreducible chains coincide on all but a finite number of columns, then positivity of one implies positivity of both; whilst if they coincide on all but a finite number of rows and columns, recurrence of one implies recurrence of both. Examples are given to show that these results (and their general analogues) cannot in general be strengthened.Keywords
This publication has 5 references indexed in Scilit:
- Sufficient conditions for ergodicity and recurrence of Markov chains on a general state spaceStochastic Processes and their Applications, 1975
- $R$-Theory for Markov Chains on a General State Space I: Solidarity Properties and $R$-Recurrent ChainsThe Annals of Probability, 1974
- Geometric ergodicity in a class of denumerable Markov chainsProbability Theory and Related Fields, 1966
- Criteria for stochastic processes II: Passage-time momentsJournal of Mathematical Analysis and Applications, 1963
- Criteria for the recurrence or transience of stochastic process. IJournal of Mathematical Analysis and Applications, 1960