Necessary and sufficient conditions for recurrence and transience of Markov chains, in terms of inequalities
- 1 March 1978
- journal article
- research article
- Published by Cambridge University Press (CUP) in Journal of Applied Probability
- Vol. 15 (04) , 848-851
- https://doi.org/10.1017/s002190020002619x
Abstract
For an aperiodic, irreducible Markov chain with the non-negative integers as state space it is shown that the existence of a solution to in which yi → ∞is necessary and sufficient for recurrence, and the existence of a bounded solution to the same inequalities, with yk < y o, · · ·, yN –1 for some k ≧ N, is necessary and sufficient for transience.Keywords
All Related Versions
This publication has 3 references indexed in Scilit:
- A Note on Feedback Queues with Bulk ServiceJournal of the ACM, 1972
- Some Conditions for Ergodicity and Recurrence of Markov ChainsOperations Research, 1969
- On the Stochastic Matrices Associated with Certain Queuing ProcessesThe Annals of Mathematical Statistics, 1953