Markov renewal theory
- 1 January 1969
- journal article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 1 (2) , 123-187
- https://doi.org/10.2307/1426216
Abstract
Consider a stochastic processX(t) (t≧ 0) taking values in a countable state space, say, {1, 2,3, …}. To be picturesque we think ofX(t) as the state which a particle is in at epocht. Suppose the particle moves from state to state in such a way that the successive states visited form a Markov chain, and that the particle stays in a given state a random amount of time depending on the state it is in as well as on the state to be visited next. Below is a possible realization of such a process.Keywords
This publication has 39 references indexed in Scilit:
- On semi-Markov processes on arbitrary spacesMathematical Proceedings of the Cambridge Philosophical Society, 1969
- Decomposition of a Semi-Markov Process Under a State Dependent RuleSIAM Journal on Applied Mathematics, 1967
- Potentials associated with recurrent Markov renewal processesJournal of Mathematical Analysis and Applications, 1966
- Limit theorems for semi-Markov processesTransactions of the American Mathematical Society, 1966
- On the limiting distributions in Markov renewal processes with finitely many statesAnnals of the Institute of Statistical Mathematics, 1963
- A Convexity Property in the Theory of Random Variables Defined on a Finite Markov ChainThe Annals of Mathematical Statistics, 1961
- On certain sojourn time problems in the theory of stochastic processesActa Mathematica Hungarica, 1957
- Regenerative stochastic processesProceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 1955
- Some contributions to the theory of denumerable Markov chainsTransactions of the American Mathematical Society, 1955
- Recurrence and first passage timesMathematical Proceedings of the Cambridge Philosophical Society, 1953