On the moments of Markov renewal processes
- 1 January 1969
- journal article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 1 (2) , 188-210
- https://doi.org/10.2307/1426217
Abstract
Recently Kshirsagar and Gupta [5] obtained expressions for the asymptotic values of the first two moments of a Markov renewal process. The method they employed involved formal inversion of matrices of Laplace-Stieltjes transforms. Their method also required the imposition of a non-singularity condition. In this paper we derive the asymptotic values using known renewal theoretic results. This method of approach utilises the fundamental matrix of the imbedded ergodic Markov chain and the theory of generalised matrix inverses. Although our results differ in form from those obtained by Kshirsagar and Gupta [5] we show that they reduce to their results under the added non-singularity condition. As a by-product of the derivation we find explicit expressions for the moments of the first passage time distributions in the associated semi-Markov process, generalising the results of Kemeny and Snell [4] obtained for Markov chains.Keywords
This publication has 7 references indexed in Scilit:
- Asymptotic values of the first two moments in Markov renewal processesBiometrika, 1967
- A central limit theorem for processes defined on a finite Markov chainMathematical Proceedings of the Cambridge Philosophical Society, 1964
- Markov Renewal Processes with Finitely Many StatesThe Annals of Mathematical Statistics, 1961
- Markov Renewal Processes: Definitions and Preliminary PropertiesThe Annals of Mathematical Statistics, 1961
- ON THE CUMULANTS OF RENEWAL PROCESSESBiometrika, 1959
- Renewal Theory and its RamificationsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1958
- Regenerative stochastic processesProceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 1955