Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of state space
- 1 March 1987
- journal article
- research article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 19 (04) , 767-783
- https://doi.org/10.1017/s0001867800017420
Abstract
Let N(t) be a finite semi-Markov process on 𝒩 and let X(t) be the associated age process. Of interest is the counting process M(t) for transitions of the semi-Markov process from a subset G of 𝒩 to another subset B where 𝒩 = B ∪ G and B ∩ G = ∅. By studying the trivariate process Y(t) =[N(t), M(t), X(t)] in its state space, new transform results are derived. By taking M(t) as a marginal process of Y(t), the Laplace transform generating function of M(t) is then obtained. Furthermore, this result is recaptured in the context of first-passage times of the semi-Markov process, providing a simple probabilistic interpretation. The asymptotic behavior of the moments of M(t) as t → ∞ is also discussed. In particular, an asymptotic expansion for E[M(t)] and the limit for Var [M(t)]/t as t → ∞ are given explicitly.Keywords
This publication has 14 references indexed in Scilit:
- An alternative approach to the analysis of finite semi-markov and related processesCommunications in Statistics. Stochastic Models, 1987
- A general software availability/reliability model: numerical exploration via the matrix laguerre transformCommunications in Statistics. Stochastic Models, 1986
- Asymptotic methods in reliability theory: a reviewAdvances in Applied Probability, 1984
- Disk schedulingCommunications of the ACM, 1980
- Exceptional Paper—Markov Renewal Theory: A SurveyManagement Science, 1975
- On the Matrix Renewal Function for Markov Renewal ProcessesThe Annals of Mathematical Statistics, 1969
- Markov renewal theoryAdvances in Applied Probability, 1969
- The Existence and Uniqueness of Stationary Measures for Markov Renewal ProcessesThe Annals of Mathematical Statistics, 1966
- Limit Theorems for Markov Renewal ProcessesThe Annals of Mathematical Statistics, 1964
- Markov-Renewal Programming. I: Formulation, Finite Return ModelsOperations Research, 1963