Point processes generated by transitions of Markov chains

Publisher Website
Google Scholar
Abstract
For a continuous time Markov chain the time points of transitions, belonging to a subset of the set of all transitions, are observed. Special cases include the point process generated by all transitions and doubly stochastic Poisson processes with a Markovian intensity. Equations are derived for the conditional distribution of the state of the Markov chain, given observations of the point process. This distribution may be used for prediction. For the forward recurrence time of the point process, distributions corresponding to synchronous and asynchronous sampling are also derived. The Palm distribution for the point process is specified in terms of the corresponding initial distribution for the Markov chain. In examples the point processes of arrivals and departures in a queueing system are studied. Two biological applications deal with estimation of population size and detection of epidemics.

This publication has 14 references indexed in Scilit: