Approximations for interactive Markov chains in discrete and continuous time
- 1 November 1980
- journal article
- research article
- Published by Taylor & Francis in The Journal of Mathematical Sociology
- Vol. 7 (2) , 139-157
- https://doi.org/10.1080/0022250x.1980.9989904
Abstract
A class of models called interactive Markov chains is studied in both discrete and continuous time. These models were introduced by Conlisk and serve as a rich class for sociological modeling, because they allow for interactions among individuals. In discrete time, it is proved that the Markovian processes converge to a deterministic process almost surely as the population size becomes infinite. More importantly, the normalized process is shown to be asymptotically normal with specified mean vector and covariance matrix. In continuous time, the chain is shown to converge weakly to a diffusion process with specified drift and scale terms. The distributional results will allow for the construction of a likelihood function from interactive Markov chain data, so these results will be important for questions of statistical inference. An example from manpower planning is given which indicates the use of this theory in constructing and evaluating control policies for certain social systems.Keywords
This publication has 8 references indexed in Scilit:
- A stochastic model allowing interaction among individuals and its behavior for large populationsThe Journal of Mathematical Sociology, 1980
- The control of a grade structure in a stochastic environment using promotion controlAdvances in Applied Probability, 1979
- A stability theorem for an interactive Markov chainThe Journal of Mathematical Sociology, 1978
- Maintaining a grade or age structure in a stochastic environmentAdvances in Applied Probability, 1977
- Stochastic ProcessesPublished by Springer Nature ,1977
- Interactive markov chainsThe Journal of Mathematical Sociology, 1976
- Markov population processesJournal of Applied Probability, 1969
- A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of ObservationsThe Annals of Mathematical Statistics, 1952