Homogeneous row-continuous bivariate markov chains with boundaries
- 1 January 1988
- journal article
- Published by Cambridge University Press (CUP) in Journal of Applied Probability
- Vol. 25 (A) , 237-256
- https://doi.org/10.2307/3214160
Abstract
The matrix-geometric results of M. Neuts are extended to ergodic row-continuous bivariate Markov processes [J(t), N(t)] on state space B = {(j, n)} for which: (a) there is a boundary level N for N(t) associated with finite buffer capacity; (b) transition rates to adjacent rows and columns are independent of row level n in the interior of B. Such processes are of interest in the modelling of queue-length for voice-data transmission in communication systems.One finds that the ergodic distribution consists of two decaying components of matrix-geometric form, the second induced by the finite buffer capacity. The results are obtained via Green's function methods and compensation. Passage-time distributions for the two boundary problems are also made available algorithmically.Keywords
This publication has 7 references indexed in Scilit:
- ROW-CONTINUOUS FINITE MARKOV CHAINS : STRUCTURE AND ALGORITHMSJournal of the Operations Research Society of Japan, 1987
- The Compensation Method Applied to a One-Product Production/Inventory ProblemMathematics of Operations Research, 1981
- Markov Chain Models — Rarity and ExponentialityPublished by Springer Nature ,1979
- Markov chains with applications in queueing theory, which have a matrix-geometric invariant probability vectorAdvances in Applied Probability, 1978
- Boundary problems for additive processes defined on a finite Markov chainMathematical Proceedings of the Cambridge Philosophical Society, 1965
- A central limit theorem for processes defined on a finite Markov chainMathematical Proceedings of the Cambridge Philosophical Society, 1964
- Nonnegative Square MatricesEconometrica, 1953