Optimal service-rate control of M/G/1 queueing systems using phase methods
- 1 June 1983
- journal article
- research article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 15 (03) , 616-637
- https://doi.org/10.1017/s0001867800021431
Abstract
A new approach to the optimal control of the service rate in M/G/1 queues is introduced using the method of phases. Each customer's work requirement is approximated by a random number of exponential phases with (possibly) different parameters (a generalized hyper-Erlang distribution). Using a semi-Markov decision-process formulation, we establish monotonicity properties of optimal policies for the finite-horizon problem, by induction on the horizon length. The analysis is then extended to the discounted infinite-horizon and the long-run average-return problems. In contrast to the models in previous papers, our model is appropriate for situations where the system controller has partial information about the work requirement of a customer, specifically the number of phases (tasks) to be performed. Because it requires a multidimensional state description, the analysis of the phase-type control model may be viewed as a first step toward the solution of control models for networks of queues.Keywords
This publication has 16 references indexed in Scilit:
- The Optimality of Full Service PoliciesOperations Research, 1982
- Applying the method of phases in the optimization of queuing systemsAdvances in Applied Probability, 1982
- Optimal control of random walks, birth and death processes, and queuesAdvances in Applied Probability, 1981
- Applying a New Device in the Optimization of Exponential Queuing SystemsOperations Research, 1975
- A Note on Optimal Service Selection in a Single Server QueueManagement Science, 1975
- Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimalProbability Theory and Related Fields, 1975
- Semi-Markov Decision Processes with Unbounded RewardsManagement Science, 1973
- Optimal service-rate selection in an $M| G |\hat 1$QueueSIAM Journal on Applied Mathematics, 1973
- Discrete Dynamic Programming with Unbounded RewardsThe Annals of Mathematical Statistics, 1972
- Optimal Operating Policies for M/G/1 Queuing SystemsOperations Research, 1968