A general markov decision method II: Applications
- 1 June 1977
- journal article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 9 (2) , 316-335
- https://doi.org/10.2307/1426389
Abstract
In a preceding paper [2] we have introduced a new approach for solving a wide class of Markov decision problems in which the state-space may be general and the system may be continuously controlled. The criterion is the average cost. This paper discusses two applications of this approach. The first application concerns a house-selling problem in which a constructor builds houses which may be sold at any stage of the construction and potential customers make offers depending on the stage of the construction. The second application considers an M/M/c queueing problem in which the number of operating servers can be controlled by turning servers on or off.Keywords
This publication has 5 references indexed in Scilit:
- A general markov decision method I: Model and techniquesAdvances in Applied Probability, 1977
- Technical Note—Turning Off a Server with Customers Present: Is This Any Way to Run an M/M/c Queue with Removable Servers?Operations Research, 1975
- A New Technique in the Optimization of Exponential Queueing SystemsPublished by Defense Technical Information Center (DTIC) ,1973
- Production Smoothing with Stochastic Demand II: Infinite Horizon CaseManagement Science, 1971
- On Linear Difference EquationsThe American Mathematical Monthly, 1968