Reinforcement Learning in Autonomic Computing: A Manifesto and Case Studies
- 15 January 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 11 (1) , 22-30
- https://doi.org/10.1109/mic.2007.21
Abstract
Reinforcement learning is a promising new approach for automatically developing effective policies for real-time self-management. RL can achieve superior performance to traditional methods, while requiring less built-in domain knowledge. Several case studies from real and simulated systems management applications demonstrate RL's promises and challenges. These studies show that standard online RL can learn effective policies in feasible training times. Moreover, a Hybrid RL approach can profit from any knowledge contained in an existing policy by training on the policy's observable behavior, without needing to interface directly to such knowledgeKeywords
This publication has 9 references indexed in Scilit:
- A Hybrid Reinforcement Learning Approach to Autonomic Resource AllocationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- A Reinforcement Learning Framework for Dynamic Resource Allocation: First Results.Published by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- An analytical model for multi-tier internet services and its applicationsPublished by Association for Computing Machinery (ACM) ,2005
- Adaptive job routing and schedulingEngineering Applications of Artificial Intelligence, 2004
- Feedback Control of Computing SystemsPublished by Wiley ,2004
- The vision of autonomic computingComputer, 2003
- Learning to trade via direct reinforcementIEEE Transactions on Neural Networks, 2001
- Temporal difference learning and TD-GammonCommunications of the ACM, 1995
- Residual Algorithms: Reinforcement Learning with Function ApproximationPublished by Elsevier ,1995