Capacity Management and Demand Prediction for Next Generation Data Centers
- 1 July 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Advances in server, network, and storage virtualization are enabling the creation of resource pools of servers that permit multiple application workloads to share each server in the pool. This paper proposes and evaluates aspects of a capacity management process for automating the efficient use of such pools when hosting large numbers of services. We use a trace based approach to capacity management that relies on i) a definition for required capacity, ii) the characterization of workload demand patterns, iii) the generation of synthetic workloads that predict future demands based on the patterns, and iv) a workload placement recommendation service. A case study with 6 months of data representing the resource usage of 139 workloads in an enterprise data center demonstrates the effectiveness of the proposed capacity management process. Our results show that when consolidating to 8 processor systems, we predicted future per-server required capacity to within one processor 95% of the time. The approach enabled a 35% reduction in processor usage as compared to today's current best practice for workload placement.Keywords
This publication has 10 references indexed in Scilit:
- R-Opus: A Composite Framework for Application Performability and QoS in Shared Resource PoolsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Evaluation of Adaptive Computing Concepts for Classical ERP Systems and Enterprise ServicesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- A capacity management service for resource poolsPublished by Association for Computing Machinery (ACM) ,2005
- Statistical service assurances for applications in utility grid environmentsPerformance Evaluation, 2004
- High level cache simulation for heterogeneous multiprocessorsPublished by Association for Computing Machinery (ACM) ,2004
- Resource overbooking and application profiling in shared hosting platformsPublished by Association for Computing Machinery (ACM) ,2002
- Applied Regression AnalysisPublished by Wiley ,1998
- Generalized autoregressive conditional heteroskedasticityJournal of Econometrics, 1986
- Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom InflationEconometrica, 1982
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979