Improving cache performance of network intensive workloads
- 1 January 2001
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 01903918,p. 87-94
- https://doi.org/10.1109/icpp.2001.952050
Abstract
The performance of servers for network-intensive workloads such as web services and online transaction processing applications depends on the effective utilization of the processor caches. A detailed analysis of the cache space utilization of web workloads shows us that several memory addresses are referenced only once during their lifetime in the cache. These references frequently reside in the cache for a long time contributing to the pollution of cache. The most commonly adopted least-recently-used (LRU) replacement scheme does not exploit this characteristic. In this paper, we propose an alternative block replacement policy called Single-Touch Aware Replacement (STAR) algorithm. This algorithm predicts blocks that will potentially be referenced only once and replaces them early enough to improve cache efficiency. The STAR scheme was implemented in a trace-driven cache simulator and the performance with several commercial workloads was analyzed. The use of the STAR algorithm results in up to 20% improvement in cache performance for web workloads (SPECweb96, SPECweb99) and up to 5% improvement in online transaction processing (TPC-C) workloads.Keywords
This publication has 8 references indexed in Scilit:
- Column-associative Caches: A Technique For Reducing The Miss Rate Of Direct-mapped CachesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Improving direct-mapped cache performance by the addition of a small fully-associative cache and prefetch buffersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Memory system characterization of commercial workloadsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Exploring the cache design space for web serversPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Architectural impact of secure socket layer on Internet serversPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Annex cache: a cache assist to implement selective cachingMicroprocessors and Microsystems, 1999
- On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policiesPublished by Association for Computing Machinery (ACM) ,1999
- Server capacity planning for Web traffic workloadIEEE Transactions on Knowledge and Data Engineering, 1999