The nature of data center traffic

Top Cited Papers

4 November 2009

proceedings article
Published by Association for Computing Machinery (ACM)

p. 202-208
https://doi.org/10.1145/1644893.1644918

Abstract

We explore the nature of traffic in data centers, designed to support the mining of massive data sets. We instrument the servers to collect socket-level logs, with negligible performance impact. In a 1500 server operational cluster, we thus amass roughly a petabyte of measurements over two months, from which we obtain and report detailed views of traffic and congestion conditions and patterns. We further consider whether traffic matrices in the cluster might be obtained instead via tomographic inference from coarser-grained counter data.

Keywords

This publication has 17 references indexed in Scilit:

VL2
Published by Association for Computing Machinery (ACM) ,2009
SCOPE
Proceedings of the VLDB Endowment, 2008
Pig latin
Published by Association for Computing Machinery (ACM) ,2008
Dryad
Published by Association for Computing Machinery (ACM) ,2007
Traffic matrices
Published by Association for Computing Machinery (ACM) ,2005
Traffic matrix estimation on a large IP backbone
Published by Association for Computing Machinery (ACM) ,2004
Building a better NetFlow
Published by Association for Computing Machinery (ACM) ,2004
The Google file system
Published by Association for Computing Machinery (ACM) ,2003
Fast accurate computation of large-scale IP traffic matrices from link loads
Published by Association for Computing Machinery (ACM) ,2003
Gigascope
Published by Association for Computing Machinery (ACM) ,2003