A scalable, commodity data center network architecture
Top Cited Papers
- 17 August 2008
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGCOMM Computer Communication Review
- Vol. 38 (4) , 63-74
- https://doi.org/10.1145/1402946.1402967
Abstract
Today's data centers may contain tens of thousands of computers with significant aggregate bandwidth requirements. The network architecture typically consists of a tree of routing and switching elements with progressively more specialized and expensive equipment moving up the network hierarchy. Unfortunately, even when deploying the highest-end IP switches/routers, resulting topologies may only support 50% of the aggregate bandwidth available at the edge of the network, while still incurring tremendous cost. Non-uniform bandwidth among data center nodes complicates application design and limits overall system performance.In this paper, we show how to leverage largely commodity Ethernet switches to support the full aggregate bandwidth of clusters consisting of tens of thousands of elements. Similar to how clusters of commodity computers have largely replaced more specialized SMPs and MPPs, we argue that appropriately architected and interconnected commodity switches may deliver more performance at less cost than available from today's higher-end solutions. Our approach requires no modifications to the end host network interface, operating system, or applications; critically, it is fully backward compatible with Ethernet, IP, and TCP.Keywords
This publication has 16 references indexed in Scilit:
- Tree bitmapACM SIGCOMM Computer Communication Review, 2004
- The Google file systemACM SIGOPS Operating Systems Review, 2003
- Statistical bandwidth sharingPublished by Association for Computing Machinery (ACM) ,2001
- Evidence for long-tailed distributions in the internetPublished by Association for Computing Machinery (ACM) ,2001
- The click modular routerACM Transactions on Computer Systems, 2000
- Fast address lookups using controlled prefix expansionACM Transactions on Computer Systems, 1999
- The anatomy of a large-scale hypertextual Web search engineComputer Networks and ISDN Systems, 1998
- Myrinet: a gigabit-per-second local area networkIEEE Micro, 1995
- The network architecture of the Connection Machine CM-5 (extended abstract)Published by Association for Computing Machinery (ACM) ,1992
- A Study of Non-Blocking Switching NetworksBell System Technical Journal, 1953