MagPIe
- 1 May 1999
- proceedings article
- Published by Association for Computing Machinery (ACM)
- Vol. 34 (8) , 131-140
- https://doi.org/10.1145/301104.301116
Abstract
Writing parallel applications for computational grids is a challenging task. To achieve good performance, algorithms designed for local area networks must be adapted to the differences in link speeds. An important class of algorithms are collective operations, such as broadcast and reduce. We have developed MAGPIE, a library of collective communication operations optimized for wide area systems. MAGPIE's algorithms send the minimal amount of data over the slow wide area links, and only incur a single wide area latency. Using our system, existing MPI applications can be run unmodified on geographically distributed systems. On moderate cluster sizes, using a wide area latency of 10 milliseconds and a bandwidth of 1 MByte/s, MAGPIE executes operations up to 10 times faster than MPICH, a widely used MPI implementation; application kernels improve by up to a factor of 4. Due to the structure of our algorithms, MAGPIE's advantage increases for higher wide area latencies.Keywords
This publication has 18 references indexed in Scilit:
- Wide-area implementation of the Message Passing InterfaceParallel Computing, 1998
- Collective communication operations: experimental results vs. theoryConcurrency: Practice and Experience, 1998
- Performance evaluation of the Orca shared-object systemACM Transactions on Computer Systems, 1998
- Communicating across parallel message-passing environmentsJournal of Systems Architecture, 1998
- User-level network interface protocolsComputer, 1998
- Cashmere-2LPublished by Association for Computing Machinery (ACM) ,1997
- The Legion vision of a worldwide virtual computerCommunications of the ACM, 1997
- Scalable Networked Information Processing Environment (SNIPE)Published by Association for Computing Machinery (ACM) ,1997
- A high-performance, portable implementation of the MPI message passing interface standardParallel Computing, 1996
- Myrinet: a gigabit-per-second local area networkIEEE Micro, 1995