Efficient layering for high speed communication: Fast Messages 2.x
- 27 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We describe our experience designing, implementing, and evaluating two generations of our high performance communication library, Fast Messages (FM) for Myrinet. In FM 1.x, we designed a simple interface and provided guarantees of reliable and in-order delivery, and flow control. While this was a significant improvement over previous systems, it was not enough. Layering MPI atop FM 1.x showed that only about 20\% of the FM 1.x bandwidth could be delivered to higher level communication APIs. Our second generation communication layer, FM 2.0, addresses the identified problems, providing gather-scatter, interlayer scheduling, receiver flow control, as well as some convenient API features which simplify programming. FM 2.x can deliver 70-90\% to higher level APIs such as MPI. This is especially impressive as the absolute bandwidths delivered have increased nearly fourfold to 70 MB/s. We describe general issues encountered in matching two communication layers, and our solutions as embodied in FM 2.x.Keywords
This publication has 20 references indexed in Scilit:
- High-performance switching with fibre channelPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Supporting high level programming with high performance: the Illinois Concert systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Fast messages: efficient, portable communication for workstation clusters and MPPsIEEE Concurrency, 1997
- MPI-FM: High Performance MPI on Workstation ClustersJournal of Parallel and Distributed Computing, 1997
- Profiling and reducing processing overheads in TCP/IPIEEE/ACM Transactions on Networking, 1996
- Runtime Mechanisms for Efficient Dynamic MultithreadingJournal of Parallel and Distributed Computing, 1996
- Myrinet: a gigabit-per-second local area networkIEEE Micro, 1995
- A comparison of architectural support for messaging in the TMC CM-5 and the Cray T3DPublished by Association for Computing Machinery (ACM) ,1995
- Fbufs: a high-bandwidth cross-domain transfer facilityPublished by Association for Computing Machinery (ACM) ,1993
- A measurement study of diskless workstation traffic on an EthernetIEEE Transactions on Communications, 1990