The Globus Striped GridFTP Framework and Server
Top Cited Papers
- 22 December 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The GridFTP extensions to the File Transfer Protocol define a general-purpose mechanism for secure, reliable, high-performance data movement. We report here on the Globus striped GridFTP framework, a set of client and server libraries designed to support the construction of data-intensive tools and applications. We describe the design of both this framework and a striped GridFTP server constructed within the framework. We show that this server is faster than other FTP servers in both single-process and striped configurations, achieving, for example, speeds of 27.3 Gbit/s memory-to-memory and 17 Gbit/s disk-to-disk over a 60 millisecond round trip time, 30 Gbit/s network. In another experiment, we show that the server can support 1800 concurrent clients without excessive load. We argue that this combination of performance and modular structure make the Globus GridFTP framework both a good foundation on which to build tools and applications, and a unique testbed for the study of innovative data management techniques and network protocols.Keywords
This publication has 26 references indexed in Scilit:
- A framework for reliable and efficient data placement in distributed computing systemsJournal of Parallel and Distributed Computing, 2005
- End-to-end quality of service for high-end applicationsComputer Communications, 2004
- Transport protocols for high performanceCommunications of the ACM, 2003
- An end-to-end approach to globally scalable network storagePublished by Association for Computing Machinery (ACM) ,2002
- A resource management architecture for metacomputing systemsPublished by Springer Nature ,1998
- A Library-Based Approach to Task Parallelism in a Data-Parallel LanguageJournal of Parallel and Distributed Computing, 1997
- Remote I/OPublished by Association for Computing Machinery (ACM) ,1997
- Server-directed collective I/O in PandaPublished by Association for Computing Machinery (ACM) ,1995
- The x-Kernel: an architecture for implementing network protocolsIEEE Transactions on Software Engineering, 1991
- Scale and performance in a distributed file systemACM Transactions on Computer Systems, 1988