I/O in Parallel Applications: the Weakest Link
- 1 December 1998
- journal article
- research article
- Published by SAGE Publications in The International Journal of High Performance Computing Applications
- Vol. 12 (4) , 389-395
- https://doi.org/10.1177/109434209801200401
Abstract
Parallel computers are increasingly being used to run large-scale applications that also have huge input/output (I/O) requirements. However, many applications obtain poor I/O performance on modem parallel machines. This two-part special issue of the Intemational Journal of High Performance Computing Applications contains papers that describe the I/O requirements and the techniques used to perform I/O in real parallel applications. The authors first explain how the I/O application program inter face (API) plays a critical role in enabling such applications to achieve high I/O performance. They describe how the commonly used UNIX I/O interface is inappropriate for parallel I/O and how an explicitly parallel API with support for collective I/O can help the underlying I/O hardware and software perform I/O efficiently. They then describe MPI- IO, a recently defined, standard, portable API specifically designed for high performance parallel I/O. They conclude with an overview of the papers in Part 1 and Part 2 of this special issue.Keywords
This publication has 11 references indexed in Scilit:
- The Galley parallel file systemParallel Computing, 1997
- Disk-directed I/O for MIMD multiprocessorsACM Transactions on Computer Systems, 1997
- File-access characteristics of parallel scientific workloadsIEEE Transactions on Parallel and Distributed Systems, 1996
- Proposal for a Common Parallel File System Programming Interface 1.0,Published by Defense Technical Information Center (DTIC) ,1996
- An Extended Two-Phase Method for Accessing Sections of Out-of-Core ArraysScientific Programming, 1996
- Parallel I/O Workload Characteristics Using VestaPublished by Springer Nature ,1996
- Introduction to Multiprocessor I/O ArchitecturePublished by Springer Nature ,1996
- Multidimensional array I/O in Panda 1.0The Journal of Supercomputing, 1996
- Parallel I/O subsystems in massively parallel supercomputersIEEE Parallel & Distributed Technology: Systems & Applications, 1995
- High-performance I/O for massively parallel computers: problems and prospectsComputer, 1994