Noncontiguous I/O accesses through MPI-IO
- 1 January 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
I/O performance remains a weakness of parallel computing systems today. While this weakness is partly attributed to rapid advances in other system components, I/O interfaces available to programmers and the I/O methods supported by file systems have traditionally not matched efficiently with the types of I/O operations that scientific applications perform, particularly noncontiguous accesses. The MPI-IO interface allows for rich descriptions of the I/O patterns desired for scientific applications and implementations such as ROMIO have taken advantage of this ability while remaining limited by underlying file system methods. A method of noncontiguous data access, list I/O, was recently implemented in the Parallel Virtual File System (PVFS). We implement support for this interface in the ROMIO MPI-IO implementation. Through a suite of noncontiguous I/O tests we compared ROMIO list I/O to current methods of ROMIO noncontiguous access and found that the list I/O interface provides performance benefits in many noncontiguous cases.Keywords
This publication has 10 references indexed in Scilit:
- Noncontiguous I/O through PVFSPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- An abstract-device interface for implementing portable parallel-I/O interfacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The parallel I/O architecture of the high-performance storage system (HPSS)Published by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear FlashesThe Astrophysical Journal Supplement Series, 2000
- On implementing MPI-IO portably and with high performancePublished by Association for Computing Machinery (ACM) ,1999
- Data sieving and collective I/O in ROMIOPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- A Case for Using MPI's Derived Datatypes to Improve I/O PerformancePublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- Disk-directed I/O for MIMD multiprocessorsACM Transactions on Computer Systems, 1997
- File-access characteristics of parallel scientific workloadsIEEE Transactions on Parallel and Distributed Systems, 1996
- Design and Evaluation of primitives for Parallel I/OPublished by Association for Computing Machinery (ACM) ,1993