Performance of the Vesta parallel file system
- 19 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 150-158
- https://doi.org/10.1109/ipps.1995.395926
Abstract
Vesta is an experimental parallel file system implemented on the IBM SPI. Its main features are support for parallel access from multiple application processes to file, and the ability to partition and re-partition the file data among these processes. This paper reports on a set of experiments designed to evaluate Vesta's performance. This includes basic single-node performance, and performance using parallel access with different file partitioning schemes. Results are that bandwidth scales with the number of I/O nodes accessed, and that orthogonal partitioning schemes achieve essentially the same performance. In many cases performance equals the disk hardware limit. This is often attributed to prefetching and write-behind in the I/O nodes.Keywords
This publication has 17 references indexed in Scilit:
- Bridge: a high performance file system for parallel processorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Dynamic file-access characteristics of a production parallel scientific workloadPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Overview of the Vesta parallel file systemACM SIGARCH Computer Architecture News, 1993
- Improved parallel I/O via a two-phase run-time access strategyACM SIGARCH Computer Architecture News, 1993
- High performance FortranIEEE Parallel & Distributed Technology: Systems & Applications, 1993
- Performance Measurement of the Concurrent File System of the Intel iPSC/2 HypercubeJournal of Parallel and Distributed Computing, 1993
- Caching and Writeback Policies in Parallel File SystemsJournal of Parallel and Distributed Computing, 1993
- Storage performance-metrics and benchmarksProceedings of the IEEE, 1993
- Input/output behavior of supercomputing applicationsPublished by Association for Computing Machinery (ACM) ,1991
- Prefetching in file systems for MIMD multiprocessorsIEEE Transactions on Parallel and Distributed Systems, 1990