Characterizing parallel file-access patterns on a large-scale multiprocessor
- 19 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 165-172
- https://doi.org/10.1109/ipps.1995.395928
Abstract
High-performance parallel file systems are needed to satisfy tremendous I/O requirements of parallel scientific applications. The design of such high-performance parallel file systems depends on a comprehensive understanding of the expected workload, but so far there have been very few usage studies of multiprocessor file systems. This paper is part of the CHARISMA project, which intends to fill this void by measuring real file-system workloads on various production parallel machines. In particular, here we present results from the CM-5 at the National Center for Supercomputing Applications. Our results are unique because we collect information about nearly every individual I/O request from the mix of jobs running on the machine. Analysis of the traces leads to various recommendations for parallel file-system design.<>Keywords
This publication has 18 references indexed in Scilit:
- CMMD I/O: a parallel Unix I/OPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Multiprocessor file system interfacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamic file-access characteristics of a production parallel scientific workloadPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- High-performance I/O for massively parallel computers: problems and prospectsComputer, 1994
- File archive activity in a supercomputing environmentPublished by Association for Computing Machinery (ACM) ,1993
- Performance Measurement of the Concurrent File System of the Intel iPSC/2 HypercubeJournal of Parallel and Distributed Computing, 1993
- Analysis of file I/O traces in commercial computing environmentsPublished by Association for Computing Machinery (ACM) ,1992
- Measurements of a distributed file systemPublished by Association for Computing Machinery (ACM) ,1991
- Directory reference patterns in hierarchical file systemsIEEE Transactions on Knowledge and Data Engineering, 1989
- Analysis of Long Term File Reference Patterns for Application to File Migration AlgorithmsIEEE Transactions on Software Engineering, 1981