PARADIGM
- 1 August 1993
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
One of the most challenging steps in developing a parallel program for a distributed memory machine is determining how data should be distributed across processors. Most of the compilers being developed to make it easier to program such machines still provide no assistance to the programmer in this difficult and machine-dependent task. We have developed PARADIGM, a compiler that makes data partitioning decisions for Fortran 77 procedures. A significant feature of the design of PARADIGM is the decomposition of the data partitioning problem into a number of sub-problems, each dealing with a different distribution parameter for all the arrays. This paper presents the algorithms that, in conjunction with the computational and the communication cost estimators developed by us, determine those distribution parameters. We also present results obtained on Fortran procedures taken from the Linpack and Eispack libraries, and the Perfect Benchmarks. We believe these are the first results demonstrating the success of automatic data partitioning on a significant class of Fortran procedures.Keywords
This publication has 16 references indexed in Scilit:
- Compiling Fortran D for MIMD distributed-memory machinesCommunications of the ACM, 1992
- Demonstration of automatic data partitioning techniques for parallelizing compilers on multicomputersIEEE Transactions on Parallel and Distributed Systems, 1992
- Automatic data mapping for distributed-memory parallel computersPublished by Association for Computing Machinery (ACM) ,1992
- A static performance estimator to guide data partitioning decisionsPublished by Association for Computing Machinery (ACM) ,1991
- Compile-time techniques for data distribution in distributed memory machinesIEEE Transactions on Parallel and Distributed Systems, 1991
- An empirical study of Fortran programs for parallelizing compilersIEEE Transactions on Parallel and Distributed Systems, 1990
- Parallelization of FORTRAN code on distributed-memory parallel processorsPublished by Association for Computing Machinery (ACM) ,1990
- Data optimization: Allocation of arrays to reduce communication on SIMD machinesJournal of Parallel and Distributed Computing, 1990
- The Perfect Club Benchmarks: Effective Performance Evaluation of SupercomputersThe International Journal of Supercomputing Applications, 1989
- SUPERB: A tool for semi-automatic MIMD/SIMD parallelizationParallel Computing, 1988