Automatic Partitioning of Parallel Loops for Cache-Coherent Multiprocessors
- 1 August 1993
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 2-11
- https://doi.org/10.1109/icpp.1993.49
Abstract
This paper presents a theoretical framework for automatically partitioning parallel loops to minimize cache coherency traffic on shared-memory multiprocessors. While several previous papers have looked at hyperplane partitioning of iteration spaces to reduce communication traffic, the problem of deriving the optimal tiling parameters for minimal communication in loops with general affine index expressions and multiple arrays has remained open. Our paper solves this open problem by presenting a method for deriving an optimal hyperparallelepiped tiling of iteration spaces for minimal communication in multiprocessors with caches. We show that the same theoretical framework can also be used to determine optimal tiling parameters for data and loop partitioning in distributed memory multiprocessors without caches. Like previous papers, our framework uses matrices to represent iteration and data space mappings and the notion of uniformly intersecting references to capture temporal locality in array references. We introduce the notion of data footprints to estimate the communication traffic between processors and use lattice theory to compute precisely the size of data footprints. We have implemented a subset of this framework in a compiler for the Alewife machine.Keywords
This publication has 8 references indexed in Scilit:
- Demonstration of automatic data partitioning techniques for parallelizing compilers on multicomputersIEEE Transactions on Parallel and Distributed Systems, 1992
- Lazy task creation: a technique for increasing the granularity of parallel programsIEEE Transactions on Parallel and Distributed Systems, 1991
- Compile-time partitioning of iterative parallel loops to reduce cache coherency trafficIEEE Transactions on Parallel and Distributed Systems, 1991
- A data locality optimizing algorithmPublished by Association for Computing Machinery (ACM) ,1991
- Compile-time techniques for data distribution in distributed memory machinesIEEE Transactions on Parallel and Distributed Systems, 1991
- Strategies for cache and local memory management by global program transformationJournal of Parallel and Distributed Computing, 1988
- Supernode partitioningPublished by Association for Computing Machinery (ACM) ,1988
- Guided Self-Scheduling: A Practical Scheduling Scheme for Parallel SupercomputersIEEE Transactions on Computers, 1987