A partitioning advisory system for networked data‐parallel processing
- 1 August 1995
- journal article
- Published by Wiley in Concurrency: Practice and Experience
- Vol. 7 (5) , 479-495
- https://doi.org/10.1002/cpe.4330070509
Abstract
With the increased performance capabilities of desktop computers, networked computing has become a popular vehicle for using parallelism to solve a variety of computationally intense problems. However, node heterogeneity and high communication costs may limit performance unless the problem space is carefully partitioned across the network in a way that considers both the capabilities of the machines and the high network communication costs. We describe an advisory system that is designed to help the programmer, compiler or run‐time environment choose the best decomposition strategy for partitioning specific data‐parallel applications across a given collection of machines. The system includes provisions for assessing the capabilities of the participating machines and the network in light of the current workload. Given information about the problem space, the machine speeds and the network, the system provides a ranking of three standard partitioning methods. We test the validity of our system by comparing the observed relative performance with predicted relative performance of different data decompositions on a program with a variable number of floating point operations and a 5‐point stencil communication pattern.Keywords
This publication has 11 references indexed in Scilit:
- An Algorithm Producing Balanced Partitionings of Data ArraysPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- A Run-Time Load Balancing Strategy For Highly Parallel SystemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Recursive Partitions On MultiprocessorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- High performance computing on a cluster of workstationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Block data decomposition for data-parallel programming on a heterogeneous workstation networkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Data partitioning for networked parallel processingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Block data decomposition for partial-homogeneous parallel networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Data‐parallel programming on a network of heterogeneous workstationsConcurrency: Practice and Experience, 1993
- Demonstration of automatic data partitioning techniques for parallelizing compilers on multicomputersIEEE Transactions on Parallel and Distributed Systems, 1992
- A static performance estimator to guide data partitioning decisionsACM SIGPLAN Notices, 1991