Partitioning tasks between a pair of interconnected heterogeneous processors: A case study
- 1 May 1995
- journal article
- Published by Wiley in Concurrency: Practice and Experience
- Vol. 7 (3) , 209-223
- https://doi.org/10.1002/cpe.4330070304
Abstract
With the variety of computer architectures available today, it is often difficult to determine which particular type of architecture will provide the best performance on a given application program. In fact, one type of architecture may be well suited to executing one section of a program while another architecture may be better suited to executing another section of the same program. One potentially promising approach for exploiting the best features of different computer architectures is to partition an application program to simultaneously execute on two or more types of machines interconnected with a high‐speed communication network. A fundamental difficulty with this heterogeneous computing, however, is the problem of determining how to partition the application program across the interconnected machines. The goal of this paper is to show how a programmer or a compiler can use a model of a heterogeneous system to determine the machine on which each subtask should be executed. This technique is illustrated with a simple model that relates the relative performance of two heterogeneous machines to the communication time required to transfer partial results across their interconnection network. Experiments with a Connection Machine CM‐200 demonstrate how to apply this model to partition two different application programs across the sequential front‐end processor and the parallel back‐end array.Keywords
This publication has 13 references indexed in Scilit:
- A multiprocessor architecture combining fine-grained and coarse-grained parallelism strategiesParallel Computing, 1994
- An analytical approach to performance/ cost modeling of parallel computersJournal of Parallel and Distributed Computing, 1991
- Distributing the comparison of DNA and protein sequences across heterogeneous supercomputersPublished by Association for Computing Machinery (ACM) ,1991
- PVM: A framework for parallel distributed computingConcurrency: Practice and Experience, 1990
- The design of nectar: a network backplane for heterogeneous multicomputersPublished by Association for Computing Machinery (ACM) ,1989
- Heterogeneity in supercomputer architecturesParallel Computing, 1988
- Multilanguage parallel programming of heterogeneous machinesIEEE Transactions on Computers, 1988
- Architecture and applications of the Connection MachineComputer, 1988
- Programming pearlsCommunications of the ACM, 1984
- The Dynamics of Finite-Difference Models of the Shallow-Water EquationsJournal of the Atmospheric Sciences, 1975