HiHCoHP-Toward a realistic communication model for hierarchical hyperclusters of heterogeneous processors
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15302075,p. 6-42
- https://doi.org/10.1109/ipdps.2001.924978
Abstract
A parameterized model of hyperclusters of processors-clusters of clusters of... of clusters of processors-is formulated under which a hypercluster enjoys generality along three orthogonal axes: (1) Its processors are heterogeneous: they may have different computational powers (speed of computation and memory access). (2) Its constituent clusters are interconnected via a hierarchy of networks of possibly differing bandwidths and speeds. (3) Its clusters at each level of the hierarchy are heterogeneous: they may differ in size. The model accounts for architectural details such as the bandwidths and transit costs of both networks and their ports. The algorithmic tractability of the model is demonstrated via broadcast and reduction algorithms, which are predictably efficient in general and actually optimal in special circumstances.Keywords
This publication has 24 references indexed in Scilit:
- Adaptive Communication Algorithms for Distributed Heterogeneous SystemsJournal of Parallel and Distributed Computing, 1999
- Predictable communication on unpredictable networks: Implementing BSP over TCP/IPPublished by Springer Nature ,1998
- Coordinating Parallel Processes on Networks of WorkstationsJournal of Parallel and Distributed Computing, 1997
- On optimal strategies for cycle-stealing in networks of workstationsIEEE Transactions on Computers, 1997
- Approximation Algorithms for Broadcasting and GossipingJournal of Parallel and Distributed Computing, 1997
- LogPCommunications of the ACM, 1996
- Designing broadcasting algorithms in the postal model for message-passing systemsTheory of Computing Systems, 1994
- Models and algorithms for coscheduling compute-intensive taks on a network of workstationsJournal of Parallel and Distributed Computing, 1992
- A bridging model for parallel computationCommunications of the ACM, 1990
- Optimum broadcasting and personalized communication in hypercubesIEEE Transactions on Computers, 1989