Including the load balancing issue in the optimization of multi-way join queries for shared-nothing database computers
- 31 December 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Dynamic load balancing issues in multiway join operations is discussed. In particular, four multiway join query optimizers have been implemented and a simulator developed to investigate the effect of skewed tuple distribution on these techniques. Dynamic load balancing is found to very critical to the performance of shared-nothing (SN) systems, particularly when the system is large. Since load balancing becomes more difficult for larger systems, one should exploit interjoin parallelism in order to limit the number of processing nodes used for each join operation. The skew issue must be considered during query optimization to achieve the best performance. The load balancing techniques proposed can easily be extended to support interquery parallelism in a multiuser environment.Keywords
This publication has 12 references indexed in Scilit:
- Optimization of parallel query execution plans in XPRSPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Comparative performance of parallel join algorithmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Algorithms for handling skew in parallel task schedulingJournal of Parallel and Distributed Computing, 1992
- Processing multi-join query in parallel systemsPublished by Association for Computing Machinery (ACM) ,1992
- A benchmark of NonStop SQL release 2 demonstrating near-linear speedup and scaleup on large databasesACM SIGMETRICS Performance Evaluation Review, 1990
- The Gamma database machine projectIEEE Transactions on Knowledge and Data Engineering, 1990
- Prototyping Bubba, a highly parallel database systemIEEE Transactions on Knowledge and Data Engineering, 1990
- Application of hash to data base machine and its architectureNew Generation Computing, 1983
- Access path selection in a relational database management systemPublished by Association for Computing Machinery (ACM) ,1979
- Decomposition—a strategy for query processingACM Transactions on Database Systems, 1976