A Lightweight Online Framework For Query Progress Indicators
- 1 April 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1292-1296
- https://doi.org/10.1109/icde.2007.368996
Abstract
Recently there has been increasing interest in the development of progress indicators for SQL queries. In this paper we present a lightweight online framework for this problem. Our framework is online, in the sense that it refines its estimate of query progress based on feedback received during query execution. It is lightweight, since our techniques are designed to impose minimal overhead on query execution without sacrificing accuracy of estimates. Our framework can estimate progressively the output size of various relational operators and pipelines. These include binary and multiway joins as well as typical grouping operations and combinations thereof. We describe the various algorithms used to efficiently implement the estimators and present the results of a thorough evaluation of a prototype implementation of our framework in an open source data manager. Our results demonstrate the feasibility and practical utility of the approach presented herein.Keywords
This publication has 11 references indexed in Scilit:
- When can we trust progress estimators for SQL queries?Published by Association for Computing Machinery (ACM) ,2005
- Proactive re-optimizationPublished by Association for Computing Machinery (ACM) ,2005
- Toward a progress indicator for database queriesPublished by Association for Computing Machinery (ACM) ,2004
- Robust query processing through progressive optimizationPublished by Association for Computing Machinery (ACM) ,2004
- Towards estimation error guarantees for distinct valuesPublished by Association for Computing Machinery (ACM) ,2000
- On random sampling over joinsPublished by Association for Computing Machinery (ACM) ,1999
- Estimating the Number of Classes in a Finite PopulationJournal of the American Statistical Association, 1998
- Efficient mid-query re-optimization of sub-optimal query execution plansACM SIGMOD Record, 1998
- Estimating the Prediction Function and the Number of Unseen Species in Sampling with ReplacementJournal of the American Statistical Association, 1998
- The importance of percent-done progress indicators for computer-human interfacesPublished by Association for Computing Machinery (ACM) ,1985