Resource-usage prediction for demand-based network-computing
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
This paper reports on an application of artificial intelligence to achieve demand-based scheduling within the context of a network-computing infrastructure. The described AI system uses tool-specific, run-time input to predict the resource-usage characteristics of runs. Instance-based learning with locally weighted polynomial regression is employed because of the need to simultaneously learn multiple polynomial concepts and the fact that knowledge is acquired incrementally in this domain. An innovative use of a two-level knowledge base allows the system to account for short-term variations in compute-server and network performance and exploit temporal and spatial locality of runs. Instance editing allows the approach to be tolerant to noise and computationally feasible for extended use. The learning system was tested on three tools during normal use of the Purdue University Network Computing Hubs. Results indicate that the described instance-based learning technique using locally weighted regression with a locally linear model works well for this domain.Keywords
This publication has 9 references indexed in Scilit:
- SmartNet: a scheduling framework for heterogeneous computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- History, an intelligent load sharing filterPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- On the design of a demand-based network-computing system: the Purdue University Network-Computing HubsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Performance prediction in production environmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Resource-usage prediction for demand-based network-computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The Semiconductor Simulation Hub: a network-based microelectronics simulation laboratoryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Predicting application run times using historical informationPublished by Springer Nature ,1998
- Prediction-based dynamic load-sharing heuristicsIEEE Transactions on Parallel and Distributed Systems, 1993
- Locally Weighted Regression: An Approach to Regression Analysis by Local FittingJournal of the American Statistical Association, 1988