Modeling Job Lifespan Delays in Volunteer Computing Projects
- 1 January 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 331-338
- https://doi.org/10.1109/ccgrid.2009.69
Abstract
Volunteer computing (VC) projects harness the power of computers owned by volunteers across the Internet to perform hundreds of thousands of independent jobs. In VC projects, the path leading from the generation of jobs to the validation of the job results is characterized by delays hidden in the job lifespan, i.e., distribution delay, in-progress delay, and validation delay. These delays are difficult to estimate because of the dynamic behavior and heterogeneity of VC resources. A wrong estimation of these delays can cause the loss of project throughput and job latency in VC projects. In this paper, we evaluate the accuracy of several probabilistic methods to model the upper time bounds of these delays. We show how our selected models predict up-and-down trends in traces from existing VC projects. The use of our models provides valuable insights on selecting project deadlines and taking scheduling decisions. By accurately predicting job lifespan delays, our models lead to more efficient resource use, higher project throughput, and lower job latency in VC projects.Keywords
This publication has 15 references indexed in Scilit:
- The Effectiveness of Threshold-Based Scheduling Policies in BOINC ProjectsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Predicting Bounds on Queuing Delay in Space-shared Computing EnvironmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Predictor@Home: A "Protein Structure Prediction Supercomputer' Based on Global ComputingIEEE Transactions on Parallel and Distributed Systems, 2006
- High-Performance Task Distribution for Volunteer ComputingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Models and Modeling Infrastructures for Global Computational PlatformsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Homogeneous Redundancy: a Technique to Ensure Integrity of Molecular Simulation Results Using Public ComputingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Predicting queue times on space-sharing parallel computersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Statistical prediction of task execution times through analytic benchmarking for scheduling in a heterogeneous environmentIEEE Transactions on Computers, 1999
- Using Run-Time Predictions to Estimate Queue Wait Times and Improve Scheduler PerformancePublished by Springer Nature ,1999
- Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic ProcessesThe Annals of Mathematical Statistics, 1952