Towards a hierarchical scheduling system for distributed WWW server clusters
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 301-308
- https://doi.org/10.1109/hpdc.1998.710016
Abstract
We present a model for dynamically scheduling HTTP requests across clusters of servers, optimizing the use of client resources as well as the scattered server nodes. We also present a system, H-SWEB, implementing our techniques and showing experimental improvements of over 250%, which have been achieved through utilizing a global approach to scheduling requests. This is the first system to provide a hierarchical scheduling mechanism for distributed HTTP server clusters incorporating dynamic client-server task distribution and distributed data access. H-SWEB uses sophisticated scheduling techniques in monitoring and adapting to workload variation at the client and server clusters for supporting typical digital library tasks, such as fast WWW image browsing. We provide a discussion of our system architecture and implementation, and briefly summarize the experimental results that have been achieved.Keywords
This publication has 16 references indexed in Scilit:
- SWEB: towards a scalable World Wide Web server on multicomputersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Cooperative caching of dynamic content on a distributed Web serverPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamic processor scheduling with client resources for fast multi-resolution WWW image browsingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Globus: a Metacomputing Infrastructure ToolkitThe International Journal of Supercomputer Applications and High Performance Computing, 1997
- Multiprocessor scheduling with client resources to improve the response time of WWW applicationsPublished by Association for Computing Machinery (ACM) ,1997
- Hypertext Transfer Protocol -- HTTP/1.1Published by RFC Editor ,1997
- Building a World-Wide virtual machine based on web and HPCC technologiesPublished by Association for Computing Machinery (ACM) ,1996
- Reducing WWW latency and bandwidth requirements by real-time distillationComputer Networks and ISDN Systems, 1996
- Digital librariesCommunications of the ACM, 1995
- An Introduction to WaveletsComputers in Physics, 1992