Design and implementation tradeoffs for wide-area resource discovery
- 24 October 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10828907,p. 113-124
- https://doi.org/10.1109/hpdc.2005.1520946
Abstract
This paper describes the design and implementation of SWORD, a scalable resource discovery service for wide-area distributed systems. In contrast to previous systems, SWORD allows users to describe desired resources as a topology of interconnected groups with required intragroup, intergroup, and per-node characteristics, along with the utility that the application derives from various ranges of values of those characteristics. This design gives users the flexibility to find geographically distributed resources for applications that are sensitive to both node and network characteristics, and allows the system to rank acceptable configurations based on their quality for that application. We explore a variety of architectures to deliver SWORD's functionality in a scalable and highly-available manner. A 1000-node ModelNet evaluation using a workload of measurements collected from PlanetLab shows that an architecture based on 4-node server cluster sites at network peering facilities outperforms a decentralized DHT-based resource discovery infrastructure for all but the smallest number of sites. While such a centralized architecture shows significant promise, we find that our decentralized implementation, both in emulation and running continuously on over 200 PlanetLab nodes, performs well while benefiting from the DHT's self-healing properties.Keywords
This publication has 25 references indexed in Scilit:
- An algebraic approach to practical and scalable overlay network monitoringPublished by Association for Computing Machinery (ACM) ,2004
- The encyclopedia of life project: Grid software and deploymentNew Generation Computing, 2004
- SHARPPublished by Association for Computing Machinery (ACM) ,2003
- AstrolabeACM Transactions on Computer Systems, 2003
- Querying the Internet with PIERPublished by Elsevier ,2003
- Network-Sensitive Service DiscoveryJournal of Grid Computing, 2003
- SNAP: A Protocol for Negotiating Service Level Agreements and Coordinating Resource Management in Distributed SystemsPublished by Springer Nature ,2002
- INS/Twine: A Scalable Peer-to-Peer Architecture for Intentional Resource DiscoveryPublished by Springer Nature ,2002
- Towards capturing representative AS-level Internet topologiesPublished by Association for Computing Machinery (ACM) ,2002
- An integrated experimental environment for distributed systems and networksPublished by Association for Computing Machinery (ACM) ,2002