A decentralized, adaptive replica location mechanism
- 25 June 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10828907,p. 24-32
- https://doi.org/10.1109/hpdc.2002.1029900
Abstract
We describe a decentralized, adaptive mechanism for replica location in wide-area distributed systems. Unlike traditional, hierarchical (e.g, DNS) and more recent (e.g., CAN, Chord, Gnutella) distributed search and indexing schemes, nodes in our location mechanism do not route queries, instead, they organize into an overlay network and distribute location information. We contend that this approach works well in environments where replica location queries are prevalent but the dynamic component of the system (e.g., node and network failures, replica add/delete operations) cannot be neglected. We argue that a replica location mechanism that combines probabilistic representations of replica location information with soft-state protocols and a flat overlay network of nodes brings important benefits: genuine decentralization, low query latency, and flexibility to introduce adaptive communication schedules. We support these claims in two ways. First, we provide a rough resource consumption evaluation: we show that, for environments similar to those encountered in large scientific data analysis projects, generated network traffic is limited and, more importantly, is comparable to the traffic generated by a request routing scheme. Second, we provide encouraging performance data from a prototype implementation.Keywords
This publication has 25 references indexed in Scilit:
- Scalable timers for soft state protocolsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A scalable content-addressable networkPublished by Association for Computing Machinery (ACM) ,2001
- ChordPublished by Association for Computing Machinery (ACM) ,2001
- Compressed bloom filtersPublished by Association for Computing Machinery (ACM) ,2001
- The Ninja architecture for robust Internet-scale systems and servicesComputer Networks, 2001
- A national-scale authentication infrastructureComputer, 2000
- OceanStorePublished by Association for Computing Machinery (ACM) ,2000
- A model, analysis, and protocol framework for soft state-based communicationACM SIGCOMM Computer Communication Review, 1999
- Practical performance of Bloom filters and parallel free-text searchingCommunications of the ACM, 1989
- A second look at bloom filtersCommunications of the ACM, 1983