Replica selection in the Globus Data Grid
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The Globus Data Grid architecture (I. Foster and C. Kesselman, 1998), provides a scalable infrastructure for the management of storage resources and data that are distributed across Grid environments. These services are designed to support a variety of scientific applications, ranging from high-energy physics to computational genomics, that require access to large amounts of data (terabytes or even petabytes) with varied quality of service requirements. By layering on a set of core services, such as data transport, security, and replica cataloging, one can construct various higher-level services. We discuss the design and implementation of a high-level replica selection service that uses information regarding replica location and user preferences to guide selection from among storage replica alternatives. We first present a basic replica selection service design, then show how dynamic information collected using Globus information service capabilities concerning storage system properties can help improve and optimize the selection process. We demonstrate the use of Condor's ClassAds resource description and matchmaking mechanism as an efficient tool for representing and matching storage resource capabilities and policies against application requirements.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- The SDSC storage resource brokerPublished by Association for Computing Machinery (ACM) ,2010
- Condor-a hunter of idle workstationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Matchmaking: distributed resource management for high throughput computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The Globus project: a status reportPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A directory service for configuring high-performance distributed computationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamically forecasting network performance using the Network Weather ServiceCluster Computing, 1998