Simulation of dynamic data replication strategies in Data Grids
- 22 March 2004
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Data Grids provide geographically distributed resources for large-scale data-intensive applications that generate large data sets. However, ensuring efficient access to such huge and widely distributed data is hindered by the high latencies of the Internet. We address these challenges by employing intelligent replication and caching of objects at strategic locations. Inour approach, replication decisions are based on a cost-driven model that computes data access gains and replica creation and maintenance costs. These measures are in turn based on factors such as runtime accumulated read/write statistics, network latency, bandwidth, and replica size. To support large numbers of users who continuously change their data and processing needs, we introduce scalable replica distribution topologies that adapt replica placement to meet these needs. To evaluate the performance of our approach, we developed a Data Grid simulator, called the GridNet. Simulation results demonstrate that replication improves the data access time in Data Grids, and that the gain increases with the size of thedatasets involved.Keywords
This publication has 8 references indexed in Scilit:
- Data replication strategies in grid environmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Improving Data Availability through Dynamic Model-Driven Replication in Large Peer-to-Peer CommunitiesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- File and object replication in data gridsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Replica selection in the Globus Data GridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The Grid: A New Infrastructure for 21st Century SciencePhysics Today, 2002
- The Anatomy of the Grid: Enabling Scalable Virtual OrganizationsThe International Journal of High Performance Computing Applications, 2001
- From the I-WAY to the National Technology GridCommunications of the ACM, 1997
- Globus: a Metacomputing Infrastructure ToolkitThe International Journal of Supercomputer Applications and High Performance Computing, 1997