The grid2003 production grid: principles and practice
- 12 November 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10828907,p. 236-245
- https://doi.org/10.1109/hpdc.2004.1323544
Abstract
The Grid2003 Project has deployed a multivirtual organization, application-driven grid laboratory ("Grid3") that has sustained for several months the production-level services required by physics experiments of the Large Hadron Collider at CERN (ATLAS and CMS), the Sloan Digital Sky Survey project, the gravitational wave search experiment LIGO, the BTeV experiment at Fermilab, as well as applications in molecular structure analysis and genome analysis, and computer science research projects in such areas as job and data scheduling. The deployed infrastructure has been operating since November 2003 with 27 sites, a peak of 2800 processors, work loads from 10 different applications exceeding 1300 simultaneous jobs, and data transfers among sites of greater than 2 TB/day. We describe the principles that have guided the development of this unique infrastructure and the practical experiences that have resulted from its creation and use. We discuss application requirements for grid services deployment and configuration, monitoring infrastructure, application performance, metrics, and operational experiences. We also summarize lessons learned.Keywords
This publication has 15 references indexed in Scilit:
- Chimera: a virtual data system for representing, querying, and automating data derivationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Grids as production computing environments: the engineering aspects of NASA's Information Power GridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Application experiences with the Globus toolkitPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Condor-G: A Computation Management Agent for Multi-Institutional GridsCluster Computing, 2002
- The Anatomy of the Grid: Enabling Scalable Virtual OrganizationsThe International Journal of High Performance Computing Applications, 2001
- High-energy-physics event generation with Pythia 6.1Computer Physics Communications, 2001
- From the I-WAY to the National Technology GridCommunications of the ACM, 1997
- Globus: a Metacomputing Infrastructure ToolkitThe International Journal of Supercomputer Applications and High Performance Computing, 1997
- Overview of the I-Way: Wide-Area Visual SupercomputingThe International Journal of Supercomputer Applications and High Performance Computing, 1996
- MetacomputingCommunications of the ACM, 1992