Multicloud Deployment of Computing Clusters for Loosely Coupled MTC Applications
- 28 October 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 22 (6) , 924-930
- https://doi.org/10.1109/tpds.2010.186
Abstract
Cloud computing is gaining acceptance in many IT organizations, as an elastic, flexible, and variable-cost way to deploy their service platforms using outsourced resources. Unlike traditional utilities where a single provider scheme is a common practice, the ubiquitous access to cloud resources easily enables the simultaneous use of different clouds. In this paper, we explore this scenario to deploy a computing cluster on the top of a multicloud infrastructure, for solving loosely coupled Many-Task Computing (MTC) applications. In this way, the cluster nodes can be provisioned with resources from different clouds to improve the cost effectiveness of the deployment, or to implement high-availability strategies. We prove the viability of this kind of solutions by evaluating the scalability, performance, and cost of different configurations of a Sun Grid Engine cluster, deployed on a multicloud infrastructure spanning a local data center and three different cloud sites: Amazon EC2 Europe, Amazon EC2 US, and ElasticHosts. Although the testbed deployed in this work is limited to a reduced number of computing resources (due to hardware and budget limitations), we have complemented our analysis with a simulated infrastructure model, which includes a larger number of resources, and runs larger problem sizes. Data obtained by simulation show that performance and cost results can be extrapolated to large-scale problems and cluster infrastructures.Keywords
This publication has 11 references indexed in Scilit:
- An elasticity model for High Throughput Computing clustersJournal of Parallel and Distributed Computing, 2011
- The Real Cost of a CPU HourComputer, 2009
- Dynamic Provisioning of Virtual Organization ClustersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Many-task computing for grids and supercomputersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- FalkonPublished by Association for Computing Machinery (ACM) ,2007
- Creating Personal Adaptive Clusters for Managing Scientific Jobs in a Distributed Computing EnvironmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Virtual Clusters for Grid CommunitiesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- VioCluster: Virtualization for Dynamic Computational Domains2005 IEEE International Conference on Cluster Computing, 2005
- Dynamic virtual clusters in a grid site managerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- NAS Grid Benchmarks: a tool for Grid space explorationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002