Evaluating Google Compute Engine with PROOF

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Ganis, Gerardo^1 ; Panitkin, Sergey^2

CERN, PH Departement, SFT Group, Geneva 23

CH 1211, Switzerland^1

Brookhaven National Laboratory, Upton

NY, United States^2

关键词: Cloud platforms;    Experimental platform;    Large-scale proofs;    LHC experiments;    Multi-Processes;    Persistent storage;    Public markets;    Single- machines;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/3/032036/pdf
DOI  :  10.1088/1742-6596/513/3/032036

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The advent of private and commercial cloud platforms has opened the question of evaluating the cost-effectiveness of such solution for computing in High Energy Physics . Google Compute Engine (GCE) is a IaaS product launched by Google as an experimental platform during 2012 and now open to the public market. In this contribution we present the results of a set of CPU-intensive and I/O-intensive tests we have run with PROOF on a GCE resources made available by Google for test purposes. We have run tests on large scale PROOF clusters (up to 1000 workers) to study the overall scalability of coordinated multi-process jobs. We have studied and compared the performance of ephemeral and persistent storage with PROOF-Lite on the single machines and of standard PROOF on the whole cluster. We will discuss our results in perspective, in particular with respect to the typical analysis needs of an LHC experiment.