Using the glideinWMS System as a Common Resource Provisioning Layer in CMS

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Balcas, J.^1 ; Belforte, S.^2 ; Bockelman, B.^3 ; Colling, D.^4 ; Gutsche, O.^5 ; Hufnagel, D.^5 ; Khan, F.^6 ; Larson, K.^5 ; Letts, J.^7 ; Mascheroni, M.^8 ; Mason, D.^5 ; McCrea, A.^7 ; Piperov, S.^9 ; Saiz-Santos, M.^7 ; Sfiligoi, I.^7 ; Tanasijczuk, A.^7 ; Wissing, C.^10

Vilnius University, Vilnius, Lithuania^1

Universitá di Trieste, INFN Sezione di Trieste, Trieste, Italy^2

University of Nebraska, Lincoln, United States^3

Imperial College London, United Kingdom^4

Fermi National Accelerator Laboratory, Batavia, United States^5

National Centre for Physics, Quaid-I-Azam University, Islamabad, Pakistan^6

University of California, San Diego, United States^7

INFN Sezione di Milano-Bicocca, Universitá di Milano-Bicocca, Milan, Italy^8

Brown University, Providence, United States

(10) Deutsches Elektronen-Synchrotron, Hamburg, Germany^9

关键词: Cloud infrastructures;    Common resources;    Efficiency gain;    Physics programs;    Processor cores;    Resource provisioning;    Supercomputing centers;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/6/062031/pdf
DOI  :  10.1088/1742-6596/664/6/062031

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

CMS will require access to more than 125k processor cores for the beginning of Run 2 in 2015 to carry out its ambitious physics program with more and higher complexity events. During Run1 these resources were predominantly provided by a mix of grid sites and local batch resources. During the long shut down cloud infrastructures, diverse opportunistic resources and HPC supercomputing centers were made available to CMS, which further complicated the operations of the submission infrastructure. In this presentation we will discuss the CMS effort to adopt and deploy the glideinWMS system as a common resource provisioning layer to grid, cloud, local batch, and opportunistic resources and sites. We will address the challenges associated with integrating the various types of resources, the efficiency gains and simplifications associated with using a common resource provisioning layer, and discuss the solutions found. We will finish with an outlook of future plans for how CMS is moving forward on resource provisioning for more heterogenous architectures and services.