Challenging data and workload management in CMS Computing with network-aware systems

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Bonacorsi, D.^1 ; Wildish, T.^2

University of Bologna, INFN, Italy^1

Princeton University, Princeton

NJ, United States^2

关键词: Bandwidth on demand;    Intelligent network services;    Operational review;    Reliable Networks;    Replication systems;    Stability and reliabilities;    Technology trends;    Workload management;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/6/062050/pdf
DOI  :  10.1088/1742-6596/513/6/062050

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

After a successful first run at the LHC, and during the Long Shutdown (LS1) of the accelerator, the workload and data management sectors of the CMS Computing Model are entering into an operational review phase in order to concretely assess area of possible improvements and paths to exploit new promising technology trends. In particular, since the preparation activities for the LHC start, the Networks have constantly been of paramount importance for the execution of CMS workflows, exceeding the original expectations - as from the MONARC model - in terms of performance, stability and reliability. The low-latency transfers of PetaBytes of CMS data among dozens of WLCG Tiers worldwide using the PhEDEx dataset replication system is an example of the importance of reliable Networks. Another example is the exploitation of WAN data access over data federations in CMS. A new emerging area of work is the exploitation of Intelligent Network Services, including also bandwidth on demand concepts. In this paper, we will review the work done in CMS on this, and the next steps.