Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Di Nardo, R.^2 ; Ganis, G.^1 ; Vilucchi, E.^2 ; Albicocco, P.^2 ; Antonelli, M.^2

CERN, Geneva 23

CH-1211, Switzerland^1

INFN Laboratori Nazionali di Frascati, via E. Fermi 40, Frascati (RM)

00044, Italy^2

关键词: Analysis frameworks;    Benchmark tests;    Clusters of computers;    Data management system;    Expected improvements;    Grid resource;    Multi-core machines;    Resource management systems;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/4/042019/pdf
DOI  :  10.1088/1742-6596/664/4/042019

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performance obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work.