Next Generation PanDA Pilot for ATLAS and Other Experiments

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Nilsson, P.^1 ; Megino, F. Barreiro^2 ; Bejar, J. Caballero^3 ; De, K.^1 ; Hover, J.^3 ; Love, P.^4 ; Maeno, T.^3 ; Llamas, R. Medrano^2 ; Walker, R.^5 ; Wenaus, T.^3

University of Texas at Arlington, United States^1

CERN, Switzerland^2

Brookhaven National Laboratory, United States^3

Lancaster University, United Kingdom^4

Ludwig-Maximilians-University Muenchen, Germany^5

关键词: ATLAS experiment;    Data access;    Distributed analysis system;    Pilot system;    Plug-ins;    Storage elements;    Time-scales;    Worker nodes;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/3/032071/pdf
DOI  :  10.1088/1742-6596/513/3/032071

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The Production and Distributed Analysis system (PanDA) has been in use in the ATLAS Experiment since 2005. It uses a sophisticated pilot system to execute submitted jobs on the worker nodes. While originally designed for ATLAS, the PanDA Pilot has recently been refactored to facilitate use outside of ATLAS. Experiments are now handled as plug-ins such that a new PanDA Pilot user only has to implement a set of prototyped methods in the plug-in classes, and provide a script that configures and runs the experiment-specific payload. We will give an overview of the Next Generation PanDA Pilot system and will present major features and recent improvements including live user payload debugging, data access via the Federated XRootD system, stage-out to alternative storage elements, support for the new ATLAS DDM system (Rucio), and an improved integration with glExec, as well as a description of the experiment-specific plug-in classes. The performance of the pilot system in processing LHC data on the OSG, LCG and Nordugrid infrastructures used by ATLAS will also be presented. We will describe plans for future development on the time scale of the next few years.