Achieving production-level use of HEP software at the Argonne Leadership Computing Facility

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Uram, T.D.^1 ; Childers, J.T.^1 ; Lecompte, T.J.^1 ; Papka, M.E.^1,2 ; Benjamin, D.^3

Argonne National Laboratory, Argonne

IL, United States^1

Northern Illinois University, Dekalb

IL, United States^2

Duke University, Durham

NC, United States^3

关键词: Compute resources;    Computing facilities;    Computing resource;    Event generators;    LHC experiments;    Local cluster;    Production level;    Production system;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/6/062063/pdf
DOI  :  10.1088/1742-6596/664/6/062063

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

HEP's demand for computing resources has grown beyond the capacity of the Grid, and these demands will accelerate with the higher energy and luminosity planned for Run II. Mira, the ten petaFLOPs supercomputer at the Argonne Leadership Computing Facility, is a potentially significant compute resource for HEP research. Through an award of fifty million hours on Mira, we have delivered millions of events to LHC experiments by establishing the means of marshaling jobs through serial stages on local clusters, and parallel stages on Mira. We are running several HEP applications, including Alpgen, Pythia, Sherpa, and Geant4. Event generators, such as Sherpa, typically have a split workload: a small scale integration phase, and a second, more scalable, event-generation phase. To accommodate this workload on Mira we have developed two Python-based Django applications, Balsam and ARGO. Balsam is a generalized scheduler interface which uses a plugin system for interacting with scheduler software such as HTCondor, Cobalt, and TORQUE. ARGO is a workflow manager that submits jobs to instances of Balsam. Through these mechanisms, the serial and parallel tasks within jobs are executed on the appropriate resources. This approach and its integration with the PanDA production system will be discussed.