Distributed Computing for the Pierre Auger Observatory

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Chudoba, J.^1

Institute of Physics of the CAS, Na Slovance 1999/2, Prague

18221, Czech Republic^1

关键词: Bulk production;    Distributed resources;    MySQL database;    Pierre Auger observatory;    Production system;    Software distributions;    Ultra high-energy cosmic rays;    Virtual organization;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/3/032005/pdf
DOI  :  10.1088/1742-6596/664/3/032005

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

Pierre Auger Observatory operates the largest system of detectors for ultra-high energy cosmic ray measurements. Comparison of theoretical models of interactions with recorded data requires thousands of computing cores for Monte Carlo simulations. Since 2007 distributed resources connected via EGI grid are successfully used. The first and the second versions of production system based on bash scripts and MySQL database were able to submit jobs to all reliable sites supporting Virtual Organization auger. For many years VO auger belongs to top ten of EGI users based on the total used computing time. Migration of the production system to DIRAC interware started in 2014. Pilot jobs improve efficiency of computing jobs and eliminate problems with small and less reliable sites used for the bulk production. The new system has also possibility to use available resources in clouds. Dirac File Catalog replaced LFC for new files, which are organized in datasets defined via metadata. CVMFS is used for software distribution since 2014. In the presentation we give a comparison of the old and the new production system and report the experience on migrating to the new system.