The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

De Salvo, A.^1 ; Kataoka, M.^2 ; Sanchez Pineda, A.^3 ; Smirnov, Y.^4

INFN Sezione di Romal, Italy^1

University of Texas at Arlington, United States^2

Università di Napoli Federico II, Italy^3

CERN, Switzerland^4

关键词: Automatic agents;    Geographical locations;    Grid information systems;    High availability;    Highly available systems;    Original systems;    Virtual organization;    Workload management;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/6/062012/pdf
DOI  :  10.1088/1742-6596/664/6/062012

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original Workload Management Service (WMS) and the new PanDA modules. The database engine has been changed from plain MySQL to Galera/Percona and the table structure has been optimized to allow a full High-Availability (HA) solution over Wide Area Network. The servlets, running on each frontend, have been also decoupled from local settings, to allow an easy scalability of the system, including the possibility of an HA system with multiple sites. The clients can also be run in multiple copies and in different geographical locations, and take care of sending the installation and validation jobs to the target Grid or Cloud sites. Moreover, the Installation Database is used as source of parameters by the automatic agents running in CVMFS, in order to install the software and distribute it to the sites. The system is in production for ATLAS since 2013, having as main sites in HA the INFN Roma Tier 2 and the CERN Agile Infrastructure. The Light Job Submission Framework for Installation (LJSFi) v2 engine is directly interfacing with PanDA for the Job Management, the Atlas Grid Information System (AGIS) for the site parameter configurations, and CVMFS for both core components and the installation of the software itself. LJSFi2 is also able to use other plugins, and is essentially Virtual Organization (VO) agnostic, so can be directly used and extended to cope with the requirements of any Grid or Cloud enabled VO. In this work we will present the architecture, performance, status and possible evolutions to the system for the LHC Run2 and beyond.