Integration of XRootD into the cloud infrastructure for ALICE data analysis

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Kompaniets, Mikhail^1 ; Shadura, Oksana^2,3,4 ; Svirin, Pavlo^2,3 ; Yurchenko, Volodymyr^3,4 ; Zarochentsev, Andrey^1

Saint Petersburg State University, Russia^1

CERN, Switzerland^2

National Technical Univ. of Ukraine, Kyiv Polytechnic Institute, Ukraine^3

Bogolyubov Institute for Theoretical Physics, Ukraine^4

关键词: Cloud infrastructures;    Computing activity;    Computing resource;    Configuration management systems;    Data analysis models;    Data preservations;    Distributed storage;    Small organizations;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/2/022036/pdf
DOI  :  10.1088/1742-6596/664/2/022036

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments. We present a cloud solution for Tier-3 sites based on OpenStack and Ceph distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is based on idea that Ceph has been used as a backend for Cinder Block Storage service for OpenStack, and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by Ceph settings. For faster and easier OpenStack deployment was applied the Packstack solution, which is based on the Puppet configuration management system. Ceph installation and configuration operations are structured and converted to Puppet manifests describing node configurations and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organizations, which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU & BITP) and integrates successfully with the ALICE data analysis model.