Integration of cloud-based storage in BES III computing environment

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Wang, L.^1 ; Hernandez, F.^1,2 ; Deng, Z.^3

IHEP Computing Centre, 19B Yuquan Road, Beijing

100049, China^1

IN2P3/CNRS Computing Centre, bd du 11 Novembre 1918, 43, Villeurbanne Cedex

69622, France^2

IHEP Experimental Physics Centre, 19B Yuquan Road, Beijing

100049, China^3

关键词: Analysis frameworks;    Cloud storages;    Computing environments;    Data repositories;    Interactive session;    Lustre file systems;    Physics experiments;    Software stacks;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/4/042050/pdf
DOI  :  10.1088/1742-6596/513/4/042050

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

We present an on-going work that aims to evaluate the suitability of cloud-based storage as a supplement to the Lustre file system for storing experimental data for the BES III physics experiment and as a backend for storing files belonging to individual members of the collaboration. In particular, we discuss our findings regarding the support of cloud-based storage in the software stack of the experiment. We report on our development work that improves the support of CERN' s ROOT data analysis framework and allows efficient remote access to data through several cloud storage protocols. We also present our efforts providing the experiment with efficient command line tools for navigating and interacting with cloud storage-based data repositories both from interactive sessions and grid jobs.