BESIII production with distributed computing

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Zhang, X.M.^1 ; Yan, T.^1 ; Zhao, X.H.^1 ; Ma, Z.T.^1 ; Yan, X.F.^3 ; Lin, T.^1 ; Deng, Z.Y.^1 ; Li, W.D.^1 ; Belov, S.^2 ; Pelevanyuk, I.^2 ; Zhemchugov, A.^2 ; Cai, H.^3

Institute of High Energy Physics, 19B Yuquan Road, Beijing

100049, China^1

Joint Institute for Nuclear Research, Joliot-Curie 6, Moscow region Dubna

141980, Russia^2

Department of Physics, Wuhan University, 299 Bayi Road, Wuhan

430072, China^3

关键词: Distributed computing systems;    Distributed environments;    Distributed resources;    Heterogeneous computing;    High energy physics experiments;    Metadata management;    Production workflows;    Workload management;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/3/032036/pdf
DOI  :  10.1088/1742-6596/664/3/032036

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

Distributed computing is necessary nowadays for high energy physics experiments to organize heterogeneous computing resources all over the world to process enormous amounts of data. The BESIII experiment in China, has established its own distributed computing system, based on DIRAC, as a supplement to local clusters, collecting cluster, grid, desktop and cloud resources from collaborating member institutes around the world. The system consists of workload management and data management to deal with the BESIII Monte Carlo production workflow in a distributed environment. A dataset-based data transfer system has been developed to support data movements among sites. File and metadata management tools and a job submission frontend have been developed to provide a virtual layer for BESIII physicists to use distributed resources. Moreover, the paper shows the experience to cope with lack of grid experience and low manpower among the BESIII community.