会议论文详细信息
20th International Conference on Computing in High Energy and Nuclear Physics
The DMLite Rucio Plugin: ATLAS data in a filesystem
物理学;计算机科学
Lassnig, M.^1 ; Dongen, D. Van^2 ; Rocha, R Brito Da^1 ; Ayllon, A. Alvarez^1 ; Calfayan, P.^3
European Organization for Nuclear Research (CERN), Geneva
1211, Switzerland^1
Radboud Universiteit, Nijmegen
6525, Netherlands^2
Ludwig-Maximilians-Universität, Munich
80539, Germany^3
关键词: ATLAS experiment;    Client software;    Data management system;    Design and implementations;    Namespaces;    Performance characteristics;    Physics analysis;    Software stacks;   
Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/4/042030/pdf
DOI  :  10.1088/1742-6596/513/4/042030
学科分类:计算机科学(综合)
来源: IOP
PDF
【 摘 要 】

Rucio is the next-generation data management system of the ATLAS experiment. Historically, clients interacted with the data management system via specialised tools, but in Rucio additional methods are provided. To support filesystem-like interaction with all ATLAS data, a plugin to the DMLite software stack has been developed. It is possible to mount Rucio as a filesystem, and execute regular filesystem operations in a POSIX fashion. This is exposed via various protocols, for example, WebDAV or NFS, which then removes any dependency on Rucio for client software. The main challenge for this work is the mapping of the set-like ATLAS namespace into a hierarchical filesystem, whilst preserving the high performance features of the former. This includes listing and searching for data, creation of files, datasets and containers, and the aggregation of existing data-all within directories with potentially millions of entries. This contribution details the design and implementation of the plugin. Furthermore, an evaluation of the performance characteristics is given, to show that this approach can scale to the requirements of ATLAS physics analysis.

【 预 览 】
附件列表
Files Size Format View
The DMLite Rucio Plugin: ATLAS data in a filesystem 764KB PDF download
  文献评价指标  
  下载次数:23次 浏览次数:19次