Ceph-based storage services for Run2 and beyond

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Van Der Ster, Daniel C.^1 ; Lamanna, Massimo^1 ; Mascetti, Luca^1 ; Peters, Andreas J.^1 ; Rousseau, Hervé^1

CERN, Geneva, Switzerland^1

关键词: Best practices;    Cloud storages;    Data archival;    Data processing applications;    Object interfaces;    Storage requirements;    Storage services;    User communities;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/4/042054/pdf
DOI  :  10.1088/1742-6596/664/4/042054

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

In 2013, CERN IT evaluated then deployed a petabyte-scale Ceph cluster to support OpenStack use-cases in production. With now more than a year of smooth operations, we will present our experience and tuning best-practices. Beyond the cloud storage use-cases, we have been exploring Ceph-based services to satisfy the growing storage requirements during and after Run2. First, we have developed a Ceph back-end for CASTOR, allowing this service to deploy thin disk server nodes which act as gateways to Ceph; this feature marries the strong data archival and cataloging features of CASTOR with the resilient and high performance Ceph subsystem for disk. Second, we have developed RADOSFS, a lightweight storage API which builds a POSIX-like filesystem on top of the Ceph object layer. When combined with Xrootd, RADOSFS can offer a scalable object interface compatible with our HEP data processing applications. Lastly the same object layer is being used to build a scalable and inexpensive NFS service for several user communities.