Integrating new Storage Technologies into EOS

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Peters, Andreas J.^1 ; Van Der Ster, Dan C.^1 ; Rocha, Joaquim^1 ; Lensing, Paul^2

CERN IT, Geneva, Switzerland^1

Seagate Technologies/CERN Openlab, Geneva, Switzerland^2

关键词: High-level services;    Object storage systems;    Open source development;    Replicated storage;    Software and hardwares;    Storage platforms;    Storage services;    Storage technology;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/4/042043/pdf
DOI  :  10.1088/1742-6596/664/4/042043

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The EOS[1] storage software was designed to cover CERN disk-only storage use cases in the medium-term trading scalability against latency. To cover and prepare for long-term requirements the CERN IT data and storage services group (DSS) is actively conducting R&D and open source contributions to experiment with a next generation storage software based on CEPH[3] and ethernet enabled disk drives. CEPH provides a scale-out object storage system RADOS and additionally various optional high-level services like S3 gateway, RADOS block devices and a POSIX compliant file system CephFS. The acquisition of CEPH by Redhat underlines the promising role of CEPH as the open source storage platform of the future. CERN IT is running a CEPH service in the context of OpenStack on a moderate scale of 1 PB replicated storage. Building a 100+PB storage system based on CEPH will require software and hardware tuning. It is of capital importance to demonstrate the feasibility and possibly iron out bottlenecks and blocking issues beforehand. The main idea behind this R&D is to leverage and contribute to existing building blocks in the CEPH storage stack and implement a few CERN specific requirements in a thin, customisable storage layer. A second research topic is the integration of ethernet enabled disks. This paper introduces various ongoing open source developments, their status and applicability.