Experiences and challenges running CERN's high capacity tape archive

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Cancio, Germán^1 ; Bahyl, Vladimír^1 ; Kruse, Daniele Francesco^1 ; Leduc, Julien^1 ; Cano, Eric^1 ; Murray, Steven^1

CERN - European Organization for Nuclear Research, Geneva 23

CH-1211, Switzerland^1

关键词: Archive systems;    Capacity requirement;    Data repositories;    High capacity;    Long term archival;    Long-term integrity;    Problem detection;    Technology evolution;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/4/042006/pdf
DOI  :  10.1088/1742-6596/664/4/042006

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. During LHC Run 2, the archive will have to cope with yearly growth rates of up to 40-50 Petabytes. In this contribution, we describe the scalable setup for coping with the storage and long-term archival of such massive data amounts. We also review the challenges resulting and mechanisms devised for measuring and enhancing availability and reliability, as well as ensuring the long-term integrity and bit-level preservation of the complete data repository. The procedures and tools for the proactive and efficient operation of the tape infrastructure are described, including the features developed for automated problem detection, identification and notification. Finally, we present an outlook in terms of future capacity requirements growth and how it matches the expected tape technology evolution.