Toward a petabyte-scale AFS service at CERN

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Ster, Daniel Van Der^1 ; Moscicki, Jakub T.^1 ; Wiebalck, Arne^1

CERN, Geneva, Switzerland^1

关键词: File servers;    Hardware and software components;    Optimisations;    Project spaces;    Remote users;    Service offering;    Storage services;    Usage patterns;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/4/042046/pdf
DOI  :  10.1088/1742-6596/513/4/042046

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

AFS is a mature and reliable storage service at CERN, having worked for more than 20 years as the provider of Unix home directories and project areas. Recently, the AFS service has grown at unprecedented rates (200% in the past year); this growth was unlocked thanks to innovations in both the hardware and software components of our file servers. This work presents how AFS is used at CERN and how the service offering is evolving with the increasing storage needs of its local and remote user communities. In particular, we demonstrate the usage patterns for home directories, workspaces and project spaces, as well as show the daily work which is required to rebalance data and maintaining stability and performance. Finally, we highlight some recent changes and optimisations made to the AFS Service, thereby revealing how AFS can possibly operate at all while being subjected to frequent-almost DDOS-like-attacks from its users.