Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Yang, W.^1 ; Hanushevsky, A.B.^1 ; Mount, R.P.^1

SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park

CA

94024, United States^1

关键词: Caching decisions;    Data access;    Large volumes;    Solid state disks;    Spinning disks;    Storage performance;    Storage systems;    User analysis;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/4/042035/pdf
DOI  :  10.1088/1742-6596/513/4/042035

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

User data analysis in high energy physics presents a challenge to spinning-disk based storage systems. The analysis is data intense, yet reads are small, sparse and cover a large volume of data files. It is also unpredictable due to users' response to storage performance. We describe here a system with an array of Solid State Disk as a non-conventional, standalone file level cache in front of the spinning disk storage to help improve the performance of LHC ATLAS user analysis at SLAC. The system uses several days of data access records to make caching decisions. It can also use information from other sources such as a work-flow management system. We evaluate the performance of the system both in terms of caching and its impact on user analysis jobs. The system currently uses Xrootd technology, but the technique can be applied to any storage system.