Efficient Storage Scaling for MBR and MSR Codes

IEEE Access

Xiaoyang Zhang¹  Yuchong Hu¹ 

[1] Key Laboratory of Information Storage System, Ministry of Education, Wuhan, China;

关键词: Storage scaling;    erasure codes;    regenerating codes;    distributed file systems;   

DOI  :  10.1109/ACCESS.2020.2989822

来源: DOAJ

【 摘 要 】

Due to the explosive growth of storage demands, distributed storage systems need to support storage scaling efficiently. Recent work optimizes scaling in a decentralized manner for Reed-solomon coded storage systems. In this paper, we focus on storage scaling for storage systems with regenerating codes and design two efficient scaling algorithms for minimum bandwidth regenerating (MBR) and minimum storage regenerating (MSR) codes. We integrate these two scaling algorithms into Hadoop Distributed File System (HDFS), and the experiments on Amazon EC2 show that the scaling bandwidth can be reduced up to 75% and 43.8% over the centralized scaling.

【 授权许可】

Unknown