BESIII physical offline data analysis on virtualization platform

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Huang, Q.^1 ; Li, H.^1 ; Kan, B.^1 ; Shi, J.^1 ; Lei, X.^1,2

IHEP Computing Center, 19B Yuquan Road, Beijing

100049, China^1

University of Chinese, Academy of Sciences, Beijing, China^2

关键词: Computing system;    Job processing;    Off-line softwares;    Performance comparison;    Performance evaluations;    Performance penalties;    Resource utilizations;    Virtualization technologies;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/2/022024/pdf
DOI  :  10.1088/1742-6596/664/2/022024

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

In this contribution, we present an ongoing work, which aims at benefiting BESIII computing system for higher resource utilization and more efficient job operations brought by cloud and virtualization technology with Openstack and KVM. We begin with the architecture of BESIII offline software to understand how it works. We mainly report the KVM performance evaluation and optimization from various factors in hardware and kernel. Experimental results show the CPU performance penalty of KVM can be approximately decreased to 3%. In addition, the performance comparison between KVM and physical machines in aspect of CPU, disk IO and network IO is also presented. Finally, we present our development work, an adaptive cloud scheduler, which allocates and reclaims VMs dynamically according to the status of TORQUE queue and the size of resource pool to improve resource utilization and job processing efficiency.