Implementation of Grid Tier 2 and Tier 3 facilities on a Distributed OpenStack Cloud

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Limosani, Antonio^1 ; Boland, Lucien^2 ; Coddington, Paul^3 ; Crosby, Sean^2 ; Huang, Joanna^2 ; Sevior, Martin^2 ; Wilson, Ross^3 ; Zhang, Shunde^3

ARC Centre of Excellence in Particle Physics at the Tera-scale, School of Physics, University of Sydney, Camperdown

NSW

2006, Australia^1

ARC Centre of Excellence in Particle Physics at the Tera-scale, School of Physics, University of Melbourne, Parkville

3010, Australia^2

EResearch SA, Hedge House, University of Adelaide, 14 Little Queen Street, Thebarton

SA

5031, Australia^3

关键词: Academic community;    Computing clusters;    Computing infrastructures;    Dynamic allocations;    Dynamic torques;    Government IS;    Remote files;    Storage facilities;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/3/032058/pdf
DOI  :  10.1088/1742-6596/513/3/032058

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The Australian Government is making a $AUD 100 million investment in Compute and Storage for the academic community. The Compute facilities are provided in the form of 30,000 CPU cores located at 8 nodes around Australia in a distributed virtualized Infrastructure as a Service facility based on OpenStack. The storage will eventually consist of over 100 petabytes located at 6 nodes. All will be linked via a 100 Gb/s network. This proceeding describes the development of a fully connected WLCG Tier-2 grid site as well as a general purpose Tier-3 computing cluster based on this architecture. The facility employs an extension to Torque to enable dynamic allocations of virtual machine instances. A base Scientific Linux virtual machine (VM) image is deployed in the OpenStack cloud and automatically configured as required using Puppet. Custom scripts are used to launch multiple VMs, integrate them into the dynamic Torque cluster and to mount remote file systems. We report on our experience in developing this nation-wide ATLAS and Belle II Tier 2 and Tier 3 computing infrastructure using the national Research Cloud and storage facilities.