Distributed job scheduling in MetaCentrum

16th International workshop on Advanced Computing and Analysis Techniques in physics research

物理学;计算机科学

Tóth, Šimon^1 ; Ruda, Miroslav^1

CESNET A.l.e., Zikova 4, Prague 6

160 00, Czech Republic^1

关键词: Cooperative scheduling;    Czech Republic;    Distributed job scheduling;    Distributed setups;    Resource managers;    Unique features;    Utilized resources;    Virtual clusters;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/608/1/012025/pdf
DOI  :  10.1088/1742-6596/608/1/012025

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

MetaCentrum - The Czech National Grid provides access to various resources across the Czech Republic. The utilized resource management and scheduling system is based on a heavily modified version of the Torque Batch System. This open source resource manager is maintained in a local fork and was extended to facilitate the requirements of such a large installation. This paper provides an overview of unique features deployed in MetaCentrum. Notably, we describe our distributed setup that encompasses several standalone independent servers while still maintaining full cooperative scheduling across the grid. We also present the benefits of our virtualized infrastructure that enables our schedulers to dynamically request ondemand virtual machines, that are then used to facilitate the varied requirements of users in our system, as well as enabling support for user requested virtual clusters that can be further interconnected using a private VLAN.