ARC Control Tower: A flexible generic distributed job management framework

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Nilsen, J.K.^1 ; Cameron, D.^2 ; Filipi, A.^3

University Center for Information Technology, University of Oslo, Norway^1

Department of Physics, University of Oslo, Norway^2

Department of Experimental High Energy Physics, Jozef Stefan Institute, Norway^3

关键词: Client tools;    Distributed job;    Distributed setups;    GRID middleware;    Job management;    Multi-server;    Single users;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/6/062042/pdf
DOI  :  10.1088/1742-6596/664/6/062042

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management framework that can be run on anything from a single users laptop to a multi-server distributed setup. aCT was originally designed to enable ATLAS jobs to be submitted to the ARC CE. However, with the recent redesign of aCT where the ATLAS specific elements are clearly separated from the ARC job management parts, the control tower can now easily be reused as a flexible generic distributed job manager for other communities. This paper will give a detailed explanation how aCT works as a job management framework and go through the steps needed to create a simple job manager using aCT and show that it can easily manage thousands of jobs.