FIFE-Jobsub: a grid submission system for intensity frontier experiments at Fermilab

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Box, Dennis^1

Scientific Computing Division, Fermi National Accelerator Laboratory, PO Box 500, Batavia

IL

60510, United States^1

关键词: Batch jobs;    Data transfer methods;    Directed acyclic graph (DAG);    Fermilab;    Open science grid;    Shared resources;    Toolsuite;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/3/032010/pdf
DOI  :  10.1088/1742-6596/513/3/032010

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The Fermilab Intensity Frontier Experiments use an integrated submission system known as FIFE-jobsub, part of the FIFE (Fabric for Frontier Experiments) initiative, to submit batch jobs to the Open Science Grid. FIFE-jobsub eases the burden on experimenters by integrating data transfer and site selection details in an easy to use and well-documented format. FIFE-jobsub automates tedious details of maintaining grid proxies for the lifetime of the grid job. Data transfer is handled using the Intensity Frontier Data Handling Client (IFDHC) [1] tool suite, which facilitates selecting the appropriate data transfer method from many possibilities while protecting shared resources from overload. Chaining of job dependencies into Directed Acyclic Graphs (Condor DAGS) is well supported and made easier through the use of input flags and parameters.