A Flexible Monitoring Infrastructure for the Simulation Requests

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Spinoso, V.^1 ; Missiato, M.^1

INFN, Bari, Italy^1

关键词: Back ends;    Cross languages;    Data caches;    Software deployment;    Web service interface;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/3/032092/pdf
DOI  :  10.1088/1742-6596/513/3/032092

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

Running and monitoring simulations usually involves several different aspects of the entire workflow: the configuration of the job, the site issues, the software deployment at the site, the file catalogue, the transfers of the simulated data. In addition, the final product of the simulation is often the result of several sequential steps. This project tries a different approach to monitoring the simulation requests. All the necessary data are collected from the central services which lead the submission of the requests and the data management, and stored by a backend into a NoSQL-based data cache; those data can be queried through a Web Service interface, which returns JSON responses, and allows users, sites, physics groups to easily create their own web frontend, aggregating only the needed information. As an example, it will be shown how it is possible to monitor the CMS services (ReqMgr, DAS/DBS, PhEDEx) using a central backend and multiple customized cross-language frontends.