ATLAS Eventlndex monitoring system using the Kibana analytics and visualization platform

17th International Workshop on Advanced Computing and Analysis Techniques in Physics Research

物理学;计算机科学

Barberis, D.^1 ; Cárdenas Zárate, S.E.^2 ; Favareto, A.^3 ; Fernandez Casani, A.^4 ; Gallas, E.J.^5 ; Garcia Montoro, C.^4 ; Gonzalez De La Hoz, S.^4 ; Hrivnac, J.^6 ; Malon, D.^7 ; Prokoshin, F.^2 ; Salt, J.^4 ; Sanchez, J.^4 ; Toebbicke, R.^8 ; Yuan, R.^6

Università di Genova and INFN, Genova, Italy^1

Universidad Técnica Federico Santa María, Valparaíso, Chile^2

Università degli Studi and INFN, Genova, Italy^3

Instituto de Física Corpuscular, Valencia, Spain^4

Department of Physics, Oxford University, Oxford, United Kingdom^5

Laboratoire de l'Accélérateur Linéaire, Orsay, France^6

Argonne National Laboratory, Argonne, United States^7

CERN Europe, France^8

关键词: Distributed storage;    Health parameters;    Monitoring system;    Producer consumers;    Service monitoring;    Sources of informations;    Visualization packages;    Visualization platforms;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/762/1/012004/pdf
DOI  :  10.1088/1742-6596/762/1/012004

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need to monitor the conditions of many heterogeneous subsystems, to make sure everything is working correctly. This paper describes how we gather information about the EventIndex components and related subsystems: the Producer-Consumer architecture for data collection, health parameters from the servers that run EventIndex components, EventIndex web interface status, and the Hadoop infrastructure that stores EventIndex data. This information is collected, processed, and then displayed using CERN service monitoring software based on the Kibana analytic and visualization package, provided by CERN IT Department. EventIndex monitoring is used both by the EventIndex team and ATLAS Distributed Computing shifts crew.