Development of site-oriented Analytics for Grid computing centres

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Washbrook, A.^2 ; Crooks, D.^1 ; Roy, G.^1 ; Skipsey, S.^1 ; Qin, G.^1 ; Stewart, G.P.^1 ; Britton, D.^1

Kelvin Building, Physics and Astronomy, University of Glasgow, Glasgow

G12 8QQ, United Kingdom^1

SUPA, School of Physics and Astronomy, University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh

EH9 3JZ, United Kingdom^2

关键词: Computing sites;    Distributed sites;    Elasticsearch;    Logstash;    Site operations;    Software stacks;    Systems management;    Work-flows;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/2/022041/pdf
DOI  :  10.1088/1742-6596/664/2/022041

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The field of analytics, the process of analysing data to visualise meaningful patterns and trends, has become increasingly important in scientific computing as the volume and variety of data available to process has significantly increased. There is now ongoing work in the High Energy Physics (HEP) community in this area, for example in the augmentation of systems management at WLCG computing sites. We report on work evaluating the feasibility of distributed site-oriented analytics using the Elasticsearch, Logstash and Kibana software stack and demonstrate functionality by the application of two workflows that give greater insight into site operations.