Monitoring in a grid cluster

20th International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Crooks, David^1 ; Mitchell, Mark^1 ; Purdie, Stuart^2 ; Roy, Gareth^1 ; Skipsey, Samuel Cadellin^1 ; Britton, David^1

School of Physics and Astronomy, University of Glasgow, G12 8QQ, United Kingdom^1

University of St Andrews, United Kingdom^2

关键词: Data stream;    Ease-of-use;    Initial time;    Instrumentation packages;    IT infrastructures;    Key elements;    Messaging system;    Monitoring frameworks;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/513/6/062010/pdf
DOI  :  10.1088/1742-6596/513/6/062010

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The monitoring of a grid cluster (or of any piece of reasonably scaled IT infrastructure) is a key element in the robust and consistent running of that site. There are several factors which are important to the selection of a useful monitoring framework, which include ease of use, reliability, data input and output. It is critical that data can be drawn from different instrumentation packages and collected in the framework to allow for a uniform view of the running of a site. It is also very useful to allow different views and transformations of this data to allow its manipulation for different purposes, perhaps unknown at the initial time of installation. In this context, we present the findings of an investigation of the Graphite monitoring framework and its use at the ScotGrid Glasgow site. In particular, we examine the messaging system used by the framework and means to extract data from different tools, including the existing framework Ganglia which is in use at many sites, in addition to adapting and parsing data streams from external monitoring frameworks and websites.