NoSQL technologies for the CMS Conditions Database

21st International Conference on Computing in High Energy and Nuclear Physics

物理学;计算机科学

Sipos, Roland^1

CERN, Geneve 23

CH-1211, Switzerland^1

关键词: Additional datum;    Column-oriented;    Conditions database;    Key-value stores;    Off-line softwares;    Performance comparison;    Special treatments;    Testing framework;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/664/4/042050/pdf
DOI  :  10.1088/1742-6596/664/4/042050

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

With the restart of the LHC in 2015, the growth of the CMS Conditions dataset will continue, therefore the need of consistent and highly available access to the Conditions makes a great cause to revisit different aspects of the current data storage solutions. We present a study of alternative data storage backends for the Conditions Databases, by evaluating some of the most popular NoSQL databases to support a key-value representation of the CMS Conditions. The definition of the database infrastructure is based on the need of storing the conditions as BLOBs. Because of this, each condition can reach the size that may require special treatment (splitting) in these NoSQL databases. As big binary objects may be problematic in several database systems, and also to give an accurate baseline, a testing framework extension was implemented to measure the characteristics of the handling of arbitrary binary data in these databases. Based on the evaluation, prototypes of a document store, using a column-oriented and plain key-value store, are deployed. An adaption layer to access the backends in the CMS Offline software was developed to provide transparent support for these NoSQL databases in the CMS context. Additional data modelling approaches and considerations in the software layer, deployment and automatization of the databases are also covered in the research. In this paper we present the results of the evaluation as well as a performance comparison of the prototypes studied.