DataSeries: An Efficient, Flexible Data Format for Structured Serial Data

Anderson, Eric ; Arlitt, Martin ; Morrey III, Charles B. ; Veitch, Alistair

HP Development Company

关键词: data series;    data format;    structured serial data;    data sets;   

RP-ID  :  HPL-2009-323

学科分类：计算机科学（综合）

美国|英语

来源: HP Labs

【 摘 要 】

Structured serial data is used in many scientific fields; such data sets consist of a series of records, and are typically written once, read many times, chronologically ordered, and read sequentially. In this paper we introduce DataSeries, an on-disk format, run-time library and set of tools for storing and analyzing structured serial data. We identify six key properties of a system to store and analyze this type of data, and describe how DataSeries was designed to provide these properties. We quantify the benefits of DataSeries through several experiments. In particular, we demonstrate that DataSeries exceeds the performance of common trace formats by at least a factor of two.