Using SciDB to Support Photon Science Data Analysis

Becla, Jack ; Wang, Daniel ; lim, Kian-Tat ; /SLAC

关键词: BENCHMARKS;    COMPUTER CODES;    DATA ANALYSIS;    DATA BASE MANAGEMENT;    DATA PROCESSING;    LIGHT SOURCES;    STANFORD LINEAR ACCELERATOR CENTER;    PHOTONS;    STORAGE Computing;    COMP;   

DOI  :  10.2172/1035090
RP-ID  :  SLAC-TN-11-020
PID  :  OSTI ID: 1035090
Others  :  TRN: US1201125

学科分类：核物理和高能物理

美国|英语

来源: SciTech Connect

【 摘 要 】

Array data analytic systems like SciDB hold great potential to accelerate processing data from SLAC's Linac Coherent Light Source and other experiments. SciDB is unique in its ability to integrate storage and processing of array data efficiently, providing both space-efficient storage and out-of-memory efficient parallel array processing. We describe a recent effort to leverage SciDB to store and process LCLS data. The work includes development of software to import data into SciDB, subsequent benchmarks, and interactive manipulation of data in SciDB.