Using SciDB to Support Photon Science Data Analysis

Becla, Jack ; Wang, Daniel ; lim, Kian-Tat ; /SLAC

SLAC National Accelerator Laboratory

关键词: Data Analysis;    Light Sources;    Photons;    43 Particle Accelerators;    Benchmarks;   

DOI  :  10.2172/1035090
RP-ID  :  SLAC-TN-11-020
RP-ID  :  AC02-76SF00515
RP-ID  :  1035090

美国|英语

来源: UNT Digital Library

【 摘 要 】

Array data analytic systems like SciDB hold great potential to accelerate processing data from SLAC's Linac Coherent Light Source and other experiments. SciDB is unique in its ability to integrate storage and processing of array data efficiently, providing both space-efficient storage and out-of-memory efficient parallel array processing. We describe a recent effort to leverage SciDB to store and process LCLS data. The work includes development of software to import data into SciDB, subsequent benchmarks, and interactive manipulation of data in SciDB.