An Optimizing Compiler for Petascale I/O on Leadership Class Architectures

Choudhary, Alok¹  Kandemir, Mahmut² 

[1] Northwestern Univ., Evanston, IL (United States);Pennsylvania State Univ., State College, PA (United States)

关键词: parallel I/O;    high-performance computing;   

DOI  :  10.2172/1172903
RP-ID  :  DOE-NWU--0001283
PID  :  OSTI ID: 1172903

学科分类：数学（综合）

美国|英语

来源: SciTech Connect

【 摘 要 】

In high-performance computing systems, parallel I/O architectures usually have very complex hierarchies with multiple layers that collectively constitute an I/O stack, including high-level I/O libraries such as PnetCDF and HDF5, I/O middleware such as MPI-IO, and parallel file systems such as PVFS and Lustre. Our project explored automated instrumentation and compiler support for I/O intensive applications. Our project made significant progress towards understanding the complex I/O hierarchies of high-performance storage systems (including storage caches, HDDs, and SSDs), and designing and implementing state-of-the-art compiler/runtime system technology that targets I/O intensive HPC applications that target leadership class machine. This final report summarizes the major achievements of the project and also points out promising future directions.