Implementation of a Multi-threaded Framework for Large- scale Scientific Applications

16th International workshop on Advanced Computing and Analysis Techniques in physics research

物理学;计算机科学

Sexton-Kennedy, E.^1 ; Gartung, Patrick^1 ; Jones, C.D.^1 ; Lange, David^2

Fermilab, P.O.Box 500, Batavia

IL

60510-5011, United States^1

Lawrence Livermore National Laboratory, 7000 East Ave, Livermore

CA

94550, United States^2

关键词: Application frameworks;    Complex codes;    Full-scale applications;    Multi-threaded application;    Multithreaded;    Reduced memory;    Scientific applications;    Turn-arounds;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/608/1/012034/pdf
DOI  :  10.1088/1742-6596/608/1/012034

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The CMS experiment has recently completed the development of a multi-threaded capable application framework. In this paper, we will discuss the design, implementation and application of this framework to production applications in CMS. For the 2015 LHC run, this functionality is particularly critical for both our online and offline production applications, which depend on faster turn-around times and a reduced memory footprint relative to before. These applications are complex codes, each including a large number of physics-driven algorithms. While the framework is capable of running a mix of thread-safe and "legacy" modules, algorithms running in our production applications need to be thread-safe for optimal use of this multi-threaded framework at a large scale. Towards this end, we discuss the types of changes, which were necessary for our algorithms to achieve good performance of our multithreaded applications in a full-scale application. Finally performance numbers for what has been achieved for the 2015 run are presented.