Parallel phase model : a programming model for high-end parallel machines with manycores.

Wu, Junfeng (Syracuse University, Syracuse, NY) ; Wen, Zhaofang ; Heroux, Michael Allen ; Brightwell, Ronald Brian

Sandia National Laboratories

关键词: Programming Languages;    Computer Architecture;    99 General And Miscellaneous//Mathematics, Computing, And Information Science;    Implementation;    Parallel Programming (Computer Science)-Research.;   

DOI  :  10.2172/984158
RP-ID  :  SAND2009-2287
RP-ID  :  AC04-94AL85000
RP-ID  :  984158

美国|英语

来源: UNT Digital Library

【 摘 要 】

This paper presents a parallel programming model, Parallel Phase Model (PPM), for next-generation high-end parallel machines based on a distributed memory architecture consisting of a networked cluster of nodes with a large number of cores on each node. PPM has a unified high-level programming abstraction that facilitates the design and implementation of parallel algorithms to exploit both the parallelism of the many cores and the parallelism at the cluster level. The programming abstraction will be suitable for expressing both fine-grained and coarse-grained parallelism. It includes a few high-level parallel programming language constructs that can be added as an extension to an existing (sequential or parallel) programming language such as C; and the implementation of PPM also includes a light-weight runtime library that runs on top of an existing network communication software layer (e.g. MPI). Design philosophy of PPM and details of the programming abstraction are also presented. Several unstructured applications that inherently require high-volume random fine-grained data accesses have been implemented in PPM with very promising results.