rMPI : increasing fault resiliency in a message-passing environment.

Stearley, Jon R. ; Laros, James H., III ; Ferreira, Kurt Brian ; Pedretti, Kevin Thomas Tauke ; Oldfield, Ron A. ; Riesen, Rolf (IBM Research, Ireland) ; Brightwell, Ronald Brian

Sandia National Laboratories

关键词: Replicas;    99 General And Miscellaneous//Mathematics, Computing, And Information Science;    Computers;    Reliability;    Design;   

DOI  :  10.2172/1012733
RP-ID  :  SAND2011-2488
RP-ID  :  AC04-94AL85000
RP-ID  :  1012733

美国|英语

来源: UNT Digital Library

【 摘 要 】

As High-End Computing machines continue to grow in size, issues such as fault tolerance and reliability limit application scalability. Current techniques to ensure progress across faults, like checkpoint-restart, are unsuitable at these scale due to excessive overheads predicted to more than double an applications time to solution. Redundant computation, long used in distributed and mission critical systems, has been suggested as an alternative to checkpoint-restart on its own. In this paper we describe the rMPI library which enables portable and transparent redundant computation for MPI applications. We detail the design of the library as well as two replica consistency protocols, outline the overheads of this library at scale on a number of real-world applications, and finally outline the significant increase in an applications time to solution at extreme scale as well as show the scenarios in which redundant computation makes sense.