EXACT: The EXperimental Algorithmics Computational Toolkit

Workshop on Experimental Computer Science

William E. Hart Jonathan W. Berry Robert Heaphy Cynthia A. Phillips

Others  :  http://www.usenix.org/events/expcs07/papers/14-hart.pdf
PID  :  6271

来源: CEUR

【 摘 要 】

In this paper, we introduce EXACT, the EXperimental Al- gorithmics Computational Toolkit. EXACT is a software framework for describing, controlling, and analyzing com- puter experiments. It provides the experimentalist with convenient software tools to ease and organize the entire ex- perimental process, including the description of factors and levels, the design of experiments, the control of experimental runs, the archiving of results, and analysis of results. As a case study for EXACT, we describe its interaction with FAST, the Sandia Framework for Agile Software Test- ing. EXACT and FAST now manage the nightly testing of several large software projects at Sandia. We also discuss EXACT’s advanced features, which include a driver module that controls complex experiments such as comparisons of