ICS 2019: International Conference on Supercomputing

Room 101B
Using the SPEC HPG Benchmarks for Better Analysis and Evaluation of Current and Future HPC Systems
Presenters: Robert Henschel [1,2], Sandra Wienke [1,3], Bo Wang [1,3], Sunita Chandrasekaran [1,4], Jimmy Cheng [1,5], Guido Juckeland [1,6], Junjie Li [1,2], and Veronica G. Vergara Larrea [1,7]

1. SPEC High Performance Group, Gainesville, VA, USA
2. RWTH Aachen University, Aachen, Germany
3. Indiana University, Bloomington, IN, USA
4. University of Delaware, Newark, DE, USA
5. Lenovo Global Technology TW ltd, Taipei, Taiwan
6. Helmholtz-Zentrum Dresden-Rossendorf, Dresden, Germany
7. Oak Ridge National Laboratory, Oak Ridge, TN, USA

Abstract: The High Performance Group (HPG) of the Standard Performance Evaluation Corporation (SPEC) develops bench- mark methodologies for High Performance Computing systems. The group also releases production quality bench- mark suites like SPEC MPI2007, SPEC OMP2012, and SPEC ACCEL, that can evaluate all dimensions of parallelism. These benchmarks are used in academia and industry to conduct research in HPC systems, facilitate procurement, testing, and tuning of HPC systems. In order to make these benchmarks more available, SPEC HPG offers these benchmark suites free of charge to non-commercial users. In this half-day tutorial, participants will learn how to leverage SPEC benchmarks for performance evaluation, tuning of system parameters, comparison of systems (e.g., for procurement), and get an outlook on its power measurement capabilities. The presenters will provide demos and hands-on guidance on how to install, compile, and run the benchmarks on HPC systems provided. The presenters will also show how the results will be interpreted, discuss various use cases, and present the publication process of results. An SSH-capable device is required for the hands-on sessions.

Gold:

Bronze: