| |
Home
> Archives > Additional
Archives > John McCalpin |
| |
John McCalpin
IBM Corporation
Austin, TX 92093
mccalpin@us.ibm.com
Abstract:
Benchmarking and Performance Characterization in High Performance
Computing
Benchmarking of High Performance Computing is a field with
a long history, but with surprisingly little science. We have "microbenchmarks"
and "paper and pencil" benchmarks and "pseudo-application"
benchmarks and "application benchmarks" and "workload"
benchmarks, and it is possible to think of other categories. This
presentation will review some of the basic philosophical differences
across benchmarking communities, and will attempt to categorize benchmarking
efforts in terms of their underlying philosophy of performance modelling,
their intended customers, their intended goals, and their unintended
side effects. The talk will conclude with a proposal for a minimalist
constitutive framework for characterizing HPC systems, as a possible
adjunct to, or replacement for, the current LINPACK-based TOP500 list.
|