Search NASA⌕ Search

DOE OSTI · 985772

Confidence: Analyzing Performance With Empirical Probabilities

Abstract

Variability in the performance of shared system components is a major obstacle in analyzing the effective throughput of leadership class computers. Shared file systems and networks are serious impediments to achieving repeatable application performance on HPC systems. In particular, performance analysts are likely to be interested in quantifying differences between average-case behavior, worst-case behavior, and standard deviation for shared system components. Typical descriptions of these statistics assume a normal distribution; however, in non-linear and multi-modal performance distributions, summary statistics are often misleading. In this paper we describe Confidence, a tool for analyzing the full spectrum of performance for a benchmarking code. By including all of the experimental outcomes in the analysis without discarding any measurements, Confidence enables a novel analysis of benchmark performance. Finally, we use Confidence to characterize the network performance of three high performance computer systems, and we provide recommendations for leveraging network performance in latency sensitive applications.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Settlemyer, Bradley W, Hodson, Stephen W, Kuehn, Jeffery A, Poole, Stephen W. 2010-01-01. Confidence: Analyzing Performance With Empirical Probabilities. https://doi.org/10.1109/clusterwksp.2010.5613114

Cite the original work for its findings. Save a collection to share your selection of sources.