HPC Analytics Support. Requirements for Uncertainty Quantification Benchmarks

Paulson, Patrick R.; Purohit, Sumit; Rodriguez, Luke R.

doi:10.2172/1225163

Home/Archive/DOE OSTI

DOE OSTI · 1225163

HPC Analytics Support. Requirements for Uncertainty Quantification Benchmarks

Paulson, Patrick R.·Purohit, Sumit·Rodriguez, Luke R.

View original source ↗Read source document ↗Export metadata ↓

Abstract

This report outlines techniques for extending benchmark generation products so they support uncertainty quantification by benchmarked systems. We describe how uncertainty quantification requirements can be presented to candidate analytical tools supporting SPARQL. We describe benchmark data sets for evaluating uncertainty quantification, as well as an approach for using our benchmark generator to produce data sets for generating benchmark data sets.

Explore related subjects

benchmark High Performance Computing RDF SPARQL Uncertainty Quantification

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Paulson, Patrick R., Purohit, Sumit, Rodriguez, Luke R.. 2015-05-01. HPC Analytics Support. Requirements for Uncertainty Quantification Benchmarks. https://doi.org/10.2172/1225163

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

DOE OSTI2025

A code-to-code benchmark for magneto-convection in a horizontal duct

Liquid metals and magnetic fields are used in many technical applications such as metallurgy, crystal growth and nuclear fusion reactors. When an electrically conducting fluid moves in a magnetic environment, electric currents and electromagnetic forces are generated that affect velocity and pressure losses in the flow. These magnetohydrodynamic (MHD) interactions have to be investigated to optimize the engineering processes. The characteristics of MHD flows depend on the geometrical configuration, the strength of the applied magnetic field, the electrical properties of fluid and structural materials and the thermal conditions. In the so-called blankets for fusion reactors, where liquid metals are used to breed the plasma fuel component tritium and to extract the generated heat, magneto-convective flows play a crucial role in determining heat and mass transfer. Therefore, the availability of numerical codes to simulate this type of flow is mandatory and their validation is a necessary step to guarantee the reliability of the results. For that reason, a benchmark problem has been defined to simulate liquid metal flows in a horizontal rectangular duct heated from below and exposed to a non-uniform magnetic field. Results obtained by five research groups using different codes are compared.

benchmark↗

DOE OSTI2022

A Comparison of Preconstruction and Operational Wake Loss Estimates for Land-Based Wind Plants

Recent studies suggest that biases between wind plant pre-construction energy yield estimates and actual energy production are decreasing over time. However, variability in energy yield prediction accuracy across different projects and wind energy consultants remains high. Wake effects are one of the largest categories comprising the pre-construction energy yield assessment process. To assess the accuracy of wake loss predictions, we compare pre-construction wake loss estimates provided by 8 consultants to the estimated operational wake losses for 10 North American wind plants, as part of the Wind Plant Performance Prediction (WP3) Benchmark project. We estimate operational wake losses using supervisory control and data acquisition (SCADA) data by comparing total wind plant energy production to the potential energy production based on the power produced by freestream wind turbines. In the presentation, we will discuss the overall wake loss prediction bias as well as the project-to-project variability in the prediction accuracy. Further, we will highlight challenges encountered when estimating operational wake losses, including the impact of complex terrain and the presence of neighboring wind plants.

benchmark↗

DOE OSTI2020

Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis

The Theory of Bottleneck Structures is a recently-developed framework for studying the performance of data networks. It describes how local perturbations in one part of the network propagate and interact with others. This framework is a powerful analytical tool that allows network operators to make accurate predictions about network behavior and thereby optimize performance. Previous work implemented a software package for bottleneck structure analysis, but applied it only to toy examples. In this work, we introduce the first software package capable of scaling bottleneck structure analysis to production-size networks. Here, we benchmark our system using logs from ESnet, the Department of Energy's high-performance data network that connects research institutions in the U.S. Using the previously published tool as a baseline, we demonstrate that our system achieves vastly improved performance, constructing the bottleneck structure graphs in 0.21 s and calculating link derivatives in 0.09 s on average. We also study the asymptotic complexity of our core algorithms, demonstrating good scaling properties and strong agreement with theoretical bounds. These results indicate that our new software package can maintain its fast performance when applied to even larger networks. They also show that our software is efficient enough to analyze rapidly changing networks in real time. Overall, we demonstrate the feasibility of applying bottleneck structure analysis to solve practical problems in large, real-world data networks.

benchmark↗