Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark exercise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Battle of the Defaults: Extracting Performance Characteristics of HDF5 under Production Load

Popular parallel I/O libraries, such as HDF5, provide tuning parameters to obtain superior performance. However, the selection of effective parameters on production systems is complex due to the interdependence of I/O software and file system layers. Hence, application developers typically use the default parameters and often experience poor I/O performance. This work conducts a benchmarking-based analysis on the HDF5 behaviors with a wide variety of I/O patterns to extract performance characteristics under the production workload. To make the analysis well controlled, we exercise I/O benchmarks on POSIX-IO, MPI-IO, and HDF5 using the same I/O patterns and in the same jobs. To address high performance variability in production environments, we repeat the benchmarks across I/O patterns, storage devices, and time intervals. Based on the results, we identified consistent HDF5 behaviors that appropriate configurations and operations on dataset layout and file-metadata placement can improve performance significantly. We apply our findings and evaluate the tuned I/O library on two supercomputers: Summit and Cori. The results show that our tuned parameters can achieve more than 10× I/O performance speedup than that with default parameters on both systems, suggesting the effectiveness, stability, and generality of our solution.

Xie, Bing↗
DOE OSTI2023

RELAP5-3D Solutions to Exercise 1 of the OECD-NEA HTTF Benchmark

Discussion of RELAP5-3D solutions to Exercise 1 of the OECD-NEA High Temperature Test Facility (HTTF) Benchmark. Results from ongoing benchmark activities supported by the Advanced Reactor Technologies - Gas-Cooled Reactor Program with use of the High Performance Computing Center at Idaho National Laboratory. Also discussion of Ultra Safe Nuclear Corporation and BWXT plans for the decade, and issues of modern thermal hydraulic tools for prismatic HTGR modeling. Open discussion of verification and validation and ART-GCR campaign to spearhead the development of an HTGR thermal hydraulics benchmark based on the HTTF.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Wind Turbine Noise Code Benchmark: A Comparison and Verification Exercise: Preprint

In a number of institutions and companies, researchers and engineers are developing modeling numerical frameworks that are used to predict the aerodynamic noise emission from a wind turbine rotor. The simulation codes vary from empirically-tuned engineering models to high-fidelity computational ones. Their common feature is the fact that they all specifically model the main aerodynamic noise mechanisms occurring at the rotating blades, namely trailing edge noise and turbulent inflow noise. Nevertheless, it can be expected that these different modeling frameworks will produce different results for a same given rotor design, and identical operating conditions. Trailing edge noise is put at the forefront of the study as it is recognized as the main audible source of noise from wind turbines. The present benchmark aims at comparing the results from the different modeling approaches, and drawing some conclusions from these comparisons. This effort, denoted as Wind Turbine Noise Code benchmark, was initiated in 2019 as a joint-activity between the IEA Wind Task 39 (Quiet Wind Turbine Technology) and Task 29 (Detailed Aerodynamics of Wind Turbines, now Task 47). In addition to the investigation of the noise emissions themselves, the rotor aerodynamic characteristics are investigated as they have a significant impact on the noise generation mechanisms. A number of test cases are defined and the aerodynamic and aeroacoustic predictions from the various models are compared. There exist some discrepancies between the different methods, but it is difficult to conclude if one methodology is better than another in order to design a wind turbine with noise as a constraint.

aeroacoustics↗
DOE OSTI2025

Discrete fracture network model benchmarks developed and applied in a DECOVALEX-2023 repository performance assessment study

This study presents newly developed benchmarks for modeling flow and transport within discrete fracture networks (DFNs) and useful methods for analyzing the results. The new benchmarks are designed to test modeling approaches for use in probabilistic performance assessment models of deep geologic repositories in fractured rock. The benchmarks simulate flow and transport through a 1 km 3 block of fractured rock. The first simulates migration of a short pulse of tracer through a simple network of four intersecting fractures. The second adds 1089 stochastically generated fractures. The third changes the pulse to a continuous point source. Evaluation of model performance relies on moment analysis and comparison of the results of different models. The expected nondimensional first moment of the conservative tracer for each benchmark is 1. The benchmarks were simulated by teams from Canada, Czechia, Germany, Korea, Sweden, Taiwan, and the United States as part of a DECOVALEX-2023 study (decovalex.org). The teams used various approaches, including explicit DFN modeling, DFN upscaling to an equivalent continuous porous medium (ECPM), and a combination of both methods. Transport mechanisms are modeled using either the advection-dispersion equation or particle tracking. Results demonstrate strong agreement among the models in breakthrough behavior up to the 75th percentile. Significant deviations in first moments and well-clustered outputs led to the identification of inaccuracies in several models. Such findings exemplify the benefit of exercising these benchmarks and using the presented methods to test DFN flow and transport models.

Benchmark↗
DOE OSTI2024

Development of an Improved RELAP5-3D Model for the High Temperature Test Facility

High-temperature gas-cooled reactors (HTGRs) are rapidly approaching deployment. Confidence in transient analysis of these systems for design, optimization, and licensing calculations requires modeling and simulation tools that have been validated against data relevant to HTGR conditions. The High Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility for prismatic HTGRs. In spring and summer of 2019, HTTF was used for a series of experiments that now serve as the basis for the OECD/NEA Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data (HTGR T/H Benchmark). This benchmark contains problems for systems code, computational fluid dynamics (CFD), and coupled systems code/CFD modeling representing lower plenum mixing and both the depressurized and pressurized conduction cooldown (DCC and PCC respectively) transients. Benchmark problems include exercises for code-to-code and code-to-data comparisons as well as an exercise for error scaling between HTTF and the Modular High Temperature Gas-Cooled Reactor, which serves as the basis for the HTTF design. Previous analysis as part of the HTGR T/H benchmark used a RELAP5-3D model developed at Idaho National Laboratory (INL) and demonstrated an ability to reproduce trends in the measured data but difficulties reproducing experimental values within their uncertainty. These difficulties were largely attributed to assumptions made during the development of the initial RELAP5-3D model, which predated the HTTF experiments. A significant cause of difficulty reproducing the measured temperatures may be the radial nodalization of the previous RELAP5-3D model. The new model provides a finer nodalization to assess the impact of radial nodalization and allows for asymmetric heating within the core, which was a feature of multiple HTTF experiments. In this paper, we present the new RELAP5-3D model of HTTF. In addition to describing the new model, this paper compares the new and old models and provides results for a full-power steady state, a DCC, and a PCC in HTTF. These analyses are based on the code-to-code comparison exercises for the DCC and PCC problems of the HTGR T/H benchmark. We present the results of these exercises from the new model and compare them to the results of the old model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Comparison of Results between the Legacy and Refined RELAP5-3D Models of the High Temperature Test Facility in Exercises 1 and 2 of the HTTF Benchmark

Work conducted in FY23 identified that RELAP5-3D was capable of reproducing trends in HTTF data during experiment PG-27 but was incapable of reproducing measured values. The primary cause of this discrepancy between RELAP5-3D results and experimental data was hypothesized to be a distortion in power density that was introduced by the radial nodalization of the model. We further hypothesized that a new model would provide better results when compared to the experiments PG-27 and PG-29. Work this FY developed a new model that is better capable of capturing local heat generation rates and contains a representation of each 1/6 azimuthal sector of the core. We used this model to develop a new set of solutions to Exercises 1 and 2 of Problems 2 and 3 in the benchmark. In this report, we present the first comprehensive comparison of the results between the two models. We see that in Exercise 1A, which is common between problems 2 and 3, the results are similar, though the results from the new model show greater detail than those from the legacy model. In Problem 2 Exercise 1B and Problem 3 Exercise 1B, we see that heat removal is slower in the new model than the legacy model. Problem 3 Exercise 1C shows temperatures that are lower in most places in the new model than the legacy model, but the area with active heat generation has higher block temperatures in the new model than the legacy model. Problem 3 Exercise 1D further shows that long-term heat removal is lower in the new model. Problem 2 Exercise 1C demonstrated that the new model observes higher temperatures in the core regions than the legacy model, justifying the need to preserve the power density in HTTF. The validation of PG-27 and PG-29 also demonstrated the improved temperature agreement in the core regions, particularly with a calibrated model that implements an effective thermal conductivity for the core material. Overall, PG-27 models show reasonable to excellent agreement for steady-state temperatures and minimal to reasonable agreement for transients. PG-29 models showed minimal to insufficient agreement with the data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Progress in the HTTF Benchmark and RELAP5-3D Gas-Cooled Reactor Validation

This slide set presents results of analysis done in the first year after the kickoff of the HTTF benchmark. This work includes the development of a new RELAP5-3D model of the facility and collection and presentation of results from one of the exercises in the benchmark. Highlights include good agreement between the new and legacy models for full-power steady state and similar predictions of maximum block temperature during a pressurized conduction cooldown. Additionally, code-to-code comparisons of a full-power steady state and depressurized conduction cooldown (DCC) from full-power steady state as part of Problem 2 Exercises 1A and 1B show good agreement on temperatures predicted in the core but considerable spread in central reflector temperatures. During the DCC, temperature behavior is similar across all models, but cooldown rates are dictated by the performance of the reactor cavity cooling system

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Snowmass White Paper: Prospects of CP-violation measurements with the Higgs boson at future experiments

The search for CP violation in interactions of the Higgs boson with either fermions or bosons provides attractive reference measurements in the Particle Physics Community Planning Exercise (a.k.a. "Snowmass"). Benchmark measurements of CP violation provide a limited and well-defined set of parameters that could be tested at the proton, electron-positron, photon, and muon colliders, and compared to those achieved through study of virtual effects in electric dipole moment measurements. We review the current status of these CP-sensitive studies and provide projections to future measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

RELAP5-3D Solutions to Exercise 1 of the OECD-NEA HTTF Benchmark

The high-temperature gas-cooled reactor (HTGR) is an advanced reactor concept that has received considerable attention over the last 60 years. HTGRs boast high coolant outlet temperatures, passive safety, and large margins to fuel failure. Recent years have seen increasing interest in HTGRs, whether large-scale HTGRs for electricity or process heat applications or as microreactors serving remote communities. HTGRs have considerable potential to fulfill these applications, but modeling and simulation tools typically used for reactor safety analysis have not been validated for HTGR modeling. The High-Temperature Test Facility (HTTF) was constructed at Oregon State University (OSU) to provide validation data for HTGR modeling. Recently, Idaho National Laboratory (INL), OSU, Argonne National Laboratory, Canadian Nuclear Laboratories, and the University of Tennessee Knoxville have collaborated to develop an HTGR thermal hydraulics benchmark based on HTTF experiments. This summary presents results from a portion of that benchmark using RELAP5-3D

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗
DOE OSTI2022

MCS solutions for the TVA Watts Bar Unit 1 multi-physics depletion benchmark

The high-fidelity solution for exercises 1-3 of the recently developed TVA Watts Bar Unit 1 multi-physics and multi-cycle depletion benchmark using MCS was coupled with two different thermal-hydraulics (TH) codes: TH1D and COBRA-TF (CTF), and their solutions were compared. The solutions from MCS/CTF and MCS/TH1D for typical Pressurized Water Reactor (PWR) problems are quite close. And to evaluate MCS solutions for the benchmark, their results were also compared against measured data as well as publicly available high-fidelity solutions. The MCS criticality solutions at Hot Zero Power (HZP) deviate within 50 pcm against the reference solutions. While for the critical boron concentration (CBC) search calculations, the difference on the MCS calculated CBC is about 7 ppm, and the root-mean-squared (RMS) errors for the assembly power distribution and outlet coolant temperature are less than 0.5% and 1 Celsius degree respectively. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Matrix Graphite Material Models In Pebbles and Compacts For Bison

The cores and reflectors in high-temperature gas-cooled reactors (HTGRs) are made of graphite materials, with the graphite acting as a moderator, a fuel host matrix, or the foundation for various structural components. This study aims to survey the models in the literature for graphite materials being used as host matrices in pebble/fuel compacts and to implement those surveyed models into Bison to conduct an early assessment of graphite's thermo-mechanical response under various reactor conditions. In this study, thermal (e.g., thermal conductivity, and specific heat capacity) and mechanical (e.g., elastic properties, thermal expansion, irradiation-induced dimensional changes, and irradiation-induced creep) material models for various graphite grades (e.g., H-451, IG-110, G-348, 2020, A3-3, and A3-27) are incorporated into Bison. Two benchmark problems are then exercised utilizing these new graphite-related capabilities: (1) modeling an Advanced Gas Reactor (AGR)-2 fuel compact, and (2) modeling the debonding of a particle-matrix interface.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2015

Aerodynamic Shape Optimization Benchmarks with Error Control and Automatic Parameterization

Results are presented for four optimization benchmark problems posed by the AIAA Aerodynamic Design Optimization Discussion Group. The benchmarks are intended to exercise optimization frameworks on representative airfoil and wing design problems. All problems involve drag minimization subject to geometric and aerodynamic constraints. Our design approach involves two forms of adaptation. First, the shape parameterization is gradually and automatically enriched from an initially coarse search space. Second, adjoint solutions are used to drive adaptive mesh refinement to control discretization error. The error threshold is tailored so that the nest meshes, with the greatest accuracy, are used only when nearing the optimum. On the inviscid airfoil design problem, while reducing the drag by a factor of 10, we show how the combination of progressive parameterization and tiered discretization error control can dramatically accelerate the optimization. On the viscous airfoil design problem, we use inviscid analysis-driven optimization to reduce the total drag by a factor of two. Next, we improve the span efficiency factor of a wing by performing twist optimization. Finally, we optimize the Common Research Model wing, managing to hold drag roughly fixed, while targeting an initially-violated pitching moment constraint. Our approach aims to introduce greater complexity and accuracy only when necessary to improve the design, and also support a greater degree of automation.

Anderson, George R.↗
DOE OSTI2020

Coupling of Pronghorn and RELAP-7 for a Pebble Bed Reactor

High temperature gas cooled reactors (HTGR) are a candidate for timely Gen-IV reactor technology deployment because of high technology readiness and walk-away safety. Among HTGRs, pebble bed reactors (PBRs) have attractive features such as low excess reactivity and online refueling. Pebble bed reactors pose unique challenges to analysts and reactor designers such as continuous burnup distribution depending on pebble motion and recirculation, radiative heat transfer across a variety of gas-filled gaps, and long design basis transients such as pressurized and depressurized loss of forced circulation. Modeling and simulation is essential for both the PBR’s safety case and design process. In order to verify and validate the new generation codes the Nuclear Energy Agency (NEA) Data bank provide a set of benchmarks data together with solutions calculated by the participants using the state of the art codes of that time. An important milestone to test the new PBR simulation codes is the OECD NEA PBMR-400 benchmark which includes thermal hydraulic and neutron kinetic standalone exercises as well as coupled exercises and transients scenarios. In this work, the reactor multiphysics code MAMMOTH and the thermal hydraulics code Pronghorn, both developed by the Idaho National Laboratory (INL) within the multiphysics object-oriented simulation environment (MOOSE), have been used to solve Phase 1 exercises 1 and 2 of the PBMR-400 benchmark. The steady state results are in agreement with the other participants’ solutions demonstrating the adequacy of MAMMOTH and Pronghorn for simulating PBRs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2015

Human Research Program Advanced Exercise Concepts (AEC) Overview

Exercise countermeasures provide benefits that are crucial for successful human spaceflight, to mitigate the spaceflight physiological deconditioning which occurs during exposure to microgravity. The NASA Human Research Program (HRP) within the Human Exploration and Operations Mission Directorate (HEOMD) is managing next generation Advanced Exercise Concepts (AEC) requirements development and candidate technology maturation to Technology Readiness Level (TRL) 7 (ground prototyping and flight demonstration) for all exploration mission profiles from Multi Purpose Crew Vehicle (MPCV) Exploration Missions (up to 21 day duration) to Mars Transit (up to 1000 day duration) missions. These validated and optimized exercise countermeasures systems will be provided to the ISS Program and MPCV Program for subsequent flight development and operations. The International Space Station (ISS) currently has three major pieces of operational exercise countermeasures hardware: the Advanced Resistive Exercise Device (ARED), the second-generation (T2) treadmill, and the cycle ergometer with vibration isolation system (CEVIS). This suite of exercise countermeasures hardware serves as a benchmark and is a vast improvement over previous generations of countermeasures hardware, providing both aerobic and resistive exercise for the crew. However, vehicle and resource constraints for future exploration missions beyond low Earth orbit will require that the exercise countermeasures hardware mass, volume, and power be minimized, while preserving the current ISS capabilities or even enhancing these exercise capabilities directed at mission specific physiological functional performance and medical standards requirements. Further, mission-specific considerations such as preservation of sensorimotor function, autonomous and adaptable operation, integration with medical data systems, rehabilitation, and in-flight monitoring and feedback are being developed for integration with the exercise countermeasures systems. Numerous technologies have been considered and evaluated against HRP-approved functional device requirements for these extreme mission profiles, and include wearable sensors, exoskeletons, flywheel, pneumatic, and closed-loop microprocessor controlled motor driven systems. Each technology has unique advantages and disadvantages. The Advanced Exercise Concepts project oversees development of candidate next generation exercise countermeasures hardware, performs trade studies of current and state of the art exercise technologies, manages and supports candidate systems physiological evaluations with human test subjects on the ground, in flight analogs and flight. The near term goal is evaluation of candidate systems in flight, culminating in an integrated candidate next generation exercise countermeasures suite on the ISS which coalesces research findings from HRP disciplines in the areas of exercise performance for muscle, bone, cardiovascular, sensorimotor, behavioral health, and nutrition for optimal benefit to the crew.

Countermeasures↗
DOE OSTI2021

Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation

When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗