Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Application of Jacobian-free Newton–Krylov method in implicitly solving two-fluid six-equation two-phase flow problems: Implementation, validation and benchmark

This work represents a first-of-its-kind successful application to employ advanced numerical methods in solving realistic two-phase flow problems with two-fluid six-equation two-phase flow model. These advanced numerical methods include high-resolution spatial discretization scheme with staggered grids (high-order) fully implicit time integration schemes, and Jacobian-free Newton–Krylov (JFNK) method as the nonlinear solver. The computer code developed in this work has been extensively validated with existing experimental flow boiling data in vertical pipes and rod bundles, which cover wide ranges of experimental conditions, such as pressure, inlet mass flux, wall heat flux and exit void fraction. Additional code-to-code benchmark with the RELAP5-3D code further verifies the correct code implementation. The combined methods employed in this work exhibit strong robustness in solving two-phase flow problems even when phase appearance (boiling) and realistic discrete flow regimes are considered. Transitional flow regimes used in existing system analysis codes, normally introduced to overcome numerical difficulty, were completely removed in this work. As a result, this in turn provides the possibility to utilize more sophisticated flow regime maps in the future to further improve simulation accuracy.

42 ENGINEERING↗

Multigrid Reduction in Time for Nonlinear Parabolic Problems

The need for parallel-in-time is being driven by changes in computer architectures, where future speed-ups will be available through greater concurrency, but not faster clock speeds, which are stagnant.This leads to a bottleneck for sequential time marching schemes, because they lack parallelism in the time dimension. Multigrid Reduction in Time (MGRIT) is an iterative procedure that allows for temporal parallelism by utilizing multigrid reduction techniques and a multilevel hierarchy of coarse time grids. MGRIT has been shown to be effective for linear problems, with speedups of up to 50 times. The goal of this work is the efficient solution of nonlinear problems with MGRIT, where efficient is defined as achieving similar performance when compared to a corresponding linear problem. As our benchmark, we use the p-Laplacian, where p = 4 corresponds to a well-known nonlinear diffusion equation and p = 2 corresponds to our benchmark linear diffusion problem. When considering linear problems and implicit methods, the use of optimal spatial solvers such as spatial multigrid imply that the cost of one time step evaluation is fixed across temporal levels, which have a large variation in time step sizes. This is not the case for nonlinear problems, where the work required increases dramatically on coarser time grids, where relatively large time steps lead to worse conditioned nonlinear solves and increased nonlinear iteration counts per time step evaluation. This is the key difficulty explored by this paper. We show that by using a variety of strategies, most importantly, spatial coarsening and an alternate initial guess to the nonlinear time-step solver, we can reduce the work per time step evaluation over all temporal levels to a range similar with the corresponding linear problem. This allows for parallel scaling behavior comparable to the corresponding linear problem.

97 MATHEMATICS AND COMPUTING↗

Open-source Tools for Solving Grid Optimization Problems: ARPA-e Benchmark Algorithm Overview [Slides]

This document contains the official formulation that will be used for evaluation in Challenge 2 of the Grid Optimization (GO) Competition. Minor changes may occur within the formulation. Entrants will be notified when a new version is released. Changes are not expected to be of a significance that would cause a change in approach for the Entrants. This formulation builds upon the Challenge 1 formulation published in ARPA-E DE-FOA-0001952. Entrants will be judged based on the current official Challenge 2 formulation posted on the GO Competition website (this document, which is subject to change), not the formulation posted in DE-FOA-0001952. Entrants are permitted and encouraged to use any alternative problem formulation and modeling convention within their own software (such as convex relaxation, decoupled power flow formulations, current-voltage formulations, etc.) in an attempt to produce an exact or approximate solution to this particular mathematical program. However, the judging of all submitted approaches must conform to the official formulation presented here.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Big Problem for Small Earthquakes: Benchmarking Routine Magnitudes and Conversion Relationships with Coda Envelope-Derived Mw in Southern Kansas and Northern Oklahoma

Earthquake magnitudes are widely relied upon measures of earthquake size. Although moment magnitude (M w ) has become the established standard for moderate and large earthquakes, difficulty in reliably measuring seismic moments for small (generally M w <4) earthquakes has meant that magnitudes for these events remain plagued by a patchwork of inconsistent measurement scales. Because of this, magnitudes of small earthquakes and statistics derived from them can be biased. Furthermore, because small earthquakes are much more numerous than large ones, many applications, such as seismic hazard modeling, depend critically on analysis of events characterized by magnitudes other than M w . Therefore, to assess this problem, we apply coda envelope analysis to reliably determine moment magnitudes for a case study of small earthquakes from northern Oklahoma and southern Kansas. Not surprisingly, we find significant differences among M L , m bLg , and M w for M ~2–4 earthquakes examined here. More troublingly, we find that relations designed to convert other magnitudes to M w , which are relied upon for important applications such as seismic hazard analysis, often increase rather than decrease this bias for our dataset. In our case study, we find that converted magnitudes can result in a systematic bias sometimes exceeding 0.5 magnitude units, a difference that typically corresponds to a factor of ~3 in seismicity rate. Moreover, we find a correspondingly large bias in Gutenberg–Richter b-values, controlled primarily by inaccurate magnitude scaling in the conversion relationships. Although this study focuses on a relatively small geographic area, we can expect that similar issues exist with varying severity in other regions. Therefore, magnitudes of small earthquakes and their associated statistics, including seismicity rates and b-values, should be treated with caution.

58 GEOSCIENCES↗

Benchmarking machine learning strategies for phase-field problems

Abstract We present a comprehensive benchmarking framework for evaluating machine-learning approaches applied to phase-field problems. This framework focuses on four key analysis areas crucial for assessing the performance of such approaches in a systematic and structured way. Firstly, interpolation tasks are examined to identify trends in prediction accuracy and accumulation of error over simulation time. Secondly, extrapolation tasks are also evaluated according to the same metrics. Thirdly, the relationship between model performance and data requirements is investigated to understand the impact on predictions and robustness of these approaches. Finally, systematic errors are analyzed to identify specific events or inadvertent rare events triggering high errors. Quantitative metrics evaluating the local and global description of the microstructure evolution, along with other scalar metrics representative of phase-field problems, are used across these four analysis areas. This benchmarking framework provides a path to evaluate the effectiveness and limitations of machine-learning strategies applied to phase-field problems, ultimately facilitating their practical application.

36 MATERIALS SCIENCE↗

Continued Verification of MOOSE Structural Mechanics Tools for Modeling Core Bowing Phenomena in Fast Reactors

Under the U.S. Department of Energy Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program, an integrated multiphysics approach is being developed to model the core bowing phenomena important to liquid metal-cooled fast reactors. Core bowing is an important passive safety mechanism whereby increased power (which leads to temperature and flux gradients) influences the core to bow into less reactive configurations when the restraint system is properly designed. The phenomenon includes a complex interplay of radiation transport, duct temperature calculations involving fluid flow and heat transfer, and thermo-mechanical responses to the induced temperature and flux gradients. Structural material properties are also important to determining inelastic response to longer term flux gradients which cause irradiation creep and swelling. While core bowing provides a strong negative reactivity feedback when the restraint system is designed properly, it also results in additional forces between assemblies which increase the loads required to extricate them during refueling or control rod movement. Therefore, the restraint system must be designed with these tradeoffs in mind. The first stage of the work, which commenced in FY21 and continues through FY22, assesses thermo-mechanical modeling tools for producing core bowing predictions consistent with conventional tools. The Multiphysics Object Oriented Simulation Environment (MOOSE) Tensor Mechanics and Contact Modules are employed. This status report describes work on additional thermo-mechanical benchmark verification problems with increased complexity from the examples demonstrated in FY21. Several benchmark verification examples were selected from the IAEA verification and validation report. These examples involve clusters of ducts representative of a sector of a hexagonal reactor core which bow into each other and cause contact and load pad elevations, as well as single ducts subjected to irradiation fields undergoing swelling and subsequent bowing. The MOOSE-based results were compared to both IAEA benchmark participants’ results, analytic equations as available, and NUBOW-3D, a beam model code developed by Argonne National Laboratory. In every case, the MOOSE results agreed with other simulations results, providing additional verification basis of the tools for this particular physics application.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Well-Balanced, Conservative Finite Difference Algorithm for Atmospheric Flows

The numerical simulation of meso-, convective-, and microscale atmospheric flows requires the solution of the Euler or the Navier-Stokes equations. Nonhydrostatic weather prediction algorithms often solve the equations in terms of derived quantities such as Exner pressure and potential temperature (and are thus not conservative) and/or as perturbations to the hydrostatically balanced equilibrium state. This paper presents a well-balanced, conservative finite difference formulation for the Euler equations with a gravitational source term, where the governing equations are solved as conservation laws for mass, momentum, and energy. Preservation of the hydrostatic balance to machine precision by the discretized equations is essential because atmospheric phenomena are often small perturbations to this balance. The proposed algorithm uses the weighted essentially nonoscillatory and compact-reconstruction weighted essentially nonoscillatory schemes for spatial discretization that yields high-order accurate solutions for smooth flows and is essentially nonoscillatory across strong gradients; however, the well-balanced formulation may be used with other conservative finite difference methods. The performance of the algorithm is demonstrated on test problems as well as benchmark atmospheric flow problems, and the results are verified with those in the literature.

Ghosh, Debojyoti↗

FY23 Status Report on MOOSE-Based Approaches to Modeling Core Bowing in Fast Reactors

Under the U.S. Department of Energy Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program, an integrated multiphysics approach is being developed to model the core bowing phenomena important to liquid metal-cooled fast reactors. Core bowing is an important passive safety mechanism whereby increased power (which leads to temperature and flux gradients) influences the core to bow into less reactive configurations when the restraint system is properly designed. The phenomenon includes a complex interplay of radiation transport, duct temperature calculations involving fluid flow and heat transfer, and thermo-mechanical responses to the induced temperature and flux gradients. Structural material properties are also important to determining inelastic response to longer term flux gradients which cause irradiation creep and swelling. While core bowing provides a strong negative reactivity feedback when the restraint system is designed properly, it also results in additional forces between assemblies which increase the loads required to extricate them during refueling or control rod movement. Therefore, the restraint system must be designed with these tradeoffs in mind. The first stage of the work, which commenced in FY21 and continues through FY23, assesses thermo-mechanical modeling tools for producing core bowing predictions consistent with conventional tools. The Multiphysics Object Oriented Simulation Environment (MOOSE) Tensor Mechanics and Contact Modules are employed. This status report describes work on additional thermo-mechanical benchmark verification problems with increased complexity from the examples demonstrated in FY21 and FY22. Several benchmark verification examples were selected from the IAEA verification and validation report with increased number of ducts and more complex contact interaction behavior. These examples involve a full symmetric sector with restraint rings at multiple load pad locations to simulate a limited free-bow restraint system concept, as well as irradiation induced swelling and creep effects in a sector. In addition, improvements to the contact module sideset assignment were assessed and compared with previous MOOSE results to verify the contact behavior. The MOOSE-based results were compared to IAEA benchmark participants’ results. In every case, the MOOSE results agreed with other simulations results for estimating bowing behavior, providing additional verification basis of the tools for this particular physics application. Estimation of contact forces were mostly in agreement, with a few outlier results. A plan was suggested for dealing with the discrepancies with estimating contact force values. In addition, a 1-way coupling demonstration was performed using subchannel analysis code Pronghorn-SC and MOOSE on an ABR-1000-design sodium-cooled fast reactor assembly to evaluate coolant and duct wall temperatures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A HYDROCHEMICAL HYBRID CODE FOR ASTROPHYSICAL PROBLEMS. I. CODE VERIFICATION AND BENCHMARKS FOR A PHOTON-DOMINATED REGION (PDR)

A two-dimensional hydrochemical hybrid code, KM2, is constructed to deal with astrophysical problems that would require coupled hydrodynamical and chemical evolution. The code assumes axisymmetry in a cylindrical coordinate system and consists of two modules: a hydrodynamics module and a chemistry module. The hydrodynamics module solves hydrodynamics using a Godunov-type finite volume scheme and treats included chemical species as passively advected scalars. The chemistry module implicitly solves nonequilibrium chemistry and change of energy due to thermal processes with transfer of external ultraviolet radiation. Self-shielding effects on photodissociation of CO and H{sub 2} are included. In this introductory paper, the adopted numerical method is presented, along with code verifications using the hydrodynamics module and a benchmark on the chemistry module with reactions specific to a photon-dominated region (PDR). Finally, as an example of the expected capability, the hydrochemical evolution of a PDR is presented based on the PDR benchmark.

79 ASTRONOMY AND ASTROPHYSICS↗

Implementation, capabilities, and benchmarking of Shift, a massively parallel Monte Carlo radiation transport code

This paper discusses the implementation, capabilities, and validation of Shift, a massively parallel Monte Carlo radiation transport package developed and maintained at Oak Ridge National Laboratory. It has been developed to scale well from laptop to small computing clusters to advanced supercomputers. Special features of Shift include hybrid capabilities for variance reduction such as CADIS and FW-CADIS, and advanced parallel decomposition and tally methods optimized for scalability on supercomputing architectures. Shift has been validated and verified against various reactor physics benchmarks and compares well to other state-of-the-art Monte Carlo radiation transport codes such as MCNP5, CE KENO-VI, and OpenMC. Some specific benchmarks used for verification and validation include the CASL VERA criticality test suite and several Westinghouse AP1000 ® problems. These benchmark and scaling studies show promising results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

PRISMS-PF: A general framework for phase-field modeling with a matrix-free finite element method

Abstract A new phase-field modeling framework with an emphasis on performance, flexibility, and ease of use is presented. Foremost among the strategies employed to fulfill these objectives are the use of a matrix-free finite element method and a modular, application-centric code structure. This approach is implemented in the new open-source PRISMS-PF framework. Its performance is enabled by the combination of a matrix-free variant of the finite element method with adaptive mesh refinement, explicit time integration, and multilevel parallelism. Benchmark testing with a particle growth problem shows PRISMS-PF with adaptive mesh refinement and higher-order elements to be up to 12 times faster than a finite difference code employing a second-order-accurate spatial discretization and first-order-accurate explicit time integration. Furthermore, for a two-dimensional solidification benchmark problem, the performance of PRISMS-PF meets or exceeds that of phase-field frameworks that focus on implicit/semi-implicit time stepping, even though the benchmark problem’s small computational size reduces the scalability advantage of explicit time-integration schemes. PRISMS-PF supports an arbitrary number of coupled governing equations. The code structure simplifies the modification of these governing equations by separating their definition from the implementation of the numerical methods used to solve them. As part of its modular design, the framework includes functionality for nucleation and polycrystalline systems available in any application to further broaden the phenomena that can be used to study. The versatility of this approach is demonstrated with examples from several common types of phase-field simulations, including coarsening subsequent to spinodal decomposition, solidification, precipitation, grain growth, and corrosion.

36 MATERIALS SCIENCE↗

RELAP5-3D in the OECD-NEA HTGR Thermal Hydraulics Benchmark

The OECD-NEA HTGR Thermal Hydraulics benchmark uses data from the High Temperature Test Facility for a series of code-to-code and code-to-data exercises aimed at improving the state of knowledge on existing thermal hydraulics modeling and simulation tools for prismatic HTGR applications. This benchmark includes problems representing hot gas mixing in the lower plenum, the depressurized conduction cooldown accident and the pressurized conduction cooldown accident. This presentation discusses the benchmark and RELAP5-3D's role in that benchmark, including as a tool for predicting behavior in the core and as a tool for providing boundary conditions to computational fluid dynamics analysis in the lower plenum.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Adaptive Interface-PINNs (AdaI-PINNs) for transient diffusion: Applications to forward and inverse problems in heterogeneous media

We model transient diffusion in heterogeneous materials using a novel physics-informed neural networks framework (PINNs) termed Adaptive interface physics-informed neural networks or AdaI-PINNs (Roy et al. arXiv preprint arXiv:2406.04626, 2024). AdaI-PINNs utilize different activation functions with trainable slopes tailored to each material region within the computational domain, allowing for a fully automated and adaptive PINNs approach to model interface problems with strongly and weakly discontinuous solutions. To enhance its performance in highly heterogeneous transient diffusion systems, we prescribe a suite of robust practices, including appropriate non-dimensionalization of equations, a biased sampling method, Glorot initialization, and the hard enforcement of boundary and initial conditions. Here we evaluate the efficacy of the proposed method on several benchmark forward and inverse problems. Comparative studies on one-dimensional and two-dimensional benchmark problems reveal that the modified AdaI-PINNs outperform its unmodified counterpart, achieving root-mean-square errors that are at least two orders of magnitude better in forward problems. For inverse problems, the maximum errors in the approximated diffusion coefficients by modified AdaI-PINNs are four orders of magnitude better than those of the unmodified version. Additionally, modified AdaI-PINNs demonstrate improved stability in problems with large material mismatches.

42 ENGINEERING↗

INL Contributions to Draft HTTF Benchmark Specifications

The High-Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility at Oregon State University designed as a 1/4 length scale model of the Modular High-Temperature Gas-Cooled Reactor 350 MW core (mHTGR-350). In the spring and summer of 2019, several experiments were conducted at HTTF providing a valuable source of gas-cooled reactor thermal hydraulics data. Idaho National Laboratory (INL), Oregon State University, Argonne National Laboratory, and Canadian Nuclear Laboratories have partnered to use this experimental data to develop a gas-cooled reactor thermal hydraulics benchmark led by INL under the auspices of the Advanced Reactor Technologies (ART) program. This report provides some context on the benchmark, HTTF, and previous Reactor Excursions and Leak Analysis Program (RELAP)5-3D modeling of HTTF. It also provides a draft of the benchmark specifications for the Depressurized Conduction Cooldown problem, which is the INL-led benchmark problem.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

VERA Benchmark Results with HELIOS Library

This report presents the comparison of results of calculations from the latest VERA 3.9R1 release with the default cross section data library along with another independent data library generated based on the HELIOS cross section data. The calculations are performed for the AMA Core Physics Benchmark Progression Problems 1 through 7, the Watts Bar Unit 1 (WB1) Cycles 1 & 2, and other actual TMI, WB1 cycles. When available, the results from continuous energy (CE) Monte Carlo transport calculations, KENO, are also used as a comparison. The Progression Problems are based on the WB1 initial startup core and span a single fuel pin up to full core depletion. The KENO results referenced in this report are extracted from a previous benchmarking report documented in Reference 7.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗

Status of the OECD/NEA Watts Bar unit 1 benchmark and calculations of local reactor core power data of the Zero Power physics tests

The paper aims to provide an update on the status of the Organization for Economic Cooperation and Development (OECD) / the Nuclear Energy Agency (NEA) Tennessee Valley Authority (TVA) Watts Bar 1 (WB1) Multi-Physics Multi-Cycle depletion benchmark and the results associated with Exercise 1. The benchmark relies on the set of benchmark progression problems developed by the Department of Energy (DOE) Consortium for the Advanced Simulation of Light Water Reactors (CASL) for the Virtual Environment for Reactor (VERA), which are based on real plant design and operational data. The OECD/NEA TVA WB1 benchmark is designed for validation of both traditional and novel high-fidelity multi-physics codes to analyze Pressurized Water Reactors (PWR) depletion cycles. The activities are conducted under the Expert Group on Reactor Systems Multi-Physics (EGMUP) at NEA/OECD. In this work, we analyze Exercise 1 of the benchmark: stand-alone Three-Dimensional (3D) neutronics at Start-up Zero Power Physics Test (ZPPT) at Hot Zero Power Conditions (HZP) and the resulting power maps. The code used to model the exercise is the continuous energy Monte Carlo code Serpent 2.1.31 along with the nuclear data library ENDF/B-VII.1. Serpent results are compared with the high-fidelity deterministic code MPACT, which is part of VERA. The paper presents three selected results from power calculations required output. The results compared are the normalized axially integrated radial core power maps, the normalized axial averaged core power shapes, and the normalized core hottest and coldest assemblies radial power maps. The Root Mean Square Deviation (RMSD) between Serpent and MPACT is 0.51 % for the axially integrated radial core power map, 1.41 % for the axial averaged core power shape, 2.42 % for the hottest assembly axial power shape, 0.88 % for the coldest assembly axial integrated hottest assembly radial pin power map, and 0.17 % for the axially integrated coldest assembly radial pin power map. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Accelerating Bilevel Optimization With Hierarchical Many-Threaded Parallel Differential Evolution

Bilevel optimization is encountered in many relevant real-world applications. The main feature of this type of problem is that an upper-level optimization problem is constrained by a nested lower-level optimization problem. Because of this nested structure, bilevel problems (BLPs) are usually computationally expensive to solve. Differential evolution (DE) has demonstrated promising results in solving BLPs of relatively small scales. As the problem scale increases, the decision space becomes intrinsically larger, requiring a growing number of function evaluations for the method to work properly. In this context, heavy parallelization and high-performance computing techniques are indispensable to enable the resolution of more complex and challenging optimization problems. Hence, we propose a hierarchical many-threaded parallel DE approach for BLPs, where both levels are parallelized. The computational experiments demonstrate that the parallel implementation achieved runtime speeds ranging from 44 to 2559 times faster than the sequential version on a well-known scalable SMD benchmark test problem when executed on an NVIDIA A100 GPU. The findings indicate that the algorithm’s convergence is strongly influenced by the number of both upper- and lower-level generations. Moreover, the success of experiments with large-scale problems is closely linked to the choice of small population sizes.

Dufek, Amanda S↗