Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Benched: Upgrading and Updating the Los Alamos Benchmark Suite for the 21st Century [Slides]

The presentation begins by stating that most organizations make choices to handle specific things when preparing input files for validation, such as which elemental abundance data to use, how to decompose specific elements, and setting calculation precision. It also discusses the consequences, which include differing calculation results between different organizations for the same case, even when using the same code. This is illustrated by the intercomparison exercise and input files that are prepared by one organization and are not necessarily correct for another. The presentation explains that the Los Alamos Benchmark Suite is a centralized repository of high-quality benchmark models currently under development at LANL. The objectives of the new repository are to remain up to date with the latest ICSBEP revision, to have a formal review and revision process, to (eventually) be an open-source repository, and to provide new tools for improved input and output file generation and review.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

Distribution-Level Phasor Measurement Units Application to Composite Load Model Validation

The paper presents the results of composite load model validation based on the distribution level micro- phasor measurement units (PMU) measurements. The actual micro-PMU measurements from the distribution feeders are collected by Lawrence Berkley National Laboratory (LBNL). The composite load model parameters are initially generated using the load model data tool developed by Pacific Northwest National Laboratory (PNNL). The generated load models are calibrated to match the performances with the micro-PMU measurements using disturbance records “play-in” capabilities available in a GE PSLF simulation package. A trial-and-error approach based on engineering judgement is proposed in this paper to benchmark the generated load model parameters and is implemented in the prototype of load model validation tool, which would be a supplement to the load model data tool.

Liu, Yuan↗
DOE OSTI2024

Mechanochemically Robust LiCoO 2 with Ultrahigh Capacity and Prolonged Cyclability

Pushing intercalation-type cathode materials to their theoretical capacity often suffers from fragile Li-deficient frameworks and severe lattice strain, leading to mechanical failure issues within the crystal structure and fast capacity fading. This is particularly pronounced in layered oxide cathodes because the intrinsic nature of their structures is susceptible to structural degradation with excessive Li extraction, which remains unsolved yet despite attempts involving elemental doping and surface coating strategies. Herein, a mechanochemical strengthening strategy is developed through a gradient disordering structure to address these challenges and push the LiCoO 2 (LCO) layered cathode approaching the capacity limit (256 mAh g -1 , up to 93% of Li utilization). This innovative approach also demonstrates exceptional cyclability and rate capability, as validated in practical Ah-level pouch full cells, surpassing the current performance benchmarks. Comprehensive characterizations with multiscale X-ray, electron diffraction, and imaging techniques unveil that the gradient disordering structure notably diminishes the anisotropic lattice strain and exhibits high fatigue resistance, even under extreme delithiation states and harsh operating voltages. Consequently, this designed LCO cathode impedes the growth and propagation of particle cracks, and mitigates irreversible phase transitions. In conclusion, this work sheds light on promising directions toward next-generation high-energy-density battery materials through structural chemistry design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A robust interface finite element formulation for modeling brittle material failure problems

Abstract Failure of many brittle materials and structures can be modeled using interface‐oriented finite elements combined with intrinsic cohesive zone models. The discontinuous Galerkin (DG) finite element method provides an innovative framework for modeling brittle crack propagation with zero‐thickness interface elements, which can accommodate extrinsic cohesive laws to avoid the artificial compliance required in intrinsic cohesive models. However, robust formulations and implementations of DG methods are critical in alleviating the well‐known convergence issues for both crack nucleation and propagation with reduced instability. This paper presents a robust interface element formulation by modifying the incomplete interior penalty Galerkin (IIPG) method, which successfully avoids the initial element interface penetration across elements that occurs prior to crack nucleation, and thereby greatly reduces the instability issue as cracks open. We further verified and validated our implementation by using a bar tension test and a beam fracturing benchmark. The robustness of our proposed interface element method was demonstrated by a micromechanics fiber/matrix debonding problem with 64 fibers embedded in a bulk matrix.

Liu, Ruijie↗
DOE OSTI2019

A GPU-accelerated package for simulation of flow in nanoporous source rocks with many-body dissipative particle dynamics

Mesoscopic simulations of hydrocarbon flow in source shales are concerning, in part due to the heterogeneous shale pores with sizes ranging from a few nanometers to a few micrometers. Additionally, the sub-continuum fluid–fluid and fluid–solid interactions in nano- to micro-scale shale pores, which are physically and chemically sophisticated, must be captured. To address those challenges, we present a GPU-accelerated package for simulation of flow in nano- to micro-pore networks with a many-body dissipative particle dynamics (mDPD) mesoscale model. Based on a fully distributed parallel paradigm, the code offloads all intensive workloads on GPUs. Other advancements, such as smart particle packing and no-slip boundary condition in complex pore geometries, are also implemented for the construction and the simulation of the realistic shale pores from 3D nanometer-resolution stack images. Our code is validated for accuracy and compared against the CPU counterpart for speedup. In our benchmark tests, the code delivers nearly perfect strong scaling and weak scaling (with up to 512 million particles) on up to 512 K20X GPUs on Oak Ridge National Laboratory’s (ORNL) Titan supercomputer. Moreover, a single-GPU benchmark on ORNL’s SummitDev and IBM’s AC922 suggests that the host-to-device NVLink can boost performance over PCIe by a remarkable 40%. Lastly, we demonstrate, through a flow simulation in realistic shale pores, that the CPU counterpart requires 840 Power9 cores to rival the performance delivered by our package with four V100 GPUs on ORNL’s Summit architecture. This simulation package enables quick-turnaround and high-throughput mesoscopic numerical simulations for exploring complex flow phenomena in nano- to micro-porous rocks with realistic pore geometries.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Uncertainty analysis of PIV measurements in bubbly flows considering sampling and bubble effects with ray optics modeling

In this report, a modeling-based approach is developed to investigate the external sources of uncertainty in particle image velocimetry (PIV) measurements for two-phase bubbly flows. Primarily relied on ray optics modeling, this study focuses on the uncertainty in PIV measurements due to bubble-induced light distortion. In addition, the uncertainty due to sampling is also considered through synthetic PIV images generated from Monte Carlo sampling. Based on a PIV-planar laser induced florescence (PLIF) measurement system, three case studies are performed and discussed, considering respectively the sampling effect, bubble effect, and the combination of these two effects. These case studies confirm the validity of the ray optics modeling in obtaining accurate particle images through a benchmark test. Furthermore, it is also found that the bubble effect could significantly influence the particle images. On the other hand, the result of the case study with synthetic PIV images indicates that the bubble effect on particle images can be minimized by removing “outliers” in the obtained velocity vector field through a multi-pass post-processing procedure. However, the uncertainty of the velocity measurements will still increase.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Rapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation

Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Enhancing ACPF Analysis: Integrating Newton-Raphson Method with Gradient Descent and Computational Graphs

This paper presents a new method for enhancing Alternating Current Power Flow (ACPF) analysis. The method integrates the Newton-Raphson (NR) method with Enhanced-Gradient Descent (GD) and computational graphs. The integration of renewable energy sources in power systems introduces variability and unpredictability, and this method addresses these challenges. It leverages the robustness of NR for accurate approximations and the flexibility of GD for handling variable conditions, all without requiring Jacobian matrix inversion. Furthermore, computational graphs provide a structured and visual framework that simplifies and systematizes the application of these methods. The goal of this fusion is to overcome the limitations of traditional ACPF methods and improve the resilience, adaptability, and efficiency of modern power grid analyses. We validate the effectiveness of our advanced algorithm through comprehensive testing on established IEEE benchmark systems. Furthermore, our findings demonstrate that our approach not only speeds up the convergence process but also ensures consistent performance across diverse system states, representing a significant advancement in power flow computation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

ExaAM: Metal additive manufacturing simulation at the fidelity of the microstructure

Additive manufacturing (AM), or 3D printing, of metals is transforming the fabrication of components, in part by dramatically expanding the design space, allowing optimization of shape and topology. However, although the physical processes involved in AM are similar to those of welding, a field with decades of experimental, modeling, simulation, and characterization experience, qualification of AM parts remains a challenge. The availability of exascale computational systems, particularly when combined with data-driven approaches such as machine learning, enables topology and shape optimization as well as accelerated qualification by providing process-aware, locally accurate microstructure and mechanical property models. We describe the physics components comprising the Exascale Additive Manufacturing simulation environment and report progress using highly resolved melt pool simulations to inform part-scale finite element thermomechanics simulations, drive microstructure evolution, and determine constitutive mechanical property relationships based on those microstructures using polycrystal plasticity. We report on implementation of these components for exascale computing architectures, as well as the multi-stage simulation workflow that provides a unique high-fidelity model of process–structure–property relationships for AM parts. In addition, we discuss verification and validation through collaboration with efforts such as AM-Bench, a set of benchmark test problems under development by a team led by the National Institute of Standards and Technology.

3D printing↗
DOE OSTI2020

Nek5000 developments in support of industry and the NRC

This year, the Nuclear Energy Advanced Modeling Simulation program (NEAMS) thermal-hydraulics verification and validation (V&V) work has focused in three areas of Nek5000 V&V-driven development. First, in a close collaborative effort with the U. S. Nuclear Regulatory Commission (NRC) staff, we have continued V&V efforts for the HYMERES-2 project using the OECD/NEA sponsored testing in the PSI PANDA facility. This year’s focus of ANL-NRC collaboration involves Nek5000 setups and validation for a range of problems relevant to and including the HYMERES-2 benchmark from PSI. The primary outcome of this year efforts is a more efficient geometry and inlet modeling simplification after a careful sensitivity study of the inlet profiles and pipe geometries. The resulting modeling choice of a short recycling/fully-developed turbulent inlet is within the experimental uncertainty estimate. This finding simplifies the next step of the cross-V&V HYMERES-2 project. In addition, the ANL team continue to provide assistance to the NRC staff in the form of Nek5000 application support in general and on the use of the HPC platforms of ALCF and INL in particular. This supports the NRC’s assessment of Nek5000 for use with the NRC Blue CRAB code suite. Second, we have implemented and tested more robust model of URANS, namely the k – τ model, a variant of the k-ω model, along with other improvements to RANS Nek5000 modeling in general. Because of its demonstrated robustness and stability, the k – τ model is the only RANS model that has been implemented in the new GPU version of the Nek5000 code, nekRS. Lastly, we report the initial implementation of Jacobian-free Newton Krylov approach to the direct Newton method for steady fluid solvers aimed at acceleration of RANS modeling and at IC improvement for LES campaigns. Also leveraging the Exascale Computing Project (ECP) ANL/CEED & SMR team’s software development effort to support NEAMS problems at large scale of the advanced computing architectures, NekRS, a GPU variant of Nek5000, built on top of kernels from libParanumal using OCCA for portability, has been successfully run on the full system of Summit (4608 nodes, 27648 GPUs).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Neutron Absorber Plate Characterization Plan for Criticality Experiments Design [Slides]

The goal of this presentation is to show the feasibility of performing a critical experiment with a B 4 C/Aluminum alloy neutron absorber plate. The motivation of this experiment is to provide integral data on modern neutron absorber product “Boralcan” by Rio Tinto. In 2020, used in about 20% of spent fuel pools in the US, and in casks for storage and transportation in the US and in Europe. The added value of this experiment: Neutron absorber plate modeling method verification: homogeneous or not, a lot of potential savings by relaxing boron loading credit limits. No available critical benchmark involving Boralcan, other boron-related experiments are relatively old. Nuclear data validation for B, C, and Al in the form of B 4 C in Al matrix.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

TEAMER Technical Support of Ramboll's for Numerical Modeling of WECs to Support OES Task 10: Cooperative Research and Development (Final Report)

National Technology & Engineering Solutions of Sandia, LLC (NTESS) in collaboration with the National Renewable Energy Laboratory (NREL), and with guidance from Ramboll, will perform fluid dynamics simulations to support of The Ocean Energy Systems (OES) Energy Technology Collaboration Program Task 10 Wave Energy Converters (WEC) Modelling Verification and Validation effort. Specific numerical simulations include the fixed device wave impingement studies to benchmark the performance of simulation techniques against physical testing results.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

Exxon Mobil-NETL Testing of DAC Materials

This joint initiative is aimed at extending our understanding of real DAC testing conditions at the NETL DAC testbed facility. Of particular focus will be: • Small Scale testing of powdered and formulated materials (supplied by ExxonMobil) to evaluate various performance metrics under DAC process cycles • Pilot scale testing of formulated materials at larger scales ExxonMobil will work with NETL to shake down equipment, validate testing methods, and define best practices for data analysis. Three tasks are proposed: 1. Validation of multi-cycle test data on powdered and formulated materials to benchmark various performance metrics of these materials. 2. Steam regeneration of powdered samples at small scale to define baseline performance under commercially relevant conditions. 3. Pilot scale testing of larger formulated materials to test commercially relevant samples under actual process cycles.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Pile Oscillator Evaluation for Flattop [Poster]

Useful method for high-precision measurements of integral cross section in various samples. The availability of benchmark-quality effective delayed neutron fraction (ßeff) values for nuclear data and code validation remains limited.

MCNP↗
DOE OSTI2026

Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation

This Final Scientific and Technical Report summarizes work performed under the Phase IIA SBIR project “Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation” (DE-SC0020906) from August 2023 through August 2025. The objective of the Phase IIA effort was to mature and harden capabilities developed during Phase II, with the goal of enabling practical interoperability between Coreform’s isogeometric analysis (IGA) technologies and the Multiphysics Object-Oriented Simulation Environment (MOOSE), while improving robustness, performance, and scalability for complex, nuclear-relevant geometries. Over the course of Phase IIA, the project established and validated an extraction-based interoperability pathway between Coreform tools and MOOSE. A combined mesh and matrix format was defined collaboratively with MOOSE developers and integrated into the solver, enabling standard MOOSE workflows to operate on data exported from Coreform’s IGA and Flex Representation Method (FRM) pipelines. Early demonstrations validated architectural compatibility using linear solid mechanics problems, while later efforts focused on benchmark testing and external use. By the end of the project period, engineers at BWXT were able to independently set up and execute a simulation using the Coreform–MOOSE workflow and provide direct feedback that informed further refinement. In parallel, substantial effort was devoted to improving the robustness of trimmed U-spline construction for complex CAD geometries. A growing test suite of nuclear-relevant models was compiled through collaboration with multiple stakeholders and used to drive extensive bug fixing and reliability improvements. These efforts resulted in improved robustness and performance, including the addition of fallback capabilities that enhance reliability when the underlying commercial CAD kernel fails. Performance-oriented work progressed later in the project, with the development and demonstration of methods to decompose complex geometries into structured subregions and updated data representations to support more efficient solver processing. Additionally, extensive enhancements to threadsafe parallel data structures and trimming operations established a foundation for scalable processing of large assemblies. Collaboration with Sandia National Laboratories on the SGM geometric modeling kernel advanced to a functioning interface test case, positioning the workflow for future kernel integration. Overall, the Phase IIA effort successfully transitioned the project from architectural proof-of-concept to externally exercised, solver-integrated capability, while clarifying remaining technical challenges related to standardization, performance optimization, and kernel integration.

42 ENGINEERING↗
DOE OSTI2021

Benchmarking near-term quantum devices with the variational quantum eigensolver and the Lipkin-Meshkov-Glick model

The variational quantum eigensolver is a promising algorithm for noisy intermediate scale quantum (NISQ) computation. Verification and validation of NISQ algorithms' performance on NISQ devices is an important task. Here, we consider the exactly diagonalizable Lipkin-Meshkov-Glick (LMG) model as a candidate for benchmarking NISQ computers. We use the Bethe Ansatz to construct eigenstates of the trigonometric LMG model using quantum circuits inspired by the LMG's underlying algebraic structure. We construct circuits with depth $\mathcal{O}$(N) and $\mathcal{O}$(log 2 N) that can prepare any trigonometric LMG eigenstate of N particles. The number of gates required for both circuits is $\mathcal{O}$(N). The energies of the eigenstates can then be measured and compared to the exactly known answers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Benchmark for Fuel Shuffling and Depletion for Pebble-Bed Reactors

Pebble bed reactors have specific operational characteristics when their fuel-cycle and fueling operations are considered. They are specifically distinguished by other type of nuclear reactor designs by their online fuel recycling scheme, where the fuel elements that have not yet reached discharge burnup can be reloaded and recycled continuously during normal operation. The fuel in a pebble bed reactor is not stationary and stochastically moves through the core once or several times during its lifetime, which allows them to operate without requiring a large excess reactivity hold for the burnup. However, this characteristic of pebble bed reactors introduces challenges in simulation, as each pebble can take many different trajectories through the core, its composition depends on the details of the irradiation history that is unique to its aggregated path through the core. For predicting the safety performance characteristics, such as source term, maximum fuel temperatures and fuel failure rates, etc., it is important to accurately incorporate the movement of pebbles through the core during their lifetime in a multi-physics simulation together with other phenomena. The equilibrium core analysis for pebble bed reactors are performed with multi-physics tools including fuel depletion in a multi pass reload coupled to the fuel movement. Currently, there are only a few legacy multi-physics simulation tools that can implement the pebble flow characteristics and perform equilibrium core analysis for pebble bed reactors. However, there are development efforts on-going under Department of Energy's Nuclear Energy Advanced Modelling and Simulation program and also in private industry for including these capabilities into their modelling and simulation tools. Any new development in the modelling and simulation tools needs to be validated by using tools such as experiments, analytical solutions or code-to-code benchmarks. In this work, a code-to-code benchmark for the equilibrium core analysis capability of pebble bed reactors was developed. Multiple cases were identified to capture different fuel cycle strategies that can be used in PBRs. The results of each case are presented in terms of overall equilibrium core characteristics: the discharge burnup; spatial burnup distribution; spatial isotopic distributions; axial and radial neutron flux distributions and power history of fuel elements per pass through the core for both a prototypical pebble bed High Temperature Gas-cooled Reactor and a prototypical pebble bed Fluoride-salt cooled High temperature Reactor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗