Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Energy Intensity Baselining and Tracking Guidance

Each company joining the U.S. Department of Energy’s (DOE’s) Better Buildings, Better Plants Program (Better Plants) commits to establishing an energy consumption and energy intensity (EI) baseline and to tracking its energy performance over a 10-year period against that baseline. The baseline must reflect a company’s energy consumption over a 12-month period, covering all its U.S.-based operations. Energy consumption is calculated by fuel type in terms of primary energy (also known as source energy). EI is broadly defined as the amount of energy consumed per unit of output produced. For this guidance document and for the program, the term energy performance represents an evaluation of a facility’s capacity to use energy efficiently. Metrics used to assess a facility’s energy performance can include EI, energy consumption, improvements in EI, etc. Establishing an energy baseline and tracking system is a critical first step in effectively managing energy use. Developing a baseline can help a company understand energy use within the corporation and give it a point of comparison to evaluate future efforts to improve energy performance. It can also support efforts to validate a company’s energy management activities, improve comparative analyses when using benchmarks, and help in predicting future energy needs. In addition, a company that normalizes its performance data can determine highly defensible measures of energy savings generated through implemented energy efficiency projects. Establishing a baseline and tracking energy performance is also a requirement for ISO 50001 certification. Although basic energy data can be collected through utility bills, most manufacturers will have to perform additional analyses to develop accurate and robust energy baselines and tracking systems. Energy is consumed in many ways within the manufacturing sector and can come from multiple sources. Energy is sometimes generated and sold to other parties or captured and reused on-site. External events can exert a significant impact on a facility or company’s energy use independent of any purposeful efforts to improve energy efficiency. Operational changes, such as production shifts—which may be inevitable for some companies over the 10-year period covered by the program—can also make a big difference in energy use. Since Better Plants asks companies to account for all their U.S.-based operations, mergers, acquisitions, and divestitures can also have significant implications for a company’s energy metrics. This document aims to demystify the sometimes complex baselining process. It devotes special attention to the task of normalizing and adjusting energy consumption to account for external factors, such as weather and production changes. A key recommendation is that companies use regression analysis to normalize their energy consumption data whenever possible. Regression analysis is a statistical technique that estimates the dependence of a variable (i.e., energy use in the context of Better Plants) on one or more independent variables such as ambient temperature, while controlling for the influence of other variables at the same time. A properly developed regression analysis can provide a reliable estimate of energy savings resulting from energy improvement strategies and projects by accounting for the effects of variables such as annual production levels and weather. DOE has developed a companion Energy Performance Indicator software tool (EnPI) to simplify the baselining process. This tool can run regression models, calculate changes in EI at the facility level, and automatically compile facility-level data into a corporate-wide metric. Note that although the relevant equations used to calculate EI are provided in this document, the EnPI tool will automatically perform most calculations for the user. Additionally, Better Plants Partners (Partners) can call on their Technical Account Manager (TAM) to help them establish a baseline and assist with the necessary calculations to track progress.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of Genetic Algorithm Based Multi-Objective Plant Reload Optimization Platform

The U.S. nuclear industry is facing a challenge in maintaining required levels of safety while ensuring economic competitiveness to stay in business. Safety remains a key parameter for all aspects of light-water reactor nuclear power plant operations. Safety can become more economical by using a risk-informed ecosystem, such as the one being developed in the Risk-Informed Systems Analysis Pathway under the U.S. Department of Energy Light Water Reactor Sustainability Program. The Light Water Reactor Sustainability Program promotes a wide range of research and development activities to maximize both the safety and economic efficiency of nuclear power plants through improved scientific understanding, especially given that many plants are now considering second license renewals. The Risk-Informed Systems Analysis Pathway has two main goals: Deploy methodologies and technologies that better represent safety margins and cost and safety factors; Develop advanced applications that enable cost-effective plant operations. The Plant Reload Optimization Platform development project aims to build a reactor core design tool that includes reactor safety and fuel performance analyses and uses artificial intelligence to support the optimization of core design solutions. This report summarizes genetic-algorithm-based multi-objective fuel reload optimization activities, specifically: Developing the non-dominated sorting genetic algorithm II optimizer in the Risk Analysis and Virtual ENviroment (RAVEN); Demonstrating and validating the developed non-dominated sorting genetic algorithm II optimizer using benchmark optimization problems.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NCSP supports 240 Pu prompt fission neutron spectrum (PFNS) evaluation

A new 240 Pu PFNS evaluation was recently undertaken at LANL as a strategic priority. It truly is an NCSP end-to-end product. It factors in a new differential experiment funded by NCSP, builds on theoretical work coming out of a previous NCSP nuclear data evaluation milestone and was validated with an NCERC experiment that was recently evaluated as an integral benchmark with NCSP funds.

240Pu↗

Update on the International Reactor Physics Evaluation Project (IRPhEP) for EGPRS

This set of slides provides an overview of benchmarking work for the International Reactor Physics Evaluation (IRPhE) project, to be presented to the Expert Group on Physics of Reactor Systems (EGPRS), which is an expert group within the OECD/NEA Working Party on Scientific Issues and Uncertainty Analysis of Reactor Systems (WPRS).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Static versioning in the polyhedral model

An approach is presented to enhancing the optimization process in a polyhedral compiler by introducing compile-time versioning, i.e., the production of several versions of optimized code under varying assumptions on its run-time parameters. We illustrate this process by enabling versioning in the polyhedral processor placement pass. We propose an efficient code generation method and validate that versioning can be useful in a polyhedral compiler by performing benchmarking on a small set of deep learning layers defined for dynamically-sized tensors.

Meister, Benoit J.↗

On the effect of scalar flux weighing of linearly anisotropic scattering matrices in few-group transport calculations

The majority of the codes available for homogenized group constant generation for deterministic transport calculations apply the approximation of scalar flux weighting during energy group condensation of higher-order anisotropic scattering matrices. In this paper, we discuss the effect of scalar flux weighting of the linearly anisotropic scattering matrices in the frame of S P{sub 3} and S{sub 12} calculations performed for a two-dimensional VVER-440 reactor benchmark. To compare group constants generated for two neutron energy groups, an infinite pin cell was homogenized with Serpent 2 and ERANOS ECCO. Serpent 2 applies scalar flux, while ERANOS ECCO performs current weighting of the linearly anisotropic scattering matrices during energy group condensation. For analyzing the effect of the various weighting options, three simple reactor models were built assuming different core sizes using standard rectangular assemblies with 15*15 fuel pins. Diffusion, SP{sub 3} and S{sub 12} calculations were performed for the 3 models using group constants generated with Serpent 2 and ERANOS ECCO. The effect of scalar flux weighting of linearly anisotropic scattering matrices is shown by comparing the decrease in reactivity due to the decreased reactor size, as well as the assembly power distribution to reference results obtained with Serpent 2 Monte Carlo calculations. Neglecting higher than linearly anisotropic scattering and indirect application of diffusion coefficients in higher-order transport calculations is advised if angular flux-moment spectra weighted higher-order scattering matrices cannot be generated. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

RELAP5-3D in the OECD-NEA HTGR Thermal Hydraulics Benchmark

The OECD-NEA HTGR Thermal Hydraulics benchmark uses data from the High Temperature Test Facility for a series of code-to-code and code-to-data exercises aimed at improving the state of knowledge on existing thermal hydraulics modeling and simulation tools for prismatic HTGR applications. This benchmark includes problems representing hot gas mixing in the lower plenum, the depressurized conduction cooldown accident and the pressurized conduction cooldown accident. This presentation discusses the benchmark and RELAP5-3D's role in that benchmark, including as a tool for predicting behavior in the core and as a tool for providing boundary conditions to computational fluid dynamics analysis in the lower plenum.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Horizontal Split Table Conceptual Design for Validation of Nuclear Data used in Advanced Reactors [Slides]

This presentation discusses a methodology that was developed to create conceptual designs of benchmark critical experiments for advanced reactors and nuclear data testing. A first concept that was explored was a pebble-bed high-temperature gas cooled reactor, based on the HTR-10 reactor. The very high correlation is a proof of concept that the design is similar to the application, and performing such critical experiments would help nuclear data testing and validation. Other concepts could be explored if needed, such as a molten-salt reactor, a sodium-cooled fast reactor, or heat pipe reactors/microreactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of Shielding Benchmarks Using the Godiva IV Assembly

The Nuclear Criticality Safety Program (NCSP) is developing a shielding benchmark using the Godiva IV assembly as a source. Its present status is reviewed herein. Even eight decades into the nuclear era, substantial work remains to develop a database of shielding benchmarks to support future nuclear development. A nuclear simulation is only as good as its supporting data, inputs, and validation basis. Uncertainty in these areas is addressed using conservatism, which adds margin and, occasionally, cost. In many shielding situations, high accuracy is not necessary because additional material is not particularly expensive. After all, 1–2 cm of lead often reduces the gamma ray dose substantially. However, in certain areas, conservatism can add unnecessary cost. These areas include mobile shielding applications such as casks, ships, microreactors, and spacecraft, where weight and, thus, margin is expensive. Although these characteristics are side benefits for NCSP shielding benchmark development, the main driver is enabling more reliable placement of criticality accident alarm systems (CAASs) in nuclear material facilities, such as those dedicated to the production of advanced reactor fuels. CAAS placement relies on more than accurate data and code validation. It also relies on sufficiently accurate materials specifications, geometry specifications, and a well-defined, alarm-producing baseline accident. All these things require tacit knowledge and understanding of the problem being evaluated. Benchmarks can help ensure this understanding.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benched: Upgrading and Updating the Los Alamos Benchmark Suite for the 21st Century [Slides]

The presentation begins by stating that most organizations make choices to handle specific things when preparing input files for validation, such as which elemental abundance data to use, how to decompose specific elements, and setting calculation precision. It also discusses the consequences, which include differing calculation results between different organizations for the same case, even when using the same code. This is illustrated by the intercomparison exercise and input files that are prepared by one organization and are not necessarily correct for another. The presentation explains that the Los Alamos Benchmark Suite is a centralized repository of high-quality benchmark models currently under development at LANL. The objectives of the new repository are to remain up to date with the latest ICSBEP revision, to have a formal review and revision process, to (eventually) be an open-source repository, and to provide new tools for improved input and output file generation and review.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Mechanochemically Robust LiCoO 2 with Ultrahigh Capacity and Prolonged Cyclability

Pushing intercalation-type cathode materials to their theoretical capacity often suffers from fragile Li-deficient frameworks and severe lattice strain, leading to mechanical failure issues within the crystal structure and fast capacity fading. This is particularly pronounced in layered oxide cathodes because the intrinsic nature of their structures is susceptible to structural degradation with excessive Li extraction, which remains unsolved yet despite attempts involving elemental doping and surface coating strategies. Herein, a mechanochemical strengthening strategy is developed through a gradient disordering structure to address these challenges and push the LiCoO 2 (LCO) layered cathode approaching the capacity limit (256 mAh g -1 , up to 93% of Li utilization). This innovative approach also demonstrates exceptional cyclability and rate capability, as validated in practical Ah-level pouch full cells, surpassing the current performance benchmarks. Comprehensive characterizations with multiscale X-ray, electron diffraction, and imaging techniques unveil that the gradient disordering structure notably diminishes the anisotropic lattice strain and exhibits high fatigue resistance, even under extreme delithiation states and harsh operating voltages. Consequently, this designed LCO cathode impedes the growth and propagation of particle cracks, and mitigates irreversible phase transitions. In conclusion, this work sheds light on promising directions toward next-generation high-energy-density battery materials through structural chemistry design.

36 MATERIALS SCIENCE↗

A robust interface finite element formulation for modeling brittle material failure problems

Abstract Failure of many brittle materials and structures can be modeled using interface‐oriented finite elements combined with intrinsic cohesive zone models. The discontinuous Galerkin (DG) finite element method provides an innovative framework for modeling brittle crack propagation with zero‐thickness interface elements, which can accommodate extrinsic cohesive laws to avoid the artificial compliance required in intrinsic cohesive models. However, robust formulations and implementations of DG methods are critical in alleviating the well‐known convergence issues for both crack nucleation and propagation with reduced instability. This paper presents a robust interface element formulation by modifying the incomplete interior penalty Galerkin (IIPG) method, which successfully avoids the initial element interface penetration across elements that occurs prior to crack nucleation, and thereby greatly reduces the instability issue as cracks open. We further verified and validated our implementation by using a bar tension test and a beam fracturing benchmark. The robustness of our proposed interface element method was demonstrated by a micromechanics fiber/matrix debonding problem with 64 fibers embedded in a bulk matrix.

Liu, Ruijie↗

Uncertainty analysis of PIV measurements in bubbly flows considering sampling and bubble effects with ray optics modeling

In this report, a modeling-based approach is developed to investigate the external sources of uncertainty in particle image velocimetry (PIV) measurements for two-phase bubbly flows. Primarily relied on ray optics modeling, this study focuses on the uncertainty in PIV measurements due to bubble-induced light distortion. In addition, the uncertainty due to sampling is also considered through synthetic PIV images generated from Monte Carlo sampling. Based on a PIV-planar laser induced florescence (PLIF) measurement system, three case studies are performed and discussed, considering respectively the sampling effect, bubble effect, and the combination of these two effects. These case studies confirm the validity of the ray optics modeling in obtaining accurate particle images through a benchmark test. Furthermore, it is also found that the bubble effect could significantly influence the particle images. On the other hand, the result of the case study with synthetic PIV images indicates that the bubble effect on particle images can be minimized by removing “outliers” in the obtained velocity vector field through a multi-pass post-processing procedure. However, the uncertainty of the velocity measurements will still increase.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Rapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation

Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Enhancing ACPF Analysis: Integrating Newton-Raphson Method with Gradient Descent and Computational Graphs

This paper presents a new method for enhancing Alternating Current Power Flow (ACPF) analysis. The method integrates the Newton-Raphson (NR) method with Enhanced-Gradient Descent (GD) and computational graphs. The integration of renewable energy sources in power systems introduces variability and unpredictability, and this method addresses these challenges. It leverages the robustness of NR for accurate approximations and the flexibility of GD for handling variable conditions, all without requiring Jacobian matrix inversion. Furthermore, computational graphs provide a structured and visual framework that simplifies and systematizes the application of these methods. The goal of this fusion is to overcome the limitations of traditional ACPF methods and improve the resilience, adaptability, and efficiency of modern power grid analyses. We validate the effectiveness of our advanced algorithm through comprehensive testing on established IEEE benchmark systems. Furthermore, our findings demonstrate that our approach not only speeds up the convergence process but also ensures consistent performance across diverse system states, representing a significant advancement in power flow computation.

24 POWER TRANSMISSION AND DISTRIBUTION↗