Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Progress Report on Model Development for Aerosol Transport through Divergent Cracks Paths

This report summarizes the progress in developing a phenomenological model of aerosol transport, deposition, and plugging through microchannels. The purpose of this effort is to introduce to a user community—involving researchers, regulators, and industry—a generic, reliable numerical model for the prediction of aerosol transport while accounting for potential deposition and plugging of the leak paths to model spent nuclear fuel (SNF) release from postulated Stress Corrosion Cracks in canisters under storage or transportation. Current work focuses on expanding the model to predict aerosol (and gas) flow through complex microchannel (nozzle) geometries in addition to the rectangular and cylindrical geometries, as we approach more realistic Stress Corrosion Crack conditions. In this regard, a divergent nozzle geometry, used at Sandia National Laboratories (SNL) for testing aerosol release and retention (Durbin et al. 2021), was added to the model. The model was then validated with blowdown data for the particular microchannel, from experiments conducted at SNL. The report also presents preliminary non-benchmarked aerosol penetration fraction and mass flow rate for a monodisperse 10-micron (AED) particle concentration of 1.7e-08 kg/m 3 being released through the divergent microchannel geometry from the SNL’s aerosol experimental tank setup.Future work will involve validating the aerosol model and updating the model’s Graphical User Interface (GUI) to include the divergent nozzle geometry. This is expected to help stakeholders perform quick and easy first principles calculations without needing to understand the underlying MATLAB script.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Modeling Approach to Critical in the Upcoming CERBERUS Experiment

The planned Critical Experiment Reflected By coppEr to betteR Understand Scattering (CERBERUS) seeks to maximize sensitivity to elastic neutron scattering in the intermediate energy region (0.625 eV to 100 keV). It will be performed near the end of FY 2023 at the National Criticality Experiments Research Center (NCERC). Very few International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks are sensitive to copper in this region. Creating a benchmark sensitive in this area will make the Zeus benchmark series, an intermediate benchmark evaluation that uses a copper reflector, more useful for code and nuclear data validation. Approaching criticality in a safe manner is of utmost importance to avoid a criticality accident, which would present a safety concern and could cause damage to equipment. The two rules that are followed closely to ensure that a criticality accident does not occur are the 3/4 rule and the 1/2 rule. The 3/4 rule states that no more than 3/4 of a critical mass can be assembled by hand, and the 1/2 rule states that no more than 1/2 of the material expected to reach criticality, or 1/2 the distance needed to reach criticality, can be added before another measurement of the count rate has been taken. This work will discuss the approach to criticality as modeled in MCNP6® 1 particle transport code with the ENDF/B- VIII.0 cross-section library and the .00c data library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

Bias Between ENDF/B-VIII and ENDF/B-VII.1 for LEU Pin Array Systems

Extensive testing of new cross section data is performed in SCALE prior to its release. The release of ENDF/B-VIII.0 requires the generation and testing of new data libraries which are planned to be included in the release of SCALE 6.3 in 2019 or 2020. KENO benchmark results have been published previously for beta and final releases of ENDF/B-VIII.0 using the entire Verified, Archived Library of Inputs and Data (VALID). This work presents an energy-dependent change in the results for low-enriched uranium (LEU) pin array systems. The process of identifying the difference is highlighted as a case study to determine how data testing and benchmarking can be performed to provide more detailed feedback to the data community on potential data deficiencies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2020

Procedure for Creating, Reviewing, and Submitting Input Files into the Benchmark Library

Los Alamos National Laboratory (LANL) has a number of criticality benchmark input files, modeled for use with MCNP, developed and maintained by various organizations including the Nuclear Criticality Safety (NCS) Division, XCP-3, and XCP-5. The purpose of this procedure is to standardize input file creation, review, and maintenance. This procedure incorporates existing practices used by IRSN as documented in the original report and the translation from French in addition to practices used by the LANL NCS Division as documented in. The report relates to input files used for the validation of the continuous energy Monte Carlo code MCNP6 but is general enough to be extended to other codes. This report describes the procedure on how to prepare and use benchmarks (taken mainly from the ICSBEP Handbook) for the validation of calculation routes. In particular, this report describes the procedure to follow in the creation of the input files and their integration in the experimental validation databases.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Experiment Design and Preparation for a Shielding Benchmark Utilizing Godiva-IV

An experiment is currently being designed to provide a high-quality shielding benchmark for Criticality Accident Alarm System (CAAS) modeling. Previous benchmarks have suffered from uncertainty primarily due to two factors. The first factor is radiation that is not directly coming from the source, also known as room return. Room return is notoriously difficult to account for in experimental data and to model in benchmarks. The second factor is uncertainty associated with the source term itself. In order to reduce these two sources of uncertainty, this experiment will utilize a room return shield [1] that will reduce the effect of room return and previous work performed to ensure the reproducibility of the source term. The experiment will use the Godiva IV [2] assembly located at the National Criticality Experiments Research Center (NCERC) to provide a neutron source representative of a criticality accident. Previous experiments [3]-[4] have shown that Godiva IV is capable of producing both bursts and steady-state emissions of equal magnitude which will allow for reduced uncertainty in the source term. The room return shield will house and isolate the shielding samples, neutron activation foils, and other detectors. Data collected will provide a comparison of the neutron and gamma dose for shielded and unshielded configurations. This data will be used to validate shielding data used for modeling criticality accident alarm systems. Shielding samples included in this benchmark are C, Fe, NaCl, Pb, high density polyethylene, and SiO 2 . This paper details the design of the room return shield, the experimental plan, challenges, and mitigation strategies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗
DOE OSTI2024

Jemima Plate Characterization

The HEU Jemima plates have been utilized in numerous International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluations. ICSBEP evaluations are a vital com ponent of nuclear data validation for applications across the nuclear community. In the past, different combinations of mass, caliper measurements, and drawing dimensions have been used to define the HEU Jemima plates in ICSBEP evaluations. Some of these combinations result in large density ranges (17 g/cm 3 to 19 g/cm 3 ) or unrealistic densities (greater than 19 g/cm 3 ). Additionally, oxidation of the plates has led to questioning the flatness of each plate, which can add additional gaps in experiment configurations. This work proposes a standardized method of defining the commonly used HEU Jemima plates across different experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

ENDF/B-VIII.1 Validation (Preliminary Release 2 + New 239 Pu)

This document should serve as a reference for validation testing of nuclear data files included in the second preliminary release of ENDF/B-VIII.1 and the newly evaluated 239 Pu nuclear data file to be included in the third preliminary release of ENDF/B-VIII.1. Experiment names listed in this report are based on International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook designations. Additional information on ICSBEP handbook designations can be found at https://www.oecd-nea.org/jcms/pl_20291/icsbep-handbook. The validation metrics used in this report include the effective neutron multiplication factor, k eff , and tritium production. All validation metrics were calculated using the radiation transport code Monte Carlo N-Particle (MCNP).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

A code-to-code benchmark for magneto-convection in a horizontal duct

Liquid metals and magnetic fields are used in many technical applications such as metallurgy, crystal growth and nuclear fusion reactors. When an electrically conducting fluid moves in a magnetic environment, electric currents and electromagnetic forces are generated that affect velocity and pressure losses in the flow. These magnetohydrodynamic (MHD) interactions have to be investigated to optimize the engineering processes. The characteristics of MHD flows depend on the geometrical configuration, the strength of the applied magnetic field, the electrical properties of fluid and structural materials and the thermal conditions. In the so-called blankets for fusion reactors, where liquid metals are used to breed the plasma fuel component tritium and to extract the generated heat, magneto-convective flows play a crucial role in determining heat and mass transfer. Therefore, the availability of numerical codes to simulate this type of flow is mandatory and their validation is a necessary step to guarantee the reliability of the results. For that reason, a benchmark problem has been defined to simulate liquid metal flows in a horizontal rectangular duct heated from below and exposed to a non-uniform magnetic field. Results obtained by five research groups using different codes are compared.

benchmark↗
DOE OSTI2026

Integral Nuclear Data and Benchmarking Needs for Fusion Energy Systems

Fusion energy systems are currently being designed and optimized using radiation transport codes. To deal with the unique environment inside a fusion-based system, many of these designs incorporate novel materials able to withstand the high radiation fields, ensure adequate cooling and thermal protection, and produce tritium. Validation plays a vital role in building trust in the predictive power of these models and computational methods. Validation of a code consists of modeling documented real-world experiments and comparing the code-predicted response to the measured response. Adequate validation requires measured responses from real-world experiments, also known as integral data, that mimic the system being designed, including materials, impinging radiation, and temperature, among other variables. The most trusted integral data are experimental responses that have been through a rigorous benchmarking process that develops a recommended computational model and evaluates all experimental uncertainties. Finally, there are a few research groups around the world that have been producing integral data for fusion applications, but a substantial investment is needed to address the unique validation needs of the fusion community.

Fusion↗
DOE OSTI2024

A multiscale anisotropic polymer network model coupled with phase field fracture

The study of polymers has continued to gain substantial attention due to their expanding range of applications, spanning essential engineering fields to emerging domains like stretchable electronics, soft robotics, and implantable sensors. These materials exhibit remarkable properties, primarily stemming from their intricate polymer chain network, which, in turn, increases the complexity of precisely modeling their behavior. Especially for modeling elastomers and their fracture behavior, accurately accounting for the deformations of the polymer chains is vital for predicting the rupture in highly stretched chains. Despite the importance, many robust multiscale continuum frameworks for modeling elastomer fracture tend to simplify network deformations by assuming uniform behavior among chains in all directions. Recognizing this limitation, our study proposes a multiscale fracture model that accounts for the anisotropic nature of elastomer network responses. At the microscale, damage in the chains is assumed to be driven by both the chain's entropy and the internal energy due to molecular bond distortions. In order to bridge the stretching in the chains to the macroscale deformation, we employ the maximal advance path constraint network model, inherently accommodating anisotropic network responses. As a result, chains oriented differently can be predicted to exhibit varying stretch and, consequently, different damage levels. To drive macroscale fracture based on damages in these chains, we utilize the micromorphic regularization theory, which involves the introduction of dual local-global damage variables at the macroscale. The macroscale local damage variable is obtained through the homogenization of the chain damage values, resulting in the prediction of an isotropic material response. The macroscale global damage variable is subjected to nonlocal effects and boundary conditions in a thermodynamically consistent phase field continuum formulation. Moreover, the total dissipation in the system is considered to be mainly due to the breaking of the molecular bonds at the microscale. To validate our model, we employ the double-edge notched tensile test as a benchmark, comparing simulation predictions with existing experimental data. Additionally, to enhance our understanding of the fracturing process, we conduct uniaxial tensile experiments on a square film made up of polydimethylsiloxane (PDMS) rubber embedded with a hole and notches and then compare our simulation predictions with the experimental observations. Furthermore, we visualize the evolution of stretch and damage values in chains oriented along different directions to assess the predictive capacity of the model. In conclusion, the results are also compared with another existing model to evaluate the utility of our model in accurately simulating the fracture behavior of rubber-like materials.

42 ENGINEERING↗
DOE OSTI2021

Rate-Based Absorption Modeling for Postcombustion CO 2 Capture with Additively Manufactured Structured Packing

Carbon capture using amine-based solvents in an absorption process is a leading candidate for reducing greenhouse gas emissions in industrial flue gas streams. To reduce operating costs and associated parasitic energy of these processes, process intensification utilizing additively manufactured structured packing has emerged as a new technology to manage exothermic reactions during absorption while improving CO 2 capture. A rate-based model framework has been developed for these novel packings that incorporates the mass and heat transfer phenomena for amine-based absorption of CO 2 . The rate-based model framework is first benchmarked using available solubility data and pilot plant data for aqueous monoethanolamine. The model validation shows accurate prediction of both CO 2 equilibrium partial pressures and ion speciation for solubility data as well as CO 2 capture, temperature profile, and solvent composition for pilot plant data in the absorption column. The model framework is then applied toward predicting the CO 2 capture performance of additively manufactured structured packing. Simulations agree with experimental data in predicting the CO 2 capture and the capture performance increase due to cooling within the structured packing device. Finally, advantages of this rate-based model framework are the utilization of correlations that may predict mass transfer and heat transfer coefficients of the packing based on the geometric properties of the device and the implementation of the model framework in open-source programming.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Model-Free Approach for Profiling of Polydisperse Soft Matter Using Small Angle Scattering

A strategy for determining the size polydispersity of systems from their small angle coherent scattering is outlined. Here, using the method of moment expansion, we show that the various central moments representing the average particle size, variance of particle size, and skewness of size distribution function (SDF) for polydisperse systems can be extracted from spectral analysis without bias. When the degree of polydispersity is moderate, SDF can be further reconstructed based on the maximum entropy principle. Numerical benchmarking of a model study over a wide range of size nonuniformity demonstrates the validity of this analytical approach for quantifying the size distribution of general soft matter systems in a model-free manner. Furthermore, the efficacy of this method was validated by successfully applying it to the fitting of small-angle neutron scattering data obtained from L64 Pluronic micelles using various form factor models. The numerical and experimental verification underscores the reliability and versatility of this method in accurately characterizing the size distribution of complex soft matter systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

SmileyLlama: modifying large language models for directed chemical space exploration

Here we show that large language models (LLMs) can be transformed via supervised fine-tuning of engineered prompts into SmileyLlama for exploring the chemical space of drug molecules. We benchmark SmileyLlama against pretrained LLMs and chemical language models trained from scratch for generating valid and novel drug-like molecules, and use direct preference optimization to both improve SmileyLlama’s adherence to a prompt and as part of the iMiner reinforcement learning framework to predict molecules with optimized three-dimensional conformations and high binding affinity to drug targets. By training an LLM to speak directly as a chemical language model, while retaining most of its natural language capabilities, we show that SmileyLlama can reliably generate molecules with user-specified properties rather than acting only as a chatbot with knowledge of chemistry or as a virtual assistant. While SmileyLlama is geared toward drug discovery, the supervised fine-tuning/direct preference optimization/LLM framework can be extended to other chemical, biological and materials applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

SYNCA: A Synthetic Cyclotron Antenna for the Project 8 Collaboration

Cyclotron Radiation Emission Spectroscopy (CRES) is a technique for measuring the kinetic energy of charged particles through a precision measurement of the frequency of the cyclotron radiation generated by the particle's motion in a magnetic field. The Project 8 collaboration is developing a next-generation neutrino mass measurement experiment based on CRES. One approach is to use a phased antenna array, which surrounds a volume of tritium gas, to detect and measure the cyclotron radiation of the resulting β-decay electrons. To validate the feasibility of this method, Project 8 has designed a test stand to benchmark the performance of an antenna array at reconstructing signals that mimic those of genuine CRES events. To generate synthetic CRES events, a novel probe antenna has been developed, which emits radiation with characteristics similar to the cyclotron radiation produced by charged particles in magnetic fields. This paper outlines the design, construction, and characterization of this Synthetic Cyclotron Antenna (SYNCA). Furthermore, we perform a series of measurements that use the SYNCA to test the position reconstruction capabilities of the digital beamforming reconstruction technique. Finally, we find that the SYNCA produces radiation with characteristics closely matching those expected for cyclotron radiation and reproduces experimentally the phenomenology of digital beamforming simulations of true CRES signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Nonlinear dimension reduction for surrogate modeling using gradient information

We introduce a method for the nonlinear dimension reduction of a high-dimensional function $u:{\mathbb{R}}^d\rightarrow{\mathbb{R}}$, $d\gg 1$. Our objective is to identify a nonlinear feature map $g:{\mathbb{R}}^d\rightarrow{\mathbb{R}}^m$, with a prescribed intermediate dimension $m\ll d$, so that $u$ can be well approximated by $f\circ g$ for some profile function $f:{\mathbb{R}}^m\rightarrow{\mathbb{R}}$. We propose to build the feature map by aligning the Jacobian $\nabla g$ with the gradient $\nabla u$, and we theoretically analyze the properties of the resulting $g$. Once $g$ is built, we construct $f$ by solving a gradient-enhanced least squares problem. Our practical algorithm uses a sample $\{{\textbf{x}}^{(i)},u({\textbf{x}}^{(i)}),\nabla u({\textbf{x}}^{(i)})\}_{i=1}^N$ and builds both $g$ and $f$ on adaptive downward-closed polynomial spaces, using cross validation to avoid overfitting. We numerically evaluate the performance of our algorithm across different benchmarks, and explore the impact of the intermediate dimension $m$. We show that building a nonlinear feature map $g$ can permit more accurate approximation of $u$ than a linear $g$, for the same input data set.

97 MATHEMATICS AND COMPUTING↗