Search NASA⌕ Search

SEARCH · Search NASA

Results for “model form uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Development of a Data Fusion Methodology for Lineload Aerodynamic Databases for a Launch Vehicle during Liftoff and Transition

The need for databases for the distributed loading on launch vehicles during the early portion of flight necessitates the use of expensive computational flows in regimes where wake effects dominate. While also being expensive, this is a regime that computational tools tend to historically have problems simulating accurately. To help tackle this problem, a method of data fusion to combine computational results to wind tunnel derived force and moment data is developed. Using this method, significant reduction in computational costs and increases in confidence of the final product is possible and has been used to generate several databases for the Space Launch System (SLS) at NASA. While the full details of database generation are not part of this work, the crucial method at its core is developed here. Two SLS geometries are used throughout the work to demonstrate the techniques. These are two of the larger geometries and represent both planned crewed missions to the Moon as well as potential cargo missions to deep space. The method uses principal component analysis (PCA) to generate a reduced ordered model (ROM) to help fill in the full parameter space. Other similar techniques are explored, but were not found to have a significant result on the predictions of the ROM. Because the full number of components are kept to generate the model, this lack of difference is expected. This method is then extended to ensure that predicted surfaces match trusted force and moment data derived from wind tunnel testing. This extension is done by setting up a constrained optimization problem in order to minimize the deviation from the surface resolved computational data while still integrating to the desired values. When generating the constrained optimization problem, a weighting factor to balance these competing needs is introduced. The work compares previously introduced weighting terms from similar work to the proposed terms and shows that the previously used terms do not have as desirable behavior in this flow regime. This method is then expanded by developing a technique to incorporate uncertainty quantification into the developed data fusion methodology. This expansion takes a two pronged approach. One examines transferring the uncertainties in the force and moment database and characterizes how those adjustments change the predicted lineloads. The second looks at model form error and looks how rebuilding the model using slightly different data changes the predictions. These two terms are then combined in order to create an uncertainty model that takes both effects into account. The limitations of the proposed methods is then discussed as well as possible techniques to address these shortcomings.

Launch Vehicles↗
DOE OSTI2022

Network Uncertainty Quantification for Analysis of Multi-Component Systems

To impact physical mechanical system design decisions and realize the full promise of high-fidelity computational tools, simulation results must be integrated at the earliest stages of the design process. This is particularly challenging when dealing with uncertainty and optimizing for system-level performance metrics, as full-system models (often notoriously expensive and time-consuming to develop) are generally required to propagate uncertainties to system-level quantities of interest. Methods for propagating parameter and boundary condition uncertainty in networks of interconnected components hold promise for enabling design under uncertainty in real-world applications. These methods avoid the need for time consuming mesh generation of full-system geometries when changes are made to components or subassemblies. Additionally, they explicitly tie full-system model predictions to component/subassembly validation data which is valuable for qualification. These methods work by leveraging the fact that many engineered systems are inherently modular, being comprised of a hierarchy of components and subassemblies that are individually modified or replaced to define new system designs. By doing so, these methods enable rapid model development and the incorporation of uncertainty quantification earlier in the design process. The resulting formulation of the uncertainty propagation problem is iterative. We express the system model as a network of interconnected component models, which exchange solution information at component boundaries. We present a pair of approaches for propagating uncertainty in this type of decomposed system and provide implementations in the form of an open-source software library. We demonstrate these tools on a variety of applications and demonstrate the impact of problem-specific details on the performance and accuracy of the resulting UQ analysis. This work represents the most comprehensive investigation of these network uncertainty propagation methods to date.

42 ENGINEERING↗
DOE OSTI2023

TRISO fuel performance analysis: Uncertainty quantification toward optimization

Tri-structural isotropic (TRISO) fuel particles are a fuel form being considered for potential use in next-generation nuclear reactors (i.e., high-temperature gas-cooled reactors). Though the TRISO fuel manufacturing process has continually advanced in recent years, particle comparisons still reveal statistical variations and uncertainties in terms of geometric configurations and material properties. Given that the physical processes ongoing in TRISO fuel particles during reactor operation are highly correlated with each other, a small degree of uncertainty in one model may lead to significant uncertainty in another. This makes appropriate uncertainty quantification of TRISO fuel particles essential. However, one may wonder about the extent to which the current version of TRISO particles has been optimized, and whether any room remains for further improvements. This paper quantifies TRISO fuel performance model uncertainties that stem from geometric and material data. For this analysis, the BISON code was used, and the Advanced Gas Reactor (AGR)-2 experiment served as a reference case. A total of 10 5 calculations was performed for the uncertainty and optimization analysis, altering the geometric and material data within their uncertainty range. Lastly, the optimization potential of TRISO particles is evaluated from a fuel performance perspective.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Baselining the Indirect Effect by Improving Quantification of Sea Spray and Marine Sources at Ascension Island (Final Report)

Oceans cover two-thirds of the Earth and understanding the interactions of aerosols with clouds in these large marine regions requires quantifying the man-made contributions to the budget of cloud-drop forming particles (known as cloud condensation nuclei, or CCN) relative to the non-manmade “baseline” conditions and understanding the meteorology of boundary layer clouds. Modeling studies have shown substantial uncertainties and sensitivities to natural marine CCN sources, meaning that to reduce uncertainties in indirect effects we must be able to better quantify the CCN budget in ocean regions. While models provide important constraints on these uncertainties, actually reducing uncertainties requires substantial observations in open-ocean and coastal regions in order to establish the baseline on which manmade emissions are added. The tropical South Atlantic Ocean is one of the least-sampled regions of the planet, making the comprehensive measurements of the Department of Energy Atmospheric Radiation Measurement Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign provides the longest record of aerosol size distribution measurements from a differential mobility analyzer in a cloud-influenced marine location in the ARM database, with 17 months of ground-based aerosol size distribution measurements. This project addressed the research topic of Aerosol-Cloud Interactions (ACI) by supporting three publications from the LASIC measurements: 1. The ARM measurements were combined with a new value-added technique that was pioneered by the Russell group for quantifying sea salt. This quantification of sea salt uses supermicron scattering measurements for retrieving reasonable sea spray mass concentrations, providing the best-available, observationally-constrained estimate of the sea spray mode properties when supermicron size distribution measurements are not available. 2. The fitted modes of the distribution were used to investigate the signatures of cloud processing for very clean to very smoky aerosol conditions, revealing not only differences in the particles that activate in clouds but also in the mechanisms that control that droplet formation process. In clean air, the size required to form a cloud droplet is influenced by the number of particles, as well as how quickly particles take up water during growth in cloud. 3. Building on this aerosol characterization, cloud and meteorological conditions were used to evaluate aerosol-related changes in cloud albedo and optical depth. We introduced a new method of decomposing the impact of aerosols on clouds known as the Twomey effect by incorporating retrieved supersaturation from two independent sets of observations to constrain the feedback of aerosol particles on cloud properties. The method quantifies the reduction of the Twomey effect at high aerosol concentrations, which has never been explained quantitatively by observations. In addition, the results provide the first direct validation for the conditions observed in the tropical South Atlantic of a parcel-based approach that is embedded in many climate models. Together these findings illustrate how ARM extended field campaigns in stratocumulus-covered regions can be used to constrain ACI processes with direct observations, providing specific radiative effects without models. By making such process-specific constraints available to improve ACI in global climate models, ARM observations play a key role in supporting model development.

58 GEOSCIENCES↗
DOE OSTI2019

Uncertainty Quantification of Microstructural Material Variability Effects

This project has developed models of variability of performance to enable robust design and certification. Material variability originating from microstructure has significant effects on component behavior and creates uncertainty in material response. The outcomes of this project are uncertainty quantification (UQ) enabled analysis of material variability effects on performance and methods to evaluate the consequences of microstructural variability on material response in general. Material variability originating from heterogeneous microstructural features, such as grain and pore morphologies, has significant effects on component behavior and creates uncertainty around performance. Current engineering material models typically do not incorporate microstructural variability explicitly, rather functional forms are chosen based on intuition and parameters are selected to reflect mean behavior. Conversely, mesoscale models that capture the microstructural physics, and inherent variability, are impractical to utilize at the engineering scale. Therefore, current efforts ignore physical characteristics of systems that may be the predominant factors for quantifying system reliability. To address this gap we have developed explicit connections between models of microstructural variability and component/system performance. Our focus on variability of mechanical response due to grain and pore distributions enabled us to fully probe these influences on performance and develop a methodology to propagate input variability to output performance. This project is at the forefront of data-science and material modeling. We adapted and innovated from progressive techniques in machine learning and uncertainty quantification to develop a new, physically-based methodology to address the core issues of the Engineering Materials Reliability (EMR) research challenge in modeling constitutive response of materials with significant inherent variability and length-scales.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Stochastic Design Optimization of Microstructural Features Using Linear Programming for Robust Design

Microstructure design can have a substantial effect on the performance of critical components in numerous aerospace applications. However, the stochastic nature of metallic microstructures leads to deviations in material properties from the design point and alters the performance of these critical components. In this paper, a novel stochastic linear programming (LP) methodology is developed for microstructure design accounting for uncertainties in desired properties. The metallic microstructure is represented using a finite element discretized form of the orientation distribution function (ODF). The inverse LP problem solves the mean values and covariance matrix of the ODFs to maximize the mean values of a property, given the statistical constraints on other properties. The highlight is an analytical uncertainty quantification model via a Gaussian distribution to model propagation of microstructural uncertainties to the properties. Examples illustrate maximization of the yield strength and magnetostriction of a galfenol alloy when constrained by uncertainties in a set of stiffness constants.

42 ENGINEERING↗
DOE OSTI2025

Role of Uncertainty Quantification in the Explainability of Large Language Models for the Nuclear Industry

The meteoric rise of generative artificial intelligence (AI) large language models (LLMs) has created an opportunity to utilize them to increase efficiencies in a multitude of industries. While LLMs carry great potential to revolutionize the manner in which work is performed, numerous known deficiencies limit their utility, including the black box nature of the models, the stochastic nature of the response (i.e., presenting the same prompt multiple times results in different responses), and the potential for hallucination. Widespread adoption of LLMs in safety-critical industries such as nuclear will require some form of explainability to assure end users that the LLM’s response to a given query is valid. Model uncertainty is inherently linked to the concepts of trust and explainability, and can be used to identify situations in which the model is insufficiently certain about its answer. Although uncertainty is not enough in and of itself to determine the suitability of an answer—a model can be very certain of an inaccurate answer—it still provides valuable supporting information. Practical methodologies for gauging or quantifying the uncertainty in LLM outputs are presented herein, along with examples based on nuclear-specific prompts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2023

Ocean Carbon From Space: Current Status and Priorities for the Next Decade

The ocean plays a central role in modulating the Earth’s carbon cycle. Monitoring how the ocean carbon cycle is changing is fundamental to managing climate change. Satellite remote sensing is currently our best tool for viewing the ocean surface globally and systematically, at high spatial and temporal resolutions, and the past few decades have seen an exponential growth in studies utilising satellite data for ocean carbon research. Satellite-based observations must be combined with in-situ observations and models, to obtain a comprehensive view of ocean carbon pools and fluxes. To help prioritise future research in this area, a workshop was organised that assembled leading experts working on the topic, from around the world, including remote-sensing scientists, field scientists and modellers, with the goal to articulate a collective view of the current status of ocean carbon research, identify gaps in knowledge, and formulate a scientific roadmap for the next decade, with an emphasis on evaluating where satellite remote sensing may contribute. A total of 449 scientists and stakeholders participated (with balanced gender representation), from North and South America, Europe, Asia, Africa, and Oceania. Sessions targeted both inorganic and organic pools of carbon in the ocean, in both dissolved and particulate form, as well as major fluxes of carbon between reservoirs (e.g., primary production) and at interfaces (e.g., air-sea and land–ocean). Extreme events, blue carbon and carbon budgeting were also key topics discussed. Emerging priorities identified include: expanding the networks and quality of in-situ observations; improved satellite retrievals; improved uncertainty quantification; improved understanding of vertical distributions; integration with models; improved techniques to bridge spatial and temporal scales of the different data sources; and improved fundamental understanding of the ocean carbon cycle, and of the interactions among pools of carbon and light. We also report on priorities for the specific pools and fluxes studied, and highlight issues and concerns that arose during discussions, such as the need to consider the environmental impact of satellites or space activities; the role satellites can play in monitoring ocean carbon dioxide removal approaches; economic valuation of the satellite based information; to consider how satellites can contribute to monitoring cycles of other important climatically-relevant compounds and elements; to promote diversity and inclusivity in ocean carbon research; to bring together communities working on different aspects of planetary carbon; maximising use of international bodies; to follow an open science approach; to explore new and innovative ways to remotely monitor ocean carbon; and to harness quantum computing. Overall, this paper provides a comprehensive scientific roadmap for the next decade on how satellite remote sensing could help monitor the ocean carbon cycle, and its links to the other domains, such as terrestrial and atmosphere.

oceanography↗
DOE OSTI2020

Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data

The physics of ferroelectric domain walls is explored using the Bayesian inference analysis of atomically resolved STEM data. We demonstrate that domain wall profile shapes are ultimately sensitive to the nature of the order parameter in the material, including the functional form of Ginzburg-Landau-Devonshire expansion, and numerical value of the corresponding parameters. The preexisting materials knowledge naturally folds in the Bayesian framework in the form of prior distributions, with the different order parameters forming competing (or hierarchical) models. Here, we explore the physics of the ferroelectric domain walls in BiFeO 3 using this method, and derive the posterior estimates of relevant parameters. More generally, this inference approach both allows learning materials physics from experimental data with associated uncertainty quantification, and establishing guidelines for instrumental development answering questions on what resolution and information limits are necessary for reliable observation of specific physical mechanisms of interest.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗
DOE OSTI2020

Uncertainty Quantification of Machine Learning Predicted Creep Property of Alumina-Forming Austenitic Alloys

The development of machine learning (ML) approaches in materials science offers the opportunity to exploit existing engineering and developmental alloy datasets, such as Oak Ridge National Laboratory (ORNL)’s consistently measured creep-rupture dataset for alumina-forming austenitic (AFA) alloys, to accelerate their further development. As a first step toward achieving ML insights for improved alloy design, the potential sources of uncertainty and their impacts on ML output are examined. It is observed that the selection of algorithms and features as well as data sampling significantly affects the performance of ML models, either positively or negatively. Further, the performance of various ML models in predicting the creep properties of AFA alloys is compared, with further evaluation by assessment of a small set of new developmental AFA alloys that were not part of the training dataset. The present study demonstrates that uncertainty quantification (UQ) is essential in materials science for evaluating the performance of ML algorithms with specifically selected feature sets and obtaining a comprehensive understanding of their limitations and the resultant capability of effective prediction in complex materials systems.

36 MATERIALS SCIENCE↗
DOE OSTI2024

MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade

The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model’s main branch and is now freely available.

Adjoints↗
DOE OSTI2021

From noise to information: The transfer function formalism for uncertainty quantification in reconstructing the nuclear density

The neutron distribution of neutron-rich nuclei provides critical information on the structure of finite nuclei and neutron stars. Parity violating experiments—such as PREX and CREX—provide a clean and largely model-independent determination of neutron densities. Such experiments, however, are challenging and expensive, which is why sound statistical arguments are required to maximize the information gained. We introduce a new framework, the “transfer function formalism,” aimed at uncertainty quantification, model selection, and experimental design in the context of neutron densities. The transfer functions (TFs) are built analytically by expressing the linear response of the objective function (e.g., χ2) to small perturbations of the data. Using the TF formalism, we are able to analyze the expected overall uncertainty—quantified in terms of bias and variance—of the mean square radius and interior density of 48 Ca and 208 Pb. Using relativistic mean field models as a proxy for the weak-charge density—and assuming that a total of five measurements could be performed on the weak form factor of 48 Ca and 208 Pb—we identify the optimal models and experimental locations that minimize the uncertainty in the extraction of the radius and interior density. We also explore the use of the TF formalism to understand the influence of prior distributions for the model parameters, as well as the optimization of model hyperparameters not constrained by the data. Here,we establish how the choice of experimental locations and the model that is used can have a significant impact on the final uncertainties of the extracted quantities of interest. For challenging experiments such as CREX and PREX, a proper quantification of such uncertainties is critical. We have demonstrated how the TF formalism provides several advantages for this type of analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2018

Uncertainty quantification for incident helium flux in plasma-exposed tungsten

In this work, the surface response of a tungsten plasma-facing component was simulated by a cluster-dynamics code, Xolotl, with a focus on quantifying the impact of uncertainty in one of the input parameters to Xolotl, namely, the incident helium flux. The simulated conditions involve a tungsten surface exposed to 100 eV helium ion implantations with a flux of either 4 × 10 22 or 4 × 10 25 He m -2 s -1 . Furthermore, two sources were used to describe the implanted helium depth distribution in tungsten, either molecular dynamics (MD) or a binary collision approximation code, the stopping and range of ions in matter (SRIM). The aim of this work is to evaluate and examine uncertain predictions on the helium retention based on these two different modeling methodologies that either neglect electronic energy loss or the crystalline structure of the solid, respectively. An embedded model-form error approach was pursued here in order to arrive at predictions that account for variability due to the two different data sources, and the impact of this model-form uncertainty in incident helium flux on Xolotl output was presented for the two implantation fluxes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Recommended nuclear data for medical radioisotope production: diagnostic gamma emitters

An extensive series of evaluations have been performed as part of an IAEA coordinated research project to study a set of nuclear reactions that produce the diagnostic gamma-ray emitting radionuclides Cr- 51 , Tc- 99m , In- 111 , I-123 and Tl- 201 . Recommended cross-section data in the form of excitation functions have been derived, along with quantifications of their uncertainties. These evaluations compiled the compilation of all previously published values and newly measured experimental data, followed by critical assessments and selection of those experimental datasets and accompanying uncertainties judged to be fully valid and statistically consistent for model-independent least-squares fitting by means of Pade approximations. Integral yields as a function of the energy were also calculated on the basis of the recommended cross sections deduced from these various fits. All evaluated numerical conclusions and their corresponding uncertainties are available online at www-nds.iaea.org/medical/gamma_emitters.html and also on the medical portal of the International Atomic Energy Agency/Nuclear Data Section (IAEA-NDS) www-nds.iaea.org/medportal

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2026

Documentation, assessment, and improvements of fission gas modeling capabilities in BISON

Fission gas behavior critically affects nuclear fuel performance, influencing thermal conductivity, microstructure, swelling, and fuel-cladding interactions. The Simple Integrated Fission Gas Release and Swelling (Sifgrs) model, implemented within the BISON fuel performance code, provides advanced capabilities for modeling these phenomena. This manuscript reviews and assesses Sifgrs’ modular structure and submodels describing intragranular, intergranular, and release mechanisms. The modular implementation enables rapid improvements as our understanding advances and new fuel forms emerge. After an overview of capabilities, we present a comprehensive validation suite, comparing predictions to experimental data from tests under normal and transient conditions, including reproduction of the Vitanza curve. Results demonstrate Sifgrs’ accuracy, robustness, and applicability. Current limitations and ongoing efforts are discussed, including mechanistic, multiscale modeling, uncertainty quantification, and validation within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, supporting the safe and efficient use of nuclear fuels.

BISON↗
DOE OSTI2026

Desmearing Bonse–Hart USANS data using Bayesian Gaussian process regression

Ultra-small-angle neutron scattering (USANS) enables access to micrometer-scale structures but is intrinsically affected by strong, anisotropic resolution smearing arising from slit-geometry optics. As a result, recovery of the intrinsic scattering intensity constitutes an ill-posed inverse problem, and commonly used iterative desmearing methods lack rigorous uncertainty quantification. We present a Bayesian desmearing framework for slit-geometry USANS based on Gaussian process regression. In this approach, the scattering intensity is modeled as a smooth random function, and the instrumental point spread function is incorporated explicitly as a forward operator. The resulting formulation yields a closed-form maximum a posteriori solution with well-defined credibility intervals. Computational benchmarks and experimental validation using combined USANS and small-angle neutron scattering (SANS) measurements demonstrate that the framework enables stable desmearing, suppresses experimental noise, and preserves physically meaningful structural features under realistic conditions.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗
NASA NTRSDate not supplied

HIFiRE Flight 2 Unstart Reliability Analysis

The objective of this work was to assess the unstart reliability of the HIFiRE Flight 2 system. To do this, a quantification of margins and uncertainties framework was used for comparing model predictions of the predicted combustion induced shock location to the predicted last stable shock location within the isolator. Uncertainty sources included parametric uncertainty in the flight conditions, the heat release model, and turbulence modeling, as well as model verification errors. Additionally, an estimate of model-form uncertainty was established by comparing the model to measured ground test data. A computationally efficient non-intrusive polynomial chaos approach was used to propagate parametric uncertainty through the computational flu-ids dynamics models of both the ground test configuration and the flight vehicle. Compared to direct-connect ground test data, computational fluid dynamics predictions yielded about two duct heights of model-form uncertainty. This was applied to a prediction of flight vehicle unstart margin at the Mach 6.5 flight condition. Building up all of the computational model uncertainty, including parametric uncertainty, verification errors, and the determined model-form uncertainty, a 95% probability level based confidence ratio, or a ratio of total uncertainty to a statistical margin measure, was found to be 0.31 for the flight system.

Thomas K West↗