SEARCH · Search NASA

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

NASA NTRS2022

Ames-2021 CO 2 Dipole Moment Surface and IR Line Lists: Toward 0.1% Uncertainty for CO 2 IR Intensities

A highly accurate CO 2 ab initio dipole moment surface (DMS), Ames-2021, is reported along with 12 C 16 O 2 infrared (IR) intensity comparisons approaching a 1–4‰ level of agreement and uncertainty. The Ames-2021 DMS was accurately fitted from CCSD(T) finite-field dipoles computed with the aug-cc-pVXZ (X = T, Q, 5) basis for C atom and the d-aug-cc-pVXZ (X = T, Q, 5) basis for O atoms, and extrapolated to the one particle basis set limit. Fitting σ(rms) is 3.8 × 10^(–7) au for 4443 geometries below 15 000 per cm . The corresponding IR intensity, S Ames-2021 , are computed using the Ames-2 potential energy surface (PES), which is the best PES available for CO 2 . Compared to high accuracy IR studies for 2001i–00001 and 3001i–00001 bands, S Ames-2021 matches NIST experiment-based intensities [S NIST-HIT16 or S HIT20 ] to −1.0 ± 1.3‰, or matches DLR experiment-based intensities [S DLR-HIT16/UCL/Ames ] to 1.9 ± 3.7‰. This indicates the systematic deviations and uncertainties have been significantly reduced in S Ames-2021 . The S UCL2015 (or S HITRAN2016 ) have larger deviations (vs S DLR ) and uncertainties (vs S DLR , S NIST ) which are attributed to the less accurate Ames-1 PES adopted in UCL-296 line list calculation. The S Ames-2021 intensity of 12 C 16 O 2 and 13 C 16 O 2 is utilized to derive new absolute 13 C/ 12 C ratios for Vienna PeeDee Belemnite (VPDB) with uncertainty reduced by 1/3 or 2/3. Further evaluation of S Ames-2021 are carried out on those CO 2 bands discussed in the HITRAN2020 update paper. Consistent improvements and better accuracies are found in band-by-band analysis, except for those bands strongly affected by Coriolis couplings, or very weak bands measured with relatively larger experimental uncertainties. The Ames-2021 296 K IR line lists are generated for 13 CO 2 isotopologues, with 18,000 per and S 296K > 1E–31) cm/molecule cutoff and then combined with CDSD line positions (except 14 C 16 O 2 ). The Ames-2021 DMS and 296 K IR line lists represent a major improvement over previous CO 2 theoretical IR intensity studies, including Ames-2016, UCL-296, and recent UCL DMS 2021 update. A real 1 permille level of agreement and uncertainty will definitely require both more accurate PES and more accurate DMS.

Chemical calculations↗

NASA NTRS2021

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗

NASA NTRS2023

Reducing Aerosol Forcing Uncertainty by Combining Models With Satellite and Within-The-Atmosphere Observations: A Three-Way Street

Aerosol forcing uncertainty represents the largest climate forcing uncertainty overall. Its magnitude has remained virtually undiminished over the past 20 years despite considerable advances in understanding most of the key contributing elements. Recent work has produced modest increases only in the confidence of the uncertainty estimate itself. This review summarizes the contributions toward reducing the uncertainty in the aerosol forcing of climate made by satellite observations, measurements taken within the atmosphere, as well as modeling and data assimilation. We adopt a more measurement-oriented perspective than most reviews of the subject in assessing the strengths and limitations of each; gaps and possible ways to fill them are considered. Currently planned programs supporting advanced, global-scale satellite and surface-based aerosol, cloud, and precursor gas observations, climate modeling, and intensive field campaigns aimed at characterizing the underlying physical and chemical processes involved, are all essential. But in addition, new efforts are needed: (a) to obtain systematic aircraft in situ measurements capturing the multi-variate probability distribution functions of particle optical, microphysical, and chemical properties (and associated uncertainty estimates), as well as co-variability with meteorology, for the major aerosol airmass types; (b) to conceive, develop, and implement a suborbital (aircraft plus surface-based) program aimed at systematically quantifying the cloud-scale microphysics, cloud optical properties, and cloud-related vertical velocities associated with aerosol-cloud interactions; and (c) to focus much more research on integrating the unique contributions of satellite observations, suborbital measurements, and modeling, to reduce the persistent uncertainty in aerosol climate forcing.

aerosol climate forcing↗

NASA NTRS2023

Understanding Volume Estimation Uncertainty of Lakes and Wetlands Using Satellites and Citizen Science

We studied variations in the volume of water stored in small lakes and wetlands using satellite remote sensing and lake water height data contributed by citizen scientists. A total of 94 water bodies across the globe were studied using satellite data in the optical and microwave wavelengths from Landsat 8, Sentinel-1, and Sentinel-2. The uncertainty in volume estimation as a function of geography and geophysical factors, such as cloud cover, precipitation, and water surface temperature, was studied. The key finding that emerged from this global study is that uncertainty is highest in regions with a distinct precipitation season, such as in the monsoon dominated South Asia or the Pacific Northwestern region of the USA. This uncertainty is further compounded when small lakes and wetlands are seasonal with alternating land use as a water body and agricultural land, such as the wetlands of Northeastern Bangladesh. On an average, 45% of studied lakes could be estimated of their volume change with a statistical significant uncertainty that is less than the expected volume in South Asia. In North America, this statistically significant uncertainty in volume estimation was found to be around 50% in lakes eastward of the 108th meridian with lowest uncertainty found in lakes along the East coast of the USA. The article provides a baseline for understanding the current state of the art in estimating volumetric change of lakes and wetlands using citizen science in anticipation of the recently launched Surface Water and Ocean Topography Mission.

Shahzaib Khan↗

NASA NTRS2024

Uncertainty Budget for Detector-Based Absolute Radiometric Calibration With GLAMR

The accuracy of the absolute radiometric calibration (RadCal) for remote sensing instruments is essential to their wide range of applications. The uncertainty associated to the traditional source-based RadCal method is assessed at a 2% (k=1) or higher level for radiance measurement. To further improve the accuracy to meet the demands of climate studies, a detector-based approach using tunable lasers as a light source has been devised. The Goddard Laser for Absolute Measurement of Radiance, known as the GLAMR system, is a notable example of the incorporation of such technology. Using transfer radiometers calibrated at NIST as calibration standards, the absolute spectral response (ASR) function of a remote sensing instrument is measured with its uncertainty traceable to the International System of Units. This paper presents a comprehensive uncertainty analysis of the detector-based absolute RadCal using the GLAMR system. It identifies and examines uncertainty sources during the GLAMR RadCal test, including those from the GLAMR system, the testing configuration, and data processing methodologies. Analysis is carried out to quantify the contribution of each source and emphasize the most influential factors. It is shown that the calibration uncertainty of GLAMR RadCal can be better than 0.3% (k=1) in the wavelength range of 350-950 nm and 0.6% (k=1) between 950-2300 nm, with the exception of regions with strong water absorption. In addition, recommendations are made to refine the calibration process to further reduce the uncertainty.

Zhipeng Wang↗

NASA NTRSDate not supplied

Uncertainty Quantification Methodology for Sonic Boom Loudness of a Low-Boom Supersonic Concept

This paper presents a comprehensive analysis of uncertainty quantification for sonic boom loudness metrics associated with the X-59 aircraft during its acoustic validation phase. The study focuses on employing advanced methodologies to characterize uncertainties in key sonic boom parameters predicted from a database derived from a computational fluid dynamics (CFD) solver. These methodologies include creating a polynomial chaos expansion (PCE) surrogate model, which is then used to run a Monte Carlo analysis to obtain 95% uncertainty intervals for sonic boom loudness parameters across the full carpet. Atmospheric uncertainties are rigorously considered, leveraging weather models based on historical data near Edwards Air Force Base to simulate potential flight conditions. The findings include preliminary uncertainty results for the full carpet during the validation phase of the Quesst mission. Additionally, a sensitivity study reveals that the primary sources of uncertainty are humidity and cruise weight.

Laura M. White↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design

UQ↗

NASA NTRSDate not supplied

Copula-based Method to Generate Consistent Surface Pressures Under Uncertainty

This paper establishes a method to create surface pressure databases that allow for uncertainty quantification. Aerodynamic databases are critical products for launch vehicles and other aeronautical systems, and surface pressure databases are one such database that constains large quantities of data. The focus of this work is the relationship between the integrated force and moment data base and the surface pressure database. In particular, the work attempts to provide a method that maintains consistency between these two databases when accounting for uncertainty. The integrated force and moment database and surface pressure databases are constructed from CFD data which is high-density but low-trust. However, the force and moment database will often also include data from high-trust but low-density sources such as from wind tunnel experiments. This means that the quantified uncertainty of the force and moment database is higher quality as it includes this high fidelity wind tunnel data. This motivates the idea to use the force and moment database uncertainty when constructing the surface pressure database uncertainty. The method utilizes the statistical idea of a copula in order to generate surface pressures that match with uncertain integrated force and moment distributions as well as being consistent with known CFD data. This statistical consistency is quantified by using the Maximum Mean Discrepancy two-sample test. The predictive error of the method is also approximated using leave-one-out error estimation and the good overall performance of the method is presented using probability boxes in a simulated uncertainty scenario.

SLS↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

UQ↗

DOE OSTI2025

Neural correspondence to spectrum of environmental uncertainty in multiple-cue probability judgment system with time delay

Despite state-of-the-art technologies like artificial intelligence, human judgment is critically essential in cooperative systems, such as the multi-agent system (MAS), which collect information among agents based on multiple-cue judgment. Human agents can prevent impaired situational awareness of automated agents by confirming situations under environmental uncertainty. System error caused by uncertainty can result in an unreliable system environment, and this environment affects the human agent, resulting in non-optimal decision-making in MAS. Thus, it is necessary to know how human behavior is changed to capture system reliability under uncertainty. Another issue affecting MAS is time delay, which can delay agent information transfer, resulting in low performance and instability. However, it is difficult to find studies on the influence of time delay on human agents. This study is about understanding the human decision-making process under a specific system reliability environment by uncertainty with time delay. We used concepts of expected and unexpected uncertainty to implement reliability of the system usage environment with three types of time delay conditions: no time delay, regular time delay, and irregular time delay conditions. We used electroencephalogram (EEG) for human cognitive neural mechanisms in multiple-cue judgment systems to understand human decision-making. In the reliability of system usage environment, the unreliable system environment significantly creates less memory load by less utilization of system rules for decision-making. In terms of time delay, delayed information delivery does not significantly affect memory load for decision-making.

cognitive process↗

DOE OSTI2025

Uncertainty improvement of 22 Na based radioactive tracer dilution for determining total mass of pyroprocessing molten salt systems by 154 Eu removal

To determine the total salt mass of the molten salt systems for pyroprocessing spent nuclear fuels, a 22 Na based radioactive tracer dilution was studied in Idaho National Laboratory in recent years. This 22 Na based RTD technique was deemed feasible, but due to the gamma energy peak of 22 Na coinciding with one of the energy peaks of 154 Eu radioisotope in the molten salt, the uncertainty of the 22 Na radioactivity in the 22 Na-spiked salt samples was quite high. To improve the uncertainty of the 22 Na based RTD technique, we proposed to chemically remove the 154 Eu of the salt samples by DGA resin for gamma spectroscopy. The effectiveness of removing 154 Eu on uncertainty improvement was evaluated. Furthermore, it was found that (1) the 154 Eu fission product effect on the uncertainty and detection limit can be effectively eliminated by chemically removing the 154 Eu during the salt sample preparation and (2) the uncertainty of 22 Na radioactivity in the salt samples for electrorefining was significantly improved from 13% to 2%, showing the potential of practical engineering application of 22 Na based RTD as a safeguards technique for molten salt systems for pyroprocessing spent nuclear fuels.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Bayesian prior construction for uncertainty quantification in first-principles statistical mechanics

First-principles statistical mechanics enables the prediction of thermodynamic and kinetic properties of materials, but is computationally expensive. Many approaches require surrogate models to calculate energies within Monte Carlo or molecular dynamics simulations. Inexpensive surrogates such as cluster expansions enable otherwise intractable calculations by interpolating data from higher accuracy methods, such as Density Functional Theory (DFT). Surrogate models introduce uncertainty into downstream calculations, in addition to any uncertainty inherent to DFT calculations. Bayesian frameworks address this by quantifying uncertainty and incorporating expert knowledge through priors. However, constructing effective priors remains challenging. This work introduces and describes practical strategies for building Bayesian cluster expansions, focusing on basis truncation, hyperparameter selection, and ground state replication. We analyze multiple basis truncation schemes, compare cross-validation to the evidence-approximation for hyperparameter optimization, and provide methods to find and enforce ground-state-preserving models through priors. Additionally, we compare the uncertainties between different approximations to DFT (LDA, PBE, SCAN) against the uncertainty introduced with the use of cluster expansion surrogate models. These approaches are demonstrated on the BCC Li x Mg 1-x and Li x Al 1-x alloys, which are both of interest for solid-state Li batteries. Our results provide guidelines for constructing and utilizing Bayesian cluster expansions, thereby improving the transparency of materials modeling. Furthermore, the approaches and insights developed in this work can be transferred to a wide range of cluster expansion surrogate models, including the atomic cluster expansion and related machine-learned interatomic potential architectures.

Alloy theory↗

DOE OSTI2026

Uncertainty guided online ensemble for non-stationary data streams in fusion science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior with distribution drifts, resulted by both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with such non-stationary data streams. Online learning techniques have been leveraged in other domains, however it has been largely unexplored for fusion applications. In this paper, we investigate online learning for continuous adaptation to drifting data streams in the prediction of Toroidal Field (TF) coils deflection at the DIII-D fusion facility. We further address the short-term performance degradation inherent to standard online learning, which arises because ground truth is unavailable at prediction time. To mitigate this issue, we propose an uncertainty-guided online ensemble framework. The method leverages the Deep Gaussian Process Approximation (DGPA) for calibrated uncertainty estimation and uses these uncertainty measures to guide a meta-algorithm that aggregates predictions from learners trained over different historical horizons. Our results show that online learning reduces prediction error by 80% compared to a static model. The online ensemble and the proposed uncertainty-guided ensemble further reduce error by approximately 6%, and 10% respectively, relative to standard single-model online learning, while also providing calibrated uncertainty estimates to support operational decision-making.

AI↗

DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗

DOE OSTI2025

GenAI4UQ: A software for forward and inverse uncertainty quantification using conditional generative AI

We introduce GenAI4UQ, a software package for forward and inverse uncertainty quantification in model calibration, parameter estimation, and ensemble forecasting. GenAI4UQ leverages a generative AI-based conditional modeling framework to address limitations of traditional inverse modeling techniques, such as Markov Chain Monte Carlo (MCMC) methods. By replacing computationally intensive iterative processes with a direct, learned mapping, GenAI4UQ enables efficient calibration of input parameters and generation of predictions directly from observations. The software supports rapid ensemble forecasting with robust uncertainty quantification while maintaining computational and storage efficiency. Built-in auto-tuning of hyperparameters simplifies model training, ensuring accessibility for users with varying expertise. Its versatile conditional generative framework is applicable across diverse scientific domains. While GenAI4UQ offers significant advantages in flexibility and efficiency, users should interpret its uncertainty estimates with caution in data-sparse scenarios, as the model may overestimate uncertainty—an effect common to all surrogate-based approaches including MCMC with surrogate models. Despite this, GenAI4UQ transforms inverse modeling by providing a fast, reliable, and user-friendly solution. It empowers researchers and practitioners to quickly estimate parameter distributions and generate model predictions for new observations, facilitating efficient decision-making and advancing the state of uncertainty quantification in computational modeling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗