Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Pre-Flight Assessment of Xenon Propellant Usage and Usage Uncertainty for the Psyche Mission

NASA’s Psyche mission will launch in 2022 and begin a 3.6-year cruise to the metallic asteroid Psyche, the largest metal asteroid in the solar system. All primary propulsion will be done with the flight-proven SPT-140 electric propulsion subsystem. The Psyche mission will feature the first use of Hall thrusters for a NASA mission, and the first use of Hall thrusters beyond cis-lunar space, which has presented some unique challenges. In this paper we describe the Psyche propellant feed system architecture, expected propellant usage for the mission, propellant gauging requirements, and challenges associated with propellant gauging. Data from two recent Maxar electric orbit-raising missions with SPT-140 thrusters are reviewed and used to assess in-flight performance. We develop a pressure-volume-temperature gauging method that incorporates the propellant temperature distributions observed in the flight data, and use this method to provide an improved quantitative understanding of in-flight propellant consumption rates and their uncertainties. The results are in excellent agreement with the results of standard Maxar gauging methods and we determine a propellant usage uncertainty of ± 7.1% 3σ based on flight telemetry. Additionally, we demonstrate that the bookkeeping method of propellant gauging accurately predicts the tank pressure flight data. This work has led to design changes in the Psyche spacecraft avionics that will further improve propellant gauging uncertainties, which is particularly important for later phases of the mission. Finally, we statistically combine the predicted propellant mass uncertainties from the two gauging methods and demonstrate that the system will meet the mission requirements for propellant uncertainty. Together, all of this work provides confidence that the Psyche mission can be successfully completed within the existing propellant budget and propellant tank capacity.

Baldwin, Jeff↗

Modis TEB Electronic Crosstalk Correction Update and Impact on L1B Product Uncertainty

The MODIS instruments on board the Terra and Aqua satellites have been in operation for over 22 and 20 years, respectively. The instruments’ calibration accuracy has been maintained, even with instrument degradation. Electronic crosstalk in the thermal emissive bands (TEB) is a known issue with an increasing impact on the calibration and product. The Terra MODIS photovoltaic (PV) longwave infrared (LWIR) bands crosstalk corrections have been applied in Collection 6.1 (C6.1). However, the electronic crosstalk contamination for some detectors in the mid-wave infrared(MWIR) bands and the Aqua PVLWIR bands affect the Level-1B(L1B) product’s measurement accuracy and image quality. In Collection 7 (C7), crosstalk corrections for select detectors in the Terra and Aqua MWIR and Aqua PV LWIR bands are applied. The entire mission crosstalk coefficients for the select detectors and bands are derived from scheduled lunar observations and populated in the form of look-up tables (LUTs). The Aqua PV-LWIR bands exhibit similar downward crosstalk trends as the Terra PV-LWIR bands, especially in recent years. The crosstalk coefficients and their trends provide a guideline for the correction application. Earth measurement analyses before and after the correction provide contamination and correction assessments. It has been shown that the product quality is enhanced with the crosstalk correction applied in C7. For C7, the crosstalk coefficient uncertainty is derived from the fit residuals between the measured values and a linear fit over a three-year sliding window. The uncertainty propagation is modeled and applied in the total uncertainty calculation intheL1B product. The TEB electronic cross talk LUT shave been processed over the entire Terra and Aqua MODIS missions. This paper presents the C7 crosstalk correction, as well as its assessment and uncertainty propagation algorithm to the TEB uncertainty.

Tiejun Chang↗

Methods for System-Level Multidisciplinary Uncertainty Analysis of Low-Boom Flight Vehicles

Current research supporting NASA’s Commercial Supersonic Technology project is focused on the efficient prediction of uncertainty in sonic boom loudness generated by low-boom aircraft concepts. This paper focuses on research incorporating aircraft trim and aerostructural analysis into a multidisciplinary system-level uncertainty analysis. This enables the modeling of a steady-state representation of a point in the uncertainty space, simulating the vehicle as it would be flown. This approach also enables multiple uncertain parameters defining the configuration of the vehicle to be reduced to three: Mach number, altitude, and aircraft weight. To demonstrate this methodology, a case study exploring a conceptual low-boom supersonic aircraft is performed. Two different approaches are used to model the interactions between nearfield pressure signature analysis and sonic boom propagation, and their performance is evaluated in terms of accuracy and computational expense. One method uses a set of local surrogate models to generate a large number of nearfield signatures and perform Monte Carlo analysis. This method is found to produce, at a lower expense, uncertainty metrics that are comparable to the second method, in which uncertainty metrics are computed based on loudness metric values obtained directly from simulated nearfield signatures.

UQ↗

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior due to drifts in the data. The drifts can arise from both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with non-stationary data streams.Online learning can be used to continuously adapt the models with new data as it is acquired. However, traditional online learning can suffer from short-term performance degradation, as ground truth are not available before making the prediction. To address this challenge, we propose uncertainty aware ensemble approach for online learning. We use Deep Gaussian Process Approximation (DGPA) technique for calibrated uncertainty estimation and use the uncertainty values to guide a meta-algorithm that produces predictions based on ensemble of learners. Moreover, DGPA also provides uncertainty estimation along with the predictions for decision makers. This paper demonstrates that the proposed method outperforms traditional online learning approach, and a naive ensemble without uncertainty guidance by about 7% and 6%, respectively, on B-coil deflection prediction at DIII-D Fusion Facility.

Rajput, Kishansingh [Thomas Jefferson National Acc↗

An uncertainty visualization framework for large-scale cardiovascular flow simulations: A case study on aortic stenosis

We present a generalizable uncertainty quantification (UQ) and visualization framework for lattice Boltzmann method simulations of high Reynolds number vascular flows, demonstrated on a patient-specific stenosed aorta. The framework combines EasyVVUQ for parameter sampling with large-eddy simulation turbulence modeling in HemeLB, and executes ensembles on the Frontier exascale supercomputer. Spatially resolved metrics, including entropy and isosurface-crossing probability, are used to map uncertainty in pressure and wall shear stress fields directly onto vascular geometries. Two sources of model variability are examined: inlet peak velocity and the Smagorinsky constant. Inlet velocity variation produces high uncertainty downstream of the stenosis where turbulence develops, while upstream regions remain stable. Smagorinsky constant variation has little effect on the large-scale pressure field but increases WSS uncertainty in localized high-shear regions. In both cases, the stenotic throat manifests low entropy, indicative of robust identification of elevated WSS. By linking quantitative UQ measures to three-dimensional anatomy, the framework improves interpretability over conventional 1D UQ plots and supports clinically relevant decision-making, with broad applicability to vascular flow problems requiring both accuracy and spatial insight.

Hemodynamics↗

Decision-Dependent Uncertainty-Aware Distribution System Planning Under Wildfire Risk

The interaction between power systems and wildfires can be dangerous and costly. Distribution grids can be liable for the outbreak of wildfires during extreme weather. In wildfire-prone areas, investment planning should consider the impact of operational actions on wildfire-related uncertainties affecting line failure likelihood. Here, in this case, endogenous-based uncertainty modeling should comprise the backbone of the investment planning model viz-a-viz the inability of standard exogenous-based uncertainty modeling. Therefore, we propose a decision-dependent uncertainty (DDU) aware methodology to optimize investment portfolios for distribution systems, considering that high power-flow levels in high-threat areas can ignite wildfires and increase line failure probability. The methodology identifies the best combination of upgrades (new lines, hardening existing lines, and placing switching devices). Methodologically, we propose a two-stage distributionally robust planning optimization problem with DDU that considers the distribution system's multiperiod operation. The first stage determines optimal switching actions and line investments, and the second stage evaluates the worst-case expected operational cost under a DDU framework designed to account for the endogenous impact of power-flow levels and hardening investment decisions in the line failure probabilities. An iterative method is tailored to handle the problem and numerical experiments demonstrate a more prepared grid to deal with wildfire risk.

Power systems investment planning↗

Deliverable 6.7-Final Technical Report: Development Summary and Evaluation of the Solar Uncertainty Integrator (SUNI) Software

The Data Quality and Uncertainty Integration Project was a three-year effort to address stakeholder needs for assessing solar radiation resource data quality based on existing tools for estimating radiometer measurement uncertainties and assessing post-measurement data quality. The annual research objectives for the project addressed a logical progression of effort needed to achieve the ultimate project goal of developing the Solar Uncertainty Integrator (SUNI) software. This final technical report summarizes the development process for achieving these key research objectives and addresses the outreach and code development efforts in the final year of the project to develop a new solar irradiance data uncertainty integration software package.

14 SOLAR ENERGY↗

Design Under Uncertainty with Design-Dependent Uncertain Variables

Uncertainty quantification (UQ) can provide a more robust understanding of a system, leading to better informed decisions earlier in the design process. The additional information that UQ provides can be leveraged during a design optimization process known as design under uncertainty that, when incorporated with multidisciplinary design and optimization, can become computationally infeasible due to the large number of responses required for meaningful results. Previous work addressed reducing the computational expense in design under uncertainty by incorporating analytic derivatives throughout polynomial chaos expansion. Although this allows design under uncertainty to be feasible for more systems, some multidisciplinary systems have design-dependent uncertain variables. This paper details an implementation of design dependent uncertain variables in a manner than preserves derivatives required for efficient gradient-based optimization throughout the process. Two analytic examples of design-dependent uncertain variables are given: the first transforms a uniform uncertain variable with one design variable and the second transforms a normal uncertain variable with two design variables. The polynomial chaos expansion (PCE) results are comparable to both the Monte Carlo (MC) results and the analytic results for the two examples. A case study that maximizes the lift-to-drag ratio with a design-dependence between the wing leading edge sweep angle and uncertain parameter percentage of laminar flow is compared to a MC and alternative optimization formulations. This paper demonstrates that design-dependent uncertain variables are valid and hold throughout PCE.

robust design↗

Quantifying Uncertainties in Modeling Wind Resource Data from Different PBL Schemes in the WRF Model: A Case Study Over the Puerto Rico Region

This study examines the modeling uncertainty of wind resource data stemming from the use of various planetary boundary layer (PBL) parameterizations available in the Weather Research and Forecasting (WRF) model. WRF-based wind simulations spanning 20 years at 3-km resolution using 11 different PBL schemes are used to objectively investigate the uncertainty in modeling wind speed for land-based wind (LBW) and offshore wind (OSW) locations in Puerto Rico. The uncertainty in the wind modeling for the 20-year dataset is quantified using the spread index (SI) and standard deviation (SD). For virtual LBW and OSW sites, the SI and SD values are analyzed as calculated across various spatial and temporal scales. Because the PBL's atmospheric stability conditions can be characterized into two dominant categories, the study focuses on analyzing the SI and SD for daytime (mainly unstable PBL conditions) and nighttime (mainly stable PBL conditions). For wind shear (10 m-200 m) at the OSW and LBW sites, WRF-based numerical experiments indicate the following SI (or SD) ranges: 39%-94% (0.74 m/s-1.44 m/s) during the daytime for OSW, 50%-75% (0.68 m/s-1.19 m/s) during the daytime for LBW, 37%-60% (0.73 m/s-1.12 m/s) during the nighttime for OSW, and 57%-143 % (0.65 m/s-1.43 m/s) during the nighttime for LBW. While a high SI is observed when modeling LBW during the nighttime, there are notable modeling uncertainties during the daytime on the leeward side of the orographic barriers for Puerto Rico.

17 WIND ENERGY↗

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗

Uncertainty quantification and reliability assessment for intermodal freight transportation

Intermodal freight optimization models support cost-effective, low-emission, and timely goods movement by coordinating trucks, rail, and barges. These models determine optimal flows, routing, and modal switches while respecting infrastructure and operational constraints. However, their real-world utility is often undermined by pervasive uncertainties-such as fluctuating transportation costs and emissions, variable terminal capacities, and uncertain freight demand-that distort key performance outcomes, including total system cost, carbon footprint, and transit time reliability. This study presents a structured framework for quantifying uncertainty in intermodal freight transportation (IFT) optimization. The framework evaluates how input uncertainty affects system performance and reliability, a critical need for ensuring that model-based decisions remain robust under real-world variability, especially amid volatile fuel prices, shifting demand, and growing disruptions. It integrates three complementary methods: (1) Sobol-based global sensitivity analysis to identify influential parameters affecting cost, emissions, and transit time, (2) Monte Carlo-based capacity perturbation analysis to assess robustness under probabilistic facility disruptions, and (3) Monte Carlo filtering with Bayesian inference to detect threshold-based performance vulnerabilities. The results highlight diesel truck unit cost as the dominant driver of variability. To improve system resilience, planners should prioritize uncertainty in fuel-related parameters when designing intermodal strategies.

Intermodal freight transportation↗

Uncertainty-Aware Machine Learning for Small-Angle X-ray Scattering Analysis in Autonomous Experimentation

Small-angle X-ray scattering (SAXS) is a powerful high-throughput characterization tool for probing nanoscale structure in native sample environments, providing real-time morphological information such as nanoparticle size and shape during synthesis. However, automated SAXS data analysis for extracting meaningful structural parameters is non-trivial and remains a bottleneck in closed-loop experimentation towards autonomous materials discovery, which demands fast, reliable, and uncertainty-aware data analysis. Here, we develop a machine-learning approach for automated SAXS analysis tailored to closed-loop nanoparticle synthesis. A Random Forest (RF) regression model is trained on 100,000 synthetic SAXS curves generated from polydisperse spherical nanoparticles with realistic background contributions. Using normalized one-dimensional SAXS intensity profiles as input, the RF model directly predicts nanoparticle radius, size polydispersity, and background parameters, while the ensemble standard deviation across trees provides built-in uncertainty quantification (UQ). On synthetic data, we show that combining fit-quality metrics (R 2 , MAE) with thresholds on prediction uncertainty reliably identifies accurate parameter estimates without access to ground truth. We then apply the trained model to 365 experimental SAXS profiles of citrate-reduced gold nanoparticles synthesized using an automated droplet-flow microreactor with in situ SAXS at a synchrotron beamline, classifying the results into high- and low-confidence subsets based on UQ metrics. Finally, we integrate RF-based SAXS analysis into a simulated closed-loop optimization campaign using Gaussian process Bayesian optimization to minimize nanoparticle polydispersity, benchmarking against conventional automated Levenberg–Marquardt fitting. The RF-guided campaign exhibits substantially faster convergence and lower relative opportunity cost (∼0.07 vs ∼0.3), demonstrating that uncertainty-aware machine-learning SAXS analysis significantly enhances the efficiency and robustness of autonomous nanomaterials synthesis workflows.

Bayesian optimization↗

A Novel Framework to Project the Permafrost Fate With Explicit Quantification of Soil Property and Future Climate Uncertainties

This study develops a novel general framework to project the permafrost fate with rigorous uncertainty quantification to assess dominant sources. Borehole temperature records from three sites in the Russian western Arctic are used to constrain the uncertainty of a high‐fidelity freeze‐thaw model. Projections from 9 Global Climate Models (GCM) are stochastically downscaled to generate future trajectories of surface ground heat flux. Under the two emission scenarios SSP2‐4.5 and SSP5‐8.5, the projected average thawing depths by 2100 vary from 0.4 to 14.4 m or 2.1 to 17.7 m, and the increase in the top 10 m average temperature from 2015 to 2100 is 1.2–2.7°C or 1.9–3.0°C. The results show that the freeze‐thaw model uncertainty can sometimes dominate over that of GCM outputs, calling for site‐specific information to improve model accuracy. The framework is applicable for understanding permafrost degradation and related uncertainties at larger scales.

Bayesian downscaling↗

Uncertainty-Aware and Explainable Human Error Detection in the Operation of Nuclear Power Plants

The timely and accurate identification of incidents, such as human factor error, is important to restore nuclear power plants (NPPs) to a stable state. However, the identification of abnormal operating conditions is difficult because of the existence of multiple scenarios. In addition, to implement mitigation actions rapidly after an incident occurs, operators must accurately identify an incident by monitoring the trends of many variables. The mental burden posed by this can increase human error and cause failure in identifying incidents. Failure to identify incidents directly results in erroneous mitigation measures, which are detrimental to NPPs. In this study, we leverage uncertainty-aware models to identify such errors and thereby increase the chances of mitigating them. We use the data collected from a physical test bed. The goal is to identify both certain and accurate models. For this, the two main aspects of focus in this study are explainable artificial intelligence (XAI) and uncertainty quantification (UQ). While XAI elucidates the decision pathway, UQ evaluates decision reliability. Their integration paints a comprehensive picture, signifying that understanding decisions and their confidence should be interlinked. Thus, in this study we leverage UQ measures (e.g. entropy and mutual information) along with Shapley additive explanations to gain insights into the features contributing to both accuracy and uncertainty in error identification. Furthermore, our results show that uncertainty-aware models combined with XAI tools can explain the artificial intelligence–prescribed decisions, with the potential of better explaining errors for the operators.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Monte Carlo Dropout Uncertainty Quantification of Long Short-Term Memory Autoencoder Anomaly Detection in a Liquid Sodium Cold Trap

Advanced high-temperature fluid reactors, such as sodium-cooled fast reactors (SFRs) and molten salt–cooled reactors (MSCRs), require coolant purification systems to prevent fluid contamination and local freezing that can lead to plugging. Liquid sodium purification can be achieved with a cold trap, where the sodium temperature is reduced to a near-freezing point to precipitate out impurities. Automation of monitoring of the cold trap performance with machine learning algorithms can aid in early detection of incipient anomalies. An efficient approach to loss-of-coolant–type anomaly detection in a cold trap monitored with more than two dozen thermal-hydraulic sensors consists of a long short-term memory (LSTM) autoencoder. This work develops the uncertainty quantification of the LSTM autoencoder performance for cold trap anomaly detection using the Monte Carlo (MC) dropout method. The MC dropout methodology creates a distribution of sister distributions that all slightly differ from each other because of random neurons being turned off for testing. The variances of the sister network distributions are used to make an uncertainty interval. Our analysis shows that the uncertainty in the autoencoder performance is largest near the peak of the anomaly signal. Using the MC dropout method, we investigate the uncertainty in the anomaly detection with missing sensor inputs. This capability allows the reactor operator to evaluate resilience of the anomaly detection system and to make informed decisions about continuity of operation in the event of sensor failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗