Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗
NASA NTRS2015

Calibration of Predictor Models Using Multiple Validation Experiments

This paper presents a framework for calibrating computational models using data from several and possibly dissimilar validation experiments. The offset between model predictions and observations, which might be caused by measurement noise, model-form uncertainty, and numerical error, drives the process by which uncertainty in the models parameters is characterized. The resulting description of uncertainty along with the computational model constitute a predictor model. Two types of predictor models are studied: Interval Predictor Models (IPMs) and Random Predictor Models (RPMs). IPMs use sets to characterize uncertainty, whereas RPMs use random vectors. The propagation of a set through a model makes the response an interval valued function of the state, whereas the propagation of a random vector yields a random process. Optimization-based strategies for calculating both types of predictor models are proposed. Whereas the formulations used to calculate IPMs target solutions leading to the interval value function of minimal spread containing all observations, those for RPMs seek to maximize the models' ability to reproduce the distribution of observations. Regarding RPMs, we choose a structure for the random vector (i.e., the assignment of probability to points in the parameter space) solely dependent on the prediction error. As such, the probabilistic description of uncertainty is not a subjective assignment of belief, nor is it expected to asymptotically converge to a fixed value, but instead it casts the model's ability to reproduce the experimental data. This framework enables evaluating the spread and distribution of the predicted response of target applications depending on the same parameters beyond the validation domain.

Crespo, Luis G.↗
NASA NTRS2010

Sources of Uncertainty in Predicting Land Surface Fluxes Using Diverse Data and Models

In the domain of predicting land surface fluxes, models are used to bring data from large observation networks and satellite remote sensing together to make predictions about present and future states of the Earth. Characterizing the uncertainty about such predictions is a complex process and one that is not yet fully understood. Uncertainty exists about initialization, measurement and interpolation of input variables; model parameters; model structure; and mixed spatial and temporal supports. Multiple models or structures often exist to describe the same processes. Uncertainty about structure is currently addressed by running an ensemble of different models and examining the distribution of model outputs. To illustrate structural uncertainty, a multi-model ensemble experiment we have been conducting using the Terrestrial Observation and Prediction System (TOPS) will be discussed. TOPS uses public versions of process-based ecosystem models that use satellite-derived inputs along with surface climate data and land surface characterization to produce predictions of ecosystem fluxes including gross and net primary production and net ecosystem exchange. Using the TOPS framework, we have explored the uncertainty arising from the application of models with different assumptions, structures, parameters, and variable definitions. With a small number of models, this only begins to capture the range of possible spatial fields of ecosystem fluxes. Few attempts have been made to systematically address the components of uncertainty in such a framework. We discuss the characterization of uncertainty for this approach including both quantifiable and poorly known aspects.

Dungan, Jennifer L.↗
DOE OSTI2025

Enhancing generative molecular design via uncertainty-guided fine-tuning of variational autoencoders

In recent years, deep generative models have been successfully applied to various molecular design tasks, particularly in the life and materials sciences. One critical challenge for pre-trained generative molecular design (GMD) models is to fine-tune them to be better suited for downstream design tasks that aim at optimizing specific molecular properties. However, redesigning and training an existing effective generative model from scratch for each new design task are impractical. Furthermore, the black-box nature of typical downstream tasks that involve property prediction makes it nontrivial to optimize the generative model in a task-specific manner. In this work, we propose an uncertainty-guided fine-tuning strategy that can effectively enhance a pre-trained variational autoencoder (VAE) for GMD through performance feedback in an active learning setting. The strategy begins by quantifying the model uncertainty of the generative model using an efficient active subspace-based UQ (uncertainty quantification) scheme. Next, the decoder diversity within the characterized model uncertainty class is explored to expand the viable space of molecular generation. The low-dimensionality of the active subspace makes this exploration tractable using a black-box optimization scheme, which in turn enables us to identify and leverage a diverse set of high-performing models to generate enhanced molecules. Empirical results across six target molecular properties using multiple VAE-based generative models demonstrate that our uncertainty-guided fine-tuning strategy consistently leads to improved models that outperform the original pre-trained models.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1997

Estimating the Uncertainty in Passive-Microwave Rain-Retrievals

Current passive-microwave rain-retrieval methods are largely based on databases built off-line using cloud models. The vertical distribution of hydrometeors within the cloud has a large impact on upwelling brightness temperatures ([31,[5]). Thus, a forward radiative transfer model can predict off-line the radiance associated with different rain scenarios. To estimate the rain from measured brightness temperatures, one simply looks for the rain scenario whose associated radiances are closest to the measurements. To understand the uncertainties in this process, we first study the dependence of the simulated brightness temperatures on different hydrometeor size distribution (DSD) models. We then analyze the marginal and joint distributions of the radiances observed by the Tropical Rainfall Measuring Mission satellite and of those in the databases used in the TRMM rain retrievals. We finally calculate the covariances of the rain profiles and brightness temperatures in the TRMM passive-microwave database and derive a simple parametric model for the conditional uncertainty, given measured radiances. These results are used to characterize the uncertainty inherent in the passive-microwave retrieval.

Coppens, Dorothee↗
DOE OSTI2021

Nonlocal Operator Learning with Uncertainty Quantification

The goal of this work is to develop a Bayesian framework to characterize the uncertainty of material response when using a nonlocal, homogenized model to describe wave propagation through heterogeneous, disordered materials. Our approach is based on an operator regression technique combined with Bayesian optimization, through which the nonlocal kernel for a specific disordered microstructure is investigated.

36 MATERIALS SCIENCE↗
NASA NTRS2012

Report of the 4th World Climate Research Programme International Conference on Reanalyses

The 4th WCRP International Conference on Reanalyses provided an opportunity for the international community to review and discuss the observational and modelling research, as well as process studies and uncertainties associated with reanalysis of the Earth System and its components. Characterizing the uncertainty and quality of reanalyses is a task that reaches far beyond the international community of producers, and into the interdisciplinary research community, especially those using reanalysis products in their research and applications. Reanalyses have progressed greatly even in the last 5 years, and newer ideas, projects and data are coming forward. While reanalysis has typically been carried out for the individual domains of atmosphere, ocean and land, it is now moving towards coupling using Earth system models. Observations are being reprocessed and they are providing improved quality for use in reanalysis. New applications are being investigated, and the need for climate reanalyses is as strong as ever. At the heart of it all, new investigators are exploring the possibilities for reanalysis, and developing new ideas in research and applications. Given the many centres creating reanalyses products (e.g. ocean, land and cryosphere research centres as well as NWP and atmospheric centers), and the development of new ideas (e.g. families of reanalyses), the total number of reanalyses is increasing greatly, with new and innovative diagnostics and output data. The need for reanalysis data is growing steadily, and likewise, the need for open discussion and comment on the data. The 4th Conference was convened to provide a forum for constructive discussion on the objectives, strengths and weaknesses of reanalyses, indicating potential development paths for the future.

Bosilovich, Michael G.↗
NASA NTRS2013

Advanced Methods for Determining Prediction Uncertainty in Model-Based Prognostics with Application to Planetary Rovers

Prognostics is centered on predicting the time of and time until adverse events in components, subsystems, and systems. It typically involves both a state estimation phase, in which the current health state of a system is identified, and a prediction phase, in which the state is projected forward in time. Since prognostics is mainly a prediction problem, prognostic approaches cannot avoid uncertainty, which arises due to several sources. Prognostics algorithms must both characterize this uncertainty and incorporate it into the predictions so that informed decisions can be made about the system. In this paper, we describe three methods to solve these problems, including Monte Carlo-, unscented transform-, and first-order reliability-based methods. Using a planetary rover as a case study, we demonstrate and compare the different methods in simulation for battery end-of-discharge prediction.

prognosis↗
DOE OSTI2025

Neutrino-nucleus cross section impacts on neutrino oscillation measurements

The challenges in neutrino-nucleus cross section modeling and its impact on neutrino oscillation experiments are widely recognized. However, a comprehensive and theoretically robust estimation of cross section uncertainties has been lacking, and few studies have quantitatively examined their impact on oscillation measurements. In this work, we evaluate the effect of cross section uncertainties on oscillation parameters using setups inspired by NOvA and DUNE. To characterize these uncertainties, we adopt multiple neutrino-nucleus event generators and simulate a realistic experimental procedure that incorporates near-detector data and near-to-far-detector extrapolation. Our results confirm that cross section uncertainties cannot significantly bias oscillation results in current statistics-dominated experiments like NOvA. However, they could lead to substantial bias for future systematics-dominated experiments like DUNE, even when near-detector data are employed to mitigate uncertainties. These findings underscore the need for further studies on the quantitative impacts of cross section modeling, improved strategies to utilize near-detector data and the PRISM concept, and more robust cross section models to optimize the success of future experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Understanding Type Ia Supernova Distance Biases by Simulating Spectral Variations

In the next decade, transient searches from the Vera C. Rubin Observatory and the Nancy Grace Roman Space Telescope will increase the sample of known Type Ia supernovae (SNe Ia) from ~10 3 to 10 5 . With this reduction of statistical uncertainties on cosmological measurements, new methods are needed to reduce systematic uncertainties. Here, characterizing the underlying spectroscopic evolution of SN Ia remains a major systematic uncertainty in current cosmological analyses, motivating a new simulation tool for the next era of SN Ia cosmology: Build Your Own Spectral Energy Distribution (byosed). byosed is used within the SNANA framework to simulate light curves by applying spectral variations to model SEDs, enabling flexible testing of possible systematic shifts in SN Ia distance measurements. We test the framework by comparing a nominal Roman SN Ia survey simulation using a baseline SED model to simulations using SEDs perturbed with byosed, and investigating the impact of ignoring specific SED features in the analysis. These features include semiempirical models of two possible, predicted relationships: between SN ejecta velocity and light-curve observables, and a redshift-dependent relationship between SN Hubble residuals and host-galaxy mass. We analyze each byosed simulation using the SALT2 and BEAMS with Bias Corrections framework, and estimate changes in the measured value of the dark-energy equation-of-state parameter, w. We find a difference of Δw = –0.023 for SN velocity and Δw = 0.021 for redshift-evolving host mass when compared to simulations without these features. By using byosed for SN Ia cosmology simulations, future analyses (e.g., the Rubin and Roman SN Ia samples) will have greater flexibility to constrain or reduce such SN Ia modeling uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1989

Uncertainty estimates in geomagnetic field modeling

This paper presents an extension of the conventional uncertainty analysis which characterizes the sources of uncertainty in the coefficients of the geomagnetic field models. The new formalism accounts for the systematic errors introduced by the omission of such sources as the presence of crustal fields, the external fields, and the field from the truncated terms. The usefulness of this formalism depends on two critical conditions. The first of these is the knowledge of the statistical properties of the fields whose parameters are not solved in the analysis, i.e., the crustal field and the external field. The second critical point in the practical use of the method is the approximation used for the weight matrix.

Langel, R. A.↗
NASA NTRS2018

Trim Flight Conditions for a Low-Boom Aircraft Design Under Uncertainty

The purpose of this paper is to investigate the noise generation of a low-boom aircraft design in flight trim conditions under uncertainty. The deflection of control surfaces to maintain a trimmed flight state has the potential to change the perceived loudness at the ground. Furthermore, the uncertainties associated with the control surface deflections can complicate the overall uncertainty quantification. Incorporation of the uncertainties in the prediction of perceived sound levels during the design phase can lead to improved robustness. In this paper, a brief review of low-boom flight trim research is presented. Realistic flight trim conditions requiring control surface deflection are integrated into the current research efforts for uncertainty quantification and vehicle design. In addition, a generalized set of procedures for the characterization of uncertainties in flight trim conditions are introduced. In a case study of the application of these procedures, a 5 decibel average difference in the perceived level of loudness was found between clean (no deflections) and trimmed configurations. Also, uncertainties attributable to control surface deflection were found to account for, on average, over 50% of the total near field uncertainty. Uncertainty discretization methods implemented were able to give more insight into the overall global variances.

Phillips, Ben D↗
NASA NTRS2019

A Terrestrial Validation of ICESat Elevation Measurements and Implications for Global Reanalyses

The primary goal of NASA's Ice, Cloud, and land Elevation Satellite (ICESat) mission was to detect centimeter-level changes in global ice sheet elevations at the spatial scale of individual ice streams. Confidence in detecting these small signals requires careful validation over time to characterize the uncertainty and stability of measured elevations. A common validation approach compares altimeter elevations to an independently characterized and stable reference surface. Using a digital elevation model (DEM) from geodetic surveys of one such surface, the salar de Uyuni in Bolivia, we show that ICESat elevations at this location have a 0.0-centimeter bias relative to the WGS84 ellipsoid, 4.0-centimeter (1-sigma) uncertainty overall, and 1.8-centimeter uncertainty under ideal conditions over short (50 kilometer) profiles. We observe no elevation bias between ascending and descending orbits, but we do find that elevations measured immediately after transitions from low to high surface albedo may be negatively biased. Previous studies have reported intercampaign biases (ICBs) between various ICESat observation campaigns, but we find no statistically significant ICBs or ICB trends in our data. We do find a previously unreported 3.1-centimeter bias between ICESat's Laser 2 and Laser 3, and we find even larger interlaser biases in reanalyzed data from other studies. For an altimeter with an exact repeat orbit like ICESat, we also demonstrate that validation results with respect to averaged elevation profiles along a single ground track are comparable to results obtained using reference elevations from an in situ survey.

Laser Ranging↗
DOE OSTI2024

Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

Abstract Large‐scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub‐surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have successfully been used in several engineering applications, estimates of output quantities of interest (QoI) — such as breakthrough time of particles reaching the edge of the system — suffer from two distinct types of uncertainty. A run of a DFN simulator requires several parameters to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameters will lead to uncertainty in the QoI, called epistemic uncertainty. Furthermore, since these input settings to DFN simulators control the stochastic processes which place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e., different seeds) of the same random process (i.e., identical input parameters) leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. Beyond the specific takeaways on which input variables influence uncertainty in the QoI the most, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.

58 GEOSCIENCES↗
DOE OSTI2024

Constraining gravity with a new precision 𝐸 𝐺 estimator using Planck + SDSS BOSS data

The 𝐸 𝐺 statistic is a discriminating probe of gravity developed to test the prediction of general relativity (GR) for the relation between gravitational potential and clustering on the largest scales in the observable Universe. We present a novel high-precision estimator for the 𝐸 𝐺 statistic using CMB lensing and galaxy clustering correlations that carefully matches the effective redshifts across the different measurement components to minimize corrections. A suite of detailed tests is performed to characterize the estimator’s accuracy, its sensitivity to assumptions and analysis choices, and the non-Gaussianity of the estimator’s uncertainty is characterized. After finalization of the estimator, it is applied to Planck CMB lensing and SDSS CMASS and LOWZ galaxy data. We report the first harmonic space measurement of 𝐸 𝐺 using the LOWZ sample and CMB lensing and also updated constraints using the final CMASS sample and the latest Planck CMB lensing map. We find $\hat{𝐸}$$^{Planck+CMASS}_{𝐺}$ = 0.3⁢6$^{+0.06}_{−0.05}$⁢(68.27%) and $\hat{𝐸}$$^{Planck+LOWZ}_{𝐺}$ = 0.4⁢0$^{+0.11}_{−0.09}$⁢(68.27%), with additional subdominant systematic error budget estimates of 2% and 3%, respectively. Using Ω m,0 constraints from Planck and SDSS BAO observations, Λ⁢CDM-GR predicts 𝐸$^{GR}_ {𝐺}$⁡(𝑧 =0.555) = 0.401 ± 0.005 and 𝐸$^{GR}_{𝐺}$⁡(𝑧 =0.316) = 0.452 ± 0.005 at the effective redshifts of the CMASS and LOWZ based measurements. We report the measurement to be in good statistical agreement with the Λ⁢CDM-GR prediction and report that the measurement is also consistent with the more general GR prediction of scale independence for 𝐸 𝐺 . Furthermore, this work provides a carefully constructed and calibrated statistic with which 𝐸 𝐺 measurements can be confidently and accurately obtained with upcoming survey data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2011

Next-Generation Satellite Precipitation Products for Understanding Global and Regional Water Variability

A major challenge in understanding the space-time variability of continental water fluxes is the lack of accurate precipitation estimates over complex terrains. While satellite precipitation observations can be used to complement ground-based data to obtain improved estimates, space-based and ground-based estimates come with their own sets of uncertainties, which must be understood and characterized. Quantitative estimation of uncertainties in these products also provides a necessary foundation for merging satellite and ground-based precipitation measurements within a rigorous statistical framework. Global Precipitation Measurement (GPM) is an international satellite mission that will provide next-generation global precipitation data products for research and applications. It consists of a constellation of microwave sensors provided by NASA, JAXA, CNES, ISRO, EUMETSAT, DOD, NOAA, NPP, and JPSS. At the heart of the mission is the GPM Core Observatory provided by NASA and JAXA to be launched in 2013. The GPM Core, which will carry the first space-borne dual-frequency radar and a state-of-the-art multi-frequency radiometer, is designed to set new reference standards for precipitation measurements from space, which can then be used to unify and refine precipitation retrievals from all constellation sensors. The next-generation constellation-based satellite precipitation estimates will be characterized by intercalibrated radiometric measurements and physical-based retrievals using a common observation-derived hydrometeor database. For pre-launch algorithm development and post-launch product evaluation, NASA supports an extensive ground validation (GV) program in cooperation with domestic and international partners to improve (1) physics of remote-sensing algorithms through a series of focused field campaigns, (2) characterization of uncertainties in satellite and ground-based precipitation products over selected GV testbeds, and (3) modeling of atmospheric processes and land surface hydrology through simulation, downscaling, and data assimilation. An overview of the GPM mission, science status, and synergies with HyMex activities will be presented

Hou, Arthur Y.↗