Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗

Assessment of Crustal Leg Uncertainties for RSTT Path-dependent Uncertainty

The Regional Seismic Travel Time (RSTT) model and software were recently updated to allow for path-dependent uncertainty (PDU) estimates for travel-time (Begnaud et al. 2021; Begnaud et al. 2020). Begnaud et al. (2021) describes the process of improving the current distance-dependent uncertainty parameterization for RSTT using a random effects model (REM) to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The REM separates the error between observed slowness and model predicted slowness into bias and random components. The PDU is calculated by integrating these mean squared errors along a seismic-phase ray path.

58 GEOSCIENCES↗

First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation [First Cosmology Results Using Type IA Supernovae from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation]

We present the analysis underpinning the measurement of cosmological parameters from 207 spectroscopically classified SNe Ia from the first 3 years of the Dark Energy Survey Supernova Program (DES-SN), spanning a redshift range of 0.017 < z < 0.849. We combine the DES-SN sample with an external sample of 122 low-redshift (z < 0.1) SNe Ia, resulting in a "DES-SN3YR" sample of 329 SNe Ia. Our cosmological analyses are blinded: after combining our DES-SN3YR distances with constraints from the Cosmic Microwave Background, our uncertainties in the measurement of the dark energy equation-of-state parameter, w, are 0.042 (stat) and 0.059 (stat+syst) at 68% confidence. We provide a detailed systematic uncertainty budget, which has nearly equal contributions from photometric calibration, astrophysical bias corrections, and instrumental bias corrections. We also include several new sources of systematic uncertainty. While our sample is less than one-third the size of the Pantheon sample, our constraints on w are only larger by 1.4×, showing the impact of the DES-SN Ia light-curve quality. We find that the traditional stretch and color standardization parameters of the DES-SNe Ia are in agreement with earlier SN Ia samples such as Pan-STARRS1 and the Supernova Legacy Survey. However, we find smaller intrinsic scatter about the Hubble diagram (0.077 mag). Interestingly, we find no evidence for a Hubble residual step (0.007 ± 0.018 mag) as a function of host-galaxy mass for the DES subset, in 2.4σ tension with previous measurements. In conclusion, we also present novel validation methods of our sample using simulated SNe Ia inserted in DECam images and using large catalog-level simulations to test for biases in our analysis pipelines.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of a special-purpose test surface guided by uncertainty analysis - Introduction of a new uncertainty analysis step

Development of a recent experimental program to investigate the effects of streamwise curvature on boundary layer transition required making a bendable, heated and instrumented test wall, a rather nonconventional surface. The present paper describes this surface, the design choices made in its development and how uncertainty analysis was used, beginning early in the test program, to make such design choices. Published uncertainty analysis techniques were found to be of great value; but, it became clear that another step, one herein called the pre-test analysis, would aid the program development. Finally, it is shown how the uncertainty analysis was used to determine whether the test surface was qualified for service.

Wang, T.↗

Numerical Uncertainty Analysis for Computational Fluid Dynamics using Student T Distribution -- Application of CFD Uncertainty Analysis Compared to Exact Analytical Solution

Computational Fluid Dynamics (CFD) is the standard numerical tool used by Fluid Dynamists to estimate solutions to many problems in academia, government, and industry. CFD is known to have errors and uncertainties and there is no universally adopted method to estimate such quantities. This paper describes an approach to estimate CFD uncertainties strictly numerically using inputs and the Student-T distribution. The approach is compared to an exact analytical solution of fully developed, laminar flow between infinite, stationary plates. It is shown that treating all CFD input parameters as oscillatory uncertainty terms coupled with the Student-T distribution can encompass the exact solution.

Groves, Curtis E.↗

Uncertainty quantification for evaluating impacts of caprock and reservoir properties on pressure buildup and ground surface displacement during geological CO2 sequestration

A series of numerical test cases reflecting broad and realistic ranges of geological formation properties was developed to systematically evaluate and compare the impacts of those properties on geomechanical responses to CO2 injection. A coupled hydro-geomechanical subsurface transport simulator, STOMP (Subsurface Transport over Multiple Phases), was adopted to simulate the CO2 migration process and geomechanical behaviors of the surrounding geological formations. A quasi-Monte Carlo sampling method was applied to efficiently sample a high-dimensional parameter space consisting of injection rate and 14 subsurface formation properties, including porosity, permeability, entry pressure, irreducible gas and aqueous saturation, Young’s modulus, and Poisson’s ratio for both reservoir and caprock. Generalized cross-validation and analysis of variance methods were used to quantitatively measure the significance of the 15 input parameters. Reservoir porosity, permeability, and injection rate were found to be among the most significant factors affecting the geomechanical responses to the CO2 injection. We used a quadrature generalized linear model to build a reduced-order model that can estimate the geomechanical response instantly instead of running computationally expensive numerical simulations.

CO2 geological sequestration↗

Comparison of Integral Parameter Estimated Uncertainties in Fast Neutron Systems with COMMARA-2.1 and COMMARA-2.0 Covariance Data

This paper shows the main differences between the COMMARA-2.0 and COMMARA-2.1 evaluated covariance data in the uncertainty estimation of integral parameters of interest for a large number of typical innovative fast neutron systems. The study provides some guidelines to the nuclear data evaluators on which materials and which reaction types need to be evaluated most accurately to achieve reliable results in computational analyses of similar systems. The assessment of the quality and reliability of the covariance data is outside the scope of the study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions

Abstract Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.

Zhang, Jiangjiang↗

Quantifying uncertainty in material damage from vibrational data

The response of a vibrating beam to a force depends on many physical parameters including those determined by material properties. Damage caused by fatigue or cracks results in local reductions in stiffness parameters and may drastically alter the response of the beam. Data obtained from the vibrating beam are often subject to uncertainties and/or errors typically modeled using probability densities. The goal of this paper is to estimate and quantify the uncertainty in damage modeled as a local reduction in stiffness using uncertain data. We present various frameworks and methods for solving this parameter determination problem. We also describe a mathematical analysis to determine and compute useful output data for each method. We apply the various methods in a specified sequence that allows us to interface the various inputs and outputs of these methods in order to enhance the inferences drawn from the numerical results obtained from each method. Numerical results are presented using both simulated and experimentally obtained data from physically damaged beams.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantification of Uncertainties in Nuclear Density Functional Theory

Reliable predictions of nuclear properties are needed as much to answer fundamental science questions as in applications such as reactor physics or data evaluation. Nuclear density functional theory is currently the only microscopic, global approach to nuclear structure that is applicable throughout the nuclear chart. In the past few years, a lot of effort has been devoted to setting up a general methodology to assess theoretical uncertainties in nuclear DFT calculations. In this paper, we summarize some of the recent progress in this direction. Most of the new material discussed here will be be published in separate articles.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The LANL/LLNL Prompt Fission Neutron Spectrum Program at LANSCE and Approach to Uncertainties

New data on the prompt fission neutron spectra (PFNS) from neutron-induced fission with higher accuracies are needed to resolve discrepancies in the literature and to address gaps in the experimental data. The Chi-Nu project, conducted jointly by LANL and LLNL, aims to measure the shape of the PFNS for fission of {sup 239}Pu induced by neutrons from 0.5 to 20 MeV with accuracies of 3–5% in the outgoing energy from 0.1 to 9 MeV and 15% from 9 to 12 MeV and to provide detailed experimental uncertainties. Neutrons from the WNR/LANSCE neutron source are being used to induce fission in a Parallel-Plate Avalanche Counter (PPAC). Two arrays of neutron detectors are used to cover the energy range of neutrons emitted promptly in the fission process. Challenges for the present experiment include background reduction, use of {sup 239}Pu in a PPAC, and understanding neutron detector response. Achieving the target accuracies requires the understanding of many systematic uncertainties. The status and plans for the future will be presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multiobjective Modular Biorefinery Configuration under Uncertainty

With increasing interest in using biomass as a raw material for fuel, the development of biorefineries is an active area of research. However, increasing market competition, uncertainty, and environmental concerns are a few of the challenges that need to be addressed. In this work, mathematical optimization formulations are proposed to address these challenges simultaneously. A multiobjective deterministic optimization framework is proposed to address economic and environmental objectives. A two-stage stochastic optimization framework is proposed to account for uncertainties in material flow and product yields. To model the environmental objective, an environmental risk metric is proposed. Finally, as modularization is gaining popularity in the process industry due to its ability to save capital cost because of standardization and reduce time to market, a formulation for simultaneously achieving modular process design and biorefinery configuration is proposed. Furthermore, the results demonstrate the efficacy of the proposed approach.

09 BIOMASS FUELS↗

The Atmospheric River Tracking Method Intercomparison Project (ARTMIP): Quantifying Uncertainties in Atmospheric River Climatology

Atmospheric rivers (ARs) are now widely known for their association with high-impact weather events and long-term water supply in many regions. Researchers within the scientific community have developed numerous methods to identify and track of ARs—a necessary step for analyses on gridded data sets, and objective attribution of impacts to ARs. These different methods have been developed to answer specific research questions and hence use different criteria (e.g., geometry, threshold values of key variables, and time dependence). Furthermore, these methods are often employed using different reanalysis data sets, time periods, and regions of interest. The goal of the Atmospheric River Tracking Method Intercomparison Project (ARTMIP) is to understand and quantify uncertainties in AR science that arise due to differences in these methods. This paper presents results for key AR-related metrics based on 20+ different AR identification and tracking methods applied to Modern-Era Retrospective Analysis for Research and Applications Version 2 reanalysis data from January 1980 through June 2017. We show that AR frequency, duration, and seasonality exhibit a wide range of results, while the meridional distribution of these metrics along selected coastal (but not interior) transects are quite similar across methods. Furthermore, methods are grouped into criteria-based clusters, within which the range of results is reduced. AR case studies and an evaluation of individual method deviation from an all-method mean highlight advantages/disadvantages of certain approaches. For example, methods with less (more) restrictive criteria identify more (less) ARs and AR-related impacts. Finally, this paper concludes with a discussion and recommendations for those conducting AR-related research to consider.

Rutz, Jonathan J.↗

Uncertainties in turbulent statistics and fluxes of CO2 associated with density effect corrections

Density effect corrections (DEC) are applied to adjust raw CO2 fluxes measured by eddy covariance (EC) systems with open-path gas analyzers. DEC is also required for adjusting the measured CO2 concentration fluctuations to obtain the adjusted CO2 for analyzing turbulent statistics or quantifying fluxes. However, our data show that the power spectra of the DEC-adjusted CO2 are distorted in the high frequency range, as compared with the corresponding spectra of temperature and water vapor density. This contradicts the similarity behavior of scalars, as suggested by Monin-Obukhov similarity theory. It is demonstrated that such a distortion is caused by the DEC-induced spikes in the DEC-adjusted CO2, altering turbulent statistics of CO2 and scalar similarity between CO2 and other scalars. Our results suggest that CO2 fluxes are overestimated by applying DEC especially under high Bowen ratio conditions, potentially leading to substantial uncertainties in long-term ecosystem carbon exchange in dry regions.

Gao, Zhongming↗

Uncertainty in the response of terrestrial carbon sink to environmental drivers undermines carbon-climate feedback predictions

Terrestrial ecosystems play a vital role in regulating the accumulation of carbon (C) in the atmosphere. Understanding the factors controlling land C uptake is critical for reducing uncertainties in projections of future climate. The relative importance of changing climate, rising atmospheric CO2, and other factors, however, remains unclear despite decades of research. Here, we use an ensemble of land models to show that models disagree on the primary driver of cumulative C uptake for 85% of vegetated land area. Disagreement is largest in model sensitivity to rising atmospheric CO2 which shows almost twice the variability in cumulative land uptake since 1901 (1 s.d. of 212.8 PgC vs. 138.5 PgC, respectively). We find that variability in CO2 and temperature sensitivity is attributable, in part, to their compensatory effects on C uptake, whereby comparable estimates of C uptake can arise by invoking different sensitivities to key environmental conditions. Conversely, divergent estimates of C uptake can occur despite being based on the same environmental sensitivities. Together, these findings imply an important limitation to the predictability of C cycling and climate under unprecedented environmental conditions. We suggest that the carbon modeling community prioritize a probabilistic multi-model approach to generate more robust C cycle projections.

Huntzinger, D. N.↗