Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Disentangling atmospheric, hydrological, and coupling uncertainties in compound flood modeling within a coupled Earth system model

Compound riverine and coastal flooding is usually driven by complex interactions among meteorological, hydrological, and ocean extremes. However, existing efforts to model this phenomenon often do not integrate hydrological processes across atmosphere–land–river–ocean systems, leading to substantial uncertainties that have not been fully examined. To bridge this gap, we leverage the new capabilities of the Energy Exascale Earth System Model (E3SM) that enable a multi-component framework that integrates coastally refined atmospheric, terrestrial, and oceanic components. We evaluate compound uncertainties arising from two-way land–river–ocean coupling in E3SM and track the cascading meteorological and hydrological uncertainties through ensemble simulations over the Delaware River basin and estuary during Hurricane Irene (2011). Our findings highlight the importance of two-way river–ocean coupling to compound flood modeling and demonstrate E3SM's capability in capturing compound flood extent near the coast, with a hit rate over 0.75. Our study shows the growing uncertainties that transition from atmospheric forcings to flood distribution and severity. Furthermore, an analysis based on artificial neural networks is used to assess the roles of hydrological drivers, such as infiltration and soil moisture, in the generation of compound flooding. The response of compound floods to tropical cyclones (TCs) is found to be susceptible to these often overlooked drivers. For instance, the flooded area could increase more than 2-fold (∼2.4) if Hurricane Irene were preceded by an extreme antecedent soil moisture condition (AMC). The results not only support the use of a multi-component framework for interactive flooding processes, but also underscore the necessity of broader definitions of compound flooding that encompass the simultaneous occurrence of intense precipitation, storm surge, and high AMC during TCs.

Feng, Dongyu [Pacific Northwest National Laborator↗

Process-oriented stochastic perturbations applied to the parametrization of turbulence and shallow convection for ensemble prediction

Weather forecasting nowadays often requires some estimation of uncertainties associated with the output of meteorological models, in order to better inform decision making, especially in the context of intense weather events. Ensemble prediction systems provide such information through sets of possible scenarios which are designed to represent various uncertainty sources, including model uncertainties. A wide variety of methods have been proposed to estimate model uncertainties, among which perturbation methods targeting uncertain processes are a promising research field. Here, we focus on the representation of small-scale variability by process-oriented perturbation schemes applied to two key physical processes, namely turbulence and shallow convection. The perturbations are applied to a single-column version of the convection-permitting AROME model, in three idealized boundary-layer cases. Large-eddy simulations (LESs) of the same cases serve as a reference for the subgrid variability that has to be represented, and the results are also compared to those given by the Stochastically Perturbed Parametrization Tendencies (SPPT) method, which is a method commonly used by weather forecast centres to represent model uncertainty. The spread produced by our process-oriented perturbations of turbulence and shallow convection does not represent all the small-scale variability implied by the LESs for temperature and humidity. However, it is of a similar order of magnitude for the wind, thanks to perturbations generated by the stochastic turbulence scheme. The dispersion is structurally different from what is obtained with SPPT. It is non-negligible in the lower levels, where SPPT perturbations are usually suppressed because of numerical instabilities, indicating a possible complementarity between the schemes.

54 ENVIRONMENTAL SCIENCES↗

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness. However, increases in the cost of flight testing and the accuracy of inexpensive CFD encourage the adoption of certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight tests or high fidelity data of the original aircraft as well as lower fidelity data from CFD or wind tunnel testing of the original and modified configurations to create 6-DOF flight dynamics models. Two methods are presented which generate an updated flight dynamics model and estimate the model form uncertainty for the modified aircraft configuration using knowledge of the original aircraft. This updated dynamics model and uncertainty estimate are then used to conduct non-deterministic simulations with wind turbulence included. The framework is applied to an example aircraft system to demonstrate the ability to predict the performance and associated model from the uncertainty of modified aircraft configurations.

uncertainty quantification↗

Uncertainty-driven dynamics for active learning of interatomic potentials

Machine learning (ML) models, if trained to data sets of high-fidelity quantum simulations, produce accurate and efficient interatomic potentials. Active learning (AL) is a powerful tool to iteratively generate diverse data sets. In this approach, the ML model provides an uncertainty estimate along with its prediction for each new atomic configuration. If the uncertainty estimate passes a certain threshold, then the configuration is included in the data set. Here we develop a strategy to more rapidly discover configurations that meaningfully augment the training data set. The approach, uncertainty-driven dynamics for active learning (UDD-AL), modifies the potential energy surface used in molecular dynamics simulations to favor regions of configuration space for which there is large model uncertainty. The performance of UDD-AL is demonstrated for two AL tasks: sampling the conformational space of glycine and sampling the promotion of proton transfer in acetylacetone. The method is shown to efficiently explore the chemically relevant configuration space, which may be inaccessible using regular dynamical sampling at target temperature conditions.

97 MATHEMATICS AND COMPUTING↗

Fuel cycle cost uncertainty from nuclear fuel cycle comparison

This paper examined the uncertainty in fuel cycle cost (FCC) calculation by considering both model and parameter uncertainty. Four different fuel cycle options were compared in the analysis including the once-through cycle (OT), the DUPIC cycle, the MOX cycle and a closed fuel cycle with fast reactors (FR). The model uncertainty was addressed by using three different FCC modeling approaches with and without the time value of money consideration. The relative ratios of FCC in comparison to OT did not change much by using different modeling approaches. This observation was consistent with the results of the sensitivity study for the discount rate. Two different sets of data with uncertainty range of unit costs were used to address the parameter uncertainty of the FCC calculation. The sensitivity study showed that the dominating contributor to the total variance of FCC is the uranium price. In general, the FCC of OT was found to be the lowest followed by FR, MOX, and DUPIC. But depending on the uranium price, the FR cycle was found to have lower FCC over OT. The reprocessing cost was also found to have a major impact on FCC.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty evaluation for twist drilling stability model

This paper describes the first uncertainty analysis for drilling stability using a frequency-domain drilling stability model. The stability model inputs include: the modal parameters for the torsional-axial vibration mode from the twist drill-holder-spindle axial frequency response function; and the mechanistic coefficients that relate the torque and thrust force to chip area for the selected drill-workpiece material combination. Furthermore, Monte Carlo simulation is applied to propagate the input uncertainties to output uncertainty in the predicted stability map, which separates stable from unstable (chatter) zones in the spindle speed-chip width parameter space. Additionally, the mean stability boundary and its 95% confidence intervals are determined for five cases: varying all four inputs simultaneously and varying them individually. This enables the individual sensitivities to be compared. Experimental results from drilling tests are included for comparison to the prediction. Additionally, Matlab code is provided to implement the stability model and Monte Carlo uncertainty analysis.

42 ENGINEERING↗

Quantifying structural errors in cloud condensation nuclei activity from reduced representation of aerosol size distributions

Aerosol effects on clouds and radiation are the dominant contribution to uncertainty in radiative forcing relative to the pre-industrial atmosphere. While previous studies have assessed the impact of parametric uncertainty on modeled forcing, structural errors from the numerical representation of particle distributions have not been well quantified. Here we present a framework for quantifying error in aerosol size distributions and cloud condensation nuclei activity, which we apply to the widely used 4-mode version of the Modal Aerosol Module (MAM4). Box model predictions from the MAM4 are evaluated against the Particle Monte Carlo Model for Simulating Aerosol Interactions and Chemistry (PartMC-MOSAIC), a benchmark model that tracks the evolution of individual particles. We show that size distributions simulated by MAM4 diverge from those simulated by PartMC-MOSAIC after only a few hours of aging by condensation and coagulation in polluted conditions, which leads to large errors in modeled cloud condensation nuclei concentrations. We find that differences between MAM4 and PartMC-MOSAIC are largest under polluted conditions, where the size distribution evolves rapidly though aging by condensation of semi-volatile substances and coagulation among particles. These findings suggest that structural error in modeled aerosol properties contributes to the large inter-model variability in aerosol radiative forcing.

Fierce, Laura M.↗

Using Median Point in Keeling Plot to Reduce the Uncertainty of the Isotopic Composition of Evapotranspiration

Abstract The isotopic composition of evapotranspirationδ ET is a crucial parameter in isotope-based evapotranspiration (ET) partitioning and moisture recycling studies. The Keeling plot method is the most prevalent method to calculateδ ET , though it contains large extrapolated uncertainties from the least squares regression. Traditional Keeling regression uses the mean point of individual measurements. Here, a modified Keeling plot framework was proposed using the median point of individual measurements. We tested theδ ET uncertainty using the mean point [σ ET (mean)] and median point [σ ET (median)]. Multiple resolutions of input and output data from six independent sites were used to test the performance of the two methods. Theσ ET (mean) would be greater thanσ ET (median) when the mean value of inverse vapor concentration () is greater than the median value of inverse vapor concentration []. When applying the filter ofr 2 > 0.8, around 70% ofσ ET (mean) was greater thanσ ET (median). This phenomenon might be due to the normality of the vapor concentrationC υ producing the asymmetric distribution of 1/C υ . The median method could perform significantly better than the mean method when inputting high-resolution measurements (e.g., 1 Hz) and when the water vapor concentrationC υ is relatively low. Compared to the mean method, applying the median method could on average reduce 6.88% of ET partitioning uncertainties and could on average reduce 9.00% of moisture recycling uncertainties. This study provided a new insight of the Keeling plot method and emphasized handling model output uncertainty from multiple perspectives instead of only from input parameters.

Meteorology & Atmospheric Sciences↗

Validation Analysis of Medium-Scale Methanol Pool Fire Simulated in SIERRA/Fuego [Slides]

Analysis of methanol pool fire conducted as part of validation study for SIERRA/Fuego. Results showed trends & errors consistent with related studies. Area validation metric provides way to quantify model form uncertainty. AVM shows that more work could be done to understand how model form uncertainty varies with mesh resolution. There is a possible atypical use of MAVM on time-series data. AVM shows mismatch between predicted flame height and experimental value less sensitive to variations in mixture fraction than temperature. Mismatch about experimental value also more symmetric for mixture fraction. Our analysis showed that mixture fraction is preferable for this application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Insights into the vulnerability of Antarctic glaciers from the ISMIP6 ice sheet model ensemble and associated uncertainty

Abstract. The Antarctic Ice Sheet represents the largest source of uncertainty in future sea level rise projections, with a contribution to sea level by 2100 ranging from −5 to 43 cm of sea level equivalent under high carbon emission scenarios estimated by the recent Ice Sheet Model Intercomparison for CMIP6 (ISMIP6). ISMIP6 highlighted the different behaviors of the East and West Antarctic ice sheets, as well as the possible role of increased surface mass balance in offsetting the dynamic ice loss in response to changing oceanic conditions in ice shelf cavities. However, the detailed contribution of individual glaciers, as well as the partitioning of uncertainty associated with this ensemble, have not yet been investigated. Here, we analyze the ISMIP6 results for high carbon emission scenarios, focusing on key glaciers around the Antarctic Ice Sheet, and we quantify their projected dynamic mass loss, defined here as mass loss through increased ice discharge into the ocean in response to changing oceanic conditions. We highlight glaciers contributing the most to sea level rise, as well as their vulnerability to changes in oceanic conditions. We then investigate the different sources of uncertainty and their relative role in projections, for the entire continent and for key individual glaciers. We show that, in addition to Thwaites and Pine Island glaciers in West Antarctica, Totten and Moscow University glaciers in East Antarctica present comparable future dynamic mass loss and high sensitivity to ice shelf basal melt. The overall uncertainty in additional dynamic mass loss in response to changing oceanic conditions, compared to a scenario with constant oceanic conditions, is dominated by the choice of ice sheet model, accounting for 52 % of the total uncertainty of the Antarctic dynamic mass loss in 2100. Its relative role for the most dynamic glaciers varies between 14 % for MacAyeal and Whillans ice streams and 56 % for Pine Island Glacier at the end of the century. The uncertainty associated with the choice of climate model increases over time and reaches 13 % of the uncertainty by 2100 for the Antarctic Ice Sheet but varies between 4 % for Thwaites Glacier and 53 % for Whillans Ice Stream. The uncertainty associated with the ice–climate interaction, which captures different treatments of oceanic forcings such as the choice of melt parameterization, its calibration, and simulated ice shelf geometries, accounts for 22 % of the uncertainty at the ice sheet scale but reaches 36 % and 39 % for Institute Ice Stream and Thwaites Glacier, respectively, by 2100. Overall, this study helps inform future research by highlighting the sectors of the ice sheet most vulnerable to oceanic warming over the 21st century and by quantifying the main sources of uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Insights on the Vulnerability of Antarctic Glaciers From the ISMIP6 Ice Sheet Model Ensemble and Associated Uncertainty

The Antarctic Ice Sheet represents the largest source of uncertainty in future sea level rise projections, with a contribution to sea level by 2100 ranging from −5 to 43 cm of sea level equivalent under high carbon emission scenarios estimated by the recent Ice Sheet Model Intercomparison for CMIP6 (ISMIP6). ISMIP6 highlighted the different behaviors of the East and West Antarctic ice sheets, as well as the possible role of increased surface mass balance in offsetting the dynamic ice loss in response to changing oceanic conditions in ice shelf cavities. However, the detailed contribution of individual glaciers, as well as the partitioning of uncertainty associated with this ensemble, have not yet been investigated. Here, we analyze the ISMIP6 results for high carbon emission scenarios, focusing on key glaciers around the Antarctic Ice Sheet, and we quantify their projected dynamic mass loss, defined here as mass loss through increased ice discharge into the ocean in response to changing oceanic conditions. We highlight glaciers contributing the most to sea level rise, as well as their vulnerability to changes in oceanic conditions. We then investigate the different sources of uncertainty and their relative role in projections, for the entire continent and for key individual glaciers. We show that, in addition to Thwaites and Pine Island glaciers in West Antarctica, Totten and Moscow University glaciers in East Antarctica present comparable future dynamic mass loss and high sensitivity to ice shelf basal melt. The overall uncertainty in additional dynamic mass loss in response to changing oceanic conditions, compared to a scenario with constant oceanic conditions, is dominated by the choice of ice sheet model, accounting for 52 % of the total uncertainty of the Antarctic dynamic mass loss in 2100. Its relative role for the most dynamic glaciers varies between 14 % for MacAyeal and Whillans ice streams and 56 % for Pine Island Glacier at the end of the century. The uncertainty associated with the choice of climate model increases over time and reaches 13 % of the uncertainty by 2100 for the Antarctic Ice Sheet but varies between 4 % for Thwaites Glacier and 53 % for Whillans Ice Stream. The uncertainty associated with the ice–climate interaction, which captures different treatments of oceanic forcings such as the choice of melt parameterization, its calibration, and simulated ice shelf geometries, accounts for 22 % of the uncertainty at the ice sheet scale but reaches 36 % and 39 % for Institute Ice Stream and Thwaites Glacier, respectively, by 2100. Overall, this study helps inform future research by highlighting the sectors of the ice sheet most vulnerable to oceanic warming over the 21st century and by quantifying the main sources of uncertainty.

Hélène Seroussi↗

Reliability Analysis in the Presence of Aleatory Uncertainty

This paper proposes a method for modeling a system’s response using data. In contrast to approaches that identify a limit state function, we focus on the case in which not all uncertain parameters affecting the response are observable and the measured response is corrupted by noise. To this end, the system response is not characterized by a limit state function but instead by a Random Predictor Model (RPM) having a nonparametric structure. Consequently, the resulting failure probability is not a scalar but a random variable. This variable accounts for the aleatory contributions of the model-form uncertainty and the measurement noise into the response. Furthermore, we propose a framework that enables trading off the predicted range of failure probabilities resulting from such an analysis with a measure of risk. In this context, risk is the percentage of all predicted outcomes the analyst is willing to ignore. The reliability analysis of an aeroelastic structure subject to flutter is used to illustrate the ideas proposed.

Crespo, L. G.↗

Evapotranspiration in Northern Eurasia: Impact of forcing uncertainties on terrestrial ecosystem model estimates

Abstract The ecosystems in Northern Eurasia (NE) play an important role in the global water cycle and the climate system. While evapotranspiration (ET) is a critical variable to understand this role, ET over this region remains largely unstudied. Using an improved version of the Terrestrial Ecosystem Model with five widely used forcing data sets, we examine the impact that uncertainties in climate forcing data have on the magnitude, variability, and dominant climatic drivers of ET for the period 1979–2008. Estimates of regional average ET vary in the range of 241.4–335.7 mm yr −1 depending on the choice of forcing data. This range corresponds to as much as 32% of the mean ET. Meanwhile, the spatial patterns of long‐term average ET across NE are generally consistent for all forcing data sets. Our ET estimates in NE are largely affected by uncertainties in precipitation ( P ), air temperature ( T ), incoming shortwave radiation ( R ), and vapor pressure deficit (VPD). During the growing season, the correlations between ET and each forcing variable indicate that T is the dominant factor in the north and P in the south. Unsurprisingly, the uncertainties in climate forcing data propagate as well to estimates of the volume of water available for runoff (here defined as P‐ET). While the Climate Research Unit data set is overall the best choice of forcing data in NE according to our assessment, the quality of these forcing data sets remains a major challenge to accurately quantify the regional water balance in NE.

Liu, Yaling↗

USACM Thematic Workshop On Uncertainty Quantification And Data-Driven Modeling.

The USACM Thematic Workshop on Uncertainty Quantification and Data-Driven Modeling was held on March 23-24, 2017, in Austin, TX. The organizers of the technical program were James R. Stewart of Sandia National Laboratories and Krishna Garikipati of University of Michigan. The administrative organizer was Ruth Hengst, who serves as Program Coordinator for the USACM. The organization of this workshop was coordinated through the USACM Technical Thrust Area on Uncertainty Quantification and Probabilistic Analysis. The workshop website (http://uqpm2017.usacm.org) includes the presentation agenda as well as links to several of the presentation slides (permission to access the presentations was granted by each of those speakers, respectively). Herein, this final report contains the complete workshop program that includes the presentation agenda, the presentation abstracts, and the list of posters.

97 MATHEMATICS AND COMPUTING↗

Gravitational waves from global cosmic strings and cosmic archaeology

Global cosmic strings are predicted in many motivated extensions to the Standard Model of particle physics, with close connections to axion dark matter physics. Recent studies suggest that, although subdominant relative to Goldstone emission, gravitational wave (GW) signals from global strings can be detectable with current and planned GW detectors such as LIGO, LISA, DECIGO/BBO, ET/CE and AEDGE/AION, as well as pulsar timing arrays such as PPTA, NANOGrav and SKA. This work is an extensive, updated study on GWs from a global cosmic string network, taking into account of the most recent developments related to the subject. The main analysis is based on the analytical Velocity-dependent One-Scale (VOS) model calibrated with recent simulation results, which provides a generic protocol for such calculations with details given. We also demonstrate how the GW signal can be influenced with variations to the baseline model: this includes considering the uncertainties of model parameters and the potential deviation from the conventional VOS model prediction (i.e. the scaling behavior) as suggested by some of the recent simulation results. Furthermore, we investigated in detail the effect of a non-standard cosmology (e.g. early matter domination or kination) or new particle species on the GW signals from global strings. We demonstrate that the frequency spectrum of GW background from global cosmic strings can be used to probe the cosmic history prior to the Big Bang nucleosynthesis (BBN) (i.e. the primordial dark age) up to a temperature of T ~ 10 8 GeV.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗

Solving iTOUGH2 simulation and optimization problems using the PEST protocol

The PEST protocol has been implemented into the iTOUGH2 code, allowing the user to link any simulation program (with ASCII-based inputs and outputs) to iTOUGH2's sensitivity analysis, inverse modeling, and uncertainty quantification capabilities. These application models can be pre- or post-processors of the TOUGH2 non-isothermal multiphase flow and transport simulator, or programs that are unrelated to the TOUGH suite of codes. PEST-style template and instruction files are used, respectively, to pass input parameters updated by the iTOUGH2 optimization routines to the model, and to retrieve the model-calculated values that correspond to observable variables. We summarize the iTOUGH2 capabilities and demonstrate the flexibility added by the PEST protocol for the solution of a variety of simulation-optimization problems. In particular, the combination of loosely coupled and tightly integrated simulation and optimization routines provides both the flexibility and control needed to solve challenging inversion problems for the analysis of multiphase subsurface flow and transport systems.

54 ENVIRONMENTAL SCIENCES↗