Search NASA⌕ Search

SEARCH · Search NASA

Results for “model structure uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

A method for the probabilistic design assessment of composite structures

A formal procedure for the probabilistic design assessment of a composite structure is described. The uncertainties in all aspects of a composite structure (constituent material properties, fabrication variables, structural geometry, service environments, etc.), which result in the uncertain behavior in the composite structural responses, are included in the assessment. The probabilistic assessment consists of design criteria, modeling of composite structures and uncertainties, simulation methods, and the decision making process. A sample case is presented to illustrate the formal procedure and to demonstrate that composite structural designs can be probabilistically assessed with accuracy and efficiency.

Shiao, Michael C.↗
NASA NTRS2006

Probabilistic Design of Composite Structures

A formal procedure for the probabilistic design evaluation of a composite structure is described. The uncertainties in all aspects of a composite structure (constituent material properties, fabrication variables, structural geometry, and service environments, etc.), which result in the uncertain behavior in the composite structural responses, are included in the evaluation. The probabilistic evaluation consists of: (1) design criteria, (2) modeling of composite structures and uncertainties, (3) simulation methods, and (4) the decision-making process. A sample case is presented to illustrate the formal procedure and to demonstrate that composite structural designs can be probabilistically evaluated with accuracy and efficiency.

Chamis, Christos C.↗
NASA NTRS1995

Partitioning of ocean and land uptake of CO2 as inferred by delta C-13 measurements from the NOAA Climate Monitoring and Diagnostics Laboratory Global Air Sampling Network

Using delta C-13 measurements in atmospheric CO2 from a cooperative global air sampling network, we determined the partitioning of the net uptake of CO2 between ocean and land as a function of latitude and time. The majority of delta C-13 measurements were made at the Institute of Arctic and Alpine Research (INSTAAR) of the University of Colorado. We perform an inverse deconvolution of both CO2 and delta C-13 observations, using a two-dimensional model of atmospheric transport. Also, the discrimination against C-13 by plant photosynthesis, as a function of latitude and time, is calculated from global runs of the simple biosphere (SiB) model. Uncertainty due to the longitudinal structure of the data, which is not represented by the model, is studied through a bootstrap analysis by adding and omitting measurement sites. The resulting error estimates for our inferred sources and sinks are of the order of 1 GTC (1 GTC = 10(exp 15) gC). Such error bars do not reflect potential systematic errors arising from our estimates of the isotopic disequilibria between the atmosphere and the oceans and biosphere, which are estimated in a separate sensitivity analysis. With respect to global totals for 1992 we found that 3.2 GTC of carbon dissolved into the ocean and that 1.5 GTC were sequestered by land ecosystems. Northern hemisphere ocean gyres north of 15 deg N absorbed 2.7 GTC. The equatorial oceans between 10 deg S and 10 deg N were a net source to the atmosphere of 0.9 GTC. We obtained a sink of 1.6 GTC in southern ocean gyres south of 20 deg S, although the deconvolution is poorly constrained by sparse data coverage at high southern latitudes. The seasonal uptake of CO2 in the northern gyres appears to be correlated with a bloom of phytoplankton in surface waters. On land, northern temperate and boreal ecosystems between 35 deg N and 65 deg N were found to be a major sink of CO2 in 1992, as large as 3.5 GTC. Northern tropical ecosystems (equator-30 deg N) appear to be a net source to the source to the atmosphere of 2 GTC which could reflect biomass burning. A small sink, 0.3 GTC, was inferred for southern tropical ecosystems (30 deg S-equator).

Ciais, Philippe↗
NASA NTRS2020

Structure and Parameter Uncertainty in Centennial Projections of Forest Community Structure and Carbon Cycling

Secondary forest regrowth shapes community succession and biogeochemistry for decades, including in the Upper Great Lakes region. Vegetation models encapsulate our understanding of forest function, and whether models can reproduce multi‐decadal succession patterns is an indication of our ability to predict forest responses to future change. We test the ability of a vegetation model to simulate C cycling and community composition during 100 years of forest regrowth following stand‐replacing disturbance, asking (a) Which processes and parameters are most important to accurately model Upper Midwest forest succession? (b) What is the relative importance of model structure versus parameter values to these predictions? We ran ensembles of the Ecosystem Demography model v2.2 with different representations of processes important to competition for light. We compared the magnitude of structural and parameter uncertainty and assessed which sub‐model–parameter combinations best reproduced observed C fluxes and community composition. On average, our simulations underestimated observed net primary productivity (NPP) and leaf area index (LAI) after 100 years and predicted complete dominance by a single plant functional type (PFT). Out of 4,000 simulations, only nine fell within the observed range of both NPP and LAI, but these predicted unrealistically complete dominance by either early hardwood or pine PFTs. A different set of seven simulations were ecologically plausible but under‐predicted observed NPP and LAI. Parameter uncertainty was large; NPP and LAI ranged from ~0% to >200% of their mean value, and any PFT could become dominant. The two parameters that contributed most to uncertainty in predicted NPP were plant–soil water conductance and growth respiration, both unobservable empirical coefficients. We conclude that (a) parameter uncertainty is more important than structural uncertainty, at least for ED‐2.2 in Upper Midwest forests and (b) simulating both productivity and plant community composition accurately without physically unrealistic parameters remains challenging for demographic vegetation models.

canopy radiative transfer↗
DOE OSTI2021

Comparing different generations of idealized solar geoengineering simulations in the Geoengineering Model Intercomparison Project (GeoMIP)

Abstract. Solar geoengineering has been receiving increased attention in recent years as a potential temporary solution to offset global warming. One method of approximating global-scale solar geoengineering in climate models is via solar reduction experiments. Two generations of models in the Geoengineering Model Intercomparison Project (GeoMIP) have now simulated offsetting a quadrupling of the CO2 concentration with solar reduction. This simulation is idealized and designed to elicit large responses in the models. Here, we show that energetics, temperature, and hydrological cycle changes in this experiment are statistically indistinguishable between the two ensembles. Of the variables analyzed here, the only major differences involve highly parameterized and uncertain processes, such as cloud forcing or terrestrial net primary productivity. We conclude that despite numerous structural differences and uncertainties in models over the past two generations of models, including an increase in climate sensitivity in the latest generation of models, the models are consistent in their aggregate climate response to global solar dimming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Impact of Systematic Modeling Uncertainties on Kilonova Property Estimation

The precise atomic structure and therefore the wavelength-dependent opacities of lanthanides are highly uncertain. This uncertainty introduces systematic errors in modeling transients like kilonovae and estimating key properties such as mass, characteristic velocity, and heavy metal content. Here, we quantify how atomic data from across the literature as well as choices of thermalization efficiency of r-process radioactive decay heating impact the light curve and spectra of kilonovae. Specifically, we analyze the spectra of a grid of models produced by the radiative transfer code Sedona that span the expected range of kilonova properties to identify regions with the highest systematic uncertainty. Our findings indicate that differences in atomic data have a substantial impact on estimates of lanthanide mass fraction, spanning approximately 1 order of magnitude for lanthanide-rich ejecta, and demonstrate the difficulty in precisely measuring the lanthanide fraction in lanthanide-poor ejecta. Mass estimates vary typically by 25%–40% for differing atomic data. Similarly, the choice of thermalization efficiency can affect mass estimates by 20%–50%. Observational properties such as color and decay rate are highly model dependent. Velocity estimation, when fitting solely based on the light curve, can have a typical error of ∼100%. Atomic data of light r-process elements can strongly affect blue emission. Even for well-observed events like GW170817, the total lanthanide production estimated using different atomic data sets can vary by a factor of ∼6.

Gravitational wave sources↗
NASA NTRSDate not supplied

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗
NASA NTRS2025

An Observation-Driven Framework for Modeling Post-Fire Hydrologic Response: Evaluation for Two Central California Case Studies

In a warming climate, wildfires are becoming increasingly common, especially in semi-arid environments. Wildfires can disrupt forest ecosystems and induce changes to the land surface. Collectively, these impacts can alter the hydrologic response of a catchment following a fire, resulting in increased potential for surface runoff, reduced evapotranspiration, and, ultimately, a higher risk for flash flooding and mass wasting. The timescale of post-fire recovery of hydrological processes to return to pre-fire conditions is not well established due to the lack of ground measurements. Accurate characterization of the impacts of fire on hydrologic response is also challenging to simulate, given the complex interplay of various processes. Here, we present a generalized framework to quantify the impacts of wildfire on runoff generation. We consider the disturbances in the vegetation and soil as the two main factors contributing to post-fire floods. Using an ensemble modeling structure to account for parameter uncertainty, remotely sensed leaf area index (LAI) is assimilated into a land surface model (LSM) to simulate vegetation disturbance, and the maximum land surface saturation LSM parameter is decreased to parameterize the soil disturbance following observed fires. We consider the impacts of fire-induced changes to LAI and soil saturation on hydrologic states like runoff and evapotranspiration for two case studies. These case studies demonstrate the general applicability of hydrophobicity formulation to serve as a guideline for exploring the range of hydrologic responses post-fire.

Fire Hydrology↗
DOE OSTI2021

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Improving Climate Projections Using "Intelligent" Ensembles

Recent changes in the climate system have led to growing concern, especially in communities which are highly vulnerable to resource shortages and weather extremes. There is an urgent need for better climate information to develop solutions and strategies for adapting to a changing climate. Climate models provide excellent tools for studying the current state of climate and making future projections. However, these models are subject to biases created by structural uncertainties. Performance metrics-or the systematic determination of model biases-succinctly quantify aspects of climate model behavior. Efforts to standardize climate model experiments and collect simulation data-such as the Coupled Model Intercomparison Project (CMIP)-provide the means to directly compare and assess model performance. Performance metrics have been used to show that some models reproduce present-day climate better than others. Simulation data from multiple models are often used to add value to projections by creating a consensus projection from the model ensemble, in which each model is given an equal weight. It has been shown that the ensemble mean generally outperforms any single model. It is possible to use unequal weights to produce ensemble means, in which models are weighted based on performance (called "intelligent" ensembles). Can performance metrics be used to improve climate projections? Previous work introduced a framework for comparing the utility of model performance metrics, showing that the best metrics are related to the variance of top-of-atmosphere outgoing longwave radiation. These metrics improve present-day climate simulations of Earth's energy budget using the "intelligent" ensemble method. The current project identifies several approaches for testing whether performance metrics can be applied to future simulations to create "intelligent" ensemble-mean climate projections. It is shown that certain performance metrics test key climate processes in the models, and that these metrics can be used to evaluate model quality in both current and future climate states. This information will be used to produce new consensus projections and provide communities with improved climate projections for urgent decision-making.

Baker, Noel C.↗
NASA NTRS2015

Improving Climate Projections Using "Intelligent" Ensembles

Recent changes in the climate system have led to growing concern, especially in communities which are highly vulnerable to resource shortages and weather extremes. There is an urgent need for better climate information to develop solutions and strategies for adapting to a changing climate. Climate models provide excellent tools for studying the current state of climate and making future projections. However, these models are subject to biases created by structural uncertainties. Performance metrics-or the systematic determination of model biases-succinctly quantify aspects of climate model behavior. Efforts to standardize climate model experiments and collect simulation data-such as the Coupled Model Intercomparison Project (CMIP)-provide the means to directly compare and assess model performance. Performance metrics have been used to show that some models reproduce present-day climate better than others. Simulation data from multiple models are often used to add value to projections by creating a consensus projection from the model ensemble, in which each model is given an equal weight. It has been shown that the ensemble mean generally outperforms any single model. It is possible to use unequal weights to produce ensemble means, in which models are weighted based on performance (called "intelligent" ensembles). Can performance metrics be used to improve climate projections? Previous work introduced a framework for comparing the utility of model performance metrics, showing that the best metrics are related to the variance of top-of-atmosphere outgoing longwave radiation. These metrics improve present-day climate simulations of Earth's energy budget using the "intelligent" ensemble method. The current project identifies several approaches for testing whether performance metrics can be applied to future simulations to create "intelligent" ensemble-mean climate projections. It is shown that certain performance metrics test key climate processes in the models, and that these metrics can be used to evaluate model quality in both current and future climate states. This information will be used to produce new consensus projections and provide communities with improved climate projections for urgent decision-making.

Baker, Noel C.↗
DOE OSTI2023

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗
DOE OSTI2021

Transmission Spectroscopy for the Warm Sub-Neptune HD 3167c: Evidence for Molecular Absorption and a Possible High-metallicity Atmosphere

We present a transmission spectrum for the warm (500−600 K) sub-Neptune HD 3167c obtained using the Hubble Space Telescope Wide Field Camera 3 infrared spectrograph. We combine these data, which span the 1.125–1.643 μm wavelength range, with broadband transit measurements made using Kepler/K2 (0.6–0.9 μm) and Spitzer/IRAC (4–5 μm). We find evidence for absorption by at least one of H{sub 2}O, HCN, CO{sub 2}, and CH{sub 4} (Bayes factor 7.4; 2.5σ significance), although the data precision does not allow us to unambiguously discriminate between these molecules. The transmission spectrum rules out cloud-free hydrogen-dominated atmospheres with metallicities ≤100× solar at >5.8σ confidence. In contrast, good agreement with the data is obtained for cloud-free models assuming metallicities >700× solar. However, for retrieval analyses that include the effect of clouds, a much broader range of metallicities (including subsolar) is consistent with the data, due to the degeneracy with cloud-top pressure. Self-consistent chemistry models that account for photochemistry and vertical mixing are presented for the atmosphere of HD 3167c. The predictions of these models are broadly consistent with our abundance constraints, although this is primarily due to the large uncertainties on the latter. Interior structure models suggest that the core mass fraction is >40%, independent of a rock or water core composition, and independent of atmospheric envelope metallicity up to 1000× solar. We also report abundance measurements for 15 elements in the host star, showing that it has a very nearly solar composition.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6

Abstract. The Scenario Model Intercomparison Project (ScenarioMIP) defines and coordinates the main set of future climate projections, based on concentration-driven simulations, within the Coupled Model Intercomparison Project phase 6 (CMIP6). This paper presents a range of its outcomes by synthesizing results from the participating global coupled Earth system models. We limit our scope to the analysis of strictly geophysical outcomes: mainly global averages and spatial patterns of change for surface air temperature and precipitation. We also compare CMIP6 projections to CMIP5 results, especially for those scenarios that were designed to provide continuity across the CMIP phases, at the same time highlighting important differences in forcing composition, as well as in results. The range of future temperature and precipitation changes by the end of the century (2081–2100) encompassing the Tier 1 experiments based on the Shared Socioeconomic Pathway (SSP) scenarios (SSP1-2.6, SSP2-4.5, SSP3-7.0 and SSP5-8.5) and SSP1-1.9 spans a larger range of outcomes compared to CMIP5, due to higher warming (by close to 1.5 ∘C) reached at the upper end of the 5 %–95 % envelope of the highest scenario (SSP5-8.5). This is due to both the wider range of radiative forcing that the new scenarios cover and the higher climate sensitivities in some of the new models compared to their CMIP5 predecessors. Spatial patterns of change for temperature and precipitation averaged over models and scenarios have familiar features, and an analysis of their variations confirms model structural differences to be the dominant source of uncertainty. Models also differ with respect to the size and evolution of internal variability as measured by individual models' initial condition ensemble spreads, according to a set of initial condition ensemble simulations available under SSP3-7.0. These experiments suggest a tendency for internal variability to decrease along the course of the century in this scenario, a result that will benefit from further analysis over a larger set of models. Benefits of mitigation, all else being equal in terms of societal drivers, appear clearly when comparing scenarios developed under the same SSP but to which different degrees of mitigation have been applied. It is also found that a mild overshoot in temperature of a few decades around mid-century, as represented in SSP5-3.4OS, does not affect the end outcome of temperature and precipitation changes by 2100, which return to the same levels as those reached by the gradually increasing SSP4-3.4 (not erasing the possibility, however, that other aspects of the system may not be as easily reversible). Central estimates of the time at which the ensemble means of the different scenarios reach a given warming level might be biased by the inclusion of models that have shown faster warming in the historical period than the observed. Those estimates show all scenarios reaching 1.5 ∘C of warming compared to the 1850–1900 baseline in the second half of the current decade, with the time span between slow and fast warming covering between 20 and 27 years from present. The warming level of 2 ∘C of warming is reached as early as 2039 by the ensemble mean under SSP5-8.5 but as late as the mid-2060s under SSP1-2.6. The highest warming level considered (5 ∘C) is reached by the ensemble mean only under SSP5-8.5 and not until the mid-2090s.

54 ENVIRONMENTAL SCIENCES↗