Search NASA⌕ Search

SEARCH · Search NASA

Results for “model structure uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Comparing different generations of idealized solar geoengineering simulations in the Geoengineering Model Intercomparison Project (GeoMIP)

Abstract. Solar geoengineering has been receiving increased attention in recent years as a potential temporary solution to offset global warming. One method of approximating global-scale solar geoengineering in climate models is via solar reduction experiments. Two generations of models in the Geoengineering Model Intercomparison Project (GeoMIP) have now simulated offsetting a quadrupling of the CO2 concentration with solar reduction. This simulation is idealized and designed to elicit large responses in the models. Here, we show that energetics, temperature, and hydrological cycle changes in this experiment are statistically indistinguishable between the two ensembles. Of the variables analyzed here, the only major differences involve highly parameterized and uncertain processes, such as cloud forcing or terrestrial net primary productivity. We conclude that despite numerous structural differences and uncertainties in models over the past two generations of models, including an increase in climate sensitivity in the latest generation of models, the models are consistent in their aggregate climate response to global solar dimming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Impact of Systematic Modeling Uncertainties on Kilonova Property Estimation

The precise atomic structure and therefore the wavelength-dependent opacities of lanthanides are highly uncertain. This uncertainty introduces systematic errors in modeling transients like kilonovae and estimating key properties such as mass, characteristic velocity, and heavy metal content. Here, we quantify how atomic data from across the literature as well as choices of thermalization efficiency of r-process radioactive decay heating impact the light curve and spectra of kilonovae. Specifically, we analyze the spectra of a grid of models produced by the radiative transfer code Sedona that span the expected range of kilonova properties to identify regions with the highest systematic uncertainty. Our findings indicate that differences in atomic data have a substantial impact on estimates of lanthanide mass fraction, spanning approximately 1 order of magnitude for lanthanide-rich ejecta, and demonstrate the difficulty in precisely measuring the lanthanide fraction in lanthanide-poor ejecta. Mass estimates vary typically by 25%–40% for differing atomic data. Similarly, the choice of thermalization efficiency can affect mass estimates by 20%–50%. Observational properties such as color and decay rate are highly model dependent. Velocity estimation, when fitting solely based on the light curve, can have a typical error of ∼100%. Atomic data of light r-process elements can strongly affect blue emission. Even for well-observed events like GW170817, the total lanthanide production estimated using different atomic data sets can vary by a factor of ∼6.

Gravitational wave sources↗
DOE OSTI2021

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗
DOE OSTI2021

Transmission Spectroscopy for the Warm Sub-Neptune HD 3167c: Evidence for Molecular Absorption and a Possible High-metallicity Atmosphere

We present a transmission spectrum for the warm (500−600 K) sub-Neptune HD 3167c obtained using the Hubble Space Telescope Wide Field Camera 3 infrared spectrograph. We combine these data, which span the 1.125–1.643 μm wavelength range, with broadband transit measurements made using Kepler/K2 (0.6–0.9 μm) and Spitzer/IRAC (4–5 μm). We find evidence for absorption by at least one of H{sub 2}O, HCN, CO{sub 2}, and CH{sub 4} (Bayes factor 7.4; 2.5σ significance), although the data precision does not allow us to unambiguously discriminate between these molecules. The transmission spectrum rules out cloud-free hydrogen-dominated atmospheres with metallicities ≤100× solar at >5.8σ confidence. In contrast, good agreement with the data is obtained for cloud-free models assuming metallicities >700× solar. However, for retrieval analyses that include the effect of clouds, a much broader range of metallicities (including subsolar) is consistent with the data, due to the degeneracy with cloud-top pressure. Self-consistent chemistry models that account for photochemistry and vertical mixing are presented for the atmosphere of HD 3167c. The predictions of these models are broadly consistent with our abundance constraints, although this is primarily due to the large uncertainties on the latter. Interior structure models suggest that the core mass fraction is >40%, independent of a rock or water core composition, and independent of atmospheric envelope metallicity up to 1000× solar. We also report abundance measurements for 15 elements in the host star, showing that it has a very nearly solar composition.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6

Abstract. The Scenario Model Intercomparison Project (ScenarioMIP) defines and coordinates the main set of future climate projections, based on concentration-driven simulations, within the Coupled Model Intercomparison Project phase 6 (CMIP6). This paper presents a range of its outcomes by synthesizing results from the participating global coupled Earth system models. We limit our scope to the analysis of strictly geophysical outcomes: mainly global averages and spatial patterns of change for surface air temperature and precipitation. We also compare CMIP6 projections to CMIP5 results, especially for those scenarios that were designed to provide continuity across the CMIP phases, at the same time highlighting important differences in forcing composition, as well as in results. The range of future temperature and precipitation changes by the end of the century (2081–2100) encompassing the Tier 1 experiments based on the Shared Socioeconomic Pathway (SSP) scenarios (SSP1-2.6, SSP2-4.5, SSP3-7.0 and SSP5-8.5) and SSP1-1.9 spans a larger range of outcomes compared to CMIP5, due to higher warming (by close to 1.5 ∘C) reached at the upper end of the 5 %–95 % envelope of the highest scenario (SSP5-8.5). This is due to both the wider range of radiative forcing that the new scenarios cover and the higher climate sensitivities in some of the new models compared to their CMIP5 predecessors. Spatial patterns of change for temperature and precipitation averaged over models and scenarios have familiar features, and an analysis of their variations confirms model structural differences to be the dominant source of uncertainty. Models also differ with respect to the size and evolution of internal variability as measured by individual models' initial condition ensemble spreads, according to a set of initial condition ensemble simulations available under SSP3-7.0. These experiments suggest a tendency for internal variability to decrease along the course of the century in this scenario, a result that will benefit from further analysis over a larger set of models. Benefits of mitigation, all else being equal in terms of societal drivers, appear clearly when comparing scenarios developed under the same SSP but to which different degrees of mitigation have been applied. It is also found that a mild overshoot in temperature of a few decades around mid-century, as represented in SSP5-3.4OS, does not affect the end outcome of temperature and precipitation changes by 2100, which return to the same levels as those reached by the gradually increasing SSP4-3.4 (not erasing the possibility, however, that other aspects of the system may not be as easily reversible). Central estimates of the time at which the ensemble means of the different scenarios reach a given warming level might be biased by the inclusion of models that have shown faster warming in the historical period than the observed. Those estimates show all scenarios reaching 1.5 ∘C of warming compared to the 1850–1900 baseline in the second half of the current decade, with the time span between slow and fast warming covering between 20 and 27 years from present. The warming level of 2 ∘C of warming is reached as early as 2039 by the ensemble mean under SSP5-8.5 but as late as the mid-2060s under SSP1-2.6. The highest warming level considered (5 ∘C) is reached by the ensemble mean only under SSP5-8.5 and not until the mid-2090s.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Multiscale Aerosol Modeling Across Space and Composition (Final Report)

The objective of this project was to harness the capabilities of our unique particle-resolved aerosol model PartMC as an integrating tool between models and measurements across scales. This particle-resolved model explicitly resolves aerosol aging processes that must be approximated in large-scale models, making it ideal for quantifying structural uncertainty and rigorously deriving simplified parameterizations (“coarse graining”) to be used in large-scale models. It also directly connects with laboratory and field measurements at both particle and bulk scales. The significant accomplishments of this project are as follows: 1. Advancing the state of the art in particle-resolved modeling; 2. Connecting modeling with ASR/ARM measurements; 3. Bridging from the process level to aerosol impacts on the global scale; 4. Community engagement through leading and participating in ASR program activities and publishing a review paper on aerosol mixing state that synthesizes experimental and modeling perspectives.

58 GEOSCIENCES↗
DOE OSTI2021

Partitioning uncertainty in projections of Arctic sea ice

Abstract Improved knowledge of the contributing sources of uncertainty in projections of Arctic sea ice over the 21st century is essential for evaluating impacts of a changing Arctic environment. Here, we consider the role of internal variability, model structure and emissions scenario in projections of Arctic sea-ice area (SIA) by using six single model initial-condition large ensembles and a suite of models participating in Phase 5 of the Coupled Model Intercomparison Project. For projections of September Arctic SIA change, internal variability accounts for as much as 40%–60% of the total uncertainty in the next decade, while emissions scenario dominates uncertainty toward the end of the century. Model structure accounts for 60%–70% of the total uncertainty by mid-century and declines to 30% at the end of the 21st century in the summer months. For projections of wintertime Arctic SIA change, internal variability contributes as much as 50%–60% of the total uncertainty in the next decade and impacts total uncertainty at longer lead times when compared to the summertime. In winter, there exists a considerable scenario dependence of model uncertainty with relatively larger model uncertainty under strong forcing compared to weak forcing. At regional scales, the contribution of internal variability can vary widely and strongly depends on the calendar month and region. For wintertime SIA change in the Greenland-Iceland-Norwegian and Barents Seas, internal variability contributes 60%–70% to the total uncertainty over the coming decades and remains important much longer than in other regions. We further find that the relative contribution of internal variability to total uncertainty is state-dependent and increases as sea ice volume declines. These results demonstrate that internal variability is a significant source of uncertainty in projections of Arctic sea ice.

Bonan, David B. (ORCID:0000000338676009)↗
DOE OSTI2022

Effects of Intrusive Confining Units on Groundwater Flow at Pahute Mesa, Nevada National Security Site

Geological, geophysical, hydrogeological, and hydrological evidence indicates that feeder dikes to rhyolitic lava flows may play a role as confining units in the groundwater flow system underlying the Pahute Mesa (PM) area of underground nuclear testing at the Nevada National Security Site (NNSS) (Figure 1). Of geological significance, the PM testing area is largely situated within the Silent Canyon caldera complex (SCCC), which includes both tuffs and lavas that were fed by (and are connected to) intrusive rock units such as feeder dikes prior to and during volcanic eruptions (Orkild et al., 1968; Byers et al., 1976a). Groundwater modeling results presented in this report support extension of “pool-dam” and “breach scenario” concepts presented in Jackson and Fenelon (2018) and Jackson et al. (2021) to low-permeability intrusive confining units (ICUs) such as feeder dikes that are expected to dissect and ring silicic calderas. As laterally extensive, steeply-dipping, and sub-parallel planar structures, ICUs may further compartmentalize groundwater flow in some areas of the volcanic aquifer system at PM. ICUs may explain unusually high horizontal hydraulic gradient southwest of Cheshire. Breaching of an ICU within which the Cheshire test was emplaced may explain changes in water levels before and after the Cheshire test was detonated in the U-20n emplacement hole on 2/14/76 (USDOE, 2015b). This analysis of the effects of ICUs on groundwater flow at PM addresses a need to evaluate uncertainty in the conceptual model or structural aspects of hydrologic source term (HST) or corrective action unit (CAU) models for groundwater flow and contaminant transport (FFACO, 1996, as amended). At Cheshire and possibly other test locations at PM, downgradient extent of radionuclide contamination may be overpredicted by not including the confining effects of ICUs. On the other hand, contaminant extent may be underpredicted by not considering transient flow effects and/or the re-equilibrated flow field caused by breaching of an ICU by an underground nuclear test. Near Cheshire, the effects of ICUs may be most apparent and impactful to the groundwater flow system at PM because of an unusual combination of thickness, extent, and frequency of dikes transecting the saturated CHLFA4 aquifer and feeding into the overlying unsaturated rhyolite lava of Windy Wash. Chapters 2, 3, and 4 present geological, geophysical, hydrogeological, and hydrological evidence for ICUs at PM. Chapters 5 and 6 examine effects of ICUs on groundwater flow including analysis by groundwater modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Thermodynamics of order and randomness in dopant distributions inferred from atomically resolved imaging

Abstract Exploration of structure-property relationships as a function of dopant concentration is commonly based on mean field theories for solid solutions. However, such theories that work well for semiconductors tend to fail in materials with strong correlations, either in electronic behavior or chemical segregation. In these cases, the details of atomic arrangements are generally not explored and analyzed. The knowledge of the generative physics and chemistry of the material can obviate this problem, since defect configuration libraries as stochastic representation of atomic level structures can be generated, or parameters of mesoscopic thermodynamic models can be derived. To obtain such information for improved predictions, we use data from atomically resolved microscopic images that visualize complex structural correlations within the system and translate them into statistical mechanical models of structure formation. Given the significant uncertainties about the microscopic aspects of the material’s processing history along with the limited number of available images, we combine model optimization techniques with the principles of statistical hypothesis testing. We demonstrate the approach on data from a series of atomically-resolved scanning transmission electron microscopy images of Mo x Re 1- x S 2 at varying ratios of Mo/Re stoichiometries, for which we propose an effective interaction model that is then used to generate atomic configurations and make testable predictions at a range of concentrations and formation temperatures.

25 ENERGY STORAGE↗