Search NASA⌕ Search

SEARCH · Search NASA

Results for “model structure uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Detection of abrupt changes in dynamic systems

Some of the basic ideas associated with the detection of abrupt changes in dynamic systems are presented. Multiple filter-based techniques and residual-based method and the multiple model and generalized likelihood ratio methods are considered. Issues such as the effect of unknown onset time on algorithm complexity and structure and robustness to model uncertainty are discussed.

Willsky, A. S.↗

Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6

The Scenario Model Intercomparison Project (ScenarioMIP) defines and coordinates the main set of future climate projections, based on concentration-driven simulations, within the Coupled Model Intercomparison Project phase 6 (CMIP6). This paper presents a range of its outcomes by synthesizing results from the participating global coupled Earth system models. We limit our scope to the analysis of strictly geophysical outcomes: mainly global averages and spatial patterns of change for surface air temperature and precipitation. We also compare CMIP6 projections to CMIP5 results, especially for those scenarios that were designed to provide continuity across the CMIP phases, at the same time highlighting important differences in forcing composition, as well as in results. The range of future temperature and precipitation changes by the end of the century (2081–2100) encompassing the Tier 1 experiments based on the Shared Socioeconomic Pathway (SSP) scenarios (SSP1-2.6, SSP2-4.5, SSP3-7.0 and SSP5-8.5) and SSP1-1.9 spans a larger range of outcomes compared to CMIP5, due to higher warming (by close to 1.5 °C) reached at the upper end of the 5 %–95 % envelope of the highest scenario (SSP5-8.5). This is due to both the wider range of radiative forcing that the new scenarios cover and the higher climate sensitivities in some of the new models compared to their CMIP5 predecessors. Spatial patterns of change for temperature and precipitation averaged over models and scenarios have familiar features, and an analysis of their variations confirms model structural differences to be the dominant source of uncertainty. Models also differ with respect to the size and evolution of internal variability as measured by individual models' initial condition ensemble spreads, according to a set of initial condition ensemble simulations available under SSP3-7.0. These experiments suggest a tendency for internal variability to decrease along the course of the century in this scenario, a result that will benefit from further analysis over a larger set of models. Benefits of mitigation, all else being equal in terms of societal drivers, appear clearly when comparing scenarios developed under the same SSP but to which different degrees of mitigation have been applied. It is also found that a mild overshoot in temperature of a few decades around mid-century, as represented in SSP5-3.4OS, does not affect the end outcome of temperature and precipitation changes by 2100, which return to the same levels as those reached by the gradually increasing SSP4-3.4 (not erasing the possibility, however, that other aspects of the system may not be as easily reversible). Central estimates of the time at which the ensemble means of the different scenarios reach a given warming level might be biased by the inclusion of models that have shown faster warming in the historical period than the observed. Those estimates show all scenarios reaching 1.5 °C of warming compared to the 1850–1900 baseline in the second half of the current decade, with the time span between slow and fast warming covering between 20 and 27 years from present. The warming level of 2 °C of warming is reached as early as 2039 by the ensemble mean under SSP5-8.5 but as late as the mid-2060s under SSP1-2.6. The highest warming level considered (5 °C) is reached by the ensemble mean only under SSP5-8.5 and not until the mid-2090s.d-2090s.

Scenario Model Intercomparison Project (ScenarioMI↗

Sources of Uncertainty in the Prediction of LAI / fPAR from MODIS

To explicate the sources of uncertainty in the prediction of biophysical variables over space, consider the general equation: where z is a variable with values on some nominal, ordinal, interval or ratio scale; y is a vector of input variables; u is the spatial support of y and z ; x and u are the spatial locations of y and z , respectively; f is a model and B is the vector of the parameters of this model. Any y or z has a value and a spatial extent which is called its support. Viewed in this way, categories of uncertainty are from variable (e.g. measurement), parameter, positional. support and model (e.g. structural) sources. The prediction of Leaf Area Index (LAI) and the fraction of absorbed photosynthetically active radiation (fPAR) are examples of z variables predicted using model(s) as a function of y variables and spatially constant parameters. The MOD15 algorithm is an example of f, called f(sub 1), with parameters including those defined by one of six biome types and solar and view angles. The Leaf Canopy Model (LCM)2, a nested model that combines leaf radiative transfer with a full canopy reflectance model through the phase function, is a simpler though similar radiative transfer approach to f(sub 1). In a previous study, MOD15 and LCM2 gave similar results for the broadleaf forest biome. Differences between these two models can be used to consider the structural uncertainty in prediction results. In an effort to quantify each of the five sources of uncertainty and rank their relative importance for the LAI/fPAR prediction problem, we used recent data for an EOS Core Validation Site in the broadleaf biome with coincident surface reflectance, vegetation index, fPAR and LAI products from the Moderate Resolution Imaging Spectrometer (MODIS). Uncertainty due to support on the input reflectance variable was characterized using Landsat ETM+ data. Input uncertainties were propagated through the LCM2 model and compared with published uncertainties from the MOD15 algorithm.

Dungan, Jennifer L.↗

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Assessment of Radiative Heating Uncertainty for Hyperbolic Earth Entry

This paper investigates the shock-layer radiative heating uncertainty for hyperbolic Earth entry, with the main focus being a Mars return. In Part I of this work, a baseline simulation approach involving the LAURA Navier-Stokes code with coupled ablation and radiation is presented, with the HARA radiation code being used for the radiation predictions. Flight cases representative of peak-heating Mars or asteroid return are de ned and the strong influence of coupled ablation and radiation on their aerothermodynamic environments are shown. Structural uncertainties inherent in the baseline simulations are identified, with turbulence modeling, precursor absorption, grid convergence, and radiation transport uncertainties combining for a +34% and ..24% structural uncertainty on the radiative heating. A parametric uncertainty analysis, which assumes interval uncertainties, is presented. This analysis accounts for uncertainties in the radiation models as well as heat of formation uncertainties in the flow field model. Discussions and references are provided to support the uncertainty range chosen for each parameter. A parametric uncertainty of +47.3% and -28.3% is computed for the stagnation-point radiative heating for the 15 km/s Mars-return case. A breakdown of the largest individual uncertainty contributors is presented, which includes C3 Swings cross-section, photoionization edge shift, and Opacity Project atomic lines. Combining the structural and parametric uncertainty components results in a total uncertainty of +81.3% and ..52.3% for the Mars-return case. In Part II, the computational technique and uncertainty analysis presented in Part I are applied to 1960s era shock-tube and constricted-arc experimental cases. It is shown that experiments contain shock layer temperatures and radiative ux values relevant to the Mars-return cases of present interest. Comparisons between the predictions and measurements, accounting for the uncertainty in both, are made for a range of experiments. A measure of comparison quality is de ned, which consists of the percent overlap of the predicted uncertainty bar with the corresponding measurement uncertainty bar. For nearly all cases, this percent overlap is greater than zero, and for most of the higher temperature cases (T >13,000 K) it is greater than 50%. These favorable comparisons provide evidence that the baseline computational technique and uncertainty analysis presented in Part I are adequate for Mars-return simulations. In Part III, the computational technique and uncertainty analysis presented in Part I are applied to EAST shock-tube cases. These experimental cases contain wavelength dependent intensity measurements in a wavelength range that covers 60% of the radiative intensity for the 11 km/s, 5 m radius flight case studied in Part I. Comparisons between the predictions and EAST measurements are made for a range of experiments. The uncertainty analysis presented in Part I is applied to each prediction, and comparisons are made using the metrics defined in Part II. The agreement between predictions and measurements is excellent for velocities greater than 10.5 km/s. Both the wavelength dependent and wavelength integrated intensities agree within 30% for nearly all cases considered. This agreement provides confidence in the computational technique and uncertainty analysis presented in Part I, and provides further evidence that this approach is adequate for Mars-return simulations. Part IV of this paper reviews existing experimental data that include the influence of massive ablation on radiative heating. It is concluded that this existing data is not sufficient for the present uncertainty analysis. Experiments to capture the influence of massive ablation on radiation are suggested as future work, along with further studies of the radiative precursor and improvements in the radiation properties of ablation products.

Johnston, Christopher O.↗

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

60 APPLIED LIFE SCIENCES↗

Multiscale Aerosol Modeling Across Space and Composition (Final Report)

The objective of this project was to harness the capabilities of our unique particle-resolved aerosol model PartMC as an integrating tool between models and measurements across scales. This particle-resolved model explicitly resolves aerosol aging processes that must be approximated in large-scale models, making it ideal for quantifying structural uncertainty and rigorously deriving simplified parameterizations (“coarse graining”) to be used in large-scale models. It also directly connects with laboratory and field measurements at both particle and bulk scales. The significant accomplishments of this project are as follows: 1. Advancing the state of the art in particle-resolved modeling; 2. Connecting modeling with ASR/ARM measurements; 3. Bridging from the process level to aerosol impacts on the global scale; 4. Community engagement through leading and participating in ASR program activities and publishing a review paper on aerosol mixing state that synthesizes experimental and modeling perspectives.

58 GEOSCIENCES↗

Validation of an Experimentally Derived Uncertainty Model

The results show that uncertainty models can be obtained directly from system identification data by using a minimum norm model validation approach. The error between the test data and an analytical nominal model is modeled as a combination of unstructured additive and structured input multiplicative uncertainty. Robust controllers which use the experimentally derived uncertainty model show significant stability and performance improvements over controllers designed with assumed ad hoc uncertainty levels. Use of the identified uncertainty model also allowed a strong correlation between design predictions and experimental results.

Lim, K. B.↗

Partitioning uncertainty in projections of Arctic sea ice

Abstract Improved knowledge of the contributing sources of uncertainty in projections of Arctic sea ice over the 21st century is essential for evaluating impacts of a changing Arctic environment. Here, we consider the role of internal variability, model structure and emissions scenario in projections of Arctic sea-ice area (SIA) by using six single model initial-condition large ensembles and a suite of models participating in Phase 5 of the Coupled Model Intercomparison Project. For projections of September Arctic SIA change, internal variability accounts for as much as 40%–60% of the total uncertainty in the next decade, while emissions scenario dominates uncertainty toward the end of the century. Model structure accounts for 60%–70% of the total uncertainty by mid-century and declines to 30% at the end of the 21st century in the summer months. For projections of wintertime Arctic SIA change, internal variability contributes as much as 50%–60% of the total uncertainty in the next decade and impacts total uncertainty at longer lead times when compared to the summertime. In winter, there exists a considerable scenario dependence of model uncertainty with relatively larger model uncertainty under strong forcing compared to weak forcing. At regional scales, the contribution of internal variability can vary widely and strongly depends on the calendar month and region. For wintertime SIA change in the Greenland-Iceland-Norwegian and Barents Seas, internal variability contributes 60%–70% to the total uncertainty over the coming decades and remains important much longer than in other regions. We further find that the relative contribution of internal variability to total uncertainty is state-dependent and increases as sea ice volume declines. These results demonstrate that internal variability is a significant source of uncertainty in projections of Arctic sea ice.

Bonan, David B. (ORCID:0000000338676009)↗

Effects of Intrusive Confining Units on Groundwater Flow at Pahute Mesa, Nevada National Security Site

Geological, geophysical, hydrogeological, and hydrological evidence indicates that feeder dikes to rhyolitic lava flows may play a role as confining units in the groundwater flow system underlying the Pahute Mesa (PM) area of underground nuclear testing at the Nevada National Security Site (NNSS) (Figure 1). Of geological significance, the PM testing area is largely situated within the Silent Canyon caldera complex (SCCC), which includes both tuffs and lavas that were fed by (and are connected to) intrusive rock units such as feeder dikes prior to and during volcanic eruptions (Orkild et al., 1968; Byers et al., 1976a). Groundwater modeling results presented in this report support extension of “pool-dam” and “breach scenario” concepts presented in Jackson and Fenelon (2018) and Jackson et al. (2021) to low-permeability intrusive confining units (ICUs) such as feeder dikes that are expected to dissect and ring silicic calderas. As laterally extensive, steeply-dipping, and sub-parallel planar structures, ICUs may further compartmentalize groundwater flow in some areas of the volcanic aquifer system at PM. ICUs may explain unusually high horizontal hydraulic gradient southwest of Cheshire. Breaching of an ICU within which the Cheshire test was emplaced may explain changes in water levels before and after the Cheshire test was detonated in the U-20n emplacement hole on 2/14/76 (USDOE, 2015b). This analysis of the effects of ICUs on groundwater flow at PM addresses a need to evaluate uncertainty in the conceptual model or structural aspects of hydrologic source term (HST) or corrective action unit (CAU) models for groundwater flow and contaminant transport (FFACO, 1996, as amended). At Cheshire and possibly other test locations at PM, downgradient extent of radionuclide contamination may be overpredicted by not including the confining effects of ICUs. On the other hand, contaminant extent may be underpredicted by not considering transient flow effects and/or the re-equilibrated flow field caused by breaching of an ICU by an underground nuclear test. Near Cheshire, the effects of ICUs may be most apparent and impactful to the groundwater flow system at PM because of an unusual combination of thickness, extent, and frequency of dikes transecting the saturated CHLFA4 aquifer and feeding into the overlying unsaturated rhyolite lava of Windy Wash. Chapters 2, 3, and 4 present geological, geophysical, hydrogeological, and hydrological evidence for ICUs at PM. Chapters 5 and 6 examine effects of ICUs on groundwater flow including analysis by groundwater modeling.

54 ENVIRONMENTAL SCIENCES↗

Robust fuel- and time-optimal control of uncertain flexible space structures

The problem of computing open-loop, fuel- and time-optimal control inputs for flexible space structures in the face of modeling uncertainty is investigated. Robustified, fuel- and time-optimal pulse sequences are obtained by solving a constrained optimization problem subject to robustness constraints. It is shown that 'bang-off-bang' pulse sequences with a finite number of switchings provide a practical tradeoff among the maneuvering time, fuel consumption, and performance robustness of uncertain flexible space structures.

Wie, Bong↗

Thermodynamics of order and randomness in dopant distributions inferred from atomically resolved imaging

Abstract Exploration of structure-property relationships as a function of dopant concentration is commonly based on mean field theories for solid solutions. However, such theories that work well for semiconductors tend to fail in materials with strong correlations, either in electronic behavior or chemical segregation. In these cases, the details of atomic arrangements are generally not explored and analyzed. The knowledge of the generative physics and chemistry of the material can obviate this problem, since defect configuration libraries as stochastic representation of atomic level structures can be generated, or parameters of mesoscopic thermodynamic models can be derived. To obtain such information for improved predictions, we use data from atomically resolved microscopic images that visualize complex structural correlations within the system and translate them into statistical mechanical models of structure formation. Given the significant uncertainties about the microscopic aspects of the material’s processing history along with the limited number of available images, we combine model optimization techniques with the principles of statistical hypothesis testing. We demonstrate the approach on data from a series of atomically-resolved scanning transmission electron microscopy images of Mo x Re 1- x S 2 at varying ratios of Mo/Re stoichiometries, for which we propose an effective interaction model that is then used to generate atomic configurations and make testable predictions at a range of concentrations and formation temperatures.

25 ENERGY STORAGE↗

Radiative Heating Rate Profiles over the Southeast Atlantic Ocean during the 2016 and 2017 Biomass Burning Seasons

Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. Further uncertainties in the cloud structure arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean where biomass burning aerosol is transported from the African continent. As the aerosol plume progresses across the southeast Atlantic Ocean, radiative heating within the aerosol layer has the potential to alter the thermodynamic environment and therefore the cloud structure; however, limited work has been done to quantify this along the trajectory of the aerosol plume in the region. The deployment of the First Atmospheric Radiation Measurement Mobile Facility in support of the Layered Atlantic Smoke Interactions with Clouds field campaign provided a unique opportunity to collect observations of cloud and aerosol properties during two consecutive biomass burning seasons during July through October of 2016 and 2017 over Ascension Island (7.96 °S, 14.35 °W). Using observed profiles of temperature, humidity, and clouds from the field campaign, alongside aerosol optical properties from MERRA-2 as input for the Rapid Radiation Transfer Model, profiles of the radiative heating rate due to aerosols and clouds were computed. Radiative heating is also assessed across the southeast Atlantic Ocean using an ensemble of back trajectories from the Hybrid Single Particle Lagrangian Integrated Trajectory Model. Idealized experiments using the Rapid Radiation Transfer Model with and without aerosols and a range of values for the single scattering albedo demonstrate that shortwave heating within the aerosol layer above Ascension Island can locally range between 2 and 8 K per day depending on the aerosol optical properties, though impacts of the aerosol can be felt elsewhere in the atmospheric column. When considered under clear conditions, the aerosol has a cooling effect at the TOA and based on the observed cloud properties at Ascension Island, the cloud albedo is not large enough to overcome this. Shortwave radiative heating due to biomass burning aerosol is not balanced by additional longwave cooling, and the net radiative impact results in a stabilization of the lower troposphere. However, these results are extremely sensitive to the single scattering albedo assumptions in models.

Allison B. Marquardt Collow↗

Radiative heating rate profiles over the southeast Atlantic Ocean during the 2016 and 2017 biomass burning seasons

Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. Further uncertainties in the cloud structure arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean, where biomass burning aerosol is transported from the African continent. As the aerosol plume progresses across the southeast Atlantic Ocean, radiative heating within the aerosol layer has the potential to alter the thermodynamic environment and therefore the cloud structure; however, limited work has been done to quantify this along the trajectory of the aerosol plume in the region. The deployment of the first Atmospheric Radiation Measurement (ARM) Mobile Facility (AMF1) in support of the Layered Atlantic Smoke Interactions with Clouds field campaign provided a unique opportunity to collect observations of cloud and aerosol properties during two consecutive biomass burning seasons during July through October of 2016 and 2017 over Ascension Island (7.96° S, 14.35° W). Using observed profiles of temperature, humidity, and clouds from the field campaign alongside aerosol optical properties from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), as input for the Rapid Radiation Transfer Model (RRTM), profiles of the radiative heating rate due to aerosols and clouds were computed. Radiative heating is also assessed across the southeast Atlantic Ocean using an ensemble of back trajectories from the Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) model. Idealized experiments using the RRTM with and without aerosols and a range of values for the single-scattering albedo (SSA) demonstrate that shortwave (SW) heating within the aerosol layer above Ascension Island can locally range between 2 and 8 K d -1 depending on the aerosol optical properties, though impacts of the aerosol can be felt elsewhere in the atmospheric column. When considered under clear conditions, the aerosol has a cooling effect at the TOA, and based on the observed cloud properties at Ascension Island, the cloud albedo is not large enough to overcome this. Shortwave radiative heating due to biomass burning aerosol is not balanced by additional longwave (LW) cooling, and the net radiative impact results in a stabilization of the lower troposphere. However, these results are extremely sensitive to the single-scattering albedo assumptions in models.

54 ENVIRONMENTAL SCIENCES↗