Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multi-Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

12 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Comparison and multi-model inference of excess risks models for radiation-related solid cancer

In assessments of detrimental health risks from exposures to ionising radiation, many forms of risk to dose–response models are available in the literature. The usual practice is to base risk assessment on one specific model and ignore model uncertainty. The analysis illustrated here considers model uncertainty for the outcome all solid cancer incidence, when modelled as a function of colon organ dose, using the most recent publicly available data from the Life Span Study on atomic bomb survivors of Japan. Seven recent publications reporting all solid cancer risk models currently deemed plausible by the scientific community have been included in a model averaging procedure so that the main conclusions do not depend on just one type of model. The models have been estimated with different baselines and presented for males and females at various attained ages and ages at exposure, to obtain specially computed model-averaged Excess Relative Risks (ERR) and Excess Absolute Risks (EAR). Monte Carlo simulated estimation of uncertainty on excess risks was accounted for by applying realisations including correlations in the risk model parameters. Three models were found to weight the model-averaged risks most strongly depending on the baseline and information criteria used for the weighting. Fitting all excess risk models with the same baseline, one model dominates for both information criteria considered in this study. Based on the analysis presented here, it is generally recommended to take model uncertainty into account in future risk analyses.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
NASA NTRS2005

A K-BKZ Formulation for Soft-Tissue Viscoelasticity

A viscoelastic model of the K-BKZ (Kaye 1962; Bernstein et al. 1963) type is developed for isotropic biological tissues, and applied to the fat pad of the human heel. To facilitate this pursuit, a class of elastic solids is introduced through a novel strain-energy function whose elements possess strong ellipticity, and therefore lead to stable material models. The standard fractional-order viscoelastic (FOV) solid is used to arrive at the overall elastic/viscoelastic structure of the model, while the elastic potential via the K-BKZ hypothesis is used to arrive at the tensorial structure of the model. Candidate sets of functions are proposed for the elastic and viscoelastic material functions present in the model, including a regularized fractional derivative that was determined to be the best. The Akaike information criterion (AIC) is advocated for performing multi-model inference, enabling an objective selection of the best material function from within a candidate set.

Freed, Alan D.↗
DOE OSTI2023

Application of multi-method-multi-model inference to radiation related solid cancer excess risks models for astronaut risk assessment

The impact of including model-averaged excess radiation risks (ER) into a measure of radiation attributed decrease of survival (RADS) for the outcome all solid cancer incidence and the impact on the uncertainties is demonstrated. It is shown that RADS applying weighted model averaged ER based on AIC weights result in smaller risk estimates with narrower 95% CI than RADS using ER based on BIC weights. Further a multi-method-multi-model inference approach is introduced that allows calculating one general RADS estimate providing a weighted average risk estimate for a lunar and a Mars mission. For males the general RADS estimate is found to be 0.42% (95% CI: 0.38%; 0.45%) and for females 0.67% (95% CI: 0.59%; 0.75%) for a lunar mission and 2.45% (95% CI: 2.23%; 2.67%) for males and 3.91% (95% CI: 3.44%; 4.39%) for females for a Mars mission considering an age at exposure of 40 years and an attained age of 65 years. It is recommended to include these types of uncertainties and to include model-averaged excess risks in astronaut risk assessment.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
NASA NTRS2020

Observational Constraints on the Effective Climate Sensitivity from the Historical Period

The observed warming in the atmosphere and ocean can be used to estimate the climate sensitivity linked to present-day feedbacks, which is referred to as the effective climate sensitivity (Shist). However, such an estimate is affected by uncertainty in the radiative forcing, particularly aerosols, over the historical period. Here, we make use of detection and attribution techniques to derive the surface air temperature and ocean warming that can be attributed directly to greenhouse gas increases. These serve as inputs to a simple energy budget to infer the likelihood of Shist in response to observed greenhouse gases increases over two time periods (1862–2012 and 1955–2012). The benefit of using greenhouse gas attributable quantities is that they are not subject to uncertainties in the aerosol forcing (other than uncertainty in the attribution to greenhouse gas versus aerosol forcing not captured by the multi-model aerosol response pattern). The resulting effective climate sensitivity estimate, Shist, ranges from 1.3 °Cto 3.1 °C(5%–95% range) over the full instrumental period (1862–2012) for our best estimate, and gets slightly wider when considering further uncertainties. This estimate increases to 1.7 °C–4.6 °C if using the shorter period (1955–2012).We also evaluate the climate model simulated surface air temperature and ocean heat content increase in response to greenhouse gas forcing over the same periods, and compare them with the observationally-constrained values.We find that that the ocean warming simulated in greenhouse gas only simulations in models considered here is consistent with that attributed to greenhouse gas increases from observations, while one model simulates more greenhouse gas-induced surface air warming than observed. However, other models with sensitivity outside our range show greenhouse gas warming that is consistent with that attributed in observations, emphasising that feedbacks during the historical period may differ from the feedbacks at CO2 doubling and from those at true equilibrium.

Tokarska, Katarzyna B↗
NASA NTRS2019

ESD Reviews: Model Dependence in Multi-Model Climate Ensembles: Weighting, Sub-Selection and Out-Of-Sample Testing

The rationale for using multi-model ensembles in climate change projections and impacts research is often based on the expectation that different models constitute independent estimates; therefore, a range of models allows a better characterisation of the uncertainties in the representation of the climate system than a single model. However, it is known that research groups share literature, ideas for representations of processes, parameterisations, evaluation data sets and even sections of model code. Thus, nominally different models might have similar biases because of similarities in the way they represent a subset of processes, or even be near-duplicates of others, weakening the assumption that they constitute independent estimates. If there are near-replicates of some models, then treating all models equally is likely to bias the inferences made using these ensembles. The challenge is to establish the degree to which this might be true for any given application. While this issue is recognised by many in the community, quantifying and accounting for model dependence in anything other than an ad-hoc way is challenging. Here we present a synthesis of the range of disparate attempts to define, quantify and address model dependence in multi-model climate ensembles in a common conceptual framework, and provide guidance on how users can test the efficacy of approaches that move beyond the equally weighted ensemble. In the upcoming Coupled Model Intercomparison Project phase 6 (CMIP6), several new models that are closely related to existing models are anticipated, as well as large ensembles from some models. We argue that quantitatively accounting for dependence in addition to model performance, and thoroughly testing the effectiveness of the approach used will be key to a sound interpretation of the CMIP ensembles in future scientific studies.

Abramowitz, Gab↗
DOE OSTI2024

A multi-model assessment of the early last deglaciation (PMIP4 LDv1): a meltwater perspective

Abstract. The last deglaciation (∼20–11 ka BP) is a period of a major, long-term climate transition from a glacial to interglacial state that features multiple centennial- to decadal-scale abrupt climate variations whose root cause is still not fully understood. To better understand this time period, the Paleoclimate Modelling Intercomparison Project (PMIP) has provided a framework for an internationally coordinated endeavour in simulating the last deglaciation whilst encompassing a broad range of models. Here, we present a multi-model intercomparison of 17 transient simulations of the early part of the last deglaciation (∼20–15 ka BP) from nine different climate models spanning a range of model complexities and uncertain boundary conditions and forcings. The numerous simulations available provide the opportunity to better understand the chain of events and mechanisms of climate changes between 20 and 15 ka BP and our collective ability to simulate them. We conclude that the amount of freshwater forcing and whether it follows the ice sheet reconstruction or induces an inferred Atlantic meridional overturning circulation (AMOC) history, heavily impacts the deglacial climate evolution for each simulation rather than differences in the model physics. The course of the deglaciation is consistent between simulations except when the freshwater forcing is above 0.1 Sv – at least 70 % of the simulations agree that there is warming by 15 ka BP in most places excluding the location of meltwater input. For simulations with freshwater forcings that exceed 0.1 Sv from 18 ka BP, warming is delayed in the North Atlantic and surface air temperature correlations with AMOC strength are much higher. However, we find that the state of the AMOC coming out of the Last Glacial Maximum (LGM) also plays a key role in the AMOC sensitivity to model forcings. In addition, we show that the response of each model to the chosen meltwater scenario depends largely on the sensitivity of the model to the freshwater forcing and other aspects of the experimental design (e.g. CO2 forcing or ice sheet reconstruction). The results provide insight into the ability of our models to simulate the first part of the deglaciation and how choices between uncertain boundary conditions and forcings, with a focus on freshwater fluxes, can impact model outputs. We can use these findings as helpful insight in the design of future simulations of this time period.

Snoll, Brooke (ORCID:0000000230914394)↗
NASA NTRS2013

Using Paleo-climate Comparisons to Constrain Future Projections in CMIP5

We present a description of the theoretical framework and best practice for using the paleo-climate model component of the Coupled Model Intercomparison Project (Phase 5) (CMIP5) to constrain future projections of climate using the same models. The constraints arise from measures of skill in hindcasting paleo-climate changes from the present over 3 periods: the Last Glacial Maximum (LGM) (21 thousand years before present, ka), the mid-Holocene (MH) (6 ka) and the Last Millennium (LM) (8501850 CE). The skill measures may be used to validate robust patterns of climate change across scenarios or to distinguish between models that have differing outcomes in future scenarios. We find that the multi-model ensemble of paleo-simulations is adequate for addressing at least some of these issues. For example, selected benchmarks for the LGM and MH are correlated to the rank of future projections of precipitationtemperature or sea ice extent to indicate that models that produce the best agreement with paleoclimate information give demonstrably different future results than the rest of the models. We also find that some comparisons, for instance associated with model variability, are strongly dependent on uncertain forcing timeseries, or show time dependent behaviour, making direct inferences for the future problematic. Overall, we demonstrate that there is a strong potential for the paleo-climate simulations to help inform the future projections and urge all the modeling groups to complete this subset of the CMIP5 runs.

paleoclimate↗
NASA NTRS2014

A Practical Philosophy of Complex Climate Modelling

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project (CMIP).We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naive predictions. The framework we use for making inferences about reality using simulations is naturally Bayesian (in an informal sense), and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work.

complex simulation↗
NASA NTRS2019

The Southern Ocean Sea Surface Temperature Response to Ozone Depletion: A Multi-Model Comparison

The effect of the Antarctic ozone hole extends downwards from the stratosphere, with clear signatures in surface weather patterns including a positive trend in the Southern Annular Mode (SAM). Several recent studies have used coupled climate models to investigate the impact of these changes on Southern Ocean sea surface temperature (SST), notably motivated by the observed cooling from the late 1970s. Here we examine the robustness of these model results through comparison of both previously published and new simulations. We focus on the calculation of ‘climate response functions' (CRFs), transient responses to an instantaneous step-change in ozone concentrations. The CRF for most models consists of a rapid cooling of SST, followed by a slower warming trend. However, inter-model comparison reveals large uncertainties, such that even the sign of the impact of ozone depletion on historical SST, when reconstructed from the CRF, remains unconstrained. Comparison of these CRFs with SST responses to a hypothetical step-change in the SAM, inferred through lagged linear regression, shows broadly similar results. Causes of uncertainty are explored by examining relationships between model climatologies and their CRFs. The inter-model spread in CRFs can be reproduced by varying a single subgrid-scale mixing parameter within a single model. Antarctic sea-ice CRFs are also calculated: these do not generally exhibit the two-time-scale behavior of SST, suggesting a complex relationship between the two. Finally, by constraining model climatology-response relationships with observational values, we conclude that ozone depletion in unlikely to have been the primary driver of the observed SST cooling trend.

Climate response functions (CRF)↗
NASA NTRS2021

AeroCom Phase III Multi-Model Evaluation of the Aerosol Life Cycle and Optical Properties Using Ground and Space-Based Remote Sensing as Well as Surface In Situ Observations

Within the framework of the AeroCom (Aerosol Comparisons between Observations and Models) initiative, the state-of-the-art modelling of aerosol optical properties is assessed from 14 global models participating in the phase III control experiment (AP3). The models are similar to CMIP6/AerChemMIP Earth System Models (ESMs) and provide a robust multi-model ensemble. Inter-model spread of aerosol species lifetimes and emissions appears to be similar to that of mass extinction coefficients (MECs), suggesting that aerosol optical depth (AOD) uncertainties are associated with a broad spectrum of parameterised aerosol processes. Total AOD is approximately the same as in AeroCom phase I (AP1) simulations. However, we find a 50 % decrease in the optical depth (OD) of black carbon (BC), attributable to a combination of decreased emissions and lifetimes. Relative contributions from sea salt (SS) and dust (DU) have shifted from being approximately equal in AP1 to SS contributing about 2∕3 of the natural AOD in AP3. This shift is linked with a decrease in DU mass burden, a lower DU MEC, and a slight decrease in DU lifetime, suggesting coarser DU particle sizes in AP3 compared to AP1. Relative to observations, the AP3 ensemble median and most of the participating models underestimate all aerosol optical properties investigated, that is, total AOD as well as fine and coarse AOD (AODf, AODc), Ångström exponent (AE), dry surface scattering (SCdry), and absorption (ACdry) coefficients. Compared to AERONET, the models underestimate total AOD by ca. 21 % ± 20 % (as inferred from the ensemble median and interquartile range). Against satellite data, the ensemble AOD biases range from −37 % (MODIS-Terra) to −16 % (MERGED-FMI, a multi-satellite AOD product), which we explain by differences between individual satellites and AERONET measurements themselves. Correlation coefficients (R) between model and observation AOD records are generally high (R>0.75), suggesting that the models are capable of capturing spatio-temporal variations in AOD. We find a much larger underestimate in coarse AODc (∼ −45 % ± 25 %) than in fine AODf (∼ −15 % ± 25 %) with slightly increased inter-model spread compared to total AOD. These results indicate problems in the modelling of DU and SS. The AODc bias is likely due to missing DU over continental land masses (particularly over the United States, SE Asia, and S. America), while marine AERONET sites and the AATSR SU satellite data suggest more moderate oceanic biases in AODc. Column AEs are underestimated by about 10 % ± 16 %. For situations in which measurements show AE > 2, models underestimate AERONET AE by ca. 35 %. In contrast, all models (but one) exhibit large overestimates in AE when coarse aerosol dominates (bias ca. +140 % if observed AE < 0.5). Simulated AE does not span the observed AE variability. These results indicate that models overestimate particle size (or underestimate the fine-mode fraction) for fine-dominated aerosol and underestimate size (or overestimate the fine-mode fraction) for coarse-dominated aerosol. This must have implications for lifetime, water uptake, scattering enhancement, and the aerosol radiative effect, which we can not quantify at this moment. Comparison against Global Atmosphere Watch (GAW) in situ data results in mean bias and inter-model variations of −35 % ± 25 % and −20 % ± 18 % for SCdry and ACdry, respectively. The larger underestimate of SCdry than ACdry suggests the models will simulate an aerosol single scattering albedo that is too low. The larger underestimate of SCdry than ambient air AOD is consistent with recent findings that models overestimate scattering enhancement due to hygroscopic growth. The broadly consistent negative bias in AOD and surface scattering suggests an underestimate of aerosol radiative effects in current global aerosol models. Considerable inter-model diversity in the simulated optical properties is often found in regions that are, unfortunately, not or only sparsely covered by ground-based observations. This includes, for instance, the Sahara, Amazonia, central Australia, and the South Pacific. This highlights the need for a better site coverage in the observations, which would enable us to better assess the models, but also the performance of satellite products in these regions. Using fine-mode AOD as a proxy for present-day aerosol forcing estimates, our results suggest that models underestimate aerosol forcing by ca. −15 %, however, with a considerably large interquartile range, suggesting a spread between −35 % and +10 %.

space-based remote sensing↗
NASA NTRSDate not supplied

Inferred Sea Level Prediction in the NASA GMAO Seasonal Forecasting System

Reliable predictions of sea level anomalies on seasonal timescales with lead times of 1 to 9 months may have relevance to stakeholders – for example, in the advance deployment of resources for coastal flood mitigation. Routine prediction and analysis may also highlight physical processes associated with sea level change and modeling capabilities on seasonal and other timescales. These forecasts may represent interannual changes in the seasonal slope of the ocean surface, teleconnection effects such as the El Niño/Southern Oscillation phenomenon, and variations in seasonal hydrology including precipitation and coastal runoff. Coupled atmosphere/ocean models are routinely used in the seasonal prediction of temperature anomalies, precipitation anomalies, sea ice cover, and climate indices such as the Niño3.4 predictions under the North American Multi-Model Ensemble (NMME) protocol. Within the limits of their configuration, these complex Earth-system models have a potential for depicting regional changes in oceanic column properties, including the sea surface height. Seasonal prediction models generally have no representation of long-term mass contributions from melting land ice, or changes in vertical land motion; their output may be more specifically characterized as predictions of the ocean dynamic sea level. In practice however, the sea surface height prognostic variable is substantially compromised by the forecast model response to initial conditions. Imbalances between the initial, observed hydrologic cycle and the forecast model state produce abrupt adjustments in the model sea surface height. As a result, most seasonal prediction systems employ a constraint on the globally-averaged sea surface height that is applied at each time step. This essentially renders the prognostic sea surface height variable as unserviceable. Several approaches have previously been used to retrieve sea level information from seasonal forecasts beyond the use of the sea surface height variable. Here, we extend a method of relating other prognostic values, including ocean circulation and climate indices, to observed sea level variations. We use the merged altimetry record of the NASA MEaSUREs Gridded Sea Surface Height Anomalies data set and monthly revised local reference gauge observations from the National Oceanography Centre Permanent Service for Mean Sea Level (PSMSL) to evaluate derived prognostic variables from the NASA Global Modeling and Assimilation Office subseasonal-to-seasonal system version 2.1 (GMAO S2S v2.1). We focus on results for the midlatitudes with particular emphasis on US gauge locations. As shown in previous studies, prognostic ENSO-related indices in boreal winter are well correlated with gauge observations for the US west coast, but also for other locations in the southeastern US. Other forecast climate indices such as the North Atlantic Oscillation have relations to sea level that are limited both seasonally and spatially. As expected, surface atmospheric pressure (e.g., inverse barometer effect) is found to be particularly well correlated with observed sea level. We provide a characterization of forecast skill for seasonal sea level with this method.

Richard I Cullather↗
NASA NTRS2023

Observational Constraints Reduce Model Spread but Not Uncertainty in Global Wetland Methane Emission Estimates

The recent rise in atmospheric methane (CH 4 ) concentrations accelerates climate change and offsets mitigation efforts. Although wetlands are the largest natural CH 4 source, estimates of global wetland CH 4 emissions vary widely among approaches taken by bottom-up (BU) process-based biogeochemical models and top-down (TD) atmospheric inversion methods. Here, we integrate in situ measurements, multi-model ensembles, and a machine learning upscaling product into the International Land Model Benchmarking system to examine the relationship between wetland CH 4 emission estimates and model performance. We find that using better-performing models identified by observational constraints reduces the spread of wetland CH 4 emission estimates by 62% and 39% for BU- and TD-based approaches, respectively. However, global BU and TD CH 4 emission estimate discrepancies increased by about 15% (from 31 to 36 TgCH 4 year −1 ) when the top 20% models were used, although we consider this result moderately uncertain given the unevenly distributed global observations. Our analyses demonstrate that model performance ranking is subject to benchmark selection due to large inter-site variability, highlighting the importance of expanding coverage of benchmark sites to diverse environmental conditions. We encourage future development of wetland CH 4 models to move beyond static benchmarking and focus on evaluating site-specific and ecosystem-specific variabilities inferred from observations.

Kuang-Yu Chang↗