Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Assessing probabilistic predictions of ENSO phase and intensity from the North American Multimodel Ensemble

Here we examine the skill of three, five, and seven-category monthly ENSO probability forecasts (1982–2015) from single and multi-model ensemble integrations of the North American Multimodel Ensemble (NMME) project. Three-category forecasts are typical and provide probabilities for the ENSO phase (El Niño, La Niña or neutral). Additional forecast categories indicate the likelihood of ENSO conditions being weak, moderate or strong. The level of skill observed for differing numbers of forecast categories can help to determine the appropriate degree of forecast precision. However, the dependence of the skill score itself on the number of forecast categories must be taken into account. For reliable forecasts with same quality, the ranked probability skill score (RPSS) is fairly insensitive to the number of categories, while the logarithmic skill score (LSS) is an information measure and increases as categories are added. The ignorance skill score decreases to zero as forecast categories are added, regardless of skill level. For all models, forecast formats and skill scores, the northern spring predictability barrier explains much of the dependence of skill on target month and forecast lead. RPSS values for monthly ENSO forecasts show little dependence on the number of categories. However, the LSS of multimodel ensemble forecasts with five and seven categories show statistically significant advantages over the three-category forecasts for the targets and leads that are least affected by the spring predictability barrier. These findings indicate that current prediction systems are capable of providing more detailed probabilistic forecasts of ENSO phase and amplitude than are typically provided.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Multimodel Predictive System for Carbon Dioxide Solubility in Saline Formation Waters

The prediction of carbon dioxide solubility in brine at conditions relevant to carbon sequestration (i.e., high temperature, pressure, and salt concentration (T-P-X)) is crucial when this technology is applied. Eleven mathematical models for predicting CO{sub 2} solubility in brine are compared and considered for inclusion in a multimodel predictive system. Model goodness of fit is evaluated over the temperature range 304–433 K, pressure range 74–500 bar, and salt concentration range 0–7 m (NaCl equivalent), using 173 published CO{sub 2} solubility measurements, particularly selected for those conditions. The performance of each model is assessed using various statistical methods, including the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC). Different models emerge as best fits for different subranges of the input conditions. A classification tree is generated using machine learning methods to predict the best-performing model under different T-P-X subranges, allowing development of a multimodel predictive system (MMoPS) that selects and applies the model expected to yield the most accurate CO{sub 2} solubility prediction. Statistical analysis of the MMoPS predictions, including a stratified 5-fold cross validation, shows that MMoPS outperforms each individual model and increases the overall accuracy of CO{sub 2} solubility prediction across the range of T-P-X conditions likely to be encountered in carbon sequestration applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Spring Onset Predictability in the North American Multimodel Ensemble

Abstract The predictability of spring onset is assessed using an index of its interannual variability (the “extended spring index” or SI‐x) and output from the North American Multimodel Ensemble reforecast experiment. The input data to compute SI‐x were treated with a daily joint bias correction approach, and the SI‐x outputs computed from the North American Multimodel Ensemble were postprocessed using an ensemble model output statistic approach—nonhomogeneous Gaussian regression. This ensemble model output statistic approach was used to quantify the effects of training period length and ensemble size on forecast skill. The lead time for predicting the timing of spring onset is found to be from 10 to 60 days, with the higher end of this range located along a narrow band between 35°N to 45°N in the eastern United States. Using continuous rank probability scores and skill score (SS) thresholds, this study demonstrates that ranges of positive predictability of SI‐x fall into two categories: 10–40 and 40–60 days. Using higher skill thresholds (SS equal to 0.1 and 0.2), predictability is confined to a lower range with values around 10–30 days. The postprocessing work using joint bias correction improves the predictive skill for SI‐x relative to the untreated input data set. Using nonhomogeneous Gaussian regression, a positive change in the SS is noted in regions where the skill with joint bias correction shows evidence of improvement. These findings suggest that the start of spring might be predictable on intraseasonal time horizons, which in turn could be useful for farmers, growers, and stakeholders making decisions on these time scales.

Carrillo, Carlos M.↗
DOE OSTI2024

Predicting September Arctic Sea Ice: A Multimodel Seasonal Skill Comparison

This study quantifies the state of the art in the rapidly growing field of seasonal Arctic sea ice prediction. A novel multimodel dataset of retrospective seasonal predictions of September Arctic sea ice is created and analyzed, consisting of community contributions from 17 statistical models and 17 dynamical models. Prediction skill is compared over the period 2001–20 for predictions of pan-Arctic sea ice extent (SIE), regional SIE, and local sea ice concentration (SIC) initialized on 1 June, 1 July, 1 August, and 1 September. This diverse set of statistical and dynamical models can individually predict linearly detrended pan-Arctic SIE anomalies with skill, and a multimodel median prediction has correlation coefficients of 0.79, 0.86, 0.92, and 0.99 at these respective initialization times. Regional SIE predictions have similar skill to pan-Arctic predictions in the Alaskan and Siberian regions, whereas regional skill is lower in the Canadian, Atlantic, and central Arctic sectors. The skill of dynamical and statistical models is generally comparable for pan-Arctic SIE, whereas dynamical models outperform their statistical counterparts for regional and local predictions. The prediction systems are found to provide the most value added relative to basic reference forecasts in the extreme SIE years of 1996, 2007, and 2012. SIE prediction errors do not show clear trends over time, suggesting that there has been minimal change in inherent sea ice predictability over the satellite era. Overall, this study demonstrates that there are bright prospects for skillful operational predictions of September sea ice at least 3 months in advance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Pooling Data Improves Multimodel IDF Estimates over Median-Based IDF Estimates: Analysis over the Susquehanna and Florida

Traditional multimodel methods for estimating future changes in precipitation intensity, duration, and frequency (IDF) curves rely on mean or median of models’ IDF estimates. Such multimodel estimates are impaired by large estimation uncertainty, shadowing their efficacy in planning efforts. Here, assuming that each climate model is one representation of the underlying data generating process, i.e., the Earth system, we propose a novel extension of current methods through pooling model data: (i) evaluate performance of climate models in simulating the spatial and temporal variability of the observed annual maximum precipitation (AMP), (ii) bias-correct and pool historical and future AMP data of reasonably performing models, and (iii) compute IDF estimates in a nonstationary framework from pooled historical and future model data. Pooling enhances fitting of the extreme value distribution to the data and assumes that data from reasonably performing models represent samples from the “true” underlying data generating distribution. Through Monte Carlo simulations with synthetic data, we show that return periods derived from pooled data have smaller biases and lesser uncertainty than those derived from ensembles of individual model data. We apply this method to NA-CORDEX models to estimate changes in 24-h precipitation intensity–frequency (PIF) estimates over the Susquehanna watershed and Florida peninsula. Our approach identifies significant future changes at more stations compared to median-based PIF estimates. The analysis suggests that almost all stations over the Susquehanna and at least two-thirds of the stations over the Florida peninsula will observe significant increases in 24-h precipitation for 2–100-yr return periods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2013

A Multimodel Assessment of the Influence of Regional Anthropogenic Emission Reductions on Aerosol Direct Radiative Forcing and the Role of Intercontinental Transport

In this study, we assess changes of aerosol optical depth (AOD) and direct radiative forcing (DRF) in response to the reduction of anthropogenic emissions in four major pollution regions in the Northern Hemisphere by using results from nine global models in the framework of the Hemispheric Transport of Air Pollution (HTAP). DRF at top of atmosphere (TOA) and surface is estimated based on AOD results from the HTAP models and AOD-normalized DRF (NDRF) from a chemical transport model. The multimodel results show that, on average, a 20% reduction of anthropogenic emissions in North America, Europe, East Asia, and South Asia lowers the global mean AOD (all-sky TOA DRF) by 9.2% (9.0%), 3.5% (3.0%), and 9.4% (10.0%) for sulfate, particulate organic matter (POM), and black carbon (BC), respectively. Global annual average TOA all-sky forcing efficiency relative to particle or gaseous precursor emissions from the four regions (expressed as multimodel mean +/- one standard deviation) is -3.5 +/-0.8, -4.0 +/- 1.7, and 29.5+/-18.1mW / sq m per Tg for sulfate (relative to SO2), POM, and BC, respectively. The impacts of the regional emission reductions on AOD and DRF extend well beyond the source regions because of intercontinental transport (ICT). On an annual basis, ICT accounts for 11 +/- 5% to 31 +/- 9% of AOD and DRF in a receptor region at continental or subcontinental scale, with domestic emissions accounting for the remainder, depending on regions and species. For sulfate AOD, the largest ICT contribution of 31 +/- 9% occurs in South Asia, which is dominated by the emissions from Europe. For BC AOD, the largest ICT contribution of 28 +/- 18% occurs in North America, which is dominated by the emissions from East Asia. The large spreads among models highlight the need to improve aerosol processes in models, and evaluate and constrain models with observations.

Europe↗
NASA NTRS2017

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗
DOE OSTI2020

Imprecise global sensitivity analysis using bayesian multimodel inference and importance sampling

Global Sensitivity Analysis (GSA) aims to understand the relative importance of uncertain input variables to model response. Conventional GSA involves calculating sensitivity (Sobol’) indices for a model with known model parameter distributions. However, model parameters are affected by aleatory and epistemic uncertainty, with the latter often caused by lack of data. In this paper, we propose a new framework to quantify uncertainty in probability model-form and model parameters resulting from small datasets and integrate these uncertainties into Sobol’ index estimates. First, the process establishes, through Bayesian multimodel inference, a set of candidate probability models and their associated probabilities. Imprecise Sobol’ indices are calculated from these probability models using an importance sampling reweighting approach. This results in probabilistic Sobol’ indices, whose distribution characterizes uncertainty in the sensitivity resulting from small dataset size. The imprecise Sobol’ indices thus provide a measure of confidence in the sensitivity estimate and, moreover, can be used to inform data collection efforts targeted to minimize the impact of uncertainties. Through an example studying the parameters of a Timoshenko beam, we show that these probabilistic Sobol’ indices converge to the true/deterministic Sobol’ indices as the dataset size increases and hence, distribution-form uncertainty reduces. The approach is then applied to assess the sensitivity of the out-of-plane properties of an E-glass fiber composite material to its constituent properties. This second example illustrates the approach for an important class of materials with wide-ranging applications when data may be lacking for some input parameters.

42 ENGINEERING↗
DOE OSTI2017

Deterministic skill of ENSO predictions from the North American Multimodel Ensemble

Hindcasts and real-time predictions of the east-central tropical Pacific sea surface temperature (SST) from the North American Multimodel Ensemble (NMME) system are verified for 1982–2015. Skill is examined using two deterministic verification measures: mean squared error skill score (MSESS) and anomaly correlation. Verification of eight individual models shows somewhat differing skills among them, with some models consistently producing more successful predictions than others. The skill levels of MME predictions are approximately the same as the two best performing individual models, and sometimes exceed both of them. A decomposition of the MSESS indicates the presence of calibration errors in some of the models. In particular, the amplitudes of some model predictions are too high when predictability is limited by the northern spring ENSO predictability barrier and/or when the interannual variability of the SST is near its seasonal minimum. The skill of the NMME system is compared to that of the MME from the IRI/CPC ENSO prediction plume, both for a comparable hindcast period and also for a set of real-time predictions spanning 2002–2011. Comparisons are made both between the MME predictions of each model group, and between the average of the skills of the respective individual models in each group. Acknowledging a hindcast versus real-time inconsistency in the 2002–2012 skill comparison, the skill of the NMME is slightly higher than that of the prediction plume models in all cases. This result reflects well on the NMME system, with its large total ensemble size and opportunity for possible complementary contributions to skill.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Bundling measures for food systems transformation: a global, multimodel assessment

Background Current food systems leave one in ten individuals at risk of hunger while driving unsustainable environmental impacts. Inaction risks further exacerbating negative impacts on both human and planetary health. These challenges emerge from complex system interactions, requiring approaches that engage with this complexity and consider how transformation measures interact across food systems. We aimed to quantify the magnitude and uncertainty of the impacts of key food systems transformation measures both individually and in a bundle using an ensemble of global economic models. Methods In this global multimodel assessment, we applied an ensemble of ten state-of-the-art global economic models to evaluate the potential of four key measures in transforming food systems: increasing agricultural productivity, halving food loss and waste, shifting towards healthier diets, and economy-wide climate mitigation policies aligned with limiting warming to 1·5°C. The scenarios used a middle-of-the-road shared socioeconomic pathway for population and gross domestic product growth, climate impact data from Jägermeyr and colleagues, Thornton and colleagues, and Nelson and colleagues, and dietary targets based on the EAT–Lancet healthy reference diet, with model simulations conducted from 2020 to 2050. We then assessed the effect of these measures in isolation and in combination in a bundled scenario. To further understand the interactions between these measures, we conducted a decomposition analysis that distinguishes between the individual effects of a measure (effect when implemented alone), total effects (its contribution within the bundle), and interaction effects (the difference between total and individual effects). This approach aimed to show complementarities and trade-offs that emerge when multiple measures are implemented simultaneously. Findings Our analysis showed that individual measures in isolation are insufficient to achieve high-level environmental objectives and might generate unintended consequences. In contrast, bundling measures produces co-benefits: avoiding 50% of projected agricultural greenhouse gas emissions by 2050 and almost 20% of anticipated land conversion, while moderating food price increases associated with ambitious climate change mitigation policies. Our decomposition analysis further shows that measures can have varying effects across different dimensions. Although dietary shifts and climate mitigation policies are the largest drivers of environmental benefits (each contributing to a median decline of >10 percentage points in non-CO 2 emissions and 5 percentage points in agricultural land use globally), productivity improvements and reducing food loss and waste play essential roles in moderating price increases (each contributing to a median decline of >5 percentage points in average prices). Interpretation This study highlights the importance of implementing coordinated approaches to food system transformation and climate change mitigation rather than relying on isolated interventions. Comprehensive transformation requires understanding how supply-side and demand-side changes can interact with climate mitigation policies, enabling policy makers to design intervention packages that maximise benefits while minimising trade-offs across environmental, economic, and social dimensions.

Sundiang, Marina [Cornell Univ., Ithaca, NY (Unite↗
DOE OSTI2020

Projected Future Changes in Tropical Cyclones Using the CMIP6 HighResMIP Multimodel Ensemble

Future changes in tropical cyclone properties are an important component of climate change impacts and risk for many tropical and midlatitude countries. In this study we assess the performance of a multimodel ensemble of climate models, at resolutions ranging from 250 to 25 km. We use a common experimental design including both atmosphere-only and coupled simulations run over the period 1950–2050, with two tracking algorithms applied uniformly across the models. There are overall improvements in tropical cyclone frequency, spatial distribution, and intensity in models at 25 km resolution, with several of them able to represent very intense storms. Projected tropical cyclone activity by 2050 generally declines in the South Indian Ocean, while changes in other ocean basins are more uncertain and sensitive to both tracking algorithm and imposed forcings. Coupled models with smaller biases suggest a slight increase in average TC 10 m wind speeds by 2050.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Impact of Model Resolution on Tropical Cyclone Simulation Using the HighResMIP–PRIMAVERA Multimodel Ensemble

A multimodel, multiresolution set of simulations over the period 1950–2014 using a common forcing protocol from CMIP6 HighResMIP have been completed by six modeling groups. Analysis of tropical cyclone performance using two different tracking algorithms suggests that enhanced resolution toward 25 km typically leads to more frequent and stronger tropical cyclones, together with improvements in spatial distribution and storm structure. Both of these factors reduce typical GCM biases seen at lower resolution. Using single ensemble members of each model, there is little evidence of systematic improvement in interannual variability in either storm frequency or accumulated cyclone energy as compared with observations when resolution is increased. Changes in the relationships between large-scale drivers of climate variability and tropical cyclone variability in the Atlantic Ocean are also not robust to model resolution. However, using a larger ensemble of simulations (of up to 14 members) with one model at different resolutions does show evidence of increased skill at higher resolution. The ensemble mean correlation of Atlantic interannual tropical cyclone variability increases from ~0.5 to ~0.65 when resolution increases from 250 to 100 km. In the northwestern Pacific Ocean the skill keeps increasing with 50-km resolution to 0.7. These calculations also suggest that more than six members are required to adequately distinguish the impact of resolution within the forced signal from the weather noise.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

PCMS: Parallel Coupler For Multimodel Simulations

This paper presents the Parallel Coupler for Multimodel Simulations (PCMS), a new GPU accelerated generalized coupling framework for coupling simulation codes on leadership class supercomputers. PCMS includes distributed control and field mapping methods for up to five dimensions. For field mapping PCMS can utilize discretization and field information to accommodate physics constraints. PCMS is demonstrated with a coupling of the gyrokinetic microturbulence code XGC with a Monte Carlo neutral transport code DEGAS2 and with a 5D distribution function coupling of an energetic particle transport code (GNET) to a gyrokinetic microturbulence code (GTC). Weak scaling is also demonstrated on up to 2,080 GPUs of Frontier with a weak scaling efficiency of 85%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2015

Multimodel Ensembles of Wheat Growth: More Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

wheat↗
NASA NTRS2015

Multimodel Ensembles of Wheat Growth: Many Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop model scan give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 2438 for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

model intercomparison↗
NASA NTRS2016

An Assessment of Multimodel Simulations for the Variability of Western North Pacific Tropical Cyclones and Its Association with ENSO

An assessment of simulations of the interannual variability of tropical cyclones (TCs) over the western North Pacific (WNP) and its association with El Niño-Southern Oscillation (ENSO), as well as a subsequent diagnosis for possible causes of model biases generated from simulated large-scale climate conditions, are documented in the paper. The model experiments are carried out by the Hurricane Work Group under the U.S. Climate Variability and Predictability Research Program (CLIVAR) using five global climate models (GCMs) with a total of 16 ensemble members forced by the observed sea surface temperature and spanning the 28-yr period from 1982 to 2009. The results show GISS and GFDL model ensemble means best simulate the interannual variability of TCs, and the multimodel ensemble mean (MME) follows. Also, the MME has the closest climate mean annual number of WNP TCs and the smallest root-mean-square error to the observation. Most GCMs can simulate the interannual variability of WNP TCs well, with stronger TC activities during two types of El Niño-namely, eastern Pacific (EP) and central Pacific (CP) El Niño-and weaker activity during La Niña. However, none of the models capture the differences in TC activity between EP and CP El Niño as are shown in observations. The inability of models to distinguish the differences in TC activities between the two types of El Niño events may be due to the bias of the models in response to the shift of tropical heating associated with CP El Niño.

climate models↗
DOE OSTI2022

Multimodel ensemble predictions of precipitation using bayesian neural networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗