Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multi-Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A Practical Philosophy of Complex Climate Modelling

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project (CMIP).We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naive predictions. The framework we use for making inferences about reality using simulations is naturally Bayesian (in an informal sense), and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work.

complex simulation↗

The ENSO Effects on Tropical Clouds and Top-of-Atmosphere Cloud Radiative Effects in CMIP5 Models

The El Nino-Southern Oscillation (ENSO) effects on tropical clouds and top-of-atmosphere (TOA) cloud radiative effects (CREs) in Coupled Model Intercomparison Project Phase5 (CMIP5) models are evaluated using satellite-based observations and International Satellite Cloud Climatology Project satellite simulator output. Climatologically, most CMIP5 models produce considerably less total cloud amount with higher cloud top and notably larger reflectivity than observations in tropical Indo-Pacific (60 degrees East - 200 degrees East; 10 degrees South - 10 degrees North). During ENSO, most CMIP5 models considerably underestimate TOA CRE and cloud changes over western tropical Pacific. Over central tropical Pacific, while the multi-model mean resembles observations in TOA CRE and cloud amount anomalies, it notably overestimates cloud top pressure (CTP) decreases; there are also substantial inter-model variations. The relative effects of changes in cloud properties, temperature and humidity on TOA CRE anomalies during ENSO in the CMIP5 models are assessed using cloud radiative kernels. The CMIP5 models agree with observations in that their TOA shortwave CRE anomalies are primarily contributed by total cloud amount changes, and their TOA longwave CRE anomalies are mostly contributed by changes in both total cloud amount and CTP. The model biases in TOA CRE anomalies particularly the strong underestimations over western tropical Pacific are, however, mainly explained by model biases in CTP and cloud optical thickness (tau) changes. Despite the distinct model cloud biases particularly in tau regime, the TOA CRE anomalies from cloud amount changes are comparable between the CMIP5 models and observations, because of the strong compensations between model underestimation of TOA CRE anomalies from thin clouds and overestimation from medium and thick clouds.

Su, Wenying↗

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗

Assessment of Arctic and Antarctic Sea Ice Predictability in CMIP5 Decadal Hindcasts

This paper examines the ability of coupled global climate models to predict decadal variability of Arctic and Antarctic sea ice. We analyze decadal hindcasts/predictions of 11 Coupled Model Intercomparison Project Phase 5 (CMIP5) models. Decadal hindcasts exhibit a large multimodel spread in the simulated sea ice extent, with some models deviating significantly from the observations as the predicted ice extent quickly drifts away from the initial constraint. The anomaly correlation analysis between the decadal hindcast and observed sea ice suggests that in the Arctic, for most models, the areas showing significant predictive skill become broader associated with increasing lead times. This area expansion is largely because nearly all the models are capable of predicting the observed decreasing Arctic sea ice cover. Sea ice extent in the North Pacific has better predictive skill than that in the North Atlantic (particularly at a lead time of 3-7 years), but there is a reemerging predictive skill in the North Atlantic at a lead time of 6-8 years. In contrast to the Arctic, Antarctic sea ice decadal hindcasts do not show broad predictive skill at any timescales, and there is no obvious improvement linking the areal extent of significant predictive skill to lead time increase. This might be because nearly all the models predict a retreating Antarctic sea ice cover, opposite to the observations. For the Arctic, the predictive skill of the multi-model ensemble mean outperforms most models and the persistence prediction at longer timescales, which is not the case for the Antarctic. Overall, for the Arctic, initialized decadal hindcasts show improved predictive skill compared to uninitialized simulations, although this improvement is not present in the Antarctic.

sea ice↗

Assessing Inter-Sectoral Climate Change Risks: The Role of ISIMIP

The aims of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP) are to provide a framework for the intercomparison of global and regional-scale risk models within and across multiple sectors and to enable coordinated multi-sectoral assessments of different risks and their aggregated effects. The overarching goal is to use the knowledge gained to support adaptation and mitigation decisions that require regional or global perspectives within the context of facilitating transformations to enable sustainable development, despite inevitable climate shifts and disruptions. ISIMIP uses community-agreed sets of scenarios with standardized climate variables and socioeconomic projections as inputs for projecting future risks and associated uncertainties, within and across sectors. The results are consistent multi-model assessments of sectoral risks and opportunities that enable studies that integrate across sectors, providing support for implementation of the Paris Agreement under the United Nations Framework Convention on Climate Change.

Regional-scale risk models↗

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗

Water Scarcity Hotspots Travel Downstream Due to Human Interventions in the 20th and 21st Century

Water scarcity is rapidly increasing in many regions. In a novel, multi-model assessment, we examine how human interventions (HI: land use and land cover change, man-made reservoirs and human water use) affected monthly river water availability and water scarcity over the period 1971 - 2010. Here we show that HI drastically change the critical dimensions of water scarcity, aggravating water scarcity for 8.8%(7.4 - 16.5 %) ) of the global population but alleviating it for another 8.3 % (6.4 -15.8 %). Positive impacts of HI mostly occur upstream, whereas HI aggravate water scarcity downstream; HI cause water scarcity to travel downstream. Attribution of water scarcity changes to HI components is complex and varies among the hydrological models. Seasonal variation in impacts and dominant HI components is also substantial. A thorough consideration of the spatially and temporally varying interactions among HI components and of uncertainties is therefore crucial for the success of water scarcity adaptation by HI.

Environmental impact↗

The Critical Role of the Routing Scheme in Simulating Peak River Discharge in Global Hydrological Models

Global hydrological models (GHMs) have been applied to assess global flood hazards, but their capacity to capture the timing and amplitude of peak river discharge which is crucial in flood simulations has traditionally not been the focus of examination. Here we evaluate to what degree the choice of river routing scheme affects simulations of peak discharge and may help to provide better agreement with observations. To this end we use runoff and discharge simulations of nine GHMs forced by observational climate data (1971-2010) within the ISIMIP2a (Inter-Sectoral Impact Model Intercomparison Project phase 2a) project. The runoff simulations were used as input for the global river routing model CaMa-Flood (Catchment-based Macro-scale Floodplain). The simulated daily discharge was compared to the discharge generated by each GHM using its native river routing scheme. For each GHM both versions of simulated discharge were compared to monthly and daily discharge observations from 1701 GRDC (Global Runoff Data Centre) stations as a benchmark. CaMa-Flood routing shows a general reduction of peak river discharge and a delay of about two to three weeks in its occurrence, likely induced by the buffering capacity of floodplain reservoirs. For a majority of river basins, discharge produced by CaMa-Flood resulted in a better agreement with observations. In particular, maximum daily discharge was adjusted, with a multi-model averaged reduction in bias over about two-thirds of the analysed basin area. The increase in agreement was obtained in both managed and near-natural basins. Overall, this study demonstrates the importance of routing scheme choice in peak discharge simulation, where CaMa-Flood routing accounts for floodplain storage and backwater effects that are not represented in most GHMs. Our study provides important hints that an explicit parameterisation of these processes may be essential in future impact studies.

peak river discharge↗

Data Descriptor: A Land Data Assimilation System for Sub-Saharan Africa Food and Water Security Applications

Seasonal agricultural drought monitoring systems, which rely on satellite remote sensing and land surface models (LSMs), are important for disaster risk reduction and famine early warning. These systems require the best available weather inputs, as well as a long-term historical record to contextualize current observations. This article introduces the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS), a custom instance of the NASA Land Information System (LIS) framework. The FLDAS is routinely used to produce multi-model and multi-forcing estimates of hydro-climate states and fluxes over semi-arid, food insecure regions of Africa. These modeled data and derived products, like soil moisture percentiles and water availability, were designed and are currently used to complement FEWSNETs operational remotely sensed rainfall, evapotranspiration, and vegetation observations. The 30+ years of monthly outputs from the FLDAS simulations are publicly available from the NASA Goddard Earth Science Data and Information Services Center (GES DISC) and recommended for use in hydroclimate studies, early warning applications, and by agro-meteorological scientists in Eastern, Southern, and Western Africa.

albedo↗

GEOS-5 Seasonal Forecast System

Ensembles of numerical forecasts based on perturbed initial conditions have long been used to improve estimates of both weather and climate forecasts. The Goddard Earth Observing System (GEOS) Atmosphere-Ocean General Circulation Model, Version 5 (GEOS-5 AOGCM) Seasonal-to-Interannual Forecast System has been used routinely by the GMAO since 2008, the current version since 2012. A coupled reanalysis starting in 1980 provides the initial conditions for the 9 month experimental forecasts. Once a month, sea surface temperature from a suite of 11 ensemble forecasts is contributed to the North American Multi-Model Ensemble (NMME) consensus project, which compares and distributes seasonal forecasts of ENSO events. Since June 2013, GEOS-5 forecasts of the Arctic sea-ice distribution were provided to the Sea-Ice Outlook project. The seasonal forecast output data includes surface fields, atmospheric and ocean fields, as well as sea ice thickness and area, and soil moisture variables. The current paper aims to document the characteristics of the GEOS-5 seasonal forecast system and to highlight forecast biases and skills of selected variables (sea surface temperature, air temperature at 2 m, precipitation and sea ice extent) to be used as a benchmark for the future GMAO seasonal forecast systems and to facilitate comparison with other global seasonal forecast systems.

GEOS-5↗

Refined Use of Satellite Aerosol Optical Depth Snapshots to Constrain Biomass Burning Emissions in the GOCART Model

Simulations of biomass burning (BB) emissions in global chemistry and aerosol transport models depend on external inventories, which provide location and strength of burning aerosol sources. Our previous work (Petrenko et al., 2012) shows that satellite snapshots of aerosol optical depth (AOD) near the emitted smoke plume can be used to constrain model-simulated AOD, and effectively, the assumed source strength. We now refine the satellite-snapshot method and investigate applying simple multiplicative emission correction factors for the widely used Global Fire Emission Database version 3 (GFEDv3) emission inventory can achieve regional-scale consistency between MODIS AOD snapshots and the Goddard Chemistry Aerosol Radiation and Transport (GOCART) model. The model and satellite AOD are compared over a set of more than 900 BB cases observed by the MODIS instrument during the 2004, and 2006-2008 biomass burning seasons. The AOD comparison presented here shows that regional discrepancies between the model and satellite are diverse around the globe yet quite consistent within most ecosystems. Additional analysis of including small fire emission correction shows the complimentary nature of correcting for source strength and adding missing sources, and also indicates that in some regions other factors may be significant in explaining model-satellite discrepancies. This work sets the stage for a larger intercomparison within the Aerosol Inter-comparisons between Observations and Models (AeroCom) multi-model biomass burning experiment. We discuss here some of the other possible factors affecting the remaining discrepancies between model simulations and observations, but await comparisons with other AeroCom models to draw further conclusions.

aerosol optical depth↗

Tropospheric Jet Response to Antarctic Ozone Depletion: An Update with Chemistry-Climate Model Initiative (CCMI) Models

The Southern Hemisphere (SH) zonal-mean circulation change in response to Antarctic ozone depletion is re-visited by examining a set of the latest model simulations archived for the Chemistry-Climate Model Initiative (CCMI) project. All models reasonably well reproduce Antarctic ozone depletion in the late 20th century. The related SH-summer circulation changes, such as a poleward intensification of westerly jet and a poleward expansion of the Hadley cell, are also well captured. All experiments exhibit quantitatively the same multi-model mean trend, irrespective of whether the ocean is coupled or prescribed. Results are also quantitatively similar to those derived from the Coupled Model Intercomparison Project phase 5 (CMIP5) high-top model simulations in which the stratospheric ozone is mostly prescribed with monthly- and zonally-averaged values. These results suggest that the ozone-hole-induced SH-summer circulation changes are robust across the models irrespective of the specific chemistry-atmosphere-ocean coupling.

chemistry-climate models↗

Global Premature Mortality Due to Anthropogenic Outdoor Air Pollution and the Contribution of Past Climate Change

Increased concentrations of ozone and fine particulate matter (PM2.5) since preindustrial times reflect increased emissions, but also contributions of past climate change. Here we use modeled concentrations from an ensemble of chemistry–climate models to estimate the global burden of anthropogenic outdoor air pollution on present-day premature human mortality, and the component of that burden attributable to past climate change. Using simulated concentrations for 2000 and 1850 and concentration–response functions (CRFs), we estimate that, at present, 470 000 (95% confidence interval, 140 000 to 900 000) premature respiratory deaths are associated globally and annually with anthropogenic ozone, and 2.1 (1.3 to 3.0) million deaths with anthropogenic PM2.5-related cardiopulmonary diseases (93%) and lung cancer (7%). These estimates are smaller than ones from previous studies because we use modeled 1850 air pollution rather than a counterfactual low concentration, and because of different emissions. Uncertainty in CRFs contributes more to overall uncertainty than the spread of model results. Mortality attributed to the effects of past climate change on air quality is considerably smaller than the global burden: 1500 (−20 000 to 27 000) deaths yr (exp -1) due to ozone and 2200 (−350 000 to 140 000) due to PM2.5. The small multi-model means are coincidental, as there are larger ranges of results for individual models, reflected in the large uncertainties, with some models suggesting that past climate change has reduced air pollution mortality.

human health↗

Remote Sensing of Evaporation

Evaporation of water from the Earth's surface into the atmosphere is central to the terrestrial energy, water and carbon cycle. Remote sensing approaches to measure evaporation (ET) combine observable inputs to the energy and water balance within statistical or process-based methodologies. These ET products draw on satellite observations from across the electro-magnetic spectrum. The ET retrievals are grouped in two main categories. One category includes approaches that combine meteorological descriptions of potential evaporation with a range of strategies to estimate evaporative stress. A second category includes surface energy balance approaches that retrieve latent heat from the thermal signatures. For each category a practical implementation example is described, including an outlook on progress towards multi-model assessment of global evaporation.

Transpiration↗

An Overview of CMIP5 and CMIP6 Simulated Cloud Ice, Radiation Fields, Surface Wind Stress, Sea Surface Temperatures and Precipitation over Tropical and Subtropical Oceans

The potential links between ice water path (IWP), radiation, circulation, sea surface temperature (SST) and precipitation over the Pacific and Atlantic Oceans resulting from the falling ice radiative effects (FIREs) are examined from present day model outputs of CMIP5 and CMIP6. The latter is divided into two subsets with (SON6) and without FIREs (NOS6) as more models with FIREs are included in CMIP6 than in CMIP5. Improvement in floating cloud ice (~20 g m-2) is noticeable over convective regions in CMIP6 relative to CMIP5. The inclusion of FIREs in SON6 subset may contribute to reduce biases of overestimated outgoing longwave radiation and downward surface shortwave and overestimated reflected shortwave at the top of the atmosphere (TOA) by magnitudes of 4?8 W m-2 over convective regions against CERES, compared to NOS6 subset. The reduced biases in radiative fluxes in convective regions stabilize the atmosphere and lead to circulation, SST, cloud and precipitation changes over the trade-wind regions, as seen from improved radiative fluxes (4?15 W m-2), surface wind stress biases, SST (0.2?0.8 K) and precipitation (1 mm day-1) biases. The significant improvement from NOS6 to SON6 leads to improved multi-model means for CMIP6 relative to CMIP5 for radiation fields over the trade wind regions but the degradation over convective zones is attributed to NOS6 subset. The results suggest that other sources of uncertainty and deficiencies in climate models may play significant roles for reducing discrepancies although FIREs, via radiation-circulation coupling, may be one of the factors that help to reduce regional biases.

Jui-Lin F Li↗

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗

Data from: Coupled machine learning-ecosystem ensemble models substantially improve predictions of nitrous oxide (N 2 O) fluxes from US croplands

Nitrous oxide (N₂O) is a potent and persistent greenhouse gas, with rising atmospheric concentrations driven in part by inefficient use of synthetic nitrogen (N) fertilizers in agriculture. Predicting soil N₂O emissions is challenging due to high spatial and temporal variability arising from complex soil biogeochemical processes. Process-based ecosystem models and standalone machine learning (ML) approaches without extensive site-specific calibration often miss high emission episodes. Here, we show how an Ensemble Modeling System (EMS) based on outputs from an ensemble of ecosystem models coupled to an ensemble of ML models can improve predictions and understanding of N2O fluxes from US cropland. Trained and validated on approximately 12,000 N2O chamber measurements at 17 U.S. Midwest sites (six crops, 35 management practices), the EMS accurately predicted daily fluxes of N2O at both training (R² = 0.84, RMSE = 16.4 g N ha⁻¹ d⁻¹) and held-out testing sites (R² = 0.84, RMSE = 6.2 g N ha⁻¹ d⁻¹). Analyses identified six dominant N₂O drivers: soil organic carbon (SOC), NH₄⁺, NO₃⁻, water-filled pore space (WFPS), soil temperature, and biomass production. Wet, warm soils produced large N₂O peaks only with sufficient SOC and mineral N; in low-SOC soils, fluxes remained low. Incorporating these drivers into process-based models might significantly improve their predictive capacity. The EMS demonstrates a strong potential to predict N₂O fluxes at unseen sites, enabling more reliable regional inventories, improved gap-filling where measurements are sparse, and enhanced understanding of mechanisms to advance targeted mitigation strategies in food, feed, and bioenergy crops.

agricultural sciences↗