SEARCH · Search NASA

Results for “multi-model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2015

The Agricultural Model Intercomparison and Improvement Project: Phase I Activities by a Global Community of Science

The Agricultural Model Intercomparison and Improvement Project (AgMIP) was founded in 2010. Its mission is to improve substantially the characterization of world food security as affected by climate variability and change, and to enhance adaptation capacity in both developing and developed countries. The objectives of AgMIP are to: Incorporate state-of-the-art climate, crop/livestock, and agricultural economic model improvements into coordinated multi-model regional and global assessments of future climate impacts and adaptation and other key aspects of the food system. Utilize multiple models, scenarios, locations, crops/livestock, and participants to explore uncertainty and the impact of data and methodological choices. Collaborate with regional experts in agronomy, animal sciences, economics, and climate to build a strong basis for model applications, addressing key climate related questions and sustainable intensification farming systems. Improve scientific and adaptive capacity in modeling for major agricultural regions in the developing and developed world, with a focus on vulnerable regions. Improve agricultural data and enhance data-sharing based on their intercomparison and evaluation using best scientific practices. Develop modeling frameworks to identify and evaluate promising adaptation technologies and policies and to prioritize strategies.

farm crops↗

NASA NTRS2015

Multi-Model Ensemble Wake Vortex Prediction

Several multi-model ensemble methods are investigated for predicting wake vortex transport and decay. This study is a joint effort between National Aeronautics and Space Administration and Deutsches Zentrum fuer Luft- und Raumfahrt to develop a multi-model ensemble capability using their wake models. An overview of different multi-model ensemble methods and their feasibility for wake applications is presented. The methods include Reliability Ensemble Averaging, Bayesian Model Averaging, and Monte Carlo Simulations. The methodologies are evaluated using data from wake vortex field experiments.

Koerner, Stephan↗

NASA NTRS2015

The ENSO Effects on Tropical Clouds and Top-of-Atmosphere Cloud Radiative Effects in CMIP5 Models

The El Nino-Southern Oscillation (ENSO) effects on tropical clouds and top-of-atmosphere (TOA) cloud radiative effects (CREs) in Coupled Model Intercomparison Project Phase5 (CMIP5) models are evaluated using satellite-based observations and International Satellite Cloud Climatology Project satellite simulator output. Climatologically, most CMIP5 models produce considerably less total cloud amount with higher cloud top and notably larger reflectivity than observations in tropical Indo-Pacific (60 degrees East - 200 degrees East; 10 degrees South - 10 degrees North). During ENSO, most CMIP5 models considerably underestimate TOA CRE and cloud changes over western tropical Pacific. Over central tropical Pacific, while the multi-model mean resembles observations in TOA CRE and cloud amount anomalies, it notably overestimates cloud top pressure (CTP) decreases; there are also substantial inter-model variations. The relative effects of changes in cloud properties, temperature and humidity on TOA CRE anomalies during ENSO in the CMIP5 models are assessed using cloud radiative kernels. The CMIP5 models agree with observations in that their TOA shortwave CRE anomalies are primarily contributed by total cloud amount changes, and their TOA longwave CRE anomalies are mostly contributed by changes in both total cloud amount and CTP. The model biases in TOA CRE anomalies particularly the strong underestimations over western tropical Pacific are, however, mainly explained by model biases in CTP and cloud optical thickness (tau) changes. Despite the distinct model cloud biases particularly in tau regime, the TOA CRE anomalies from cloud amount changes are comparable between the CMIP5 models and observations, because of the strong compensations between model underestimation of TOA CRE anomalies from thin clouds and overestimation from medium and thick clouds.

Su, Wenying↗

NASA NTRS2015

Multi-Model Ensemble Wake Vortex Prediction

Koerner, Stephan↗

NASA NTRS2016

Multi-Wheat-Model Ensemble Responses to Interannual Climate Variability

We compare 27 wheat models' yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981e2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models' climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R2 0.24) was found between the models' sensitivities to interannual temperature variability and their response to long-termwarming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts.

uncertainty↗

NASA NTRS2016

Crop Model Improvement Reduces the Uncertainty of the Response to Temperature of Multi-Model Ensembles

To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT worldwide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures greater than 24 C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.

damage assessment↗

NASA NTRS2016

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗

NASA NTRS2016

Uncertainty of Wheat Water Use: Simulated Patterns and Sensitivity to Temperature and CO2

Projected global warming and population growth will reduce future water availability for agriculture. Thus, it is essential to increase the efficiency in using water to ensure crop productivity. Quantifying crop water use (WU; i.e. actual evapotranspiration) is a critical step towards this goal. Here, sixteen wheat simulation models were used to quantify sources of model uncertainty and to estimate the relative changes and variability between models for simulated WU, water use efficiency (WUE, WU per unit of grain dry mass produced), transpiration efficiency (Teff, transpiration per kg of unit of grain yield dry mass produced), grain yield, crop transpiration and soil evaporation at increased temperatures and elevated atmospheric carbon dioxide concentrations ([CO2]). The greatest uncertainty in simulating water use, potential evapotranspiration, crop transpiration and soil evaporation was due to differences in how crop transpiration was modelled and accounted for 50 of the total variability among models. The simulation results for the sensitivity to temperature indicated that crop WU will decline with increasing temperature due to reduced growing seasons. The uncertainties in simulated crop WU, and in particularly due to uncertainties in simulating crop transpiration, were greater under conditions of increased temperatures and with high temperatures in combination with elevated atmospheric [CO2] concentrations. Hence the simulation of crop WU, and in particularly crop transpiration under higher temperature, needs to be improved and evaluated with field measurements before models can be used to simulate climate change impacts on future crop water demand.

Sensitivity↗

NASA NTRS2016

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗

NASA NTRS2017

The Critical Role of the Routing Scheme in Simulating Peak River Discharge in Global Hydrological Models

Global hydrological models (GHMs) have been applied to assess global flood hazards, but their capacity to capture the timing and amplitude of peak river discharge which is crucial in flood simulations has traditionally not been the focus of examination. Here we evaluate to what degree the choice of river routing scheme affects simulations of peak discharge and may help to provide better agreement with observations. To this end we use runoff and discharge simulations of nine GHMs forced by observational climate data (1971-2010) within the ISIMIP2a (Inter-Sectoral Impact Model Intercomparison Project phase 2a) project. The runoff simulations were used as input for the global river routing model CaMa-Flood (Catchment-based Macro-scale Floodplain). The simulated daily discharge was compared to the discharge generated by each GHM using its native river routing scheme. For each GHM both versions of simulated discharge were compared to monthly and daily discharge observations from 1701 GRDC (Global Runoff Data Centre) stations as a benchmark. CaMa-Flood routing shows a general reduction of peak river discharge and a delay of about two to three weeks in its occurrence, likely induced by the buffering capacity of floodplain reservoirs. For a majority of river basins, discharge produced by CaMa-Flood resulted in a better agreement with observations. In particular, maximum daily discharge was adjusted, with a multi-model averaged reduction in bias over about two-thirds of the analysed basin area. The increase in agreement was obtained in both managed and near-natural basins. Overall, this study demonstrates the importance of routing scheme choice in peak discharge simulation, where CaMa-Flood routing accounts for floodplain storage and backwater effects that are not represented in most GHMs. Our study provides important hints that an explicit parameterisation of these processes may be essential in future impact studies.

peak river discharge↗

NASA NTRS2019

The Subseasonal Experiment (SubX): A Multi-Model Subseasonal Prediction Experiment

SubX is a multi-model subseasonal prediction experiment designed around operational requirements with the goal of improving subseasonal forecasts. Seven global models have produced seventeen years of retrospective (re-) forecasts and more than a year of weekly real-time forecasts. The re-forecasts and forecasts are archived at the Data Library of the International Research Institute for Climate and Society, Columbia University, providing a comprehensive database for research on subseasonal to seasonal predictability and predictions. The SubX models show skill for temperature and precipitation three weeks ahead of time in specific regions. The SubX multi-model ensemble mean is more skillful than any individual model overall. Skill in simulating the Madden-Julian Oscillation (MJO) and the North Atlantic Oscillation (NAO), two sources of subseasonal predictability, is also evaluated with skillful predictions of the MJO four weeks in advance and of the NAO 2 weeks in advance. SubX is also able to make useful contributions to operational forecast guidance at the Climate Prediction Center. Additionally, SubX provides information on the potential for extreme precipitation associated with tropical cyclones which can help emergency management and aid organizations to plan for disasters. (Capsule Summary) A research to operations project in service of developing better operational subseasonal forecasts.

Precipitation↗

NASA NTRS2019

Historical (1700–2012) Global Multi-Model Estimates of the Fire Emissions from the Fire Modeling Intercomparison Project (FireMIP)

Fire emissions are critical for carbon and nutrient cycles, climate, and air quality. Dynamic Global Vegetation Models (DGVMs) with interactive fire modeling provide important estimates for long-term and large-scale changes of fire emissions. Here we present the first multi-model estimates of global gridded historical fire emissions for 1700-2012, including carbon and 33 species of trace gases and aerosols. The dataset is based on simulations of nine DGVMs with different state-of-the-art global fire models that participated in the Fire Modeling Intercomparison Project (FireMIP), using the same and standardized protocols and forcing data, and the most up-to-date fire emission factor table from field and laboratory studies over various land cover types. We evaluate the simulations of present-day fire emissions by comparing them with satellite-based products. Evaluation results show that most DGVMs simulate present-day global fire emission totals within the range of satellite-based products, and can capture the high emissions over the tropical savannas, low emissions over the arid and sparsely vegetated regions, and the main features of seasonality. However, most of the models fail to simulate the interannual variability, partly due to a lack of modeling peat fires and tropical deforestation fires. Historically, all models show only a weak trend in global fire emissions before ~1850s, consistent with multi-source merged historical reconstructions. The long-term trends among DGVMs are quite different for the 20th century, with some models showing an increase and others a decrease in fire emissions, mainly as a result of the discrepancy in their simulated responses to human population density change and land-use and land-cover change (LULCC). Our study provides a basic dataset for developing regional and global multi-source merged historical reconstructions and merging methods, and analyzing historical changes of fire emissions and their uncertainties as well as their role in the Earth system. It also highlights the importance of accurately modeling the responses of fire emissions to LULCC and population density change in reducing uncertainties in historical reconstructions of fire emissions and providing more reliable future projections.

Li, Fang↗

NASA NTRSDate not supplied

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗

NASA NTRS2020

Evaluation of Arctic Warming in Mid-Pliocene Climate Simulations

Palaeoclimate simulations improve our understanding of the climate, inform us about the performance of climate models in a different climate scenario, and help to identify robust features of the climate system. Here, we analyse Arctic warming in an ensemble of 16 simulations of the mid-Pliocene Warm Period (mPWP), derived from the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2). The PlioMIP2 ensemble simulates Arctic (60–90∘ N) annual mean surface air temperature (SAT) increases of 3.7 to 11.6 ∘C compared to the pre-industrial period, with a multi-model mean (MMM) increase of 7.2 ∘C. The Arctic warming amplification ratio relative to global SAT anomalies in the ensemble ranges from 1.8 to 3.1 (MMM is 2.3). Sea ice extent anomalies range from −3.0 to −10.4×106 km2, with a MMM anomaly of −5.6×106 km2, which constitutes a decrease of 53 % compared to the pre-industrial period. The majority (11 out of 16) of models simulate summer sea-ice-free conditions (≤1×106 km2) in their mPWP simulation. The ensemble tends to underestimate SAT in the Arctic when compared to available reconstructions, although the degree of underestimation varies strongly between the simulations. The simulations with the highest Arctic SAT anomalies tend to match the proxy dataset in its current form better. The ensemble shows some agreement with reconstructions of sea ice, particularly with regard to seasonal sea ice. Large uncertainties limit the confidence that can be placed in the findings and the compatibility of the different proxy datasets. We show that while reducing uncertainties in the reconstructions could decrease the SAT data–model discord substantially, further improvements are likely to be found in enhanced boundary conditions or model physics. Lastly, we compare the Arctic warming in the mPWP to projections of future Arctic warming and find that the PlioMIP2 ensemble simulates greater Arctic amplification than CMIP5 future climate simulations and an increase instead of a decrease in Atlantic Meridional Overturning Circulation (AMOC) strength compared to pre-industrial period. The results highlight the importance of slow feedbacks in equilibrium climate simulations, and that caution must be taken when using simulations of the mPWP as an analogue for future climate change.

Palaeoclimate simulations↗

NASA NTRS2021

Placing the East-West North American Aridity Gradient in a Multi-Century Context

Instrumental records indicate a century-long trend towards drying over western North America and wetting over eastern North America. A continuation of these trends into the future would have significant hydroclimatic and socioeconomic consequences in both the semi-arid Southwest and humid East. Using tree-ring reconstructions and hydrologic simulations of summer soil moisture, we evaluate and contextualize the modern summer aridity gradient within its natural range of variability established over the past 600 years and evaluate the effects of observed and anthropogenic precipitation, temperature, and humidity trends. The 2001–2020 positive (wet east-dry west) aridity gradient was larger than any 20-year period since 1400 CE, preceded by the most negative (wet west-dry east) aridity gradient during 1976-1995, leading to a strong multi-decade reversal in aridity gradient anomalies that was rivaled only by a similar event in the late-16th century. The 2001-2020 aridity gradient was dominated by long-term summer precipitation increases in the Midwest and Northeast, with smaller contributions from more warming in the West than the East and spring precipitation decreases in the Southwest. Multi-model mean climate simulations from CMIP6 experiments suggest anthropogenic climate trends should not have strongly affected the aridity gradient thus far. However, there is high uncertainty due to inter-model disagreement on anthropogenic precipitation trends. The recent strengthening of the observed aridity gradient, its increasing dependence on precipitation variability, and disagreement in modeled anthropogenic precipitation trends reveal significant uncertainties in how water resource availability will change across North America in the coming decades.

drought↗

NASA NTRS2022

Investigating Stable Oxygen and Carbon Isotopic Variability in Speleothem Records Over the Last Millennium Using Multiple Isotope-Enabled Climate Models

The incorporation of water isotopologues into the hydrology of general circulation models (GCMs) facilitates the comparison between modeled and measured proxy data in paleoclimate archives. However, the variability and drivers of measured and modeled water isotopologues, as well as the diversity of their representation in different models, are not well constrained. Improving our understanding of this variability in past and present climates will help to better constrain future climate change projections and decrease their range of uncertainty. Speleothems are a precisely datable terrestrial paleoclimate archives and provide well-preserved (semi-)continuous multivariate isotope time series in the lower latitudes and mid-latitudes and are therefore well suited to assess climate and isotope variability on decadal and longer timescales. However, the relationships of speleothem oxygen and carbon isotopes to climate variables are influenced by site-specific parameters, and their comparison to GCMs is not always straightforward. Here we compare speleothem oxygen and carbon isotopic signatures from the Speleothem Isotopes Synthesis and Analysis database version 2 (SISALv2) to the output of five different water-isotope-enabled GCMs (ECHAM5-wiso, GISS-E2-R, iCESM, iHadCM3, and isoGSM) over the last millennium (850–1850 CE). We systematically evaluate differences and commonalities between the standardized model simulation outputs. The goal is to distinguish climatic drivers of variability for modeled isotopes and compare them to those of measured isotopes. We find strong regional differences in the oxygen isotope signatures between models that can partly be attributed to differences in modeled surface temperature. At low latitudes, precipitation amount is the dominant driver for stable water isotope variability; however, at cave locations the agreement between modeled temperature variability is higher than for precipitation variability. While modeled isotopic signatures at cave locations exhibited extreme events coinciding with changes in volcanic and solar forcing, such fingerprints are not apparent in the speleothem isotopes. This may be attributed to the lower temporal resolution of speleothem records compared to the events that are to be detected. Using spectral analysis, we can show that all models underestimate decadal and longer variability compared to speleothems (albeit to varying extents). We found that no model excels in all analyzed comparisons, although some perform better than the others in either mean or variability. Therefore, we advise a multi-model approach whenever comparing proxy data to modeled data. Considering karst and cave internal processes, e.g., through isotope-enabled karst models, may alter the variability in speleothem isotopes and play an important role in determining the most appropriate model. By exploring new ways of analyzing the relationship between the oxygen and carbon isotopes, their variability, and co-variability across timescales, we provide methods that may serve as a baseline for future studies with different models using, e.g., different isotopes, different climate archives, or different time periods.

isotope-enabled simulations↗

NASA NTRS2022

Are Soybean Models Ready for Climate Change Food Impact Assessments?

An accurate estimation of crop yield under climate change scenarios is essential to quantify our ability to feed a growing population and develop agronomic adaptations to meet future food demand. A coordinated evaluation of yield simulations from process-based eco-physiological models for climate change impact assessment is still missing for soybean, the most widely grown grain legume and the main source of protein in our food chain. In this first soybean multi-model study, we used ten prominent models capable of simulating soybean yield under varying temperature and atmospheric CO 2 concentration [CO 2 ] to quantify the uncertainty in soybean yield simulations in response to these factors. Models were first parametrized with high quality measured data from five contrasting environments. We found considerable variability among models in simulated yield responses to increasing temperature and [CO 2 ]. For example, under a + 3 °C temperature rise in our coolest location in Argentina, some models simulated that yield would reduce as much as 24%, while others simulated yield increases up to 29%. In our warmest location in Brazil, the models simulated a yield reduction ranging from a 38% decrease under + 3 °C temperature rise to no effect on yield. Similarly, when increasing [CO 2 ] from 360 to 540 ppm, the models simulated a yield increase that ranged from 6% to 31%. Model calibration did not reduce variability across models but had an unexpected effect on modifying yield responses to temperature for some of the models. The high uncertainty in model responses indicates the limited applicability of individual models for climate change food projections. However, the ensemble mean of simulations across models was an effective tool to reduce the high uncertainty in soybean yield simulations associated with individual models and their parametrization. Ensemble, ensemble mean yield responses to temperature and [CO 2 ] were similar to those reported from the literature. Our study is the first demonstration of the benefits achieved from using an ensemble of grain legume models for climate change food projections, and highlights that further soybean model development with experiments under elevated [CO 2 ] and temperature is needed to reduce the uncertainty from the individual models.

Agricultural Model Inter-comparison and Improvemen↗

NASA NTRSDate not supplied

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗