Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Models and Measurements Intercomparison 2

Models and Measurement Intercomparison II (MM II) summarizes the intercomparison of results from model simulations and observations of stratospheric species. Representatives from twenty-three modeling groups using twenty-nine models participated in these MM II exercises between 1996 and 1999. Twelve of the models were two- dimensional zonal-mean models while seventeen were three-dimensional models. This was an international effort as seven were from outside the United States. Six transport experiments and five chemistry experiments were designed for various models. Models participating in the transport experiments performed simulations of chemically inert tracers providing diagnostics for transport. The chemistry experiments involved simulating the distributions of chemically active trace cases including ozone. The model run conditions for dynamics and chemistry were prescribed in order to minimize the factors that caused differences in the models. The report includes a critical review of the results by the participants and a discussion of the causes of differences between modeled and measured results as well as between results from different models, A sizable effort went into preparation of the database of the observations. This included a new climatology for ozone. The report should help in evaluating the results from various predictive models for assessing humankind perturbations of the stratosphere.

Park, Jae H.↗
NASA NTRS2014

Long-Term Changes in Lower Tropospheric Baseline Ozone Concentrations:

Two recent papers have quantified long-term ozone (O3) changes observed at northernmidlatitude sites that are believed to represent baseline (here understood as representative of continental to hemispheric scales) conditions. Three chemistry-climate models (NCAR CAM-chem, GFDL-CM3, and GISS-E2-R) have calculated retrospective tropospheric O3 concentrations as part of the Atmospheric Chemistry and Climate Model Intercomparison Project and Coupled Model Intercomparison Project Phase 5 model intercomparisons. We present an approach for quantitative comparisons of model results with measurements for seasonally averaged O3 concentrations. There is considerable qualitative agreement between the measurements and the models, but there are also substantial and consistent quantitative disagreements. Most notably, models (1) overestimate absolute O3 mixing ratios, on average by approximately 5 to 17 ppbv in the year 2000, (2) capture only approximately 50% of O3 changes observed over the past five to six decades, and little of observed seasonal differences, and (3) capture approximately 25 to 45% of the rate of change of the long-term changes. These disagreements are significant enough to indicate that only limited confidence can be placed on estimates of present-day radiative forcing of tropospheric O3 derived from modeled historic concentration changes and on predicted future O3 concentrations. Evidently our understanding of tropospheric O3, or the incorporation of chemistry and transport processes into current chemical climate models, is incomplete. Modeled O3 trends approximately parallel estimated trends in anthropogenic emissions of NO(sub x), an important O3 precursor, while measured O3 changes increase more rapidly than these emission estimates.

atmospheric composition↗
NASA NTRS2013

Evaluation of Intercomparisons of Four Different Types of Model Simulating TWP-ICE

Four model intercomparisons were run and evaluated using the TWP-ICE field campaign, each involving different types of atmospheric model. Here we highlight what can be learnt from having single-column model (SCM), cloud-resolving model (CRM), global atmosphere model (GAM) and limited-area model (LAM) intercomparisons all based around the same field campaign. We also make recommendations for anyone planning further large multi-model intercomparisons to ensure they are of maximum value to the model development community. CRMs tended to match observations better than other model types, although there were exceptions such as outgoing long-wave radiation. All SCMs grew large temperature and moisture biases and performed worse than other model types for many diagnostics. The GAMs produced a delayed and significantly reduced peak in domain-average rain rate when compared to the observations. While it was shown that this was in part due to the analysis used to drive these models, the LAMs were also driven by this analysis and did not have the problem to the same extent. Based on differences between the models with parametrized convection (SCMs and GAMs) and those without (CRMs and LAMs), we speculate that that having explicit convection helps to constrain liquid water whereas the ice contents are controlled more by the representation of the microphysics.

convection↗
NASA NTRS2018

The PMIP4 Contribution to CMIP6 - Part 1: Overview and Over-Arching Analysis Plan

This paper is the first of a series of four GMD (Geoscientific Model Development) papers on the PMIP4-CMIP6 (Paleoclimate Modelling Intercomparison Project - Phase 4 -- Coupled Model Intercomparison Project - Phase 6) experiments. Part 2 (Otto-Bliesner et al., 2017) gives details about the two PMIP4-CMIP6 interglacial experiments, Part 3 (Jungclaus et al., 2017) about the last millennium experiment, and Part 4 (Kageyama et al., 2017) about the Last Glacial Maximum experiment. The mid-Pliocene Warm Period experiment is part of the Pliocene Model Intercomparison Project (PlioMIP) - Phase 2, detailed in Haywood et al. (2016). The goal of the Paleoclimate Modelling Intercomparison Project (PMIP) is to understand the response of the climate system to different climate forcings for documented climatic states very different from the present and historical climates. Through comparison with observations of the environmental impact of these climate changes, or with climate reconstructions based on physical, chemical, or biological records, PMIP also addresses the issue of how well state-of-the-art numerical models simulate climate change. Climate models are usually developed using the present and historical climates as references, but climate projections show that future climates will lie well outside these conditions. Palaeoclimates very different from these reference states therefore provide stringent tests for state-of-the-art models and a way to assess whether their sensitivity to forcings is compatible with palaeoclimatic evidence. Simulations of five different periods have been designed to address the objectives of the sixth phase of the Coupled Model Intercomparison Project (CMIP6): the millennium prior to the industrial epoch (CMIP6 name: past1000); the mid-Holocene, 6000 years ago (midHolocene); the Last Glacial Maximum, 21,000 years ago (lgm); the Last Interglacial, 127,000 years ago (lig127k); and the mid-Pliocene Warm Period, 3.2 million years ago (midPliocene-eoi400). These climatic periods are well documented by palaeoclimatic and palaeoenvironmental records, with climate and environmental changes relevant for the study and projection of future climate changes. This paper describes the motivation for the choice of these periods and the design of the numerical experiments and database requests, with a focus on their novel features compared to the experiments performed in previous phases of PMIP and CMIP. It also outlines the analysis plan that takes advantage of the comparisons of the results across periods and across CMIP6 in collaboration with other MIPs.

climate↗
NASA NTRS2002

An Intercomparison of 2-D Models Within a Common Framework

A model intercomparison among the Atmospheric and Environmental Research (AER) 2-D model, the Goddard Space Flight Center (GSFC) 2-D model, and the Lawrence Livermore National Laboratory 2-D model allows us to separate differences due to model transport from those due to the model's chemical formulation. This is accomplished by constructing two hybrid models incorporating the transport parameters of the GSFC and LLNL models within the AER model framework. By comparing the results from the native models (AER and e.g. GSFC) with those from the hybrid model (e.g. AER chemistry with GSFC transport), differences due to chemistry and transport can be identified. For the analysis, we examined an inert tracer whose emission pattern is based on emission from a High Speed Civil Transport (HSCT) fleet; distributions of trace species in the 2015 atmosphere; and the response of stratospheric ozone to an HSCT fleet. Differences in NO(y) in the upper stratosphere are found between models with identical transport, implying different model representations of atmospheric chemical processes. The response of O3 concentration to HSCT aircraft emissions differs in the models from both transport-dominated differences in the HSCT-induced perturbations of H2O and NO(y) as well as from differences in the model represent at ions of O3 chemical processes. The model formulations of cold polar processes are found to be the most significant factor in creating large differences in the calculated ozone perturbations

Weisenstein, Debra K.↗
NASA NTRSDate not supplied

Machine Learning Emulators and Empirical Models Combining Climate and Global Crop Models for Seasonal Agricultural Production

We present results from several connected efforts to apply machine learning methods to estimates of seasonal agricultural production anomalies around the world. First, we apply the XGBoost Random Forest method to fit emulators that mimic global crop models participating in the Agricultural Model Intercomparison and Improvement Project (AgMIP) Global Gridded Crop Model Intercomparison (GGCMI). These are the same models used in the agricultural sector simulations of the Inter-Sectoral Impacts Model Intercomparison Project (ISIMIP). These emulators use 8 climate variables split across 5 sub-seasonal representations of the growing season for each ½ degree grid cell around the world for maize, wheat, rice and soybeans. Emulators are useful for estimating conditions that have not already been simulated by GGCMI (e.g., in a seasonal prediction model) and also to diagnose model differences and capabilities. For example, emulators of the pDSSAT maize model tend to be more reliant on mean temperatures than the LPJmL model, and few models have strong responses to cold extremes. Second, we use a similar XGBoost approach to fit empirical models for national production data for the top 20 producing countries according to the United Nations Food and Agricultural Organization (FAO). Models utilize both climate observations and the GGCM models as predictors, resulting in skillful models for many (but not all) top producing-countries. The patterns of climate and crop model features selected indicate regions and systems that are better or worse simulated by the GGCMs. For example, information in cold extreme predictors is often combined with GGCM output predictors to provide sensitivity that models may underrepresent.

machine learning↗
NASA NTRS2022

Climate Change Penalty and Benefit on Surface Ozone: A Global Perspective Based on CMIP6 Earth System Models

This work presents an analysis of the effect of climate change on surface ozone discussing the related penalties and benefits around the globe from the global modelling perspective based on simulations with five CMIP6 (Coupled Model Intercomparison Project Phase 6) Earth System Models. As part of AerChemMIP (Aerosol Chemistry Model Intercomparison Project) all models conducted simulation experiments considering future climate (ssp370SST) and present-day climate (ssp370pdSST) under the same future emissions trajectory (SSP3-7.0). A multi-model global average climate change benefit on surface ozone of −0.96 ± 0.07 ppbv °C−1 is calculated which is mainly linked to the dominating role of enhanced ozone destruction with higher water vapour abundances under a warmer climate. Over regions remote from pollution sources, there is a robust decline in mean surface ozone concentration on an annual basis as well as for boreal winter and summer varying spatially from −0.2 to −2 ppbv °C−1, with strongest decline over tropical oceanic regions. The implication is that over regions remote from pollution sources (except over the Arctic) there is a consistent climate change benefit for baseline ozone due to global warming. However, ozone increases over regions close to anthropogenic pollution sources or close to enhanced natural biogenic volatile organic compounds emission sources with a rate ranging regionally from 0.2 to 2 ppbv C−1, implying a regional surface ozone penalty due to global warming. Overall, the future climate change enhances the efficiency of precursor emissions to generate surface ozone in polluted regions and thus the magnitude of this effect depends on the regional emission changes considered in this study within the SSP3_7.0 scenario. The comparison of the climate change impact effect on surface ozone versus the combined effect of climate and emission changes indicates the dominant role of precursor emission changes in projecting surface ozone concentrations under future climate change scenarios.

surface ozone↗
NASA NTRS2014

Constraints and Potentials of Future Irrigation Water Availability on Agricultural Production Under Climate Change

Freshwater availability is relevant to almost all socioeconomic and environmental impacts of climate and demographic change and their implications for sustainability. We compare ensembles of water supply and demand projections driven by ensemble output from five global climate models. Our results suggest reasons for concern. Direct climate impacts to maize, soybean, wheat, and rice involve losses of 400–2,600 Pcal (8–43% of present-day total). Freshwater limitations in some heavily irrigated regions could necessitate reversion of 20–60 Mha of cropland from irrigated to rainfed management, and a further loss of 600–2,900 Pcal. Freshwater abundance in other regions could help ameliorate these losses, but substantial investment in infrastructure would be required. We compare ensembles of water supply and demand projections from 10 global hydrological models and six global gridded crop models. These are produced as part of the Inter-Sectoral Impacts Model Intercomparison Project, with coordination from the Agricultural Model Intercomparison and Improvement Project, and driven by outputs of general circulation models run under representative concentration pathway 8.5 as part of the Fifth Coupled Model Intercomparison Project. Models project that direct climate impacts to maize, soybean, wheat, and rice involve losses of 400–1,400 Pcal (8–24% of present-day total) when CO2 fertilization effects are accounted for or 1,400–2,600 Pcal (24–43%) otherwise. Freshwater limitations in some irrigated regions (western United States; China; and West, South, and Central Asia) could necessitate the reversion of 20–60 Mha of cropland from irrigated to rainfed management by end-of-century, and a further loss of 600–2,900 Pcal of food production. In other regions (northern/eastern United States, parts of South America, much of Europe, and South East Asia) surplus water supply could in principle support a net increase in irrigation, although substantial investments in irrigation infrastructure would be required.

agriculture↗
NASA NTRS2023

Comparison of Clouds and Cloud Feedback between AMIP5 and AMIP6

We examine the changes in clouds and cloud feedback between Phase 5 (AMIP5) and Phase 6 (AMIP6) of the Atmospheric Model Intercomparison Project. Each model is perturbed by uniformly increasing the sea surface temperature by 4 K. The simulated cloud fraction, the perturbed states and cloud radiative kernels are used to derive cloud feedback in the shortwave (SW), longwave (LW) and their sum (Net). Compared to AMIP5, the cloud fraction in AMIP6 increases by 9.1%, while the perturbation leads to a 0.25% decrease. The Net cloud feedback at the top of the atmosphere (TOA) is almost double (174%). Statistical tests support that this change is mainly due to an increase in the surface SW cloud feedback caused by optically thick, middle and low clouds. The contribution of the atmospheric Net component (12%) stems from the increase in the atmospheric LW cloud feedback, likely to play a role in weakening (strengthening) the northward (southward) meridional atmospheric energy transport, while the opposite is true for the surface LW and Net cloud feedback in the meridional oceanic energy transport. The substantial increase in cloud feedback at the TOA primarily contributes to the higher climate sensitivity. The cloud feedback spread in AMIP6 is comparable to that in AMIP5.

Clouds↗
NASA NTRS2021

Climate Impacts on Global Agriculture Emerge Earlier in New Generation of Climate and Crop Models

Potential climate-related impacts on future crop yield are a major societal concern. Previous projections of the Agricultural Model Intercomparison and Improvement Project’s Global Gridded Crop Model Intercomparison based on the Coupled Model Intercomparison Project Phase 5 identified substantial climate impacts on all major crops, but associated uncertainties were substantial. Here we report new twenty-first-century projections using ensembles of latest-generation crop and climate models. Results suggest markedly more pessimistic yield responses for maize, soybean and rice compared to the original ensemble. Mean end-of-century maize productivity is shifted from +5% to −6% (SSP126) and from +1% to −24% (SSP585)—explained by warmer climate projections and improved crop model sensitivities. In contrast, wheat shows stronger gains (+9% shifted to +18%, SSP585), linked to higher CO 2 concentrations and expanded high-latitude gains. The ‘emergence’ of climate impacts consistently occurs earlier in the new projections—before 2040 for several main producing regions. While future yield estimates remain uncertain, these results suggest that major breadbasket regions will face distinct anthropogenic climatic risks sooner than previously anticipated.

crop model↗
NASA NTRS2022

Attribution of Stratospheric and Tropospheric Ozone Changes Between 1850 and 2014 in CMIP6 Models

We quantify the impacts of halogenated ozone-depleting substances (ODSs), greenhouse gases (GHGs), and short-lived ozone precursors on ozone changes between 1850 and 2014 using single-forcing perturbation simulations from several Earth system models with interactive chemistry participating in the Coupled Model Intercomparison Project Aerosol and Chemistry Model Intercomparison Project. We present the responses of ozone to individual forcings and an attribution of changes in ozone columns and vertically resolved stratospheric and tropospheric ozone to these forcings. We find that whilst substantial ODS-induced ozone loss dominates the stratospheric ozone changes since the 1970s, in agreement with previous studies, increases in tropospheric ozone due to increases in short-lived ozone precursors and methane since the 1950s make increasingly important contributions to total column ozone (TCO) changes. Increases in methane also lead to substantial extra-tropical stratospheric ozone increases. Impacts of nitrous oxide and carbon dioxide on stratospheric ozone are significant but their impacts on TCO are small overall due to several opposing factors and are also associated with large dynamical variability. The multi-model mean (MMM) results show a clear change in the stratospheric ozone trends after 2000 due to now declining ODSs, but the trends are generally not significantly positive, except in the extra-tropical upper stratosphere, due to relatively small changes in forcing over this period combined with large model uncertainty. Although the MMM ozone compares well with the observations, the inter-model differences are large primarily due to the large differences in the models' representation of ODS-induced ozone depletion.

Halogenated ozone-depleting substances↗
NASA NTRS2000

Predictability of the 1997 and 1998 South Asian Summer Monsoons on the Intraseasonal Time Scale Based on 10 AMIP2 Model Runs

Predictability of the 1997 and 1998 South Asian summer monsoons is examined using National Centers for Environmental Prediction/National Center for Atmospheric Research (NCEP/NCAR) reanalyses, and 100 two-year simulations with ten different Atmospheric General Circulation Models (AGCMs) with prescribed sea surface temperature (SST). We focus on the intraseasonal variations of the south Asian summer monsoon associated with the Madden-Julian Oscillation (MJO). The NCEP/NCAR reanalysis shows a clear coupling between SST anomalies and upper level velocity potential anomalies associated with the MJO. We analyze several MJO events that developed during the 1997 and 1998 focusing of the coupling with the SST. The same analysis is carried out for the model simulations. Remarkably, the ensemble mean of the two-year AGCM simulations show a signature of the observed MJO events. The ensemble mean simulated MJO events are approximately in phase with the observed events, although they are weaker, the period of oscillation is somewhat longer, and their onset is delayed by about ten days compared with the observations. Details of the analysis and comparisons among the ten AMIP2 (Atmospheric Model Intercomparison Project) models will be presented in the conference.

Wu, Man Li C.↗
NASA NTRS2012

A Canonical Response in Rainfall Characteristics to Global Warming: Projections by IPCC CMIP5 Models

Changes in rainfall characteristics induced by global warming are examined based on probability distribution function (PDF) analysis, from outputs of 14 IPCC (Intergovernmental Panel on Climate Change), CMIP (5th Coupled Model Intercomparison Project) models under various scenarios of increased CO2 emissions. Results show that collectively CMIP5 models project a robust and consistent global and regional rainfall response to CO2 warming. Globally, the models show a 1-3% increase in rainfall per degree rise in temperature, with a canonical response featuring large increase (100-250 %) in frequency of occurrence of very heavy rain, a reduction (5-10%) of moderate rain, and an increase (10-15%) of light rain events. Regionally, even though details vary among models, a majority of the models (>10 out of 14) project a consistent large scale response with more heavy rain events in climatologically wet regions, most pronounced in the Pacific ITCZ and the Asian monsoon. Moderate rain events are found to decrease over extensive regions of the subtropical and extratropical oceans, but increases over the extratropical land regions, and the Southern Oceans. The spatial distribution of light rain resembles that of moderate rain, but mostly with opposite polarity. The majority of the models also show increase in the number of dry events (absence or only trace amount of rain) over subtropical and tropical land regions in both hemispheres. These results suggest that rainfall characteristics are changing and that increased extreme rainfall events and droughts occurrences are connected, as a consequent of a global adjustment of the large scale circulation to global warming.

Lau, William K. M.↗
NASA NTRS2015

Conclusion: Major Findings and Future Activities.

The Agricultural Model Intercomparison and Improvement Project (AgMIP) incorporates a number of major advances in the way that climate impacts, vulnerability, and adaptation are being simulated. At its core is a protocol approach that results in impact assessments being more scientifically credible and thus ultimately having greater value to the wide range of agricultural stakeholders. Moreover, the use of the protocol approach enables closer scrutiny and intercomparison of models and methods so that they can be improved over time. By creating a truly trans-disciplinary, systems-based approach, AgMIP impact assessments and evaluation of adaptations become useful to agricultural decision-makers at multiple scales. The chapters in this two-part set demonstrate the use of this approach and represent early steps towards the full realization of these new methods and their application.

damage assessment↗
NASA NTRS2022

Potential Link Between Ice Nucleation and Climate Model Spread in Arctic Amplification

Arctic amplification (AA) is simulated by all global climate models, however the spread in the degree of projected warming is large and the underlying mechanisms driving it are poorly understood. The impact of the temperature dependence of immersion freezing on cloud feedbacks and AA is studied using NASA's GEOS-5 model. Parameterizations that exhibit low ice-nucleating particle (INP) concentrations in the high Arctic during summer are found to weaken the cloud-phase feedback. This allows sunlight to readily melt sea-ice in the summer, which decreases the stability of the lower troposphere, causing a decrease in wintertime cloud fraction over open ocean. Arctic amplification was found to span from ∼1.4 to >2.6, which spans 30% of the spread in AA in the coupled model intercomparison project models, depending on the temperature dependence of immersion freezing. These results suggest that summertime INP concentrations may provide an observational constraint on AA.

Ice Nucleation↗
NASA NTRS2021

The PMIP4 Last Glacial Maximum experiments: preliminary results and comparison with the PMIP3 simulations

The Last Glacial Maximum (LGM, ∼ 21 000 years ago) has been a major focus for evaluating how well state-of-the-art climate models simulate climate changes as large as those expected in the future using paleoclimate reconstructions. A new generation of climate models has been used to generate LGM simulations as part of the Paleoclimate Modelling Intercomparison Project (PMIP) contribution to the Coupled Model Intercomparison Project (CMIP). Here, we provide a preliminary analysis and evaluation of the results of these LGM experiments (PMIP4, most of which are PMIP4-CMIP6) and compare them with the previous generation of simulations (PMIP3, most of which are PMIP3-CMIP5). We show that the global averages of the PMIP4 simulations span a larger range in terms of mean annual surface air temperature and mean annual precipitation compared to the PMIP3-CMIP5 simulations, with some PMIP4 simulations reaching a globally colder and drier state. However, the multi-model global cooling average is similar for the PMIP4 and PMIP3 ensembles, while the multi-model PMIP4 mean annual precipitation average is drier than the PMIP3 one. There are important differences in both atmospheric and oceanic circulations between the two sets of experiments, with the northern and southern jet streams being more poleward and the changes in the Atlantic Meridional Overturning Circulation being less pronounced in the PMIP4-CMIP6 simulations than in the PMIP3-CMIP5 simulations. Changes in simulated precipitation patterns are influenced by both temperature and circulation changes. Differences in simulated climate between individual models remain large. Therefore, although there are differences in the average behaviour across the two ensembles, the new simulation results are not fundamentally different from the PMIP3-CMIP5 results. Evaluation of large-scale climate features, such as land–sea contrast and polar amplification, confirms that the models capture these well and within the uncertainty of the paleoclimate reconstructions. Nevertheless, regional climate changes are less well simulated: the models underestimate extratropical cooling, particularly in winter, and precipitation changes. These results point to the utility of using paleoclimate simulations to understand the mechanisms of climate change and evaluate model performance.

Last Glacial Maximum↗
NASA NTRS2021

Strong Regional Influence of Climatic Forcing Datasets on Global Crop Model Ensembles

We present results from the Agricultural Model Intercomparison and Improvement Project (AgMIP) Global Gridded Crop Model Intercomparison (GGCMI) Phase I, which aligned 14 global gridded crop models (GGCMs) and 11 climatic forcing datasets (CFDs) in order to understand how the selection of climate data affects simulated historical crop productivity of maize, wheat, rice and soybean. Results show that CFDs demonstrate mean biases and differences in the probability of extreme events, with larger uncertainty around extreme precipitation and in regions where observational data for climate and crop systems are scarce. Countries where simulations correlate highly with reported FAO national production anomalies tend to have high correlations across most CFDs, whose influence we isolate using multi-GGCM ensembles for each CFD. Correlations compare favorably with the climate signal detected in other studies, although production in many countries is not primarily climate-limited (particularly for rice). Bias-adjusted CFDs most often were among the highest model-observation correlations, although all CFDs produced the highest correlation in at least one top-producing country. Analysis of larger multi-CFD-multi-GGCM ensembles (up to 91 members) shows benefits over the use of smaller subset of models in some regions and farming systems, although bigger is not always better. Our analysis suggests that global assessments should prioritize ensembles based on multiple crop models over multiple CFDs as long as a top-performing CFD is utilized for the focus region.

Agricultural Model Intercomparison and Improvement↗
NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗