SEARCH · Search NASA

Results for “multi-model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2016

Multi-Wheat-Model Ensemble Responses to Interannual Climate Variability

We compare 27 wheat models' yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981e2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models' climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R2 0.24) was found between the models' sensitivities to interannual temperature variability and their response to long-termwarming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts.

uncertainty↗

NASA NTRS2016

Crop Model Improvement Reduces the Uncertainty of the Response to Temperature of Multi-Model Ensembles

To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT worldwide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures greater than 24 C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.

damage assessment↗

NASA NTRS2016

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗

NASA NTRS2016

Uncertainty of Wheat Water Use: Simulated Patterns and Sensitivity to Temperature and CO2

Projected global warming and population growth will reduce future water availability for agriculture. Thus, it is essential to increase the efficiency in using water to ensure crop productivity. Quantifying crop water use (WU; i.e. actual evapotranspiration) is a critical step towards this goal. Here, sixteen wheat simulation models were used to quantify sources of model uncertainty and to estimate the relative changes and variability between models for simulated WU, water use efficiency (WUE, WU per unit of grain dry mass produced), transpiration efficiency (Teff, transpiration per kg of unit of grain yield dry mass produced), grain yield, crop transpiration and soil evaporation at increased temperatures and elevated atmospheric carbon dioxide concentrations ([CO2]). The greatest uncertainty in simulating water use, potential evapotranspiration, crop transpiration and soil evaporation was due to differences in how crop transpiration was modelled and accounted for 50 of the total variability among models. The simulation results for the sensitivity to temperature indicated that crop WU will decline with increasing temperature due to reduced growing seasons. The uncertainties in simulated crop WU, and in particularly due to uncertainties in simulating crop transpiration, were greater under conditions of increased temperatures and with high temperatures in combination with elevated atmospheric [CO2] concentrations. Hence the simulation of crop WU, and in particularly crop transpiration under higher temperature, needs to be improved and evaluated with field measurements before models can be used to simulate climate change impacts on future crop water demand.

Sensitivity↗

NASA NTRS2016

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗

NASA NTRS2017

The Critical Role of the Routing Scheme in Simulating Peak River Discharge in Global Hydrological Models

Global hydrological models (GHMs) have been applied to assess global flood hazards, but their capacity to capture the timing and amplitude of peak river discharge which is crucial in flood simulations has traditionally not been the focus of examination. Here we evaluate to what degree the choice of river routing scheme affects simulations of peak discharge and may help to provide better agreement with observations. To this end we use runoff and discharge simulations of nine GHMs forced by observational climate data (1971-2010) within the ISIMIP2a (Inter-Sectoral Impact Model Intercomparison Project phase 2a) project. The runoff simulations were used as input for the global river routing model CaMa-Flood (Catchment-based Macro-scale Floodplain). The simulated daily discharge was compared to the discharge generated by each GHM using its native river routing scheme. For each GHM both versions of simulated discharge were compared to monthly and daily discharge observations from 1701 GRDC (Global Runoff Data Centre) stations as a benchmark. CaMa-Flood routing shows a general reduction of peak river discharge and a delay of about two to three weeks in its occurrence, likely induced by the buffering capacity of floodplain reservoirs. For a majority of river basins, discharge produced by CaMa-Flood resulted in a better agreement with observations. In particular, maximum daily discharge was adjusted, with a multi-model averaged reduction in bias over about two-thirds of the analysed basin area. The increase in agreement was obtained in both managed and near-natural basins. Overall, this study demonstrates the importance of routing scheme choice in peak discharge simulation, where CaMa-Flood routing accounts for floodplain storage and backwater effects that are not represented in most GHMs. Our study provides important hints that an explicit parameterisation of these processes may be essential in future impact studies.

peak river discharge↗

NASA NTRS2019

The Subseasonal Experiment (SubX): A Multi-Model Subseasonal Prediction Experiment

SubX is a multi-model subseasonal prediction experiment designed around operational requirements with the goal of improving subseasonal forecasts. Seven global models have produced seventeen years of retrospective (re-) forecasts and more than a year of weekly real-time forecasts. The re-forecasts and forecasts are archived at the Data Library of the International Research Institute for Climate and Society, Columbia University, providing a comprehensive database for research on subseasonal to seasonal predictability and predictions. The SubX models show skill for temperature and precipitation three weeks ahead of time in specific regions. The SubX multi-model ensemble mean is more skillful than any individual model overall. Skill in simulating the Madden-Julian Oscillation (MJO) and the North Atlantic Oscillation (NAO), two sources of subseasonal predictability, is also evaluated with skillful predictions of the MJO four weeks in advance and of the NAO 2 weeks in advance. SubX is also able to make useful contributions to operational forecast guidance at the Climate Prediction Center. Additionally, SubX provides information on the potential for extreme precipitation associated with tropical cyclones which can help emergency management and aid organizations to plan for disasters. (Capsule Summary) A research to operations project in service of developing better operational subseasonal forecasts.

Precipitation↗

NASA NTRS2019

Historical (1700–2012) Global Multi-Model Estimates of the Fire Emissions from the Fire Modeling Intercomparison Project (FireMIP)

Fire emissions are critical for carbon and nutrient cycles, climate, and air quality. Dynamic Global Vegetation Models (DGVMs) with interactive fire modeling provide important estimates for long-term and large-scale changes of fire emissions. Here we present the first multi-model estimates of global gridded historical fire emissions for 1700-2012, including carbon and 33 species of trace gases and aerosols. The dataset is based on simulations of nine DGVMs with different state-of-the-art global fire models that participated in the Fire Modeling Intercomparison Project (FireMIP), using the same and standardized protocols and forcing data, and the most up-to-date fire emission factor table from field and laboratory studies over various land cover types. We evaluate the simulations of present-day fire emissions by comparing them with satellite-based products. Evaluation results show that most DGVMs simulate present-day global fire emission totals within the range of satellite-based products, and can capture the high emissions over the tropical savannas, low emissions over the arid and sparsely vegetated regions, and the main features of seasonality. However, most of the models fail to simulate the interannual variability, partly due to a lack of modeling peat fires and tropical deforestation fires. Historically, all models show only a weak trend in global fire emissions before ~1850s, consistent with multi-source merged historical reconstructions. The long-term trends among DGVMs are quite different for the 20th century, with some models showing an increase and others a decrease in fire emissions, mainly as a result of the discrepancy in their simulated responses to human population density change and land-use and land-cover change (LULCC). Our study provides a basic dataset for developing regional and global multi-source merged historical reconstructions and merging methods, and analyzing historical changes of fire emissions and their uncertainties as well as their role in the Earth system. It also highlights the importance of accurately modeling the responses of fire emissions to LULCC and population density change in reducing uncertainties in historical reconstructions of fire emissions and providing more reliable future projections.

Li, Fang↗

NASA NTRSDate not supplied

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗

NASA NTRS2020

Evaluation of Arctic Warming in Mid-Pliocene Climate Simulations

Palaeoclimate simulations improve our understanding of the climate, inform us about the performance of climate models in a different climate scenario, and help to identify robust features of the climate system. Here, we analyse Arctic warming in an ensemble of 16 simulations of the mid-Pliocene Warm Period (mPWP), derived from the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2). The PlioMIP2 ensemble simulates Arctic (60–90∘ N) annual mean surface air temperature (SAT) increases of 3.7 to 11.6 ∘C compared to the pre-industrial period, with a multi-model mean (MMM) increase of 7.2 ∘C. The Arctic warming amplification ratio relative to global SAT anomalies in the ensemble ranges from 1.8 to 3.1 (MMM is 2.3). Sea ice extent anomalies range from −3.0 to −10.4×106 km2, with a MMM anomaly of −5.6×106 km2, which constitutes a decrease of 53 % compared to the pre-industrial period. The majority (11 out of 16) of models simulate summer sea-ice-free conditions (≤1×106 km2) in their mPWP simulation. The ensemble tends to underestimate SAT in the Arctic when compared to available reconstructions, although the degree of underestimation varies strongly between the simulations. The simulations with the highest Arctic SAT anomalies tend to match the proxy dataset in its current form better. The ensemble shows some agreement with reconstructions of sea ice, particularly with regard to seasonal sea ice. Large uncertainties limit the confidence that can be placed in the findings and the compatibility of the different proxy datasets. We show that while reducing uncertainties in the reconstructions could decrease the SAT data–model discord substantially, further improvements are likely to be found in enhanced boundary conditions or model physics. Lastly, we compare the Arctic warming in the mPWP to projections of future Arctic warming and find that the PlioMIP2 ensemble simulates greater Arctic amplification than CMIP5 future climate simulations and an increase instead of a decrease in Atlantic Meridional Overturning Circulation (AMOC) strength compared to pre-industrial period. The results highlight the importance of slow feedbacks in equilibrium climate simulations, and that caution must be taken when using simulations of the mPWP as an analogue for future climate change.

Palaeoclimate simulations↗

NASA NTRS2021

Placing the East-West North American Aridity Gradient in a Multi-Century Context

Instrumental records indicate a century-long trend towards drying over western North America and wetting over eastern North America. A continuation of these trends into the future would have significant hydroclimatic and socioeconomic consequences in both the semi-arid Southwest and humid East. Using tree-ring reconstructions and hydrologic simulations of summer soil moisture, we evaluate and contextualize the modern summer aridity gradient within its natural range of variability established over the past 600 years and evaluate the effects of observed and anthropogenic precipitation, temperature, and humidity trends. The 2001–2020 positive (wet east-dry west) aridity gradient was larger than any 20-year period since 1400 CE, preceded by the most negative (wet west-dry east) aridity gradient during 1976-1995, leading to a strong multi-decade reversal in aridity gradient anomalies that was rivaled only by a similar event in the late-16th century. The 2001-2020 aridity gradient was dominated by long-term summer precipitation increases in the Midwest and Northeast, with smaller contributions from more warming in the West than the East and spring precipitation decreases in the Southwest. Multi-model mean climate simulations from CMIP6 experiments suggest anthropogenic climate trends should not have strongly affected the aridity gradient thus far. However, there is high uncertainty due to inter-model disagreement on anthropogenic precipitation trends. The recent strengthening of the observed aridity gradient, its increasing dependence on precipitation variability, and disagreement in modeled anthropogenic precipitation trends reveal significant uncertainties in how water resource availability will change across North America in the coming decades.

drought↗

NASA NTRS2022

Investigating Stable Oxygen and Carbon Isotopic Variability in Speleothem Records Over the Last Millennium Using Multiple Isotope-Enabled Climate Models

The incorporation of water isotopologues into the hydrology of general circulation models (GCMs) facilitates the comparison between modeled and measured proxy data in paleoclimate archives. However, the variability and drivers of measured and modeled water isotopologues, as well as the diversity of their representation in different models, are not well constrained. Improving our understanding of this variability in past and present climates will help to better constrain future climate change projections and decrease their range of uncertainty. Speleothems are a precisely datable terrestrial paleoclimate archives and provide well-preserved (semi-)continuous multivariate isotope time series in the lower latitudes and mid-latitudes and are therefore well suited to assess climate and isotope variability on decadal and longer timescales. However, the relationships of speleothem oxygen and carbon isotopes to climate variables are influenced by site-specific parameters, and their comparison to GCMs is not always straightforward. Here we compare speleothem oxygen and carbon isotopic signatures from the Speleothem Isotopes Synthesis and Analysis database version 2 (SISALv2) to the output of five different water-isotope-enabled GCMs (ECHAM5-wiso, GISS-E2-R, iCESM, iHadCM3, and isoGSM) over the last millennium (850–1850 CE). We systematically evaluate differences and commonalities between the standardized model simulation outputs. The goal is to distinguish climatic drivers of variability for modeled isotopes and compare them to those of measured isotopes. We find strong regional differences in the oxygen isotope signatures between models that can partly be attributed to differences in modeled surface temperature. At low latitudes, precipitation amount is the dominant driver for stable water isotope variability; however, at cave locations the agreement between modeled temperature variability is higher than for precipitation variability. While modeled isotopic signatures at cave locations exhibited extreme events coinciding with changes in volcanic and solar forcing, such fingerprints are not apparent in the speleothem isotopes. This may be attributed to the lower temporal resolution of speleothem records compared to the events that are to be detected. Using spectral analysis, we can show that all models underestimate decadal and longer variability compared to speleothems (albeit to varying extents). We found that no model excels in all analyzed comparisons, although some perform better than the others in either mean or variability. Therefore, we advise a multi-model approach whenever comparing proxy data to modeled data. Considering karst and cave internal processes, e.g., through isotope-enabled karst models, may alter the variability in speleothem isotopes and play an important role in determining the most appropriate model. By exploring new ways of analyzing the relationship between the oxygen and carbon isotopes, their variability, and co-variability across timescales, we provide methods that may serve as a baseline for future studies with different models using, e.g., different isotopes, different climate archives, or different time periods.

isotope-enabled simulations↗

NASA NTRS2022

Are Soybean Models Ready for Climate Change Food Impact Assessments?

An accurate estimation of crop yield under climate change scenarios is essential to quantify our ability to feed a growing population and develop agronomic adaptations to meet future food demand. A coordinated evaluation of yield simulations from process-based eco-physiological models for climate change impact assessment is still missing for soybean, the most widely grown grain legume and the main source of protein in our food chain. In this first soybean multi-model study, we used ten prominent models capable of simulating soybean yield under varying temperature and atmospheric CO 2 concentration [CO 2 ] to quantify the uncertainty in soybean yield simulations in response to these factors. Models were first parametrized with high quality measured data from five contrasting environments. We found considerable variability among models in simulated yield responses to increasing temperature and [CO 2 ]. For example, under a + 3 °C temperature rise in our coolest location in Argentina, some models simulated that yield would reduce as much as 24%, while others simulated yield increases up to 29%. In our warmest location in Brazil, the models simulated a yield reduction ranging from a 38% decrease under + 3 °C temperature rise to no effect on yield. Similarly, when increasing [CO 2 ] from 360 to 540 ppm, the models simulated a yield increase that ranged from 6% to 31%. Model calibration did not reduce variability across models but had an unexpected effect on modifying yield responses to temperature for some of the models. The high uncertainty in model responses indicates the limited applicability of individual models for climate change food projections. However, the ensemble mean of simulations across models was an effective tool to reduce the high uncertainty in soybean yield simulations associated with individual models and their parametrization. Ensemble, ensemble mean yield responses to temperature and [CO 2 ] were similar to those reported from the literature. Our study is the first demonstration of the benefits achieved from using an ensemble of grain legume models for climate change food projections, and highlights that further soybean model development with experiments under elevated [CO 2 ] and temperature is needed to reduce the uncertainty from the individual models.

Agricultural Model Inter-comparison and Improvemen↗

NASA NTRSDate not supplied

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗

NASA NTRS2023

Arctic Tropospheric Ozone: Assessment of Current Knowledge and Model Performance

As the third most important greenhouse gas (GHG) after carbon dioxide (CO2) and methane (CH4), tropospheric ozone (O3) is also an air pollutant causing damage to human health and ecosystems. This study brings together recent research on observations and modeling of tropospheric O3 in the Arctic, a rapidly warming and sensitive environment. At different locations in the Arctic, the observed surface O3 seasonal cycles are quite different. Coastal Arctic locations, for example, have a minimum in the springtime due to O3 depletion events resulting from surface bromine chemistry. In contrast, other Arctic locations have a maximum in the spring. The 12 state-of-the-art models used in this study lack the surface halogen chemistry needed to simulate coastal Arctic surface O3 depletion in the springtime; however, the multi-model median (MMM) has accurate seasonal cycles at non-coastal Arctic locations. There is a large amount of variability among models, which has been previously reported, and we show that there continues to be no convergence among models or improved accuracy in simulating tropospheric O3 and its precursor species. The MMM underestimates Arctic surface O3 by 5 % to 15 % depending on the location. The vertical distribution of tropospheric O3 is studied from recent ozonesonde measurements and the models. The models are highly variable, simulating free-tropospheric O3 within a range of ±50 % depending on the model and the altitude. The MMM performs best, within ±8 % for most locations and seasons. However, nearly all models overestimate O3 near the tropopause (∼300 hPa or ∼8 km), likely due to ongoing issues with underestimating the altitude of the tropopause and excessive downward transport of stratospheric O3 at high latitudes. For example, the MMM is biased high by about 20 % at Eureka. Observed and simulated O3 precursors (CO, NOx, and reservoir PAN) are evaluated throughout the troposphere. Models underestimate wintertime CO everywhere, likely due to a combination of underestimating CO emissions and possibly overestimating OH. Throughout the vertical profile (compared to aircraft measurements), the MMM underestimates both CO and NOx but overestimates PAN. Perhaps as a result of competing deficiencies, the MMM O3 matches the observed O3 reasonably well. Our findings suggest that despite model updates over the last decade, model results are as highly variable as ever and have not increased in accuracy for representing Arctic tropospheric O3.

Arctic↗

NASA NTRSDate not supplied

Inferred Sea Level Prediction in the NASA GMAO Seasonal Forecasting System

Reliable predictions of sea level anomalies on seasonal timescales with lead times of 1 to 9 months may have relevance to stakeholders – for example, in the advance deployment of resources for coastal flood mitigation. Routine prediction and analysis may also highlight physical processes associated with sea level change and modeling capabilities on seasonal and other timescales. These forecasts may represent interannual changes in the seasonal slope of the ocean surface, teleconnection effects such as the El Niño/Southern Oscillation phenomenon, and variations in seasonal hydrology including precipitation and coastal runoff. Coupled atmosphere/ocean models are routinely used in the seasonal prediction of temperature anomalies, precipitation anomalies, sea ice cover, and climate indices such as the Niño3.4 predictions under the North American Multi-Model Ensemble (NMME) protocol. Within the limits of their configuration, these complex Earth-system models have a potential for depicting regional changes in oceanic column properties, including the sea surface height. Seasonal prediction models generally have no representation of long-term mass contributions from melting land ice, or changes in vertical land motion; their output may be more specifically characterized as predictions of the ocean dynamic sea level. In practice however, the sea surface height prognostic variable is substantially compromised by the forecast model response to initial conditions. Imbalances between the initial, observed hydrologic cycle and the forecast model state produce abrupt adjustments in the model sea surface height. As a result, most seasonal prediction systems employ a constraint on the globally-averaged sea surface height that is applied at each time step. This essentially renders the prognostic sea surface height variable as unserviceable. Several approaches have previously been used to retrieve sea level information from seasonal forecasts beyond the use of the sea surface height variable. Here, we extend a method of relating other prognostic values, including ocean circulation and climate indices, to observed sea level variations. We use the merged altimetry record of the NASA MEaSUREs Gridded Sea Surface Height Anomalies data set and monthly revised local reference gauge observations from the National Oceanography Centre Permanent Service for Mean Sea Level (PSMSL) to evaluate derived prognostic variables from the NASA Global Modeling and Assimilation Office subseasonal-to-seasonal system version 2.1 (GMAO S2S v2.1). We focus on results for the midlatitudes with particular emphasis on US gauge locations. As shown in previous studies, prognostic ENSO-related indices in boreal winter are well correlated with gauge observations for the US west coast, but also for other locations in the southeastern US. Other forecast climate indices such as the North Atlantic Oscillation have relations to sea level that are limited both seasonally and spatially. As expected, surface atmospheric pressure (e.g., inverse barometer effect) is found to be particularly well correlated with observed sea level. We provide a characterization of forecast skill for seasonal sea level with this method.

Richard I Cullather↗

NASA NTRSDate not supplied

Dynamical Sensitivity in Response to a Wide Range of Abrupt CO 2 Forcings

An improved understanding of dynamical variability is important for projecting future changes in extratropical weather and the interaction between the extratropical troposphere and the tropics, stratosphere, cryosphere and ocean. Despite their simplicity, the abrupt 2x- and 4xCO 2 forcing simulations from the Coupled Model Intercomparison Project (CMIP) Phase 6 DECK experiments enable a mechanistic look into the forcing and feedback response characteristics of models that can be unambiguously attributed to an increase in carbon dioxide concentrations. Thus, while typically used to evaluate the climate sensitivity in models, with a primary focus on global surface temperature change, here we focus on several measures of extratropical variability, including projected changes in the storm tracks and in stratospheric polar vortex variability. Results are primarily based on simulations produced using low- and high-top versions of the NASA Goddard Institute for Space Studies Model (ModelE) but results are also presented from the larger CMIP6 multi-model ensemble. In addition to the 2x- and 4xCO 2 simulations, we also explore the linearity of the response of extratropical dynamical variability in ModelE to varying levels of CO 2 spanning the range 1/8-8xCO 2 . In particular, we show that the expansion of the jet streams varies nonlinearly with increasing CO 2 , especially in the Northern Hemisphere, and that this can be interpreted in terms of variations in ocean heat transport. The impact of composition feedbacks on changes in variability is also discussed.

dynamical variability↗

NASA NTRS2023

Observational Constraints Reduce Model Spread but Not Uncertainty in Global Wetland Methane Emission Estimates

The recent rise in atmospheric methane (CH 4 ) concentrations accelerates climate change and offsets mitigation efforts. Although wetlands are the largest natural CH 4 source, estimates of global wetland CH 4 emissions vary widely among approaches taken by bottom-up (BU) process-based biogeochemical models and top-down (TD) atmospheric inversion methods. Here, we integrate in situ measurements, multi-model ensembles, and a machine learning upscaling product into the International Land Model Benchmarking system to examine the relationship between wetland CH 4 emission estimates and model performance. We find that using better-performing models identified by observational constraints reduces the spread of wetland CH 4 emission estimates by 62% and 39% for BU- and TD-based approaches, respectively. However, global BU and TD CH 4 emission estimate discrepancies increased by about 15% (from 31 to 36 TgCH 4 year −1 ) when the top 20% models were used, although we consider this result moderately uncertain given the unevenly distributed global observations. Our analyses demonstrate that model performance ranking is subject to benchmark selection due to large inter-site variability, highlighting the importance of expanding coverage of benchmark sites to diverse environmental conditions. We encourage future development of wetland CH 4 models to move beyond static benchmarking and focus on evaluating site-specific and ecosystem-specific variabilities inferred from observations.

Kuang-Yu Chang↗