SEARCH · Search NASA
Results for “climate model evaluation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Learning Why: Data-Driven Causal Evaluations of Climate Models.
Abstract not provided.
Evaluating models of climate and forest vegetation
Understanding how the biosphere may respond to increasing trace gas concentrations in the atmosphere requires models that contain vegetation responses to regional climate. Most of the processes ecologists study in forests, including trophic interactions, nutrient cycling, and disturbance regimes, and vital components of the world economy, such as forest products and agriculture, will be influenced in potentially unexpected ways by changing climate. These vegetation changes affect climate in the following ways: changing C, N, and S pools; trace gases; albedo; and water balance. The complexity of the indirect interactions among variables that depend on climate, together with the range of different space/time scales that best describe these processes, make the problems of modeling and prediction enormously difficult. These problems of predicting vegetation response to climate warming and potential ways of testing model predictions are the subjects of this chapter.
Evaluation of climate model aerosol trends with ground-based observations over the last 2 decades – an AeroCom and CMIP6 analysis
Explore the source record for details and available documents.
Learning Why: Data-Driven Causal Evaluations of Climate Models.
Abstract not provided.
Practical Application of Parallel Coordinates for Climate Model Analysis
The determination of relationships between climate variables and the identification of the most significant associations between them in various geographic regions is an important aspect of climate model evaluation. The EDEN visual analytics toolkit has been developed to aid such analysis by facilitating the assessment of multiple variables with respect to the amount of variability that can be attributed to specific other variables. EDEN harnesses the parallel coordinates visualization technique and is augmented with graphical indicators of key descriptive statistics. A case study is presented in which the focus on the Harvard Forest site (42.5378N Lat, 72.1715W Lon) and the Community Land Model Version 4 (CLM4) is evaluated. It is shown that model variables such as land water runoff are more sensitive to a particular set of environmental variables than a suite of other inputs in the 88 variable analysis conducted. The approach presented here allows climate-domain scientists to focus on the most important variables in the model evaluations.
Internal variability and forcing influence model–satellite differences in the rate of tropical tropospheric warming
Climate-model simulations exhibit approximately two times more tropical tropospheric warming than satellite observations since 1979. The causes of this difference are not fully understood and are poorly quantified. Here, we apply machine learning to relate the patterns of surface-temperature change to the forced and unforced components of tropical tropospheric warming. This approach allows us to disentangle the forced and unforced change in the model-simulated temperature of the midtroposphere (TMT). In applying the climate-model-trained machine-learning framework to observations, we estimate that external forcing has produced a tropical TMT trend of 0.25 ± 0.08 K⋅decade −1 between 1979 and 2014, but internal variability has offset this warming by 0.07 ± 0.07 K⋅decade −1 . Using the Community Earth System Model version 2 (CESM2) large ensemble, we also find that a discontinuity in the variability of prescribed biomass-burning aerosol emissions artificially enhances simulated tropical TMT change by 0.04 K⋅decade −1 . The magnitude of this aerosol-forcing bias will vary across climate models, but since the latest generation of climate models all use the same emissions dataset, the bias may systematically enhance climate-model trends over the satellite era. Our results indicate that internal variability and forcing uncertainties largely explain differences in satellite-versus-model warming and are important considerations when evaluating climate models.
The Effect of Global Warming on Severe Thunderstorms in the United States
How will warming temperatures influence thunderstorm severity? This question can be explored by using climate models to diagnose changes in large-scale convective instability (CAPE) and wind shear, conditions that are known to be conducive to the formation of severe thunderstorms. First, an ensemble of climate models from phase 5 of the Coupled Model Intercomparison Project (CMIP5) is evaluated on its ability to reproduce a radiosonde climatology of such storm-favorable conditions in the current climate's spring and summer seasons, focusing on the contiguous United States (CONUS). Of the 11 climate models evaluated, a high-performing subset of four (GFDL CM3, GFDL-ESM2M, MRI-CGCM3, and NorESM1-M) is identified. Second, the twenty-first-century changes in the frequency of environments favorable to severe thunderstorms are calculated in these high-performing models as they are forced by the RCP4.5 and RCP8.5 emissions pathways. For the RCP8.5 scenario, the models predict consistent CONUS-mean fractional springtime increases in the range of 50%-180% by the end of the twenty-first century; for the summer, three of the four models predict increases in the range of 40%-120% and one model predicts a small decrease. This disagreement between the models is traced to divergent projections for future CAPE and boundary layer humidity in the Great Plains. This paper also explores the sensitivity of the results to the relative weight given to wind shear in determining how "favorable" a large-scale environment is for the development of severe thunderstorms, and it is found that this weighting is not the dominant source of uncertainty in projections of future thunderstorm severity.
Chapter 10 - Remote Sensing Measurements of Aerosol Properties
Satellite instruments have proven especially capable at monitoring the quantity of airborne particles in columns of atmosphere, globally. This chapter describes the principles of satellite measurements and retrieval algorithms, and surveys current instruments and their capabilities. We outline the issues associated with retrieval algorithms, such as surface characterization and aerosol proximity to clouds, and the challenges with interpretation of the results. The relationship between measured aerosol properties and climate-relevant aerosol properties simulated in models is outlined, as well as how measurements are used to evaluate models. Most space-based aerosol instruments are passive sensors that measure reflected sunlight at multiple wavelengths, some at multiple viewing angles. A few are active sensors that send out their own laser light and measure the returned signal. Except when clouds are present, the excess amount of light scattered back to space, beyond that expected from the surface and atmospheric gas, is attributed to aerosol. Satellite measurements are used in many ways in aerosol research. They often provide the only method for monitoring hazardous phenomena such as major wildfire and volcanic eruption plumes, especially in remote areas. Stable, long-term, near-global-scale satellite data records make it possible to identify regional and global aerosol trends. Aerosol radiative effects on climate can be quantified on a near-global scale and used to estimate the strength of aerosol–radiation and aerosol–cloud interactions as well as to evaluate climate model simulations of these interactions. Aerosol-type mapping from satellite imagery is helpful for source attribution, model validation, and to constrain particle light-absorption properties that are essential for radiative forcing calculations. The range of aerosol properties retrieved from satellite observations has grown considerably since the first global estimates of aerosol optical depth (τ a) over ocean were made in the late 1970s. Methods for retrieving particle size and light-absorption properties were explored in the 1990s using multispectral, multi-angle observations, and polarization in visible and near-infrared wavelengths. Sensitivity to particle light absorption, primarily from black or brown carbon content, improved with the inclusion of UV channels, and sensitivity to very thin aerosol layers in the upper troposphere and lower stratosphere was advanced with the use of limb-sounding instruments and active sensors. There are limitations to every measurement technique, including satellite aerosol remote sensing. For wide-swath, passive instruments, aerosol retrievals near clouds can present substantial challenges as far as 15 km away due to cloud-scattered light contaminating the signal. In nearly all cases, retrievals over bright snow and ice surfaces are precluded because surface reflectance uncertainties can overwhelm the aerosol signal. Similarly, meteorological cloud is identified and masked out where possible. Data from passive sensors also lack vertical resolution except those that view toward the limb or where multi-angle imagery is acquired over plumes from wildfires, erupting volcanoes, and wind-blown dust. Yet, passive sensors provide vastly more coverage than the active instruments that mitigate these issues. Particle microphysical information is qualitative from all remote sensing techniques, relying on proxies to infer particle composition, hygroscopicity, and the amount of light-absorbing material. Further, particles smaller than about 200 nm diameter cannot be distinguished from atmospheric gas molecules with remote sensing, which hinders studies of cloud condensation nuclei and their effects on clouds. Most satellite instruments dedicated to aerosol observations are in low-Earth, near-polar, sun-synchronous orbits, which means they cross the equator at the same local time each day. Most are set on cycles that repeat approximately every 16 days, which makes it difficult to monitor aerosol evolution locally. Geostationary satellites make it possible to observe changes occurring from minutes to hours over regions up to 8000 km in size, but lack coverage of high latitudes, and often provide more limited constraints on aerosol properties. Ground-truth data are vital for satellite aerosol-retrieval validation. The AErosol RObotic NETwork (AERONET) of sun photometers was created in 1993 and has become an established global network of over 350 instruments for validating satellite measurements. The network, as well as global networks of ground-based lidars, solar flux radiometers and other sun photometers, are widely used for evaluating global satellite retrievals and model simulations. NASA's Earth Observing System (EOS) program beginning in 1999 led to improvements in reliability, spatial resolution, and spectral resolution (and hence, to improved particle size discrimination and light absorption properties). Satellite payloads include advanced broad-swath and multi-angle imagers, along with the first space-based active sensor focused largely on long-term aerosol monitoring. Since about 2002, Europe's SENTINEL and operational meteorological satellite fleets are also providing sustained aerosol observations, with planned continuation until at least 2030. Satellite remote sensing instruments offer valuable data for evaluating aerosol representations in global climate models. They have been used to assess aerosol optical and physical properties, trends and distributions, and are applied increasingly as direct model constraints in data assimilation to create global aerosol reanalysis products. Aerosol optical depth is the most common quantity adopted for routine model evaluation, including multiwavelength data to loosely constrain particle-size distributions. These evaluations of multiple models have revealed general biases in their regional aerosol amounts and seasonal patterns of transport and removal. Although satellite measurements have near-global coverage, substantial errors can be introduced into the model observation comparison unless attention is paid to spatial and temporal collocation, cloud screening, subgrid-scale variability, and measurement uncertainties that vary with retrieval conditions.
The DeepMIP Contribution to PMIP4: Experimental Design for Model Simulations of the EECO, PETM, and pre-PETM (version 1.0)
Past warm periods provide an opportunity to evaluate climate models under extreme forcing scenarios, in particular high ( greater than 800 ppmv) atmospheric CO2 concentrations. Although a post hoc intercomparison of Eocene (approximately 50 Ma) climate model simulations and geological data has been carried out previously, models of past high-CO2 periods have never been evaluated in a consistent framework. Here, we present an experimental design for climate model simulations of three warm periods within the early Eocene and the latest Paleocene (the EECO, PETM, and pre-PETM). Together with the CMIP6 pre-industrial control and abrupt 4(times) CO2 simulations, and additional sensitivity studies, these form the first phase of DeepMIP - the Deep-time Model Intercomparison Project, itself a group within the wider Paleoclimate Modeling Intercomparison Project (PMIP). The experimental design specifies and provides guidance on boundary conditions associated with palaeogeography, greenhouse gases, astronomical configuration, solar constant, land surface processes, and aerosols. Initial conditions, simulation length, and output variables are also specified. Finally, we explain how the geological data sets, which will be used to evaluate the simulations, will be developed.
Climate Model Diagnostic Analyzer
The comprehensive and innovative evaluation of climate models with newly available global observations is critically needed for the improvement of climate model current-state representation and future-state predictability. A climate model diagnostic evaluation process requires physics-based multi-variable analyses that typically involve large-volume and heterogeneous datasets, making them both computation- and data-intensive. With an exploratory nature of climate data analyses and an explosive growth of datasets and service tools, scientists are struggling to keep track of their datasets, tools, and execution/study history, let alone sharing them with others. In response, we have developed a cloud-enabled, provenance-supported, web-service system called Climate Model Diagnostic Analyzer (CMDA). CMDA enables the physics-based, multivariable model performance evaluations and diagnoses through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. At the same time, CMDA provides a crowd-sourcing space where scientists can organize their work efficiently and share their work with others. CMDA is empowered by many current state-of-the-art software packages in web service, provenance, and semantic search.
Generating data ensembles over a model grid from sparse climate measurements.
Parameterizations in high-end climate models can be evaluated with observed climate and meteorological data. Often this evaluation is achieved by averaging measured quantities over time and space to match the spatial and temporal resolution of a gridded climate model without any regard for the statistical errors in doing so. We present a statistical method to interpolate sparsely located surface measurements into a uniform spatial grid representative of global and regional models of the atmosphere and climate. This method provides estimates of mean values over the entire domain containing the measurement sites as well as the uncertainty in the estimated quantities at the grid locations through multiple simulations to create 'data ensembles.' We demonstrate this method using measurements of surface sensible heat flux over the southern Great Plains region gathered through the Department of Energy's Atmospheric Radiation Measurement (ARM) program. Application to the numerous other climate variables measured through the ARM program and the development of a software tool to streamline data management and implementation of the statistical models is also discussed.
Reducing uncertainty about carbon dioxide as a climate driver
The lack of an adequate ancient analogue for future climates means that we ultimately must use and trust climate models, evaluated against modern observation and our best geologic records of warm and cold climates of the past. Armed with an elevated confidence in the models, we will then be able to make reliable predictions of the Earth's response to our risky experiment with the climate system.
The PMIP4 Contribution to CMIP6-Part 4: Scientific Objectives and Experimental Design of the PMIP4-CMIP6 Last Glacial Maximum Experiments and PMIP4 Sensitivity Experiments
The Last Glacial Maximum (LGM, 21,000 years ago) is one of the suite of paleoclimate simulations included in the current phase of the Coupled Model Intercomparison Project (CMIP6). It is an interval when insolation was similar to the present, but global ice volume was at a maximum, eustatic sea level was at or close to a minimum, greenhouse gas concentrations were lower, atmospheric aerosol loadings were higher than today, and vegetation and land-surface characteristics were different from today. The LGM has been a focus for the Paleoclimate Modelling Intercomparison Project (PMIP) since its inception, and thus many of the problems that might be associated with simulating such a radically different climate are well documented. The LGM state provides an ideal case study for evaluating climate model performance because the changes in forcing and temperature between the LGM and pre-industrial are of the same order of magnitude as those projected for the end of the 21st century. Thus, the CMIP6 LGM experiment could provide additional information that can be used to constrain estimates of climate sensitivity. The design of the Tier 1 LGM experiment (lgm) includes an assessment of uncertainties in boundary conditions, in particular through the use of different reconstructions of the ice sheets and of the change in dust forcing. Additional (Tier 2) sensitivity experiments have been designed to quantify feedbacks associated with land-surface changes and aerosol loadings, and to isolate the role of individual forcings. Model analysis and evaluation will capitalize on the relative abundance of paleoenvironmental observations and quantitative climate reconstructions already available for the LGM.
The Intrinsic 150‐Day Periodicity of the Southern Hemisphere Extratropical Large‐Scale Atmospheric Circulation
Abstract The variability of the Southern Hemisphere (SH) extratropical large‐scale circulation is dominated by the Southern Annular Mode (SAM), whose timescale is extensively used as a key metric in evaluating state‐of‐the‐art climate models. Past observational and theoretical studies suggest that the SAM lacks any internally generated (intrinsic) periodicity. Here, we show, using observations and a climate model hierarchy, that the SAM has an intrinsic 150‐day periodicity. This periodicity is robustly detectable in the power spectra and principal oscillation patterns (aka dynamical mode decomposition) of the zonal‐mean circulation, and in hemispheric‐scale precipitation and ocean surface wind stress. The 150‐day period is consistent with the predictions of a new reduced‐order model for the SAM, which suggests that this periodicity is associated with a complex interaction of turbulent eddies and zonal wind anomalies, as the latter propagate from low to high latitudes. These findings present a rare example of periodic oscillations arising from the internal dynamics of the extratropical turbulent circulations. Based on these findings, we further propose a new metric for evaluating climate models, and show that some of the previously reported shortcomings and improvements in simulating SAM's variability connect to the models' ability in reproducing this periodicity. We argue that this periodicity should be considered in evaluating climate models and understanding the past, current, and projected Southern Hemisphere climate variability.
Estimating Uncertainty in Simulated ENSO Statistics
Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.
Analysing Scales of Precipitation
The Analysing Scales of Precipitation (ASoP) package is being interfaced with the DOE Coordinated Model Evaluation Capabilities (CMEC) project. Users will be able to use the cmec-driver software to easily run ASoP and generate precipitation metrics as part of climate model evaluation workflows. These metrics provide information about the spatial and temporal patterns of precipitation at different timescales.