Search NASA⌕ Search

SEARCH · Search NASA

Results for “climate model testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Climate Quality Broadband and Narrowband Solar Reflected Radiance Calibration Between Sensors in Orbit

vAs the potential impacts of global climate change become more clear [1], the need to determine the accuracy of climate prediction over decade-to-century time scales has become an urgent and critical challenge. The most critical tests of climate model predictions will occur using observations of decadal changes in climate forcing, response, and feedback variables. Many of these key climate variables are observed by remotely sensing the global distribution of reflected solar spectral and broadband radiance. These "reflected solar" variables include aerosols, clouds, radiative fluxes, snow, ice, vegetation, ocean color, and land cover. Achieving sufficient satellite instrument accuracy, stability, and overlap to rigorously observe decadal change signals has proven very difficult in most cases and has not yet been achieved in others [2]. One of the earliest efforts to make climate quality observations was for Earth Radiation Budget: Nimbus 6/7 in the late 1970s, ERBE in the 1980s/90s, and CERES in 2000s are examples of the most complete global records. The recent CERES data products have carried out the most extensive intercomparisons because if the need to merge data from up to 11 instruments (CERES, MODIS, geostationary imagers) on 7 spacecraft (Terra, Aqua, and 5 geostationary) for any given month. In order to achieve climate calibration for cloud feedbacks, the radiative effect of clear-sky, all-sky, and cloud radiative effect must all be made with very high stability and accuracy. For shortwave solar reflected flux, even the 1% CERES broadband absolute accuracy (1-sigma confidence bound) is not sufficient to allow gaps in the radiation record for decadal climate change. Typical absolute accuracy for the best narrowband sensors like SeaWiFS, MISR, and MODIS range from 2 to 4% (1-sigma). IPCC greenhouse gas radiative forcing is approx. 0.6 W/sq m per decade or 0.6% of the global mean shortwave reflected flux, so that a 50% cloud feedback would change the global reflected flux by approx. 0.3 W/sq m or 0.3% per decade in broadband SW calibration change. Recent results comparing CERES reflected flux changes with MODIS, MISR, and SeaWiFS narrowband changes concluded that only SeaWiFS and CERES were approaching sufficient stability in calibration for decadal climate change [3]. Results using deep convective clouds in the optically thick limit as a stability target may prove very effective for improving past data sets like ISCCP. Results for intercalibration of geostationary imagers to CERES using an entire month of regional nearly coincident data demonstrates new approaches to constraining the calibration of current geostationary imagers. The new Decadal Survey Mission CLARREO is examining future approaches to a "NIST-in-Orbit" approach of very high absolute accuracy reference radiometers that cover the full solar and infrared spectrum at high spectral resolution but at low spatial resolution. Sampling studies have shown that a precessing CLARREO mission could calibrate other geo and leo reflected solar radiation and thermal infrared sensors.

Wielicki, Bruce A.↗
NASA NTRS1990

Model test of CCN-cloud albedo climate forcing

Cloud condensation nuclei (CCN) influence cloud albedo through their effect on the cloud droplet size distribution. A number of studies have evaluated the climatic impact of the CCN-cloud albedo feedback, but all have assumed that cloud distributions, cloud thicknesses, and cloud liquid water contents would remain constant as the climate adjusted. This assumption has been tested using the Livermore version of the National Center for Atmospheric Research Community Climate Model. The results indicate that there are no significant compensating changes in cloud properties that would counteract the 1.7 percent global albedo increase resulting from a fourfold increase in marine CCN concentration. Furthermore, when ocean surface temperatures are decreased 4 C in a manner broadly consistent with the enhanced cloud albedos, an increase in cloud fraction of 3.5 percent and a reduction in cloud altitude are predicted, leading to a positive feedback from clouds that would imply a climate impact roughly double that calculated from cloud droplet size distribution change alone.

Ghan, S. J.↗
NASA NTRS2019

ESD Reviews: Model Dependence in Multi-Model Climate Ensembles: Weighting, Sub-Selection and Out-Of-Sample Testing

The rationale for using multi-model ensembles in climate change projections and impacts research is often based on the expectation that different models constitute independent estimates; therefore, a range of models allows a better characterisation of the uncertainties in the representation of the climate system than a single model. However, it is known that research groups share literature, ideas for representations of processes, parameterisations, evaluation data sets and even sections of model code. Thus, nominally different models might have similar biases because of similarities in the way they represent a subset of processes, or even be near-duplicates of others, weakening the assumption that they constitute independent estimates. If there are near-replicates of some models, then treating all models equally is likely to bias the inferences made using these ensembles. The challenge is to establish the degree to which this might be true for any given application. While this issue is recognised by many in the community, quantifying and accounting for model dependence in anything other than an ad-hoc way is challenging. Here we present a synthesis of the range of disparate attempts to define, quantify and address model dependence in multi-model climate ensembles in a common conceptual framework, and provide guidance on how users can test the efficacy of approaches that move beyond the equally weighted ensemble. In the upcoming Coupled Model Intercomparison Project phase 6 (CMIP6), several new models that are closely related to existing models are anticipated, as well as large ensembles from some models. We argue that quantitatively accounting for dependence in addition to model performance, and thoroughly testing the effectiveness of the approach used will be key to a sound interpretation of the CMIP ensembles in future scientific studies.

Abramowitz, Gab↗
NASA NTRSDate not supplied

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗
NASA NTRS1981

The effect of zonal gradients of sea surface temperature on the Indian Ocean winter monsoon

Several global climate simulations by the 7-layer, 8 x 10 GISS climate model were designed to test the contributions of various surface boundary conditions to the global climate. The model was run with the sun fixed at a perpetual January. In a comparison of run #5, in which realistic January surface boundary conditions were used, with run #4, which was the same except that a zonally symmetric climatological January sea surface temperature (SST) field was used, one of the results was that run #5 provided a better simulation of the Indian Ocean monsoon. A further comparison of the wind fields over the Indian Ocean that were generated by these two model runs is presented.

Cohen, C.↗
NASA NTRS1990

Investigation of biogeophysical feedback on the African climate using a two-dimensional model

A numerical scheme is specifically designed to develop a time-dependent climate model to ensure the conservation of mass, momentum, energy, and water vapor, in order to study the biogeophysical feedback for the climate of Africa. A vegetation layer is incorporated in the present two-dimensional climate model. Using the coupled climate-vegetation model, two tests were performed involving the removal and expansion of the Sahara Desert. Results show that variations in the surface conditions produce a significant feedback to the climate system. It is noted that the simulation responses to the temperature and zonal wind in the case of an expanded desert agree with the climatological data for African dry years. Perturbed simulations have also been performed by changing the albedo only, without allowing the variation in the vegetation layer. It is shown that the variation in latent heat release is significant and is related to changes in the vegetation cover. As a result, precipitation and cloud cover are reduced.

Xue, Yongkang↗
NASA NTRSDate not supplied

Observing and Projecting the Lasting Fate of the Hunga Eruption on Atmospheric Water Vapor and Hydroxyl Radical

On 15th Jan. 2022 the submarine Hunga volcano erupted injecting approximately 0.5 Tg of sulfur dioxide into the stratosphere, but more significantly added 150-170 Tg of water vapor to the stratospheric background (over a 10% perturbation) in a matter of several hours. The sulfur dioxide rapidly converted to sulfate aerosol and along with water vapor, was transported around the Southern Hemisphere sub-tropics into midlatitudes and beyond with some transport into the Northern Hemisphere. With a much longer lifetime than sulfate aerosol, measurable water vapor mass anomalies have persisted with only small losses over more than 2 years since the eruption and are likely to continue above background for the remainder of the decade. Satellite measurements from limb and nadir viewing observing instruments provide the information needed to reasonably initialize the Hunga eruption in the Goddard Earth Observing System (GEOS) model using the “replay” framework coupled to the Global Modeling Initiative (GMI) stratosphere-troposphere chemical mechanism for the recent past and have continued the simulations into the future with the free running chemistry climate model (CCM). Using a number of model ensemble members together with the satellite observations, we quantify how the Hunga eruption is perturbing atmospheric composition and climate and projecting the influences to come as the enhanced water vapor continues in the stratosphere with only very slow removal mechanisms. Modeling suggests that the water rich eruption enhanced stratospheric hydroxyl radiacal (OH) and is supported by the speed of the observed conversion of SO2 into sulfate aerosol. These simulations also suggest a significant reduction in tropospheric OH over the mid-high latitude Southern Hemisphere, which has implications for numerous species that are impacted by this radical. The Hunga eruption provides a useful test of chemistry climate models and an opportunity for observation-based process understanding and in making new connections.

Hunga volcano↗
NASA NTRSDate not supplied

Projecting the Lasting Fate of the Hunga Tonga-Hunga Ha’apai Eruption on the Stratosphere through Connecting Measurements to Models

On 15th Jan. 2022 the submarine volcano Hunga Tonga-Hunga Ha’apai (HTHH) injected approximately 0.5 Tg of sulfur dioxide into the stratosphere, but more significantly added 150-170 Tg of water vapor to the stratospheric background (over a 10% perturbation) in a matter of several hours. The sulfur dioxide rapidly converted to sulfate aerosol and along with water vapor, was transported around the Southern Hemisphere sub-tropics into midlatitudes with some transport into the Northern Hemisphere. With a much longer lifetime than sulfate aerosol, measurable water vapor mass anomalies have persisted with only small losses over the past almost 2 years and are likely to continue above background for the remainder of the decade. Satellite measurements from limb and nadir viewing observing instruments provide the information needed to reasonably initialize the HTHH eruption in the Goddard Earth Observing System (GEOS) model using the “replay” framework coupled to the Global Modeling Initiative (GMI) stratosphere-troposphere chemical mechanism for the recent past and continue the simulations into the future with the free running chemistry climate model (CCM). Using a number of model ensemble members together with the satellite observations, we quantify how the HTHH eruption is perturbing stratospheric composition and climate and projecting the influences to come as the enhanced water vapor continues in the stratosphere with only very slow removal mechanisms. HTHH eruption provides a useful test of chemistry climate models and an opportunity for observation-based process understanding, which we will highlight.

Hunga Tonga-Hunga Ha’apai↗
DOE OSTI2024

Dynamic ecosystem assembly and escaping the “fire trap” in the tropics: insights from FATES_15.0.0

Abstract. Fire is a fundamental part of the Earth system, with impacts on vegetation structure, biomass, and community composition, the latter mediated in part via key fire-tolerance traits, such as bark thickness. Due to anthropogenic climate change and land use pressure, fire regimes are changing across the world, and fire risk has already increased across much of the tropics. Projecting the impacts of these changes at global scales requires that we capture the selective force of fire on vegetation distribution through vegetation functional traits and size structure. We have adapted the fire behavior and effects module, SPITFIRE (SPread and InTensity of FIRE), for use with the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), a size-structured vegetation demographic model. We test how climate, fire regime, and fire-tolerance plant traits interact to determine the biogeography of tropical forests and grasslands. We assign different fire-tolerance strategies based on crown, leaf, and bark characteristics, which are key observed fire-tolerance traits across woody plants. For these simulations, three types of vegetation compete for resources: a fire-vulnerable tree with thin bark, a vulnerable deep crown, and fire-intolerant foliage; a fire-tolerant tree with thick bark, a thin crown, and fire-tolerant foliage; and a fire-promoting C4 grass. We explore the model sensitivity to a critical parameter governing fuel moisture and show that drier fuels promote increased burning, an expansion of area for grass and fire-tolerant trees, and a reduction of area for fire-vulnerable trees. This conversion to lower biomass or grass areas with increased fuel drying results in increased fire-burned area and its effects, which could feed back to local climate variables. Simulated size-based fire mortality for trees less than 20 cm in diameter and those with fire-vulnerable traits is higher than that for larger and/or fire-tolerant trees, in agreement with observations. Fire-disturbed forests demonstrate reasonable productivity and capture observed patterns of aboveground biomass in areas dominated by natural vegetation for the recent historical period but have a large bias in less disturbed areas. Though the model predicts a greater extent of burned fraction than observed in areas with grass dominance, the resulting biogeography of fire-tolerant, thick-bark trees and fire-vulnerable, thin-bark trees corresponds to observations across the tropics. In areas with more than 2500 mm of precipitation, simulated fire frequency and burned area are low, with fire intensities below 150 kW m−1, consistent with observed understory fire behavior across the Amazon. Areas drier than this demonstrate fire intensities consistent with those measured in savannas and grasslands, with high values up to 4000 kW m−1. The results support a positive grass–fire feedback across the region and suggest that forests which have existed without frequent burning may be vulnerable at higher fire intensities, which is of greater concern under intensifying climate and land use pressures. The ability of FATES to capture the connection between fire disturbance and plant fire-tolerance strategies in determining biogeography provides a useful tool for assessing the vulnerability and resilience of these critical carbon storage areas under changing conditions across the tropics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Porting a fast-running wildfire plume model for use in national security and climate applications

In this project, the code for the fast-running Freitas wildfire plume model was successfully ported into the NARAC system, creating an operations-ready capability for predicting the transport of hazardous smoke from large wildfires. “Porting” refers to copying a section of code from one software package to another while accounting for unique dependencies in each software package. In this case, the code was ported from the Weather Research and Forecasting (WRF) Model, which is used extensively by the project team. To verify correct implementation, model results from the updated NARAC system were compared to those from WRF and the High-Resolution Rapid Refresh (HRRR) forecast model, which also employs the Freitas scheme. The NARAC User Interface (UI) and code documentation were also updated to include the new wildfire plume option, and a wildfire case was added to the NARAC test suite. The code was used in a real-time, semi-operational setup to predict smoke transport during the Cerro Pelado fire near Los Alamos National Laboratory in May 2022. The Freitas plume model was also tested for LLNL climate applications. Although the code was not ported into the Energy Exascale Earth System Model (E3SM), it was tested offline using E3SM atmospheric inputs, and results were compared to existing high-resolution plume predictions from large-eddy simulations in WRF. The code implementation and testing completed during this project will enable future work predicting smoke transport from large wildfires in LLNL national security and climate mission spaces.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Files and scripts to support manuscript Shuman et al 2023 FATES-SPITFIRE ecosystem assembly across tropics

The dataset includes the parameter and domain files, relevant output files, and scripts to generate simulations and perform analysis with Jupyter notebooks that support the manuscript Shuman, JK et al 2023 “Dynamic ecosystem assembly and escaping the “fire-trap” in the tropics: Insights from FATES_15.0.0”. We have adapted the fire-behavior and effects module, SPITFIRE, for use with the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), a size-structured vegetation demographic model. We test how climate, fire regime and fire-tolerance plant traits interact to determine the biogeography of tropical forests and grasslands. We assign different fire-tolerance strategies based on crown, leaf and bark characteristics, which are key observed fire-tolerance traits across woody plants. For these simulations, three types of vegetation compete for resources: a fire-vulnerable tree with thin bark, a vulnerable deep crown and fire-intolerant foliage; a fire-tolerant tree with thick bark, a thin crown and fire-tolerant foliage; and a fire-promoting C4 grass. We explore the model sensitivity to a critical parameter governing fuel moisture, and show that drier fuels promote increased burning, an expansion of area for grass and fire-tolerant trees and a reduction of area for fire-vulnerable trees. This conversion to lower biomass or grass areas with increased fuel drying results in increased fire burned area and its effects, which could fee back to local climate variables. Simulated size-based fire mortality for trees less than 20 cm in diameter and those with fire-vulnerable traits is higher than that for larger and/or fire-tolerant trees, in agreement with observations. Fire-disturbed forests demonstrate reasonable productivity and capture observed patterns of aboveground biomass in areas dominated by natural vegetation for the recent historical period, but have a large bias in less disturbed areas. Though the model predicts a greater extent of burned fraction than observed in areas with grass dominance, the resulting biogeography of fire-tolerant, thick-bark trees and fire-vulnerable, thin-bark trees corresponds to observations across the tropics. In areas with more than 2500 mm of precipitation, simulated fire frequency and burned area are low, with fire intensities below 150 kW m-1, consistent with observed understory fire behavior across the Amazon. Areas drier than this demonstrate fire intensities consistent with those measured in savannas and grasslands, with high values up to 4000 kW m-1. The results support a positive grass-fire feedback across the region, and suggest that forests which have existed without frequent burning may be vulnerable at higher fire intensities, which is of greater concern under intensifying climate and land use pressures. The ability of FATES to capture the connection between fire disturbance and plant fire-tolerance strategies in determining biogeography provides a useful tool for assessing the vulnerability and resilience of these critical carbon storage areas under changing conditions across the tropics.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1987

Validating regional differences in modelled satellite microwave signatures

A three-part microwave T(B) brightness temperature model was tested for applicability in regions of differing climatic and vegetation regime. Model parameters were limited to vegetation in the form of the normalized vegetation index (NDVI) and climatically modeled soil moisture. The T(B) model was calibrated for two climatically contrasting areas and subsequently validated on different test sites of similar climatic character. Vegetative characteristics in the form of the mean NDVI was used to partition and lump data from different test sites. Good agreement was realized between estimated T(B) and Nimbus-7 SMMR T(B) at the 6.6 GHz horizontal channel.

Owe, Manfred↗
NASA NTRS2012

NASA Center for Climate Simulation (NCCS) Presentation

The NASA Center for Climate Simulation (NCCS) offers integrated supercomputing, visualization, and data interaction technologies to enhance NASA's weather and climate prediction capabilities. It serves hundreds of users at NASA Goddard Space Flight Center, as well as other NASA centers, laboratories, and universities across the US. Over the past year, NCCS has continued expanding its data-centric computing environment to meet the increasingly data-intensive challenges of climate science. We doubled our Discover supercomputer's peak performance to more than 800 teraflops by adding 7,680 Intel Xeon Sandy Bridge processor-cores and most recently 240 Intel Xeon Phi Many Integrated Core (MIG) co-processors. A supercomputing-class analysis system named Dali gives users rapid access to their data on Discover and high-performance software including the Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT), with interfaces from user desktops and a 17- by 6-foot visualization wall. NCCS also is exploring highly efficient climate data services and management with a new MapReduce/Hadoop cluster while augmenting its data distribution to the science community. Using NCCS resources, NASA completed its modeling contributions to the Intergovernmental Panel on Climate Change (IPCG) Fifth Assessment Report this summer as part of the ongoing Coupled Modellntercomparison Project Phase 5 (CMIP5). Ensembles of simulations run on Discover reached back to the year 1000 to test model accuracy and projected climate change through the year 2300 based on four different scenarios of greenhouse gases, aerosols, and land use. The data resulting from several thousand IPCC/CMIP5 simulations, as well as a variety of other simulation, reanalysis, and observationdatasets, are available to scientists and decision makers through an enhanced NCCS Earth System Grid Federation Gateway. Worldwide downloads have totaled over 110 terabytes of data.

Webster, William P.↗
NASA NTRS2012

Upgrades, Current Capabilities and Near-Term Plans of the NASA ARC Mars Climate

We describe and review recent upgrades to the ARC Mars climate modeling framework, in particular, with regards to physical parameterizations (i.e., testing, implementation, modularization and documentation); the current climate modeling capabilities; selected research topics regarding current/past climates; and then, our near-term plans related to the NASA ARC Mars general circulation modeling (GCM) project.

Hollingsworth, J. L.↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Model Performance in Simulating the Mid-Holocene Green Sahara

The Green Sahara Period, spanning about 11,500 to 5,000 years ago, offers an opportunity to test the ability of climate models to simulate large-scale changes in northern African climate through the strengthening of the West African Monsoon. In this study, we evaluate the performance of four models in simulating the mid-Holocene (6,000 BP), namely – EC-Earth, iCESM, CCSM4-Toronto, and the GISS ModelE2.1-G. Two scenarios are considered for each model – a standard PMIP scenario simulated with the mid-Holocene orbital parameters and greenhouse gas concentrations with vegetation prescribed to pre-industrial conditions, as well as a Green-Sahara scenario which additionally considers factors such as enhanced vegetation, reduced dust, presence of lakes, and land and soil feedbacks. All mid-Holocene scenarios capture an increase in monsoonal precipitation in northern Africa. However, a comparison of the two mid-Holocene scenarios reveals significantly higher precipitation in northern Africa for all the Green-Sahara scenarios relative to the PMIP scenarios – an observation consistent across all models. Accompanied by a strengthened Saharan Heat Low, these changes in the West African Monsoon are also linked to polar amplification, a stronger Indian Summer Monsoon and alterations to the Walker circulation. Model results are in agreement with pollen-based SAT records, multi-proxy SST records and African lake level records. This comparison indicates that a realistic simulation of the mid-Holocene Green Sahara requires consideration of multiple factors in addition to orbital and greenhouse gas forcings.

Green Sahara Period↗