Search NASA⌕ Search

SEARCH · Search NASA

Results for “climate model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗

ARM Climate Modeling Best Estimate Data - A new data product for climate modelers

This paper provides an overview of a new data product, named the Climate Modeling Best Estimate (CMBE) dataset, developed by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) Program in order to better serve the need of climate model developers and encourage greater use of ARM data by modelers. The CMBE dataset contains those quantities that are often used in model evaluation and reflect unique ARM measurements of clouds and radiation (e.g., cloud occurrence, liquid water path, and surface radiative fluxes) from the highest quality data that ARM has for many years. The data are averaged over one hour period, which is comparable to a typical temporal resolution used in climate model output. They are currently available at five ARM Climate Research Facility (ACRF) sites located at the Southern Great Plains, North Slope of Alaska, and Tropic Western Pacific, and can be obtained from the ACRF data archive. The long-term continuous ARM data provide invaluable information to improve our understanding of the interaction between clouds and radiation and a solid observational basis for model validation and improvement. This paper shows some examples to demonstrate its unique values in studies of cloud processes, climate variability and change, and climate modeling. Plans for future enhancements of the CMBE product are also discussed.

54 ENVIRONMENTAL SCIENCES↗

Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity

Evaluating a climate model’s fidelity (ability to simulate observed climate) is a critical step in establishing confidence in the model’s suitability for future climate projections, and in tuning climate model parameters. Model developers use their judgement in determining which trade-offs between different aspects of model fidelity are acceptable. However, little is known about the degree of consensus in these evaluations, and whether experts use the same criteria when different scientific objectives are defined. Here, we report on results from a broad community survey studying expert assessments of the relative importance of different output variables when evaluating a global atmospheric model’s mean climate. We find that experts adjust their ratings of variable importance in response to the scientific objective, for instance, scientists rate surface wind stress as significantly more important for Southern Ocean climate than for the water cycle in the Asian watershed. There is greater consensus on the importance of certain variables (e.g., shortwave cloud forcing) than others (e.g., aerosol optical depth). We find few differences in expert consensus between respondents with greater or less climate modeling experience, and no statistically significant differences between the responses of climate model developers and users. In conclusion, the concise variable lists and community ratings reported here provide baseline descriptive data on current expert understanding of certain aspects of model evaluation, and can serve as a starting point for further investigation, as well as developing more sophisticated evaluation and scoring criteria with respect to specific scientific objectives.

54 ENVIRONMENTAL SCIENCES↗

Incorporation of the HYbrid Coordinate Ocean Model (HYCOM) into the Community Climate System Model (CCSM): Evaluation and Climate Applications (Final Report for DOE Grant DE-FG02-07ER64470)

The primary goal of the project entitled “Incorporation of the HYbrid Coordinate Ocean Model (HYCOM) into the Community Climate System Model (CCSM): Evaluation and Climate Applications” was to systematically investigate the performance of the HYbrid Coordinate Ocean Model (HYCOM) as an alternative oceanic component of the NCAR’s Community Climate System Model (CCSM). We have configured two versions of the fully coupled CCSM3/HYCOM: one with a medium resolution (T42) Community Atmospheric Model (CAM) and the other with higher resolution (T85). We have performed a comprehensive analysis of the 400-year fully coupled CCSM3/HYCOM simulations and compared the results with those from CCSM3/POP and with climatological observations, and also we have performed tuning of critical model parameters, including Smagorinsky viscosity, isopycnal diffusivity, and background vertical diffusivity. The analysis shows that most oceanic features are well represented in the CCSM3/HYCOM. The coupled CCSM3/HYCOM (T42) has been integrated for 400 years, and the results have been archived and transferred to the High Performance Computer in the Florida State Univesity. In the last year, we have made comprehensive diagnostics of the long-term simulations by the comparison with the original CCSM3/POP simulation and with the observations. To gain some understanding of the model biases, the mean climate and modes of climate variability of the two models are compared with observations. The examination includes the Northern and Southern Annular Modes (NAM and SAM), the Pacific-North-American (PNA) pattern, the Atlantic Multidecadal Oscillation (AMO), and the main Southern Ocean SST mode. We also compared the performance of ENSO simulation in the coupled models. This report summarizes the main findings from the comparison of long-term CCSM3/HYCOM and CCSM3/POP simulations.

54 ENVIRONMENTAL SCIENCES↗

Separating the Wheat from the Chaff: Comparative Visual Cues for Transparent Diagnostics of Competing Models

Experts in data and physical sciences have to regularly grapple with the problem of competing models. Be it analytical or physics-based models, a cross-cutting challenge for experts is to reliably diagnose which model outcomes appropriately predict or simulate real-world phenomena. Expert judgment involves reconciling information across many, and often, conflicting criteria that describe the quality of model outcomes. In this paper, through a design study with climate scientists, we develop a deeper understanding of the problem and solution space of model diagnostics, resulting in the following contributions: i) a problem and task characterization using which we map experts’ model diagnostics goals to multi-way visual comparison tasks, ii) a design space of comparative visual cues for letting experts quickly understand the degree of disagreement among competing models and gauge the degree of stability of model outputs with respect to alternative criteria, and iii) design and evaluation of MyriadCues, an interactive visualization interface for exploring alternative hypotheses and insights about good and bad models by leveraging comparative visual cues. Here, we present case studies and subjective feedback by experts, which validate how MyriadCues enables more transparent model diagnostic mechanisms, as compared to the state of the art.

54 ENVIRONMENTAL SCIENCES↗

SciDAC's Earth System Grid Center for Enabling Technologies Semi-Annual Progress Report for the Period October 1, 2009 through March 31, 2010

This report summarizes work carried out by the ESG-CET during the period October 1, 2009 through March 31, 2009. It includes discussion of highlights, overall progress, period goals, collaborations, papers, and presentations. To learn more about our project, and to find previous reports, please visit the Earth System Grid Center for Enabling Technologies (ESG-CET) website. This report will be forwarded to the DOE SciDAC program management, the Office of Biological and Environmental Research (OBER) program management, national and international collaborators and stakeholders (e.g., the Community Climate System Model (CCSM), the Intergovernmental Panel on Climate Change (IPCC) 5th Assessment Report (AR5), the Climate Science Computational End Station (CCES), the SciDAC II: A Scalable and Extensible Earth System Model for Climate Change Science, the North American Regional Climate Change Assessment Program (NARCCAP), and other wide-ranging climate model evaluation activities).

99 GENERAL AND MISCELLANEOUS↗

Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6

The Observations for Model Intercomparison Project (Obs4MIPs) was initiated in 2010 to facilitate the use of observations in climate model evaluation and research, with a particular target being the Coupled Model Intercomparison Project (CMIP), a major initiative of the World Climate Research Programme (WCRP). To this end, Obs4MIPs (1) targets observed variables that can be compared to CMIP model variables; (2) utilizes dataset formatting specifications and metadata requirements closely aligned with CMIP model output; (3) provides brief technical documentation for each dataset, designed for nonexperts and tailored towards relevance for model evaluation, including information on uncertainty, dataset merits, and limitations; and (4) disseminates the data through the Earth System Grid Federation (ESGF) platforms, making the observations searchable and accessible via the same portals as the model output. Taken together, these characteristics of the organization and structure of obs4MIPs should entice a more diverse community of researchers to engage in the comparison of model output with observations and to contribute to a more comprehensive evaluation of the climate models. At present, the number of obs4MIPs datasets has grown to about 80; many are undergoing updates, with another 20 or so in preparation, and more than 100 are proposed and under consideration. A partial list of current global satellite-based datasets includes humidity and temperature profiles; a wide range of cloud and aerosol observations; ocean surface wind, temperature, height, and sea ice fraction; surface and top-of-atmosphere longwave and shortwave radiation; and ozone (O 3 ), methane (CH 4 ), and carbon dioxide (CO 2 ) products. A partial list of proposed products expected to be useful in analyzing CMIP6 results includes the following: alternative products for the above quantities, additional products for ocean surface flux and chlorophyll products, a number of vegetation products (e.g., FAPAR, LAI, burned area fraction), ice sheet mass and height, carbon monoxide (CO), and nitrogen dioxide (NO 2 ). While most existing obs4MIPs datasets consist of monthly-mean gridded data over the global domain, products with higher time resolution (e.g., daily) and/or regional products are now receiving more attention. Along with an increasing number of datasets, obs4MIPs has implemented a number of capability upgrades including (1) an updated obs4MIPs data specifications document that provides additional search facets and generally improves congruence with CMIP6 specifications for model datasets, (2) a set of six easily understood indicators that help guide users as to a dataset's maturity and suitability for application, and (3) an option to supply supplemental information about a dataset beyond what can be found in the standard metadata. With the maturation of the obs4MIPs framework, the dataset inclusion process, and the dataset formatting guidelines and resources, the scope of the observations being considered is expected to grow to include gridded in situ datasets as well as datasets with a regional focus, and the ultimate intent is to judiciously expand this scope to any observation dataset that has applicability for evaluation of the types of Earth system models used in CMIP.

54 ENVIRONMENTAL SCIENCES↗

Introduction to the Special Section on Fast Physics in Climate Models: Parameterization, Evaluation and Observation

Many physical processes that influence Earth’s climate occur at scales of space and time that are too small to be resolved by typical global climate models (GCMS). These processes – e.g., aerosol/cloud physics, convection, boundary layer processes, turbulence, radiation, and land-atmosphere interactions–must be parameterized in GCMs, and are collectively called fast physics or fast processes for convenience.

54 ENVIRONMENTAL SCIENCES↗

A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields

Abstract. A new test statistic for climate model evaluation has been developed that potentially mitigates some of the limitations that exist for observing and representing field and space dependencies of climate phenomena. Traditionally such dependencies have been ignored when climate models have been evaluated against observational data, which makes it difficult to assess whether any given model is simulating observed climate for the right reasons. The new statistic uses Gaussian Markov random fields for estimating field and space dependencies within a first-order grid point neighborhood structure. We illustrate the ability of Gaussian Markov random fields to represent empirical estimates of field and space covariances using "witch hat" graphs. We further use the new statistic to evaluate the tropical response of a climate model (CAM3.1) to changes in two parameters important to its representation of cloud and precipitation physics. Overall, the inclusion of dependency information did not alter significantly the recognition of those regions of parameter space that best approximated observations. However, there were some qualitative differences in the shape of the response surface that suggest how such a measure could affect estimates of model uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Climate Model Diagnostic and Evaluation: With a Focus on Satellite Observations

Each year, we host a summer school that brings together the next generation of climate scientists - about 30 graduate students and postdocs from around the world - to engage with premier climate scientists from the Jet Propulsion Laboratory and elsewhere. Our yearly summer school focuses on topics on the leading edge of climate science research. Our inaugural summer school, held in 2011, was on the topic of "Using Satellite Observations to Advance Climate Models," and enabled students to explore how satellite observations can be used to evaluate and improve climate models. Speakers included climate experts from both NASA and the National Oceanic and Atmospheric Administration (NOAA), who provided updates on climate model diagnostics and evaluation and remote sensing of the planet. Details of the next summer school will be posted here in due course.

climate↗

Toward a chemical reanalysis in a coupled chemistry-climate model: An evaluation of MOPITT CO assimilation and its impact on tropospheric composition

Here, we examine in detail a 1 year global reanalysis of carbon monoxide (CO) that is based on joint assimilation of conventional meteorological observations and Measurement of Pollution in The Troposphere (MOPITT) multispectral CO retrievals in the Community Earth System Model (CESM). Our focus is to assess the impact to the chemical system when CO distribution is constrained in a coupled full chemistry-climate model like CESM. To do this, we first evaluate the joint reanalysis (MOPITT Reanalysis) against four sets of independent observations and compare its performance against a reanalysis with no MOPITT assimilation (Control Run). We then investigate the CO burden and chemical response with the aid of tagged sectoral CO tracers. We estimate the total tropospheric CO burden in 2002 (from ensemble mean and spread) to be 371 ± 12% Tg for MOPITT Reanalysis and 291 ± 9% Tg for Control Run. Our multispecies analysis of this difference suggests that (a) direct emissions of CO and hydrocarbons are too low in the inventory used in this study and (b) chemical oxidation, transport, and deposition processes are not accurately and consistently represented in the model. Increases in CO led to net reduction of OH and subsequent longer lifetime of CH 4 (Control Run: 8.7 years versus MOPITT Reanalysis: 9.3 years). Yet at the same time, this increase led to 5-10% enhancement of Northern Hemisphere O 3 and overall photochemical activity via HO x recycling. Such nonlinear effects further complicate the attribution to uncertainties in direct emissions alone. This has implications to chemistry-climate modeling and inversion studies of longer-lived species.

54 ENVIRONMENTAL SCIENCES↗

Using Climate Models to Evaluate Mechanisms of Glacial Inception

The initiation and subsequent growth of an ice sheet or large glacier is based on two primary factors: 1. Most fundamentally, a region must exist with a positive net snow accumulation, that is, cold season snowfall exceeds warm season snowmelt. Because snow can melt very rapidly, in a practical sense this probably means that little or no snow melt should occur in the warm season (mountain glaciers being one possible exception). 2. When sufficient ice builds in a region with a positive net snow accumulation, the ice will flow into adjoining regions with a negative mass balance. Feedbacks can also then arise between the emerging ice sheet and the overall climate, which, among other effects, may cause the mass balance in that region to turn positive. A key question is the relative importance of these two factors. In particular, is it possible for a large lowland region to experience a positive mass balance, such that the ice sheet can arise largely 'in-situ'? Or instead are uplands necessary, such that essentially mountain glaciers form first, and then, under the right conditions, grow and coalesce, eventually spreading out into the lowlands? This is probably the single most fundamental question to be addressed in the modeling of glacial inception. Other key questions then focus on how the (upland or low-land) positive mass balance is obtained at some times, but not others (the ice sheets are not continuously present). For Northern Hemisphere ice sheets in particular, what climatic conditions can lead to abundant winter snowfall in the Canadian Arctic and northern Labrador in conjunction with cool summertime conditions? Are both required, or will cool summer conditions alone suffice? Conversely, are a few years of abnormally heavy snowfall all that is required to trigger glacial inception? A major need at present is for carefully constructed climate model studies aimed at addressing these questions. A successful strategy will almost certainly require more than just a global model; while the global climate model might be necessary to properly simulate large-scale forcing, such models have insufficient spatial resolution to adequately address the roles of topography and the nature of the land surface. Necessary also is the use of a high-resolution regional climate model (in conjunction with a global model). Possible forcing mechanisms of Pleistocene ice ages are well known (e.g., orbital forcing; CO2 fluctuations) but we must understand and be able to successfully model the actual processes involved in glacial inception before we can fully understand the true roles played by these forcing mechanisms.

Oglesby, Robert J.↗

SciDAC's Earth System Grid Center for Enabling Technologies Semi-Annual Progress Report for the Period April 1, 2009 through September 30, 2009

This report summarizes work carried out by the ESG-CET during the period April 1, 2009 through September 30, 2009. It includes discussion of highlights, overall progress, period goals, collaborations, papers, and presentations. To learn more about our project, and to find previous reports, please visit the Earth System Grid Center for Enabling Technologies (ESG-CET) website. This report will be forwarded to the DOE SciDAC program management, the Office of Biological and Environmental Research (OBER) program management, national and international collaborators and stakeholders (e.g., the Community Climate System Model (CCSM), the Intergovernmental Panel on Climate Change (IPCC) 5th Assessment Report (AR5), the Climate Science Computational End Station (CCES), the SciDAC II: A Scalable and Extensible Earth System Model for Climate Change Science, the North American Regional Climate Change Assessment Program (NARCCAP), and other wide-ranging climate model evaluation activities). During this semi-annual reporting period, the ESG-CET team continued its efforts to complete software components needed for the ESG Gateway and Data Node. These components include: Data Versioning, Data Replication, DataMover-Lite (DML) and Bulk Data Mover (BDM), Metrics, Product Services, and Security, all joining together to form ESG-CET's first beta release. The launch of the beta release is scheduled for late October with the installation of ESG Gateways at NCAR and LLNL/PCMDI. Using the developed ESG Data Publisher, the ESG II CMIP3 (IPCC AR4) data holdings - approximately 35 TB - will be among the first datasets to be published into the new ESG enterprise system. In addition, the NCAR's ESG II data holdings will also be published into the new system - approximately 200 TB. This period also saw the testing of the ESG Data Node at various collaboration sites, including: the British Atmospheric Data Center (BADC), the Max-Planck-Institute for Meteorology, the University of Tokyo Center for Climate System Research, and the Australian National University. This period, a total of 14 national and international sites installed an ESG Data Node for testing. During this period, we also continued to provide production-level services to the community, providing researchers worldwide with access to CMIP3 (IPCC AR4), CCES, and CCSM, Parallel Climate Model (PCM), Parallel Ocean Program (POP), and Cloud Feedback Model Intercomparison Project (CFMIP), and NARCCAP data.

54 ENVIRONMENTAL SCIENCES↗

Carbon Outgassing in the Antarctic Circumpolar Current Is Supported by Ekman Transport From the Sea Ice Zone in an Observation‐Based Seasonal Mixed‐Layer Budget

Despite its importance for the global cycling of carbon, there are still large gaps in our understanding of the processes driving annual and seasonal carbon fluxes in the high-latitude Southern Ocean. This is due in part to a historical paucity of observations in this remote, turbulent, and seasonally ice-covered region. Here, we use autonomous biogeochemical float data spanning 6 full seasonal cycles and with circumpolar coverage of the Southern Ocean, complemented by atmospheric reanalysis, to construct a monthly climatology of the mixed layer budget of dissolved inorganic carbon (DIC). We investigate the processes that determine the annual mean and seasonal cycle of DIC fluxes in two different zones of the Southern Ocean—the Sea Ice Zone (SIZ) and Antarctic Southern Zone (ASZ). We find that, annually, mixing with carbon-rich waters at the base of the mixed layer supplies DIC which is, in the ASZ, either used for net biological production or outgassed to the atmosphere. In contrast, in the SIZ, where carbon outgassing and the biological pump are weaker, the surplus of DIC is instead advected northward to the ASZ. In other words, carbon outgassing in the southern Antarctic Circumpolar Current (ACC), which has been attributed to remineralized carbon from deep water upwelled in the ACC, is also due to the wind-driven transport of DIC from the SIZ. These results stem from the first observation-based carbon budget of the circumpolar Southern Ocean and thus provide a useful benchmark to evaluate climate models, which have significant biases in this region.

Sauvé, Jade↗