Search NASA⌕ Search

SEARCH · Search NASA

Results for “intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol applied to Earth system models

Abstract. Strongly coupled nonlinear phenomena such as those described by Earth system models (ESMs) are composed of multiple component models with independent mesh topologies and scalable numerical solvers. A common operation in ESMs is to remap or interpolate component solution fields defined on their computational mesh to another mesh with a different combinatorial structure and decomposition, e.g., from the atmosphere to the ocean, during the temporal integration of the coupled system. Several remapping schemes are currently in use or available for ESMs. However, a unified approach to compare the properties of these different schemes has not been attempted previously. We present a rigorous methodology for the evaluation and intercomparison of remapping methods through an independently implemented suite of metrics that measure the ability of a method to adhere to constraints such as grid independence, monotonicity, global conservation, and local extrema or feature preservation. A comprehensive set of numerical evaluations is conducted based on a progression of scalar fields from idealized and smooth to more general climate data with strong discontinuities and strict bounds. We examine four remapping algorithms with distinct design approaches, namely ESMF Regrid (Hill et al., 2004), TempestRemap (Ullrich and Taylor, 2015), generalized moving least squares (GMLS) (Trask and Kuberry, 2020) with post-processing filters, and WLS-ENOR (Li et al., 2020). By repeated iterative application of the high-order remapping methods to the test fields, we verify the accuracy of each scheme in terms of their observed convergence order for smooth data and determine the bounded error propagation using challenging, realistic field data on both uniform and regionally refined mesh cases. In addition to retaining high-order accuracy under idealized conditions, the methods also demonstrate robust remapping performance when dealing with non-smooth data. There is a failure to maintain monotonicity in the traditional L2-minimization approaches used in ESMF and TempestRemap, in contrast to stable recovery through nonlinear filters used in both meshless GMLS and hybrid mesh-based WLS-ENOR schemes. Local feature preservation analysis indicates that high-order methods perform better than low-order dissipative schemes for all test cases. The behavior of these remappers remains consistent when applied on regionally refined meshes, indicating mesh-invariant implementations. The MIRA intercomparison protocol proposed in this paper and the detailed comparison of the four algorithms demonstrate that the new schemes, namely GMLS and WLS-ENOR, are competitive compared to standard conservative minimization methods requiring computation of mesh intersections. The work presented in this paper provides a foundation that can be extended to include complex field definitions, realistic mesh topologies, and spectral element discretizations, thereby allowing for a more complete analysis of production-ready remapping packages.

58 GEOSCIENCES↗

Understanding AMOC stability: the North Atlantic Hosing Model Intercomparison Project

Abstract. The Atlantic meridional overturning circulation (AMOC) is an important part of our climate system. The AMOC is predicted to weaken under climate change; however, theories suggest that it may have a tipping point beyond which recovery is difficult, hence showing quasi-irreversibility (hysteresis). Although hysteresis has been seen in simple models, it has been difficult to demonstrate in comprehensive global climate models. Here, we outline a set of experiments designed to explore AMOC hysteresis and sensitivity to additional freshwater input as part of the North Atlantic Hosing Model Intercomparison Project (NAHosMIP). These experiments include adding additional freshwater (hosing) for a fixed length of time to examine the rate and mechanisms of AMOC weakening and whether the AMOC subsequently recovers once hosing stops. Initial results are shown from eight climate models participating in the Sixth Coupled Model Intercomparison Project (CMIP6). The AMOC weakens in all models as a result of the freshening, but once the freshening ceases, the AMOC recovers in half of the models, and in the other half it stays in a weakened state. The difference in model behaviour cannot be explained by the ocean model resolution or type nor by details of subgrid-scale parameterisations. Likewise, it cannot be explained by previously proposed properties of the mean climate state such as the strength of the salinity advection feedback. Instead, the AMOC recovery is determined by the climate state reached when hosing stops, with those experiments where the AMOC is weakest not experiencing a recovery.

54 ENVIRONMENTAL SCIENCES↗

Experimental design for the Marine Ice Sheet–Ocean Model Intercomparison Project – phase 2 (MISOMIP2)

The Marine Ice Sheet–Ocean Model Intercomparison Project – phase 2 (MISOMIP2) is a natural progression of previous and ongoing model intercomparison exercises that have focused on the simulation of ice-sheet and ocean processes in Antarctica. The previous exercises motivate the move towards realistic configurations, as well as more diverse model parameters and resolutions. The main objective of MISOMIP2 is to investigate the performance of existing ocean and coupled ice-sheet–ocean models in a range of Antarctic environments through comparisons to observational data. We will assess the status of ice-sheet–ocean modelling as a community and identify common characteristics of models that are best able to capture observed features. As models are highly tuned based on present-day data, we will also compare their sensitivity to prescribed abrupt atmospheric perturbations leading to either very warm or slightly warmer ocean conditions compared to the present day. The approach of MISOMIP2 is to welcome contributions of models as they are, including global and regional configurations, but we request standardized variables and common grids for the outputs. We target the analysis at two specific regions, the Amundsen Sea and the Weddell Sea, since they describe two different ocean environments and have been relatively well observed compared to other areas of Antarctica. An observational “MIPkit” synthesizing existing ocean and ice-sheet observations for a common period is provided to evaluate ocean and ice-sheet models in these two regions.

58 GEOSCIENCES↗

The Detection and Attribution Model Intercomparison Project (DAMIP v2.0) contribution to CMIP7

The first version of the Detection and Attribution Model Intercomparison Project (DAMIP v1.0) coordinated key simulations exploring the role of individual forcings in past, current and future climate as part of the Coupled Model Intercomparison Project, Phase 6 (CMIP6). The simulations have been used extensively in the literature for detection and attribution of long-term changes, constraining projections of climate change, attributing extreme events and understanding drivers of past and future simulated climate changes. Attribution studies using DAMIP v1.0 simulations underpinned prominent assessments of human-induced warming in the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report. Here, we describe the set of DAMIP v2.0 simulations, proposed for the next phase of CMIP, CMIP7. Detection and attribution studies rely on pre-industrial control simulations and historical simulations, which will be part of the Diagnostic, Evaluation and Characterization of Klima (DECK) set of simulations for CMIP7. In addition, we identify the three highest-priority single-forcing experiments for CMIP7 to be run as “Assessment Fast Track” simulations in support of the Seventh Assessment Report of the IPCC: simulations with natural forcings only, anthropogenic well-mixed greenhouse gases only and anthropogenic aerosols only. Beyond this, the DAMIP v2.0 experimental design includes full-column ozone-only simulations and land-use-only simulations, such that the set of individual forcing experiments, when these are considered together, represents the full set of historical forcings. While concentration-driven simulations are prioritised for attribution, emissions-driven versions of the DAMIP experiments are also proposed to support understanding of the influence of carbon-cycle feedbacks on the simulated responses to individual forcings.

Gillett, Nathan P. [Environment and Climate Change↗

An evolving Coupled Model Intercomparison Project phase 7 (CMIP7) and Fast Track in support of future climate assessment

The Coupled Model Intercomparison Project (CMIP) coordinates community-based efforts to answer key and timely climate science questions, facilitate delivery of relevant multi-model simulations through shared infrastructure, and support national and international climate assessments. Generations of CMIP have evolved through extensive community engagement from punctuated phasing into more continuous support for the design of experimental protocols, infrastructure for data publication and access, and public delivery of climate information. We identify four fundamental research questions motivating a seventh phase of coupled model intercomparison relating to patterns of sea surface temperature change, changing weather, the water–carbon–climate nexus, and tipping points. Key CMIP7 advances include an expansion of baseline experiments, a focus on CO 2 -emissions-driven experiments, sustained support for community MIPs, periodic updating of historical forcings and diagnostics requests, and a collection of prioritized experiments, or the “Assessment Fast Track”, drawn from community MIPs to support climate research, assessment, and service goals across prediction and projection, characterization, attribution, and process understanding.

Environmental sciences↗

The global gridded crop model intercomparison: Data and modeling protocols for Phase 1 (v1.0)

We present protocols and input data for Phase 1 of the Global Gridded Crop Model Intercomparison, a project of the Agricultural Model Intercomparison and Improvement Project (AgMIP). The project consist of global simulations of yields, phenologies, and many land-surface fluxes using 12–15 modeling groups for many crops, climate forcing data sets, and scenarios over the historical period from 1948 to 2012. The primary outcomes of the project include (1) a detailed comparison of the major differences and similarities among global models commonly used for large-scale climate impact assessment, (2) an evaluation of model and ensemble hindcasting skill, (3) quantification of key uncertainties from climate input data, model choice, and other sources, and (4) a multi-model analysis of the agricultural impacts of large-scale climate extremes from the historical record.

54 ENVIRONMENTAL SCIENCES↗

The Geoengineering Model Intercomparison Project Phase 6 (GeoMIP6): Simulation design and preliminary results

We present a suite of new climate model experiment designs for the Geoengineering Model Intercomparison Project (GeoMIP). This set of experiments, named GeoMIP6 (to be consistent with the Coupled Model Intercomparison Project Phase 6), builds on the previous GeoMIP project simulations, and has been expanded to address several further important topics, including key uncertainties in extreme events, the use of geoengineering as part of a portfolio of responses to climate change, and the relatively new idea of cirrus cloud thinning to allow more long wave radiation to escape to space. We discuss experiment designs, as well as the rationale for those designs, showing preliminary results from individual models when available. We also introduce a new feature, called the GeoMIP Testbed, which provides a platform for simulations that will be performed with a few models and subsequently assessed to determine whether the proposed experiment designs will be adopted as core (Tier 1) GeoMIP experiments. In conclusion, this is meant to encourage various stakeholders to propose new targeted experiments that address their key open science questions, with the goal of making GeoMIP more relevant to a broader set of communities.

58 GEOSCIENCES↗

Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization

By coordinating the design and distribution of global climate model simulations of the past, current, and future climate, the Coupled Model Intercomparison Project (CMIP) has become one of the foundational elements of climate science. However, the need to address an ever-expanding range of scientific questions arising from more and more research communities has made it necessary to revise the organization of CMIP. After a long and wide community consultation, a new and more federated structure has been put in place. It consists of three major elements: (1) a handful of common experiments, the DECK (Diagnostic, Evaluation and Characterization of Klima) and CMIP historical simulations (1850–near present) that will maintain continuity and help document basic characteristics of models across different phases of CMIP; (2) common standards, coordination, infrastructure, and documentation that will facilitate the distribution of model outputs and the characterization of the model ensemble; and (3) an ensemble of CMIP-Endorsed Model Intercomparison Projects (MIPs) that will be specific to a particular phase of CMIP (now CMIP6) and that will build on the DECK and CMIP historical simulations to address a large range of specific questions and fill the scientific gaps of the previous CMIP phases. The DECK and CMIP historical simulations, together with the use of CMIP data standards, will be the entry cards for models participating in CMIP. Participation in CMIP6-Endorsed MIPs by individual modelling groups will be at their own discretion and will depend on their scientific interests and priorities. With the Grand Science Challenges of the World Climate Research Programme (WCRP) as its scientific backdrop, CMIP6 will address three broad questions: – How does the Earth system respond to forcing? – What are the origins and consequences of systematic model biases? – How can we assess future climate changes given internal climate variability, predictability, and uncertainties in scenarios? This CMIP6 overview paper presents the background and rationale for the new structure of CMIP, provides a detailed description of the DECK and CMIP6 historical simulations, and includes a brief introduction to the 21 CMIP6-Endorsed MIPs.

54 ENVIRONMENTAL SCIENCES↗

Experimental design for three interrelated marine ice sheet and ocean model intercomparison projects: MISMIP v. 3 (MISMIP +), ISOMIP v. 2 (ISOMIP +) and MISOMIP v. 1 (MISOMIP1)

Coupled ice sheet-ocean models capable of simulating moving grounding lines are just becoming available. Such models have a broad range of potential applications in studying the dynamics of marine ice sheets and tidewater glaciers, from process studies to future projections of ice mass loss and sea level rise. The Marine Ice Sheet-Ocean Model Intercomparison Project (MISOMIP) is a community effort aimed at designing and coordinating a series of model intercomparison projects (MIPs) for model evaluation in idealized setups, model verification based on observations, and future projections for key regions of the West Antarctic Ice Sheet (WAIS). Here we describe computational experiments constituting three interrelated MIPs for marine ice sheet models and regional ocean circulation models incorporating ice shelf cavities. These consist of ice sheet experiments under the Marine Ice Sheet MIP third phase (MISMIP+), ocean experiments under the Ice Shelf-Ocean MIP second phase (ISOMIP+) and coupled ice sheet-ocean experiments under the MISOMIP first phase (MISOMIP1). All three MIPs use a shared domain with idealized bedrock topography and forcing, allowing the coupled simulations (MISOMIP1) to be compared directly to the individual component simulations (MISMIP+ and ISOMIP+). The experiments, which have qualitative similarities to Pine Island Glacier Ice Shelf and the adjacent region of the Amundsen Sea, are designed to explore the effects of changes in ocean conditions, specifically the temperature at depth, on basal melting and ice dynamics. In future work, differences between model results will form the basis for the evaluation of the participating models.

58 GEOSCIENCES↗

The CMIP6 Sea-Ice Model Intercomparison Project (SIMIP): Understanding sea ice through climate-model simulations

A better understanding of the role of sea ice for the changing climate of our planet is the central aim of the diagnostic Coupled Model Intercomparison Project 6 (CMIP6)-endorsed Sea-Ice Model Intercomparison Project (SIMIP). To reach this aim, SIMIP requests sea-ice-related variables from climate-model simulations that allow for a better understanding and, ultimately, improvement of biases and errors in sea-ice simulations with large-scale climate models. This then allows us to better understand to what degree CMIP6 model simulations relate to reality, thus improving our confidence in answering sea-ice-related questions based on these simulations. Furthermore, the SIMIP protocol provides a standard for sea-ice model output that will streamline and hence simplify the analysis of the simulated sea-ice evolution in research projects independent of CMIP. To reach its aims, SIMIP provides a structured list of model output that allows for an examination of the three main budgets that govern the evolution of sea ice, namely the heat budget, the momentum budget, and the mass budget. Furthermore, we explain the aims of SIMIP in more detail and outline how its design allows us to answer some of the most pressing questions that sea ice still poses to the international climate-research community.

54 ENVIRONMENTAL SCIENCES↗

A comparison of two Stokes ice sheet models applied to the Marine Ice Sheet Model Intercomparison Project for plan view models (MISMIP3d)

Here, we present a comparison of the numerics and simulation results for two "full" Stokes ice sheet models, FELIX-S (Leng et al. 2012) and Elmer/Ice. The models are applied to the Marine Ice Sheet Model Intercomparison Project for plan view models (MISMIP3d). For the diagnostic experiment (P75D) the two models give similar results (< 2 % difference with respect to along-flow velocities) when using identical geometries and computational meshes, which we interpret as an indication of inherent consistencies and similarities between the two models. For the standard (Stnd), P75S, and P75R prognostic experiments, we find that FELIX-S (Elmer/Ice) grounding lines are relatively more retreated (advanced), results that are consistent with minor differences observed in the diagnostic experiment results and that we show to be due to different choices in the implementation of basal boundary conditions in the two models. While we are not able to argue for the relative favorability of either implementation, we do show that these differences decrease with increasing horizontal (i.e., both along- and across-flow) grid resolution and that grounding-line positions for FELIX-S and Elmer/Ice converge to within the estimated truncation error for Elmer/Ice. Stokes model solutions are often treated as an accuracy metric in model intercomparison experiments, but computational cost may not always allow for the use of model resolution within the regime of asymptotic convergence. In this case, we propose that an alternative estimate for the uncertainty in the grounding-line position is the span of grounding-line positions predicted by multiple Stokes models.

54 ENVIRONMENTAL SCIENCES↗

Results of the second Ice Shelf–Ocean Model Intercomparison Project (ISOMIP+)

Ocean-driven basal melting of Antarctic ice shelves plays an important role in the mass loss of the Antarctic Ice Sheet. Ice shelf cavity-resolving ocean models are a valuable tool for understanding ice shelf-ocean interactions and for simulating projections of ice shelf and ocean states under future climate. Designed to assess the current state of ice shelf–ocean modelling, the second Ice Shelf–Ocean Model Intercomparison Project, ISOMIP+, consists of 12 ocean model configurations submitted with a common, idealised experimental setup. Here, we focus on the experiments Ocean0–2 (Asay-Davis et al., 2016), which are ocean models with idealised, static ice shelf geometries, but where the ocean reaches a balance with prescribed far-field ocean conditions. Different thermal transfer coefficient values (ranging from 0.011 to 0.2) are used for each model in the melting parameterisation to achieve a common, tuned melt rate since the models cover a range of types of vertical coordinates, ice–ocean boundary layer treatments, and numerical schemes. These model differences lead to spread in the resultant ocean properties, circulation, boundary-layer structure and spatial distribution of melting. We also highlight similarities between models, such as a shared linear relationship across most models between melt rate and overturning and barotropic streamfunctions during the spin-up and spin-down, demonstrating a robust relationship between melt and circulation across models and forcing conditions. The ISOMIP+ results provide a systematic comparison of ice shelf cavity-capable ocean models. However, we also demonstrate the need for realistic ice shelf–ocean model intercomparison projects (some already underway) to assess model biases and inter-model variation against sparse observations. Further research is needed to understand the differences between models and further improve our modelled representations of the ice–ocean boundary layer and ice shelf cavity circulation.

54 ENVIRONMENTAL SCIENCES↗

Total ozone measurement: Intercomparison of prototype New Zealand filter instrument and Dobson spectrophotometer

A five month intercomparison showed that the total ozone amounts of a prototype narrowband interference filter instrument were 7% less than those of a Dobson instrument for an ozone range of 0.300 to 0.500 atm cm and for airmasses less than two. The 7% bias was within the intercomparison calibration uncertainty. An airmass dependence in the Dobson instrument made the bias relationship airmass-dependent but the filter instrument's ozone values were generally constant to 2% up to an airmass of four. Long term drift in the bias was negligible.

Basher, R. E.↗

Crustal dynamics project session 4 validation and intercomparison experiments 1979-1980 report

As part of the Crustal Dynamics Project, an experiment was performed to verify the ability of Satellite Laser Ranging (SLR), Very Long Baseline interferometry (VLBI) and Doppler Satellite Positioning System (Doppler) techniques to estimate the baseline distances between several locations. The Goddard Space Flight Center (GSFC) lasers were in operation at all five sites available to them. The ten baselines involved were analyzed using monthly orbits and various methods of selecting data. The standard deviation of the monthly SLR baseline lengths was at the 7 cm level. The GSFC VLBI (Mark III) data was obtained during three separate experiments. November 1979 at Haystack and Owens Valley, and April and July 1980 at Haystack, Owens Valley, and Fort Davis. Repeatability of the VLBI in determining baseline lengths was calculated to be at the 2 cm level. Jet Propulsion Laboratory (JPL) VLBI (Mark II) data was acquired on the Owens Valley to Goldstone baseline on ten occasions between August 1979 and November 1980. The repeatability of these baseline length determinations was calculated to be at the 5 cm level. National Geodetic Survey (NGS) Doppler data was acquired at all five sites in January 1980. Repeatability of the Doppler determined baseline lengths results were calculated at approximately 30 cm. An intercomparison between baseline distances and associated parameters was made utilizing SLR, VLBI, and Doppler results on all available baselines. The VLBI and SLR length determinations were compared on four baselines with a resultant mean difference of -1 cm and a maximum difference of 12 cm. The SLR and Doppler length determinations were compared on ten baselines with a resultant mean difference of about 30 cm and a maximum difference of about 60 cm. The VLBI and Doppler lengths from seven baselines showed a resultant mean difference of about 30 cm and maximum difference of about 1 meter. The intercomparison of baseline orientation parameters were consistent with past analysis.

Liebrecht, P.↗

Instrument intercomparisons and assessments

Over the past few years, several field campaigns were devoted to the goal of assessing instrument reliability, as opposed to solely obtaining data to answer a geophysical question. Some examples of the formal instrument intercomparisons that have occurred in the past decade and those that are planned for the very near future are listed chronologically. Balloon-borne techniques and instruments that address the height profiles of the trace species in the lower stratosphere are emphasized. Beginning with the most extensively studied trace constituent, the approach taken and the results obtained, are described. The current status of the measurement capabilities are summarized, and the needs for future intercomparisons and assessments are listed.

Albritton, D. L.↗

Operational overview of Wallops Island instrument intercomparison - Carbon monoxide, nitric oxide, and hydroxyl instrumentation

NASA has initiated the Global Tropospheric Experiment (GTE) for the study of the chemistry of the global troposphere. One phase of GTE, Chemical Instrumentation Test and Evaluation (CITE), is concerned with the development and validation of measurement techniques for trace species which play important roles in the tropospheric chemical cycles. In connection with CITE 1 an intercomparison of instruments is conducted for the measurement of CO, NO, and OH. These species have been identified as critical for an understanding of homogeneous gas-phase chemistry in the troposphere. The present paper provides an operational overview of the first of three instrument intercomparison field missions conducted as part of GTE/CITE 1. The missions include one ground-based and two airborne missions, and were designed to characterize current capability of measuring ambient levels of CO, NO, and OH.

Gregory, G. L.↗

Airborne intercomparison of nitric oxide measurement techniques

Results from an airborne intercomparison of techniques to measure tropospheric levels of nitric oxide (NO) are discussed. The intercomparison was part of the National Aeronautics and Space Administration's Global Tropospheric Experiment and was conducted during missions flown in the fall of 1983 and spring of 1984. Instruments intercompared included a laser-induced fluorescence (LIF) system and two chemiluminescence instruments (CL). NO mixing ratios from below 5 pptv (parts per trillion by volume) to greater than 100 pptv were reported, with the majority less than 20 pptv. Good correlation was observed between the measurements reported by the CL and LIF techniques. The general level of agreement observed for the ensemble of measurements obtained during the two missions provides the basis from which one can conclude that equally 'valid' measurements of background levels of NO can be expected from either CL or LIF instruments. At the same time the periods of disagreement that were observed between the CL and LIF instruments as well as between the two CL instruments highlight the difficulty of obtaining reliable measurements with NO mixing ratios in the 5-20 pptv range and emphasize the vigilance that should be maintained in future NO measurements.

Hoell, James M., Jr.↗

Airborne intercomparisons of carbon monoxide measurement techniques

Results from an airborne intercomparison of techniques to measure tropospheric levels of carbon monoxide (CO) are discussed. The intercomparison was conducted as part of the National Aeronautics and Space Administration's Global Tropospheric Experiment and included a laser differential absorption method and two grab sample/gas chromatograph methods. Measurements were obtained during approximately 90 flight hours, during which the CO mixing ratios ranged from about 60 to 140 ppbv. The level of agreement observed for the ensemble of measurements was well within the overall accuracy stated for each instrument. The correlation observed between the measurements from the respective pairs of instruments ranged from 0.85 to 0.98, with no evidence for the presence of either a constant or proportional bias between any of the instruments.

Hoell, James M., Jr.↗