Search NASA⌕ Search

SEARCH · Search NASA

Results for “intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Forced Component Estimation Statistical Method Intercomparison Project (ForceSMIP)

Anthropogenic climate change is unfolding rapidly, yet its regional manifestation can be obscured by internal variability. A primary goal of climate science is to identify the externally forced climate response from among the noise of internal variability. Separating the forced response from internal variability can be addressed in climate models by using a large ensemble to average over different possible realizations of internal variability. However, with only one realization of the real world, it is a major challenge to isolate the forced response directly in observations. In the Forced Component Estimation Statistical Method Intercomparison Project (ForceSMIP), contributors used existing and newly developed statistical and machine learning methods to estimate the forced response over 1950–2022 within individual realizations of the climate system. Participants used neural networks, linear inverse models, fingerprinting methods, and low-frequency component analysis, among other approaches. These methods were trained using large ensembles from multiple climate models and then applied to observations. Here, we evaluate method performance within large ensembles and investigate the estimates of the forced response in observations. Our results show that many different types of methods are skillful for estimating the forced response in climate models, though the relative skill of individual methods varies depending on the variable and evaluation metric. Methods with comparable skill in models can give a wide range of estimates of the forced response pattern in observations, illustrating the epistemic uncertainty in forced response estimates. ForceSMIP gives new insights into the forced response in observations, its uncertainty, and methods for its estimation.

Climate attribution↗
DOE OSTI2024

Initial Results of the Nuclear Accident Dosimetry Intercomparison at the Armed Forces Radiobiology Research Institute's TRIGA Reactor

This report presents the initial results for IER-602, the international nuclear accident dosimetry intercomparison performed at the Armed Forces Radiobiology Research Institute (AFRRI). Ten groups participated (six DOE laboratories, three international groups, and one DOD group) in a week-long exercise in late June 2024. Two additional groups observed the exercise (one DOE laboratory, one university). Three days of irradiations were performed, and participants reported results within 24 hours of the irradiations. Results were compared to the reference values and performance criteria established by IER-484 AFRRI ER1 Dosimetry Characterization and ANSI/HPS N13.3-2013, respectively. Passing performance varied from 17% to 100%, with an average of 67%.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2026

Logistics for the 2026 International Nuclear Accident Dosimetry Intercomparison Exercise

The purpose of this exercise is to test participants’ nuclear accident dosimeters (NADs) and personnel to the requirements established by American National Standards Institute (ANSI), Health Physics Society (HPS) standard ANSI/HPS-N13.3-2013 (R2025) Dosimetry for Criticality Accidents. IER-634 is the second nuclear accident dosimetry exercise taking place at the Armed Forces Radiobiology Research Institute (AFRRI) in Bethesda, MD, a Department of Defense (DOD) facility. This effort continues use of the high-dose neutron exposure test bed maintained by the DOD and represents the continued collaboration between the DOD and Department of Energy (DOE). Previous work at AFRRI included a reactor characterization (IER 484) in 2023 and a nuclear accident intercomparison exercise (IER-602) in 2024.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

The Aerosol Model Benchmarking Repository: A toolkit for model intercomparison

The Aerosol Model Benchmarking Repository and Standards (AMBRS) project was initiated to provide tools and to establish community standards for benchmarking aerosol models. This report describes a set of open-source tools for building, running, and analyzing aerosol box model simulations in a standardized framework. The framework consists of three core components: AMBuilder, a CMake-based build system that compiles supported models consistently; AMBRS, a Python module that defines unified numerical experiments and executes them with aligned inputs; and PyParticle, an aerosol analysis package that standardizes output, computes diagnostics, and visualizes simulation results. Together, these tools enable reproducible intercomparison of aerosol schemes and support process-level evaluation of how model simplifications affect predictions of size distributions, cloud condensation nuclei activity, and other relevant properties relevant for the Earth-Energy system. Beyond its role in benchmarking, AMBRS provides a platform for studying aerosol processes across scales and can be used to generate training data for AI/ML applications in support of a broader hierarchical aerosol modeling strategy.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Corrigendum to “The Emissions Model Intercomparison Project (Emissions-MIP): quantifying model sensitivity to emission characteristics” published in Atmos. Chem. Phys., 23, 14779–14799, 2023

Anthropogenic emissions of aerosols and precursor compounds are known to significantly affect the energy balance of the Earth–atmosphere system, alter the formation of clouds and precipitation, and have a substantial impact on human health and the environment. Global models are an essential tool for examining the impacts of these emissions. In this study, we examine the sensitivity of model results to the assumed height of SO 2 injection, seasonality of SO 2 and black carbon (BC) particulate emissions, and the assumed fraction of SO 2 emissions that is injected into the atmosphere as particulate phase sulfate (SO 4 ) in 11 climate and chemistry models, including both chemical transport models and the atmospheric component of Earth system models. We find large variation in atmospheric lifetime across models for SO 2 , SO 4 , and BC, with a particularly large relative variation for SO 2 , which indicates that fundamental aspects of atmospheric sulfur chemistry remain uncertain. Of the perturbations examined in this study, the assumed height of SO 2 injection had the largest overall impacts, particularly on global mean net radiative flux (maximum difference of -0.35?W?m-2), SO2 lifetime over Northern Hemisphere land (maximum difference of 0.8?d), surface SO 2 concentration (up to 59?% decrease), and surface sulfate concentration (up to 23?% increase). Emitting SO 2 at height consistently increased SO 2 and SO 4 column burdens and shortwave cooling, with varying magnitudes, but had inconsistent effects across models on the sign of the change in implied cloud forcing. The assumed SO 4 emission fraction also had a significant impact on net radiative flux and surface sulfate concentration. Because these properties are not standardized across models this is a source of inter-model diversity typically neglected in model intercomparisons. These results imply a need to ensure that anthropogenic emission injection height and SO 4 emission fraction are accurately and consistently represented in global models.

Ahsan, Hamza [Pacific Northwest National Laborator↗
DOE OSTI2024

Measurement report: The Fifth International Workshop on Ice Nucleation phase 1 (FIN-01): intercomparison of single-particle mass spectrometers

Knowledge of the chemical composition and mixing state of aerosols at a single-particle level is critical for gaining insights into atmospheric processes. One common tool to make these measurements is single-particle mass spectrometry. There remains a need to compare the performance of different single-particle mass spectrometers (SPMSs). An intercomparison of SPMSs was conducted at the Aerosol Interaction and Dynamics in the Atmosphere (AIDA) chamber at the Karlsruhe Institute of Technology (KIT) in November 2014, as part of the first phase of the Fifth International Workshop on Ice Nucleation (FIN-01). In this paper we compare size distributions and mass spectra of atmospherically relevant particle types measured by five SPMSs. These include different minerals, desert and soil dusts, soot, bioaerosol (Snomax; protein granule), secondary organic aerosol (SOA), and SOA-coated mineral particles. Most SPMSs reported similar vacuum aerodynamic diameter (d va ) within typical instrumental ranges from ~100–200 nm (lower limit) to ~2–3 µm (upper limit). In general, all SPMSs exhibited a wide dynamic range (up to ~10 3 ) and high signal-to-noise ratio (up to ~10 4 ) in mass spectra. Common spectral features with small diversities in mass spectra were found with high average Pearson's correlation coefficients, i.e., for average positive spectra r avg-pos =0.74 ± 0.12 and average negative spectra r avg-neg =0.67 ± 0.22. We found that instrument-specific detection efficiency (DE) was more dependent on particle size than particle type, and particle identification favored the use of bipolar, rather than monopolar, instruments. Particle classification from “blind experiments” showed that all instruments differentiated SOA, soot, and soil dust and detected subtle changes in the particle internal mixing but had difficulties differentiating among specific mineral types and dusts. This study helps to further understand the capabilities and limitations of the single-particle mass spectrometry technique in general and the specific performance of the instrument in characterizing atmospheric aerosol particles.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Quantification of regional net CO 2 flux errors in the Orbiting Carbon Observatory-2 (OCO-2) v10 model intercomparison project (MIP) ensemble using airborne measurements

Inverse model intercomparison projects (MIPs) provide a chance to assess the uncertainties in inversion estimates arising from various sources. However, accurately quantifying ensemble CO 2 flux errors remains challenging and often relies on the ensemble spread. This study proposes a method for quantifying the errors in regional net surface–atmosphere CO 2 flux estimates from models taken from the Orbiting Carbon Observatory-2 (OCO-2) v10 MIP by using independent airborne CO 2 measurements for the period 2015–2017. We first calculate the root mean square error (RMSE) between the ensemble mean of posterior CO 2 concentrations and airborne observations and then isolate the CO 2 concentration errors caused solely by the ensemble mean of posterior net fluxes by subtracting the observation, representation, and transport errors from seven regions. Our analysis reveals that the flux errors projected onto CO 2 space account for 55 %–85 % of the regional average RMSE over the 3 years, ranging from 0.88 to 1.91 ppm. In five regions, the error estimates based on observations exceed those computed from the ensemble spread of posterior fluxes by a factor of 1.33–1.93, implying an underestimation of the actual flux errors, while their magnitudes are comparable in two regions. The adjoint sensitivity analysis identifies that the underestimation of flux errors is prominent where the magnitudes of fossil fuel emissions exceed those of terrestrial-biosphere fluxes by a factor of 3–31 over the 3 years. This suggests the presence of systematic biases in the inversion estimates associated with errors in the prescribed fossil fuel emissions common to all models. Our study emphasizes the value of airborne measurements for quantifying regional errors in ensemble net CO 2 flux estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Field intercomparison of ice nucleation measurements: the Fifth International Workshop on Ice Nucleation Phase 3 (FIN-03)

Abstract. The third phase of the Fifth International Ice Nucleation Workshop (FIN-03) was conducted at the Storm Peak Laboratory in Steamboat Springs, Colorado, in September 2015 to facilitate the intercomparison of instruments measuring ice-nucleating particles (INPs) in the field. Instruments included two online and four offline measurement systems for INPs, which are a subset of those utilized in the laboratory study that comprised the second phase of FIN (FIN-02). The composition of the total aerosols was characterized using the Particle Analysis by Laser Mass Spectrometry (PALMS) and Wideband Integrated Bioaerosol Sensor (WIBS) instruments, and aerosol size distributions were measured by a laser aerosol spectrometer (LAS). The dominant total particle compositions present during FIN-03 were composed of sulfates, organic compounds, and nitrates, as well as particles derived from biomass burning. Mineral-dust-containing particles were ubiquitous throughout and represented 67 % of supermicron particles. Total WIBS fluorescing particle concentrations for particles with diameters of > 0.5 µm were 0.04 ± 0.02 cm−3 (0.1 cm−3 highest; 0.02 cm−3 lowest), typical of the warm season in this region and representing ≈ 9 % of all particles in this size range as a campaign average. The primary focus of FIN-03 was the measurement of INP concentrations via immersion freezing at temperatures > −33 °C. Additionally, some measurements were made in the deposition nucleation regime at these same temperatures, representing one of the first efforts to include both mechanisms within a field campaign. INP concentrations via immersion freezing agreed within factors ranging from nearly 1 to 5 times on average between matched (time and temperature) measurements, and disagreements only rarely exceeded 1 order of magnitude for sampling times coordinated to within 3 h. Comparisons were restricted to temperatures lower than −15 °C due to the limits of detection related to sample volumes and very low INP concentrations. Outliers of up to 2 orders of magnitude occurred between −25 and −18 °C; a better agreement was seen at higher and lower temperatures. Although the 5–10 factor agreement of INP measurements found in FIN-03 aligned with the results of the FIN-02 laboratory comparison phase, giving confidence in progress of this measurement field, this level of agreement still equates to temperature uncertainties of 3.5 to 5 °C that may not be sufficient for numerical cloud modeling applications that utilize INP information. INP activity in the immersion-freezing mode was generally found to be an order of magnitude or more, making it more efficient than in the deposition regime at 95 %–99 % water relative humidity, although this limited data set should be augmented in future efforts. To contextualize the study results, an assessment was made of the composition of INPs during the late-summer to early-fall period of this study inferred through comparison to existing ice nucleation parameterizations and through measurement of the influence of thermal and organic carbon digestion treatments on immersion-freezing ice nucleation activity. Consistent with other studies in continental regions, biological INPs dominated at temperatures of > −20 °C and sometimes colder, while arable dust-like or other organic-influenced INPs were inferred to dominate below −20 °C.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

RCEMIP-II: mock-Walker simulations as phase II of the radiative–convective equilibrium model intercomparison project

Abstract. The radiative–convective equilibrium (RCE) model intercomparison project (RCEMIP) leveraged the simplicity of RCE to focus attention on moist convective processes and their interactions with radiation and circulation across a wide range of model types including cloud-resolving models (CRMs), general circulation models (GCMs), single-column models, global cloud-resolving models, and large-eddy simulations. While several robust results emerged across the spectrum of models that participated in the first phase of RCEMIP (RCEMIP-I), two points that stand out are (1) the strikingly large diversity in simulated climate states and (2) the strong imprint of convective self-aggregation on the climate state. However, the lack of consensus in the structure of self-aggregation and its response to warming is a barrier to understanding. Gaining a deeper understanding of convective aggregation and tropical climate will require reducing the degrees of freedom with which convection can vary. Therefore, we propose phase II of RCEMIP (RCEMIP-II) that utilizes a prescribed sinusoidal sea surface temperature (SST) pattern to provide a constraint on the structure of convection and move one critical step up the model hierarchy. This so-called “mock-Walker” configuration generates features that resemble observed tropical circulations. The specification of the mock-Walker protocol for RCEMIP-II is described, along with example results from one CRM and one GCM. RCEMIP-II will consist of five required simulations: three simulations with the same three mean SSTs as in RCEMIP-I but with an SST gradient and two additional simulations at one of the mean SSTs with different values of the SST gradients. We also test the sensitivity to the imposed SST gradient and the domain size. Under weak SST gradients, unforced self-aggregation emerges across the entire domain, similar to what was found in RCEMIP. As the SST gradient increases, the convective region narrows and is more confined to the warmest SSTs. At warmer mean SSTs and stronger SST gradients, low-frequency variability in the convective aggregation emerges, suggesting that simulations of at least 200 d may be needed to achieve robust equilibrium statistics in this configuration. Simulations with different domain sizes generally have similar mean statistics and convective structures, depending on the value of the SST gradient. The prescribed SST boundary condition is the only difference in the set-up between RCEMIP-II and RCEMIP-I, which enables comparison between the two; however, we also welcome participation in RCEMIP-II from models that did not participate in RCEMIP-I.

Geology↗
DOE OSTI2025

The Tropical Basin Interaction Model Intercomparison Project (TBIMIP)

Abstract. Large-scale interaction between the three tropical ocean basins is an area of intense research that is often conducted through experimentation with numerical models. A common problem is that modeling groups use different experimental setups, which makes it difficult to compare results and delineate the role of model biases from differences in experimental setups. To address this issue, an experimental protocol for examining interaction between the tropical basins is introduced. The Tropical Basin Interaction Model Intercomparison Project (TBIMIP) consists of experiments in which sea surface temperatures (SSTs) are prescribed to follow observed values in selected basins. There are two types of experiments. One type, called standard pacemaker, consists of simulations in which SSTs are restored to observations in selected basins during a historical simulation. The other type, called pacemaker hindcast, consists of seasonal hindcast simulations in which SSTs are restored to observations during 12-month forecast periods. TBIMIP is coordinated by the Climate and Ocean – Variability, Predictability, and Change (CLIVAR) Research Focus on Tropical Basin Interaction. The datasets from the model simulations will be made available to the community to facilitate and stimulate research on tropical basin interaction and its role in seasonal-to-decadal variability and climate change.

Richter, Ingo↗
NASA NTRS1968

Intercomparison of GEOS-A observation systems.

NASA geodetic Satellite Observation Systems Intercomparison Investigation, discussing Goddard Range and Range Rate, Laser and MOTS camera systems, AF PC-1000 camera, etc

Berbert, J. H.↗