Search NASA⌕ Search

SEARCH · Search NASA

Results for “intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

High-Latitude, Low-Altitude SAI: Overview of G6-1.5K-HiLLA Simulations in E3SMv3

This report details a contribution of Energy Exascale Earth System Model version 3 (E3SMv3) simulations to a proposed model intercomparison project funded and organized by Reflective, a nonprofit group studying the possible global impacts of SAI. Using annual feedback control and seasonally-variable injection sites to achieve a desired global near-surface temperature target, the simulated SAI campaign indicates robust maintenance of the 2020-2039 climatic state over 60 years into the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Report on the Atmospheric Temperature Changes and their Drivers (ATC) Activity 2025 Spring Meeting

The Atmospheric Temperature Change and their Drivers (ATC) Activity brings together experts interested in improving understanding of atmospheric temperature variability and trends and their representation in climate data records. ATC pursues this goal by fostering intercomparisons of atmospheric temperature datasets, providing and improving uncertainty information for climate data records, comparing observations with model simulations, assessing atmospheric temperature trends and their drivers, and documenting their efforts in review papers and assessment reports. The ATC activity convened at the Wegener Center for Climate and Global Change at the University of Graz in Graz, Austria over April 23 – 25. The purpose of the meeting was to provide updates on research and datasets related to atmospheric temperature change and variability, to identify areas that need further research, and to coordinate ongoing and future collaborations. Meeting themes included theoretical and simulated controls on atmospheric temperature, the development of new and improved atmospheric temperature datasets, and analysis of atmospheric temperature variability and trends. 18 activity members attended the meeting including 12 in-person attendees and 6 remote attendees. Four new early career activity members attended with support from APARC.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Joint Sample Analyses of Nuclear Forensic Materials Provided by the Republic of Kazakhstan: U. S. Laboratory Results

This document serves as an interim report to summarize sample analyses performed by Lawrence Livermore National Laboratory (LLNL) and Los Alamos National Laboratory (LANL) on a series of five nuclear forensics samples provided by the Institute of Nuclear Physics (INP) in the Republic of Kazakhstan. The sample set contains four uranium oxide powders and one low-enriched uranium fuel pellet. The samples were provided as part of a broader collaboration that involved a set of joint sample analyses conducted by INP and the US National Laboratories. The joint analyses are being conducted using well-developed analytical plans. These activities are designed to support the advancement of nuclear forensic science and capacity building in all three institutes in both countries. This report builds upon an earlier preliminary summary of the joint interactions and will be augmented by a final report. The final report will summarize the results and value of all sample analyses performed at the three institutes (INP, LLNL, and LANL). The final report will also provide an intercomparison of the results, analytical methods and best practices employed, as well as outline future collaborative nuclear forensics activities that are being developed in the Kazakhstan region.

and nuclear chemistry↗
DOE OSTI2025

ILAMBv2.7 benchmarking results comparing E3SMv2.1 land-atmosphere coupled (BGCv2LNDATM) and stand alone land (ELM) simulations with CMIP6 emission driven historical simulations

This dataset contains land model benchmarking results for the Energy Exascale Earth System Model version 2.1 (E3SMv2.1), including outputs from both coupled biogeochemistry simulations and stand-alone land model simulations. These results are compared against several emission-driven historical simulations from the Coupled Model Intercomparison Project Phase 6 (CMIP6). Benchmarking was conducted using the International Land Model Benchmarking (ILAMB) package, version 2.7 (ILAMBv2.7). CMIP6 model outputs were sourced from the Earth System Grid Federation (ESGF), while the E3SMv2.1 results were derived from raw model outputs. These outputs underwent processing steps such as time serialization, conservative regridding, and data standardization to ensure comparability. For spatial interpolation, the Earth System Modeling Framework (ESMF) tool, ESMF_RegridWeightGen, was employed to generate regridding weights, enabling the transformation of E3SM’s native cubed-sphere grid to a regular latitude-longitude grid.

Feng, Sha [PNNL]↗
DOE OSTI2025

Geochemistry of Mars with Laser-Induced Breakdown Spectroscopy (LIBS): ChemCam, SuperCam, and MarSCoDe

Laser-induced breakdown spectroscopy (LIBS) has been used to explore the chemistry of three regions of Mars on respective missions by NASA and CNSA, with CNES contributions. All three LIBS instruments use ~100 mm diameter telescopes projecting pulsed infrared laser beams of 10–14 mJ to enable LIBS at 2–10 m distances, eliminating the need to position the rover and instrument directly onto targets. Over 1.3 million LIBS spectra have been used to provide routine compositions for eight major elements and several minor and trace elements on >3000 targets on Mars. Onboard calibration targets common to all three instruments allow careful intercomparison of results. Operating over thirteen years, ChemCam on Curiosity has explored lacustrine sediments and diagenetic features in Gale crater, which was a long-lasting (>1 My) lake during Mars’ Hesperian period. SuperCam on Perseverance is exploring the ultramafic igneous floor, fluvial–deltaic features, and the rim of Jezero crater. MarSCoDe on the Zhurong rover investigated for one year the local blocks, soils, and transverse aeolian ridges of Utopia Planitia. The pioneering work of these three stand-off LIBS instruments paves the way for future space exploration with LIBS, where advantages of light-element (H, C, N, O) quantification can be used on icy regions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Modelling Tritium Production and Release at High-Energy Proton Accelerators

Tritium is a well-known byproduct of particle accelerator operations. To keep levels of tritium below regulatory limits, tritium production is actively monitored and managed at Fermilab. We plan to study tritium production in the targets, beamline components, and shielding elements of the Fermilab facilities such as NuMI, BNB, and MI-65. To facilitate the analysis, we construct a simple model and use three Monte Carlo radiation codes, FLUKA, MARS, and PHITS, to estimate the amount of tritium produced in these facilities. The analysis could also serve as an intercomparison between these code results related to tritium production. To assess the actual amounts of tritium that would be released from various materials, we employ a semi-empirical diffusion model. The results of this analysis are compared to experimental data whenever possible. This approach also helps to optimize proposed target materials with respect to the tritium production and release.

Georgobiani, Dali [Fermilab]↗
DOE OSTI2026

Distinct drivers of recent seasonal precipitation increase over Central Asia: roles of anthropogenic aerosols and greenhouse gases

Observational evidence reveals a pronounced wetting trend over Central Asia in recent decades, with the most substantial increases occurring during winter and summer. Yet the extent to which the drivers of these changes differ seasonally remains unknown. Here, we use single-forcing experiments from the Precipitation Driver and Response Model Intercomparison Project (PDRMIP) to examine the effects of various external forcings on winter and summer precipitation across Central Asia and to explore the physical mechanisms underlying seasonal precipitation changes. We find that greenhouse gas (GHG) forcing mainly increases winter precipitation by enhancing atmospheric moisture content through warming. In contrast, in summer, Asian sulfate aerosols enhance precipitation by modulating the westerly jet, which strengthens atmospheric moisture transport into the region. Asian black carbon exerts an opposing influence that partially offsets the sulfate-induced effect. Further attribution analysis based on CMIP6 simulations reinforces these sensitivity results and shows that GHG forcing is the primary driver of winter precipitation increases whereas anthropogenic aerosols dominate summer trends. Future CMIP6 projections suggest that under moderate- to high-emission scenarios, winter precipitation will continue to rise due to increasing GHG concentrations, while summer precipitation may decline across much of Central Asia as a result of reduced aerosol emissions following Asian clean air policies. These findings highlight a distinct seasonality in the drivers of recent precipitation increase and suggest a plausible divergence in future winter and summer precipitation trends.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Marine and continental stratocumulus cloud microphysical properties obtained from routine ARM Cimel sunphotometer observations

This study investigates marine and continental stratocumulus (Sc) cloud properties obtained from an automated implementation of a multispectral photometer retrieval. Photometer methods simultaneously retrieve cloud optical depth (τ) and cloud droplet effective radius (r e ), with estimates for liquid water path (LWP) calculated on the availability of those quantities. These applied methods evaluate retrieved cloud properties for Sc identified during a recent 6 year period over the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) program sites in Oklahoma, USA (SGP) and in the Azores, Portugal (ENA). Modest agreement in key quantity retrievals is found between the routine photometer products and multisensor collocated profiling references. Cumulative breakdowns contingent on cloud thickness indicate increases in all retrieved quantities in thicker clouds, with larger discrepancies in the relative performance between the retrievals collected in the presence of drizzle. Under continental cloud conditions, the clouds of a similar thickness and r e to those sampled under marine conditions report a factor of 1.5 larger τ and LWP. An r 2 ≅0.65 is found between photometer τ retrievals and shadowband radiometer measurements, with photometer retrievals reporting a high (relative) bias. The τ intercomparisons indicate that variability between retrievals is a factor of three larger than errors reported from individual retrieval input perturbation tests. Photometer r e retrievals suggest a low r 2 (< 0.1) having a standard deviation ≅ 3 µm when compared to ARM baseline multi-sensor radar/radiometer references (accounting for offsets in the cloud droplet number concentration assumptions of the latter). However, photometer LWP calculations remain relatively unbiased in non-drizzling conditions, with errors O (50 g m −2 ) and r 2 ≅0.5 to collocated radiometer and interferometer references. Additional sensitivity tests for island influences on marine Sc properties suggest that while island-influenced winds may promote larger cloud LWP or thickness, the influence could be within retrieval method uncertainty and/or collocated instrument variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Laboratory and field assessment of mid-infrared absorption (MIRA) instrument performance for methane and ethane dry mole fractions

Concurrent measurements of methane (CH 4 ) and ethane (C 2 H 6 ) can be used to identify and separate methane sources, as ethane is present in thermogenic sources (e.g., oil and natural gas) but not in biogenic sources (e.g., agriculture). In this study, we evaluated the performance of multiple Aeris MIRA Ultra instruments (Versions 1 and 2) through controlled laboratory tests and tower-based deployments under field conditions. The systems were modified with an external pump, flow control, a Nafion dryer, and a custom-built auxiliary box to automate the system and transmit near real-time data. We determined the best calibration approach for our application, given practical limitations, to be a full calibration cycle (with ambient and high calibration cylinders) about once per day and an ambient calibration cylinder sampled hourly. Measurement uncertainty was assessed, including the uncertainty due to instrument noise as a function of calibration frequency, uncertainty in the water vapor correction, and cylinder assignment uncertainty. Instrument noise was the dominant source of uncertainty for C 2 H 6 , while the water vapor correction dominated the CH 4 uncertainty. For Version 2 systems with hourly calibrations and a Nafion dryer with counterflow, the mean total uncertainty, including both systematic errors and noise, of hourly averages was 0.8–3.0 ppb CH 4 and 0.35–0.37 ppb C 2 H 6 . Laboratory intercomparisons showed network compatibility within 1.2 ppb CH 4 and 0.23 ppb C 2 H6, and a collocated deployment with a NOAA Picarro system agreed within 1.8 ppb CH 4 . Instrument noise varied substantially amongst the instruments, with errors reaching up to 11 ppb CH 4 and 2 ppb C 2 H 6 for hourly means, with similar variability indicated in a 50 h cylinder test. With appropriate engineering and calibration, the Aeris MIRA Ultra has the potential to distinguish regional methane emission sources in many field settings.

03 NATURAL GAS↗
DOE OSTI2024

Observational benchmarks inform representation of soil organic carbon dynamics in land surface models

Abstract. Representing soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon–climate feedbacks. Machine learning models can help identify dominant environmental controllers and establish their functional relationships with SOC stocks. The resulting knowledge can be integrated into ESMs to reduce uncertainty and improve predictions of SOC dynamics over space and time. In this study, we used a large number of SOC field observations (n=54 000), geospatial datasets of environmental factors (n=46), and two machine learning approaches (namely random forest, RF, and generalized additive modeling, GAM) to (1) identify dominant environmental controllers of global and biome-specific SOC stocks, (2) derive functional relationships between environmental controllers and SOC stocks, and (3) compare the identified environmental controllers and predictive relationships with those in models used in Phase 6 of the Coupled Model Intercomparison Project (CMIP6). Our results showed that the diurnal temperature, drought index, cation exchange capacity, and precipitation were important observed environmental predictors of global SOC stocks. While the RF model identified 14 environmental factors that describe climatic, vegetation, and edaphic conditions as important predictors of global SOC stocks (R2=0.61, RMSE = 0.46 kg m−2), current ESMs oversimplify the relationships between environmental factors and SOC, with precipitation, temperature, and net primary productivity explaining > 96 % of the variability in ESM-modeled SOC stocks. Further, our study revealed notable disparities among the functional relationships between environmental factors and SOC stocks simulated by ESMs compared with observed relationships. To improve SOC representations in ESMs, it is imperative to incorporate additional environmental controls, such as the cation exchange capacity, and refine the functional relationships to align more closely with observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results

Accurate representation of the turbulent exchange of carbon, water, and heat between the land surface and the atmosphere is critical for modelling global energy, water, and carbon cycles in both future climate projections and weather forecasts. Evaluation of models' ability to do this is performed in a wide range of simulation environments, often without explicit consideration of the degree of observational constraint or uncertainty and typically without quantification of benchmark performance expectations. We describe a Model Intercomparison Project (MIP) that attempts to resolve these shortcomings, comparing the surface turbulent heat flux predictions of around 20 different land models provided with in situ meteorological forcing evaluated with measured surface fluxes using quality-controlled data from 170 eddy-covariance-based flux tower sites. Predictions from seven out-of-sample empirical models are used to quantify the information available to land models in their forcing data and so the potential for land model performance improvement. Sites with unusual behaviour, complicated processes, poor data quality, or uncommon flux magnitude are more difficult to predict for both mechanistic and empirical models, providing a means of fairer assessment of land model performance. When examining observational uncertainty, model performance does not appear to improve in low-turbulence periods or with energy-balance-corrected flux tower data, and indeed some results raise questions about whether the energy balance correction process itself is appropriate. In all cases the results are broadly consistent, with simple out-of-sample empirical models, including linear regression, comfortably outperforming mechanistic land models. In all but two cases, latent heat flux and net ecosystem exchange of CO 2 are better predicted by land models than sensible heat flux, despite it seeming to have fewer physical controlling processes. Land models that are implemented in Earth system models also appear to perform notably better than stand-alone ecosystem (including demographic) models, at least in terms of the fluxes examined here. The approach we outline enables isolation of the locations and conditions under which model developers can know that a land model can improve, allowing information pathways and discrete parameterisations in models to be identified and targeted for future model development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Changing effects of external forcing on Atlantic–Pacific interactions

Recent studies have highlighted the increasingly dominant role of external forcing in driving Atlantic and Pacific Ocean variability during the second half of the 20th century. This paper provides insights into the underlying mechanisms driving interactions between modes of variability over the two basins. We define a set of possible drivers of these interactions and apply causal discovery to reanalysis data, two ensembles of pacemaker simulations where sea surface temperatures in either the tropical Pacific or the North Atlantic are nudged to observations, and a pre-industrial control run. We also utilize large-ensemble means of historical simulations from the Coupled Model Intercomparison Project Phase 6 (CMIP6) to quantify the effect of external forcing and improve the understanding of its impact. A causal analysis of the historical time series between 1950 and 2014 identifies a regime switch in the interactions between major modes of Atlantic and Pacific climate variability in both reanalysis and pacemaker simulations. A sliding window causal analysis reveals a decaying El Niño–Southern Oscillation (ENSO) effect on the Atlantic as the North Atlantic fluctuates towards an anomalously warm state. The causal networks also demonstrate that external forcing contributed to strengthening the Atlantic's negative-sign effect on ENSO since the mid-1980s, where warming tropical Atlantic sea surface temperatures induce a La Niña-like cooling in the equatorial Pacific during the following season through an intensification of the Pacific Walker circulation. The strengthening of this effect is not detected when the historical external forcing signal is removed in the Pacific pacemaker ensemble. The analysis of the pre-industrial control run supports the notion that the Atlantic and Pacific modes of natural climate variability exert contrasting impacts on each other even in the absence of anthropogenic forcing. The interactions are shown to be modulated by the (multi)decadal states of temperature anomalies of both basins with stronger connections when these states are “out of phase”. We show that causal discovery can detect previously documented connections and provides important potential for a deeper understanding of the mechanisms driving changes in regional and global climate variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Long-term measurements of ice nucleating particles at Atmospheric Radiation Measurement (ARM) sites worldwide

Ice nucleating particles (INPs) play a critical role in cloud microphysics and precipitation formation, yet long-term, spatially extensive observational datasets remain limited. Here, we present one of the most comprehensive publicly available datasets of immersion-mode INP concentrations using a single analytical method, generated through the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility. INP filter samples have been collected across a broad range of environments – including agricultural plains, Arctic coastlines, high-elevation mountain sites, marine regions, and urban areas – via fixed observatories, mobile facility deployments, and vertically-resolved tethered balloon system operations. We describe the standardized processing and quality assurance pipeline, from filter collection and processing using the Ice Nucleation Spectrometer to final data products archived on the ARM Data Discovery portal. The dataset includes both total INP concentrations and selectively treated samples, allowing for classification of biological, organic, and inorganic INP types. It features a continuous 5-year record of INP measurements from a central U.S. site, with data collection still ongoing. Seasonal and site-specific differences in INP concentrations are illustrated through intercomparisons at −10 and −20 °C, revealing distinct regional sources and atmospheric drivers. We also outline mechanisms for researchers to access existing data, request additional sample analyses, and propose future field campaigns involving ARM INP measurements. This dataset supports a wide range of scientific applications, from observational and mechanistic studies to model development, and provides critical constraints on aerosol-cloud interactions across diverse atmospheric regimes (Creamean et al., 2024, 2020b; https://doi.org/10.5439/1770816).

Creamean, Jessie M. [Colorado State Univ., Fort Co↗
DOE OSTI2024

Hector V3.2.0: functionality and performance of a reduced-complexity climate model

Abstract. Hector is an open-source reduced-complexity climate–carbon cycle model that models critical Earth system processes on a global and annual basis. Here, we present an updated version of the model, Hector V3.2.0 (hereafter Hector V3), and document its new features, implementation of new science, and performance. Significant new features include permafrost thaw, a reworked energy balance submodel, and updated parameterizations throughout. Hector V3 results are in good general agreement with historical observations of atmospheric CO2 concentrations and global mean surface temperature, and the future temperature projections from Hector V3 are consistent with more complex Earth system model output data from the sixth phase of the Coupled Model Intercomparison Project. We show that Hector V3 is a flexible, performant, robust, and fully open-source simulator of global climate changes. We also note its limitations and discuss future areas for improvement and research with respect to the model's scientific, stakeholder, and educational priorities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The need for carbon-emissions-driven climate projections in CMIP7

Abstract. Previous phases of the Coupled Model Intercomparison Project (CMIP) have primarily focused on simulations driven by atmospheric concentrations of greenhouse gases (GHGs), for both idealized model experiments and climate projections of different emissions scenarios. We argue that although this approach was practical to allow parallel development of Earth system model simulations and detailed socioeconomic futures, carbon cycle uncertainty as represented by diverse, process-resolving Earth system models (ESMs) is not manifested in the scenario outcomes, thus omitting a dominant source of uncertainty in meeting the Paris Agreement. Mitigation policy is defined in terms of human activity (including emissions), with strategies varying in their timing of net-zero emissions, the balance of mitigation effort between short-lived and long-lived climate forcers, their reliance on land use strategy, and the extent and timing of carbon removals. To explore the response to these drivers, ESMs need to explicitly represent complete cycles of major GHGs, including natural processes and anthropogenic influences. Carbon removal and sequestration strategies, which rely on proposed human management of natural systems, are currently calculated in integrated assessment models (IAMs) during scenario development with only the net carbon emissions passed to the ESM. However, proper accounting of the coupled system impacts of and feedback on such interventions requires explicit process representation in ESMs to build self-consistent physical representations of their potential effectiveness and risks under climate change. We propose that CMIP7 efforts prioritize simulations driven by CO2 emissions from fossil fuel use and projected deployment of carbon dioxide removal technologies, as well as land use and management, using the process resolution allowed by state-of-the-art ESMs to resolve carbon–climate feedbacks. Post-CMIP7 ambitions should aim to incorporate modeling of non-CO2 GHGs (in particular, sources and sinks of methane and nitrous oxide) and process-based representation of carbon removal options. These developments will allow three primary benefits: (1) resources to be allocated to policy-relevant climate projections and better real-time information related to the detectability and verification of emissions reductions and their relationship to expected near-term climate impacts, (2) scenario modeling of the range of possible future climate states including Earth system processes and feedbacks that are increasingly well-represented in ESMs, and (3) optimal utilization of the strengths of ESMs in the wider context of climate modeling infrastructure (which includes simple climate models, machine learning approaches and kilometer-scale climate models).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evaluation of Global Fire Simulations in CMIP6 Earth System Models

Fire is the primary form of terrestrial ecosystem disturbance on a global scale and an important Earth system process. Most Earth system models (ESMs) have incorporated fire modeling, with 19 of them submitting model outputs of fire-related variables to the Coupled Model Intercomparison Project Phase 6 (CMIP6). This study provides the first comprehensive evaluation of CMIP6 historical fire simulations by comparing them with multiple satellite-based products and charcoal-based historical reconstructions. Our results show that most CMIP6 models simulate the present-day global burned area and fire carbon emissions within the range of satellite-based products. They also capture the major features of observed spatial patterns and seasonal cycles, the relationship of fires with precipitation and population density, and the influence of the El Niño–Southern Oscillation (ENSO) on the interannual variability of tropical fires. Regional fire carbon emissions simulated by the CMIP6 models from 1850 to 2010 generally align with the charcoal-based reconstructions, although there are regional mismatches, such as in southern South America and eastern temperate North America prior to the 1910s and in temperate North America, eastern boreal North America, Europe, and boreal Asia since the 1980s. The CMIP6 simulations have addressed three critical issues identified in CMIP5: (1) the simulated global burned area being less than half of that of the observations, (2) the failure to reproduce the high burned area fraction observed in Africa, and (3) the weak fire seasonal variability. Furthermore, the CMIP6 models exhibit improved accuracy in capturing the observed relationship between fires and both climatic and socioeconomic drivers and better align with the historical long-term trends indicated by charcoal-based reconstructions in most regions worldwide. However, the CMIP6 models still fail to reproduce the decline in global burned area and fire carbon emissions observed over the past 2 decades, mainly attributed to an underestimation of anthropogenic fire suppression, and the spring peak in fires in the Northern Hemisphere midlatitudes, mainly due to an underestimation of crop fires. In addition, the model underestimates the fire sensitivity to wet–dry conditions, indicating the need to improve fuel wet-ness estimation. Based on these findings, we present specific guidance for fire scheme development and suggest a postprocessing methodology for using CMIP6 multi-model outputs to generate reliable fire projection products.

Wildfire, Earth system models↗
DOE OSTI2025

CoCoMET v1.0: a unified open-source toolkit for atmospheric object tracking and analysis

Advances in performance and analysis capabilities have accelerated the development of object tracking algorithms for atmospheric research. This has resulted in a growing number of studies using Lagrangian tracking techniques to analyze the evolution of atmospheric phenomena and the underlying processes. However, the increasing complexity and variety of tracking algorithms present a steep learning curve for new users and make it difficult for existing users to compare algorithm performance. We introduce CoCoMET (Community Cloud Model Evaluation Toolkit), an open-source toolkit that addresses these issues. CoCoMET simplifies the process of running multiple tracking algorithms simultaneously and analyzing objects in both model and observational datasets by specifying parameters in a single configuration file. It standardizes input data from different sources into a consistent format and unifies the tracking output across algorithms. CoCoMET enhances the functionality of existing tracking methods by calculating additional properties such as cell growth and dissipation rates, perimeter, surface area, convexity, and irregularity. In addition, CoCoMET includes a novel method for identifying mergers and splits in 2D and 3D tracks and supports the integration of Eulerian/stationary datasets external to the tracking data for process studies. Its potential utility is demonstrated through examples of model intercomparison, model evaluation against observations, and comparisons between tracking algorithms. Designed for open-source environments, CoCoMET will continue to expand with future releases, incorporating more input data types and tracking algorithms.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Moving beyond post hoc explainable artificial intelligence: a perspective paper on lessons learned from dynamical climate modeling

AI models are criticized as being black boxes, potentially subjecting climate science to greater uncertainty. Explainable artificial intelligence (XAI) has been proposed to probe AI models and increase trust. In this review and perspective paper, we suggest that, in addition to using XAI methods, AI researchers in climate science can learn from past successes in the development of physics-based dynamical climate models. Dynamical models are complex but have gained trust because their successes and failures can sometimes be attributed to specific components or sub-models, such as when model bias is explained by pointing to a particular parameterization. We propose three types of understanding as a basis to evaluate trust in dynamical and AI models alike: (1) instrumental understanding, which is obtained when a model has passed a functional test; (2) statistical understanding, obtained when researchers can make sense of the modeling results using statistical techniques to identify input–output relationships; and (3) component-level understanding, which refers to modelers' ability to point to specific model components or parts in the model architecture as the culprit for erratic model behaviors or as the crucial reason why the model functions well. We demonstrate how component-level understanding has been sought and achieved via climate model intercomparison projects over the past several decades. Such component-level understanding routinely leads to model improvements and may also serve as a template for thinking about AI-driven climate science. Currently, XAI methods can help explain the behaviors of AI models by focusing on the mapping between input and output, thereby increasing the statistical understanding of AI models. Yet, to further increase our understanding of AI models, we will have to build AI models that have interpretable components amenable to component-level understanding. We give recent examples from the AI climate science literature to highlight some recent, albeit limited, successes in achieving component-level understanding and thereby explaining model behavior. The merit of such interpretable AI models is that they serve as a stronger basis for trust in climate modeling and, by extension, downstream uses of climate model data.

54 ENVIRONMENTAL SCIENCES↗