SEARCH · Search NASA

Results for “scoring system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Exploring the Landscape of Distributed Graph Clustering on Leadership Supercomputers

The rapid growth of large-scale datasets in fields like biology and social networks has driven the need for advanced graph analytics techniques. Community detection, a fundamental task in graph analytics, identifies closely connected groups of nodes within a network, providing valuable insights across various disciplines. This study focuses on two classic community detection methods, the Louvain algorithm and Markov Clustering (MCL), and evaluates the performance of two prominent distributed community detection algorithms: HiPDPL-GPU, our prior implementation, and HipMCL. We conduct experiments on GPU-accelerated heterogeneous HPC systems, Summit and Frontier, to assess their performance under varying conditions. Our objective is to identify the strengths and weaknesses of these algorithms in terms of scalability, and quality of solutions. We evaluate these algorithms on a diverse set of 70+ networks spanning 13 domains, with sizes ranging up to 4.2 billion edges. Our results demonstrate that HiPDPL-GPU consistently outperforms HipMCL, especially for large-scale networks. HiPDPL-GPU achieves significantly faster runtimes (47x to 1439x), higher modularity scores, and improved scalability. These findings highlight HiPDPL-GPU as a promising solution for efficient and effective large-scale graph analytics in diverse application domains, and provide insights into the feasibility of using MCL-based approaches for certain application domains.

Community detection, graph algorithms↗

DOE OSTI2023

Automatic detection of ship-induced cloud features in satellite imagery

Ships crossing the ocean are known to produce long, curvilinear features called ship tracks visible in satellite imagery via the Twomey effect; however, there has been little exploitation of satellite imagery for broad atmospheric studies or global monitoring of ship emissions due to the difficulty of automated ship track detection. Prior studies are either proof-of-concept, qualitatively assessed, or restricted to a certain time of day. We propose a statistical method for the automated identification of ship tracks and demonstrate using GOES-West ABI data. We first present a human-assisted segmentation method, which we use to generate a ground truth data set of 529 annotated ship tracks in GOES-West ABI products. We then describe a two-stage automated approach comprising a detection stage to generate ship track proposals and a classification stage to reduce false positives. For detection, we present a novel pipeline based around a z-score filtering technique, and for classification, we demonstrate several classifiers from literature. In a final experiment, we quantitatively tune the detection parameters and train the classifier using the ground truth dataset, then test on a sequestered set of images; the detect-then-classify system had an overall Pd of 0.68 and 0.80 for daytime and nighttime data, respectively, and the classifier reduced false positive detections by 67% and 75%.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Generative learning of densities on manifolds

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent) spaces in the high-dimensional data (ambient) space. Two approaches for sampling from the latent data density are described. The first is a score-based diffusion model, which is trained to map a standard normal distribution to the latent data distribution using a neural network. The second one involves solving an Itô stochastic differential equation in the latent space. Additional realizations of the data are generated by lifting the samples back to the ambient space using Double Diffusion Maps , a recently introduced technique typically employed in studying dynamical system reduction; here the focus lies in sampling densities rather than system dynamics. The proposed approaches enable sampling high dimensional data densities restricted to low-dimensional, a priori unknown manifolds. The efficacy of the proposed framework is demonstrated through a benchmark problem and a material with multiscale structure.

Double diffusion maps↗

DOE OSTI2024

NANO.PTML model for read-across prediction of nanosystems in neurosciences. computational model and experimental case of study

Abstract Neurodegenerative diseases involve progressive neuronal death. Traditional treatments often struggle due to solubility, bioavailability, and crossing the Blood-Brain Barrier (BBB). Nanoparticles (NPs) in biomedical field are garnering growing attention as neurodegenerative disease drugs (NDDs) carrier to the central nervous system. Here, we introduced computational and experimental analysis. In the computational study, a specific IFPTML technique was used, which combined Information Fusion (IF) + Perturbation Theory (PT) + Machine Learning (ML) to select the most promising Nanoparticle Neuronal Disease Drug Delivery (N2D3) systems. For the application of IFPTML model in the nanoscience, NANO.PTML is used. IF-process was carried out between 4403 NDDs assays and 260 cytotoxicity NP assays conducting a dataset of 500,000 cases. The optimal IFPTML was the Decision Tree (DT) algorithm which shown satisfactory performance with specificity values of 96.4% and 96.2%, and sensitivity values of 79.3% and 75.7% in the training (375k/75%) and validation (125k/25%) set. Moreover, the DT model obtained Area Under Receiver Operating Characteristic (AUROC) scores of 0.97 and 0.96 in the training and validation series, highlighting its effectiveness in classification tasks. In the experimental part, two samples of NPs (Fe 3 O 4 _A and Fe 3 O 4 _B) were synthesized by thermal decomposition of an iron(III) oleate (FeOl) precursor and structurally characterized by different methods. Additionally, in order to make the as-synthesized hydrophobic NPs (Fe 3 O 4 _A and Fe 3 O 4 _B) soluble in water the amphiphilic CTAB (Cetyl Trimethyl Ammonium Bromide) molecule was employed. Therefore, to conduct a study with a wider range of NP system variants, an experimental illustrative simulation experiment was performed using the IFPTML-DT model. For this, a set of 500,000 prediction dataset was created. The outcome of this experiment highlighted certain NANO.PTML systems as promising candidates for further investigation. The NANO.PTML approach holds potential to accelerate experimental investigations and offer initial insights into various NP and NDDs compounds, serving as an efficient alternative to time-consuming trial-and-error procedures.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2019

Formulation of Multicomponent Lattice Gas Model Cluster Expansions Parameterized on Ab Initio Data: An Introduction to the Ab Initio Mean-Field Augmented Lattice Gas Modeling Code

A formalism is presented for the construction of multicomponent lattice gas models parameterized with ab initio (typically density functional theory) data. The leave-multiple-out and the leave-one-out cross validation score are showcased, and practical algorithms are developed and implemented in a new code called the Ab initio Mean-field Augmented Lattice Gas Modeling (AMALGM) code. Here, the functionality of these algorithms is demonstrated with a fully worked out example using the O/Fe(100) system. AMALGM and the formalism on which it is based are envisioned as a surface-oriented lattice gas alternative to other cluster expansion codes that are typically geared toward bulk systems whose lateral interactions between components are parameterized using an Ising model. While the formalism is created within the context of surfaces, it is equally applicable to bulk materials.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Identifying Urban Pluvial Frequency Flooding Hotspots Using the Topographic Control Index and Remote Sensing Radar Images for Early Warning Systems

Identifying areas that frequently experience post-rainfall ponding is essential for effective flood mitigation and planning. This study integrates Sentinel-1 radar imagery and the Topographic Control Index (TCI) to identify 378 flood-prone urban depressions in Beaumont, Texas. Out of 159 major rainfall events, only six had Sentinel-1 radar imagery acquired within six hours of peak rainfall, and these were used to generate the flood frequency map; the ground-based flood sensor data were used to verify that these selected events corresponded to actual peak rainfall and to validate radar-detected water pixels. Validation results showed 100% precision, 70.87% recall, an F1-score of 82.95%, and 71.32% overall accuracy. Approximately 84% of medium-to-high TCI depressions overlapped with Beaumont’s two-year inundation map, confirming a strong relationship between TCI and observed flooding. A total of 124 depressions retained significant water, and after excluding 25 engineered detention ponds, 99 natural depressions remained flood vulnerable. Among these, 74 depressions with medium or high TCI were identified as the highest-priority nuisance flooding hotspots. The results demonstrate that combining TCI with radar imagery provides a reliable and cost-effective approach for identifying areas prone to frequent urban ponding. This framework supports practical decision-making for drainage improvements, hotspot identification, and early-warning system development in urban flood-prone regions.

Sentinel-1 radar imagery↗

DOE OSTI2020

Targeted alpha therapy in a systemic mouse model of prostate cancer - a feasibility study

225 Ac-PSMA-617 targeted-therapy has demonstrated efficacy in 75-85% of patients; however, responses are not durable. We aimed to establish translatable mouse models of disseminated prostate cancer (PCa) to evaluate effectiveness of 225 Ac-PSMA-617 at various disease stages. Methods: C4-2, C4-2B, or 22Rv1 cells were injected into the left ventricle of male NSG mice. Disease progression was monitored using bioluminescence imaging (BLI). For treatment, mice were injected with 40 kBq 225 Ac-PSMA-617 at one (early treatment cohort) or three weeks (late treatment cohort) post-inoculation. Treatment efficacy was monitored by BLI of whole-body tumor burden. Mice were sacrificed based on body conditioning score. Results: C4-2 cells yielded metastases in liver, lungs, spleen, stomach, bones, and brain - achieving a clinically relevant model of widespread metastatic disease. The disease burden in the early treatment cohort was stable over 27 weeks in 5/9 mice and progressive in 4/9 mice. These mice were sacrificed due to brain metastases. Median survival of the late treatment cohort was superior to controls (13 vs. 7 weeks; p<0.0001) but inferior to that in the early treatment cohort (13 vs. 27 weeks; p<0.001). Late cohort mice succumbed to extensive liver involvement. The 22Rv1 and C4-2B systemic models were not used for treatment due to high kidney metastatic burden or low take rate, respectively. Conclusion: C4-2 cells reproduced metastatic cancer spread most relevantly. Early treatment with 225 Ac-PSMA-617 prevented liver metastases and led to significant survival benefit. Late treatment improved survival without reducing tumor burden in the liver, the main site of metastasis. The current findings suggest that early 225 Ac-PSMA-617 intervention is more efficacious in the setting of widespread metastatic PCa.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2023

Younger facial looks are associate with a lower likelihood of several age-related morbidities in the middle-aged to elderly

Abstract Background Looking older for one’s chronological age is associated with a higher mortality rate. Yet it remains unclear how perceived facial age relates to morbidity and the degree to which facial ageing reflects systemic ageing of the human body. Objectives To investigate the association between ΔPA and age-related morbidities of different organ systems, where ΔPA represents the difference between perceived age (PA) and chronological age. Methods We performed a cross-sectional analysis on data from the Rotterdam Study, a population-based cohort study in the Netherlands. High-resolution facial photographs of 2679 men and women aged 51.5–87.8 years of European descent were used to assess PA. PA was estimated and scored in 5-year categories using these photographs by a panel of men and women who were blinded for chronological age and medical history. A linear mixed model was used to generate the mean PAs. The difference between the mean PA and chronological age was calculated (ΔPA), where a higher (positive) ΔPA means that the person looks younger for their age and a lower (negative) ΔPA that the person looks older. ΔPA was tested as a continuous variable for association with ageing-related morbidities including cardiovascular, pulmonary, ophthalmological, neurocognitive, renal, skeletal and auditory morbidities in separate regression analyses, adjusted for age and sex (model 1) and additionally for body mass index, smoking and sun exposure (model 2). Results We observed 5-year higher ΔPA (i.e. looking younger by 5 years for one’s age) to be associated with less osteoporosis [odds ratio (OR) 0.76, 95% confidence interval (CI) 0.62–0.93], less chronic obstructive pulmonary disease (OR 0.85, 95% CI 0.77–0.95), less age-related hearing loss (model 2; B = −0.76, 95% CI −1.35 to −0.17) and fewer cataracts (OR 0.84, 95% CI 0.73–0.97), but with better global cognitive functioning (g-factor; model 2; B = 0.07, 95% CI 0.04–0.10). Conclusions PA is associated with multiple morbidities and better cognitive function, suggesting that systemic ageing and cognitive ageing are, to an extent, externally visible in the human face.

Mekić, Selma↗

DOE OSTI2020

After the hurricane: Validating a resilience assessment methodology

With increasing utility grid outages in the United States, there is growing interest in assessing risk and developing mitigation strategies to reduce the impact of grid outages. Working with the U.S. Air Force, the U.S. Department of Energy's National Renewable Energy Laboratory (NREL) developed a replicable energy resilience assessment methodology and investment decision tool to: (1) identify and score hazards and vulnerabilities at the site level; (2) analyze risks to energy infrastructure; and (3) identify and prioritize energy resilience investments. This work improves on existing resilience assessment methodologies and tools by combining a bottom-up, all-hazards assessment methodology with top-down geographic information system mapping capabilities to provide an innovative, dynamic tool for identifying and prioritizing actionable solutions. This process combines probabilistic forecasting with an iterative approach for continuously updating and reassessing risks to address temporal dynamism. Relationships among systems are modeled and visualized to estimate the effectiveness of resilience actions across multiple interdependent systems and inform financial priorities through cost-difficulty-impact trade-offs. The approach is validated in a case study at Tyndall Air Force Base (AFB) in Florida, which experienced a Category 5 hurricane in 2018. The risks and mitigation strategies identified pre-hurricane are compared with post-hurricane, realized impacts. The assessment effectively identifies risks and actions to increase site energy resilience, but the methodology can be enhanced though greater consideration of the interdependencies between the energy system and related systems like transportation, communication, and food/water systems, which impact the recovery of the energy system and the base.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Mobility Energy Productivity and Equity: E-Bike Impacts for Low-Income Essential Workers in Denver

New mobility technologies such as electrified and shared mobility, combined with polices and incentive programs, are emerging to help address sustainability and equity issues in transportation planning. However, it can be difficult to understand the impacts of novel mobility trends and emerging modes on energy-efficient access. This is owing to a lack of (1) open-source tools enabling rapid data collection, and (2) open-source metrics that consider multimodal, multiactivity access and mobility within the contexts of sustainability and equity. Here, this paper addresses the topic of improving evaluation of transportation modes and incentive programs by integrating an open-source platform for tracking human travel data—the Open Platform for Agile Trip Heuristics (OpenPATH)—with a mobility metric that quantifies the efficiency of a region’s transportation system: Mobility Energy Productivity (MEP). Integration is demonstrated in the context of pilot programs in Colorado, where low-income essential workers were provided with electric bikes (e-bikes). OpenPATH-informed MEP calculations showed that several locations in downtown Denver provided comparable time-, cost-, and energy-efficient access to opportunities using e-bikes compared with driving. Additionally, providing e-bikes to low-income essential workers was found to be meaningful, as they utilized e-bikes the most to commute, despite driving still being their most utilized mode and the mode with highest MEP scores in Denver. We show how data collected from open-source tools coupled with robust metrics such as MEP can help evaluate the impacts of emerging mobility options. This could support developing policies to incentivize novel modes to achieve greater levels of sustainable, equitable, and efficient access.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Data-driven Quasi-static Surrogate Models for Nuclear-powered Integrated Energy Systems

The integration of nuclear power into energy systems presents a promising avenue to address the growing global energy demands while minimizing greenhouse gas emissions. In this paper, we introduce a data-driven quasi-static surrogate model for nuclear-powered Integrated Energy Systems (IES) that comprises various components, including a small modular reactor (SMR), steam manifold, balance of plant (BOP), high-temperature steam electrolysis (HTSE), and district heating (DH) system. Traditional physics-based models for these components often entail significant computational resource and time consumption, necessitating the development of efficient surrogate models. The development of a complete surrogate model for the IES involves the creation of individual surrogate models for each component, leveraging machine learning techniques and simulated data. These isolated surrogate models are subsequently integrated, enabling a holistic view of the IES and reducing the computational burden associated with detailed physics-based simulations. This paper outlines the development process, validation, and the performance evaluation of the surrogate models. The exceptional performance, with low root-mean-squared errors and R-squared scores of at least 99.8% across all individual surrogate models, underscores their accuracy and practical applicability. These results demonstrate the potential of these models to expedite the analysis of nuclear-powered IES, offering insights that can shape future research and development efforts.

08 HYDROGEN↗

DOE OSTI2024

Signature analysis of high-throughput transcriptomics screening data for mechanistic inference and chemical grouping

Abstract High-throughput transcriptomics (HTTr) uses gene expression profiling to characterize the biological activity of chemicals in in vitro cell-based test systems. As an extension of a previous study testing 44 chemicals, HTTr was used to screen an additional 1,751 unique chemicals from the EPA’s ToxCast collection in MCF7 cells using 8 concentrations and an exposure duration of 6 h. We hypothesized that concentration-response modeling of signature scores could be used to identify putative molecular targets and cluster chemicals with similar bioactivity. Clustering and enrichment analyses were conducted based on signature catalog annotations and ToxPrint chemotypes to facilitate molecular target prediction and grouping of chemicals with similar bioactivity profiles. Enrichment analysis based on signature catalog annotation identified known mechanisms of action (MeOAs) associated with well-studied chemicals and generated putative MeOAs for other active chemicals. Chemicals with predicted MeOAs included those targeting estrogen receptor (ER), glucocorticoid receptor (GR), retinoic acid receptor (RAR), the NRF2/KEAP/ARE pathway, AP-1 activation, and others. Using reference chemicals for ER modulation, the study demonstrated that HTTr in MCF7 cells was able to stratify chemicals in terms of agonist potency, distinguish ER agonists from antagonists, and cluster chemicals with similar activities as predicted by the ToxCast ER Pathway model. Uniform manifold approximation and projection (UMAP) embedding of signature-level results identified novel ER modulators with no ToxCast ER Pathway model predictions. Finally, UMAP combined with ToxPrint chemotype enrichment was used to explore the biological activity of structurally related chemicals. The study demonstrates that HTTr can be used to inform chemical risk assessment by determining in vitro points of departure, predicting chemicals’ MeOA and grouping chemicals with similar bioactivity profiles.

Toxicology↗

DOE OSTI2024

Metabolite, annotation, and gene integration system and method

Disclosed herein are systems and methods for associating metabolites with genes. In some embodiments, after potential metabolites are identified based on spectroscopy data of the content of an organism, possible reactions capable of producing the potential metabolites are determined. The possible reactions are compared to gene sequences in a database, and an association score for the likelihood that a gene sequence is related to the potential metabolites is calculated.

Erbilgin, Onur↗

DOE OSTI2026

ELM‐MOSART‐DOC: A Large‐Scale Riverine Dissolved Organic Carbon Model and Its Application Over the United States

Riverine dissolved organic carbon (DOC), primarily sourced from soil organic carbon (SOC), plays a crucial role in regional and global carbon cycles. However, the complexities of the underlying mechanisms and limited observations present significant challenges for predictive understanding of DOC at regional or larger scales. Recently, we developed a machine learning‐based (ML) map of DOC transformation rates, bridging the gap between SOC and DOC leaching flux and simplifying terrestrial DOC representation. Building on this advancement, we introduce ELM‐MOSART‐DOC, a DOC module integrated into the riverine component of the Energy Exascale Earth System Model (E3SM)—the Model for Scale Adaptive River Transport (MOSART). ELM‐MOSART‐DOC simulates DOC transport and transformation across both headwater streams and river networks, including those managed. Model validation demonstrates the ability of ELM‐MOSART‐DOC to accurately capture long‐term average DOC concentrations, with Kling‐Gupta Efficiency (KGE) scores of 0.58 and 0.76 at large and local stations, respectively. We further assess the impact of reservoirs through different simulation schemes, revealing that reservoirs significantly alter DOC fluxes by regulating streamflow patterns and promoting DOC mineralization. Model simulations indicate that reservoirs reduce total DOC flux from the Mississippi River into the ocean by 7.5%, with the long‐term average annual export decreasing from 3.34 to 3.14 teragrams (Tg) per year. ELM‐MOSART‐DOC integrates process‐based modeling with ML parameterization to enhance the predictive understanding of riverine biogeochemical processes. This approach reduces uncertainties in modeling regional and global carbon cycle ESMs and provides new insights into carbon cycling and its implications for global environmental change.

Li, Lingbo [Univ. of Houston, TX (United States); ↗

DOE OSTI2022

Feedstock Carbon Intensity Calculator (FD-CIC): Users’ Manual and Technical Documentation

The carbon intensities (CIs) of biofuels are determined with the life cycle analysis (LCA) technique, which accounts for the energy/material uses and emissions during the complete supply chain of biofuel including feedstock production and fuel conversion stages. Regulatory agencies such as California Air Resources Board (CARB) adopts LCA to calculate biofuel CIs. The Low Carbon Fuel Standard (LCFS) program developed by CARB allows individual biofuel conversion facilities to submit their own biofuel CIs with their facility input data and incentivizes the reduction in the CI specific to that particular facility compared to a reference fuel’s CI (Liu et al 2020). Such an incentive program has driven innovations in biorefineries to reduce their greenhouse gas (GHG) emissions by linking their revenue directly to its CI score through LCFS credit trading. Besides the biofuel conversion stage, different farming practices for feedstock growth can result in significant CI variations for feedstocks, thus for biofuels. To provide evidence-based research findings, the U.S. Department of Energy’s Advanced Research Projects Agency–Energy (ARPA-E) has supported the Systems Assessment Center of the Energy Systems and Infrastructure Analysis Division at Argonne National Laboratory to examine CI variations of different farming practices to grow agricultural crops for biofuel production. Meanwhile, the ARPA-E has launched the Systems for Monitoring and Analytics for Renewable Transportation Fuels from Agricultural Resources and Management (SMARTFARM) program to develop technologies and data platforms that enable an accurate measurement of key farming parameters that can help robust accounting of the GHG benefits of sustainable, low-carbon agronomic practices at farm level.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Enhancing dimensionality prediction in hybrid metal halides via feature engineering and class-imbalance mitigation

We present a machine learning (ML) framework for predicting the structural dimensionality of hybrid metal halides (HMHs), including organic-inorganic perovskites, using a combination of chemically-informed feature engineering and advanced class-imbalance handling techniques. This study is motivated by the small and highly imbalanced nature of experimentally available HMH datasets, which limits the applicability and reliability of conventional ML approaches. The dataset, consisting of 494 HMH structures, is highly imbalanced across dimensionality classes (0D, 1D, 2D, 3D), posing significant challenges to predictive modeling. To mitigate this limitation, the dataset was augmented to 1336 samples using the synthetic minority oversampling technique, enabling improved learning of underrepresented dimensionality classes while preserving chemically meaningful feature relationships. We developed interaction-based descriptors designed to capture coupled steric and polarity effects relevant to dimensionality prediction, which are not readily captured by standard single-parameter or composition-only descriptors. These descriptors are integrated into a multi-stage workflow combining feature selection, ensemble stacking, and performance optimization. Our approach significantly improves F1-scores for underrepresented classes, achieving robust cross-validation performance across all dimensionalities. This work demonstrates a generalizable strategy for extracting reliable and interpretable structure–dimensionality relationships from limited experimental data, enabling pre-synthesis screening of organic cations and providing a practical blueprint for small-data ML in hybrid materials systems.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Grid Optimization Competition on Synthetic and Industrial Power Systems

This paper summarizes a grid optimization (GO) competition effort in the United States to find the best solution strategies for up to interconnect-scale power system networks with around 32,000 buses. The optimization problem is a mixedinteger, non-convex non-linear problem, (MINLP) and includes discrete variables such as unit commitment and line switching, control settings (transformer taps and phase shifters with impedance correction tables), and bus shunts. The case study includes six actual industry grids as well as 16 realistic synthetic grids created by three different dataset teams. The winners are selected and ranked based on scoring criteria, which consider the solution quality (such as objective functions) within time limits. Nine winner teams are selected from 26 competitor teams. The results achieved by different teams are described and the performance of different algorithms on synthetic grids and actual industry grids are compared and analyzed.

mixed-integer non-linear programming↗

DOE OSTI2021

Differential Credibility of Climate Modes in CMIP6

This work quantitatively evaluates the fidelity with which the northern annular mode (NAM), southern annular mode (SAM), Pacific–North American pattern (PNA), El Niño–Southern Oscillation (ENSO), Pacific decadal oscillation (PDO), Atlantic multidecadal oscillation (AMO), and the first-order mode interactions are represented in Earth system model (ESM) output from the CMIP6 archive. Several skill metrics are used as part of a differential credibility assessment (DCA) of both spatial and temporal characteristics of the modes across ESMs, ESM families, and specific ESM realizations relative to ERA5. The spatial patterns and probability distributions are generally well represented but skill scores that measure the degree to which the frequencies of maximum variance are captured are consistently lower for most ESMs and climate modes. Substantial variability in skill scores manifests across realizations from individual ESMs for the PNA and oceanic modes. Further, the ESMs consistently overestimate the strength of the NAM–PNA first-order interaction and underestimate the NAM–AMO connection. Furthermore, these results suggest that the choice of ESM and ESM realizations will continue to play a critical role in determining climate projections at the global and regional scale at least in the near term.

54 ENVIRONMENTAL SCIENCES↗