Search NASA⌕ Search

SEARCH · Search NASA

Results for “imbalanced data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

30 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

HydraGNN v4.0

The new version of HydraGNN v4.0 provides additional core capabilities, such as: Inclusion of multi-body atomistic cluster expansion MACE, polarizable atom interaction neural network PAINN, and equivariant principal neighborhood aggregation (PNAEq) among the message passing layers supported -Inclusion of graph transformers to directly model long-range interactions between nodes that are distant in the graph topology Integration of graph transformers with message passing layers by combining the graph embedding generated by the two mechanisms, which allows for an improved expressivity of the HydraGNN architecture Improved re-implementation of multi-task learning (MTL) to allow its use for stabilized training across imbalanced, multi-source, multi-fidelity data Introduction of multi-task parallelism, a newly proposed type of model parallelism specifically for MTL architectures, which allows to dispatch different output decoding heads to different GPU devices Integration of multi-task parallelism with pre-existing distributed data parallelism to enable a 2D parallelization for distributed training Improved portability of the distributed training across Intel GPUs, which has been testes on ALCF exascale supercomputer Aurora Inclusion of 2-level fine-grained energy profilers portable across NVIDIA, AMD, and Intel GPUs to monitor the power and energy consumption associated with different functions executed by the HydraGNN code during data pre-load and training Restructuring of previous examples and inclusion of new sets of examples to illustrate the download, preprocess, and training of HydraGNN models on new large-scale open-source datasets for atomistic materials modeling (e.g., Alexandria, Transition1x, OMat24, OMol25)

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗
DOE OSTI2026

The Impact of Time-Aware Design Choices in ICS Anomaly Detection

Industrial control systems (ICS) remain vulnerable to increasingly sophisticated cyberattacks, yet evaluating anomaly detection models in these environments is challenging due to temporal dependencies, missing-not-at-random patterns, and extremely imbalanced datasets. These factors make common practices—especially random data splits and na¨ıve imputation— prone to severe temporal leakage, which can inflate reported performance and obscure real-world limitations. In this work, we systematically examine classical machine learning models, temporal deep learning architecture, and tensordecomposition– based methods on a gas-pipeline dataset using a fully temporally separated evaluation pipeline designed to mimic realistic deployment conditions. Our findings show that proper temporal handling and MNAR-aware preprocessing significantly alter the relative performance of popular anomaly-detection methods, providing practical guidance for designing reliable, leakage-resistant ICS intrusion-detection systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Using convolutional neural networks to detect edge localized modes in DIII-D from Doppler backscattering measurements

In H-mode tokamak plasmas, the plasma is sometimes ejected beyond the edge transport barrier. These events are known as edge localized modes (ELMs). ELMs cause a loss of energy and damage the vessel walls. Understanding the physics of ELMs, and by extension, how to detect and mitigate them, is an important challenge. In this paper, we focus on two diagnostic methods—deuterium-alpha (D α ) spectroscopy and Doppler backscattering (DBS). The former detects ELMs by measuring Balmer alpha emission, while the latter uses microwave radiation to probe the plasma. DBS has the advantages of having a higher temporal resolution and robustness to damage. These advantages of DBS diagnostic may be beneficial for future operational tokamaks, and thus, data processing techniques for DBS should be developed in preparation. In sight of this, we explore the training of neural networks to detect ELMs from DBS data, using D α data as the ground truth. With shots found in the DIII-D database, the model is trained to classify each time step based on the occurrence of an ELM event. The results are promising. When tested on shots similar to those used for training, the model is capable of consistently achieving a high f1-score of 0.93. Furthermore, this score is a performance metric for imbalanced datasets that ranges between 0 and 1. We evaluate the performance of our neural network on a variety of ELMs in different high confinement regimes (grassy ELM, RMP mitigated, and wide-pedestal), finding broad applicability. Beyond ELMs, our work demonstrates the wider feasibility of applying neural networks to data from DBS diagnostic.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Reducing the Parameter Dependency of Phase-Picking Neural Networks with Dice Loss

Training a neural network for picking seismic phase arrivals has been commonly posed as a segmentation problem. It is a highly imbalanced segmentation problem in the sense that the background vastly dominates the foreground because we are trying to pick the optimal single sample point that represents the arrival of a seismic phase in a many seconds long time window. Here, we test the Dice loss, which is a preferred loss function for highly imbalanced image segmentation problems. We show that phase-picking neural networks trained on the Dice loss behave in a binary fashion for which the prediction output is almost always either nearly 1 or nearly 0. This feature removes the strong dependence of data processing workflows on the prediction score threshold, which is an otherwise critical parameter to determine when using neural networks trained on the cross-entropy loss. When strategically used, models trained on the Dice loss can reduce the parameter dependency of machine learning-based seismic monitoring.

58 GEOSCIENCES↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
DOE OSTI2025

New Results on Communication- and Memory-Aware Load Balancing Model and Algorithms

While load balancing in distributed-memory computing has been well-studied, we present an innovative approach to this problem: a unified, reduced-order model that combines three key components to describe “work” in a distributed system: computation, communication, and memory. Our model enables an optimizer to explore complex tradeoffs in task placement, such as augmented parallelism, at the expense of data replication increasing memory usage. We propose a fully distributed, heuristic-based load balancing optimization algorithm, and demonstrate that it quickly finds close-to-optimal solutions. We formalize the complex optimization problem as a mixed-integer linear program, and compare it to our strategy. Finally, we show that when applied to an electromagnetics code, our approach obtains up to 2.3x speedups for the imbalanced execution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗
DOE OSTI2024

Avian Activity Classification Using Recurrent Networks to Fuse Videos with Metadata on Imbalanced Datasets

Activity classification plays a crucial role in various real-life scenarios involving both humans and animals. There is an increasing need for precise activity classification focused on avian-solar interactions, as the usage of solar energy facilities, such as photovoltaic array power stations, has been observed to impact bird species richness, behavior, and activity. However, there has been no work to develop an automated system to monitor and classify these avian-solar interactions. All current methods rely on human observers, which is time and human resources costly and subject to errors related to searcher efficiency. With the recent success of Deep Learning models in activity classification problems, this paper develops a recurrent neural network-based model to automatically classify six avian activities around solar energy facilities. Our proposed model integrates critical feature engineering metadata with video frame data, enabling improved learning and more accurate activity classification. Furthermore, we address the challenge of data imbalance during training and demonstrate the efficacy of our model in detecting and classifying different activities within video tracks. Additionally, we analyze the saliency/backpropagation map of the trained proposed model and validate its decision-making rationale.

Avian activity classification; bidirectional LSTM;↗
DOE OSTI2026

Enhancing dimensionality prediction in hybrid metal halides via feature engineering and class-imbalance mitigation

We present a machine learning (ML) framework for predicting the structural dimensionality of hybrid metal halides (HMHs), including organic-inorganic perovskites, using a combination of chemically-informed feature engineering and advanced class-imbalance handling techniques. This study is motivated by the small and highly imbalanced nature of experimentally available HMH datasets, which limits the applicability and reliability of conventional ML approaches. The dataset, consisting of 494 HMH structures, is highly imbalanced across dimensionality classes (0D, 1D, 2D, 3D), posing significant challenges to predictive modeling. To mitigate this limitation, the dataset was augmented to 1336 samples using the synthetic minority oversampling technique, enabling improved learning of underrepresented dimensionality classes while preserving chemically meaningful feature relationships. We developed interaction-based descriptors designed to capture coupled steric and polarity effects relevant to dimensionality prediction, which are not readily captured by standard single-parameter or composition-only descriptors. These descriptors are integrated into a multi-stage workflow combining feature selection, ensemble stacking, and performance optimization. Our approach significantly improves F1-scores for underrepresented classes, achieving robust cross-validation performance across all dimensionalities. This work demonstrates a generalizable strategy for extracting reliable and interpretable structure–dimensionality relationships from limited experimental data, enabling pre-synthesis screening of organic cations and providing a practical blueprint for small-data ML in hybrid materials systems.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Experimental search for the chiral magnetic effect in relativistic heavy-ion collisions: A perspective

The chiral magnetic effect (CME) refers to generation of the electric current along a magnetic field in a chirally imbalanced system of quarks. The latter is predicted by quantum chromodynamics to arise from quark interaction with nontrivial topological fluctuations of the vacuum gluonic field. The CME has been actively searched for in relativistic heavy-ion collisions, where such gluonic field fluctuations and a strong magnetic field are believed to be present. The CME-sensitive observables are unfortunately subject to a possibly large non-CME background, and firm conclusions on a CME observation have not yet been reached. In this perspective, we review the experimental status and progress in the CME search, from the initial measurements more than a decade ago to the dedicated program of isobar collisions in 2018 and the release of the isobar blind analysis result in 2022 to intriguing hints of a possible CME signal in Au + Au collisions, and discuss future prospects of a potential CME discovery in the anticipated high-statistic Au + Au collision data at the Relativistic Heavy-Ion Collider by 2025. We hope such a perspective will help sharpening our focus on the fundamental physics of the CME and steer its experimental search.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Direct Measurement of Diffusion Coefficients: Evidence for Diffusive Stochastic Heating in Collisionless Plasmas

Open questions in collisionless plasma dissipation can be addressed using space-based observations in different astrophysical environments, with implications for both astrophysical and laboratory plasma systems. We study a low-𝛽, highly imbalanced, sub-Alfvénic stream observed by Parker Solar Probe (PSP) to identify and distinguish between signatures of stochastic heating (SH) and resonant heating (RH) by parallel ion cyclotron waves (∥-ICWs). Prior work studying this stream [Trevor A. Bowen et al., Stochastic heating in the sub-Alfvénic solar wind, Phys. Rev. Lett. 135, 255201 (2025)] showed that the SH rate, accounting for intermittency, matched the amplitude of the local energy transfer (LET) rate, while the RH rate did not. This comparison relied on a number of assumptions regarding the nature of the diffusive process and the calculation of the LET rate. We introduce a novel technique of inverting the proton guiding center equation to empirically measure velocity-space diffusion coefficients using three-dimensional proton velocity distribution functions, from the ion electrostatic analyzer (the Solar Probe Analyzer for Ions) on PSP. Measured diffusion coefficients are used to determine phase-space heating rates, leading to a calculation of a fully kinetic heating rate independent of assumptions made in prior work. We show that scale-dependent analytic expressions for SH via noncoherent fluctuations match the empirical measurements from PSP data, provided that we account for intermittency in the heating calculation. In contrast, the derived heating rates for SH that accounts for the effects of the helicity barrier and heating rates for RH via ∥-ICWs do not peak in the same region of velocity space as the empirical measurements, nor do they reach the required magnitude. Our approach provides novel methodology to uniquely identify and constrain heating processes in collisionless plasmas and shows evidence of a Fokker-Planck-like diffusive process in the near-Sun solar wind.

Plasma kinetic theory↗
NASA NTRS2014

Fibroblast Growth Factor-23 in Bed Rest and Spaceflight

Many nutritional factors influence bone, from the basics of calcium and vitamin D, to factors which influence bone through acid/base balance, including protein, sodium, and more. Fibroblast growth factor 23 (FGF23) is a recently identified factor, secreted from osteocytes, which is involved in classic (albeit complex) feedback loops controlling phosphorus homeostasis through both vitamin D and parathyroid hormone (PTH) (1, 2). As osteocytes are gravity sensing cells, it is important to determine if there are changes in FGF23 during spaceflight. In extreme cases, such as chronic kidney disease, FGF23 levels are highly elevated. FGF23 imbalances, secondary to dietary influences, may contribute to skeletal demineralization and kidney stone risk during spaceflight. Presented with an imbalanced dietary phosphorus to calcium ratio, increased secretion of FGF23 will inhibit renal phosphorus reabsorption, resulting in increased excretion and reduced circulating phosphorus. Increased intake and excretion of phosphorus is associated with increased kidney stone risk in both the terrestrial and microgravity environments. Highly processed foods and carbonated beverages are associated with higher phosphorus content. Ideally, the dietary calcium to phosphorus ratio should be at minimum 1:1. Nutritional requirements for spaceflight suggest that this ratio not be less than 0.67 (3), while the International Space Station (ISS) menu provides 1020 mg Ca and 1856 mg P, for a ratio of 0.55 (3). Subjects in NASA's bed rest studies, by design, have consumed intake ratios much closer to 1.0 (4). FGF23 also has an inhibitory influence on PTH secretion and 1(alpha)-hydroxylase, both of which are required for activating vitamin D with the conversion of 25-hydroxyvitamin D to 1,25-dihydroxyvitamin D. Decreased 1,25-dihydroxyvitamin D will result in decreased intestinal phosphorus absorption, and increased urinary phosphorus excretion (via decreased renal reabsorption). Should a decrease in 1,25- dihydroxyvitamin D be necessary to reduce intestinal phosphorus absorption, calcium absorption will also proportionally be reduced, potentially leading to skeletal demineralization. Demineralization of bone can increase kidney stone risk, a medical issue that could prove detrimental to mission success. Given the interrelationships described above, we sought to determine circulating FGF23 concentrations in spaceflight and ground analog studies to better understand the potential effects of dietary phosphorus on bone and calcium metabolism. We analyzed serum from ISS astronauts participating in studies of bone biochemistry, including the Nutrition SMO and Pro K experiments, and we also evaluated FGF23 during extended-duration bed rest. Serum intact FGF23 levels were determined using an ELISA kit from Kainos laboratories in Japan. While initial evaluation of the data showed no changes over time during flight or bed rest, evaluation continues of FGF23 data in light of dietary factors, PTH, vitamin D status, and other biochemical and endocrine factors.

Bokhari, R.↗