Search NASA⌕ Search

SEARCH · Search NASA

Results for “unsupervised method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Gradient-Based Novelty Detection Boosted by Self-Supervised Binary Classification

Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data: (1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data. (2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.

Sun, Jingbo↗

Decoding the shift-invariant data: applications for band-excitation scanning probe microscopy *

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other latent variables. Using synthetic data sets, we show that the shift-VAE latent variables closely match the ground truth parameters. The shift VAE is extended towards the analysis of band-excitation piezoresponse force microscopy data, disentangling the resonance frequency shifts from the peak shape parameters in a model-free unsupervised manner. The extensions of this approach towards denoising of data and model-free dimensionality reduction in imaging and spectroscopic data are further demonstrated. This approach is universal and can also be extended to analysis of x-ray diffraction, photoluminescence, Raman spectra, and other data sets.

36 MATERIALS SCIENCE↗

Learning from metastable symmetric-tilt grain boundaries using physics-based descriptors

Grain boundaries (GBs) govern critical properties of polycrystalline materials. Although significant advancements have been made in characterizing minimum energy and ordered GBs, real GBs are seldom found in such well-defined states. This diversity of atomic arrangements in metastable states makes it challenging to establish structure-property relationships with physical insights. Here, to address this challenge, we use data-driven methods to explore these relationships and examine the underlying physics. In this study, we utilize a large atomistic database (~5000) of minimum energy and metastable states of symmetric-tilt copper GBs, combined with physically motivated local atomic environment (LAE) descriptors [strain functional descriptors (SFDs)], to predict GB properties and gain physical insights. Our regression models exhibit robust predictive capabilities using only 19 descriptors, generalizing to atomic environments in nanocrystals. A significant highlight of our work is the integration of an unsupervised method with SFDs to elucidate LAEs at GBs and their role in determining properties. The model, trained on these minimum energy and metastable GBs using SFDs, predicts the properties of unseen nanocrystals with good accuracy. Our research underscores the role of a physics-based representation of LAEs and the efficacy of data-driven methods in establishing GB structure-property relationships.

36 MATERIALS SCIENCE↗

Estimating Permafrost Distribution Using Co‐Located Temperature and Electrical Resistivity Measurements

Abstract Assessing the lateral and vertical extent of permafrost is critical to understanding the fate of Arctic ecosystems under climate change. Yet, direct measurements of permafrost distribution and temperature are often limited to a small number of borehole locations. Here, we assess the use of co‐located shallow temperature and electrical resistivity tomography (ERT) measurements to estimate at high‐resolution the distribution of permafrost in three watersheds underlain by discontinuous permafrost. Synthetic modeling shows that co‐located temperature and ERT measurements allow for supervised classification schemes that provide 60% higher accuracy compared to unsupervised methods. Linking resistivity and size of the identified permafrost bodies to surface observations, we show that tall vegetation (>0.5 m) and gentle slopes (<15°) are related to warmer and smaller permafrost bodies, and a more frequent occurrence of taliks.

54 ENVIRONMENTAL SCIENCES↗

Towards a bayesian seismotectonic zoning for use in Probabilistic Seismic Hazard Assessment (PSHA)

The mathematical representation of seismic sources is an important part of probabilistic seismic hazard assessment. It reflects the association of the seismicity with the tectonically-active geological structures evidenced by seismotectonic studies. Given that most active faults are not characterized well enough, seismic sources are generally defined as areal zones, delimited with finite boundary polygons, within which the geological features of active tectonics and the seismicity are deemed homogeneous (e.g., focal depth, seismicity rate, and maximum magnitude). Besides the lack of data (e.g., narrow range of recorded magnitudes), the application of this representation generates different problems: 1) a large sensitivity of resulting hazard maps on the location of zone boundaries, while these boundaries are set by expert decision; 2) the zoning can not represent any variation in faulting mechanism; 3) the seismicity rates are distributed throughout the zones and we lose the location of the determinant information used for their calculation. We propose an exploratory study for an alternative procedure in area source modeling. First, different data (e.g., geomorphology, geology, fault orientations) will be combined by using automated spatial partitioning (investigation of both supervised and unsupervised methods) in order to obtain several information classes, which may be defined as areal source zones. Then, a given hypocenter belonging to a given ''zone'', from now on called seismicity model, will be expressed by a probability computed from the 2D (spatial) probability density function (pdf) for the active tectonic model used as an a priori and updated with specific data from seismicity catalogs (e.g., focal mechanism) or other new data sources (e.g., geomorphology, subsurface exploration). This hypocenter will thus be allowed to contribute to several models, with weights given by the value of the pdf for each model. The annual rate of occurrence, for a given model, will be calculated by the weighted average of the different hypocenter contributions contained in this model. Future applications will couple the seismicity models to Ground Motion Prediction Equations. In consequence, the results will provide the full spectrum of variability in the hazard and will highlight zones badly constrained and deserving to be more studied.

58 GEOSCIENCES↗

Detecting anomalous SRF cavity behavior with unsupervised learning

We present an unsupervised learning framework for detecting anomalous superconducting radio-frequency (SRF) cavity behavior at the Continuous Electron Beam Accelerator Facility (CEBAF), emphasizing its initial performance and effectiveness. Key to the system’s success was the development of data acquisition systems (DAQs) that capture fast-sampled, information-rich signals, essential for detecting transient effects. The approach involves creating daily cavity-specific models using principal component analysis to handle variations in rf signal behavior and mitigate performance degradation from data drift. This unsupervised method eliminates the need for expensive labeling by continuously updating models with recent data. Deployed and operational for 3 months before a scheduled shutdown, the system successfully identified several issues with DAQ signals, confirming its effectiveness. Despite access to only a fraction of CEBAF’s SRF cavity signals, the framework efficiently detected several instances requiring intervention, demonstrating a significant improvement over traditional, labor-intensive methods of manual plot inspection. Published by the American Physical Society 2025

43 PARTICLE ACCELERATORS↗

Anomaly detection with flow-based fast calorimeter simulators

Recently, several normalizing flow-based deep generative models have been proposed to accelerate the simulation of calorimeter showers. Using caloflow as an example, we show that these models can simultaneously perform unsupervised anomaly detection with no additional training cost. As a demonstration, we consider electromagnetic showers initiated by one (background) or multiple (signal) photons. The caloflow model is designed to generate single-photon showers, but it also provides access to the shower likelihood. We use this likelihood as an anomaly score and study the showers tagged as being unlikely. As expected, the tagger struggles when the signal photons are nearly collinear but is otherwise effective. This approach is complementary to a supervised classifier trained on only specific signal models using the same low-level calorimeter inputs. While the supervised classifier is also highly effective at unseen signal models, the unsupervised method is more sensitive in certain regions, and, thus, we expect that the ultimate performance will require a combination of these approaches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Community detection robustness of graph neural networks

Graph neural networks (GNNs) are increasingly widely used for community detection in attributed networks. They combine structural topology with node attributes through message passing and pooling. However, their robustness or lack thereof with respect to different perturbations and targeted attacks in conjunction with community detection tasks is not well understood. To shed light on latent mechanisms behind GNN sensitivity on community detection tasks, we conduct a systematic computational evaluation of six widely adopted GNN architectures graph convolutional network, graph attention network, graph sample and aggregate (GraphSAGE), differentiable pooling (DiffPool), minimum cut pooling (MinCUT), and deep modularity networks (DMoN). The analysis covers three perturbation categories: node attribute manipulations, edge topology distortions, and adversarial attacks. We use element-centric similarity as the evaluation metric on synthetic benchmarks and real-world citation networks. Our findings indicate that supervised GNNs tend to achieve higher baseline accuracy, while unsupervised methods, particularly DMoN, maintain stronger resilience under targeted and adversarial perturbations. Furthermore, robustness appears to be strongly influenced by community strength, with well-defined communities reducing performance loss. Across all models, node attribute perturbations associated with targeted edge deletions and shifts in attribute distributions tend to cause the largest degradation in community recovery. These findings highlight important trade-offs between accuracy and robustness in GNN-based community detection and offer insights into selecting architectures resilient to noise and adversarial attacks.

Goel, Jaidev [Virginia Polytechnic Inst. and State↗

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Technical Note: Unsupervised C-arm pose tracking with radiographic fiducial

Purpose: C-arm fluoroscopy reconstruction, such as that used in prostate brachytherapy, requires that the relative poses of the individual C-arm fluoroscopy images must be known prior to reconstruction. Radiographic fiducials can provide excellent C-arm pose tracking, but they need to be segmented in the image. The authors report an automated and unsupervised method that does not require prior segmentation of the fiducial. Methods: The authors compute the individual C-arm poses relative to a stationary radiographic fiducial of known geometry. The authors register a filtered 2D fluoroscopy image of the fiducial to its 3D model by using image intensity alone without prior segmentation. To enhance the C-arm images, the authors investigated a three-step cascade filter and a line enhancement filter. The authors tested the method on a composite fiducial containing beads, straight lines, and ellipses. Ground-truth C-arm pose was provided by a clinically proven method. Results: Using 111 clinical C-arm images and {+-}10 deg. and {+-}10 mm random perturbation around the ground-truth pose, a total of 2775 cases were evaluated. The average rotation and translation errors were 0.62 deg. (STD=0.31 deg.) and 0.72 mm (STD=0.55 mm) for the three-step filter and 0.67 deg. (STD=0.40 deg.) and 0.87 mm (STD=0.27 mm) using the line enhancement filter. Conclusions: The C-arm pose tracking method was sufficiently accurate and robust on human patient data for subsequent 3D implant reconstruction.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Unsupervised classification of single-particle X-ray diffraction snapshots by spectral clustering

Single-particle experiments using X-ray Free Electron Lasers produce more than 105 snapshots per hour, consisting of an admixture of blank shots (no particle intercepted), and exposures of one or more particles. Experimental data sets also often contain unintentional contamination with different species. We present an unsupervised method able to sort experimental snapshots without recourse to templates, specific noise models, or user-directed learning. The results show 90% agreement with manual classification.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A New, Principled Approach to Anomaly Detection

Intrusion detection is often described as having two main approaches: signature-based and anomaly-based. We argue that only unsupervised methods are suitable for detecting anomalies. However, there has been a tendency in the literature to conflate the notion of an anomaly with the notion of a malicious event. As a result, the methods used to discover anomalies have typically been ad hoc, making it nearly impossible to systematically compare between models or regulate the number of alerts. We propose a new, principled approach to anomaly detection that addresses the main shortcomings of ad hoc approaches. We provide both theoretical and cyber-specific examples to demonstrate the benefits of our more principled approach.

anomaly detection↗

Video Summarization Using Deep Action Recognition Features and Robust Principal Components Analysis

In an instance where desired pre-defined actions, behaviors, or other categories are known a priori, various video classification and recognition models can be trained to discover those classifications and their location within the video. Absent that information, one might still be tasked with identifying interesting portions within a video, a process which—if done manually—is onerous and time-consuming as it requires manual inspection of the video itself. Recognizing high-level interesting segments within a whole video has been a general area of interest due to the ubiquity of video data. However the size of the data makes storage, retrieval, and inspection of large collections of videos cumbersome. This problem motivates the task of generating shortened clips highlighting the primary content of a video, relieving the burden of having to watch the entire video. This paper presents an unsupervised method of creating shortened clips of videos, enabling the rapid review of the most interesting content within a video. Our method uses features extracted from pre-trained action recognition models as input to online moving window robust principal component analysis to generate summaries. The procedure is tested on a publicly available video summarization dataset and demonstrates comparable performance to state-of-the-art in an un-augmented setting while requiring no training.

Claborne, Daniel M.↗

Supervised and unsupervised machine learning of structural phases of polymers adsorbed to nanowires

Here, we identify configurational phases and structural transitions in a polymer nanotube composite by means of machine learning. We employ various unsupervised dimensionality reduction methods, conventional neural networks, as well as the confusion method, an unsupervised neural-network-based approach. We find neural networks are able to reliably recognize all configurational phases that have been found previously in experiment and simulation. Furthermore, we locate the boundaries between configurational phases in a way that removes human intuition or bias. This could be done before only by relying on preconceived, ad hoc order parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spectral Transfer Learning Using Information Geometry for a User-Independent Brain-Computer Interface

Recent advances in signal processing and machine learning techniques have enabled the application of Brain-Computer Interface (BCI) technologies to fields such as medicine, industry, and recreation; however, BCIs still suffer from the requirement of frequent calibration sessions due to the intra- and inter-individual variability of brain-signals, which makes calibration suppression through transfer learning an area of increasing interest for the development of practical BCI systems. In this paper, we present an unsupervised transfer method (spectral transfer using information geometry,STIG),which ranks and combines unlabeled predictions from an ensemble of information geometry classifiers built on data from individual training subjects. The STIG method is validated in both off-line and real-time feedback analysis during a rapid serial visual presentation task (RSVP). For detection of single-trial, event-related potentials (ERPs), the proposed method can significantly outperform existing calibration-free techniques as well as out perform traditional within-subject calibration techniques when limited data is available. Here, this method demonstrates that unsupervised transfer learning for single-trial detection in ERP-based BCIs can be achieved without the requirement of costly training data, representing a step-forward in the overall goal of achieving a practical user-independent BCI system.

60 APPLIED LIFE SCIENCES↗