Search NASA⌕ Search

SEARCH · Search NASA

Results for “unsupervised method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Object-oriented feature-tracking algorithms for SAR images of the marginal ice zone

An unsupervised method that chooses and applies the most appropriate tracking algorithm from among different sea-ice tracking algorithms is reported. In contrast to current unsupervised methods, this method chooses and applies an algorithm by partially examining a sequential image pair to draw inferences about what was examined. Based on these inferences the reported method subsequently chooses which algorithm to apply to specific areas of the image pair where that algorithm should work best.

Daida, Jason↗

Copula based Damage Detection for Structural Health Monitoring

This project utilizes copulas for damage detection in a Structural Health Monitoring (SHM) application. A copula-based system was chosen for the benefit of multivariate joint distribution with a goal to detect damage based on how the system as a whole reacts rather than one or two sensors by themselves. Copulas are commonly used in the field of finance for risk modeling based on two or more random inputs. A few applications in the field of SHM and Non-Destructive Evaluation (NDE) have been researched mostly on risk or reliability of the structure. The goal of this project is to determine if a copula-based approach can be used for damage detection. An unsupervised learning method was desired to reduce the dimensionality, minimal training, and be a faster evaluation method than other unsupervised methods. If a copula method can be used to detect damage what additional information on the damage can be interpreted. The remainder of this report will go over the background needed, SHM methodology, SHM applications, conclusions, and future developments.

47 OTHER INSTRUMENTATION↗

An unsupervised feature extraction method for high dimensional image data compaction

A new on-line unsupervised feature extraction method for high-dimensional remotely sensed image data compaction is presented. This method can be utilized to solve the problem of data redundancy in scene representation by satellite-borne high resolution multispectral sensors. The algorithm first partitions the observation space into an exhaustive set of disjoint objects. Then, pixels that belong to an object are characterized by an object feature. Finally, the set of object features is used for data transmission and classification. The example results show that the performance with the compacted features provides a slight improvement in classification accuracy instead of any degradation. Also, the information extraction method does not need to be preceded by a data decompaction.

Ghassemian, Hassan↗

Automatic Feature Extraction from Planetary Images

With the launch of several planetary missions in the last decade, a large amount of planetary images has already been acquired and much more will be available for analysis in the coming years. The image data need to be analyzed, preferably by automatic processing techniques because of the huge amount of data. Although many automatic feature extraction methods have been proposed and utilized for Earth remote sensing images, these methods are not always applicable to planetary data that often present low contrast and uneven illumination characteristics. Different methods have already been presented for crater extraction from planetary images, but the detection of other types of planetary features has not been addressed yet. Here, we propose a new unsupervised method for the extraction of different features from the surface of the analyzed planet, based on the combination of several image processing techniques, including a watershed segmentation and the generalized Hough Transform. The method has many applications, among which image registration and can be applied to arbitrary planetary images.

Troglio, Giulia↗

Errant Beam Prognostics with Machine Leaning at SNS Accelerator

Particle Accelerators are complex machine with many pieces of equipment running in synchronization to deliver required beam. However, faults in particle accelerators reduce the availability of the beam for experiments affecting the overall science output. To avoid these faults, we apply anomaly detection techniques to predict any unusual behavior and perform preemptive actions to improve the total availability. Many researchers have adopted semi-supervised Machine Learning (ML) methods such as auto-encoders and variational auto-encoders for such tasks. However, supervised ML techniques designed for similarity learning such as Siamese Neural Network (SNN) can outperform semi-supervised or unsupervised methods for anomaly prediction. One of the challenges associated with application of ML models to particle accelerators is the variability in observed data over time due to system configuration changes. We employ conditional models such as Conditional Siamese Neural Networks (CSNN), and Conditional-VAE (CVAE) to learn the variability in the data by using beam configuration parameters as conditional input. We apply these models for errant beam prediction at Spallation Neutron Source accelerator under different system configurations and compare their performance. We demonstrate that CSNN outperforms CVAE in our application. This talk will present the data source, collection, analysis, data-preparation, model development, hyper-parameter studies and the results.

Rajput, Kishansingh↗

Learning from metastable symmetric-tilt grain boundaries using physics-based descriptors

Grain boundaries (GBs) govern critical properties of polycrystalline materials. Although significant advancements have been made in characterizing minimum energy and ordered GBs, real GBs are seldom found in such well-defined states. This diversity of atomic arrangements in metastable states makes it challenging to establish structure-property relationships with physical insights. Here, to address this challenge, we use data-driven methods to explore these relationships and examine the underlying physics. In this study, we utilize a large atomistic database (~5000) of minimum energy and metastable states of symmetric-tilt copper GBs, combined with physically motivated local atomic environment (LAE) descriptors [strain functional descriptors (SFDs)], to predict GB properties and gain physical insights. Our regression models exhibit robust predictive capabilities using only 19 descriptors, generalizing to atomic environments in nanocrystals. A significant highlight of our work is the integration of an unsupervised method with SFDs to elucidate LAEs at GBs and their role in determining properties. The model, trained on these minimum energy and metastable GBs using SFDs, predicts the properties of unseen nanocrystals with good accuracy. Our research underscores the role of a physics-based representation of LAEs and the efficacy of data-driven methods in establishing GB structure-property relationships.

36 MATERIALS SCIENCE↗

Estimating Permafrost Distribution Using Co‐Located Temperature and Electrical Resistivity Measurements

Abstract Assessing the lateral and vertical extent of permafrost is critical to understanding the fate of Arctic ecosystems under climate change. Yet, direct measurements of permafrost distribution and temperature are often limited to a small number of borehole locations. Here, we assess the use of co‐located shallow temperature and electrical resistivity tomography (ERT) measurements to estimate at high‐resolution the distribution of permafrost in three watersheds underlain by discontinuous permafrost. Synthetic modeling shows that co‐located temperature and ERT measurements allow for supervised classification schemes that provide 60% higher accuracy compared to unsupervised methods. Linking resistivity and size of the identified permafrost bodies to surface observations, we show that tall vegetation (>0.5 m) and gentle slopes (<15°) are related to warmer and smaller permafrost bodies, and a more frequent occurrence of taliks.

54 ENVIRONMENTAL SCIENCES↗

Detecting anomalous SRF cavity behavior with unsupervised learning

We present an unsupervised learning framework for detecting anomalous superconducting radio-frequency (SRF) cavity behavior at the Continuous Electron Beam Accelerator Facility (CEBAF), emphasizing its initial performance and effectiveness. Key to the system’s success was the development of data acquisition systems (DAQs) that capture fast-sampled, information-rich signals, essential for detecting transient effects. The approach involves creating daily cavity-specific models using principal component analysis to handle variations in rf signal behavior and mitigate performance degradation from data drift. This unsupervised method eliminates the need for expensive labeling by continuously updating models with recent data. Deployed and operational for 3 months before a scheduled shutdown, the system successfully identified several issues with DAQ signals, confirming its effectiveness. Despite access to only a fraction of CEBAF’s SRF cavity signals, the framework efficiently detected several instances requiring intervention, demonstrating a significant improvement over traditional, labor-intensive methods of manual plot inspection. Published by the American Physical Society 2025

43 PARTICLE ACCELERATORS↗

Anomaly detection with flow-based fast calorimeter simulators

Recently, several normalizing flow-based deep generative models have been proposed to accelerate the simulation of calorimeter showers. Using caloflow as an example, we show that these models can simultaneously perform unsupervised anomaly detection with no additional training cost. As a demonstration, we consider electromagnetic showers initiated by one (background) or multiple (signal) photons. The caloflow model is designed to generate single-photon showers, but it also provides access to the shower likelihood. We use this likelihood as an anomaly score and study the showers tagged as being unlikely. As expected, the tagger struggles when the signal photons are nearly collinear but is otherwise effective. This approach is complementary to a supervised classifier trained on only specific signal models using the same low-level calorimeter inputs. While the supervised classifier is also highly effective at unseen signal models, the unsupervised method is more sensitive in certain regions, and, thus, we expect that the ultimate performance will require a combination of these approaches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Community detection robustness of graph neural networks

Graph neural networks (GNNs) are increasingly widely used for community detection in attributed networks. They combine structural topology with node attributes through message passing and pooling. However, their robustness or lack thereof with respect to different perturbations and targeted attacks in conjunction with community detection tasks is not well understood. To shed light on latent mechanisms behind GNN sensitivity on community detection tasks, we conduct a systematic computational evaluation of six widely adopted GNN architectures graph convolutional network, graph attention network, graph sample and aggregate (GraphSAGE), differentiable pooling (DiffPool), minimum cut pooling (MinCUT), and deep modularity networks (DMoN). The analysis covers three perturbation categories: node attribute manipulations, edge topology distortions, and adversarial attacks. We use element-centric similarity as the evaluation metric on synthetic benchmarks and real-world citation networks. Our findings indicate that supervised GNNs tend to achieve higher baseline accuracy, while unsupervised methods, particularly DMoN, maintain stronger resilience under targeted and adversarial perturbations. Furthermore, robustness appears to be strongly influenced by community strength, with well-defined communities reducing performance loss. Across all models, node attribute perturbations associated with targeted edge deletions and shifts in attribute distributions tend to cause the largest degradation in community recovery. These findings highlight important trade-offs between accuracy and robustness in GNN-based community detection and offer insights into selecting architectures resilient to noise and adversarial attacks.

Goel, Jaidev [Virginia Polytechnic Inst. and State↗

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Analysis of thematic mapper simulator data acquired during winter season over Pearl River, Mississippi, test site

Digital processed aircraft-acquired thematic mapping simulator (TMS) data collected during the winter season over a forested site in southern Mississippi are presented to investigate the utility of TMS data for use in forest inventories and monitoring. Analyses indicated that TMS data are capable of delineating the mixed forest land cover type to an accuracy of 92.5 % correct. The accuracies associated with river bottom forest and pine forest were 95.5 and 91.5 % correct. The accuracies associated with river bottom forest and pine forest were 95.5 and 91.5 % correct, respectively. The figures reflect the performance for products produced using the best subset of channels for each forest cover type. It was found that the choice of channels (subsets) has a significant effect on the accuracy of classification produced, and that the same channels are not the most desirable for all three forest types studied. Both supervised and unsupervised spectral signature development techniques are evaluated; the unsupervised methods proved unacceptable for the three forest types considered.

Anderson, J. E.↗

Analysis of thematic mapper simulator data collected over eastern North Dakota

The results of the analysis of aircraft-acquired thematic mapper simulator (TMS) data, collected to investigate the utility of thematic mapper data in crop area and land cover estimates, are discussed. Results of the analysis indicate that the seven-channel TMS data are capable of delineating the 13 crop types included in the study to an overall pixel classification accuracy of 80.97% correct, with relative efficiencies for four crop types examined between 1.62 and 26.61. Both supervised and unsupervised spectral signature development techniques were evaluated. The unsupervised methods proved to be inferior (based on analysis of variance) for the majority of crop types considered. Given the ground truth data set used for spectral signature development as well as evaluation of performance, it is possible to demonstrate which signature development technique would produce the highest percent correct classification for each crop type.

Anderson, J. E.↗

Improving Acoustic Models by Watching Television

Obtaining sufficient labelled training data is a persistent difficulty for speech recognition research. Although well transcribed data is expensive to produce, there is a constant stream of challenging speech data and poor transcription broadcast as closed-captioned television. We describe a reliable unsupervised method for identifying accurately transcribed sections of these broadcasts, and show how these segments can be used to train a recognition system. Starting from acoustic models trained on the Wall Street Journal database, a single iteration of our training method reduced the word error rate on an independent broadcast television news test set from 62.2% to 59.5%.

Witbrock, Michael J.↗

Unsupervised Segmentation Of Polarimetric SAR Data

Method of unsupervised segmentation of polarimetric synthetic-aperture-radar (SAR) image data into classes involves selection of classes on basis of multidimensional fuzzy clustering of logarithms of parameters of polarimetric covariance matrix. Data in each class represent parts of image wherein polarimetric SAR backscattering characteristics of terrain regarded as homogeneous. Desirable to have each class represent type of terrain, sea ice, or ocean surface distinguishable from other types via backscattering characteristics. Unsupervised classification does not require training areas, is nearly automated computerized process, and provides nonsubjective selection of image classes naturally well separated by radar.

Rignot, Eric J.↗

Unsupervised segmentation of polarimetric SAR data using the covariance matrix

A method for unsupervised segmentation of polarimetric synthetic aperture radar (SAR) data into classes of homogeneous microwave polarimetric backscatter characteristics is presented. Classes of polarimetric backscatter are selected on the basis of a multidimensional fuzzy clustering of the logarithm of the parameters composing the polarimetric covariance matrix. The clustering procedure uses both polarimetric amplitude and phase information, is adapted to the presence of image speckle, and does not require an arbitrary weighting of the different polarimetric channels; it also provides a partitioning of each data sample used for clustering into multiple clusters. Given the classes of polarimetric backscatter, the entire image is classified using a maximum a posteriori polarimetric classifier. Four-look polarimetric SAR complex data of lava flows and of sea ice acquired by the NASA/JPL airborne polarimetric radar (AIRSAR) are segmented using this technique. The results are discussed and compared with those obtained using supervised techniques.

Rignot, Eric J. M.↗

Data Mining for Anomaly Detection

The Vehicle Integrated Prognostics Reasoner (VIPR) program describes methods for enhanced diagnostics as well as a prognostic extension to current state of art Aircraft Diagnostic and Maintenance System (ADMS). VIPR introduced a new anomaly detection function for discovering previously undetected and undocumented situations, where there are clear deviations from nominal behavior. Once a baseline (nominal model of operations) is established, the detection and analysis is split between on-aircraft outlier generation and off-aircraft expert analysis to characterize and classify events that may not have been anticipated by individual system providers. Offline expert analysis is supported by data curation and data mining algorithms that can be applied in the contexts of supervised learning methods and unsupervised learning. In this report, we discuss efficient methods to implement the Kolmogorov complexity measure using compression algorithms, and run a systematic empirical analysis to determine the best compression measure. Our experiments established that the combination of the DZIP compression algorithm and CiDM distance measure provides the best results for capturing relevant properties of time series data encountered in aircraft operations. This combination was used as the basis for developing an unsupervised learning algorithm to define "nominal" flight segments using historical flight segments.

Biswas, Gautam↗