Search NASA⌕ Search

SEARCH · Search NASA

Results for “unsupervised method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗

MALDI Orbitrap Mass Spectrometry Profiling of Dysregulated Sulfoglycosphingolipids in Renal Cell Carcinoma Tissues

Matrix-assisted laser desorption/ionization coupled with Orbitrap mass spectrometry (MALDI-Orbitrap-MS) is used for the clinical study of patients with renal cell carcinoma (RCC), as the most common type of kidney cancer. Significant changes in sulfoglycosphingolipid abundances between tumor and autologous normal kidney tissues are observed. First, sulfoglycosphingolipid species in studied RCC samples are identified using high mass accuracy full scan and tandem mass spectra. Subsequently, optimization, method validation, and statistical evaluation of MALDI-MS data for 158 tissues of 80 patients are discussed. More than 120 sulfoglycosphingolipids containing one to five hexosyl units are identified in human RCC samples based on the systematic study of their fragmentation behavior. Many of them are recorded here for the first time. Multivariate data analysis (MDA) methods, i.e., unsupervised principal component analysis (PCA) and supervised orthogonal partial least square discriminant analysis (OPLS-DA), are used for the visualization of differences between normal and tumor samples to reveal the most up- and downregulated lipids in tumor tissues. Obtained results are closely correlated with MALDI mass spectrometry imaging (MSI) and histologic staining. Important steps of the present MALDI-Orbitrap-MS approach are also discussed, such as the selection of best matrix, correct normalization, validation for semiquantitative study, and problems with possible isobaric interferences on closed masses in full scan mass spectra. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep learning analysis of defect and phase evolution during electron beam-induced transformations in WS2

Abstract Recent advances in scanning transmission electron microscopy (STEM) allow the real-time visualization of solid-state transformations in materials, including those induced by an electron beam and temperature, with atomic resolution. However, despite the ever-expanding capabilities for high-resolution data acquisition, the inferred information about kinetics and thermodynamics of the process, and single defect dynamics and interactions is minimal. This is due to the inherent limitations of manual ex situ analysis of the collected volumes of data. To circumvent this problem, we developed a deep-learning framework for dynamic STEM imaging that is trained to find the lattice defects and apply it for mapping solid state reactions and transformations in layered WS 2 . The trained deep-learning model allows extracting thousands of lattice defects from raw STEM data in a matter of seconds, which are then classified into different categories using unsupervised clustering methods. We further expanded our framework to extract parameters of diffusion for sulfur vacancies and analyzed transition probabilities associated with switching between different configurations of defect complexes consisting of Mo dopant and sulfur vacancy, providing insight into point-defect dynamics and reactions. This approach is universal and its application to beam-induced reactions allows mapping chemical transformation pathways in solids at the atomic level.

36 MATERIALS SCIENCE↗

Time resolved surface photovoltage measurements using a big data capture approach to KPFM

Optoelectronic behavior in materials such as organic/inorganic hybrid perovskites depend on a complex interplay between fast (electronic) and slower (ionic) processes. These processes are thought to be influenced by structural inhomogeneities (e.g. interfaces and grain boundaries) bringing forward the necessity for development of techniques capable of correlating nanostructure and photo-transport behavior. While Kelvin probe force microscopy (KPFM) is ideally suited to map surface potentials on relevant length scales, it lacks sufficient temporal resolution to extract the meaningful system dynamics. Here, we develop a time resolved surface photovoltage (SPV) measurement based on full information capture of the photodetector stream during open loop KPFM operation. G-Mode, or G-KPFM allows quantification of SPV with microsecond temporal and nanoscale spatial resolution. Using this technique, we observe concurrent spatial and fast temporal variations in the SPV generated across a methylammonium lead bromide (MAPbBr3) thin film, a possible indicator relating microstructure with heterogenous photo-transport behavior. Here, we further demonstrate the advantage of adopting big data analytics including unsupervised clustering methods to quickly discern spatial variability in the information rich SPV dataset. Beyond G-KPFM, such clustering methods will be useful for interpretation of the multidimensional datasets arising from the growing number of time resolved KPFM approaches now available.

36 MATERIALS SCIENCE↗

A neural network for determination of latent dimensionality in Nonnegative Matrix Factorization

Non-negative Matrix Factorization (NMF) has proven to be a powerful unsupervised learning method for uncovering hidden features in complex and noisy datasets with applications in data mining, text recognition, dimension reduction, face recognition, anomaly detection, blind source separation, and many other fields. An important input for NMF is the latent dimensionality of the data, that is, the number of hidden features, K, present in the explored dataset. Unfortunately, and this quantity is rarely known a priori. The existing methods for determining latent dimensionality, such as Automatic Relevance Determination (ARD), are mostly heuristic and utilize different characteristics to estimate the number of hidden features. However, all of them require human presence to make a final determination of K. Here we utilize a supervised machine learning approach in combination with a recent method for model determination, called NMFk, to determine the number of hidden features automatically. NMFk performs a set of NMF simulations on an ensemble of matrices, obtained by bootstrapping the initial dataset, and estimates which K produces stable groups of latent features that reconstruct the initial dataset well. We then train a Multi-Layter Perceptron (MLP) classifier network to determine the correct number of latent features utilizing the statistics and characteristics of the NMF solution, obtained from NMFk. In order to train the MLP classifier, a training set of 58,660 matrices with predetermined latent features were factorized with NMFk. The MLP classifier in conjunction with NMFk maintains a greater than 95% success rate when applied to a held out test set. Additionally, when applied to two well-known benchmark datasets, the swimmer and MIT face data, NMFk/MLP correctly recovers the established number of hidden features. Finally, we compare the accuracy of our method to the ARD, AIC and Stability-based methods.

97 MATHEMATICS AND COMPUTING↗

Symbolic pregression: Discovering physical laws from distorted video

In this work, we present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled synthetic video (or, more generally, for discovering and modeling predictable features in time-series data). We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of motion are as simple as possible, by minimizing a combination of nonlinearity, acceleration, and prediction error. Differential equations describing the motion are then discovered using Pareto-optimal symbolic regression. We find that our pre-regression (“pregression”) step is able to rediscover Cartesian coordinates of unlabeled moving objects even when the video is distorted by a generalized lens. Using intuition from multidimensional knot theory, we find that the pregression step is facilitated by first adding extra latent space dimensions to avoid topological problems during training and then removing these extra dimensions via principal component analysis. An inertial frame is autodiscovered by minimizing the combined equation complexity for multiple experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Convolutional Variational Autoencoder-based Unsupervised Learning for Power Systems Faults

Classification of power system event data is a growing need, particularly where non-protective relaying-based sensors are used to monitor grid performance. Given the high burden of obtaining event data with appropriate labeling, an unsupervised approach is highly valuable. This approach enables using event data without labeling, which is far easier to obtain. This paper presents an unsupervised learning method to classify and label transients observed in the distribution grid. A Convolutional Variational Autoencoder (CVAE) was developed for this purpose. We demonstrate the efficacy of our approach using the transient data generated from the simulations. The simulation data is used to train the CVAE that identifies different faults as different clusters in the latent space. The clusters are then used as the foundation model to categorize the real-world data.

Alam, Maksudul↗

Minor Isozymes Tailor Yeast Metabolism to Carbon Availability

ABSTRACT Isozymes are enzymes that differ in sequence but catalyze the same chemical reactions. Despite their apparent redundancy, isozymes are often retained over evolutionary time, suggesting that they contribute to fitness. We developed an unsupervised computational method for identifying environmental conditions under which isozymes are likely to make fitness contributions. This method analyzes published gene expression data to find specific experimental perturbations that induce differential isozyme expression. In yeast, we found that isozymes are strongly enriched in the pathways of central carbon metabolism and that many isozyme pairs show anticorrelated expression during the respirofermentative shift. Building on these observations, we assigned function to two minor central carbon isozymes, aconitase 2 ( ACO2 ) and pyruvate kinase 2 ( PYK2 ). ACO2 is expressed during fermentation and proves advantageous when glucose is limiting. PYK2 is expressed during respiration and proves advantageous for growth on three-carbon substrates. PYK2 ’s deletion can be rescued by expressing the major pyruvate kinase only if that enzyme carries mutations mirroring PYK2 ’s allosteric regulation. Thus, central carbon isozymes help to optimize allosteric metabolic regulation under a broad range of potential nutrient conditions while requiring only a small number of transcriptional states. IMPORTANCE Gene duplication is one of the main evolutionary paths to new protein function. Typically, duplicated genes either accumulate mutations and degrade into pseudogenes or are retained and diverge in function. Some duplicated genes, however, show long-term persistence without apparently acquiring new function. An important class of isozymes consists of those that catalyze the same reaction in the same compartment, where knockout of one isozyme causes no known functional defect. Here we present an approach to assigning specific functional roles to seemingly redundant isozymes. First, gene expression data are analyzed computationally to identify conditions under which isozyme expression diverges. Then, knockouts are compared under those conditions. This approach revealed that the expression of many yeast isozymes diverges in response to carbon availability and that carbon source manipulations can induce fitness phenotypes for seemingly redundant isozymes. A driver of these fitness phenotypes is differential allosteric enzyme regulation, indicating isozyme divergence to achieve more-optimal control of metabolism.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

GraphEM

An unsupervised segmentation method for structural analysis of Scanning Transmission Electron Microscopy (STEM) images

Pope, Jenna↗

Subseasonal Representation and Predictability of North American Weather Regimes Using Cluster Analysis

Abstract This study focuses on assessing the representation and predictability of North American weather regimes, which are persistent large-scale atmospheric patterns, in a set of initialized subseasonal reforecasts created using the Community Earth System Model, version 2 (CESM2). The k -means clustering was used to extract four key North American (10°–70°N, 150°–40°W) weather regimes within ERA5 reanalysis, which were used to interpret CESM2 subseasonal forecast performance. Results show that CESM2 can recreate the climatology of the four main North American weather regimes with skill but exhibits biases during later lead times with overoccurrence of the West Coast high regime and underoccurrence of the Greenland high and Alaskan ridge regimes. Overall, the West Coast high and Pacific trough regimes exhibited higher predictability within CESM2, partly related to El Niño. Despite biases, several reforecasts were skillful and exhibited high predictability during later lead times, which could be partly attributed to skillful representation of the atmosphere from the tropics to extratropics upstream of North America. The high predictability at the subseasonal time scale of these case-study examples was manifested as an “ensemble realignment,” in which most ensemble members agreed on a prediction despite ensemble trajectory dispersion during earlier lead times. Weather regimes were also shown to project distinct temperature and precipitation anomalies across North America that largely agree with observational products. This study further demonstrates that unsupervised learning methods can be used to uncover sources and limits of subseasonal predictability, along with systematic biases present in numerical prediction systems. Significance Statement North American weather regimes are large-scale atmospheric patterns that can persist for several days. Their skillful subseasonal (2 weeks or greater) prediction can provide valuable lead time to prepare for temperature and precipitation anomalies that can stress energy and water resources. The purpose of this study was to assess the climatological representation and subseasonal predictability of four key North American weather regimes using a research subseasonal prediction system and clustering analysis. We found that the Pacific trough and West Coast high regimes exhibited higher predictability than other regimes and that skillful representation of conditions across the tropics and extratropics can increase predictability during later lead times. Future work will quantify causal pathways associated with high predictability.

58 GEOSCIENCES↗

Unsupervised Learning Through Randomized Algorithms for High-Volume High-Velocity Data (ULTRA-HV).

Through long-term investments in computing, algorithms, facilities, and instrumentation, DOE is an established leader in massive-scale, high-fidelity simulations, as well as science-leading experimentation. In both cases, DOE is generating more data than it can analyze and the problem is intensifying quickly. The need for advanced algorithms that can automatically convert the abundance of data into a wealth of useful information by discovering hidden structures is well recognized. Such efforts however, are hindered by the massive volume of the data and its high velocity. Here, the challenge is developing unsupervised learning methods to discover hidden structure in high-volume, high-velocity data.

97 MATHEMATICS AND COMPUTING↗

Machine Learning for Geothermal Resource Exploration in the Tularosa Basin, New Mexico

Geothermal energy is considered an essential renewable resource to generate flexible electricity. Geothermal resource assessments conducted by the U.S. Geological Survey showed that the southwestern basins in the U.S. have a significant geothermal potential for meeting domestic electricity demand. Within these southwestern basins, play fairway analysis (PFA), funded by the U.S. Department of Energy’s (DOE) Geothermal Technologies Office, identified that the Tularosa Basin in New Mexico has significant geothermal potential. This short communication paper presents a machine learning (ML) methodology for curating and analyzing the PFA data from the DOE’s geothermal data repository. The proposed approach to identify potential geothermal sites in the Tularosa Basin is based on an unsupervised ML method called non-negative matrix factorization with custom k-means clustering. This methodology is available in our open-source ML framework, GeoThermalCloud (GTC). Using this GTC framework, we discover prospective geothermal locations and find key parameters defining these prospects. Our ML analysis found that these prospects are consistent with the existing Tularosa Basin’s PFA studies. This instills confidence in our GTC framework to accelerate geothermal exploration and resource development, which is generally time-consuming.

15 GEOTHERMAL ENERGY↗

Big Data and AI at DoE's Legacy Sites - 20546

More than 30 years have passed since DOE started the decommissioning of nuclear weapon complexes and the clean-up of soil and groundwater. All the sites have been collecting and archiving soil and groundwater monitoring datasets; particularly contaminant concentration time-series. These datasets provide unparalleled opportunities to understand the system behavior (including more fundamental hydrological and geochemical processes, the response to various perturbations, the long-term trend and environmental decay rate towards the regulatory limit). This understanding is critical for providing multiple lines of evidences that can support site closure. In this study, we explore the machine learning (ML) and artificial intelligence (AI) applications to the long-term soil and groundwater management at DoE's legacy sites. ML can improve our understanding of the subsurface systems, which is critical for long-term monitoring and management of the sites, while AI can automate or support some of decision-making processes (e.g., anomaly detection, monitoring well placements). The particular focuses are to develop general algorithms to: (1) to identify distinct spatiotemporal patterns and to identify several groups that have similar temporal behaviors, using unsupervised clustering methods, (2) identify the different temporal scales of hydrological responses to climate perturbations by time-series analysis, and (3) reduce the number of monitoring wells by identifying the minimum sufficient number of wells to capture the heterogeneity of the groundwater contaminant plume and concentration distribution, using the Gaussian Process model. We demonstrate our methodology at the Savannah River Site F-Area. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Anomaly Detection and Identification Using a Leave-One-Variable-Out Method

At nuclear power plants (NPPs), anomaly detection and identification (i.e., determining the causes of anomalies) are important tasks for ensuring the safe and efficient operation of NPPs. These tasks are currently labor-intensive and costly, and are made more difficult by the size and complexity of NPP systems. An alternative approach to conducting these tasks is to automate them, such as via the reconstruction-based contribution method, which is a well-researched unsupervised machine learning method that uses a data-driven model of anomaly-free behavior to detect events and then identify each variable’s contributions to those events. The present effort developed a novel contribution approach that utilized a leave-one-variable-out (LOVO) model, with which each variable is predicted using all the other variables. The novelty lay in transforming this model into a reconstruction model and modifying the identification algorithm to work with the new reconstruction model. To evaluate this method in a controlled environment, a synthetic dataset based on spring-mass-damper (SMD) systems (commonly found in mechanical engineering references) was used, with known anomalies introduced into the system. The proposed method successfully detected the anomalies and afforded insights into their causes, thus enabling the appropriate identifications to be made.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Active Learning with Rationales for Identifying Operationally Significant Anomalies in Aviation

A major focus of the commercial aviation community is discovery of unknown safety events in flight operations data. Data-driven unsupervised anomaly detection methods are better at capturing unknown safety events compared to rule-based methods which only look for known violations. However, not all statistical anomalies that are discovered by these unsupervised anomaly detection methods are operationally significant (e.g., represent a safety concern). Subject Matter Experts (SMEs) have to spend significant time reviewing these statistical anomalies individually to identify a few operationally significant ones. In this paper we propose an active learning algorithm that incorporates SME feedback in the form of rationales to build a classifier that can distinguish between uninteresting and operationally significant anomalies. Experimental evaluation on real aviation data shows that our approach improves detection of operationally significant events by as much as 75% compared to the state-of-the-art. The learnt classifier also generalizes well to additional validation data sets.

anomaly detection↗

Exploring variability in seasonal average and extreme precipitation using unsupervised machine learning.

Focal Area(s): We will use unsupervised machine learning methods to identify and quantify the influence of large scale natural modes of climate variability to gain insight into the observed and simulated seasonal average and extreme precipitation changes. Science Challenge: A recent paper, led by co-PI Mark Risser, finds that although much of the variability in seasonal average and extreme precipitation over CONUS is unforced, the effect of large-scale modes of circulation variability (such as ENSO, AMO, PNA, etc.) can be detected and attributed. However, it is unclear whether or not unsupervised learning methods can (a) replicate this finding or (b) yield insight into possible nonlinear behavior that was not captured in the initial statistical analysis. Further work would entail extending this framework to other global land areas.

54 ENVIRONMENTAL SCIENCES↗

Methods for rapid identification of anomalous layers in laser powder bed fusion

In situ process monitoring is a key requirement for increased industry acceptance of powder bed Additive Manufacturing. As sensing technologies increase in maturity, attention must also be given to effective data exploration techniques. These data are often high-resolution and multi-modal, with each build consisting of thousands of layers. Here, in this paper, the authors propose two methods enabling users to rapidly identify layers of interest within a build. Both methods leverage results from deep learning based segmentations of in situ powder bed images. The first method is an unsupervised “reverse layer search” algorithm while the second method uses supervised machine learning.

36 MATERIALS SCIENCE↗