Search NASA⌕ Search

SEARCH · Search NASA

Results for “unsupervised”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Automated phase segmentation and quantification of high-resolution TEM image for alloy design

In the alloy design and development process, a wealth of atomically resolved structural high-resolution transmission electron microscopy (HRTEM) images are produced. Identifying the different nano-precipitate phases and tracking their evolution under various compositions and during manufacturing or post-processing requires hundreds of HRTEM images and thousands of precipitates. The nanoscopic phase information labeling and analysis purely relies on humans are prohibitively costly and time-consuming, sometimes not reliable because of the lack of authoritative knowledge. Here, in this work, we develop a novel unsupervised machine learning approach coupled with adaptive computer vision techniques with features in the Fourier space to automatically determine the number of phases and segment/quantify the phases with nanoscale resolution, allowing for quantitative correlation between nanostructure formation, processing and functional properties. To automate the phase extraction/quantification and ascertain its applicability, we have applied the developed framework to the HRTEM images from several alloy systems, processing conditions, image magnifications, and phase types and morphologies (precipitates, nano-twins, stacking faults, crystalline matrix, and amorphous structures) for verification. This study paves the road for compression, visualization, and translation of raw image structural data into physically relevant information in real-time with minimal human supervision. It shows the promise of enabling high-throughput materials characterization for the acceleration of alloy manufacturing and design.

36 MATERIALS SCIENCE↗

Unveiling the structural transformations in glassy solid electrolyte adapted to high-stress cycles

Brittleness of glass–ceramic and ceramic ion conductors is considered as a main roadblock for their implementation as electrolytes in solid-state batteries where the fractures often occur due to the pressure exerted by metallic lithium. In this regard, nano- and micro-scale ductility of the solid electrolyte allows reducing such pressure without formation of cracks. Among different types of solid state ion conductors, phosphate invert glasses seem to be promising in achieving such ductility. We report the mechanical behavior of lithium phosphorous oxynitride (LiPON) invert glass probed by static and cyclic nanoindentation. Repeated application of high intensity stress results in densification and shear deformation of material allowing LiPON to accommodate the ~ 22% nominal strain imposed by the nanoindenter without cracking. Ability to do this under repeated loading indicates robustness of LiPON when used in lithium metal batteries under cyclic charge and discharge. Using Raman spectroscopy with unsupervised K-means clustering we reveal pressure-induced formation of P 2 O 7 units which migrate to the periphery of the residual hardness impressions with cycling resulting in surface morphology of LiPON superficially similar to that of deformed bulk metallic glass.

36 MATERIALS SCIENCE↗

NaroNet: Discovery of tumor microenvironment elements from highly multiplexed images

Understanding the spatial interactions between the elements of the tumor microenvironment -i.e. tumor cells. fibroblasts, immune cells- and how these interactions relate to the diagnosis or prognosis of a tumor is one of the goals of computational pathology. We present NaroNet, a deep learning framework that models the multi-scale tumor microenvironment from multiplex-stained cancer tissue images and provides patient-level interpretable predictions using a seamless end-to-end learning pipeline. Trained only with multiplex-stained tissue images and their corresponding patient-level clinical labels, NaroNet unsupervisedly learns which cell phenotypes, cell neighborhoods, and neighborhood interactions have the highest influence to predict the correct label. To this end, NaroNet incorporates several novel and state-of-the-art deep learning techniques, such as patch-level contrastive learning, multi-level graph embeddings, a novel max-sum pooling operation, or a metric that quantifies the relevance that each microenvironment element has in the individual predictions. We validate NaroNet using synthetic data simulating multiplex-immunostained images where a patient label is artificially associated to the -adjustable- probabilistic incidence of different microenvironment elements. We then apply our model to two sets of images of human cancer tissues: 336 seven-color multiplex-immunostained images from 12 high-grade endometrial cancer patients; and 382 35-plex mass cytometry images from 215 breast cancer patients. In both synthetic and real datasets, NaroNet provides outstanding predictions of relevant clinical information while associating those predictions to the presence of specific microenvironment elements.

60 APPLIED LIFE SCIENCES↗

Methods for rapid identification of anomalous layers in laser powder bed fusion

In situ process monitoring is a key requirement for increased industry acceptance of powder bed Additive Manufacturing. As sensing technologies increase in maturity, attention must also be given to effective data exploration techniques. These data are often high-resolution and multi-modal, with each build consisting of thousands of layers. Here, in this paper, the authors propose two methods enabling users to rapidly identify layers of interest within a build. Both methods leverage results from deep learning based segmentations of in situ powder bed images. The first method is an unsupervised “reverse layer search” algorithm while the second method uses supervised machine learning.

36 MATERIALS SCIENCE↗

Database development and exploration of process–microstructure relationships using variational autoencoders

The paper demonstrates graphical representation of a large database containing process–microstructure relationships using an unsupervised machine learning algorithm. Correlating microstructural features to processing is an essential first step to answer the difficult problem of process sequence design. Here, a large database of 346,200 orientation distribution functions resulting from a variety of process sequences is constructed, where each sequence comprises up to four stages of tension, compression and rolling along different directions in various permutations. This open-source database is constructed for collaborative development of process design algorithms. The paper demonstrates a novel application of the large database: graphical representation of texture–process relationships. A variational autoencoder is used to reduce the entire database to a two dimensional latent space where variations in processes and properties can be visualized. Using proximity analysis in this latent space, we can quickly unearth multiple process solutions to the problem of texture or property design.

36 MATERIALS SCIENCE↗

Automated integration gate selection for Gaussian mixture model pulse shape discrimination

Pulse shapes differ between neutron and gamma particles when measured with detector devices employing pulse shape discriminating (PSD) scintillators. Digitized waveforms can be used in detection systems to perform pulse shape discrimination for this application. Prior Gaussian Mixture Model (GMM) methods require access to the pulse full-waveform. Reducing the waveform to a smaller set of combined samples reduces computational cost while affecting PSD performance. In this work, we develop a method for selecting the best performing combination of integration gates, or contiguous summed segments of the digitized pulse for PSD. The method uses a discrimination score based on the GMM PSD approach. Furthermore, the final selection is performed using Bayesian Optimization. PSD detection results are compared with varying numbers of selected gates on time-of-flight (TOF) data. This method can be used to fully automate the selection of gates in an unsupervised (without ground truth labels) setting.

42 ENGINEERING↗

Machine-learning-based automatic small-angle measurement between planar surfaces in interferometer images: A 2D multilayer Laue lenses case

Here, we report a new machine-learning-based approach to automatically measure the small angle between multiple planar surfaces characterized by white light interferometers. By applying an unsupervised clustering algorithm, DBSCAN (Density-Based Spatial Clustering of Applications with Noise), the multiple surfaces in an interferometer image are automatically identified as distinct surfaces. The angles between every two surfaces are then calculated through the surface fitting. This method can be applied to multiple surfaces regardless of their shapes and locations and significantly simplifies the angle measurement procedure. Using the developed method, we have demonstrated a quick and precise angle measurement for the alignment of 2D Multilayer Laue Lenses (MLLs) for the development of high-resolution x-ray microscopy. This automatic, accurate, and robust small-angle measurement method is compatible with widely used white light interferometers and can be further applied to other metrology applications of interferometer results.

36 MATERIALS SCIENCE↗

Combustion machine learning: Principles, progress and prospects

Progress in combustion science and engineering has led to the generation of large amounts of data from large-scale simulations, high-resolution experiments, and sensors. This corpus of data offers enormous opportunities for extracting new knowledge and insights—if harnessed effectively. Machine learning (ML) techniques have demonstrated remarkable success in data analytics, thus offering a new paradigm for data-intense analyses and scientific investigations through combustion machine learning (CombML). While data-driven methods are utilized in various combustion areas, recent advances in algorithmic developments, the accessibility of open-source software libraries, the availability of computational resources, and the abundance of data have together rendered ML techniques ubiquitous in scientific analysis and engineering. This article examines ML techniques for applications in combustion science and engineering. Starting with a review of sources of data, data-driven techniques, and concepts, we examine supervised, unsupervised, and semi-supervised ML methods. Various combustion examples are considered to illustrate and to evaluate these methods. Next, we review past and recent applications of ML approaches to problems in combustion, spanning fundamental combustion investigations, propulsion and energy-conversion systems, and fire and explosion hazards. Challenges unique to CombML are discussed and further opportunities are identified, focusing on interpretability, uncertainty quantification, robustness, consistency, creation and curation of benchmark data, and the augmentation of ML methods with prior combustion-domain knowledge.

33 ADVANCED PROPULSION SYSTEMS↗

A machine learning-based interaction force model for non-spherical and irregular particles in low Reynolds number incompressible flows

In this study, interaction force of non-spherical particles in low Reynolds number gas-solid flow is investigated by neural network approaches. An artificial neural network (ANN) model is developed to correlate the non-spherical particle shape and the flow conditions with the interaction force. To define the particle shape, spherical harmonic expansion is applied. Furthermore, variational autoencoder model is then used to extract latent geometric features. The latent vector is utilized as an input with the Reynolds number for the ANN. The interaction force data, which is used as output data of the ANN, is obtained by particle resolved direct numerical simulation for 5200 non-spherical particles. The proposed model enables unsupervised extraction for non-spherical particle shapes and accurate predictions on the interaction force without heavy computation. This study provides the model that can explain complicated shapes of particles and be applied to a large scale, computational fluid dynamics simulation.

01 COAL, LIGNITE, AND PEAT↗

Automated and efficient local adaptive regression for principal component-based reduced-order modeling of turbulent reacting flows

Principal Component Analysis can be used to reduce the cost of Computational Fluid Dynamics simulations of turbulent reacting flows by reducing the dimensionality of the transported variables through projection of the thermochemical state onto a lower-dimensional manifold. However, because of the nonlinearity of the principal component source terms, nonlinear regression techniques must be utilized for the source terms in terms of the principal components. Unfortunately, widely available and utilized nonlinear regression techniques can have prohibitive computational requirements and/or accuracy that is highly dependent on user experience in ad hoc tuning of model architecture and hyperparameters. Here, in this work, a new nonlinear regression approach is proposed that is both computationally efficient and automated so does not require any user input. The approach is evaluated through a priori prediction of principal component source terms using data from a Direct Numerical Simulation of a turbulent nonpremixed n-heptane/air jet flame. In particular, the proposed framework consists of local regressions whose complexity is adapted according to the local nonlinearity of the data: local linear regression when accurate enough and local Artificial Neural Networks when nonlinear regression is required. The number of local clusters for local regression is determined automatically using the Davies-Bouldin index. In addition, Bayesian optimization is utilized for model training (i.e., to select the best architectures and hyperparameters of the nonlinear regressions in an unsupervised fashion), eliminating ad hoc hand-tuning and/or expensive grid searches. Overall, compared to a single, global neural network, the new local adaptive regression approach is shown to have comparable accuracy but 69% less training time due to the utilization of local linear regression and faster training of local neural networks.

42 ENGINEERING↗

Directionally supervised cellular automaton for the initial peopling of Sahul

Reconstructing the patterns of Homo sapiens expansion out of Africa and across the globe has been advanced using demographic and travel-cost models. However, modelled routes are ipso facto influenced by migration rates, and vice versa. We combined movement ‘superhighways’ with a demographic cellular automaton to predict one of the world's earliest peopling events — Sahul between 75000 and 50000 years ago. Novel outcomes from the superhighways-weighted model include (i) an approximate doubling of the predicted time to continental saturation (~10,000 years) compared to that based on the directionally unsupervised model (~5000 years), suggesting that rates of migration need to account for topographical constraints in addition to rate of saturation; (ii) a previously undetected movement corridor south through the centre of Sahul early in the expansion wave based on the scenarios assuming two dominant entry points into Sahul; and (iii) a better fit to the spatially de-biased, Signor-Lipps-corrected layer of initial arrival inferred from dated archaeological material. Our combined model infrastructure provides a data-driven means to examine how people initially moved through, settled, and abandoned different regions of the globe.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of chemometric models to classify solid-state U materials by micro-Raman spectroscopy

Discerning uranium (U) particles found in environmental sampling is of interest for monitoring the peaceful use of nuclear material. In this study, a soft independent modeling of class analogy (SIMCA) library was successfully developed for the classification of a four-class system consisting of α-U 3 O 8 , UO 2 , UO 2 (NO 3 ) 2 ·6H 2 O (UNH), and UO 2 O 2 ·4H 2 O (studtite) by Raman spectroscopy in the presence of matrix particulates and additional outliers. Spectral variability between numerous particles of each type revealed appreciable differences as a function of particle size with respect to hydration state and potential oxide phase within each class. Interclass variability was accounted for using both unsupervised and supervised chemometric models. The supervised SIMCA model displayed reasonable sensitivity for each U class and a high degree of specificity by returning whether a spectrum belonged to one class or not. This work demonstrates how Raman spectral features and chemometrics can be used to distinguish U materials from one another and from matrix materials such as flint clay. Combining the outlined chemometric approach with Raman mapping sequences could provide a rapid, nondestructive technique to characterize the chemical composition of a diverse collection of U compounds amid background samples for environmental sampling, nuclear forensics, and industrial applications.

Actinide↗

Ensemble models for circuit topology estimation, fault detection and classification in distribution systems

This paper presents a methodology for simultaneous fault detection, classification, and topology estimation for adaptive protection of distribution systems. The methodology estimates the probability of the occurrence of each one of these events by using a hybrid structure that combines three sub-systems, a convolutional neural network for topology estimation, a fault detection based on predictive residual analysis, and a standard support vector machine with probabilistic output for fault classification. The input to all these sub-systems is the local voltage and current measurements. A convolutional neural network uses these local measurements in the form of sequential data to extract features and estimate the topology conditions. The fault detector is constructed with a Bayesian stage (a multitask Gaussian process) that computes a predictive distribution (assumed to be Gaussian) of the residuals using the input. Since the distribution is known, these residuals can be transformed into a Standard distribution, whose values are then introduced into a one-class support vector machine. The structure allows using a one-class support vector machine without parameter cross-validation, so the fault detector is fully unsupervised. Finally, a support vector machine uses the input to perform the classification of the fault types. All three sub-systems can work in a parallel setup for both performance and computation efficiency. In conclusion, we test all three sub-systems included in the structure on a modified IEEE123 bus system, and we compare and evaluate the results with standard approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Identification of characteristic molecular signature for volatile organic compounds in peripheral blood of rat

In a previous report we demonstrated that the transcriptomic response of liver tissue was specific to toxicants, and a characteristic molecular signature could be used as an early prognostic biomarker in rats. It is necessary to determine the transcriptomic response to toxicants in peripheral blood for application to the human system. Volatile organic compounds (VOCs) comprise a major group of pollutants which significantly affect the chemistry of the atmosphere and human health. In this study we identified and validated the specific molecular signatures of toxicants in rat whole blood as early predictors of environmental toxicants. VOCs (dichloromethane, ethylbenzene, and trichloroethylene) were administered to 11-week-old SD male rats after 48 h of exposure, peripheral whole blood was subjected to expression profiling analysis. Unsupervised gene expression analysis resulted in a characteristic molecular signature for each toxicant, and supervised analysis identified 1,217 outlier genes as distinct molecular signatures discerning VOC exposure from healthy controls. Further analysis of multi-classification suggested 337 genes as early detective molecular markers for three VOCs with 100% accuracy. A large-scale gene expression analysis of a different VOC exposure animal model suggested that characteristic expression profiles exist in blood cells and multi-classification of this VOC-specific molecular signature can discriminate each toxicant at an early exposure time. This blood expression signature can thus be used as discernable surrogate marker for detection of biological responses to VOC exposure in an environment.

60 APPLIED LIFE SCIENCES↗

Arsenic responsive microRNAs in vivo and their potential involvement in arsenic-induced oxidative stress

Arsenic exposure is postulated to modify microRNA (miRNA) expression, leading to changes of gene expression and toxicities, but studies relating the responses of miRNAs to arsenic exposure are lacking, especially with respect to in vivo studies. We utilized high-throughput sequencing technology and generated miRNA expression profiles of liver tissues from Sprague Dawley (SD) rats exposed to various concentrations of sodium arsenite (0, 0.1, 1, 10 and 100 mg/L) for 60 days. Unsupervised hierarchical clustering analysis of the miRNA expression profiles clustered the SD rats into different groups based on the arsenic exposure status, indicating a highly significant association between arsenic exposure and cluster membership (p-value of 0.0012). Multiple miRNA expressions were altered by arsenic in an exposure concentration-dependent manner. Among the identified arsenic-responsive miRNAs, several are predicted to target Nfe2l2-regulated antioxidant genes, including glutamate–cysteine ligase (GCL) catalytic subunit (GCLC) and modifier subunit (GCLM) which are involved in glutathione (GSH) synthesis. Exposure to low concentrations of arsenic increased mRNA expression for Gclc and Gclm, while high concentrations significantly reduced their expression, which were correlated to changes in hepatic GCL activity and GSH level. Moreover, our data suggested that other mechanisms, e.g., miRNAs, rather than Nfe2l2-signaling pathway, could be involved in the regulation of mRNA expression of Gclc and Gclm post-arsenic exposure in vivo. Together, our findings show that arsenic exposure disrupts the genome-wide expression of miRNAs in vivo, which could lead to the biological consequence, such as an altered balance of antioxidant defense and oxidative stress. - Highlights: • Chronic arsenic exposure induces changes of hepatic miRNA expression profiles. • Hepatic GCL activity and GSH level in rats are altered following arsenic exposure. • Arsenic induced GCL expression change is independent to Nfe2l2-signaling pathway. • Expression of several miRNAs predicted to target GCL changed after arsenic exposure.

60 APPLIED LIFE SCIENCES↗

Three-dimensional paganica fault morphology obtained from hypocenter clustering (L'Aquila 2009 seismic sequence, Central Italy)

In seismic modelling, fault planes are normally assumed to be flat due to the lack of data which can constrain fault morphology. However, incorporating 3D fault morphology is important for modelling several phenomena, for example calculating mainshock induced stress changes. Here we utilize a data-analytical method to unveil the 3D rupture morphology of faults using unsupervised clustering techniques applied to earthquake hypocenters in seismic sequences. We apply this method to the 2009 L'Aquila seismic sequence which involved a M W 6.1 mainshock on April 6th. We use a dataset of about 50,000 relocated events, mostly microearthquakes, reaching magnitude of completeness equal to 0.7. Clustering distinguishes the earthquakes as occurring in three main clusters along with other minor fault segments. We then represent the morphology of the main Paganica fault system (responsible for the largest mainshock) using splines. This method shows promise as a step toward robustly and quickly obtaining 3D rupture morphologies where earthquake sequences have been monitored. The 3D model is presented interactively online, and the processing is presented in an interactive Jupyter Notebook (https://bit.ly/2MnCFdj).

58 GEOSCIENCES↗

Fast Grain Mapping with Sub-Nanometer Resolution Using 4D-STEM with Grain Classification by Principal Component Analysis and Non-Negative Matrix Factorization

High-throughput grain mapping with sub-nanometer spatial resolution is demonstrated using scanning nanobeam electron diffraction (also known as 4D scanning transmission electron microscopy, or 4D-STEM) combined with high-speed direct-electron detection. An electron probe size down to 0.5 nm in diameter is used and the sample investigated is a gold–palladium nanoparticle catalyst. Computational analysis of the 4D-STEM data sets is performed using a disk registration algorithm to identify the diffraction peaks followed by feature learning to map the individual grains. Two unsupervised feature learning techniques are compared: principal component analysis (PCA) and non-negative matrix factorization (NNMF). The characteristics of the PCA versus NNMF output are compared and the potential of the 4D-STEM approach for statistical analysis of grain orientations at high spatial resolution is discussed.

47 OTHER INSTRUMENTATION↗