SEARCH · Search NASA

Results for “Contrastive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Machine learning interatomic potential for silicon-nitride (Si 3 N 4 ) by active learning

Silicon nitride (Si 3 N 4 ) is an extensively used material in the automotive, aerospace, and semiconductor industries. However, its widespread use is in contrast to the scarce availability of reliable interatomic potentials that can be employed to study various aspects of this material on an atomistic scale, particularly its amorphous phase. In this work, we developed a machine learning interatomic potential, using an efficient active learning technique, combined with the Gaussian approximation potential (GAP) method. Our strategy is based on using an inexpensive empirical potential to generate an initial dataset of atomic configurations, for which energies and forces were recalculated with density functional theory (DFT); thereafter, a GAP was trained on these data and an iterative re-training algorithm was used to improve it by learning on-the-fly. When compared to DFT, our potential yielded a mean absolute error of 8 meV/atom in energy calculations for a variety of liquid and amorphous structures and a speed-up of molecular dynamics simulations by 3–4 orders of magnitude, while achieving a first-rate agreement with experimental results. Our potential is publicly available in an open-access repository.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2002

Dar Al Gani 872: Yet Another Eucrite, Yet Another Lesson to Learn?

We present chemical and mineralogical data on a new monomict basaltic eucrite recovered from Libya. In contrast to most other eucrites, it exhibits high shock features, unusually heterogeneous exsolution of pigeonite, and interesting melt pockets. Additional information is contained in the original extended abstract.

Patzer, A.↗

DOE OSTI2022

Deep-Learning-Enabled Crack Detection and Analysis in Commercial Lithium-Ion Battery Cathodes

We report in Li-ion batteries, the mechanical degradation initiated by micro cracks is one of the bottlenecks for enhancing the performance. Quantifying the crack formation and evolution in complex composite electrodes can provide important insights into electrochemical behaviors under prolonged and/or aggressive cycling. However, observation and interpretation of the complicated crack patterns in battery electrodes through imaging experiments are often time-consuming, labor intensive, and subjective. Herein, a deep learning-based approach is developed to extract the crack patterns from nanoscale hard X-ray holo-tomography data of a commercial 18650-type battery cathode. Efficient and effective quantification of the damage heterogeneity with automation and statistical significance is demonstrated. The crack characteristics are further associated with the active particles’ packing densities and a potentially viable architectural design is discussed for suppressing the structural degradation in an industry-relevant battery configuration.

25 ENERGY STORAGE↗

DOE OSTI2025

Utilization of Data Augmentation Techniques in Automated Inspection Systems for Defect Detection in Metals With Limited Data

Accurate identification of defects on metal surfaces is of great interest to many industry sectors, such as the automotive and aerospace industries. In contrast to conventional manual inspection techniques, recent automated inspection systems employ deep learning models trained to detect defects rapidly and precisely. The development of these models often requires a substantial image dataset to acquire adequate knowledge of defect features and enhance their predictive accuracy. When data is limited, augmentation techniques are often used to improve the precision and accuracy of defect detection systems. This study examined the prediction performance of two object detection models, namely Faster Region‐based Convolutional Neural Network (Faster R‐CNN) and You Only Look Once version 8 (YOLOv8), to identify dent defects in limited images of cast iron cylinder head surfaces. The original image set contains 46 images with 563 dents. To overcome limited data availability, common image augmentation techniques along with a copy‐paste method were applied. Results show that standard augmentation improved YOLOv8 accuracy by 8.00% and average precision (AP) by 3.00%. On the other hand, the copy‐paste technique achieved a 20.00% increase in accuracy and a 1% increase in AP with just 200 synthetic dents. Furthermore, these results provide support for using the copy‐paste augmentation strategy to enhance defect detection performance, with a limited dataset, contributing to more accurate defect identification in remanufacturing processes.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Biomimetic Control over Bimetallic Nanoparticle Structure and Activity via Peptide Capping Ligand Sequence

Here, the controlled design of bimetallic nanoparticles (BNPs) is a key goal in tailoring their catalytic properties. Recently, biomimetic pathways demonstrated potent control over the distribution of different metals within BNPs, but a direct understanding of the peptide effect on the compositional distribution at the interparticle and intraparticle levels remains lacking. We synthesized two sets of PtAu systems with two peptides and correlated their structure, composition, and distributions with the catalytic activity. Structural and compositional analyses were performed by a combined machine learning-assisted refinement of X-ray absorption spectra and Z-contrast measurements by scanning transmission electron microscopy. The difference in the catalytic activities between nanoparticles synthesized with different peptides was attributed to the details of interparticle distribution of Pt and Au across these markedly heterogeneous systems, comprising Pt-rich, Au-rich, and Au core/Pt shell nanoparticles. The total amount of Pt in the shells of the BNPs was proposed to be the key catalytic activity descriptor. This approach can be extended to other systems of metals and peptides to facilitate the targeted design of catalysts with the desired activity.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Towards Anomaly Detection at the CMS High-Level Trigger System

Traditional trigger strategies in CMS typically rely on model-dependent selections or rigid kinematic cuts, risking the omission of unexpected exotic signatures. To address this, we propose a novel anomaly detection (AD) algorithm for the High-Level Trigger (HLT), designed to serve as a complementary second layer of filtering to the Level-1 AXOL1TL AD algorithm. We employ a transformer-based foundation model trained on a diverse ensemble of Standard Model processes. By combining a joint contrastive and classification objective, and using particle kinematics as inputs, the model learns to map events to a physics-informed latent space where anomalous events are isolated from dominant backgrounds. Preliminary results show that this strategy enhances the signal-to-background ratio across a range of rare SM and BSM scenarios. Furthermore, this work constitutes foundational R&D for the potential implementation of an analogous AD algorithm in the Level-1 trigger system for Phase-2.

Cruz, Roy [U. Wisconsin, Madison (main)] (ORCID:00↗

DOE OSTI2021

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗

DOE OSTI2025

Machine learning models for segmentation and classification of cyanobacterial cells

Abstract Timelapse microscopy has recently been employed to study the metabolism and physiology of cyanobacteria at the single-cell level. However, the identification of individual cells in brightfield images remains a significant challenge. Traditional intensity-based segmentation algorithms perform poorly when identifying individual cells in dense colonies due to a lack of contrast between neighboring cells. Here, we describe a newly developed software package called Cypose which uses machine learning (ML) models to solve two specific tasks: segmentation of individual cyanobacterial cells, and classification of cellular phenotypes. The segmentation models are based on the Cellpose framework, while classification is performed using a convolutional neural network named Cyclass. To our knowledge, these are the first developed ML-based models for cyanobacteria segmentation and classification. When compared to other methods, our segmentation models showed improved performance and were able to segment cells with varied morphological phenotypes, as well as differentiate between live and lysed cells. We also found that our models were robust to imaging artifacts, such as dust and cell debris. Additionally, the classification model was able to identify different cellular phenotypes using only images as input. Together, these models improve cell segmentation accuracy and enable high-throughput analysis of dense cyanobacterial colonies and filamentous cyanobacteria.

Huffine, Clair A.↗

DOE OSTI2021

Optimizing a magnitude-limited spectroscopic training sample for photometric classification of supernovae

ABSTRACT In preparation for photometric classification of transients from the Legacy Survey of Space and Time (LSST) we run tests with different training data sets. Using estimates of the depth to which the 4-m Multi-Object Spectroscopic Telescope (4MOST) Time Domain Extragalactic Survey (TiDES) can classify transients, we simulate a magnitude-limited sample reaching rAB ≈ 22.5 mag. We run our simulations with the software snmachine, a photometric classification pipeline using machine learning. The machine-learning algorithms struggle to classify supernovae when the training sample is magnitude limited, in contrast to representative training samples. Classification performance noticeably improves when we combine the magnitude-limited training sample with a simulated realistic sample of faint high-redshift supernovae observed from larger spectroscopic facilities; the algorithms’ range of average area under receiver operator characteristic curve (AUC) scores over 10 runs increases from 0.547–0.628 to 0.946–0.969 and purity of the classified sample reaches 95 per cent in all runs for two of the four algorithms. By creating new, artificial light curves using the augmentation software avocado, we achieve a purity in our classified sample of 95 per cent in all 10 runs performed for all machine-learning algorithms considered. We also reach a highest average AUC score of 0.986 with the artificial neural network algorithm. Having ‘true’ faint supernovae to complement our magnitude-limited sample is a crucial requirement in optimization of a 4MOST spectroscopic sample. However, our results are a proof of concept that augmentation is also necessary to achieve the best classification results.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Neural Learning Based Blind Source Separation for Detection of Material Defects in Pulsed Thermography Images

In this paper, we introduce a neural learning-based approach to blind source separation for detection of material flaws in pulsed thermography (PT) images. This approach can be used to detect internal defects (pores) in metallic Additively Manufactured (AM) materials. Such defects occur in high-strength alloys produced with direct laser sintering AM method for nuclear energy applications. Pulsed thermal imaging system utilizes a high intensity flash lamp to rapidly heat surface of sample, a high sensitivity infrared camera to capture data of surface temperature variations. The data cube obtained with PT (stack of surface temperature images at different times) can be analyzed with image processing algorithms to detect material defects. Compared with conventional nondestructive evaluation (NDE) methods, such as digital radiography and ultrasonic testing, the PT pulsed infrared thermal detection technique has advantages of one-sided non-contact measurements, fast processing of large sample areas captured in one image. Detection of small material defects requires finding features in thermal images, which have signal contrast levels approaching sensitivity limit of IR camera. In this study, an optimized Neural Learning based Blind Source Separation (NLBSS) algorithm, including Principal Component Analysis (PCA), and Independent Component Analysis (ICA) is demonstrated to automatically extract principal temporal and spatial features of thermography frames to enhance flaw detection. By using the NLBSS algorithm, material internal defects can be automatically detected. Furthermore, this processing approach compensates for experimental thermal imaging artifacts, such as noise and uneven heating. By merging artificial intelligence with the photothermic, the NDE system detects internal calibrated defects of various sizes and depths in AM nuclear-grade metallic alloys.

Zhang, Xin↗

DOE OSTI2026

Mechanisms of Alkali Ionic Transport in Amorphous Oxyhalides Solid State Conductors

Amorphous oxyhalides have attracted significant attention due to their relatively high ionic conductivity (1 mS cm –1 ), excellent chemical stability, mechanical softness, and facile synthesis routes via standard solid‐state reactions. These materials exhibit an ionic conductivity that is almost independent of the underlying chemistry, in stark contrast to what occurs in crystalline conductors. In this work, we employ machine learning interatomic potentials to construct large‐scale molecular dynamics trajectories encompassing hundreds of nanoseconds to obtain statistically converged transport properties. We find that the amorphous state consists of chain fragments of metal‐anion tetrahedra of various lengths. By analyzing the residence time of alkali cations migrating around tetrahedrally‐coordinated metals, we find that oxygen anions limit alkali diffusion. By computing the full Einstein expression of the ionic conductivity, we demonstrate that the alkali transference number of these materials is strongly influenced by distinct‐particles correlations, while alkali transport is dictated by uncorrelated self‐diffusion. By extending this analysis to chemical compositions AMX 2.5 O 0.75 , spanning different alkaline (A = Li, Na, K), metallic (M = Al, Ga, In), and halogen (X = Cl, Br, I) species, we clarify why the diffusion properties of these materials remain largely insensitive to variations in atomic isovalent chemistry.

amorphous materials↗

DOE OSTI2024

2023 Southeast Decarbonization Workshop

Decarbonization refers to a large-scale shift away from fossil fuel sources for energy production and toward energy sources, energy end-use practices, and land management approaches that do not result in a net increase of carbon dioxide in the atmosphere. Decarbonization in the Southeastern United States is distinguished from that of other regions in the country by its potential impact on historically underserved populations and the ways this region’s human–environmental systems are predicted to fare in a climate-altered world. In parallel, ensuring a clean energy transition requires the ability to engage entire communities that are motivated to learn, build, and encourage the spread of so-called clean tech. In contrast to other technology trends from the past century, the foundation of clean tech is a shared sense of purpose—a collective strategy to mitigate the threats of climate change and support a better environment for everyone. As seen in the Office of Science and Technology Policy’s (OSTP’s) Net-Zero Technology Action Plan (2023), decarbonization is best accelerated by simultaneous investments in Innovation, Demonstration, and Deployment of technology in tandem with intentional policy and community-based solutions. The 2023 Southeast Decarbonization Workshop, hosted by the Georgia Institute of Technology (Georgia Tech) and Oak Ridge National Laboratory (ORNL), aimed to bring together members of our communities and a group of regional experts to strategize about opportunities in this important area, as well as to incorporate the important pillar of System Interactions to bridge the gap between clean tech’s intent and its impact.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1998

35 GHz Measurements of CO2 Crystals for Simulating Observations of the Martian Polar Caps

In order to learn more about the Martian polar caps, it is important to compare and contrast the behavior of both frozen H2O and CO2 in different parts of the electromagnetic spectrum. Relatively little attention has been given, thus far, to observing the thermal microwave part of the spectrum. In this experiment, passive microwave radiation emanating from within a 33 cm snowpack was measured with a 35 GHz hand-held radiometer, and in addition to the natural snow measurements, the radiometer was used to measure the microwave emission and scattering from layers of manufactured CO2 (dry ice). A 1 m x 2 m plate of aluminum sheet metal was positioned beneath the natural snow so that microwave emissions from the underlying soil layers would be minimized. Compared to the natural snow crystals, results for the dry ice layers exhibit lower' microwave brightness temperatures for similar thicknesses, regardless of the incidence angle of the radiometer. For example, at 50 degree H (horizontal polarization) and with a covering of 21 cm of snow and 18 cm of dry ice, the brightness temperatures were 150 K and 76 K, respectively. When the snow depth was 33 cm, the brightness temperature was 144 K, and when the total thickness of the dry ice was 27 cm, the brightness temperature was 86 K. The lower brightness temperatures are due to a combination of the lower physical temperature and the larger crystal sizes of the commercial CO2 Crystals compared to the snow crystals. As the crystal size approaches the size of the microwave wavelength, it scatters microwave radiation more effectively, thus lowering the brightness temperature. The dry ice crystals in this experiment were about an order of magnitude larger than the snow crystals and three orders of magnitude larger than the CO2 Crystals produced in the cold stage of a scanning electron microscope. Spreading soil, approximately 2 mm in thickness, on the dry ice appeared to have no effect on the brightness temperatures.

Foster, J. L.↗

NASA NTRS2016

Mineralogy of Eolian Sands at Gale Crater

The Mars Science Laboratory rover Curiosity has been exploring outcrop and regolith in Gale crater since August 6, 2012. During this exploration, the mission has collected 10 samples for mineralogical analysis by X-ray diffraction (XRD), using the CheMin instrument. The CheMin (Chemistry and Mineralogy) instrument on the Mars Science Laboratory rover Curiosity uses a CCD detector and a Co-anode tube source to acquire both mineralogy (from the pat-tern of Co diffraction) and chemical information (from energies of fluoresced X-rays). A detailed description of CheMin is provided in [1]. As part of the rover checkout after landing, the first sample selected for analysis was an eolian sand deposit (the Rocknest "sand shadow"). This sample was selected in part to characterize unconsolidated eolian regolith, but primarily to prove performance of the scoop collection system on the rover. The focus of the mission after Rocknest was on the consolidated sediments of Gale crater, so all of the nine subsequent samples were collected by drilling into bedrock com-posed of lithified sedimentary materials, including mudstone and sandstone. No scoop samples have been collected since Rocknest, but at the time this abstract was written the mission stands poised to use the scoop again, to collect active dune sands from the Bagnold dune field. Several abstracts at this conference outline the Bagnold dune campaign and summarize preliminary results from analyses on approach to the Namib dune sampling site. In this abstract we review the mineralogy of Rocknest, contrast that with the mineralogy of local sediments, and anticipate what will be learned by XRD analysis of Bagnold dune sands.

Achilles, C. N.↗

DOE OSTI2020

The Role of Competitions in Speeding Energy-Efficient Technology Development and Adoption

This conference paper, which will be submitted for publication in the 2020 ACEEE Summer Study on Energy Efficiency in Buildings, describes competition approaches used by the U.S. Department of Energy (DOE) Building Technologies Office (BTO) and other government agencies to encourage the development and adoption of innovative new energy-efficient, high-performing products while spurring external competition to maximize limited resources. The competition model helps to disrupt traditional thinking and introduce, expand, and evolve what’s possible within limited resource conditions. DOE BTO has sponsored technology competitions, including campaigns, challenges, prizes, and technology procurements to speed the uptake of more efficient refrigerators, clothes washers, air conditioners, and many types of highly efficient lighting technologies, including compact fluorescent lamps (CFLs) and light-emitting diode LED-based home and office luminaires, replacement lamps, and street lighting. In this paper, we will draw upon the technology competition frameworks employed by DOE BTO to support ongoing research and development efforts to illustrate the differences between the approaches and to identify which type is likely to be the most effective in a given technology status and market context. We’ll also share examples of the various technology competition types and results. A question-and-answer table helps readers compare and contrast the four competition types. The paper concludes with a summary of lessons learned from past DOE BTO competitions. The paper will be available in the ACEEE 2020 Summer Study proceedings and a related presentation will be given at the conference.

U.S. Department of Energy Building Technologies Of↗

DOE OSTI2024

Complexity of many-body interactions in transition metals via machine-learned force fields from the TM23 data set

Abstract This work examines challenges associated with the accuracy of machine-learned force fields (MLFFs) for bulk solid and liquid phases ofd-block elements. In exhaustive detail, we contrast the performance of force, energy, and stress predictions across the transition metals for two leading MLFF models: a kernel-based atomic cluster expansion method implemented using sparse Gaussian processes (FLARE), and an equivariant message-passing neural network (NequIP). Early transition metals present higher relative errors and are more difficult to learn relative to late platinum- and coinage-group elements, and this trend persists across model architectures. Trends in complexity of interatomic interactions for different metals are revealed via comparison of the performance of representations with different many-body order and angular resolution. Using arguments based on perturbation theory on the occupied and unoccupieddstates near the Fermi level, we determine that the large, sharpddensity of states both above and below the Fermi level in early transition metals leads to a more complex, harder-to-learn potential energy surface for these metals. Increasing the fictitious electronic temperature (smearing) modifies the angular sensitivity of forces and makes the early transition metal forces easier to learn. This work illustrates challenges in capturing intricate properties of metallic bonding with current leading MLFFs and provides a reference data set for transition metals, aimed at benchmarking the accuracy and improving the development of emerging machine-learned approximations.

Chemistry↗

DOE OSTI2020

Predicting the proximity to macroscopic failure using local strain populations from dynamic in situ X-ray tomography triaxial compression experiments on rocks

Predicting the proximity of large-scale dynamic failure is a critical concern in the engineering and geophysical sciences. Here we use evolving contractive, dilatational, and shear strain deformation preceding failure in dynamic X-ray tomography experiments to examine which strain components best predict the proximity to failure. We develop machine learning models to predict the proximity to failure using time series of three-dimensional local incremental strain tensor fields acquired in rock deformation experiments under stress conditions of the upper crust. Three-dimensional scans acquired in situ throughout triaxial compression experiments provide a distribution of density contrasts from which we estimate the three-dimensional incremental strain that accumulates between each scan acquisition. Training machine learning models on multiple experiments of six rock types provides suites of feature importance that indicate the predictive power of each feature. Comparing the average importance of groups of features that include information about each strain component quantifies the ability of the contractive, dilatational and shear strain to predict the proximity of macroscopic failure. A total of 24 models of four machine learning algorithms with six rock types indicate that 1) the dilatational strain provides the best predictive power of the strain components, and 2) the intermediate values (25th-75th percentile) of the strain population provide the best predictive power of the statistics of the strain populations. In addition, the success of the predictions of models trained on one rock type and tested on other rock types quantifies the similarities and differences of the precursory strain accumulation process in the six rock types. These similarities suggest the potential existence of a unified theory of brittle rock deformation for a range of rock types.

58 GEOSCIENCES↗

DOE OSTI2022

Physics-assisted generative adversarial network for X-ray tomography

X-ray tomography is capable of imaging the interior of objects in three dimensions non-invasively, with applications in biomedical imaging, materials science, electronic inspection, and other fields. The reconstruction process can be an ill-conditioned inverse problem, requiring regularization to obtain satisfactory results. Recently, deep learning has been adopted for tomographic reconstruction. Unlike iterative algorithms which require a distribution that is known a priori , deep reconstruction networks can learn a prior distribution through sampling the training distributions. In this work, we develop a Physics-assisted Generative Adversarial Network (PGAN), a two-step algorithm for tomographic reconstruction. In contrast to previous efforts, our PGAN utilizes maximum-likelihood estimates derived from the measurements to regularize the reconstruction with both known physics and the learned prior. Compared with methods with less physics assisting in training, PGAN can reduce the photon requirement with limited projection angles to achieve a given error rate. The advantages of using a physics-assisted learned prior in X-ray tomography may further enable low-photon nanoscale imaging.

47 OTHER INSTRUMENTATION↗