Search NASA⌕ Search

SEARCH · Search NASA

Results for “segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Cutting edge deep learning techniques allow for image segmentation with great speed and accuracy. However, application to problems in materials science is often difficult since these complex models may have difficultly learning meaningful image features that would enable extension to new datasets. In situ electron microscopy provides a clear platform for utilizing automated image analysis. In this work, we consider the case of studying coarsening dynamics in supported nanoparticles, which is important for understanding, for example, the degradation of industrial catalysts. By systematically studying dataset preparation, neural network architecture, and accuracy evaluation, we describe important considerations in applying deep learning to physical applications, where generalizable and convincing models are required. With a focus on unique challenges that arise in high-resolution images, we propose methods for optimizing performance of image segmentation using convolutional neural networks, critically examining the application of complex deep learning models in favor of motivating intentional process design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An efficient instance segmentation approach for studying fission gas bubbles in irradiated metallic nuclear fuel

Abstract Gaseous fission products from nuclear fission reactions tend to form fission gas bubbles of various shapes and sizes inside nuclear fuel. The behavior of fission gas bubbles dictates nuclear fuel performances, such as fission gas release, grain growth, swelling, and fuel cladding mechanical interaction. Although mechanical understanding of the overall evolution behavior of fission gas bubbles is well known, lacking the quantitative data and high-level correlation between burnup/temperature and microstructure evolution blocks the development of predictive models and reduces the possibility of accelerating the qualification for new fuel forms. Historical characterization of fission gas bubbles in irradiated nuclear fuel relied on a simple threshold method working on low-resolution optical microscopy images. Advanced characterization of fission gas bubbles using scanning electron microscopic images reveals unprecedented details and extensive morphological data, which strains the effectiveness of conventional methods. This paper proposes a hybrid framework, based on digital image processing and deep learning models, to efficiently detect and classify fission gas bubbles from scanning electron microscopic images. The developed bubble annotation tool used a multitask deep learning network that integrates U-Net and ResNet to accomplish instance-level bubble segmentation. With limited annotated data, the model achieves a recall ratio of more than 90%, a leap forward compared to the threshold method. The model has the capability to identify fission gas bubbles with and without lanthanides to better understand the movement of lanthanide fission products and fuel cladding chemical interaction. Lastly, the deep learning model is versatile and applicable to the micro-structure segmentation of similar materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Precisely segmented PEEK–ionene + ionic liquid composite membranes for CO 2 separation

Ionenes, polymers with ionic groups incorporated directly within the backbone are a highly versatile class of materials, although they have received much less attention than polyelectrolytes which have ionic groups pendant from the polymer backbone. By designing ionenes that incorporate robust properties of poly(ether ether ketone) (PEEK), we have achieved new imidazolium-containing PEEK–ionene architectures that create opportunities for enhanced CO 2 separation membranes. To achieve these materials, an new imidazole-functionalized PEEK oligomer (ImK(EEK) 2 KIm) was synthesized through facile and straightforward routes. This molecule was then polymerized via condensation reactions with two different aromatic (α,α'-dibromo-p-xylene) and aliphatic (dibromohexyl containing-bis(imidazolium)hexane dibromide salt) comonomers and exchanged with bistriflimide ([Tf 2 N]) anion to obtain two unique PEEK–ionenes containing distinct PEEK and ionic segments: p([ImK(EEK) 2 Im-p-xyl][Tf 2 N] 2 ) and p([ImK(EEK) 2 (ImC 6 ) 3 ][Tf 2 N] 4 ). While the neat PEEK–ionenes exhibited high molecular weight but were not able to form high-quality films, adding stoichiometric amounts of “free” IL (1-methyl-3-butylimidazolium bistriflimide, [C 4 mIm][Tf 2 N]), greatly improved the flexibility and processability of the resultant membranes. Further, the structure–property relationships of bulk PEEK–ionenes and corresponding composites were extensively characterized by different analytical techniques (thermogravimetric analysis, differential scanning calorimetry, X-ray diffraction, and solid-state NMR). In conclusion, the gas separation properties were investigated, with the PEEK–ionenes + IL composites exhibiting CO 2 permeabilities of 14–94 barrer and good CO 2 /N 2 permselectivities of 26–35, indicating that new designs of segmented ionenes and composites with ILs a promising material design strategy for developing gas separation membranes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Digital twins and deep learning segmentation of defects in monolayer MX 2 phases

Developing methods to understand and control defect formation in nanomaterials offers a promising route for materials discovery. Monolayer MX 2 phases represent a particularly compelling case for defect engineering of nanomaterials due to the large variability in their physical properties as different defects are introduced into their structure. However, effective identification and quantification of defects remain a challenge even as high-throughput scanning transmission electron microscopy methods improve. This study highlights the benefits of employing first principles calculations to produce digital twins for training deep learning segmentation models for defect identification in monolayer MX 2 phases. Around 600 defect structures were obtained using density functional theory calculations, with each monolayer MX 2 structure being subjected to multislice simulations for the purpose of generating the digital twins. Several deep learning segmentation architectures were trained on this dataset, and their performances evaluated under a variety of conditions such as recognizing defects in the presence of unidentified impurities, beam damage, grain boundaries, and with reduced image quality from low electron doses. Further, this digital twin approach allows benchmarking different deep learning architectures on a theory dataset, which enables the study of defect classification under a broad array of finely controlled conditions. It thus opens the door to resolving the underpinning physical reasons for model shortcomings and potentially chart paths forward for automated discovery of materials defect phases in experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Unsupervised Segmentation and Clustering Workflow for Efficient Processing of 4D-STEM and 5D-STEM Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as data dimensionality and sampling density increase, particularly for in situ scanning diffraction experiments (5D-STEM), robust segmentation of structurally consistent behavior across sequential measurements becomes essential for efficient and physically meaningful analysis. Here, we introduce a clustering framework that identifies crystallographically distinct domains from 4D-STEM datasets. By using local diffraction-pattern similarity as a metric, the method extracts closed contours delineating spatially contiguous regions. This approach produces cluster-averaged diffraction patterns that improve signal quality while reducing data volume by orders of magnitude, enabling rapid and accurate orientation, phase, and strain mapping. We demonstrate the applicability of this approach to in situ liquid-cell 4D-STEM data of gold nanoparticle growth. Our method provides a scalable and generalizable route for spatially coherent segmentation, data compression, and quantitative structure–strain mapping across diverse 4D-STEM modalities. The full analysis code and example workflows are publicly available to support reproducibility and reuse.

4D-STEM↗
DOE OSTI2023

Hindered segmental dynamics in associative protein hydrogels studied by neutron spin-echo spectroscopy

Transient binding between associating macromolecules can cause qualitative changes to chain dynamics, including modes of conformational relaxation and diffusion, through tethering effects imparted by long-range connectivity. Here, in this work, the role of binding on short-time segmental dynamics in associative polymer gels is investigated by neutron spin-echo (NSE) measurements on a class of model artificial coiled-coil proteins with a systematically varied architecture, probing timescales of 0.1–130 ns, and length scales close to the molecular radius of gyration. The results illustrate effects of transient cross-linking on chain dynamics on different timescales, manifested in changes in segmental relaxation behavior with variations in strand length, chain concentration, and sticker distribution (endblock- vs midblock-functionalized). In all gels, a short-time cooperative diffusion mode is seen over all wave vectors, analogous to a semidilute solution, with no transitions seen at any known structural length scale. However, the diffusion coefficients are found to decrease with increasing junction density across all gels, with the strand length and number of stickers per chain in each gel appearing to play a relatively minor role. The slowing of cooperative diffusion with junction density contrasts with classical predictions of a greater restoring force for fluctuation dissipation due to the increased elasticity, suggesting additional effects of the coiled-coil junctions such as an enhancement in local viscosity that slows dynamics. Notably, the relaxation rates for all gels can be rescaled by the interjunction spacing inferred from small-angle neutron scattering, where they collapse onto a master curve suggestive of self-similar dynamics even in networks with different strand lengths and chain architectures. On long timescales (but shorter than the junction exchange time), a slowing of network relaxation is observed, resulting in a nondecaying plateau in the spin-echo amplitude attributed to a freezing of chain dynamics due to tethering. A characteristic length scale corresponding to the extent of dynamic fluctuations is estimated for each gel, which appears to be smaller than the interjunction spacing but similar to the correlation blob size of the overlapping strands. The results indicate an important role of transient binding on molecular-scale dynamics in associative polymer gels, even on timescales shorter than the junction exchange time, in addition to its effects on long-range self-diffusion previously observed.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Predictive Control to Further Reduce DC-Link Capacitor Current Stress for Segmented Inverter

Two three-phase interleaved inverters have been used in traction drive applications to reduce the current stress in a DC link capacitor bank. In such applications, either carrier-based or space vector modulation is used to select the optimum switching sequences, and the results show 50% less capacitor current than that of a single three-phase inverter. The switching state selection process for this inverter is tedious, and there has been no research to find the optimal switching state. To overcome this challenge, this research employed a simple finite set model predictive control to select the optimum switching sequence for a dual three-phase interleaved topology, called a segmented inverter. The results show that the predictive control algorithm can provide a simple solution and can reduce the current stress by 27% compared with traditional modulation techniques for the segmented inverters.

Ribeiro, Pedro↗
DOE OSTI2022

Ductile failure and damage localization in Al6061-T6 characterized by in situ X-ray computed tomography and neural network segmentation

Damage initiation and localization in uniaxial tension tests of an Al6061-T6 alloy are evaluated and quantified using in situ X-ray computed tomography and a neural network segmentation strategy. This segmentation strategy offers significant advantages over traditional thresholding in quantifying microstructural and damage evolution metrics. Void nucleation was observed to occur throughout the deformation process, whereas void volume did not grow significantly until later stages of deformation. Localized analysis determined that void nucleation begins in and around the necked region during the early stages of deformation, whereas limited damage nucleation occurs outside of the neck until late stages of deformation. Lastly, inhomogeneities in void and particle spacing in the initial undeformed state of the material are observed to correlate well with the location of damage localization and necking during deformation. These results provide new insights into the ductile failure of Al alloys and how preexisting defects influence damage and rupture.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Segmenting water and shadow regions within WorldView imagery using local binary patterns

Many shadow detection algorithms pertaining to remotely sensed imagery exist. Several of these algorithms exploit the spectral characteristics of shadows within imagery to identify shaded regions. However, these algorithms can have problems when water is also present within the imagery because water shares similar spectral characteristics with shadows. Many of these algorithms are applied to small image subsets instead of the image as a whole and frequently are applied to urban environments that require additional use of the normalized difference water index or other features to affect the removal of water from the shadow mask. This diversity of the image scene content coupled with the complexity and wide variety of environmental conditions that satellite imagery can acquire makes reliably separating shadow and water within larger images a complex problem. Thresholding various spectral indices to produce segmentation maps can be challenging when large, complex, and often imbalanced scenes are captured, which may require manual adjustment of algorithmic parameters for different image areas. Here, we present a methodology that makes use of the near-infrared channel using a watershed segmentation algorithm, local binary pattern measurements, and a support vector machine to classify shadow and water within a full WorldView scene. Results are promising with initial accuracies above 97% for both shadow and water.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Quantifying the robustness of deep multispectral segmentation models against natural perturbations and data poisoning

In overhead image segmentation tasks, including additional spectral bands beyond the traditional RGB channels can improve model performance. However, it is still unclear how incorporating this additional data impacts model robustness to adversarial attacks and natural perturbations. For adversarial robustness, the additional in-formation could improve the model’s ability to distinguish malicious inputs, or simply provide new attack avenues and vulnerabilities. For natural perturbations, the additional information could better inform model decisions and weaken perturbation effects or have no significant influence at all. In this work, we seek to characterize the performance and robustness of a multispectral (RGB and near infrared) image segmentation model subjected to adversarial attacks and natural perturbations. While existing adversarial and natural robustness research has focused primarily on digital perturbations, we prioritize on creating realistic perturbations designed with physical world conditions in mind. For adversarial robustness, we focus on data poisoning attacks whereas for natural robustness, we focus on extending ImageNet-C common corruptions for fog and snow that coherently and self-consistently perturbs the input data. Overall, we find both RGB and multispectral models are vulnerable to data poisoning attacks regardless of input or fusion architectures and that while physically-realizable natural perturbations still degrade model performance, the impact differs based on fusion architecture and input data.

Deep learning, multispectral images, multimodal fu↗
DOE OSTI2021

Discovery of segmented Fermi surface induced by Cooper pair momentum

Imaging a peculiar Fermi surface Running a current through a superconductor can cause the superconducting gap to close on a section of the Fermi surface. However, observing this segmented Fermi surface directly is tricky. To do so, Zhu et al . worked with a thin film of the topological insulator bismuth telluride placed on top of superconducting niobium diselenide. A small applied magnetic field caused a screening current, which in turn led to a segmented Fermi surface in the topological insulator layer. Using a scanning tunneling microscope, the researchers were able to map out this Fermi surface. —JS

Science & Technology - Other Topics↗
DOE OSTI2025

Foundation Models for Zero-Shot Segmentation of Scientific Images without AI-Ready Data

Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive computer vision platform designed to reduce data readiness bottlenecks in scientific imaging workflows. Zenesis integrates lightweight multimodal adaptation for zero-shot inference on raw scientific data, human-in-the-loop refinement, and heuristic-based temporal enhancement. We validate our approach on Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) datasets of catalyst-loaded membranes. Zenesis outperforms baselines, achieving an average accuracy of 0.947, Intersection over Union (IoU) of 0.858, and Dice score of 0.923 on amorphous catalyst samples; and 0.987 accuracy, 0.857 IoU, and 0.923 Dice on crystalline samples. These results represent a significant performance gain over conventional methods such as Otsu thresholding and standalone models like the Segment Anything Model (SAM). Zenesis enables effective image segmentation in domains where annotated datasets are limited, offering a scalable solution for scientific discovery.

Mukherjee, Shubhabrata↗
DOE OSTI2020

Collective Risk Ranking of Highway Segments on the Basis of Severity-Weighted Crash Rates

This study is intended to focus on the major factors affecting traffic crash rates and severity levels, in addition to identifying crash-prone locations (i.e., black spots) based on the two indicators. The available crash data for different road segments used for the analysis were obtained from the Washington state database provided by the Highway Safety Information System (HSIS) for the years 2006 to 2011. A Random Forest (RF) classifier was used to predict the outcome level of crash severity, while crash rates were predicted by applying RF regressor. Certain features were selected for each model besides the abstraction of new features to check if there are unobserved correlations affecting the independent variables, such as accounting for the number and weight of crashes within 1 km2 area by implementing the Getis-Ord Gi∗ index. Moreover, to calculate the collective risk (CR) score, crash rates were adjusted to incorporate crash severity weights (cost per severity type) and regression-to-the-mean (RTM) bias via Empirical Bayes (EB) method. Finally, segments were ranked according to their CR score.

Li, Dawei↗
DOE OSTI2023

Machine learning and deep learning for brain tumor MRI image segmentation

Brain tumors are often fatal. Therefore, accurate brain tumor image segmentation is critical for the diagnosis, treatment, and monitoring of patients with these tumors. Magnetic resonance imaging (MRI) is a commonly used imaging technique for capturing brain images. Both machine learning and deep learning techniques are popular in analyzing MRI images. This article reviews some commonly used machine learning and deep learning techniques for brain tumor MRI image segmentation. The limitations and advantages of the reviewed machine learning and deep learning methods are discussed. Even though each of these methods has a well-established status in their individual domains, the combination of two or more techniques is currently an emerging trend.

Research & Experimental Medicine↗
DOE OSTI2022

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Segmented Gamma Scanner for Radioactive Waste Assessment: A User Guide

Radioactive waste assessment is important for ensuring nuclear material security at various types of facilities, such as enrichment, fuel fabrication, and reprocessing plants. The waste generated at such nuclear facilities is stored in standard containers and is required to be characterized for material-accounting purposes. The segmented gamma scanner system is a popular, nondestructive analysis measurement system used for characterizing nuclear material, including radioactive waste. This document provides guidance on how to achieve effective performance from a segmented gamma scanner system for accurately quantifying fission products, activation products, and transuranic wastes.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Multimodal Few-Shot Segmentation of Electron Micrographs

Scanning transmission electron microscopy (STEM) is one of the most used methods of analyzing the chemistry and composition of materials. By analyzing microstructures, these microscopes can help scientists better understand the molecular underpinnings of microelectronics, batteries, and more. However, STEM data can be difficult to interpret, so recent developments have been made in applications of machine learning to analyze these images. The PNNL-developed pyCHIP Classifier has achieved results in segmenting STEM these images via few-shot learning, a method which requires little data and human input, perfect for quickly analysis. In my internship I (Eli Meyers) investigated a multimodal improvement of this classifier by incorporating energy dispersive x-ray spectroscopy (EDS) data into the classification process for a more accurate segmentation. Furthermore, I encoded the spectral data by training a mass spectrometry encoder on the EDS data to extract a more meaningful representation of the data.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A High Power Density and High Efficiency Traction Drive Based on a Segmented Inverter and an Axial and Radial Flux Hybrid Machine

Eaton Corporation and Oak Ridge National Laboratory (ORNL) collaborated to develop a high performance traction drive system aimed at increasing power density and overall efficiency. The system integrates Eaton’s hybrid flux motor—combining radial and axial flux paths to convert end-winding and structural elements into torque-producing components—with ORNL’s high-power-density segmented inverter. This motor design achieves higher torque density within the same footprint as traditional radial flux machines by effectively utilizing end turns. ORNL’s segmented inverter reduces the DC bus capacitor requirement by over 50% compared to standard voltage source inverters (VSIs), achieving power densities exceeding 100 kVA/L. The dual-module architecture also enables six-phase operation, aligning with Eaton’s motor design. Together, the motor and inverter offer a compact, efficient traction drive system with the potential for significant reductions in system weight and improvements in powertrain efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗