Search NASA⌕ Search

SEARCH · Search NASA

Results for “segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Robust High-Throughput Phenotyping with Deep Segmentation Enabled by a Web-Based Annotator

The abilities of plant biologists and breeders to characterize the genetic basis of physiological traits are limited by their abilities to obtain quantitative data representing precise details of trait variation, and particularly to collect this data at a high-throughput scale with low cost. Although deep learning methods have demonstrated unprecedented potential to automate plant phenotyping, these methods commonly rely on large training sets that can be time-consuming to generate. Intelligent algorithms have therefore been proposed to enhance the productivity of these annotations and reduce human efforts. We propose a high-throughput phenotyping system which features a Graphical User Interface (GUI) and a novel interactive segmentation algorithm: Semantic-Guided Interactive Object Segmentation (SGIOS). By providing a user-friendly interface and intelligent assistance with annotation, this system offers potential to streamline and accelerate the generation of training sets, reducing the effort required by the user. Our evaluation shows that our proposed SGIOS model requires fewer user inputs compared to the state-of-art models for interactive segmentation. As a case study of the use of the GUI applied for genetic discovery in plants, we present an example of results from a preliminary genome-wide association study (GWAS) of in planta regeneration in Populus trichocarpa (poplar). We further demonstrate that the inclusion of a semantic prior map with SGIOS can accelerate the training process for future GWAS, using a sample of a dataset extracted from a poplar GWAS of in vitro regeneration. The capabilities of our phenotyping system surpass those of unassisted humans to rapidly and precisely phenotype our traits of interest. The scalability of this system enables large-scale phenomic screens that would otherwise be time-prohibitive, thereby providing increased power for GWAS, mutant screens, and other studies relying on large sample sizes to characterize the genetic basis of trait variation. Our user-friendly system can be used by researchers lacking a computational background, thus helping to democratize the use of deep segmentation as a tool for plant phenotyping.

54 ENVIRONMENTAL SCIENCES↗

High-Throughput Field Plant Phenotyping: A Self-Supervised Sequential CNN Method to Segment Overlapping Plants

High-throughput plant phenotyping—the use of imaging and remote sensing to record plant growth dynamics—is becoming more widely used. The first step in this process is typically plant segmentation, which requires a well-labeled training dataset to enable accurate segmentation of overlapping plants. However, preparing such training data is both time and labor intensive. To solve this problem, we propose a plant image processing pipeline using a self-supervised sequential convolutional neural network method for in-field phenotyping systems. This first step uses plant pixels from greenhouse images to segment nonoverlapping in-field plants in an early growth stage and then applies the segmentation results from those early-stage images as training data for the separation of plants at later growth stages. The proposed pipeline is efficient and self-supervising in the sense that no human-labeled data are needed. We then combine this approach with functional principal components analysis to reveal the relationship between the growth dynamics of plants and genotypes. We show that the proposed pipeline can accurately separate the pixels of foreground plants and estimate their heights when foreground and background plants overlap and can thus be used to efficiently assess the impact of treatments and genotypes on plant growth in a field environment by computer vision techniques. This approach should be useful for answering important scientific questions in the area of high-throughput phenotyping.

59 BASIC BIOLOGICAL SCIENCES↗

Micro-channel cooling of integrated combustor nozzle of a segmented annular combustion system

A segmented annular combustion system includes integrated combustor nozzles, each of which has a fuel injection panel disposed radially between an inner liner segment and an outer liner segment. The fuel injection panel includes an aft end portion, a first side wall, a second side wall, premixing channels defined between the first side wall and the side wall, and injection outlets defined along at least one of the first side wall and the second side wall. The aft end portion defines a turbine nozzle portion. An interior portion between the first side wall and the second side wall includes walls that extend between the first and second side walls, thereby partitioning the interior portion into discrete air cavities. The liner segments may be cooled by micro-channel cooling passages, which may be fluidly coupled to a collection trough.

33 ADVANCED PROPULSION SYSTEMS↗

Cooling of integrated combustor nozzle of segmented annular combustion system

A segmented annular combustion system includes integrated combustor nozzles, each of which has a fuel injection panel disposed radially between an inner liner segment and an outer liner segment. The fuel injection panel includes an aft end portion, a first side wall, a second side wall, premixing channels defined between the first side wall and the side wall, and injection outlets defined along at least one of the first side wall and the second side wall. The aft end portion defines a turbine nozzle portion. An interior portion between the first side wall and the second side wall includes walls that extend between the first and second side walls, thereby partitioning the interior portion into discrete air cavities. The air cavities and the liner segments may be cooled by impingement inserts or panels.

42 ENGINEERING↗

Armature segment, armature and methods for assembling them

The present disclosure relates to armature segments for an armature for an electrical machine. An armature segment may comprise a plurality of coils and an electrically insulating supporting structure providing structural support to the plurality of coils. An armature may comprise a plurality of armature segments. The present disclosure further relates to methods for assembling such armature segments and armature.

Cross, Andrew Thomas↗

Adaptive Patching for High-resolution Image Segmentation with Transformers

Attention-based models are proliferating in the space of image analytics, including segmentation. The standard method of feeding images to transformer encoders is to divide the images into patches and then feed the patches to the model as a linear sequence of tokens. For high-resolution images, e.g. microscopic pathology images, the quadratic compute and memory cost prohibits the use of an attention-based model, if we are to use smaller patch sizes that are favorable in segmentation. The solution is to either use custom complex multi-resolution models or approximate attention schemes. We take inspiration from Adapative Mesh Refinement (AMR) methods in HPC by adaptively patching the images, as a pre-processing step, based on the image details to reduce the number of patches being fed to the model, by orders of magnitude. This method has a negligible overhead, and works seamlessly with any attention-based model, i.e. it is a pre-processing step that can be adopted by any attention-based model without friction. We demonstrate superior segmentation quality over SoTA segmentation models for realworld pathology datasets while gaining a geomean speedup of 6.9× for resolutions up to 64K2, on up to 2, 048 GPUs.

Zhang, Enzhi↗

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne↗

A VR-based volumetric medical image segmentation and visualization system with natural human interaction

Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

42 ENGINEERING↗

Paw-Net: Stacking ensemble deep learning for segmenting scanning electron microscopy images of fine-grained shale samples

Segmentation of scanning electron microscopy (SEM) images is critical yet time-consuming for geological analyses, as it needs to differentiate the boundaries for different mineral objects to facilitate subsequent analyses, such as porosity calculation. Recently, various machine learning methods, especially convolutional neural networks (CNNs), have been explored to segment SEM images of fine-grained shale samples. However, we found that general CNNs do not yield optimal performance due to insufficient training data and imbalanced objects in SEM images. This work has revised the U-Net architecture, a popular approach for biomedical image analyses, by incorporating a loss function that addresses the imbalance issue. Furthermore, we used the ensemble learning method to train multiple models and combined the results to improve the overall performance of segmentation. We prepared 2162 sub-images from raw SEM images in our experiments and divided them into training, validation, and testing datasets. The overall results show that our method improves the average Intersection over Union (IOU) of mineral objects from 0.49 to 0.58, compared to the original U-Net model. Our method can clearly distinguish each object from others with boundaries, even in highly imbalanced images. Training our models takes less than three minutes using a single GPU, while manual labeling can take up to three hours for each image. Furthermore, the method helps geoscientists gain insights quickly and effectively by building neural network models from a small dataset of SEM images.

58 GEOSCIENCES↗

A mesoscale 3D model of irradiated concrete informed via a 2.5 U-Net semantic segmentation

The concrete biological shield in light-water reactors is exposed to neutron and gamma irradiation, which deteriorates the concrete’s mechanical properties in the long term. To assess the irradiation-induced damage, predictive mechanical models are developed and used in parallel with the characterization of irradiated concrete samples. Realistic 3D simulation domains can drastically improve a model’s prediction. In this work, we utilized x-ray computed tomography (XCT) data of a concrete specimen to reconstruct its 3D microstructure. The XCT data shows low contrast between the concrete’s aggregates and cement paste, resulting in poor image segmentation when using traditional unsupervised techniques. To address this issue, we developed and trained a 2.5D U-Net model on only 24 pre-labeled XCT layers to segment 651 layers of the XCT data. The overall F1-score of the model is approximately 96%. Then, we created a 3D finite element (FE) mesh based on the stack of segmented images. The FE model contains radiation-induced expansion, damage, and creep. The constitutive equations are adapted to each phase (aggregates and cement paste). Here, we simulated the effects of neutron irradiation in the concrete specimen as well as the specimen’s mechanical response to uniaxial compression. Finally, model validation was performed using experimental data on similar concrete specimens in the literature.

2.5D U-Net↗

NuSD: A Geant4 based simulation framework for segmented anti-neutrino detectors

NuSD: Neutrino Segmented Detector is a Geant4-based user application that simulates inverse beta decay event in a variety of segmented scintillation detectors developed by different international collaborations. This simulation framework uses a combination of cross-programs and libraries including Geant4, ROOT and CLHEP developed and used by high energy physics community. It will enable the neutrino physics community to simulate and study neutrino interactions within different detector concepts using a single program. In addition to neutrino simulations in segmented detectors, this program can also be used for various research projects that use of scintillation detectors for different physics purposes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Application of a deep learning semantic segmentation model to helium bubbles and voids in nuclear materials

Imaging nanoscale radiation-induced defects using the transmission electron microscope (TEM) is a key factor in the successful implementation of materials for nuclear energy structural applications. Analyzing each defect in a TEM micrograph is currently a manual task. To identify the defects in a single image can take anywhere from 15 min to an hour and a project can require the analysis of anywhere from tens to ≥ 100 images. Here, we use artificial intelligence (AI) models to automate this task. For simplification, we evaluated images with only a single type of defect; helium bubbles. Additionally, we performed semantic segmentation of these helium bubble defects in electron microscopy images of irradiated FeCrAl alloys using a deep learning DefectSegNet model. This model, which was previously used to classify crystal defects, is inspired by the classic DenseNet and U-Net image segmentation models. It claims high spatial resolution, but has poor performance at object boundaries. Our paper improves the DefectSegNet model’s application by adding two new features. First, the DefectSegNet model is applied not only to perform calculation pixel-wise but also object (or feature) wise. Because object-wise metrics are directly relevant to our final goal of detecting bubbles, whereas pixel-wise classification is only an intermediate step, it is an important part of our study. Second, a distance map loss (DML) function has been added to increase its performance at object boundaries. It is crucial to accurately represent defects boundaries, especially bubbles, in order to track the bubble-induced swelling caused by irradiation. The boundary-focused DML function is also compared to other loss functions like Cross-entropy, Weighted Binary Cross Entropy (WBCE), Dice and Intersection over Union (IOU). Finally, by incorporating new features, we found a marked improvement on segmentation quality and better shape preservation at the boundaries and areas of the bubbles.

42 ENGINEERING↗

A machine learning pipeline for membrane segmentation of cryo-electron tomograms

We describe how to use several machine learning techniques organized in a learning pipeline to segment and identify cell membrane structures from cryo electron tomograms. These tomograms are difficult to analyze with traditional segmentation tools. The learning pipeline in our approach starts from supervised learning via a special convolutional neural network trained with simulated data. It continues with semi-supervised reinforcement learning and/or a region merging technique that tries to piece together disconnected components belonging to the same membrane structure. A parametric or non-parametric fitting procedure is then used to enhance the segmentation results and quantify uncertainties in the fitting. Domain knowledge is used in generating the training data for the neural network and in guiding the fitting procedure through the use of appropriately chosen priors and constraints. We demonstrate that the approach proposed here works well for extracting membrane surfaces in two real tomogram datasets.

97 MATHEMATICS AND COMPUTING↗

Origin of rate limitations in solid-state polymer batteries from constrained segmental dynamics within the cathode

Currently, one of the key challenges preventing the wide commercialization of polymer-based solid-state batteries is achieving high-rate capabilities. This work unravels chain structure and segmental dynamics in a polymer-based composite cathode consisting of LiFePO 4 (LFP), carbon, and poly(ethylene oxide) (PEO) with lithium bis(trifluoromethanesulfonyl)imide. Small-angle neutron scattering (SANS) data reveal that PEO chains are adsorbed on the surface of LFP particles during slurry processing to make the composite electrode. The strong interaction between LFP and PEO chains leads to greatly reduced segmental dynamics of PEO, as discovered by quasi-elastic neutron scattering (QENS). The reduced segmental dynamics results in 70% decreased Li + mobility of the polymer electrolyte in the composite cathode. The combined SANS and QENS study indicates that one of the key bottlenecks that limits the rate performance of PEO-based polymer batteries originates from molecular interactions within the cathode.

25 ENERGY STORAGE↗

Improved Single-Ion Conductivity of Polymer Electrolyte via Accelerated Segmental Dynamics

Single-ion conducting polymer electrolytes (SICPEs) have many advantages for solid-state battery applications, while low conductivities remain the bottleneck for their practical applications. In this paper, a strategy that can significantly improve the ionic conductivity of SICPEs based on the concept of accelerated segmental dynamics was demonstrated by the evaluation of the thermal property, rheological behavior, morphology analysis, molecular dynamics simulation, and conductivity performance. With both “soft” poly(dimethylsiloxane) (PDMS) backbone and poly(ethylene glycol) (PEG) side chains, the obtained SICPE possesses faster segmental relaxation and higher lithium-ion conductivity. With lithium “transference” number close to unity, the obtained SICPE also shows excellent electrochemical stability against lithium metal electrodes. The clear relationship established between the segmental dynamics of polymer electrolyte and its ionic conductivity should contribute to achieve a solid electrolyte with improved ionic conductivity toward the next-generation solid-state battery.

Segmental Dynamics↗

End-to-End Automated Segmentation Framework for Four-Dimensional Scanning Transmission Electron Microscopy Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) is powerful for rapidly characterizing arrays of nanoparticles produced via high-throughput synthesis. However, such 4D-STEM datasets typically contain thousands of nanoparticles, each characterized by thousands of diffraction patterns spatially distributed across the nanoparticle, necessitating efficient and comprehensive analysis. We propose an end-to-end segmentation framework to automatically segment each nanoparticle into regions with distinct composition/orientation of crystal grains, using only the 4D-STEM data. Bragg disk information is extracted in a physics-informed manner from the diffraction patterns at each spatial location and combined with the real space coordinates to form feature vectors. These feature vectors are then used as inputs to a Gaussian mixture model (GMM) to segment the nanoparticle into distinct regions. We also develop two visualization tools based on the GMM outputs to infer the interface transition and the degree of superposition. Our framework comprehensively integrates machine learning tools and physics knowledge, and provides a basis for substantially compressing enormous 4D-STEM datasets, e.g., by replacing the full 4D-STEM dataset for each nanoparticle with only a single set of Bragg disk features for each distinct crystal grain identified in the nanoparticle. In this article, we demonstrate the power of our framework by presenting results for real, complex datasets.

47 OTHER INSTRUMENTATION↗

A Novel Data Segmentation Method for Data-driven Phase Identification

This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ExtremeMETA: High-speed Lightweight Image Segmentation Model by Remodeling Multi-channel Metamaterial Imagers

Deep neural networks (DNNs) have heavily relied on traditional computational units, such as CPUs and GPUs. However, this conventional approach brings significant computational burden, latency issues, and high power consumption, limiting their effectiveness. This has sparked the need for lightweight networks such as ExtremeC3Net. Meanwhile, there have been notable advancements in optical computational units, particularly with metamaterials, offering the exciting prospect of energy-efficient neural networks operating at the speed of light. Yet, the digital design of metamaterial neural networks (MNNs) faces precision, noise, and bandwidth challenges, limiting their application to intuitive tasks and low-resolution images. In this study, we proposed a large kernel lightweight segmentation model, ExtremeMETA. Based on ExtremeC3Net, our proposed model, ExtremeMETA maximized the ability of the first convolution layer by exploring a larger convolution kernel and multiple processing paths. With the large kernel convolution model, we extended the optic neural network application boundary to the segmentation task. To further lighten the computation burden of the digital processing part, a set of model compression methods was applied to improve model efficiency in the inference stage. The experimental results on three publicly available datasets demonstrated that the optimized efficient design improved segmentation performance from 92.45 to 95.97 on mIoU while reducing computational FLOPs from 461.07 MMacs to 166.03 MMacs. The large kernel lightweight model ExtremeMETA showcased the hybrid design’s ability on complex tasks.

large convolution kernel↗