Uncertainty Quantification for the Image Segmentation Task [Slides]
This report provides information about image segmentation, including challenges, experiment results and future efforts.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “segmentation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images
Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.
59 BASIC BIOLOGICAL SCIENCES↗
A Benchmark for Crack Segmentation in Electroluminescence Images
This public dataset contains electroluminescence images of solar cells and crack annotations, which can be used for developing semantic segmentation model to detect cracks in solar modules.
14 SOLAR ENERGY↗
Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints
Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.
97 MATHEMATICS AND COMPUTING↗
A Region-Growing Segmentation Approach to Delineating Timberline from Satellite-Derived Tree Fractional Cover Products
Timberline marks the transitions from continuous forests to sparse forests and tundra landscapes. As the spatial distribution and dynamics of timberline are closely associated with regional energy and carbon balance, mapping timberline is important to a wide range of environmental and ecological studies. However, current timberline delineation approaches remain under-developed. We proposed an automatic timberline delineation method based on a seeded region-growing segmentation technique and satellite-derived products of tree fractional cover. We applied our approach to the West Siberian Plain and Alaska treeline regions as defined by the Circumpolar Arctic Vegetation Map. The results demonstrate the effectiveness of the proposed method for the accurate delineation of the timberlines that spatially align well with very-high-resolution satellite images. Based on the delineated timberlines, we find regional-scale tree encroachment to be not as substantial as previously reported. The proposed approach can be applied to understanding climate-induced forest responses and inform forest management practices.
Circumpolar Arctic Vegetation Map↗
Design space exploration and decision‐making for a segmented ultralight morphing 50‐MW wind turbine
Abstract Wind turbine design encompasses many different aspects including aerodynamic, structural, electrical, and control system design. To achieve optimal plant performance, a system design approach is utilized in which the performance of the whole wind turbine is evaluated and quantified during operational scenarios with subsystem interactions. In this paper, the design for a Segmented Ultralight Morphing Rotor (SUMR) 50‐MW wind turbine is presented utilizing levelized cost of energy (LCOE) for design choices, with additional quantification of simulated performance shortcomings at the 50‐MW scale. The multi‐disciplinary design process results in a final ultra‐scale turbine configuration that outperforms other existing offshore wind farms regarding the LCOE.
Kianbakht, Sepideh↗
NuGraph2 with context-aware inputs: physics-inspired improvements in semantic segmentation
Graph neural networks have recently shown strong promise for event reconstruction tasks in Liquid Argon Time Projection Chambers, yet their performance remains limited for underrepresented classes of particles, such as Michel electrons. In this work, we investigate physics-informed strategies to improve semantic segmentation within the NuGraph2 architecture. We explore three complementary approaches: (i) enriching the input representation with context-aware features derived from detector geometry and track continuity, (ii) introducing auxiliary decoders to capture class-level correlations, and (iii) incorporating energy-based regularization terms motivated by Michel electron energy distributions. Experiments on MicroBooNE public datasets show that physics-inspired feature augmentation yields the largest gains, particularly boosting Michel electron precision and recall by disentangling overlapping latent space regions. In contrast, auxiliary decoders and energy-regularization terms provided limited improvements, partly due to the hit-level nature of NuGraph2, which lacks explicit particle- or event-level representations. Our findings highlight that embedding physics context directly into node-level inputs is more effective than imposing task-specific auxiliary losses, and suggest that future hierarchical architectures such as NuGraph3, with explicit particle- and event-level reasoning, will provide a more natural setting for advanced decoders and physics-based regularization. The code for this work is publicly available on Github at https://github.com/vitorgrizzi/nugraph_phys/tree/main_phys.
Other Experiments↗
Understanding the role of segmentation on process-structure–property predictions made via machine learning
Here, the present study investigated the effect of porosity surface determination methods on performance of machine learning models used to predict the tensile properties of AlSi10Mg processed by laser powder bed fusion from micro-computed tomography data. Machine learning models applied in this work include support vector machines, neural networks, decision trees, and Bayesian classifiers. The effects of isosurface thresholding and local gradient approaches for porosity segmentation, as well as image filtering schemes, on model precision were evaluated for samples produced under differing levels of global energy density.
36 MATERIALS SCIENCE↗
Deep-learning based artificial intelligence tool for melt pools and defect segmentation
Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.
additive manufacturing↗
In situ laser profilometry for material segmentation and digital reconstruction of a multicomponent additively manufactured part
In addition to its ability to produce geometrically complex parts, additive manufacturing offers a unique opportunity to collect data about a component while it is being fabricated. However, there has only been limited effort to characterize parts morphologically and compositionally in situ. In this article, we present a layer-by-layer, laser profilometry-based in situ characterization technique as a method to digitally reconstruct a multi-material part. Data collected by the laser profilometer yields height maps and grayscale images which are voxelized using purpose-built software to volumetrically reconstruct the part. Additionally, the same part was also analyzed using X-ray computed tomography (CT) which was not able to resolve the different compositional regions within the part, but captured the filament morphology. The part was then bisected to compare the digital reconstruction to the actual part morphology and composition. Overall, the digital reconstruction was in good agreement with both the CT and bisected images. Deviations between the digital reconstruction and the CT/bisected images are likely the result of image segmentation settings or material shifts after data was collected. The in situ characterization method demonstrated here sets the stage for real time process monitoring and paves the way for additively manufactured parts that are “born qualified.”
36 MATERIALS SCIENCE↗
Improving the performance of PM6 donor polymer by random ternary copolymerization of BDD and DTBT segments
Developing high-performance wide bandgap polymer donors to match the rapidly growing non-fullerene small molecule acceptors (NF-SMAs) is of great importance to further improve the photovoltaic performances of organic solar cells (OSCs). PM6 and D18 are two leading wide bandgap donor polymers, but their performances are highly sensitive to the molecular weights, which have distinct impact on the morphology and thereby the charge generation and recombination processes. Here, in this work, we reported the random ternary copolymerization of PM6 and D18 segments to develop random terpolymers with finely tuned photoelectronic properties and optimized blend morphology for high-performance OSCs. The resulting random terpolymers (PMD-5, PMD-10, PMD-15 and PMD-20) exhibited finely tuned absorptions, energy levels and blend morphology. The optimal morphology of PMD-15:L8-BO contributed to the fast exciton diffusion and dissociation, efficient charge extraction with suppressed recombination. Thus, the power conversion efficiency was improved from 17.22% of the control PM6 devices and 17.47% of the control D18 devices to 18.12% of PMD-15 based devices, which is the top performance of random terpolymers. Moreover, the PMD-15 exhibited much higher batch-to-batch reproducibility at a broad molecular weight range than that of PM6 and D18, showing promising for practical applications.
36 MATERIALS SCIENCE↗
Common risk segment mapping: Streamlining exploration for carbon storage sites, with application to coastal Texas and Louisiana
Large-scale deployment of Carbon Capture and Storage (CCS) will require a commensurately large number of sites. Efficient screening methods are needed to create investment assurance and focus efforts on the most promising sites. The problem is similar to petroleum exploration, for which there are well-developed (though seldom published) workflows, including Common Risk Segment (CRS) mapping. In brief, the process requires 1) defining the key play elements; 2) identifying candidate geologic intervals for each; 3) creating fact-based maps for those intervals; 4) determining minimum criteria for the success of each element; 5) reinterpreting the fact-based maps in terms of chance of success; and 6) combining the individual maps to form a composite, basin-scale view of prospectivity. We adapt the CRS process to screening for CO 2 storage sites. Critically, we redefine the process in terms of cost of characterization and development, rather than chance of success. For illustration, we apply the process to the example of the Lower Miocene on the Texas and Louisiana Gulf Coast. We show that the predictions are consistent with historic hydrocarbon production volumes and rates. The power of the CRS method is that it creates a systematic approach to geologic evaluation and translates complex, multidimensional analysis into clear, graphical and easily comprehended business inputs. The results highlight sweet spots and identifies critical risks, suggesting a focus for further data collection and analysis. Furthermore, the method developed here can be applied to both surface and subsurface factors anywhere that there is interest in geologic storage of CO 2 .
54 ENVIRONMENTAL SCIENCES↗
Automatic Segmentation Using Deep Learning to Enable Online Dose Optimization During Adaptive Radiation Therapy of Cervical Cancer
This study investigated deep learning models for automatic segmentation to support the development of daily online dose optimization strategies, eliminating the need for internal target volume expansions and thereby reducing toxicity events of intensity modulated radiation therapy for cervical cancer.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
Segmentation and Classification of Fission as Pores in Reactor Irradiated Annular U–10Zr Metallic Fuel Using Machine Learning Models
Metallic fuels, particularly U—10Zr, are promising candidates for next-generation sodium-cooled fast reactors. Irradiation of nuclear fuels in reactors can lead to the formation of solid and gas fission product which subsequently forms microstructural pores, deteriorating fuel performance. Due to the massive amount of pores and complex phases formed, a quantitative description of fission gas pores is not yet available, preventing the development of microstructure-informed fuel performance modeling for fuel qualification. This paper applied a pre-trained deep learning model to ~10,260 high magnification scanning electron microscopy images. This method increased the accuracy of fission gas pore segmentation and allows statistical features to be extracted which cannot be achieved manually. A pre-trained decision tree model worked on the segemenation results and further classified the pores into different categories to produce a correlation between the pores, movement of lanthanides, and temperature gradient during irradiation. Finally, this paper emphasizes the potentials of machine learning models to accelerate fuel research, development, and qualification for advanced reactors.
36 MATERIALS SCIENCE↗
A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network
Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.
36 MATERIALS SCIENCE↗
New segmented target for studies of neutron unbound systems
The study of neutron-unbound systems using invariant mass spectroscopy is often performed using low-intensity radioactive ion beams. Low reaction yields can be countered by using thick targets but at the expense of larger uncertainties in the reconstructed invariant mass. In this work, we present a new segmented target designed to address this trade-off. It is composed of three mm thick passive beryllium targets interleaved between four thick position sensitive silicon detectors. In the first experiment to use this new system the half-life of two-neutron unbound was measured to be (stat) (syst) ps, which agrees with a previous measurement made by the MoNA Collaboration.
47 OTHER INSTRUMENTATION↗
Characterization of the optical model of the T2K 3D segmented plastic scintillator detector unit cube
The magnetized near detector (ND280) of the T2K long-baseline neutrino oscillation experiment has been recently upgraded aiming to satisfy the requirement of reducing the systematic uncertainty from measuring the neutrino–nucleus interaction cross section, which is the largest systematic uncertainty in the search for leptonic charge-parity symmetry violation. A key component of the upgrade is SuperFGD, a 3D segmented plastic scintillator detector made of approximately 2,000,000 optically-isolated 1 cm 3 cubes. The SuperFGD cube unit shows promising optical performance, including a high light yield of about 40 photoelectrons (p.e.) per channel, a low cube-to-cube crosstalk rate below 3%, and a sub-nanosecond time resolution of 0.96 ns. By combining tracking and stopping power measurements of final state particles, this novel detector enables precise 3D-imaging of GeV neutrino interactions with reduced systematic uncertainties. A detailed Geant4 based optical simulation of the SuperFGD building block, i.e. a plastic scintillating cube read out by three wavelength shifting fibers, has been developed and validated with the different datasets collected in various beam tests. In this manuscript the description of the optical model as well as the comparison with data are reported.
Neutrino oscillations↗
Utilizing a Dynamic Segmentation Convolutional Neural Network for Microstructure Analysis of Additively Manufactured Superalloy 718
Additive manufacturing (AM) is revolutionizing almost all industries through the production of intricate geometries previously prohibited by cost or machinability. Ni-based superalloys form a primary alloy class for high temperature applications in the petrochemical, aerospace, and nuclear industries because of their intrinsic resistance to creep and the ability to heat treat the superalloy for high strength. Despite these attractive properties, the extreme work hardening of Ni-based superalloys makes traditional manufacturing of complex shapes difficult and thus, these alloys are an attractive target for AM. Superalloy 718 was chosen as an example superalloy because of the wide variety of precipitates that can form within its composition space from the repetitive heating and cooling cycles of the AM process. The precipitates and other microstructure features, such as grain boundaries and dislocations, will dictate the mechanical properties and thus, there is an extensive challenge to characterize the size, number density, composition, and volume fraction of each microstructural feature from AM fabrication using analytical electron microscopy. This work focused on the application of a pixel-wise classification machine learning (ML) model called a dynamic segmentation convolutional neural network (DSCNN) to identify the microstructural features of an as-fabricated additively manufactured superalloy 718.
Taller, Stephen↗