Use of ML in Image-Based Simulation: CNNs for 3D Image Segmentation and Uncertainty Quantification.
Abstract not provided.
Roberts, Scott Alan↗
SEARCH · Search NASA
Results for “Image Segmentation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Reconstruction of 3D Concrete Microstructures Combining High-Resolution Characterization and Convolutional Neural Network for Image Segmentation
After water, concrete is the second most used material in the world. Concrete’s forming adaptability and low-cost constituents make it a predominant material used in the construction of civil infrastructures in nuclear power plants such as concrete biological shields, containment buildings, turbine buildings, fuel handling and storage buildings, underground piping for cooling, cooling towers, and so on. Depending on environmental and operating conditions, these passive structures are subject to time-dependent phenomena that can either enhance (e.g., continued hydration) or degrade concrete’s structural performance. Unlike components such as the reactor pressure vessel and the primary circuit, concrete composition varies regionally because it is manufactured using local aggregates and cement. Hence, concrete performance metrics over time cannot be derived confidently using empirical relations. Alternatively, the specific characteristics of the local concrete constituents and their assemblage in concrete must be considered.
36 MATERIALS SCIENCE↗
Establishing Uniform Image Segmentation Ground Truth Protocols for Uncertainty Quantification and Improved Model Evaluation.
Abstract not provided.
Chen, Maximillian Gene↗
Selecting Parameters for Image Processing Algorithms: A Case Study Using Retinal Image Segmentation
Explore the source record for details and available documents.
Mathematics and Computing↗
SAM-I-Am: Semantic boosting for zero-shot atomic-scale electron micrograph segmentation
Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics — where are boundaries located? what segments are logically similar? — change depending on the domain, such that state-of-the-art foundation models can generate meaningless and incorrect results. Moreover, in certain domains, fine-tuning and retraining techniques are infeasible: obtaining labels is costly and time-consuming; domain images (micrographs) can be exponentially diverse; and data sharing (for third-party retraining) is restricted. To enable rapid adaptation of the best segmentation technology, we propose the concept of semantic boosting: given a zero-shot foundation model, guide its segmentation and adjust results to match domain expectations. Here, we apply semantic boosting to the Segment Anything Model (SAM) to obtain microstructure segmentation for transmission electron microscopy. Our booster, SAM-I-Am, serves as a post-processing engine that extracts geometric and textural features of various intermediate masks to perform mask removal and mask merging operations. We demonstrate a zero-shot performance increase of (absolute) +21.35%, +12.6%, +5.27% in mean IoU, and a -9.91%, -18.42%, -4.06% drop in mean false positive masks across images of three difficulty classes over vanilla SAM (ViT-L).
36 MATERIALS SCIENCE↗
The correlation study of parallel feature extractor and noise reduction approaches
This paper presents literature reviews that show variety of techniques to develop parallel feature extractor and finding its correlation with noise reduction approaches for low light intensity images. Low light intensity images are normally displayed as darker images and low contrast. Without proper handling techniques, those images regularly become evidences of misperception of objects and textures, the incapability to section them. The visual illusions regularly clues to disorientation, user fatigue, poor detection and classification performance of humans and computer algorithms. Noise reduction approaches (NR) therefore is an essential step for other image processing steps such as edge detection, image segmentation, image compression, etc. Parallel Feature Extractor (PFE) meant to capture visual contents of images involves partitioning images into segments, detecting image overlaps if any, and controlling distributed and redistributed segments to extract the features. Working on low light intensity images make the PFE face challenges and closely depend on the quality of its pre-processing steps. Some papers have suggested many well established NR as well as PFE strategies however only few resources have suggested or mentioned the correlation between them. This paper reviews best approaches of the NR and the PFE with detailed explanation on the suggested correlation. This finding may suggest relevant strategies of the PFE development. With the help of knowledge based reasoning, computational approaches and algorithms, we present the correlation study between the NR and the PFE that can be useful for the development and enhancement of other existing PFE.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
WE-G-207-05: Relationship Between CT Image Quality, Segmentation Performance, and Quantitative Image Feature Analysis
Purpose: Segmentation quality can affect quantitative image feature analysis. The objective of this study is to examine the relationship between computed tomography (CT) image quality, segmentation performance, and quantitative image feature analysis. Methods: A total of 90 pathology proven breast lesions in 87 dedicated breast CT images were considered. An iterative image reconstruction (IIR) algorithm was used to obtain CT images with different quality. With different combinations of 4 variables in the algorithm, this study obtained a total of 28 different qualities of CT images. Two imaging tasks/objectives were considered: 1) segmentation and 2) classification of the lesion as benign or malignant. Twenty-three image features were extracted after segmentation using a semi-automated algorithm and 5 of them were selected via a feature selection technique. Logistic regression was trained and tested using leave-one-out-cross-validation and its area under the ROC curve (AUC) was recorded. The standard deviation of a homogeneous portion and the gradient of a parenchymal portion of an example breast were used as an estimate of image noise and sharpness. The DICE coefficient was computed using a radiologist’s drawing on the lesion. Mean DICE and AUC were used as performance metrics for each of the 28 reconstructions. The relationship between segmentation and classification performance under different reconstructions were compared. Distributions (median, 95% confidence interval) of DICE and AUC for each reconstruction were also compared. Results: Moderate correlation (Pearson’s rho = 0.43, p-value = 0.02) between DICE and AUC values was found. However, the variation between DICE and AUC values for each reconstruction increased as the image sharpness increased. There was a combination of IIR parameters that resulted in the best segmentation with the worst classification performance. Conclusion: There are certain images that yield better segmentation or classification performance. The best segmentation Result does not necessarily lead to the best classification Result. This work has been supported in part by grants from the NIH R21-EB015053. R Nishikawa is receives royalties form Hologic, Inc.
60 APPLIED LIFE SCIENCES↗
MO-B-207B-00: Harmonization & Robustness in Radiomics
Feature extraction for radiomics studies typically comprises the following stages: Imaging, segmentation, image processing, and feature extraction. Each of these stages has associated uncertainties that can affect the quality of a radiomics model created using the resulting image features. For example, the imaging device manufacturer and model have been shown to impact the values of image features, as have pixel size and imaging protocol parameters. Image processing, such as low-pass filtering to reduce noise, also changes calculated image features and should be designed to optimize the information content of the resulting features. The details of certain feature algorithms, such as co-occurrence matrix bin sizes, are also important, and should be optimized for specific radiomics tasks. The volume of the region of interest should be considered as image features can be related to volume and can give unanticipated results when the volumes are too small. In this session we will describe approaches to quantify the variabilities in radiomics studies, including the most recent results quantifying these variabilities for CT, MRI and PET imaging. We will discuss methods to optimize image processing and feature extraction in order to maximize the information content of the image features. Finally, we will describe work to harmonize imaging protocols and feature calculations to help minimize uncertainties in radiomics studies. Learning Objectives: At the end of this session, participants will be able to: Identify the sources of uncertainty in radiomics studies (CT, PET, and MRI imaging) Describe methods for quantifying the magnitude of uncertainties Describe approaches for mitigating the effects of the uncertainties on radiomics models Funding from NIH, CPRIT, Varian, Elekta; L. Court, NCI, CPRIT, Varian, Elekta.
60 APPLIED LIFE SCIENCES↗
MO-B-207B-01: Harmonization & Robustness in Radiomics
Feature extraction for radiomics studies typically comprises the following stages: Imaging, segmentation, image processing, and feature extraction. Each of these stages has associated uncertainties that can affect the quality of a radiomics model created using the resulting image features. For example, the imaging device manufacturer and model have been shown to impact the values of image features, as have pixel size and imaging protocol parameters. Image processing, such as low-pass filtering to reduce noise, also changes calculated image features and should be designed to optimize the information content of the resulting features. The details of certain feature algorithms, such as co-occurrence matrix bin sizes, are also important, and should be optimized for specific radiomics tasks. The volume of the region of interest should be considered as image features can be related to volume and can give unanticipated results when the volumes are too small. In this session we will describe approaches to quantify the variabilities in radiomics studies, including the most recent results quantifying these variabilities for CT, MRI and PET imaging. We will discuss methods to optimize image processing and feature extraction in order to maximize the information content of the image features. Finally, we will describe work to harmonize imaging protocols and feature calculations to help minimize uncertainties in radiomics studies. Learning Objectives: At the end of this session, participants will be able to: Identify the sources of uncertainty in radiomics studies (CT, PET, and MRI imaging) Describe methods for quantifying the magnitude of uncertainties Describe approaches for mitigating the effects of the uncertainties on radiomics models Funding from NIH, CPRIT, Varian, Elekta; L. Court, NCI, CPRIT, Varian, Elekta.
60 APPLIED LIFE SCIENCES↗
TH-CD-206-02: BEST IN PHYSICS (IMAGING): 3D Prostate Segmentation in MR Images Using Patch-Based Anatomical Signature
Purpose: MRI has shown promise in identifying prostate tumors with high sensitivity and specificity for the detection of prostate cancer. Accurate segmentation of the prostate plays a key role various tasks: to accurately localize prostate boundaries for biopsy needle placement and radiotherapy, to initialize multi-modal registration algorithms or to obtain the region of interest for computer-aided detection of prostate cancer. However, manual segmentation during biopsy or radiation therapy can be time consuming and subject to inter- and intra-observer variation. This study’s purpose it to develop an automated method to address this technical challenge. Methods: We present an automated multi-atlas segmentation for MR prostate segmentation using patch-based label fusion. After an initial preprocessing for all images, all the atlases are non-rigidly registered to a target image. And then, the resulting transformation is used to propagate the anatomical structure labels of the atlas into the space of the target image. The top L similar atlases are further chosen by measuring intensity and structure difference in the region of interest around prostate. Finally, using voxel weighting based on patch-based anatomical signature, the label that the majority of all warped labels predict for each voxel is used for the final segmentation of the target image. Results: This segmentation technique was validated with a clinical study of 13 patients. The accuracy of our approach was assessed using the manual segmentation (gold standard). The mean volume Dice Overlap Coefficient was 89.5±2.9% between our and manual segmentation, which indicate that the automatic segmentation method works well and could be used for 3D MRI-guided prostate intervention. Conclusion: We have developed a new prostate segmentation approach based on the optimal feature learning label fusion framework, demonstrated its clinical feasibility, and validated its accuracy. This segmentation technique could be a useful tool in image-guided interventions for prostate-cancer diagnosis and treatment.
60 APPLIED LIFE SCIENCES↗
WE-EF-210-08: BEST IN PHYSICS (IMAGING): 3D Prostate Segmentation in Ultrasound Images Using Patch-Based Anatomical Feature
Purpose: Transrectal ultrasound (TRUS) is the standard imaging modality for the image-guided prostate-cancer interventions (e.g., biopsy and brachytherapy) due to its versatility and real-time capability. Accurate segmentation of the prostate plays a key role in biopsy needle placement, treatment planning, and motion monitoring. As ultrasound images have a relatively low signal-to-noise ratio (SNR), automatic segmentation of the prostate is difficult. However, manual segmentation during biopsy or radiation therapy can be time consuming. We are developing an automated method to address this technical challenge. Methods: The proposed segmentation method consists of two major stages: the training stage and the segmentation stage. During the training stage, patch-based anatomical features are extracted from the registered training images with patient-specific information, because these training images have been mapped to the new patient’ images, and the more informative anatomical features are selected to train the kernel support vector machine (KSVM). During the segmentation stage, the selected anatomical features are extracted from newly acquired image as the input of the well-trained KSVM and the output of this trained KSVM is the segmented prostate of this patient. Results: This segmentation technique was validated with a clinical study of 10 patients. The accuracy of our approach was assessed using the manual segmentation. The mean volume Dice Overlap Coefficient was 89.7±2.3%, and the average surface distance was 1.52 ± 0.57 mm between our and manual segmentation, which indicate that the automatic segmentation method works well and could be used for 3D ultrasound-guided prostate intervention. Conclusion: We have developed a new prostate segmentation approach based on the optimal feature learning framework, demonstrated its clinical feasibility, and validated its accuracy with manual segmentation (gold standard). This segmentation technique could be a useful tool for image-guided interventions in prostate-cancer diagnosis and treatment. This research is supported in part by DOD PCRP Award W81XWH-13-1-0269, and National Cancer Institute (NCI) Grant CA114313.
60 APPLIED LIFE SCIENCES↗
Super-resolution and segmentation deep learning for breast cancer histopathology image analysis
Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.
60 APPLIED LIFE SCIENCES↗
Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images
Cutting edge deep learning techniques allow for image segmentation with great speed and accuracy. However, application to problems in materials science is often difficult since these complex models may have difficultly learning meaningful image features that would enable extension to new datasets. In situ electron microscopy provides a clear platform for utilizing automated image analysis. In this work, we consider the case of studying coarsening dynamics in supported nanoparticles, which is important for understanding, for example, the degradation of industrial catalysts. By systematically studying dataset preparation, neural network architecture, and accuracy evaluation, we describe important considerations in applying deep learning to physical applications, where generalizable and convincing models are required. With a focus on unique challenges that arise in high-resolution images, we propose methods for optimizing performance of image segmentation using convolutional neural networks, critically examining the application of complex deep learning models in favor of motivating intentional process design.
36 MATERIALS SCIENCE↗
Assessing pore network heterogeneity across multiple scales to inform CO2 injection models
Geologic heterogeneity is a key feature that must be considered when translations of scaled data are performed. This paper presents the assessment of geologic heterogeneity using a multiscale workflow that includes image analysis-based methods coupled with well log analysis to provide data in which fractals and machine learning methods estimate the carbon dioxide (CO 2 ) storage resource potential of a reservoir. The heterogeneity of rock properties of the complex Bell Creek reservoir in Montana, USA, was explored at the pore scale (~nm to mm), core scale (~mm to m), and well scale (~cm to m). The data used in this study included advanced image analysis of micro-CT (computed tomography) images (pore scale), thin sections (pore scale), plugs and core images (core scale) and well logs (well scale). The micro-CT images were segmented using a U-net segmentation approach into objects of pores and grains. Further, the segmented images were reconstructed into subvolumes of different sizes. Physical properties (porosity and permeability) and fractal dimensions were calculated for the various subvolumes, and Lorenz coefficient (Lc) values, a single parameter to describe the degree of heterogeneity within a pay zone section, were calculated from thin-section images and well logs. Porosity and fractal dimension values were used to estimate the 188-µm threshold of representative elementary volume (REV) in this study. Both the Lc and fractal dimension values were found to be negatively correlated. When these two parameters are combined, it is possible to discern differences in the complex porous networks of the samples analyzed in this study.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
AtomAI framework for deep learning analysis of image and spectroscopy data in electron and scanning probe microscopy
Over the past several decades, electron and scanning probe microscopes have become critical components of condensed matter physics, materials science and chemistry research. At the same time, the infrastructure for establishing a connection between microscopy observations and materials behaviour over a broader parameter space is lacking. In this work, we introduce AtomAI, an open-source software package bridging instrument-specific Python libraries, deep learning and simulation tools into a single ecosystem. AtomAI allows direct applications of deep neural networks for atomic and mesoscopic image segmentation converting image and spectroscopy data into class-based local descriptors for downstream tasks such as statistical and graph analysis. For atomically resolved imaging data, the output is types and positions of atomic species, with an option for subsequent refinement. AtomAI further allows the implementation of a broad range of image and spectrum analysis functions, including invariant variational autoencoders for disentangling structural factors of variation and im2spec type of encoder–decoder models for mapping structure–property relationships. Finally, our framework allows seamless connection to the first principles modelling with a Python interface on the inferred atomic positions.
36 MATERIALS SCIENCE↗
FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis
In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.
47 OTHER INSTRUMENTATION↗
Mass-balance approach to quantify water distribution in soils based on X-ray computed tomography ima
Explore the source record for details and available documents.
Guber, Andrey↗
Quantifying the unknown impact of segmentation uncertainty on image-based simulations
Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.
42 ENGINEERING↗