Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

WE-AB-BRA-04: Evaluation of the Tumor Registration Error in Biopsy Procedures Performed Under Real Time PET/CT Guidance

Purpose: PET/CT guidance is used for biopsies of metabolically active lesions, which are not well seen on CT alone or to target the metabolically active tissue in tumor ablations. It has also been shown that PET/CT guided biopsies provide an opportunity to verify the location of the lesion border at the place of needle insertion. However the error in needle placement with respect to the metabolically active region may be affected by motion between the PET/CT scan performed at the start of the procedure and the CT scan performed with the needle in place and this error has not been previously quantified. Methods: Specimens from 31 PET/CT guided biopsies were investigated and correlated to the intraoperative PET scan under an IRB approved HIPAA compliant protocol. For 4 of the cases in which larger motion was suspected a second PET scan was obtained with the needle in place. The CT and the PET images obtained before and after the needle insertion were used to calculate the displacement of the voxels along the needle path. CTpost was registered to CTpre using a free form deformable registration and then fused with PETpre. The shifts between the PET image contours (42% of SUVmax) for PETpre and PETpost were obtained at the needle position. Results: For these extreme cases the displacement of the CT voxels along the needle path ranged from 2.9 to 8 mm with a mean of 5 mm. The shift of the PET image segmentation contours (42% of SUVmax) at the needle position ranged from 2.3 to 7 mm between the two scans. Conclusion: Evaluation of the mis-registration between the CT with the needle in place and the pre-biopsy PET can be obtained using deformable registration of the respective CT scans and can be used to indicate the need of a second PET in real-time. This work is supported in part by a grant from Biospace Lab, S.A.

60 APPLIED LIFE SCIENCES↗

The impact of carbonation on bulk and ITZ porosity in microconcrete materials with fly ash replacement

Scanning electron microscopy was used to evaluate the porosity patterns found in microconcrete materials to better understand the gaseous diffusion pathways and reaction of CO{sub 2} within the bulk cement paste and interfacial transition zone (ITZ) of microconcrete materials containing different fly ash replacement types. Image segmentation was applied to evaluate the porosity as a function of distance from an exposed surface in the bulk cement paste and from aggregate boundaries in the ITZ in both carbonated and non-carbonated microconcrete materials. The ITZ region remained more porous compared to the bulk cement paste for all microconcrete types after carbonation despite a change in the porosity profile across the ITZ region. Results indicate that both the carbonation reaction capacity and porosity before carbonation impact the decrease in porosity observed as a result of carbonation in the ITZ and bulk cement paste regions.

36 MATERIALS SCIENCE↗

Cross-scale sensing of field-level crop residue cover: Integrating field photos, airborne hyperspectral imaging, and satellite data

Conservation tillage practices can bring benefits to agricultural sustainability. Accurate spatial and temporal resolved information of field-scale crop residue cover, which reflects tillage intensity, is highly valuable for evaluating the outcomes of government conservation programs and voluntary ecosystem service markets, as well as facilitating agroecosystem modeling to quantify cropland biogeochemical processes. Remote sensing has the potential to cost-effectively detect crop residue cover, however, existing regional-scale studies were limited by insufficient ground truth data, scale mismatch between coarse satellite pixels and ground data, and the lack of key spectral data for detecting crop residues. Therefore, this study developed an innovative cross-sensing framework to integrate proximal sensing, airborne hyperspectral imaging, and satellite Earth Observation through deep learning to quantify field-level crop residue cover fractions at the regional scale. Specifically, we have collected intensive ground orthographic photos and conducted airborne hyperspectral surveys at corn and soybean fields of Champaign and nearby counties in Illinois, the heartland of the U.S. Corn Belt. Through semi-automatic labeling aided by ResNet-50 and superpixel image segmentation, we obtained 6719 records of ground residue fractions. With these ground data, we developed the 1-dimensional convolution neural network (CNN) model using airborne hyperspectral reflectance, which has 0.5m spatial resolution and 3–5 nm spectral resolution from 400 to 2400 nm, to predict residue fractions. By applying the CNN model to airborne pixels, we augmented “ground truth” data of crop residues and further combined them with Harmonized Landsat and Sentinel-2 (HLS) satellite data to quantify regional residue fractions at 30 m resolution. Results show that airborne hyperspectral imagery with CNN can accurately detect residue fractions (R 2 = 0.82, relative RMSE = 11.73%) to effectively generate quasi “ground truth” data to support satellite upscaling to all fields. With independent ground data for testing, we found that the ground-airborne-satellite integrative framework achieved better predictions in estimating crop residue cover (R 2 = 0.67, relative RMSE = 17.53%) than the conventional ground-satellite upscaling (R 2 = 0.22, relative RMSE = 32.09%). Here we also found that the shortwave infrared wavelengths, particularly 2100–2300 nm, are vital for predicting crop residue cover. Sentinel-2 and Landsat-8 data have a comparable capability to track residue fractions due to similar shortwave infrared wavelengths. This study highlights the high accuracy of hyperspectral imaging to detect agroecosystem tillage management practices and the advantages of cross-scale sensing to cost-effectively integrate multi-source data to quantify field-level agroecosystem variables across scales.

60 APPLIED LIFE SCIENCES↗

Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure

Swings in pH can be achieved by electrically polarizing a bipolar membrane (BPM) to drive water dissociation at the BPM junction for electrochemical conversion and separation processes. BPM junction design is critical to tailor performance for specific applications; however, characterization techniques capable of resolving the nanometer scale physical structure of the junction are limited. We present sample preparation, imaging, and analysis workflows that are adaptable to a variety of BPM junction architectures. Atomic force microscopy produces BPM junction images with nanometer scale lateral resolution for samples with and without a graphene oxide water dissociation catalyst in the junction. Subsequent image segmentation and analysis quantify line edge roughness and catalyst layer thickness as descriptors of junction structure. Comparison of pre- and post-electrodialysis junctions suggests electric field-induced alignment of catalyst particles during electrodialysis. This characterization workflow can inform manufacturing protocols, computational modeling, and failure mode analysis for next-generation BPMs.

97 MATHEMATICS AND COMPUTING↗

Upgrade and benchmarking of a 4D treatment planning system for scanned ion beam therapy

Purpose: Upgrade and benchmarking of a research 4D treatment planning system (4DTPS) suitable for realistic patient treatment planning and treatment simulations taking into account specific requirements for scanned ion beam therapy, i.e., modeling of dose heterogeneities due to interplay effects and range changes caused by patient motion and dynamic beam delivery. Methods: The 4DTPS integrates data interfaces to 4D computed tomography (4DCT), deformable image registration and clinically used motion monitoring devices. The authors implemented a novel data model for 4D image segmentation using Boolean mask volume datasets and developed an algorithm propagating a manually contoured reference contour dataset to all 4DCT phases. They further included detailed treatment simulation and dose reconstruction functionality, based on the irregular patient motion and the temporal structure of the beam delivery. The treatment simulation functionality was validated against experimental data from irradiation of moving radiographic films in air, 3D moving ionization chambers in a water phantom, and moving cells in a biological phantom with a scanned carbon ion beam. The performance of the program was compared to results obtained with predecessor programs. Results: The measured optical density distributions of the radiographic films were reproduced by the simulations to (-2 {+-} 12)%. Compared to earlier versions of the 4DTPS, the mean agreement improved by 2%, standard deviations were reduced by 7%. The simulated dose to the moving ionization chambers in water showed an agreement with the measured dose of (-1 {+-} 4)% for the typical beam configuration. The mean deviation of the simulated from the measured biologically effective dose determined via cell survival was (617 {+-} 538) mGy relative biological effectiveness corresponding to (10 {+-} 9)%. Conclusions: The authors developed a research 4DTPS suitable for realistic treatment planning on patient data and capable of simulating dose delivery to a moving patient geometry for scanned ion beams. The accuracy and reliability of treatment simulations improved considerably with respect to earlier versions of the 4DTPS.

60 APPLIED LIFE SCIENCES↗

Exploring Physics of Ferroelectric Domain Walls in Real Time: Deep Learning Enabled Scanning Probe Microscopy

The functionality of ferroelastic domain walls in ferroelectric materials is explored in real-time via the in situ implementation of computer vision algorithms in scanning probe microscopy (SPM) experiment. The robust deep convolutional neural network (DCNN) is implemented based on a deep residual learning framework (Res) and holistically nested edge detection (Hed), and ensembled to minimize the out-of-distribution drift effects. The DCNN is implemented for real-time operations on SPM, converting the data stream into the semantically segmented image of domain walls and the corresponding uncertainty. Further the pre-defined experimental workflows perform piezoresponse spectroscopy measurement on thus discovered domain walls, and alternating high- and low-polarization dynamic (out-of-plane) ferroelastic domain walls in a PbTiO 3 (PTO) thin film and high polarization dynamic (out-of-plane) at short ferroelastic walls (compared with long ferroelastic walls) in a lead zirconate titanate (PZT) thin film is reported. This work establishes the framework for real-time DCNN analysis of data streams in scanning probe and other microscopies and highlights the role of out-of-distribution effects and strategies to ameliorate them in real time analytics.

36 MATERIALS SCIENCE↗

Using X-ray radiography to study oxygen flow in a proton exchange membrane electrolyzer operating under balanced pressure conditions

Of the various water electrolyzer technologies, the proton exchange membrane electrolyzer (PEMWE) is one of the best solutions for producing clean hydrogen without releasing CO 2 . In order to allow for widespread use of clean hydrogen, it is necessary to decrease its cost, which is intrinsically related to system operation. Current PEMWE plants operate in differential mode, directly pressurizing hydrogen and benefiting from thermodynamic compression, which increases overall system efficiency. However, high differential pressure above 30 bar can cause membrane stress, resulting in membrane creeping and failure. Pressurizing the water and operating at balanced pressure allows hydrogen to be produced at higher pressures while preserving the integrity of the membrane and porous layers. Nevertheless, the impact of pressurizing water on PEMWE performance must be better understood to maximize performance under balanced pressure conditions. Here, this study examined the impact of water pressure on two-phase flow. A high-pressure electrolyzer setup was developed to perform operando X-ray radiography and examine oxygen transport with high temporal resolution. The imaging segmentation process, developed to capture bubble properties in the channel, was applied to a specific experiment. The results clearly showed that as pressure increased up to 30 bars, the initial bubbly flow transitioned to slug flow, which led to channel saturation with oxygen. This work demonstrates that two-phase flow in an electrolyzer can be studied using X-ray radiography, which has the advantages of fast measurements and the ability to probe dense materials, such as those required for pressurized electrolyzers.

Balanced high pressure operation↗

Methods development towards automated, physics-informed, quantitative quality control of TRISO-SiC

Tristructural-isotropic (TRISO) fuel particles have been developed as a high-performance fuel for use in high-temperature gas-cooled reactor (HTGR) systems due to their high efficiency and stability under both normal and off-normal conditions. Broader deployment of this technology in advanced nuclear applications may benefit from quantitative quality assurance and quality control (QA/QC) methods that directly link TRISO properties to downstream performance. A key TRISO property is the SiC layer microstructure, which influences fission product retention during irradiation. However, existing QA/QC for the TRISO-SiC microstructure comprises only a qualitative visual inspection; therefore, there is a clear opportunity for the development of quantitative methods for TRISO QA/QC. Here, to this end, previous work has demonstrated an image processing approach to grain boundary (GB) identification and subsequent extraction of microstructural metrics; however, extensive twinning within the SiC layer complicates such analyses because twin GBs significantly influence microstructural metrics but are not expected to contribute to fission product transport. This study presents the initial development, training, and testing of an ML-based image segmentation algorithm designed to identify and remove twin GBs from standard backscattered electron micrographs, providing an industrially applicable, quantitative, and physically meaningful QA/QC approach for the TRISO-SiC microstructure. Although pixel-wise performance metrics for the twin predictions are low, the change in grain area and the number of GB pixels after twin removal predicted by the ML workflow are within 1% of the true values calculated using crystallographic data. This suggests that the model is well capable of predicting overall twin boundary structures and grain morphology, and continued advancement of this approach could enable automated, scalable, and physics-informed QA/QC for TRISO-SiC microstructures, supporting the reliable qualification of coated particle fuels for next-generation reactor systems.

Computer vision↗

Recent advances in computational mathematics and applications

We are honored to bring you this special issue dedicated to recent advances in computational mathematics and applications in science and engineering. The papers in this special issue were presented in ”Conference on Computational Mathematics and Applications (CCMA)” held at the University of Nevada Las Vegas (UNLV) during October 25–27, 2019. The conference has attracted about 90 attendees from six countries. The 15 papers in the special issue comprise a diverse collection of theoretical numerical analysis as well as applications in various subjects. Topics cover optimal control of PDEs, discontinuous Galerkin methods, fluid flow in porous media, turbulence flow, static and moving interface problems, complex fluids composed by the mixture of Newtonian fluid and nematic (liquid crystal) flows, modeling of ocean–atmosphere system, image segmentation algorithm, uncertainty quantification problems for turbulence model and Maxwell’s equations, iterative solver for systems resulting from mixed methods, and novel methods for solving systems of nonlinear equations. As the Guest Editors we would like to thank Dr. Leland Jameson at NSF (National Science Foundation) for kindly supporting our conference proposal which made this conference possible. We would also like to thank Darren Sugrue from Elsevier who provided partial support for our conference, and Thennarasu Gunasekaran and his production team from Elsevier who produced this nice special issue. We are grateful to many people (Dr. Zhijian Wu, Lori Ornelas, Elsa Juarez, and many Ph.D. students) at the Department of Mathematical Sciences of UNLV who provided tremendous support for the conference. Finally, we very much appreciate all authors who contributed their precious results to this special issue.

97 MATHEMATICS AND COMPUTING↗

Toward In Situ Synchrotron Mapping of Crystal Selection Processes during Crystal Growth

In this work, we present an automated and rapid method for non-destructive mapping of crystal grains in a rod-shaped sample. The approach was designed for application to in situ float-zone crystal growth experiments at an x-ray synchrotron source, but could be useful in other applications. The methods have been tested on a TiO 2 boule grown in an optical float zone furnace. The approach applies a statistical filter to polycrystalline diffraction patterns on 2D detectors to rapidly determine the degree of powder-quality 1of the signal. When larger crystals emerge in the growth, their position, size and shape can be tracked using an automated blob-tracking algorithm that follows individual Bragg peaks as a function of position in a grid-scan, even when multiple crystals are contributing spots to diffraction images. This method is found to be robust as the same crystal shape can be independently reconstructed using different sets of Bragg reflections. Image segmentation methods are then used to map out the polycrystalline grains. We also note that other information about crystal quality, such as mosaicity or strain state, may be inferred and mapped from the intensity variation of the Bragg peaks at different locations within the sample.

36 MATERIALS SCIENCE↗

Defect detection in atomic-resolution images via unsupervised learning with translational invariance

Abstract Crystallographic defects can now be routinely imaged at atomic resolution with aberration-corrected scanning transmission electron microscopy (STEM) at high speed, with the potential for vast volumes of data to be acquired in relatively short times or through autonomous experiments that can continue over very long periods. Automatic detection and classification of defects in the STEM images are needed in order to handle the data in an efficient way. However, like many other tasks related to object detection and identification in artificial intelligence, it is challenging to detect and identify defects from STEM images. Furthermore, it is difficult to deal with crystal structures that have many atoms and low symmetries. Previous methods used for defect detection and classification were based on supervised learning, which requires human-labeled data. In this work, we develop an approach for defect detection with unsupervised machine learning based on a one-class support vector machine (OCSVM). We introduce two schemes of image segmentation and data preprocessing, both of which involve taking the Patterson function of each segment as inputs. We demonstrate that this method can be applied to various defects, such as point and line defects in 2D materials and twin boundaries in 3D nanocrystals.

36 MATERIALS SCIENCE↗

Quantitative evaluation of hidden defects in cast iron components using ultrasound activated lock-in vibrothermography

This paper reports one of the first experimental results on the application of ultrasound activated lock-in vibrothermography for quantitative assessment of buried flaws in complex cast parts. The use of amplitude modulated ultrasonic heat generation allowed selective response of defective areas within the part, as the defect itself is turned into a local thermal wave emitter. Quantitative evaluation of hidden damages was accomplished by estimating independently both the area and the depth extension of the buried flaws, while x-ray 3D computed tomography was used as reference for sizing accuracy assessment. To retrieve flaw's area, a simple yet effective histogram-based phase image segmentation algorithm with automatic pixels classification has been developed. A clear correlation was found between the thermal (phase) signature measured by the infrared camera on the target surface and the actual mean cross-section area of the flaw. Due to the very fast cycle time (<30 s/part), the method could potentially be applied for 100% quality control of casting components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Asymmetric grain distribution in phthalocyanine thin films

Many electronic and optical properties of organic thin films depend on the precise morphology of grains. Iron phthalocyanine thin films are grown on sapphire substrates at different temperatures to study the effect of grain growth kinematics and to experimentally quantify the grain size distribution in organic thin films. The grain size is measured with an atomic force microscope and the data is processed and analyzed with well-known image segmentation algorithms. For relevant statistics, over 3000 grains are evaluated for each sample. The data show pronounced asymmetric grain growth with increasing deposition temperature from almost spherical grains at room temperature to elongated needlelike shapes at 260 deg. C. The average size along the major axis increases from 35 to 200 nm and along the minor axis from 25 to 90 nm. The distribution is almost symmetric at low-deposition temperatures, but becomes lognormal at higher temperatures. Strikingly, the major axis and minor axis of the elliptically shaped grains have different distributions at all temperatures due to the planar asymmetry of the molecule.

36 MATERIALS SCIENCE↗

BraggNet: integrating Bragg peaks using neural networks

Neutron crystallography offers enormous potential to complement structures from X-ray crystallography by clarifying the positions of low-Z elements, namely hydrogen. Macromolecular neutron crystallography, however, remains limited, in part owing to the challenge of integrating peak shapes from pulsed-source experiments. To advance existing software, this article demonstrates the use of machine learning to refine peak locations, predict peak shapes and yield more accurate integrated intensities when applied to whole data sets from a protein crystal. The artificial neural network, based on the U-Net architecture commonly used for image segmentation, is trained using about 100 000 simulated training peaks derived from strong peaks. After 100 training epochs (a round of training over the whole data set broken into smaller batches), training converges and achieves a Dice coefficient of around 65%, in contrast to just 15% for negative control data sets. Integrating whole peak sets using the neural network yields improved intensity statistics compared with other integration methods, including k-nearest neighbours. These results demonstrate, for the first time, that neural networks can learn peak shapes and be used to integrate Bragg peaks. In conclusion, it is expected that integration using neural networks can be further developed to increase the quality of neutron, electron and X-ray crystallography data.

97 MATHEMATICS AND COMPUTING↗

Ultraviolet Fluorescence Imaging for Photovoltaic Module Metrology: Best Practices and Survey of Features Observed in Fielded Modules

As the photovoltaics (PV) industry grows in sophistication, so must the extent to which systems are characterized. UV Fluorescence (UVF) imaging is a valuable, easy-to-perform, high-throughput, nonintrusive technique for characterizing modules in the field and in the lab. However, UVF is still a relatively new technique, and many in the PV industry are still unaware of its potential. We provide a guideline for obtaining, processing, and interpreting UVF images. We have provided a list of considerations for imaging hardware and settings, a suggested pipeline for image processing, and details on a survey of features shown in UVF images. As a result, a new database with UVF images of 7190 modules and another database curated by BrightSpot Automation are publicly available.

14 SOLAR ENERGY↗

Distributed-Memory Parallel Symmetric Nonnegative Matrix Factorization

We develop the first distributed-memory parallel implementation of Symmetric Nonnegative Matrix Factorization (SymNMF), a key data analytics kernel for clustering and dimensionality reduction. Our implementation includes two different algorithms for SymNMF, which give comparable results in terms of time and accuracy. The first algorithm is a parallelization of an existing sequential approach that uses solvers for non symmetric NMF. The second algorithm is a novel approach based on the Gauss-Newton method. It exploits second-order information without incurring large computational and memory costs. We evaluate the scalability of our algorithms on the Summit system at Oak Ridge National Laboratory, scaling up to 128 nodes (4,096 cores) with 70% efficiency. Additionally, we demonstrate our software on an image segmentation task.

Eswar, Srinivas↗

Revealing Three-Dimensional Morphology in Nanoporous Gold Using Three-Dimensional X-Ray Fresnel Coherent Diffractive Imaging Tomography

Nanoporous metals fabricated by dealloying have a unique bi-continuous, sponge-like porous structure with ultra-high surface area. The unique properties of these materials, especially nanoporous gold, have numerous potential applications in sensors and actuators and in energy-related applications such as catalytic materials, super-capacitors, and battery supports. The degree of porosity and size of the metal ligaments are critical parameters that determine many properties and thus govern the functionalities of nanoporous metals in many applications including energy storage and conversion. Additionally, we used Fresnel coherent diffractive imaging combined with tomographic reconstruction to quantify the nanoscale three-dimensional spatial distribution and homogeneity of the porosity and ligament size within a bulk sample of nanoporous gold. The average porosity and its standard deviation along the axial direction through the sample were determined, as well as the characteristic feature size and its standard deviation. The result shows that free corrosion is an effective way to create homogeneous nanoporous metals with sample sizes on the order of 1 µm.

36 MATERIALS SCIENCE↗