Search NASA⌕ Search

SEARCH · Search NASA

Results for “segmentation algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Development of Machine Learning Algorithms to Segment and Study Images of Astromaterial Samples

Introduction: Micrometer-scale chemical analyses of chondritic meteorites and mission-returned asteroid samples can reveal details of the physical and chemical processes operating in the early solar system, including processes that gave rise to planets, moons, and minor bodies. These primitive astromaterials are comprised of chondrules, calcium- and aluminum-rich inclusions (CAI), and many other silicates, oxides, metals, sulfides, and fine-grained materials. The chemical and mineralogical complexity of these samples, vast populations of different components, and heterogeneity across mm to km scales, all limit our understanding of the origin and evolution of these materials. Here, we describe recent efforts to use machine learning techniques to automate the segmentation of chemical maps of chondritic meteorites, designed to aid studies of asteroid samples returned by spacecraft. By automating the task of segmentation it will become possible to rapidly analyze and interpret the sizes, shapes, mineralogy, chemistry, and other properties of every chondrule, calcium- and aluminum-rich inclusion (CAI) and other clast within and between asteroid samples. Sample return missions significantly accelerate and heighten the need to develop such new data analysis techniques, and associated data repositories. Techniques: Neural networks require abundant training data, i.e. images which have been segmented by a human user. We have manually segmented data available from previous petrologic and chemical work at NASA Johnson Space Center and the American Museum of Natural History [1-4]. These data were derived from energy- and wavelength-dispersive X-ray spectroscopy (EDS, WDS) mapping of samples from many chondrite groups. The Deeplabv3+ [5] neural network architecture was trained on human-labeled masks and used to create machine-labeled masks. Several different algorithms were investigated, with inputs ranging from common RGB image formats through to hyperspectral datasets, with raw data comprising greyscale maps of Mg, Ca, and Al, with or without Si, Fe, Ti for both EDS and WDS data, and extending to other elements in EDS only. Each greyscale image was paired with a binary mask for each labelled particle type. Results: The trained algorithms can segment (Fig 1), classify, and measure the dimensions of thousands of particles in chemical maps of a standard 1-inch round petrographic section in seconds to minutes, rather than many hours needed by a human. Accuracy of the algorithms varied from chondrite to chondrite and across particle types. Further results and details of the algorithms will be presented at the workshop. Future directions: Machine learning has the potential to revolutionize our understanding of complex particle populations contained within primitive astromaterial, with segmentation being a critical first step. Example applications include better understanding of particle transport, nebular reservoirs, parent body accretion, and a deeper understanding of the relationships between particle populations and bulk rock elemental and isotopic compositions. In addition to benefits that machine learning can bring to individual researchers, building a community data repository of thousands to millions of particles across hundreds of samples will open up many other possibilities. For example, with a large enough dataset it will be possible to search for exceptionally closely matching particles across disparate samples. Such a capability would enable a single CAI from OSIRISREx or Hayabusa/II samples to be matched to chondritic CAIs that exhibit near-identical size, texture, and mineralogy, down to the level of similar core phenocrysts, zonation, and rim sequences. Such comparative analyses will help to disentangle precursor chemistry, chronology, gas/dust reservoirs during heating, and accretion. Such an endeavor would be impossible without machine learning and a large community data repository of astromaterial chemical/mineralogic maps.

Machine Learning↗

Automatic extraction of planetary image features

A method for the extraction of Lunar data and/or planetary features is provided. The feature extraction method can include one or more image processing techniques, including, but not limited to, a watershed segmentation and/or the generalized Hough Transform. According to some embodiments, the feature extraction method can include extracting features, such as, small rocks. According to some embodiments, small rocks can be extracted by applying a watershed segmentation algorithm to the Canny gradient. According to some embodiments, applying a watershed segmentation algorithm to the Canny gradient can allow regions that appear as close contours in the gradient to be segmented.

LeMoigne-Stewart, Jacqueline J.↗

Method for implementation of recursive hierarchical segmentation on parallel computers

A method, computer readable storage, and apparatus for implementing a recursive hierarchical segmentation algorithm on a parallel computing platform. The method includes setting a bottom level of recursion that defines where a recursive division of an image into sections stops dividing, and setting an intermediate level of recursion where the recursive division changes from a parallel implementation into a serial implementation. The segmentation algorithm is implemented according to the set levels. The method can also include setting a convergence check level of recursion with which the first level of recursion communicates with when performing a convergence check.

Tilton, James C.↗

Robustness of Spann-Wilson segmentation on SAR imagery

The performances of the Spann-Wilson algorithm on simulated synthetic aperture radar (SAR) images with varying degrees of speckle (one to four looks and varying amounts of white noise) is described. One hundred forty-eight test images are considered, of which the algorithm segmented most without any adjustment to the algorithm's parameters. The effect of speckle on fractal boundaries is studied. The effect of varying multiplicative and additive noise distributions for a fixed set of segmentation parameters is examined. The modified Spann-Wilson algorithm on four-look imagery is evaluated.

Daida, Jason M.↗

Detecting the Greatest Changes in Global Satellite-Based Precipitation Observations

In recent years, the analysis of abrupt and non-abrupt changes in precipitation has received much attention due to the importance of climate change-related issues (e.g., extreme climate events). In this study, we used a novel segmentation algorithm, DBEST (Detecting Breakpoints and Estimating Segments in Trend), to analyze the greatest changes in precipitation using a monthly pixel-based satellite precipitation dataset (TRMM 3B43) at three different scales: (i) global, (ii) continental, and (iii) climate zone, during the 1998–2019 period. We found significant breakpoints, 14.1%, both in the form of abrupt and non-abrupt changes, in the global scale precipitation at the 0.05 significance level. Most of the abrupt changes were observed near the Equator in the Pacific Ocean and Asian continent, relative to the rest of the globe. Most detected breakpoints occurred during the 1998–1999 and 2009–2011 periods on the global scale. The average precipitation change for the detected breakpoint was ±100 mm, with some regions reaching ±3000 mm. For instance, most portions of northern Africa and Asia experienced major changes of approximately +100 mm. In contrast, most of the South Pacific and South Atlantic Ocean experienced changes of −100 mm during the studied period. Our findings indicated that the larger areas of Africa (23.9%), Asia (22.9%), and Australia (15.4%) experienced significant precipitation breakpoints compared to North America (11.6%), South America (9.3%), Europe (8.3%), and Oceania (9.6%). Furthermore, we found that the majority of detected significant breakpoints occurred in the arid (31.6%) and polar (24.1%) climate zones, while the least significant breakpoints were found for snow-covered (11.5%), equatorial (7.5%), and warm temperate (7.7%) climate zones. Positive breakpoints’ temporal coverage in the arid (54.0%) and equatorial (51.9%) climates were more than those in other climates zones. Here, the findings indicated that large areas of Africa and Asia experienced significant changes in precipitation (−250 to +250 mm). Compared to the average state (trend during a specific period), the greatest changes in precipitation were more abrupt and unpredictable, which might impose a severe threat to the ecology, environment, and natural resources.

Breakpoint↗

Autonomous robot using infrared thermal camera to discriminate objects in outdoor scene

A complete autonomous legged robot is beig designed at Carnegie Mellon University to perform planetary exploration without human supervision. This robot must traverse unknown and geographically diverse areas in order to collect samples of materials. This paper describes how thermal imaging can be used to identify materials in order to find good footfall positions and collection sites of material. First, a model developed for determining the temperature of materials in an outdoor scene is presented. By applying this model, it is shown that it is possible to determine a physical characteristic of the material: thermal inertia. Second, experimental results are described that consist in recording thermal images of an outdoor scene constituted with sand and rock. Third, results and limitations of applying the model to experimental images are analyzed. Finally, the paper analyzes how basic segmentation algorithms can be combined with the thermal inertia segmentation in order to improve the discrimination of different kinds of materials.

Caillas, C.↗

Flat and Level Analysis Tool (FLAT) for real-time automated segmentation and analysis of concrete slab point clouds

In the United States, the flatness and levelness of concrete floors during construction is traditionally specified by a maximum allowable gap under a 3 meter straightedge. However, the straightedge method is inexact and rarely representative of the entire floor since the technician is free to choose any location on the floor to perform the measurement. In cases requiring a higher degree of precision and repeatability, concrete floor flatness and levelness can be measured using the standard test method ASTM E1155. With the recent introduction of advanced surveying instruments such as robotic theodolites and terrestrial laser scanners (TLS), the means now exist to modernize and expedite the measurement of floor flatness and levelness. This paper details the development and demonstration of a digital tool, named the Flat and Level Analysis Tool (FLAT), to automate and expedite the segmentation and analysis of flatness and levelness from dense point cloud data of concrete floor slabs. Segmentation algorithms were developed using unsupervised machine learning to extract the set of points belonging to the concrete floor slab from a full 360 scan of a construction site. After segmentation, automated analysis algorithms report the results according to the standard method. The developed algorithms were demonstrated on a dense point cloud captured from a concrete slab-on-grade at a construction site. Results show that the digital tool can quickly provide estimates for floor flatness and levelness with minimal human involvement with comparable accuracy to manual methods.

Hayes, Nolan↗

Microwave Observations of Precipitation and the Atmosphere

This research effort had three elements devoted to improving satellite-derived passive microwave retrievals of precipitation rate: morphological rain-rate retrievals, warm rain retrievals, and extension of a study of geostationary satellite options. The morphological precipitation-rate retrieval method uses for the first time the morphological character of the observed storm microwave spectra. The basic concept involves: 1) retrieval of point rainfall rates using current algorithms, 2) using spatial feature vectors of the observations over segmented multi-pixel storms to estimate the integrated rainfall rate for that storm (cu m/s), and 3) normalization of the point rain-rate retrievals to ensure consistency with the storm-wide retrieval. This work is ongoing, but two key steps have been completed: development of a segmentation algorithm for defining spatial regions corresponding to single storms for purposes of estimation, and reduction of some of the data from NAST-M that will be used to support this research going forward. The warm rain retrieval method involved extension of Aquai/AIRS/AMSU/HSB algorithmic work on cloud water retrievals. The central concept involves the fact that passive microwave cloud water retrievals over approx. 0.4 mm are very likely associated with precipitation. Since glaciated precipitation is generally detected quite successfully using scattering signatures evident in the surface-blind 54- and 183-GHz bands, this new method complements the first by permitting precipitation retrievals of non-glaciated events. The method is most successful over ocean, but has detected non-glaciated convective cells over land, perhaps in their early formative stages. This work will require additional exploration and validation prior to publication. Passive microwave instrument configurations for use in geostationary orbit were studied. They employ parabolic reflectors between 2 and 4 meters in diameter, and frequencies up to approx.430 GHz; this corresponds to nadir spot diameters as small as 10 km.

Staelin, David H.↗

Image segmentation by iterative parallel region growing with application to data compression and image analysis

Image segmentation can be a key step in data compression and image analysis. However, the segmentation results produced by most previous approaches to region growing are suspect because they depend on the order in which portions of the image are processed. An iterative parallel segmentation algorithm avoids this problem by performing globally best merges first. Such a segmentation approach, and two implementations of the approach on NASA's Massively Parallel Processor (MPP) are described. Application of the segmentation approach to data compression and image analysis is then described, and results of such application are given for a LANDSAT Thematic Mapper image.

Tilton, James C.↗

Manifold projection image segmentation for nano-XANES imaging

As spectral imaging techniques are becoming more prominent in science, advanced image segmentation algorithms are required to identify appropriate domains in these images. We present a version of image segmentation called manifold projection image segmentation (MPIS) that is generally applicable to a broad range of systems without the need for training because MPIS uses unsupervised machine learning with a few physically motivated hyperparameters. We apply MPIS to nanoscale x-ray absorption near edge structure (XANES) imaging, where XANES spectra are collected with nanometer spatial resolution. We show the superiority of manifold projection over linear transformations, such as the commonly used principal component analysis (PCA). Moreover, MPIS maintains accuracy while reducing computation time and sensitivity to noise compared to the standard nano-XANES imaging analysis procedure. Finally, we demonstrate how multimodal information, such as x-ray fluorescence data and spatial location of pixels, can be incorporated into the MPIS framework. We propose that MPIS is adaptable for any spectral imaging technique, including scanning transmission x-ray microscopy, where the length scale of domains is larger than the resolution of the experiment.

36 MATERIALS SCIENCE↗

Examination of Global Midlatitude Atmospheric River Lifecycles Using an Object-Oriented Methodology

Tracking atmospheric rivers (ARs) across their lifecycles is a field of recent interest with a multitude of emerging methodologies. The CONNected-objECT (CONNECT) algorithm is adapted for the tracking of global midlatitude AR lifecycles and associated precipitation by implementing a seeded region growing segmentation algorithm, creating the AR-CONNECT algorithm. To facilitate the permissiveness of the methodology, AR-CONNECT is without hard-coded geometric criteria yet is still shown to extract synoptic-scale elongated objects >99.99% of the time. One of the consequences of the methodology is the ability to occasionally track atmospheric water vapor anomalies before evolving into AR geometries, effectively tracking AR genesis further back than other studies. With the aid of subdaily satellite-derived rain data, we investigate the climatology, trends, and patterns of AR lifecycles from 1983–2016 and compare with other AR tracking studies. We find that AR frequency, genesis, and terminus locations are in generally good agreement with other AR tracking methodologies, though with key differences, and that AR frequencies in each hemisphere are determined by the number of AR hotspots. Furthermore, we uncover evidence that certain AR characteristics, such as frequency, areal extent, and duration, show evidence of increasing trends. Midlatitude precipitation uncovered by AR-CONNECT shows contributions up to 50% over land and 65% over the ocean. Trend analysis of AR precipitation shows an increase in precipitation associated with ARs propagated by the Southern Jet Stream and ARs that traverse over the Sahara Desert, among others, but is determined not to be a driver of changes in global precipitation.

54 ENVIRONMENTAL SCIENCES↗

Computation of Earth Science Products on Spaceborne Platforms

Spaceborne sensors like NASA's Hyperion hyperspectral imager generate huge data volumes, and several near-term trends indicate that data volumes will only increase. Next-generation hyperspectral missions, such as NASA's Hyperspectral Infrared Imager (HyspIRI), will operate at higher duty cycles and higher data rates, and their users will expect products to be generated from the data in near real time [1]. Barring a sudden advance in satellite downlink capacity, these trends point to a need to process data and generate products onboard the spacecraft. Rather than downlink an entire hyperspectral image cube, onboard processing enables satellites to downlink partial or completed scientific data products, which are often one to two orders of magnitude smaller than the original image. In addition, a satellite with onboard data processing resources and direct broadcast transmission equipment could send data products directly to first responders, research scientists or other users on the ground. Next-generation space-capable data processors will have a combination of reconfigurable gate arrays, digital signal processors and general-purpose CPUs. Correctly programmed and configured, these resources are sufficient to run sophisticated data analysis programs, including hyperspectral image processing algorithms that commonly run on desktop computers [2]. This paper describes how we implemented one such program, the HSEG hierarchical image segmentation algorithm, software commonly used on desktop and parallel processors, on a hardware platform designed to mimic a next-generation space-capable data processor [3]. We also describe our approach to porting the algorithm to and optimizing it for the new platform, and determine the expected performance gains enabled by our design. This extended abstract will describe the HSEG algorithm and hardware platform in greater detail, provide an analysis of the key function within the algorithm that required hardware acceleration, and describe our implementation of that function in hardware.

Fisher, Kevin↗

Examination of Haines Jump in Microfluidic Experiments via Evolution Graphs and Interface Tracking

This work examines a type of rapid pore-filling event in multiphase flow through permeable media that is better known as Haines Jump. While existing microfluidic experiments on Haines Jump mostly seek to maintain quasi-steady states through very low bulk flow rates over long periods of time, this work explores the combined use of a highly structured microscale transport network, high-speed fluorescent microscopy, displacement front segmentation algorithms, and a tracking algorithm to build evolution graphs that track displacement fronts as they evolve through high-speed video recording. The resulting evolution graph allows the segmentation of a high-speed recording in both space and time, potentially facilitating topology-cognitive computation on the transport network. Occurrences of Haines Jump are identified in the microfluidic displacement experiments and their significance in bulk flow rates is qualitatively analyzed. The bulk flow rate has little effect on the significance of Haines Jump during merging and splitting, but large bulk flow rates may obscure small bursts at the narrowest part of the throat.

permeable media↗

Unsupervised texture image segmentation by improved neural network ART2

We here propose a segmentation algorithm of texture image for a computer vision system on a space robot. An improved adaptive resonance theory (ART2) for analog input patterns is adapted to classify the image based on a set of texture image features extracted by a fast spatial gray level dependence method (SGLDM). The nonlinear thresholding functions in input layer of the neural network have been constructed by two parts: firstly, to reduce the effects of image noises on the features, a set of sigmoid functions is chosen depending on the types of the feature; secondly, to enhance the contrast of the features, we adopt fuzzy mapping functions. The cluster number in output layer can be increased by an autogrowing mechanism constantly when a new pattern happens. Experimental results and original or segmented pictures are shown, including the comparison between this approach and K-means algorithm. The system written in C language is performed on a SUN-4/330 sparc-station with an image board IT-150 and a CCD camera.

Wang, Zhiling↗

Machine learning models for segmentation and classification of cyanobacterial cells

Abstract Timelapse microscopy has recently been employed to study the metabolism and physiology of cyanobacteria at the single-cell level. However, the identification of individual cells in brightfield images remains a significant challenge. Traditional intensity-based segmentation algorithms perform poorly when identifying individual cells in dense colonies due to a lack of contrast between neighboring cells. Here, we describe a newly developed software package called Cypose which uses machine learning (ML) models to solve two specific tasks: segmentation of individual cyanobacterial cells, and classification of cellular phenotypes. The segmentation models are based on the Cellpose framework, while classification is performed using a convolutional neural network named Cyclass. To our knowledge, these are the first developed ML-based models for cyanobacteria segmentation and classification. When compared to other methods, our segmentation models showed improved performance and were able to segment cells with varied morphological phenotypes, as well as differentiate between live and lysed cells. We also found that our models were robust to imaging artifacts, such as dust and cell debris. Additionally, the classification model was able to identify different cellular phenotypes using only images as input. Together, these models improve cell segmentation accuracy and enable high-throughput analysis of dense cyanobacterial colonies and filamentous cyanobacteria.

Huffine, Clair A.↗

Visual Object Recognition and Tracking of Tools

A method has been created to automatically build an algorithm off-line, using computer-aided design (CAD) models, and to apply this at runtime. The object type is discriminated, and the position and orientation are identified. This system can work with a single image and can provide improved performance using multiple images provided from videos. The spatial processing unit uses three stages: (1) segmentation; (2) initial type, pose, and geometry (ITPG) estimation; and (3) refined type, pose, and geometry (RTPG) calculation. The image segmentation module files all the tools in an image and isolates them from the background. For this, the system uses edge-detection and thresholding to find the pixels that are part of a tool. After the pixels are identified, nearby pixels are grouped into blobs. These blobs represent the potential tools in the image and are the product of the segmentation algorithm. The second module uses matched filtering (or template matching). This approach is used for condensing synthetic images using an image subspace that captures key information. Three degrees of orientation, three degrees of position, and any number of degrees of freedom in geometry change are included. To do this, a template-matching framework is applied. This framework uses an off-line system for calculating template images, measurement images, and the measurements of the template images. These results are used online to match segmented tools against the templates. The final module is the RTPG processor. Its role is to find the exact states of the tools given initial conditions provided by the ITPG module. The requirement that the initial conditions exist allows this module to make use of a local search (whereas the ITPG module had global scope). To perform the local search, 3D model matching is used, where a synthetic image of the object is created and compared to the sensed data. The availability of low-cost PC graphics hardware allows rapid creation of synthetic images. In this approach, a function of orientation, distance, and articulation is defined as a metric on the difference between the captured image and a synthetic image with an object in the given orientation, distance, and articulation. The synthetic image is created using a model that is looked up in an object-model database. A composable software architecture is used for implementation. Video is first preprocessed to remove sensor anomalies (like dead pixels), and then is processed sequentially by a prioritized list of tracker-identifiers.

English, James↗

Dual X-ray computed tomography-aided classification of melt pool boundaries and flaws in crept additively manufactured parts

In metal additive manufacturing (AM), understanding the process-structure-performance relationships requires a combination of multi-scale characterization techniques that allows for the measurement of the melt pool shape and boundary and classifying various defects and flaws in the AM parts. Such approaches can be destructive, only 2D in nature, or have a small field of view and can be complex to co-register and analyze. Here, in this work, we present a non-destructive 3D inspection technique that employs dual-energy X-ray computed tomography (XCT) along with a model-based iterative reconstruction (MBIR) and a new segmentation algorithm. The proposed approach and algorithm are not only capable of classifying and quantifying flaws such as pores, cracks, and inclusions, but they also allow for the extraction of microstructural features such as melt pool boundaries (MPB) and melt pool regions (MPR), that can help understand process-structure-performance relationships for alloys under study. As an exemplar application, we employed the method for characterization of an additively manufactured aluminum alloy crept under tensile stress at 300 °C for 1064 h. Our results demonstrate high quality segmentation and classification of various flaws and MPB and MPR, for the first time, using 3D X-ray CT inspection. The delineated MPB and MPR in the crept samples reveal the preferential growth paths of cracks that formed during creep deformation. The technique was used for successfully quantifying the characteristics (number of defects, their density, volume fraction, etc.) of the manufacturing-induced pores and creep-induced cracks, which is necessary to better understand the creep failure mechanisms of the material.

36 MATERIALS SCIENCE↗

Evaluation of U-net-based Image Segmentation Model to Digital Mammography

Detecting suspicious lesions in medical imaging is the important first step in computer-aided detection (CAD) systems. However, detecting abnormalities in breast tissue is difficult due to the lesion's varying size, shape, margin, and contrast with the background tissue. We focused on mass segmentation, a method that provides notable morphological features by outlining contours of masses. Accurate segmentation is crucial for correct diagnosis. Recent advancements in deep learning have improved object detection and segmentation, and these techniques are also being applied to medical imaging studies. We focused on U-net, which is a recently developed mass segmentation algorithm based on a fully convolutional network. The U-net architecture consists of (1) a contracting path to increase the resolution of the output and (2) a symmetric expanding path to better locate the region of interest. The performance of a U-net model was tested with 63 digital mammograms from INbreast, a publicly available database. We trained the model with images resized to 40x40 pixels and conducted 10-fold cross-validation to prevent overfitting. The model's performance with respect to breast density and the lesion's BI-RADS rating was also investigated. Dice coefficients (DC) were used as a performance measure to compare the predicted segmentation of the model with the ground truth. Logistic regression and an analysis of variance were performed to determine the significance of the DCs with regards to breast density and lesion behavior and to calculate the 95% confidence interval. The average DC was 0.80. The difference between DCs for BI-RADS 2 and 4c and for BI-RADS 2 and 5 were significant, suggesting that the model has more difficulty in segmenting benign lesions.

Cho, Priscilla↗