Search NASASearch

SEARCH · Search NASA

Results for “Image Segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Analysis of objects in binary images

Digital image processing techniques are typically used to produce improved digital images through the application of successive enhancement techniques to a given image or to generate quantitative data about the objects within that image. In support of and to assist researchers in a wide range of disciplines, e.g., interferometry, heavy rain effects on aerodynamics, and structure recognition research, it is often desirable to count objects in an image and compute their geometric properties. Therefore, an image analysis application package, focusing on a subset of image analysis techniques used for object recognition in binary images, was developed. This report describes the techniques and algorithms utilized in three main phases of the application and are categorized as: image segmentation, object recognition, and quantitative analysis. Appendices provide supplemental formulas for the algorithms employed as well as examples and results from the various image segmentation techniques and the object recognition algorithm implemented.

Leonard, Desiree M.

Satellite-Derived Imagery and Transfer Learning: A Novel Technique for Land Cover Classification

Land cover classification is a continuing research topic due to its relevance to land use and land cover changes from impacts such as climate change, agriculture, urbanization, and hazardous weather. Simple access to frequently changing land cover classifications could provide knowledge and decision support to various researchers and agencies across the globe for each of above-mentioned and related influences. This research aims to provide a novel technique for land cover classification of remote sensing imagery; harnessing Artificial Neural Networks and transfer learning (TL). Knowledge sharing techniques within machine learning are typically utilized when training datasets are sparse or transitions between data modalities is required. In this case, two data modalities, multi and hyperspectral data, are considered for knowledge transfer. The large number of continuous spectral bands available from hyperspectral sensors typically provide increased sophisticated land classification capability compared to more traditional multispectral imagery with limited discrete spectral bands. However, large-scale, frequent access to hyperspectral imagery is relatively limited. The proposed classification technique would therefore prove useful in regions in which hyperspectral data are not readily available for classification but multispectral data are. Image segmentation models are trained on each multi and hyperspectral datasets. Knowledge sharing techniques are then applied to each model to understand what knowledge, if any, is gained when moving between the data modalities. The datasets utilized for training and testing a U-Net model include the European Space Agency’s multispectral imager Sentinel-2 and the hyperspectral German Aerospace Center’s Earth Sensing Imaging Spectrometer (DESIS). Initially, only two classes, land and water, are classified for simplicity. However, more complex classes can be added if knowledge sharing is successful. The workflow for image classification through supervised image segmentation with a U-Net model will be discussed along with metrics calculated before and after TL for both Sentinel-2 and DESIS data are applied. Additionally, future steps to advance the sophistication of this technique as well as other applicable methodologies will be explored.

Emily Foshee

Object-based Mapping of the Circumpolar Taiga-Tundra Ecotone with MODIS Tree Cover

The circumpolar taiga-tundra ecotone was delineated using an image segmentation based mapping approach with multi-annual MODIS Vegetation Continuous Fields (VCF) tree cover data. Circumpolar tree canopy cover (TCC) throughout the ecotone was derived by averaging MODIS VCF data from 2000 - 2005 and adjusting the averaged values using linear equations relating MODIS TCC to Quickbird-derived tree cover estimates. The adjustment helped mitigate VCF's overestimation of tree cover in lightly forested regions. An image segmentation grouped pixels representing similar tree cover into polygonal features (objects) that form the map of the transition zone. Eachfeature represents an area much larger than the 500m MODIS pixel to characterize thepatterns of sparse forest patches on a regional scale. Comparisons of the adjusted average tree cover data were made with (1) two existing tree line definitions aggregated for each 1deg longitudinal interval in North America and Eurasia and (2) Landsat-derived Canadianproportion of forest cover for Canada. The adjusted TCC from MODIS VCF shows, on average, greater than 12% TCC for all but one regional zone at the intersection with independently delineated tree lines. Adjusted values track closely with Canadian proportion of forest cover data in areas of low tree cover. Those polygons near the boreal/tundra interface with either (1) mean adjusted TCC values between 5-20% , or (2) mean adjusted TCC values <5% but with a standard deviation > 5% were used to identify the ecotone.

Ransom, Kenneth J.

Object-Based Mapping of the Circumpolar Taiga-Tundra Ecotone with MODIS Tree Cover

The circumpolar taiga tundra ecotone was delineated using an image-segmentation-based mapping approach with multi-annual MODIS Vegetation Continuous Fields (VCF) tree cover data. Circumpolar tree canopy cover (TCC) throughout the ecotone was derived by averaging MODIS VCF data from 2000 to 2005 and adjusting the averaged values using linear equations relating MODIS TCC to Quickbird-derived tree cover estimates. The adjustment helped mitigate VCF's overestimation of tree cover in lightly forested regions. An image segmentation procedure was used to group pixels representing similar tree cover into polygonal features (segmentation objects) that form the map of the transition zone. Each polygon represents an area much larger than the 500 m MODIS pixel and characterizes the patterns of sparse forest patches on a regional scale. Those polygons near the boreal/tundra interface with either (1) mean adjusted TCC values from5 to 20%, or (2) mean adjusted TCC values greater than 5% but with a standard deviation less than 5% were used to identify the ecotone. Comparisons of the adjusted average tree cover data were made with (1) two existing tree line definitions aggregated for each 1 degree longitudinal interval in North America and Eurasia, (2) Landsat-derived Canadian proportion of forest cover for Canada, and (3) with canopy cover estimates extracted from airborne profiling lidar data that transected 1238 of the TCC polygons. The adjusted TCC from MODIS VCF shows, on average, less than 12% TCC for all but one regional zone at the intersection with independently delineated tree lines. Adjusted values track closely with Canadian proportion of forest cover data in areas of low tree cover. A comparison of the 1238 TCC polygons with profiling lidar measurements yielded an overall accuracy of 67.7%.

Ranson, K. J.

Data supporting the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure"

This dataset contains atomic force microscopy images associated with the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure" by Maria Kelly, Emily R. Dunn, Ellis A. Spickermann, Josephine N. Gruber, César A. Lasalde-Ramírez, P. N. Romero Zavala, Éowyn Lucas, Ankur Gupta, Harry A. Atwater, and Wilson A. Smith. The dataset contains both raw images as well as segmented images produced by the image processing workflow described in the manuscript. A readme file and meta data file are included to provide additional details regarding the sample identity, image acquisition parameters, and file naming scheme.

36 MATERIALS SCIENCE

A tool for interactive exploration of a hierarchical segmentation

Hierarchical segmentation is discussed as a form of region growing in which the sequence of merges is controlled by a 'best merge first' principle, and a record of the region merging sequence is often retained for later analysis. In the author's massively parallel implementation of hierarchical segmentation, which he calls iterative parallel region growing (IPRG), a set of directional edge maps are used to store the region merging sequence information. An iteractive tool is described that allows an analyst to fully explore a hierarchical segmentation, potentially producing an image segmentation that is a combination of segmentations produced at several different iterations of the IPRG algorithm. A potential method for automatically producing such segmentations is also discussed.

Tilton, James C.

Incorporating Edge Information into Best Merge Region-Growing Segmentation

We have previously developed a best merge region-growing approach that integrates nonadjacent region object aggregation with the neighboring region merge process usually employed in region growing segmentation approaches. This approach has been named HSeg, because it provides a hierarchical set of image segmentation results. Up to this point, HSeg considered only global region feature information in the region growing decision process. We present here three new versions of HSeg that include local edge information into the region growing decision process at different levels of rigor. We then compare the effectiveness and processing times of these new versions HSeg with each other and with the original version of HSeg.

Image segmentation

Contextual Segmentation of Fire Spotting Regions Through Satellite-Augmented Autonomous Modular Sensor Image

Globally, forest fires remain a significant threat to human and environmental wellbeing. Towards mitigating the impacts of forest fires, it is critical that accurate and updated information regarding not only the fire line, but also nearby human settlements, vegetation, and water sources is reported quickly to emergency services. However, while existing UAS-based fire detection methods are effective, they largely do not report the contextual environmental information necessary to best serve nearby communities in disaster response. Additionally, modern advancements in deep learning offer new approaches for image segmentation which may improve classification accuracy beyond current pixel-wise indices. In this work, we benchmark the performance of these modern segmentation techniques in locating both fire lines and environmental features in historical Autonomous Modular Sensor imagery. Furthermore, we augment these outputs with satellite imagery segmentation towards developing a robust contextual mapping tool for rapid emergency fire response and decision making.

Nikhil Behari

An adaptive technique to maximize lossless image data compression of satellite images

Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.

Stewart, Robert J.

A Markov Random Field Model for Texture-based Segmentation of Small Cracks in Thin InconelTubes

Markov random fields have been used for image segmentation since their introduction in the1980s. This work applies a method from Principal Component Thermography to enhance thecontrast in damage regions in 3D images derived from X-ray computed tomography (CT)inspections. The developed method is applied to sizing of small cracks in thin Inconel tubes designed as probability of detection (POD) samples for radiographic inspection.Misclassification errors arising from artifacts due to beam-hardening are reduced by fitting the boundary of the segmented damage region with the arc of an ellipse. Results are comparedagainst those obtained through manual inspection.

Image segmentation

Target Detection Using Fractal Geometry

The concepts and theory of fractal geometry were applied to the problem of segmenting a 256 x 256 pixel image so that manmade objects could be extracted from natural backgrounds. The two most important measurements necessary to extract these manmade objects were fractal dimension and lacunarity. Provision was made to pass the manmade portion to a lookup table for subsequent identification. A computer program was written to construct cloud backgrounds of fractal dimensions which were allowed to vary between 2.2 and 2.8. Images of three model space targets were combined with these backgrounds to provide a data set for testing the validity of the approach. Once the data set was constructed, computer programs were written to extract estimates of the fractal dimension and lacunarity on 4 x 4 pixel subsets of the image. It was shown that for clouds of fractal dimension 2.7 or less, appropriate thresholding on fractal dimension and lacunarity yielded a 64 x 64 edge-detected image with all or most of the cloud background removed. These images were enhanced by an erosion and dilation to provide the final image passed to the lookup table. While the ultimate goal was to pass the final image to a neural network for identification, this work shows the applicability of fractal geometry to the problems of image segmentation, edge detection and separating a target of interest from a natural background.

Fuller, J. Joseph

NASA Tech Briefs, May 2011

Topics covered include: 1) Method to Estimate the Dissolved Air Content in Hydraulic Fluid; 2) Method for Measuring Collimator-Pointing Sensitivity to Temperature Changes; 3) High-Temperature Thermometer Using Cr-Doped GdAlO3 Broadband Luminescence; 4)Metrology Arrangement for Measuring the Positions of Mirrors of a Submillimeter Telescope; 5) On-Wafer S-Parameter Measurements in the 325-508-GHz Band; 6) Reconfigurable Microwave Phase Delay Element for Frequency Reference and Phase-Shifter Applications; 7) High-Speed Isolation Board for Flight Hardware Testing; 8) High-Throughput, Adaptive FFT Architecture for FPGA-Based Spaceborne Data Processors; 9) 3D Orbit Visualization for Earth-Observing Missions; 10) MaROS: Web Visualization of Mars Orbiting and Landed Assets; 11) RAPID: Collaborative Commanding and Monitoring of Lunar Assets; 12) Image Segmentation, Registration, Compression, and Matching; 13) Image Calibration; 14) Rapid ISS Power Availability Simulator; 15) A Method of Strengthening Composite/Metal Joints; 16) Pre-Finishing of SiC for Optical Applications; 17) Optimization of Indium Bump Morphology for Improved Flip Chip Devices; 18) Measuring Moisture Levels in Graphite Epoxy Composite Sandwich Structures; 19) Marshall Convergent Spray Formulation Improvement for High Temperatures; 20) Real-Time Deposition Monitor for Ultrathin Conductive Films; 21) Optimized Li-Ion Electrolytes Containing Triphenyl Phosphate as a Flame-Retardant Additive; 22) Radiation-Resistant Hybrid Lotus Effect for Achieving Photoelectrocatalytic Self-Cleaning Anticontamination Coatings; 23) Improved, Low-Stress Economical Submerged Pipeline; 24) Optical Fiber Array Assemblies for Space Flight on the Lunar Reconnaissance Orbiter; 25) Local Leak Detection and Health Monitoring of Pressurized Tanks; 26) Dielectric Covered Planar Antennas at Submillimeter Wavelengths for Terahertz Imaging; 27) Automated Cryocooler Monitor and Control System; 28) Broadband Achromatic Phase Shifter for a Nulling Interferometer; 29) Super Dwarf Wheat for Growth in Confined Spaces; 30) Fine Guidance Sensing for Coronagraphic Observatories; 31) Single-Antenna Temperature- and Humidity-Sounding Microwave Receiver; 32) Multi-Wavelength, Multi-Beam, and Polarization-Sensitive Laser Transmitter for Surface Mapping; 33) Optical Communications Link to Airborne Transceiver; 34) Ascent Heating Thermal Analysis on Spacecraft Adaptor Fairings; 35) Entanglement in Self-Supervised Dynamics; 36) Prioritized LT Codes; 37) Fast Image Texture Classification Using Decision Trees; 38) Constraint Embedding Technique for Multibody System Dynamics; 39) Improved Systematic Pointing Error Model for the DSN Antennas; 40) Observability and Estimation of Distributed Space Systems via Local Information-Exchange Networks; 41) More-Accurate Model of Flows in Rocket Injectors; 42) In-Orbit Instrument-Pointing Calibration Using the Moon as a Target; 43) Reliability of Ceramic Column Grid Array Interconnect Packages Under Extreme Temperatures; 44) Six Degrees-of-Freedom Ascent Control for Small-Body Touch and Go; and 45) Optical-Path-Difference Linear Mechanism for the Panchromatic Fourier Transform Spectrometer.

Source record

Detecting perceptual groupings in textures by continuity considerations

A generalization is presented for the second derivative of a Gaussian D(sup 2)G operator to apply to problems of perceptual organization involving textures. Extensions to other problems of perceptual organization are evident and a new research direction can be established. The technique presented is theoretically pleasing since it has the potential of unifying the entire area of image segmentation under the mathematical notion of continuity and presents a single algorithm to form perceptual groupings where many algorithms existed previously. The eventual impact on both the approach and technique of image processing segmentation operations could be significant.

Greene, Richard J.

Automated, on-board terrain analysis for precision landings

Advances in space robotics technology hinge to a large extent upon the development and deployment of sophisticated new vision-based methods for automated in-space mission operations and scientific survey. To this end, we have developed a new concept for automated terrain analysis that is based upon a generic image enhancement platform|multi-scale retinex (MSR) and visual servo (VS) processing. This pre-conditioning with the MSR and the vs produces a "canonical" visual representation that is largely independent of lighting variations, and exposure errors. Enhanced imagery is then processed with a biologically inspired two-channel edge detection process, followed by a smoothness based criteria for image segmentation. Landing sites can be automatically determined by examining the results of the smoothness-based segmentation which shows those areas in the image that surpass a minimum degree of smoothness. Though the msr has proven to be a very strong enhancement engine, the other elements of the approach|the vs, terrain map generation, and smoothness-based segmentation|are in early stages of development. Experimental results on data from the Mars Global Surveyor show that the imagery can be processed to automatically obtain smooth landing sites. In this paper, we describe the method used to obtain these landing sites, and also examine the smoothness criteria in terms of the imager and scene characteristics. Several examples of applying this method to simulated and real imagery are shown.

Rahman, Zia-ur

Automated On-board Terrain Analysis for Precision Landings

Advances in space robotics technology hinge to a large extent upon the development and deployment of sophisticated new vision-based methods for automated in-space mission operations and scientific survey. To this end, we have developed a new concept for automated terrain analysis that is based upon a generic image enhancement platform-multi-scale Retinex (MSR) and visual servo (VS) processing. This pre-conditioning with the MSR and the VS produces a "canonical" visual representation that is largely independent of lighting variations, and exposure errors. Enhanced imagery is then processed with a biologically inspired two-channel edge detection process, followed by a smoothness based criteria for image segmentation. Landing sites can be automatically determined by examining the results of the smoothness-based segmentation which shows those areas in the image that surpass a minimum degree of smoothness. Though the MSR has proven to be a very strong enhancement engine, the other elements of the approach, the VS, terrain map generation, and smoothness-based segmentation, are in early stages of development. Experimental results on data from the Mars Global Surveyor show that the imagery can be processed to automatically obtain smooth landing sites. In this paper, we describe the method used to obtain these landing sites, and also examine the smoothness criteria in terms of the imager and scene characteristics. Several examples of applying this method to simulated and real imagery are shown.

Rahman, Zia-ur

A User-Friendly GUI Tool for Automated Microstructural Analysis of Fiber-Reinforced Composites and Porous Structures

Understanding and quantifying microstructural features such as fiber orientation and porosity is critical for predicting the mechanical behavior and performance of fiber-reinforced polymer composites. Traditional manual analysis is time-consuming, subjective, and unsuitable for high-throughput datasets. We present a graphical user interface (GUI) application that automates the analysis of microscopy images to extract key microstructural metrics, including fiber orientation tensors, fiber orientation distribution, porosity and pore size distribution. The app integrates multiple image segmentation techniques including global and local thresholding, clustering, and region-based approaches, offering flexibility for different types of image qualities and features. Users can load microstructural images, select regions of interest and segmentation techniques tailored to their image dataset. It also addresses a critical challenge in fiber orientation analysis: the ambiguities caused by touching, overlapping, or partially cut fibers. It supports autorun examples for standardized workflows, enabling reproducible analysis and facilitating training and benchmarking. This tool significantly reduces manual intervention, enhances consistency, and accelerates data generation for structure–property modeling, process optimization, and digital materials research. The tool is intended for use by materials scientists, engineers, and researchers engaged in composite characterization, quality control, and machine learning-based microstructural studies.

Chawla, Komal [ORNL] (ORCID:0000000190327565)

Generation of texture images using adaptive windows

Simulated forest and observed TM and SPOT images illustrate the improvements an adaptive-window texture image can have over traditional texture images for applications like image segmentation where edge effects in the texture image can be detrimental. By adaptive selection of the 'best' window position (as opposed to always having the window centered over the pixel) minimizes edge effects while retaining local texture information. Tests using 3 x 3 windows and local variance on SPOT, TM and simulated TM data show similar results.

Woodcock, Curtis E.

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES