SEARCH · Search NASA
Results for “image thresholding”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Automated layer identification in large area additive manufacturing (LAAM): A comparison of image thresholding and edge detection techniques
Explore the source record for details and available documents.
Thresholding Analysis and Feature Extraction from 3D Ground Penetrating Radar Data for Noninvasive Assessment of Peanut Yield
This study explores the efficacy of utilizing a novel ground penetrating radar (GPR) acquisition platform and data analysis methods to quantify peanut yield for breeding selection, agronomic research, and producer management and harvest applications. Sixty plots comprising different peanut market types were scanned with a multichannel, air-launched GPR antenna. Image thresholding analysis was performed on 3D GPR data from four of the channels to extract features that were correlated to peanut yield with the objective of developing a noninvasive high-throughput peanut phenotyping and yield-monitoring methodology. Plot-level GPR data were summarized using mean, standard deviation, sum, and the number of nonzero values (counts) below or above different percentile threshold values. Best results were obtained for data below the percentile threshold for mean, standard deviation and sum. Data both below and above the percentile threshold generated good correlations for count. Correlating individual GPR features to yield generated correlations of up to 39% explained variability, while combining GPR features in multiple linear regression models generated up to 51% explained variability. The correlations increased when regression models were developed separately for each peanut type. This research demonstrates that a systematic search of thresholding range, analysis window size, and data summary statistics is necessary for successful application of this type of analysis. The results also establish that thresholding analysis of GPR data is an appropriate methodology for noninvasive assessment of peanut yield, which could be further developed for high-throughput phenotyping and yield-monitoring, adding a new sensor and new capabilities to the growing set of digital agriculture technologies.
Optical image analysis of WSe 2 − thresholding for layer detection
The fast and reliable layer identification of two-dimensional transition metal dichalcogenide (TMD), such as WSe 2 , is essential to investigating their thickness-dependent electronic and optical properties. This article presents efficient optical image thresholding methodology designed to segment the mono, bi, and tri-layer regions of WSe 2 flakes mechanically exfoliated onto a SiO 2 /Si substrate. The optical images were first preprocessed to exclude the background effect and analyzed using the pixel medians and interquartile ranges for fundamental color channels—red, green, and blue (RGB). The analysis of red channel pixel intensities yielded three distinct ranges, serving as thresholds for layer segmentation: monolayer (111.0–118.0), bilayer (103.0–110.0), and tri-layer (93.0–103.0). Similarly, thresholds were established for each color channel, facilitating a comparative study of the segmentation performances. Further, the intersection-over-union ($IoU$) calculations revealed that the red and green channels demonstrated greater than 99 % and 90 % accuracy in differentiating each layer, respectively. This approach yields remarkable results without substantial data calibration that utilizes time-intensive heuristic techniques. Moreover, the proposed methodology offers the flexibility to compare performances across different color channels, expanding the applicability for other 2D material systems.
Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting
Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.
Controlled Assembly of Upconverting Nanoparticles for Low-Threshold Microlasers and Their Imaging in Scattering Media
Micron-sized lasers fabricated from upconverting nanoparticles (UCNP) coupled to whispering gallery mode (WGM) microresonators can exhibit continuous-wave anti-Stokes lasing useful for tracking cells, environmental sensing, and coherent stimulation of biological activity. The integration of these microlasers into organisms and microelectronics requires even smaller diameters, however, which raises threshold pump powers beyond practical limits for biological applications. To meet the need for low lasing thresholds and high fidelity fabrication methods, we use correlative optical and electron microscopy to uncover the nanoparticle assembly process and structural factors that determine efficient upconverted lasing. We show that 5 μm microspheres with controlled submonolayer UCNP coatings exhibit, on average, 25-fold lower laser thresholds (1.7 ± 0.7 kW/cm 2 ) compared to the mean values of the lowest threshold UCNP lasers, and variability is reduced 30-fold. WGMs are observed in the upconversion spectra for TiO 2 -coated microspheres as small as 3 μm, a size at which optical losses had previously prevented such observations. Finally, we demonstrate that the WGM signatures of these upconverting microlasers can be imaged and distinguished through tissue-mimicking phantoms. These advances will enable the fabrication of more efficient upconverting lasers for imaging, sensing, and actuation in optically complex environments.
An image-driven machine learning approach to kinetic modeling of a discontinuous precipitation reaction
Micrograph quantification is an essential component of several materials science studies. Machine learning methods, in particular convolutional neural networks, have previously demonstrated performance in image recognition tasks across several disciplines (e.g. materials science, medical imaging, facial recognition). Here, we apply these well-established methods to develop an approach to microstructure quantification for kinetic modeling of a discontinuous precipitation reaction in a case study on the uranium-molybdenum system. Prediction of material processing history based on image data (classification), calculation of area fraction of phases present in the micrographs (segmentation), and kinetic modeling from segmentation results were performed. Results indicate that convolutional neural networks represent microstructure image data well, and segmentation using the k-means clustering algorithm yields results that agree well with manually annotated images. Classification accuracies of original and segmented images are both 94% for a 5-class classification problem. Kinetic modeling results agree well with previously reported data using manual thresholding. The image quantification and kinetic modeling approach developed and presented here aims to reduce researcher bias introduced into the characterization process, and allows for leveraging information in limited image data sets.
Optical image analysis for graphene layer detection: Enhanced green channel methodology
Graphene, a material of increasing research interest, requires accurate layer identification due to its sensitivity to layer count. Existing methods for graphene layer number identification are either time-consuming or of low accuracy, with high-accuracy methods often requiring expensive processes. This paper aims to address this challenge by proposing a cost-effective and efficient approach. Specifically, the current work highlights only the green channel—one of the three primary color channels (red, green, blue) that make up an optical image—from images of exfoliated graphene flakes for layer count identification. A linear regression is performed between pixel position and substrate green channel value, and this effect is subtracted from the entire optical image to mitigate background effects. By storing the range of green channel values for each type of flake (monolayer, bilayer, or tri-layer) based on a few images, we establish thresholds for identifying different types of layers in a particular setup. Additionally, our methodology allows for flexible threshold tuning using a single reference image, enabling adjustment to changes in detection setup such as illumination level, magnification, or microscope used. Finally, demonstrating high accuracy and flexibility, this methodology presents a suitable technique for graphene layer number identification without the need for large datasets or expensive instruments.
Retrieving Tarnished Daguerreotype Content Using X-ray Fluorescence Imaging—Recent Observations on the Effect of Chemical and Electrochemical Cleaning Methods
We report a study on the effect of chemical and electrochemical cleaning of tarnished daguerreotypes observed using X-ray fluorescence (XRF) microscopy with a micro-focussed X-ray beam from a synchrotron source. It has been found that, while both techniques result in some success depending on the condition of the plate and the experimental parameters (chemical concentration, voltage, current, etc.) the effect varies, and cleaning is often incomplete. The XRF images using Hg Lα,β at an excitation energy just above the L3 edge threshold produce fine images, regardless of the treatment. This finding confirms previous observations that if the bulk of the image particles remains intact, the surface tarnish has little effect on the quality of the original daguerreotype image retrievable from XRF.
Applications of LIF to Document Natural Variability of Chlorophyll Content and Cu Uptake in Moss
Chlorophyll has long been used as a natural indicator of plant health and photosynthetic efficiency. Laser-induced fluorescence (LIF) is an emerging technique for understanding broad spectrum organic processes and has more recently been used to monitor chlorophyll response in plants. Previous work has focused on developing a LIF technique for imaging moss mats to identify metal contamination with the current focus shifting toward application to moss fronds and aiding sample collection for chemical analysis. Two laser systems (CoCoBi a Nd:YGa pulsed laser system and Chl-SL with two blue continuous semiconductor diodes) were used to collect images of moss fronds exposed to increasing levels of Cu (1, 10, and 100 nmol/cm 2 ) using a CMOS camera. The best methods for the preprocessing of images were conducted before the analysis of fluorescence signatures were compared to a control. The Chl-SL system performed better than the CoCoBi, with dynamic time warping (DTW) proving the most effective for image analysis. Manual thresholding to remove lower decimal code values improved the data distributions and proved whether using one or two fronds in an image was more advantageous. A higher DTW difference from the control correlated to lower chlorophyll a/b ratios and a higher metal content, indicating that LIF, with the aid of image processing, can be an effective technique for identifying Cu contamination shortly after an event.
How “hot” are hotspots: Statistically localizing the high-activity areas on soil and rhizosphere images
The topic of microbial hotspots in soil requires not only visualizing their spatial distribution and biochemical analyses, but also statistical approaches to identify these hotspots and separate them from the surrounding activities (background). We hypothesized that each hotspot type (e.g. enzyme activities in the rhizosphere, root exudation, localization of herbicide accumulation) is a result of local process driven by biotic and/or abiotic factors, and the process rates in the hotspots are much faster than those in the soil background. We further hypothesized that the background and hotspot activities in soil belong to different statistical distributions. Consequently, hotspot determination should be based on statistical separation of activities significantly higher than the background. We analyzed for the statistical distributions of grey values on three groups of published images: 1) 14 C images of carbon input by roots into the rhizosphere, 2) 14 C glyphosate accumulation in the plant, and 3) zymogram of leucine aminopeptidase activity in rooted soil. The two Gaussian distributions were fit (the first representing the background, the second the hotspots) to the distribution of grey values in the images, the parameters (means and standard deviations, SD) of the fitted distributions were calculated, and the background was removed. Thus, we identified hotspots as areas outside of the Mean+2SD image intensity (corresponding to the upper ~ 2.5% of activity, being over 97.5% of background values) and finally, visualized images of solely hotspot locations. Finally, these results were compared with previously used decisions on hotspot intensity thresholding (i.e. Top-25% and 17 standard thresholding approaches in ImageJ) and discussed the advantages of the Mean+2SD as well as Mean+3SD approaches. These advantages include: i) simple unification of the thresholding approach for several imaging methods with various principles of activity distribution, ii) identification of hotspots with various activity levels, iii) analysis of “time-specific” hotspots in temporal sequences of images. Compared with 17 standard thresholding methods, we concluded that objectively elucidating and separating the hotspots should be based on statistical distribution analysis, e.g. using the Mean+2SD or Mean+3SD approaches. Furthermore, this simple Mean+2SD approach delivered suitable results for three groups of images and so, helps to understand the processes responsible for the highest activities and elucidate hotspots.
Spiking retina microscope
A spiking retina microscope comprising microscope optics and a neuromorphic imaging sensor. The microscope optics are configured to direct a magnified image of a specimen onto the neuromorphic imaging sensor. The neuromorphic imaging sensor comprises a plurality of sensor elements that are configured to generate spike signals in response to integrated light from the magnified image reaching a threshold. The spike signals may be processed by a processor unit to generate a result, such as tracking biological particles in a specimen comprising biological material.
Design and testing of ultrasound probe adapters for a robotic imaging platform
Medical imaging-based triage is a critical tool for emergency medicine in both civilian and military settings. Ultrasound imaging can be used to rapidly identify free fluid in abdominal and thoracic cavities which could necessitate immediate surgical intervention. However, proper ultrasound image capture requires a skilled ultrasonography technician who is likely unavailable at the point of injury where resources are limited. Instead, robotics and computer vision technology can simplify image acquisition. As a first step towards this larger goal, here, we focus on the development of prototypes for ultrasound probe securement using a robotics platform. The ability of four probe adapter technologies to precisely capture images at anatomical locations, repeatedly, and with different ultrasound transducer types were evaluated across more than five scoring criteria. Testing demonstrated two of the adapters outperformed the traditional robot gripper and manual image capture, with a compact, rotating design compatible with wireless imaging technology being most suitable for use at the point of injury. Next steps will integrate the robotic platform with computer vision and deep learning image interpretation models to automate image capture and diagnosis. This will lower the skill threshold needed for medical imaging-based triage, enabling this procedure to be available at or near the point of injury.
Dual-Image Color Normalization to Enable High-Performance Concentrating Solar Optical Metrology
Concentrating Solar Power (CSP) requires precision mirrors, and these in turn require metrology systems to measure their optical slope. In this project we studied a color-based approach to the correspondence problem, which is the association of points on an optical target with their corresponding points seen in a reflection. This is a core problem in deflectometry-based metrology, and a color solution would enable important new capabilities. We modeled color as a vector in the [R,G,B] space measured by a digital camera, and explored a dual-image approach to compensate for inevitable changes in illumination color. Through a series of experiments including color target design and dual-image setups both indoors and outdoors, we collected reference/measurement image pairs for a variety of configurations and light conditions. We then analyzed the resulting image pairs by selecting example [R,G,B] pixels in the reference image, and seeking matching [R,G,B] pixels in the measurement image. Modulating a tolerance threshold enabled us to assess both match reliability and match ambiguity, and for some configurations, orthorectification enabled us to assess match accuracy. Using direct-direct imaging, we demonstrated color correspondence achieving average match accuracy values of 0.004 h, where h is the height of the color pattern. We found that wide-area two-dimensional and linear one-dimensional color targets outperformed hybrid linear/lateral gradient targets in the cases studied. Introducing a mirror degraded performance under our current techniques, and we did not have time to evaluate whether matches could be reliably achieved despite varying light conditions. Nonetheless, our results thus far are promising.
Segmenting water and shadow regions within WorldView imagery using local binary patterns
Many shadow detection algorithms pertaining to remotely sensed imagery exist. Several of these algorithms exploit the spectral characteristics of shadows within imagery to identify shaded regions. However, these algorithms can have problems when water is also present within the imagery because water shares similar spectral characteristics with shadows. Many of these algorithms are applied to small image subsets instead of the image as a whole and frequently are applied to urban environments that require additional use of the normalized difference water index or other features to affect the removal of water from the shadow mask. This diversity of the image scene content coupled with the complexity and wide variety of environmental conditions that satellite imagery can acquire makes reliably separating shadow and water within larger images a complex problem. Thresholding various spectral indices to produce segmentation maps can be challenging when large, complex, and often imbalanced scenes are captured, which may require manual adjustment of algorithmic parameters for different image areas. Here, we present a methodology that makes use of the near-infrared channel using a watershed segmentation algorithm, local binary pattern measurements, and a support vector machine to classify shadow and water within a full WorldView scene. Results are promising with initial accuracies above 97% for both shadow and water.
Dual particle imaging using time-of-flight neutron classification
Fast-neutron imaging technology is well-suited for passive nuclear material monitoring, secondary inspection of flagged cargo, and wide-area search for lost neutron sources. However, imaging systems that use pulse shape discrimination for event classification require complex pulse waveform analysis. In this work, we evaluate time-of-flight (TOF) based particle classification as an alternative solution for fast-neutron imaging by classifying all events with a TOF above a maximum threshold as neutrons. We measured a Cf-252 source next to Cs-137 using a 12-bar organic-glass scintillator array. By varying the TOF thresholds for neutron identification, we demonstrate a clear trade-off between event yield and backprojection image fidelity, with stricter thresholds improving precision at the cost of statistics, TOF thresholded data generated an image that predicted the neutron source direction with 20% reduced mean central angle prediction error compared to a traditional pulse shape discrimination (PSD) method with comparable event count. Time-of-flight particle classification shows promise as an alternative to pulse shape discrimination systems for fast neutron imaging systems looking to minimize costs and size of electronics with comparable imaging quality. The sources used demonstrate that the method is effective in classifying measured neutrons in a measurement environment with 150 μCi Cs-137 and 1.6 × 10 6 n/s Cf-252 sources positioned at distances of 66 cm and 81 cm from the detector. Additionally, the method classifies low-energy neutron events that pulse shape discrimination removes, so a combination of both methods would result in a higher overall neutron event efficiency.
SREMI: Super-resolution electromagnetic imaging with single-channel ground-penetrating radar
High-resolution near-surface imaging has important applications in civil engineering, infrastructure inspection, military threat detection, geological characterization, and lunar and planetary exploration. Zero-offset, singlechannel ground penetrating radar (GPR) imaging is an established technique for near-surface target imaging and sensing but often suffers from low spatial resolution and imaging artifacts, especially of deep structures. In response, we formulate the GPR imaging as a dual-sparsity optimization problem, and develop a super-resolution electromagnetic imaging method based on a fast iterative shrinkage-thresholding algorithm. We develop our GPR imaging method in the framework of electromagnetic exploding-reflectors simulation theory, therefore the imaging method is computationally efficient. In this work, we demonstrate through synthetic and field data examples that our method can produce sharper, more reliable images with fewer artifacts compared with single-pass reverse-time migration GPR method, thus leading to improved near-surface interpretation and object identification.
Measurement of hybrid rocket solid fuel regression rate for a slab burner using deep learning
This study presents an imaging-based deep learning tool to measure the fuel regression rate in a 2D slab burner experiment for hybrid rocket fuels. The slab burner experiment is designed to verify mechanistic models of reacting boundary layer combustion in hybrid rockets by the measurement of fuel regression rates. A DSLR camera with a high intensity flash is used to capture images throughout the burn and the images are then used to find the fuel boundary to calculate the regression rate. A U-net convolutional neural network architecture is explored to segment the fuel from the experimental images. Here, a Monte-Carlo Dropout process is used to quantify the regression rate uncertainty produced from the network. The U-net computed regression rates are compared with values from other techniques from literature and show error less than 10%. An oxidizer flux dependency study is performed and shows the U-net predictions of regression rates are accurate and independent of the oxidizer flux, when the images in the training set are not over-saturated. Training with monochrome images is explored and is not successful at predicting the fuel regression rate from images with high noise. The network is superior at filtering out noise introduced by soot, pitting, and wax deposition on the chamber glass as well as the flame when compared to traditional image processing techniques, such as threshold binary conversion and spatial filtering. U-net consistently provides low error image segmentations to allow accurate computation of the regression rate of the fuel.