Search NASA⌕ Search

SEARCH · Search NASA

Results for “image detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Prognostic Importance of MRI-Detected Extramural Venous Invasion in Rectal Cancer: A Literature Review and Systematic Meta-Analysis

Extramural venous invasion (EMVI) is recognized as a poor prognostic factor in rectal cancer. There are well-documented limitations associated with pathology detection of EMVI, including variable reporting and the inability to use it preoperatively to guide neoadjuvant treatment. Magnetic resonance imaging (MRI)-detected EMVI (mrEMVI) has been proposed as an imaging biomarker. This review assesses the prognostic significance of mrEMVI on survival outcomes and whether regression of mrEMVI after neoadjuvant therapy is associated with improvements in survival.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Comprehensive Survey of Readout Strategies for SiPMs Used in Nuclear Imaging Systems

Silicon photomultipliers (SiPMs) offer advantages such as lower relative cost, smaller size, and lower operating voltages compared to photomultiplier tubes. A SiPM’s readout circuit topology can significantly affect the characteristics of an imaging array. In nuclear imaging and detection, energy, timing, and position are the primary characteristics of interest. Nuclear imaging has applications in the medical, astronomy, and high energy physics fields, making SiPMs an active research area. This work is focused on the circuit topologies required for nuclear imaging. We surveyed the readout strategies including the front end preamplification topology choices of transimpedance amplifier, charge amplifier, and voltage amplifier. In addition, a review of circuit topologies suitable for energy, timing, and position information extraction was performed along with a summary of performance limitations and current challenges.

42 ENGINEERING↗

Phase evolution and structural modulation during in situ lithiation of MoS 2 , WS 2 and graphite in TEM

Li-ion batteries function by Li intercalating into and through the layered electrode materials. Intercalation is a solid-state interaction resulting in the formation of new phases. The new observations presented here reveal that at the nanoscale the intercalation mechanism is fundamentally different from the existing models and is actually driven by nonuniform phase distributions rather than the localized Li concentration: the lithiation process is a ‘distribution-dependent’ phenomena. Direct structure imaging of 2H and 1T dual-phase microstructures in lithiated MoS 2 and WS 2 along with the localized chemical segregation has been demonstrated in the current study. Li, a perennial challenge for the TEM, is detected and imaged using a low-dose, direct-electron detection camera on an aberration-corrected TEM and confirmed by image simulation. This study shows the presence of fully lithiated nanoscale domains of 2D host matrix in the vicinity of Li-lean regions. This confirms the nanoscale phase formation followed by Oswald ripening, where the less-stable smaller domains dissolves at the expense of the larger and more stable phases.

25 ENERGY STORAGE↗

Using AI Segmentation Models to Improve Foreign Body Detection and Triage from Ultrasound Images

Medical imaging can be a critical tool for triaging casualties in trauma situations. In remote or military medicine scenarios, triage is essential for identifying how to use limited resources or prioritize evacuation for the most serious cases. Ultrasound imaging, while portable and often available near the point of injury, can only be used for triage if images are properly acquired, interpreted, and objectively triage scored. Here, we detail how AI segmentation models can be used for improving image interpretation and objective triage evaluation for a medical application focused on foreign bodies embedded in tissues at variable distances from critical neurovascular features. Ultrasound images previously collected in a tissue phantom with or without neurovascular features were labeled with ground truth masks. These image sets were used to train two different segmentation AI frameworks: YOLOv7 and U-Net segmentation models. Overall, both approaches were successful in identifying shrapnel in the image set, with U-Net outperforming YOLOv7 for single-class segmentation. Both segmentation models were also evaluated with a more complex image set containing shrapnel, artery, vein, and nerve features. YOLOv7 obtained higher precision scores across multiple classes whereas U-Net achieved higher recall scores. Using each AI model, a triage distance metric was adapted to measure the proximity of shrapnel to the nearest neurovascular feature, with U-Net more closely mirroring the triage distances measured from ground truth labels. Overall, the segmentation AI models were successful in detecting shrapnel in ultrasound images and could allow for improved injury triage in emergency medicine scenarios.

47 OTHER INSTRUMENTATION↗

Haze Mitigation in High-Resolution Satellite Imagery using Enhanced Style-Transfer Neural Network and Normalization Across Multiple GPUs

Despite recent advances in deep learning approaches, haze mitigation in large satellite images is still a challenging problem. Due to amorphous nature of haze, object detection or image segmentation approaches are not applicable. Also it is practically infeasible to obtain ground truths for training. Bounded memory capacity of GPUs is another constraint that limits the size of image to be processed. In this paper, we propose a style transfer based neural network approach to mitigate haze in a large overhead imagery. The network is trained without paired ground truths; further, perception loss is added to restore vivid colors, enhance contrast and minimize artifacts. The paper also illustrates our use of multiple GPUs in a collective way to produce a single coherent clear image where each GPU dehazes different portions of a large hazy image.

Park, Byung↗

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗

Computer Vision: EO Imaging & Video Tasks, Metrics, and Datasets [Slides]

Classification is an assignment of an image to a certain category. Localization is identified by the box surrounding the object in the image. Object detection detects instances of semantic objects of a certain class. Semantic segmentation categorizes all the pixels of an image into classes of objects. Instance segmentation identifies each instance of each object in the image. Panoptic (i.e., showing or seeing everything at once) segmentation is a combination of semantic and instance segmentation and classifies all the pixels in the image.

97 MATHEMATICS AND COMPUTING↗

Implementation of heterodyne detection of radio frequency waves using phase contrast imaging

An upgrade to the DIII–D phase contrast imaging (PCI) diagnostic for detection of radio frequency waves has been implemented using low-noise optical heterodyning. Electro-optical modulation allows detection of waves with frequencies up to 500 MHz with wide flexibility restricted only by the driver electronics, with continuous adjustability up to 100 MHz and fixed frequency drivers needed for higher frequencies. The PCI diagnostic images the line-integrated plasma density fluctuations and provides absolutely calibrated measurements with good wavenumber resolution.

Rost, J. C. [Massachusetts Institute of Technology↗

Towards deep computer vision for in-line defect detection in polymer electrolyte membrane fuel cell materials

Polymer Electrolyte Membrane (PEM) fuel cells are a promising source of alternative energy. However, their production is limited by a lack of well-established methods for quality control of their constituent materials like the membrane-electrode assembly during roll-to-roll manufacturing. One potential solution is the implementation of deep learning methods to detect unwanted defects through their detection in scanned images. Here we explore the detection of defects like scratches, pinholes, and scuffs in a sample dataset of PEM optical images using two deep learning algorithms: Patch Distribution Modeling (PaDiM) for unsupervised anomaly detection and Faster-RCNN for supervised object detection. Both methods achieve scores on performance metrics (ROC-AUC and PRO-AUC for PaDiM and AP for Faster-RCNN) that are comparable to their scores on benchmark datasets. These methods also have the potential to detect a wider range of defects compared to IR thermography and previous optical inspection methods. Overall, deep learning shows promise at detecting relevant defects of interest and has the potential to achieve real-time defect detection.

30 DIRECT ENERGY CONVERSION↗

Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation

Deep learning architectures have achieved state-of-the-art (SOTA) performance on computer vision tasks such as object detection and image segmentation. This may be attributed to the use of over-parameterized, monolithic deep learning architectures executed on large datasets. Although such large architectures lead to increased accuracy, this is usually accompanied by a larger increase in computation and memory requirements during inference. While this is a non-issue in traditional machine learning (ML) pipelines, the recent confluence of machine learning and fields like the Internet of Things (IoT) has rendered such large architectures infeasible for execution in low-resource settings. For some datasets, large monolithic pipelines may be overkill for simpler inputs. To address this problem, previous efforts have proposed decision cascades where inputs are passed through models of increasing complexity until the desired performance is achieved. However, we argue that cascaded prediction leads to sub-optimal throughput and increased computational cost due to wasteful intermediate computations. To address this, we propose PaSeR (Parsimonious Segmentation with Reinforcement Learning) a non-cascading, cost-aware learning pipeline as an efficient alternative to cascaded decision architectures. Through experimental evaluation on both real-world and standard datasets, we demonstrate that PaSeR achieves better accuracy while minimizing computational cost relative to cascaded models. Further, we introduce a new metric IoU/GigaFlop to evaluate the balance between cost and performance. On the real-world task of battery material phase segmentation, PaSeR yields 179% improvement over SOTA MatPhase model and a 196% improvement over IDK Cascades under the IoU/GigaFlop metric. We also demonstrate PaSeR’s adaptability to complementary models trained on a noisy MNIST dataset, where it outperforms all baselines on IoU/GigaFlop by an average of 44%.

Srikshan, Bharat↗

Detection of defects in atomic-resolution images of materials using cycle analysis

The automated detection of defects in high-angle annular dark-field Z-contrast (HAADF) scanning-transmission-electron microscopy (STEM) images has been a major challenge. Here, we report an approach for the automated detection and categorization of structural defects based on changes in the material’s local atomic geometry. The approach applies geometric graph theory to the already-found positions of atomic-column centers and is capable of detecting and categorizing any defect in thin diperiodic structures (i.e., “2D materials”) and a large subset of defects in thick diperiodic structures (i.e., 3D or bulk-like materials). Despite the somewhat limited applicability of the approach in detecting and categorizing defects in thicker bulk-like materials, it provides potentially informative insights into the presence of defects. The categorization of defects can be used to screen large quantities of data and to provide statistical data about the distribution of defects within a material. This methodology is applicable to atomic column locations extracted from any type of high-resolution image, but here we demonstrate it for HAADF STEM images.

36 MATERIALS SCIENCE↗

FCIC FY18 LT-baseline Feedstock Images

Set of images taken during pilot plant dilute-acid hydrolysis preatreatment reactor operation. Images were taken with a GoPro Hero 5 with rectilinear lens facing downwards on a weigh-belt instrument. Image period was every 30 seconds during operation. This image set is connected to a journal article titled "Real-Time Biomass Feedstock Particle Quality Detection Using Image Analysis and Machine Vision", http://dx.doi.org/10.1007/s13399-020-00904-w.

09 BIOMASS FUELS↗

Holes in Optical Lightning Flashes: Identifying Poorly Transmissive Clouds in Lightning Imager Data

Space-based optical lightning sensors including the lightning imaging sensor (LIS) and geostationary lightning mapper (GLM) are pixelated imagers that detect lightning as transient increases in cloud top illumination. Detection requires optical emissions to escape the cloud top to space with sufficient energy to trigger a pixel on the imaging array. Through scattering and absorption, certain clouds are able to block most light from reaching the instrument, causing a reduction in detection efficiency (DE) and possibly location accuracy (LA). Radiant lightning emissions that illuminate large cloud top areas are used to examine scenarios where clouds block light from reaching orbit. In some cases, these anomalies in the spatial radiance distribution from the lightning pulse lead to “holes” in the optical lightning flash where certain pixels fail to trigger. Such holes are identified algorithmically in the Tropical Rainfall Measuring Mission satellite LIS record and the microphysical properties of the coincident storm region are queried. We find that holes primarily occur in tall (IR T b < 235 K) convection (87%) and overhanging anvil clouds (10%). The remaining 3% of holes occur in moderate-to-weak convection or in clear air breaks between stormclouds. We further demonstrate how an algorithm that assesses the spatial radiance patterns from energetic lightning pulses might be used to construct an optical transmission gridded stoplight product for GLM that could help operators identify clouds with a potentially reduced DE and LA.

54 ENVIRONMENTAL SCIENCES↗

Optical image analysis for graphene layer detection: Enhanced green channel methodology

Graphene, a material of increasing research interest, requires accurate layer identification due to its sensitivity to layer count. Existing methods for graphene layer number identification are either time-consuming or of low accuracy, with high-accuracy methods often requiring expensive processes. This paper aims to address this challenge by proposing a cost-effective and efficient approach. Specifically, the current work highlights only the green channel—one of the three primary color channels (red, green, blue) that make up an optical image—from images of exfoliated graphene flakes for layer count identification. A linear regression is performed between pixel position and substrate green channel value, and this effect is subtracted from the entire optical image to mitigate background effects. By storing the range of green channel values for each type of flake (monolayer, bilayer, or tri-layer) based on a few images, we establish thresholds for identifying different types of layers in a particular setup. Additionally, our methodology allows for flexible threshold tuning using a single reference image, enabling adjustment to changes in detection setup such as illumination level, magnification, or microscope used. Finally, demonstrating high accuracy and flexibility, this methodology presents a suitable technique for graphene layer number identification without the need for large datasets or expensive instruments.

2D materials↗

Enhanced detection of paramagnetic fluorine-19 magnetic resonance imaging agents using zero echo time sequence and compressed sensing

Fluorine-19 ( 19 F) magnetic resonance imaging (MRI) is an emerging technique offering specific detection of labeled cells in vivo. Lengthy acquisition times and modest signal-to-noise ratio (SNR) makes three-dimensional spin-density–weighted 19 F imaging challenging. Recent advances in tracer paramagnetic metallo-perfluorocarbon (MPFC) nanoemulsion probes have shown multifold SNR improvements due to an accelerated 19 F T 1 relaxation rate and a commensurate gain in imaging speed and averages. However, 19 F T 2 -reduction and increased linewidth limit the amount of metal additive in MPFC probes, thus constraining the ultimate SNR. To overcome these barriers, we describe a compressed sampling (CS) scheme, implemented using a “zero” echo time (ZTE) sequence, with data reconstructed via a sparsity-promoting algorithm. Our CS-ZTE scheme acquires k-space data using an undersampled spherical radial pattern and signal averaging. Image reconstruction employs off-the-shelf sparse solvers to solve a joint total variation and -norm regularized least square problem. To evaluate CS-ZTE, we performed simulations and acquired 19 F MRI data at 11.7 T in phantoms and mice receiving MPFC-labeled dendritic cells. For MPFC-labeled cells in vivo, we show SNR gains of ~6.3 × with 8-fold undersampling. We show that this enhancement is due to three mechanisms including undersampling and commensurate increase in signal averaging in a fixed scan time, denoising attributes from the CS algorithm, and paramagnetic reduction of T 1 . Importantly, 19 F image intensity analyses yield accurate estimates of absolute quantification of 19 F spins. Overall, the CS-ZTE method using MPFC probes achieves ultrafast imaging, a substantial boost in detection sensitivity, accurate 19 F spin quantification, and minimal image artifacts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗