Search NASA⌕ Search

SEARCH · Search NASA

Results for “imagers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects

Abstract Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

47 OTHER INSTRUMENTATION↗

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

47 OTHER INSTRUMENTATION↗

Overview of the DESI Legacy Imaging Surveys

The DESI Legacy Imaging Surveys (http://legacysurvey.org/) are a combination of three public projects (the Dark Energy Camera Legacy Survey, the Beijing–Arizona Sky Survey, and the Mayall z-band Legacy Survey) that will jointly image ≈14,000 deg{sup 2} of the extragalactic sky visible from the northern hemisphere in three optical bands (g, r, and z) using telescopes at the Kitt Peak National Observatory and the Cerro Tololo Inter-American Observatory. The combined survey footprint is split into two contiguous areas by the Galactic plane. The optical imaging is conducted using a unique strategy of dynamically adjusting the exposure times and pointing selection during observing that results in a survey of nearly uniform depth. In addition to calibrated images, the project is delivering a catalog, constructed by using a probabilistic inference-based approach to estimate source shapes and brightnesses. The catalog includes photometry from the grz optical bands and from four mid-infrared bands (at 3.4, 4.6, 12, and 22 μm) observed by the Wide-field Infrared Survey Explorer satellite during its full operational lifetime. The project plans two public data releases each year. All the software used to generate the catalogs is also released with the data. This paper provides an overview of the Legacy Surveys project.

79 ASTRONOMY AND ASTROPHYSICS↗

Extracting the Subhalo Mass Function from Strong Lens Images with Image Segmentation

Abstract Detecting substructure within strongly lensed images is a promising route to shed light on the nature of dark matter. However, it is a challenging task, which traditionally requires detailed lens modeling and source reconstruction, taking weeks to analyze each system. We use machine learning to circumvent the need for lens and source modeling and develop a neural network to both locate subhalos in an image as well as determine their mass using the technique of image segmentation. The network is trained on images with a single subhalo located near the Einstein ring across a wide range of apparent source magnitudes. The network is then able to resolve subhalos with masses m ≳ 10 8.5 M ⊙ . Training in this way allows the network to learn the gravitational lensing of light, and, remarkably, it is then able to detect entire populations of substructure, even for locations further away from the Einstein ring than those used in training. Over a wide range of the apparent source magnitude, the false-positive rate is around three false subhalos per 100 images, coming mostly from the lightest detectable subhalo for that signal-to-noise ratio. With good accuracy and a low false-positive rate, counting the number of pixels assigned to each subhalo class over multiple images allows for a measurement of the subhalo mass function (SMF). When measured over three mass bins from 10 9 –10 10 M ⊙ the SMF slope is recovered with an error of 36% for 50 images, and this improves to 10% for 1000 images with Hubble Space Telescope-like noise.

79 ASTRONOMY AND ASTROPHYSICS↗

APPLEPIPS /Apple Personal Image Processing System/ - An interactive digital image processing system for the Apple II microcomputer

Recent developments related to microprocessor-based personal computers have made low-cost digital image processing systems a reality. Image analysis systems built around these microcomputers provide color image displays for images as large as 256 by 240 pixels in sixteen colors. Descriptive statistics can be computed for portions of an image, and supervised image classification can be obtained. The systems support Basic, Fortran, Pascal, and assembler language. A description is provided of a system which is representative of the new microprocessor-based image processing systems currently on the market. While small systems may never be truly independent of larger mainframes, because they lack 9-track tape drives, the independent processing power of the microcomputers will help alleviate some of the turn-around time problems associated with image analysis and display on the larger multiuser systems.

Masuoka, E.↗

Laboratory demonstration of image reconstruction for coherent optical system of modular imaging collectors (COSMIC)

The first physical demonstration of the principle of image reconstruction using a set of images from a diffraction-blurred elongated aperture is reported. This is an optical validation of previous theoretical and numerical simulations of the COSMIC telescope array (coherent optical system of modular imaging collectors). The present experiment utilizes 17 diffraction blurred exposures of a laboratory light source, as imaged by a lens covered by a narrow-slit aperture; the aperture is rotated 10 degrees between each exposure. The images are recorded in digitized form by a CCD camera, Fourier transformed, numerically filtered, and added; the sum is then filtered and inverse Fourier transformed to form the final image. The image reconstruction process is found to be stable with respect to uncertainties in values of all physical parameters such as effective wavelength, rotation angle, pointing jitter, and aperture shape. Future experiments will explore the effects of low counting rates, autoguiding on the image, various aperture configurations, and separated optics.

Traub, W. A.↗

Combined optimization of image-gathering and image-processing systems for scene feature detection

The relationship between the image gathering and image processing systems for minimum mean squared error estimation of scene characteristics is investigated. A stochastic optimization problem is formulated where the objective is to determine a spatial characteristic of the scene rather than a feature of the already blurred, sampled and noisy image data. An analytical solution for the optimal characteristic image processor is developed. The Wiener filter for the sampled image case is obtained as a special case, where the desired characteristic is scene restoration. Optimal edge detection is investigated using the Laplacian operator x G as the desired characteristic, where G is a two dimensional Gaussian distribution function. It is shown that the optimal edge detector compensates for the blurring introduced by the image gathering optics, and notably, that it is not circularly symmetric. The lack of circular symmetry is largely due to the geometric effects of the sampling lattice used in image acquisition. The optimal image gathering optical transfer function is also investigated and the results of a sensitivity analysis are shown.

Halyo, Nesim↗

Image interpretation and prediction in microwave diversity imaging

The microwave image of a metallic object is interpreted from a point of view based on the understanding of the interconnection between the scattering mechanisms, the data acquisition system, and the image reconstruction algorithm. From this understanding it is possible to interpret and predict microwave images reconstructed from data collected over specified and angular windows. The connection between a special scattering mechanism, edge diffraction, and its reconstructed image is established. The microwave image of an edge is two bright points whose locations correspond to the end points of the edge if the normal aspect angle is not included in the angular windows; otherwise a line joining the two end points and representing the edge will appear in the image. Experimental images of a trihedral reflector constructed from data collected over different angular windows support this approach to image interpretation and prediction.

Li, Hsueh-Jyh↗

On the possibility of a significant improvement in the quality of a quantum ghost image by registering an additional image in the object channel

A modification of the classical scheme of the quantum ghost image formation is considered, in which an image of the object under study is formed and recorded in the object channel. This image is used together with the ghost image to construct an estimate of the transparency distribution of the object. It is shown that this technique reduces the image quality worsening associated with the non-unit quantum efficiency of the sensors, even when the quantum image obtained in the object channel is additionally distorted by noise due to photons that did not interact with the object. (image processing)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mapping Benthic Habitat Conditions and Seafloor Deposits using Sediment Profile Imaging and a Semiautomated Image Processing System

Objectives/Scope: Sediment profile imaging (SPI) technology characterizes in situ physical, geochemical, and biological seafloor features. SPI was required by Mexico’s Agency for Safety, Energy, and Environment in 2017 for environmental baseline surveys (EBS) of oil lease blocks in the southern Gulf of Mexico. Because of its ability to provide information on benthic community health and the distribution of very thin (down to the centimeter scale) layers of deposited materials, SPI technology is highly effective for mapping drill cuttings or drilling muds released around wellheads during exploration or production and documenting their ecological impacts. SPI technology has not been widely used in the oil and gas industry for EBS or other monitoring activities. A primary objective of this work is to improve the transparency and consistency of the SPI data generation and data management process. Methods, Procedures, Process: The SPI camera works like an inverted periscope and obtains an undisturbed 21x15-cm cross-sectional image of the upper sediment column. The camera is internally powered and can be deployed rapidly from a standard winch in depths to 4,000 m. Many stations can be sampled in a single day by “pogo-sticking” across a survey area. Sediment grain size, penetration depth, surface boundary roughness, natural and anthropogenic depositional layers, depth of the oxidized surface sediment layer, maximum biogenic mixing depth, and infaunal successional stage can be directly measured at sea or immediately following the cruise. Final SPI data sets can be provided within a few weeks of the survey. Results, Observations, Conclusions: Details on the features measured in SPI images and the underlying interpretive paradigms are presented. To standardize the SPI data generation process, Integral Consulting Inc. has developed 1) a semiautomated image analysis platform, and 2) a SPI data-specific database architecture that allows both numerical and non-numerical metrics to be incorporated into a standard database structure. An integrated, software-based SPI analysis platform has been developed that imports image files and metadata and provides a graphical user interface. The software automatically stores the data, which can then be reviewed for quality assurance, plotted, statistically analyzed, and mapped or exported to other platforms (e.g., Esri ArcGIS©) for further evaluation. Image processing algorithms have been developed using a combination of open-source and commercially available software packages (e.g., MATLAB® and OpenCV) to automatically quantify key parameters. Novel/Additive Information: SPI technology’s underutilization in the oil and gas industry may be in part due to a lack of standardization in the measurement of basic features in SPI images. A primary objective of this work is to develop a streamlined, standardized, and transparent process for generating and managing SPI data.

02 PETROLEUM↗

Image Navigation and Registration Performance Assessment Tool Set for the GOES-R Advanced Baseline Imager and Geostationary Lightning Mapper

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. For ABI, these metrics are the 3-sigma errors in navigation (NAV), channel-to-channel registration (CCR), frame-to-frame registration (FFR), swath-to-swath registration (SSR), and within frame registration (WIFR) for the Level 1B image products. For GLM, the single metric of interest is the 3-sigma error in the navigation of background images (GLM NAV) used by the system to navigate lightning strikes. 3-sigma errors are estimates of the 99.73rd percentile of the errors accumulated over a 24-hour data collection period. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24-hour evaluation period. Another aspect of the IPATS design that vastly reduces execution time is the off-line propagation of Landsat based truth images to the fixed grid coordinates system for each of the three GOES-R satellite locations, operational East and West and initial checkout locations. This paper describes the algorithmic design and implementation of IPATS and provides preliminary test results.

Image Navigation↗

Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for the GOES-R Advanced Baseline Imager and Geostationary Lightning Mapper

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. For ABI, these metrics are the 3-sigma errors in navigation (NAV), channel-to-channel registration (CCR), frame-to-frame registration (FFR), swath-to-swath registration (SSR), and within frame registration (WIFR) for the Level 1B image products. For GLM, the single metric of interest is the 3-sigma error in the navigation of background images (GLM NAV) used by the system to navigate lightning strikes. 3-sigma errors are estimates of the 99.73rd percentile of the errors accumulated over a 24 hour data collection period. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. Another aspect of the IPATS design that vastly reduces execution time is the off-line propagation of Landsat based truth images to the fixed grid coordinates system for each of the three GOES-R satellite locations, operational East and West and initial checkout locations. This paper describes the algorithmic design and implementation of IPATS and provides preliminary test results.

Image Registration↗

Fusion Imaging to Guide Thoracic Endovascular Aortic Repair (TEVAR): A Randomized Comparison of Two Methods, 2D/3D Versus 3D/3D Image Fusion

Purpose: To compare the accuracy of two-dimensional (2D) versus three-dimensional (3D) image fusion for thoracic endovascular aortic repair (TEVAR) image guidance. Materials and Methods: Between December 2016 and March 2018, all eligible patients who underwent TEVAR were prospectively included in a single-center study. Image fusion methods (2D/3D or 3D/3D) were randomly assigned to guide each TEVAR and compared in terms of accuracy, dose area product (DAP), volume of contrast medium injected, fluoroscopy time and procedure time. Results: Thirty-two patients were prospectively included; 18 underwent 2D/3D and 14 underwent 3D/3D TEVAR. The 3D/3D method allowed more accurate positioning of the aortic mask on top of the fluoroscopic images (proximal landing zone error vector: 1.7 ± 3.3 mm) than was achieved by the 2D/3D method (6.1 ± 6.1 mm; p = 0.03). The 3D/3D image fusion method was associated with significantly lower DAP than the 2D/3D method (50.5 ± 30.1 Gy cm{sup 2} for 3D/3D vs. 99.5 ± 79.1 Gy cm{sup 2} for 2D/3D; p = 0.03). The volume of contrast medium injected was significantly lower for the 3D/3D method than for the 2D/3D method (50.6 ± 22.9 ml vs. 98.4 ± 47.9 ml; p = 0.002). Conclusion: Higher image fusion accuracy and lower contrast volume and irradiation dose were observed for 3D/3D image fusion than for 2D/3D during TEVAR. Level of Evidence: II, Randomized trial.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Gamma-ray imaging of Np-237 metal using an organic glass imager

Neutron and gamma-ray imaging systems are deployed within the field of nuclear safeguards for the detection and localization of special nuclear materials and other materials of interest. 237 Np is one of these materials of interest due its presence in spent nuclear fuel and potential for use in nuclear weapons when purified. Here, for the first time, a 6 kg neptunium sphere (98.8 wt% 237 Np) was measured using a dual-particle imager, from the University of Michigan, consisting of organic glass and inorganic scintillators. The novel composition of organic glass scintillator was recently developed at Sandia National Labs and has been used in particle imaging systems due to its time resolution and particle discrimination capabilities. Gamma-ray energy spectra from single and coincident events were extracted and the sequencing of Compton scatter and photoelectric absorption gamma-ray events was used to generate images using simple backprojection. The emissions of interest in this work are the 312 keV and 416 keV gamma rays from 233 Pa, a daughter isotope from the neptunium decay series. The results of this work show that there is close agreement between the true source location in angular space and the converged location from the gamma ray images created using the system. The gamma spectroscopy from single and coincident events also identified the characteristic emission from the daughter isotope and could be used to assist with the identification of 237 Np. Furthermore, successful localization of the source with 5 s of data demonstrates the practical application of the imaging system for imaging and detection of material in weapons-useable quantities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Imaging from Macro to Nanoscale: Multimodal Advances in Chemical and Biomedical Imaging

Imaging increasingly serves as a multiscale framework for linking molecular mechanisms to cellular behavior, tissue architecture, and organ phenotypes in biology and unraveling fundamental processes in chemistry, physics and materials science. This Perspective highlights recent advances in chemical and biomedical imaging across macro-, micro-, and nanoscales, using representative examples published in Chemical and Biomedical Imaging (CBMI). At the macroscale, we discuss chemically selective MRI, including endogenous and exogenous CEST strategies, together with photoacoustic imaging as a hybrid modality with functional and chemical contrast. At the microscale, we consider fluorescence, label-free optical and vibrational imaging, and selected X-ray approaches that expand sensitivity, specificity, and temporal resolution in biological and materials systems. At the nanoscale, we highlight super-resolution fluorescence microscopy, single-molecule methods, tip-enhanced Raman spectroscopy, and correlative imaging strategies that resolve local heterogeneity and molecular organization. Across scales, a common theme emerges that advances in probes, contrast mechanisms, instrumentation, and sample handling are enabling chemically informed imaging that connects molecular specificity with biological context.

multiscale imaging↗

FIRM image analysis: A machine learning workflow for quantifying extracellular matrix components from electron microscopy images

The extracellular matrix (ECM) is a complex network of biomolecules that plays an integral role in the structure, processes, and signaling mechanisms of cells and tissues. Identifying and quantifying changes in these matrix components provides insight into the mechanisms behind specific tissue remodeling processes; however, quantifying these changes is challenging due to difficult imaging conditions, complexity of the ECM, and the subtlety of these changes. Current imaging techniques allow us to visualize these critical remodeling events and developments in image analysis have employed a combination of analysis software and machine learning techniques to improve the efficiency and accuracy with which features are measured. Although image analysis has seen much improvement in recent years, there has been no technique developed to address ambiguity in feature edges in electron microscopy images. Presented here is a new machine learning-based workflow for the analysis of microscopy images named FIRM (Feature Identification from Raw Microscopy) that uses a random forest classifier to identify ECM features of interest and generate binary segmentation masks for quantification with ImageJ-FIJI. FIRM performed with an F1 score of 0.794 and greater than 80% accuracy for number and size of features detected. FIRM had similar deviation from the ground truth in the number of identified fibrils, fibril size, and size distributions when compared to human analyses. The results suggest that FIRM performs as well as manual analysis and requires a fraction of the time. This analysis technique is more efficient, eliminates user bias, and can be easily optimized to identify a variety of features, making it useful for any discipline requiring image analysis.

Science & Technology - Other Topics↗

High compression image and image sequence coding

The digital representation of an image requires a very large number of bits. This number is even larger for an image sequence. The goal of image coding is to reduce this number, as much as possible, and reconstruct a faithful duplicate of the original picture or image sequence. Early efforts in image coding, solely guided by information theory, led to a plethora of methods. The compression ratio reached a plateau around 10:1 a couple of years ago. Recent progress in the study of the brain mechanism of vision and scene analysis has opened new vistas in picture coding. Directional sensitivity of the neurones in the visual pathway combined with the separate processing of contours and textures has led to a new class of coding methods capable of achieving compression ratios as high as 100:1 for images and around 300:1 for image sequences. Recent progress on some of the main avenues of object-based methods is presented. These second generation techniques make use of contour-texture modeling, new results in neurophysiology and psychophysics and scene analysis.

Kunt, Murat↗