Search NASA⌕ Search

SEARCH · Search NASA

Results for “Imaging & optical processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Single-molecule imaging of lignocellulose deconstruction by SCATTIRSTORM microscopy

The goal of this project is to build a multimodal optical microscope to measure the binding, processive degradation, and pausing behaviors of cellulases as they interact with and degrade both synthetic and naturally occurring lignocellulosic walls. To achieve this, we will use high spatio-temporal single-molecule imaging to track cellulases, while visualizing specific molecular components of cellulose, lignin and hemicellulose, that make up their lignocellulose substrate. The microscope will combine Interferometric Scattering (iSCAT), which provides unprecedented spatiotemporal resolution; Total Internal Reflection Fluorescence (TIRF), which provides single-molecule resolution of multiple fluorophore-labeled molecules; and Stochastic Reconstruction (STORM), which allows for three-dimensional super-resolution imaging of intact plant cell walls during degradation. Initial studies will investigate cellulase dynamics on in vitro-assembled cell wall analogs, and later work will progress to using native plant cell walls.

09 BIOMASS FUELS↗

Quantum optical classifier with superexponential speedup

Abstract Classification is a central task in deep learning algorithms. Usually, images are first captured and then processed by a sequence of operations, of which the artificial neuron represents one of the fundamental units. This paradigm requires significant resources that scale (at least) linearly in the image resolution, both in terms of photons and computational operations. Here, we present a quantum optical pattern recognition method for binary classification tasks. It classifies objects without reconstructing their images, using the rate of two-photon coincidences at the output of a Hong-Ou-Mandel interferometer, where both the input and the classifier parameters are encoded into single-photon states. Our method exhibits the behaviour of a classical neuron of unit depth. Once trained, it shows a constant $${{\mathcal{O}}}(1)$$ O ( 1 ) complexity in the number of computational operations and photons required by a single classification. This is a superexponential advantage over a classical artificial neuron.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Landsat Legacy

The Landsat resources survey system spawned a number of companies engaged in commercial applications of remote sensing, among them International Imaging Systems (I2S). With initial NASA assistance, I2S has provided remote sensing hardware and software to several foreign countries, developed meteorological analysis systems, medical diagnostic software and scanning equipment for government and commercial use. Latest product is an advanced image-based photogrammetric system employing digital technology - not optical or mechanical systems - to generate terrain elevation data and other processing functions. Called PRI2SM, it compensates automatically for topographic relief displacement, is cheaper, faster, and easier to use and maintain. Company product line includes four major areas: image processing equipment for Earth Resources Management; meteorological analysis systems; satellite ground processing systems; and digital photogrammetric mapping systems.

Source record↗

Examples of Current and Future Uses of Neural-Net Image Processing for Aerospace Applications

Feed forward artificial neural networks are very convenient for performing correlated interpolation of pairs of complex noisy data sets as well as detecting small changes in image data. Image-to-image, image-to-variable and image-to-index applications have been tested at Glenn. Early demonstration applications are summarized including image-directed alignment of optics, tomography, flow-visualization control of wind-tunnel operations and structural-model-trained neural networks. A practical application is reviewed that employs neural-net detection of structural damage from interference fringe patterns. Both sensor-based and optics-only calibration procedures are available for this technique. These accomplishments have generated the knowledge necessary to suggest some other applications for NASA and Government programs. A tomography application is discussed to support Glenn's Icing Research tomography effort. The self-regularizing capability of a neural net is shown to predict the expected performance of the tomography geometry and to augment fast data processing. Other potential applications involve the quantum technologies. It may be possible to use a neural net as an image-to-image controller of an optical tweezers being used for diagnostics of isolated nano structures. The image-to-image transformation properties also offer the potential for simulating quantum computing. Computer resources are detailed for implementing the black box calibration features of the neural nets.

Decker, Arthur J.↗

Compact Microscope Imaging System with Intelligent Controls

The figure presents selected views of a compact microscope imaging system (CMIS) that includes a miniature video microscope, a Cartesian robot (a computer- controlled three-dimensional translation stage), and machine-vision and control subsystems. The CMIS was built from commercial off-the-shelf instrumentation, computer hardware and software, and custom machine-vision software. The machine-vision and control subsystems include adaptive neural networks that afford a measure of artificial intelligence. The CMIS can perform several automated tasks with accuracy and repeatability . tasks that, heretofore, have required the full attention of human technicians using relatively bulky conventional microscopes. In addition, the automation and control capabilities of the system inherently include a capability for remote control. Unlike human technicians, the CMIS is not at risk of becoming fatigued or distracted: theoretically, it can perform continuously at the level of the best human technicians. In its capabilities for remote control and for relieving human technicians of tedious routine tasks, the CMIS is expected to be especially useful in biomedical research, materials science, inspection of parts on industrial production lines, and space science. The CMIS can automatically focus on and scan a microscope sample, find areas of interest, record the resulting images, and analyze images from multiple samples simultaneously. Automatic focusing is an iterative process: The translation stage is used to move the microscope along its optical axis in a succession of coarse, medium, and fine steps. A fast Fourier transform (FFT) of the image is computed at each step, and the FFT is analyzed for its spatial-frequency content. The microscope position that results in the greatest dispersal of FFT content toward high spatial frequencies (indicating that the image shows the greatest amount of detail) is deemed to be the focal position.

McDowell, Mark↗

Direct mechanistic connection between acoustic signals and melt pool morphology during laser powder bed fusion

Various nondestructive diagnostic techniques have been proposed for in situ process monitoring of laser powder bed fusion (LPBF), including melt pool pyrometry, whole-layer optical imaging, acoustic emission, atomic emission spectroscopy, high speed melt pool imaging, and thermionic emission. Correlations between these in situ monitoring signals and defect formation have been demonstrated with acoustic signals having been shown to predict pore formation with especially high confidence in recent machine learning studies. Here, in this work, time-resolved acoustic data are collected in both the conduction and keyhole welding regimes of LPBF-processed Ti-6Al-4V alloy. A non-dimensionalized Strouhal number analysis, used in whistle aeroacoustics, is applied to demonstrate that the acoustic signals recorded in the keyhole regimes can be directly associated with the vapor depression morphology. This mechanistic understanding developed from whistle aeroacoustics shows that acoustic monitoring during the LPBF process can provide a direct probe into the vapor depression dynamics and defect occurrence, especially in the keyhole regimes relevant to printing and defect formation.

36 MATERIALS SCIENCE↗

Sensitivity of Marine Warm Cloud Retrieval Statistics to Algorithm Choices: Examples from MODIS Collection 6

The optical and microphysical structure of warm boundary layer marine clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS (Moderate Resolution Imaging Spectroradiometer) on the NASA EOS Terra and Aqua platforms, simultaneous global/daily 1km retrievals of cloud optical thickness and effective particle size are provided, as well as the derived water path. In addition, the cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate effective radii results using the l.6, 2.1, and 3.7 ~m spectral channels. Cloud retrieval statistics are highly sensitive to how a pixel identified as being "notclear" by a cloud mask (e.g., the MOD35/MYD35 product) is determined to be useful for an optical retrieval based on a 1-D cloud model. The Collection 5 MODIS retrieval algorithm removed pixels associated with cloud'edges as well as ocean pixels with partly cloudy elements in the 250m MODIS cloud mask - part of the so-called Clear Sky Restoral (CSR) algorithm. Collection 6 attempts retrievals for those two pixel populations, but allows a user to isolate or filter out the populations via CSR pixel-level Quality Assessment (QA) assignments. In this paper, using the preliminary Collection 6 MOD06 product, we present global and regional statistical results of marine warm cloud retrieval sensitivities to the cloud edge and 250m partly cloudy pixel populations. As expected, retrievals for these pixels are generally consistent with a breakdown of the ID cloud model. While optical thickness for these suspect pixel populations may have some utility for radiative studies, the retrievals should be used with extreme caution for process and microphysical studies.

Platnick, Steven↗

An extended-source spatial acquisition process based on maximum likelihood criterion for planetary optical communications

This paper describes an extended-source spatial acquisition process based on the maximum likelihood criterion for interplanetary optical communications. The objective is to use the sun-lit Earth image as a receiver beacon and point the transmitter laser to the Earth-based receiver to establish a communication path. The process assumes the existence of a reference image. The uncertainties between the reference image and the received image are modeled as additive white Gaussian disturbances. It has been shown that the optimal spatial acquisition requires solving two nonlinear equations to estimate the coordinates of the transceiver from the received camera image in the transformed domain. The optimal solution can be obtained iteratively by solving two linear equations. Numerical results using a sample sun-lit Earth as a reference image demonstrate that sub-pixel resolutions can be achieved in a high disturbance environment. Spatial resolution is quantified by Cramer-Rao lower bounds.

Yan, Tsun-Yee↗

Optical computing.

Applications of the optical computer include an approach for increasing the sharpness of images obtained from the most powerful electron microscopes and fingerprint/credit card identification. The information-handling capability of the various optical computing processes is very great. Modern synthetic-aperture radars scan upward of 100,000 resolvable elements per second. Fields which have assumed major importance on the basis of optical computing principles are optical image deblurring, coherent side-looking synthetic-aperture radar, and correlative pattern recognition. Some examples of the most dramatic image deblurring results are shown.

Stroke, G. W.↗

Computational Ghost Imaging for Remote Sensing

This work relates to the generic problem of remote active imaging; that is, a source illuminates a target of interest and a receiver collects the scattered light off the target to obtain an image. Conventional imaging systems consist of an imaging lens and a high-resolution detector array [e.g., a CCD (charge coupled device) array] to register the image. However, conventional imaging systems for remote sensing require high-quality optics and need to support large detector arrays and associated electronics. This results in suboptimal size, weight, and power consumption. Computational ghost imaging (CGI) is a computational alternative to this traditional imaging concept that has a very simple receiver structure. In CGI, the transmitter illuminates the target with a modulated light source. A single-pixel (bucket) detector collects the scattered light. Then, via computation (i.e., postprocessing), the receiver can reconstruct the image using the knowledge of the modulation that was projected onto the target by the transmitter. This way, one can construct a very simple receiver that, in principle, requires no lens to image a target. Ghost imaging is a transverse imaging modality that has been receiving much attention owing to a rich interconnection of novel physical characteristics and novel signal processing algorithms suitable for active computational imaging. The original ghost imaging experiments consisted of two correlated optical beams traversing distinct paths and impinging on two spatially-separated photodetectors: one beam interacts with the target and then illuminates on a single-pixel (bucket) detector that provides no spatial resolution, whereas the other beam traverses an independent path and impinges on a high-resolution camera without any interaction with the target. The term ghost imaging was coined soon after the initial experiments were reported, to emphasize the fact that by cross-correlating two photocurrents, one generates an image of the target. In CGI, the measurement obtained from the reference arm (with the high-resolution detector) is replaced by a computational derivation of the measurement-plane intensity profile of the reference-arm beam. The algorithms applied to computational ghost imaging have diversified beyond simple correlation measurements, and now include modern reconstruction algorithms based on compressive sensing.

Erkmen, Baris I.↗

Early High-contrast Imaging Results with Keck/NIRC2-PWFS: The SR 21 Disk

High-contrast imaging of exoplanets and protoplanetary disks depends on wave front sensing and correction made by adaptive optics instruments. Classically, wave front sensing has been conducted at optical wavelengths, which made high-contrast imaging of red targets such as M-type stars or extincted T Tauri stars challenging. Keck/NIRC2 has combined near-infrared (NIR) detector technology with the pyramid wave front sensor (PWFS). With this new module we observed SR 21, a young star that is brighter at NIR wavelengths than at optical wavelengths. Compared with the archival data of SR 21 taken with the optical wave front sensing we achieved ~20% better Strehl ratio in similar natural seeing conditions. Further post-processing utilizing angular differential imaging and reference-star differential imaging confirmed the spiral feature reported by the Very Large Telescope/Spectro-Polarimetric High-contrast Exoplanet REsearch instrument polarimetric observation, which is the first detection of the SR 21 spiral in total intensity at L' band. We also compared the contrast limit of our result (10 -4 at 0.'4 and 2 × 10 -5 at 1.'0) with the archival data that were taken with optical wave front sensing and confirmed the improvement, particularly at ≤0.'5. Our observation demonstrates that the NIR PWFS improves AO performance and will provide more opportunities for red targets in the future.

79 ASTRONOMY AND ASTROPHYSICS↗

Multipurpose active scanning probe cantilevers for near-field spectroscopy, scanning tunnel imaging, and atomic-resolution lithography

In this work, we report progress on developing a multipurpose scanning probe cantilever applying gallium nitride nanowires as the probe tip. Gallium nitride nanowires possess high potential as probes due to their straight profile, tunable electrical and optical properties, high Young’s Modulus, durability, and high-yield fabrication process. Their wide bandgap enables them to be pumped to emit ultraviolet pulses which can be used for optical imaging and spectroscopy. They can be doped during growth to be electrically conductive, and their sharp tips obtained during epitaxial growth enable confinement of a high electric field at tip–sample interface. Their sharp tips are obtained during fabrication by their epitaxial growth which eliminates the need for postprocess sharpening that is typically required for standard STM tips. We present results of using gallium nitride nanowires for scanning tunnel microscopy applications of atomic-resolution imaging and lithography, and atomic force microscopy applications of imaging and lithography in vacuum and atmospheric environments.

Engineering↗

Temporal Interpolation of Geostationary Satellite Imagery With Optical Flow

Applications of satellite data in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on the tradeoffs to spatial, spectral, and temporal resolutions of observations. In weather tracking, high-frequency temporal observations are critical and used to improve forecasts, study severe events, and extract atmospheric motion, among others. However, while the current generation of geostationary (GEO) satellites has hemispheric coverage at 10-15-min intervals, higher temporal frequency observations are ideal for studying mesoscale severe weather events. In this work, we present a novel application of deep learning-based optical flow to temporal upsampling of GEO satellite imagery. We apply this technique to 16 bands of the GOES-R/Advanced Baseline Imager mesoscale dataset to temporally enhance full-disk hemispheric snapshots of different spatial resolutions from 10 to 1 min. Experiments show the effectiveness of task-specific optical flow and multiscale blocks for interpolating high-frequency severe weather events relative to bilinear and global optical flow baselines. Finally, we demonstrate strong performance in capturing variability during convective precipitation events.

Image processing↗

Accelerated Adaptive MGS Phase Retrieval

The Modified Gerchberg-Saxton (MGS) algorithm is an image-based wavefront-sensing method that can turn any science instrument focal plane into a wavefront sensor. MGS characterizes optical systems by estimating the wavefront errors in the exit pupil using only intensity images of a star or other point source of light. This innovative implementation of MGS significantly accelerates the MGS phase retrieval algorithm by using stream-processing hardware on conventional graphics cards. Stream processing is a relatively new, yet powerful, paradigm to allow parallel processing of certain applications that apply single instructions to multiple data (SIMD). These stream processors are designed specifically to support large-scale parallel computing on a single graphics chip. Computationally intensive algorithms, such as the Fast Fourier Transform (FFT), are particularly well suited for this computing environment. This high-speed version of MGS exploits commercially available hardware to accomplish the same objective in a fraction of the original time. The exploit involves performing matrix calculations in nVidia graphic cards. The graphical processor unit (GPU) is hardware that is specialized for computationally intensive, highly parallel computation. From the software perspective, a parallel programming model is used, called CUDA, to transparently scale multicore parallelism in hardware. This technology gives computationally intensive applications access to the processing power of the nVidia GPUs through a C/C++ programming interface. The AAMGS (Accelerated Adaptive MGS) software takes advantage of these advanced technologies, to accelerate the optical phase error characterization. With a single PC that contains four nVidia GTX-280 graphic cards, the new implementation can process four images simultaneously to produce a JWST (James Webb Space Telescope) wavefront measurement 60 times faster than the previous code.

Lam, Raymond K.↗

Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). A description of the sensor, ground data processing facility, laboratory calibration, and first results

The papers in this document were presented at the Imaging Spectroscopy 2 Conference of the 31st International Symposium on Optical and Optoelectronic Applied Science and Engineering, in San Diego, California, on 20 and 21 August 1987. They describe the design and performance of the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) sensor and its subsystems, the ground data processing facility, laboratory calibration, and first results.

Vane, Gregg↗

Accelerated Stress Testing of Perovskite Photovoltaic Modules: Differentiating Degradation Modes with Electroluminescence Imaging

Herein, electroluminescence (EL) and thermal imaging are used to examine p–i–n metal halide perovskite (MHP) photovoltaic (PV) mini-modules (MA0.6FA0.4PbI3, 20 cells, 78 cm2) before and after indoor-accelerated stress testing or outdoor deployment. Distinct spatial patterns in the EL images emerge, which depend on the external stress conditions experienced by the mini-module. Imaging results highlight a distribution of dark speckle features that dominate after UV stress, attributed to widespread interfacial contact degradation. Lateral intensity gradients across cells dominate after thermal cycling (TC) stress, attributed to current crowding near scribe defects. While current–voltage analysis alone does not give full insight on the degradation process, this study shows that distinct degradation modes can be further defined by multimodal electro-optical imaging (i.e., EL combined with photoluminescence and dark lock-in thermography). Neither UV exposure nor TC-accelerated stress testing alone replicates the same degradation signatures observed after outdoor deployment, suggesting that multiple degradation modes occur under concurrent stressors outdoors. Finally, spatial characterization of degradation modes in MHP PV mini-modules before and after accelerated stress testing lays the groundwork for developing targeted accelerated stress testing procedures through comparison with outdoor aging.

14 SOLAR ENERGY↗

3D nanolithography with metalens arrays and spatially adaptive illumination

The growing demand for advanced materials, miniaturized devices and integrated microsystems calls for the reliable fabrication of complex, multiscale, three-dimensional (3D) architectures, a need increasingly addressed through light-based and laser-based processes. However, owing to the field-of-view (FOV) limitations of conventional imaging optics, existing 3D laser nanofabrication techniques face fundamental challenges in throughput, proximity error and stitching defects on the path to scaling. Here, in this study, we present a scalable 3D nanofabrication platform that uses a metalens-generated focal spot array to parallelize two-photon lithography (TPL) beyond centimetre-scale write field areas. Metalenses are ideally suited for producing submicron-scale focal spots for high-throughput nanolithography, as they uniquely feature large numerical apertures (NAs), immersion media compatibility and large-scale manufacturability. We experimentally demonstrate a printing system that uses a 12-cm 2 metalens array to produce more than 120,000 cooperative focal spots, corresponding to a throughput exceeding 10 8 voxels s −1 . By programmatically patterning the focal spot array using a spatial light modulator (SLM), an adaptive parallel printing strategy is developed for precise greyscale linewidth modulation and choreographed printing of semiperiodic and fully aperiodic 3D geometries. We demonstrate parallel printing of replicated microstructures (>50 M microparticles per day), centimetre-scale 3D architectures with feature sizes down to 113 nm, and photonic and mechanical metamaterials. This work demonstrates the potential of 3D nanolithography towards wafer-scale production, showing how TPL could be used at scale for applications in microelectronics, biomedicine, quantum technology and high-energy laser targets.

Materials science↗

Optical correlators for automated rendezvous and capture

The paper begins with a description of optical correlation. In this process, the propagation physics of coherent light is used to process images and extract information. The processed image is operated on as an area, rather than as a collection of points. An essentially instantaneous convolution is performed on that image to provide the sensory data. In this process, an image is sensed and encoded onto a coherent wavefront, and the propagation is arranged to create a bright spot of the image to match a model of the desired object. The brightness of the spot provides an indication of the degree of resemblance of the viewed image to the mode, and the location of the bright spot provides pointing information. The process can be utilized for AR&C to achieve the capability to identify objects among known reference types, estimate the object's location and orientation, and interact with the control system. System characteristics (speed, robustness, accuracy, small form factors) are adequate to meet most requirements. The correlator exploits the fact that Bosons and Fermions pass through each other. Since the image source is input as an electronic data set, conventional imagers can be used. In systems where the image is input directly, the correlating element must be at the sensing location.

Juday, Richard D.↗