Search NASA⌕ Search

SEARCH · Search NASA

Results for “image formation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Sensitivity of back‐projection algorithm (BPA) synthetic aperture radar (SAR) image formation to initial position, velocity, and attitude navigation errors

Abstract The Back‐Projection Algorithm (BPA) is a time‐domain‐matched filtering technique to form synthetic aperture radar (SAR) images. To produce high‐quality BPA images, precise navigation data for the radar platform must be known. Errors in position, velocity, or attitude result in improperly formed images that are corrupted by shifting and blurring. The contribution of this paper is the development of analytical expressions that characterise the relationship between navigation errors and image formation errors from an inertial navigation point of view, where trajectory estimation errors in position, velocity, and attitude propagate through time and cause compounding errors in the vehicle state vector. These analytical expressions are verified via simulated image formation and real‐data image formation.

Lindstrom, Colton↗

Pre-trained network-based transfer learning: A small-sample machine learning approach to nuclear power plant classification problem

Some research topics belonging to classification problems in the nuclear industry, such as fault diagnosis and accident identification, can be solved by feature extraction and subsequent application of statistical machine learning classifiers. Recently, deep neural network-based methods with automatic feature extraction and high accuracy have gained wide attention. They usually require large-scale training data, however, plant fault or accident data are scarce or difficult to obtain. Here this paper proposes a convolutional network (CNN)-based transfer learning method to solve this problem. The network's shallow layer is derived from a pre-trained CNN based on the ImageNet database to automatically extract features, and the deep layer is customized to match the classification problem. Data in non-image formats are converted to image formats and subsequently used to train the network. Case studies of rotating machines fault diagnosis show that the proposed method requires only limited training data to achieve high accuracy.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗

Inorganic semiconductor quantum dots as a saturated excitation (SAX) probe for subdiffraction imaging

The photoluminescence (PL) saturation of CdSe/ZnS core/shell inorganic semiconductor quantum dots (QDs) and its utility as a probe for saturated excitation (SAX) microscopy are reported. Under saturating excitation power densities, the PL signal was demodulated and recorded at harmonics of the fundamental frequency. For commercially available Qdot® 655 ITK™ QDs, the power density required to achieve saturation was dependent upon the local environment of the QDs. For QDs deposited and dried on a glass substrate, the excitation power density required for PL saturation was less than 1 kW/cm 2 . Compared to this, saturation of PL for QDs dispersed in water required an excitation power density greater than 200 kW/cm 2 . This observation is manifested as a limitation in the imaging of hydrated samples, as demonstrated for HeLa cells labelled with biotinylated-phalloidin followed by labelling with streptavidin-coated QDs. Finally as saturation affects the obtained spatial resolution in several imaging formats, including confocal imaging, the provided data will aid in obtaining the optimal spatial resolution when using QD probes to image biological samples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Super-resolution computational saturated absorption microscopy

Imaging beyond the diffraction limit barrier has attracted wide attention due to the ability to resolve previously hidden image features. Of the various super-resolution microscopy techniques available, a particularly simple method called saturated excitation microscopy (SAX) requires only simple modification of a laser scanning microscope: The illumination beam power is sinusoidally modulated and driven into saturation. SAX images are extracted from the harmonics of the modulation frequency and exhibit improved spatial resolution. Unfortunately, this elegant strategy is hindered by the incursion of shot noise that prevents high-resolution imaging in many realistic scenarios. Here, we demonstrate a technique for super-resolution imaging that we call computational saturated absorption (CSA) in which a joint deconvolution is applied to a set of images with diversity in spatial frequency support among the point spread functions (PSFs) used in the image formation with saturated laser scanning fluorescence microscopy. CSA microscopy allows access to the high spatial frequency diversity in a set of saturated effective PSFs, while avoiding image degradation from shot noise.

Murray, Gabe (ORCID:0000000295655485)↗

Imaging plasma formation in isolated nanoparticles with ultrafast resonant scattering

We have recorded the diffraction patterns from individual xenon clusters irradiated with intense extreme ultraviolet pulses to investigate the influence of light-induced electronic changes on the scattering response. The clusters were irradiated with short wavelength pulses in the wavelength regime of different 4d inner-shell resonances of neutral and ionic xenon, resulting in distinctly different optical properties from areas in the clusters with lower or higher charge states. The data show the emergence of a transient structure with a spatial extension of tens of nanometers within the otherwise homogeneous sample. Simulations indicate that ionization and nanoplasma formation result in a light-induced outer shell in the cluster with a strongly altered refractive index. The presented resonant scattering approach enables imaging of ultrafast electron dynamics on their natural timescale.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Coastal Typologies: Methods for Improving Representation of Arctic Coastal Environments, Starting with Alaska's Northern Slope [Slides]

The objectives of the project included: Broaden QGIS (mapping) and Python (data analysis) skill set; Contribute to overall development of coastal typologies by conducting data mining and analysis; Expand scientific literacy; Narrow data sources to those most useful for project; Convert chosen data sets into image formats for analysis; and, Utilize python to analyze images.

58 GEOSCIENCES↗

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Atomic Resolution Imaging of Light Elements in a Crystalline Environment using Dynamic Hollow-Cone Illumination Transmission Electron Microscopy

Multiple electron scattering and the nonintuitive nature of image formation with coherent radiation complicate the interpretation of conventional transmission electron microscopy images. Precession of the illuminating beam in transmission electron microscopy (TEM) can lead to more robust and interpretable images with some penalty to image contrast, a technique known as dynamic hollow-cone illumination TEM. Here, we demonstrate direct and robust imaging of light and heavy atoms in a crystalline environment with this technique. This method is similar to the annular bright-field technique in scanning transmission electron microscopy, via the principle of reciprocity. Dynamic hollow-cone illumination TEM is challenging in practice due to sensitivity to the misalignment of the precession axis, microscope objective aperture, and crystal zone axis.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Zero-Power Analog Optical Processing

The motivation behind this research is the growing challenge of handling the massive amounts of data generated by modern imaging systems. Conventional digital image processing techniques are struggling to keep pace with the demands of high-resolution and high-speed imaging systems for remote sensing due to their high-power consumption and data storage requirements. We present a novel approach based on analog photonics to address this challenge. The proposed system utilizes a silicon-photonics-based image encoder positioned after image formation and initial optical-to-electrical conversion. The photonic encoder compresses image data using a passive disordered photonic structure to perform kernel-type random projections of the raw data. The compressed data is then processed by a back-end neural network, which reconstructs the original image with high fidelity (structural similarity exceeding 90%). Our proposed approach has the potential to compress images with ~ 1000X lower power consumption compared to digital approaches with data rates exceeding 1 terapixel/second.

97 MATHEMATICS AND COMPUTING↗

Automatic Image Point Matching

Sparse Image Point Matching (SIPM) is a foundational technology for photo triangulation, structure from motion (SfM), Simultaneous Location and Mapping (SLAM), and data fusion. The goal of the matching is to automatically generate sets of image coordinates that identify the same feature across images. Ideally, the process should be robust to lighting, scale, perspective, and modality changes. The scope of the image matching topic in the field of remote sensing (RS) is enormous because of the variety of collection platforms, modalities, sensor types, applications, and subjects. In this work, we report the history of and assess the state of the art of visible-spectrum (panchromatic and color) image matching of the Earth’s surface. Work specific to large-format images (LFI) (e.g., metric aerial cameras and Earth-observing satellites) will be highlighted. However, the state of the art in this century will mostly be traced through machine vision research and benchmarks because research specific to LFI is rare.

97 MATHEMATICS AND COMPUTING↗

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

The manipulation and control of nanoscale magnetic spin textures are of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging.

36 MATERIALS SCIENCE↗

Image-enhanced bipolaron formation at organic semiconductor/electrode interfaces

We explore the image charge interaction for organic semiconductor bipolarons near a conducting interface and find that the cross term between one of the constituent charges and the image of its neighbor stabilizes the bipolaron by up to ~0.3 eV, dramatically increasing the concentration of this species near the interface. Using density functional theory calculations for the common hole transport molecule N,N'-bis(3-methylphenyl)- N,N'-diphenylbenzidine, we validate a simple point charge description of this effect and incorporate it within an interface energy level alignment model to predict the density of polarons and bipolarons near the interface. We find that the image effect greatly enhances bipolaron formation in the first few monolayers, leading to the expectation that bipolarons account for more than 1% of the total interface charge in many cases of practical interest. Furthermore, this result reinforces the notion that bipolarons are robust near the contacts of many organic semiconductor devices and thus helps to rationalize their involvement in the phenomenon of unipolar organic magnetoresistance.

36 MATERIALS SCIENCE↗