Search NASA⌕ Search

SEARCH · Search NASA

Results for “Synthetic Image Generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Microscopy modality transfer of steel microstructures: Inferring scanning electron micrographs from optical microscopy using generative AI

Scanning electron microscopy (SEM) is resource intensive, which limits its throughput in some applications. As an alternative, we propose applying computer vision and machine learning to generate high-quality synthetic SEM micrographs from micrographs obtained using light optical microscopy (LOM). Working with a correlated LOM/SEM dataset of dual-phase steel images, we test generative models of various architectures, including encoder-decoder networks, generative adversarial networks (GANs), and diffusion-based models. We find that the diffusion models significantly outperform other methods on both qualitative and quantitative assessments, while preserving key metallurgical meaning. This work establishes diffusion as the state-of-the-art for microscopy modality transfer and demonstrates the potential of AI-powered microscopy to enhance LOM with micron scale structural recreation.

Computer vision↗
NASA NTRS1976

The Seasat-A Synthetic Aperture Imaging Radar System

The Seasat-A Synthetic Aperture Imaging Radar System is the first radar system of its kind designed for orbital use. The requirement of this system is to generate continuous radar imagery with a 100-km swath with 25 m resolution from an orbital altitude of 800 km. These requirements impose unique system design problems and a description of the implementation will be given. The end to end data system will be described including interactions of the spacecraft, antenna, sensor, telemetry link, and data processor. The synthetic aperture radar system generates a large quantity of data (110 megabits per second) requiring the use of a dedicated data link. The data link selected for use with the synthetic aperture radar is an analog link with stable local oscillator encoding. The problems associated in telemetering the radar information with sufficient fidelity to synthesize an image on the ground will be described as well as the selected solutions to the problems. The interactions between the antenna attitude control system, rotation of the earth and the data processor will be described as well as proposed solutions, both optical and digital, to generate final imagery with the required 25 m resolution.

Jordan, R. L.↗
DOE OSTI2026

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗
NASA NTRS1977

DKDP /potassium dideuterium phosphate/ light valves

The use of potassium dideuterium phosphate (DKDP) light valves for optical data processing is discussed. The operating principles and structure of optically and electron beam addressed DKDPs are compared, and specifications for both devices given. Optically addressed DKDPs are capable of higher resolution and contrast, but both systems represent viable real time spatial light modulators adaptable to optical processing. Examples of real time data processing performed by the DKDPs include: image addition and subtraction; reduction of noise introduced by scattered light in recording media; reconstruction of computer generated and acoustic holograms; reconstruction of synthetic aperture radar data; retrieval of three-dimensional information in X-ray diagnoses; radar signal processing and display; and optical pattern recognition and correlation of images, which has applications for missile guidance systems.

Casasent, D.↗
NASA NTRS2018

Augmented Reality Data Generation for Training Deep Learning Neural Network

One of the major challenges in deep learning is retrieving sufficiently large labeled training datasets, which can become expensive and time consuming to collect. A unique approach to training segmentation is to use Deep Neural Network (DNN) models with a minimal amount of initial labeled training samples. The procedure involves creating synthetic data and using image registration to calculate affine transformations to apply to the synthetic data. The method takes a small dataset and generates a highquality augmented reality synthetic dataset with strong variance while maintaining consistency with real cases. Results illustrate segmentation improvements in various target features and increased average target confidence.

Torres, Gil↗
NASA NTRS1975

A SEASAT-A synthetic aperture imaging radar system

The SEASAT, a synthetic aperture imaging radar system is the first radar system of its kind designed for the study of ocean wave patterns from orbit. The basic requirement of this system is to generate continuous radar imagery with a 100 km swath with 25m resolution from an orbital altitude of 800 km. These requirements impose unique system design problems. The end to end data system described including interactions of the spacecraft, antenna, sensor, telemetry link, and data processor. The synthetic aperture radar system generates a large quantity of data requiring the use of an analog link with stable local oscillator encoding. The problems associated in telemetering the radar information with sufficient fidelity to synthesize an image on the ground is described as well as the selected solutions to the problems.

Jordan, R. L.↗
NASA NTRS2017

Monitoring Land Surface Albedo and Vegetation Dynamics Using High Spatial and Temporal Resolution Synthetic Time Series from Landsat and the MODIS BRDF/NBAR/Albedo Product

Seasonal vegetation phenology can significantly alter surface albedo which in turn affects the global energy balance and the albedo warmingcooling feedbacks that impact climate change. To monitor and quantify the surface dynamics of heterogeneous landscapes, high temporal and spatial resolution synthetic time series of albedo and the enhanced vegetation index (EVI) were generated from the 500-meter Moderate Resolution Imaging Spectroradiometer (MODIS) operational Collection V006 daily BRDF (Bidirectional Reflectance Distribution Function) / NBAR (Nadir BRDF-Adjusted Reflectance) / albedo products and 30-meter Landsat 5 albedo and near-nadir reflectance data through the use of the Spatial and Temporal Adaptive Reflectance Fusion Model (STARFM). The traditional Landsat Albedo (Shuai et al., 2011) makes use of the MODIS BRDFAlbedo products (MCD43) by assigning appropriate BRDFs from coincident MODIS products to each Landsat image to generate a 30-meter Landsat albedo product for that acquisition date. The available cloud free Landsat 5 albedos (due to clouds, generated every 16 days at best) were used in conjunction with the daily MODIS albedos to determine the appropriate 30-meter albedos for the intervening daily time steps in this study. These enhanced daily 30-meter spatial resolution synthetic time series were then used to track albedo and vegetation phenology dynamics over three Ameriflux tower sites (Harvard Forest in 2007, Santa Rita in 2011 and Walker Branch in 2005). These Ameriflux sites were chosen as they are all quite nearby new towers coming on line for the National Ecological Observatory Network (NEON), and thus represent locations which will be served by spatially paired albedo measures in the near future. The availability of data from the NEON towers will greatly expand the sources of tower albedometer data available for evaluation of satellite products. At these three Ameriflux tower sites the synthetic time series of broadband shortwave albedos were evaluated using the tower albedo measurements with a Root Mean Square Error (RMSE) less than 0.013 and a bias within the range of 0.006. These synthetic time series provide much greater spatial detail than the 500 meter gridded MODIS data, especially over more heterogeneous surfaces, which improves the efforts to characterize and monitor the spatial variation across species and communities. The mean of the difference between maximum and minimum synthetic time series of albedo within the MODIS pixels over a subset of satellite data of Harvard Forest (16 kilometers by 14 kilometers) was as high as 0.2 during the snow-covered period and reduced to around 0.1 during the snow-free period. Similarly, we have used STARFM to also couple MODIS Nadir BRDF-Adjusted Reflectances (NBAR) values with Landsat 5 reflectances to generate daily synthetic times series of NBAR and thus Enhanced Vegetation Index (NBAR-EVI) at a 30-meter resolution. While normally STARFM is used with directional reflectances, the use of the view angle corrected daily MODIS NBAR values will provide more consistent time series. These synthetic times series of EVI are shown to capture seasonal vegetation dynamics with finer spatial and temporal details, especially over heterogeneous land surfaces.

Vegetation Index↗
NASA NTRS1998

Nonlinear Internal Wave Interaction in the China Seas

This project researched the nonlinear wave interactions in the East China Sea, and the South China Sea, using Synthetic Aperture Radar (SAR) images. The complicated nature of the internal wave field, including the generation mechanisms, was studied, and is discussed. Discussion of wave-wave interactions in the East China Sea, the area of the China Sea northeast of Taiwan, and the Yellow Sea is included.

Liu, Antony K.↗
NASA NTRS2018

Deep Neural Network for Precision Multi-band Infrared Image Segmentation

Image segmentation is one of the fundamental steps in computer vision. Separating targets from background clutter with high precision is a challenging operation for both humans and computers. Currently, segmenting objects from IR images is done by tedious manual work. The implementation of a Deep Neural Network (DNN) to perform precision segmentation of multi-band IR video images is presented. A customized pix2pix DNN with multiple layers of generative encoder/decoder and discriminator architecture is used in the IR image segmentation process. Real and synthetic images and ground truths are employed to train the DNN. Iterative training is performed to achieve optimum accuracy of segmentation using a minimal number of training data. Special training images are created to enhance the missing features and to increase the segmentation accuracy of the objects. Retraining strategies are developed to minimize the DNN training time. Single pixel accuracy has been achieved in IR target boundary segmentation using DNNs. The segmentation accuracy between the customized pix2pix DNN and simple thresholding, GraphCut, simple neural network and ResNet models are compared.

Torres, Gil↗
NASA NTRS1976

Radar data processing and analysis

Digitized four-channel radar images corresponding to particular areas from the Phoenix and Huntington test sites were generated in conjunction with prior experiments performed to collect X- and L-band synthetic aperture radar imagery of these two areas. The methods for generating this imagery are documented. A secondary objective was the investigation of digital processing techniques for extraction of information from the multiband radar image data. Following the digitization, the remaining resources permitted a preliminary machine analysis to be performed on portions of the radar image data. The results, although necessarily limited, are reported.

Ausherman, D.↗
NASA NTRS1993

Engineering workstation: Sensor modeling

The purpose of the engineering workstation is to provide an environment for rapid prototyping and evaluation of fusion and image processing algorithms. Ideally, the algorithms are designed to optimize the extraction of information that is useful to a pilot for all phases of flight operations. Successful design of effective fusion algorithms depends on the ability to characterize both the information available from the sensors and the information useful to a pilot. The workstation is comprised of subsystems for simulation of sensor-generated images, image processing, image enhancement, and fusion algorithms. As such, the workstation can be used to implement and evaluate both short-term solutions and long-term solutions. The short-term solutions are being developed to enhance a pilot's situational awareness by providing information in addition to his direct vision. The long term solutions are aimed at the development of complete synthetic vision systems. One of the important functions of the engineering workstation is to simulate the images that would be generated by the sensors. The simulation system is designed to use the graphics modeling and rendering capabilities of various workstations manufactured by Silicon Graphics Inc. The workstation simulates various aspects of the sensor-generated images arising from phenomenology of the sensors. In addition, the workstation can be used to simulate a variety of impairments due to mechanical limitations of the sensor placement and due to the motion of the airplane. Although the simulation is currently not performed in real-time, sequences of individual frames can be processed, stored, and recorded in a video format. In that way, it is possible to examine the appearance of different dynamic sensor-generated and fused images.

Pavel, M↗
NASA NTRS2009

Lossless Compression of Classification-Map Data

A lossless image-data-compression algorithm intended specifically for application to classification-map data is based on prediction, context modeling, and entropy coding. The algorithm was formulated, in consideration of the differences between classification maps and ordinary images of natural scenes, so as to be capable of compressing classification- map data more effectively than do general-purpose image-data-compression algorithms. Classification maps are typically generated from remote-sensing images acquired by instruments aboard aircraft (see figure) and spacecraft. A classification map is a synthetic image that summarizes information derived from one or more original remote-sensing image(s) of a scene. The value assigned to each pixel in such a map is the index of a class that represents some type of content deduced from the original image data for example, a type of vegetation, a mineral, or a body of water at the corresponding location in the scene. When classification maps are generated onboard the aircraft or spacecraft, it is desirable to compress the classification-map data in order to reduce the volume of data that must be transmitted to a ground station.

Hua, Xie↗
NASA NTRS1976

A Seasat-A Synthetic Aperture Imaging Radar System

The Seasat-A Synthetic Aperture Imaging Radar System is the first radar system of its kind designed for the study of ocean wave patterns from orbit. The basic requirement of this system is to generate continuous radar imagery with a 100-km swath with 25 m resolution from an orbital altitude of 800 km. These requirements impose unique system design problems and their solutions will be stated. The end to end data system will be described including interactions of the spacecraft, antenna, sensor, telemetry link, and data processor. The synthetic aperture radar system generates a large quantity of data (110 megabits per second) requiring the use of a dedicated data link. The data link selected for use with the synthetic aperture radar is an analog link with stable local oscillator encoding. The problems associated in telemetering the radar information with sufficient fidelity to synthesize an image on the ground will be described as well as the selected solutions to the problems.

Jordan, R. L.↗
NASA NTRS2003

Fine Resolution Topographic Mapping of the Jovian Moons: A Ka-Band High Resolution Topographic Mapping Interferometric Synthetic Aperture Radar

The topographic data set obtained by MOLA has provided an unprecedented level of information about Mars' geologic features. The proposed flight of JIMO provides an opportunity to accomplish a similar mapping of and comparable scientific discovery for the Jovian moons through use of an interferometric imaging radar analogous to the Shuttle radar that recently generated a new topographic map of Earth. A Ka-band single pass across-track synthetic aperture radar (SAR) interferometer can provide very high resolution surface elevation maps. The concept would use two antennas mounted at the ends of a deployable boom (similar to the Shuttle Radar Topographic Mapper) extended orthogonal to the direction of flight. Assuming an orbit altitude of approximately 100km and a ground velocity of approximately 1.5 km/sec, horizontal resolutions at the 10 meter level and vertical resolutions at the sub-meter level are possible.

Madsen, S. N.↗
NASA NTRS2003

Fine resolution topographic mapping of the Jovian moons: a Ka-band high resolution topographic mapping interferometric synthetic aperture radar

The topographic data set obtained by MOLA has provided an unprecedented level of information about Mars' geologic features. The proposed flight of JIMO provides an opportunity to accomplish a similar mapping of and comparable scientific discovery for the Jovian moons through us of an interferometric imaging radar analogous to the Shuttle radar that recently generated a new topographic map of Earth. A Ka-band single pass across-track synthetic aperture radar (SAR) interferometer can provide very high resolution surface elevation maps. The concept would use two antennas mounted at the ends of a deployable boom (similar to the Shuttle Radar Topographic Mapper) extended orthogonal to the direction of flight. Assuming an orbit altitude of approximately 100 km and a ground velocity of approximately 1.5 km/sec, horizontal resolutions at the 10 meter level and vertical resolutions at the sub-meter level are possible.

Jupiter Icy Moon Orbiter↗
NASA NTRS2010

Super Resolution Image Enhancement for a Flash Lidar: Back Projection Method

In this paper a new image processing technique for flash LIDAR data is presented as a potential tool to enable safe and precise spacecraft landings in future robotic or crewed lunar and planetary missions. Flash LIDARs can generate, in real-time, range data that can be interpreted as a 3-dimensional (3-D) image and transformed into a corresponding digital elevation map (DEM). The NASA Autonomous Landing and Hazard Avoidance (ALHAT) project is capitalizing on this new technology by developing, testing and analyzing flash LIDARs to detect hazardous terrain features such as craters, rocks, and slopes during the descent phase of spacecraft landings. Using a flash LIDAR for this application looks very promising, however through theoretical and simulation analysis the ALHAT team has determined that a single frame, or mosaic, of flash LIDAR data may not be sufficient to build a landing site DEM with acceptable spatial resolution, precision, size, or for a mosaic, in time, to meet current system requirements. One way to overcome this potential limitation is by enhancing the flash LIDAR output images. We propose a new super-resolution algorithm applicable to flash LIDAR range data that will create a DEM with sufficient accuracy, precision and size to meet current ALHAT requirements. The performance of our super-resolution algorithm is analyzed by processing data generated during a series of simulation runs by a high fidelity model of a flash LIDAR imaging a high resolution synthetic lunar elevation map. The flash LIDAR model is attached to a simulated spacecraft by a gimbal that points the LIDAR to a target landing site. For each simulation run, a sequence of flash LIDAR frames is recorded and processed as the spacecraft descends toward the landing site. Each run has a different trajectory profile with varying LIDAR look angles of the terrain. We process the output LIDAR frames using our SR algorithm and the results show that the achieved level of accuracy and precision of the SR generated landing site DEM is more than adequate for detecting hazardous terrain features and identifying safe areas.

Bulyshev, Alexander↗
NASA NTRS1999

Satellite Hyperspectral Imaging Simulation

Simulation of generic pushbroom satellite hyperspectral sensors have been performed to evaluate the potential performance and validation techniques for satellite systems such as COIS(NEMO), Warfighter-1(OrbView-4) and Hyperion(EO-1). The simulations start with a generation of synthetic scenes from material maps of studied terrain. Scene-reflected radiance is corrected for atmospheric effects and convolved with sensor spectral response using MODTRAN 4 radiance and transmissions calculations. Scene images are further convolved with point spread functions derived from Optical Transfer Functions (OTF's) of the sensor system. Photon noise and etectorr/electronics noise are added to the simulated images, which are also finally quantized to the sensor bit resolution. Studied scenes include bridges and straight roads used for evaluation of sensor spatial resolution, as well as fields of minerals, vegetation and manmade materials used for evaluation of sensor radiometric response and sensitivity. The scenes are simulated with various seasons and weather conditions. Signal-to-noise ratios and expected performance are estimated for typical satellite system specifications and are discussed for all the scenes.

Zanoni, Vicki↗
NASA NTRS1999

Satellite Hyperspectral Imaging Simulation

Simulations of generic pushbroom satellite hyperspetral sensors have been performed to evaluate the potential performance and validation techniques for satellite systems such as COIS (NEMO), Warfighter-1 (OrbView-4), and Hyperion (EO-1). The simulaitons start with a generation of synthetic scenes form material maps of studied terrain. Scene-reflected radiance is corrected for atmospheric effects and convolved with sensor spectral response uwing MODTRAN 4 radiance and transmission calculations. Scene images are further convolved with point spread functions derived from Optical Transfer Functions (OTF's) of the sensor system. Photon noise and detector/electronics noise are added to the simulated images, which are also finally quantized to the sensor bit resolution. Studied scenes include bridges and straight roads used for evaluation of sensor spatial resolution, as well as fields of minerals, vegetation, and manmade materials used for evaluation of sensor radiometric response and sensitivity. The scenes are simulated with various seasons and weather conditions. Signal-to-noise ratos and expected performance are estimated for typica satellite system specifications and are discussed for all the scenes.

Zanoni, Vicki↗