Results for “Synthetic Image Generation” — Page 3

NASA NTRS1977

Microwave backscattering theory and active remote sensing of the ocean surface

The status is reviewed of electromagnetic scattering theory relative to the interpretation of microwave remote sensing data acquired from spaceborne platforms over the ocean surface. Particular emphasis is given to the assumptions which are either implicit or explicit in the theory. The multiple scale scattering theory developed during this investigation is extended to non-Gaussian surface statistics. It is shown that the important statistic for the case is the probability density function of the small scale heights conditioned on the large scale slopes; this dependence may explain the anisotropic scattering measurements recently obtained with the AAFE Radscat. It is noted that present surface measurements are inadequate to verify or reject the existing scattering theories. Surface measurements are recommended for qualifying sensor data from radar altimeters and scatterometers. Additional scattering investigations are suggested for imaging type radars employing synthetically generated apertures.

Brown, G. S.↗

NASA NTRS2006

Hybrid Terrain Database

A prototype hybrid terrain database is being developed in conjunction with other databases and with hardware and software that constitute subsystems of aerospace cockpit display systems (known in the art as synthetic vision systems) that generate images to increase pilots' situation awareness and eliminate poor visibility as a cause of aviation accidents. The basic idea is to provide a clear view of the world around an aircraft by displaying computer-generated imagery derived from an onboard database of terrain, obstacle, and airport information.

Arthur, Trey↗

NASA NTRS2022

Quantifying Errors in 3D CME Parameters Derived from Synthetic Data Using White-Light Reconstruction Techniques

Current efforts in space weather forecasting of CMEs have been focused on predicting their arrival time and magnetic structure. To make these predictions, methods have been developed to derive the true CME speed, size, position, and mass, among others. Difficulties in determining the input parameters for CME forecasting models arise from the lack of direct measurements of the coronal magnetic fields and uncertainties in estimating the CME 3D geometric and kinematic parameters after eruption. White-light coronagraph images are usually employed by a variety of CME reconstruction techniques that assume more or less complex geometries. This is the first study from our International Space Science Institute (ISSI) team “Understanding Our Capabilities in Observing and Modeling Coronal Mass Ejections”, in which we explore how subjectivity affects the 3D CME parameters that are obtained from the Graduated Cylindrical Shell (GCS) reconstruction technique, which is widely used in CME research. To be able to quantify such uncertainties, the “true” values that are being fitted should be known, which are impossible to derive from observational data. We have designed two different synthetic scenarios where the “true” geometric parameters are known in order to quantify such uncertainties for the first time. We explore this by using two sets of synthetic data: 1) Using the ray-tracing option from the GCS model software itself, and 2) Using 3D magnetohydrodynamic (MHD) simulation data from the Magnetohydrodynamic Algorithm outside a Sphere code. Our experiment includes different viewing configurations using single and multiple viewpoints. CME reconstructions using a single viewpoint had the largest errors and error ranges overall for both synthetic GCS and simulated MHD white-light data. As the number of viewpoints increased from one to two, the errors decreased by approximately 4° in latitude, 22° in longitude, 14° in tilt, and 10° in half-angle. Our results quantitatively show the critical need for at least two viewpoints to be able to reduce the uncertainty in deriving CME parameters. We did not find a significant decrease in errors when going from two to three viewpoints for our specific hypothetical three spacecraft scenario using synthetic GCS white-light data. As we expected, considering all configurations and numbers of viewpoints, the mean absolute errors in the measured CME parameters are generally significantly higher in the case of the simulated MHD white-light data compared to those from the synthetic white-light images generated by the GCS model. We found the following CME parameter error bars as a starting point for quantifying the minimum error in CME parameters from white-light reconstructions: Δθ (latitude)=6° +2° -3° , Δϕ (longitude)=11° +18° -6° , Δγ (tilt)=25° +8° -7° , Δx (half-angle)=10° +12° -6° , Δh (height)=0.6 +1.2 -0.4 R ⨀ , and Δκ (ratio)=0.1 +0.03 -0.02 .

Coronal mass ejections↗

NASA NTRS2022

Quantifying Errors in 3D CME Parameters Derived From Synthetic Data Using White-Light Reconstruction Techniques

Current efforts in space weather forecasting of CMEs have been focused on predicting their arrival time and magnetic structure. To make these predictions, methods have been developed to derive the true CME speed, size, position, and mass, among others. Difficulties in determining the input parameters for CME forecasting models arise from the lack of direct measurements of the coronal magnetic fields and uncertainties in estimating the CME 3D geometric and kinematic parameters after eruption. White-light coronagraph images are usually employed by a variety of CME reconstruction techniques that assume more or less complex geometries. This is the first study from our International Space Science Institute (ISSI) team “Understanding Our Capabilities in Observing and Modeling Coronal Mass Ejections”, in which we explore how subjectivity affects the 3D CME parameters that are obtained from the Graduated Cylindrical Shell (GCS) reconstruction technique, which is widely used in CME research. To be able to quantify such uncertainties, the “true” values that are being fitted should be known, which are impossible to derive from observational data. We have designed two different synthetic scenarios where the “true” geometric parameters are known in order to quantify such uncertainties for the first time. We explore this by using two sets of synthetic data: 1) Using the ray-tracing option from the GCS model software itself, and 2) Using 3D magnetohydrodynamic (MHD) simulation data from the Magnetohydrodynamic Algorithm outside a Sphere code. Our experiment includes different viewing configurations using single and multiple viewpoints. CME reconstructions using a single viewpoint had the largest errors and error ranges overall for both synthetic GCS and simulated MHD white-light data. As the number of viewpoints increased from one to two, the errors decreased by approximately 4° in latitude, 22° in longitude, 14° in tilt, and 10° in half-angle. Our results quantitatively show the critical need for at least two viewpoints to be able to reduce the uncertainty in deriving CME parameters. We did not find a significant decrease in errors when going from two to three viewpoints for our specific hypothetical three spacecraft scenario using synthetic GCS white-light data. As we expected, considering all configurations and numbers of viewpoints, the mean absolute errors in the measured CME parameters are generally significantly higher in the case of the simulated MHD white-light data compared to those from the synthetic white-light images generated by the GCS model. We found the following CME parameter error bars as a starting point for quantifying the minimum error in CME parameters from white-light reconstructions: Δθ (latitude)=6° +2° -3° , Δϕ (longitude)=11° +18° -6° , Δγ (tilt)=25° +8° -7° , Δx (half-angle)=10° +12° -6° , Δh (height)=0.6 +1.2 -0.4 R ⨀ , and Δκ (ratio)=0.1 +0.03 -0.02 .

Coronal mass ejections↗

NASA NTRSDate not supplied

Synthetic OCT-A blood vessel maps using fundus images and generative adversarial networks

Explore the source record for details and available documents.

Ivan Coronado↗

DOE OSTI2024

RGM: Random Geological Model Generation Package

This Fortran code is to accompany a manuscript to be submitted to Computers & Geosciences, a high-impact, peer-reviewed journal in computer methods for geosciences research. This Fortran code focuses on generation of synthetic geological models using a multi-randomization strategy. Generating high-fidelity synthetic geological models, including realistic seismic reflector migration images, faults, salt bodies, and relative geological time images, is the key for many supervised machine learning methods that aim to delineate faults and other geological properties of interest from seismic migration images. Our package contains two major functionalities: generating 2D synthetic random geological models and generating 3D synthetic random geological models. In each step of the generation process, we set random values for key properties of a geological model to improve the fidelity of the resulting geological model. The package also includes example codes on how to use the random geological model generation subroutines. We name this package RGM – Random Geological Model generation package.

Gao, Kai↗

DOE OSTI2025

Continuous-variable quantum Boltzmann machine

Here, we propose a continuous-variable quantum Boltzmann machine (CVQBM) using a powerful energy-based neural network. It can be realized experimentally on a continuous-variable (CV) photonic quantum computer. We used a CV quantum imaginary time evolution (QITE) algorithm to prepare the essential thermal state and then designed the CVQBM to proficiently generate continuous probability distributions. We applied our method to both classical and quantum data. Using real-world classical data, such as synthetic-aperture radar (SAR) images, we generated probability distributions. For quantum data, we used the output of CV quantum circuits. We obtained high fidelity and low Kullback–Leibler (KL) divergence showing that our CVQBM learns distributions from given data well and generates data sampling from that distribution efficiently. We also discussed the experimental feasibility of our proposed CVQBM. Our method can be applied to a wide range of real-world problems by choosing an appropriate target distribution (corresponding to, e.g., SAR images, medical images, and risk management in finance). Moreover, our CVQBM is versatile and could be programmed to perform tasks beyond generation, such as anomaly detection.

SAR images↗

NASA NTRSDate not supplied

Building Maps for Terrain Relative Navigation Using Blender: An Open-Source Approach

A persistent challenge for vision-based navigation systems that compare imagery to a reference map is generating high quality maps with similar lighting conditions. Image rendering software can be used to apply variable lighting to reference maps or to generate synthetic imagery for test trajectories. While many image rendering software packages are available, with several developed specifically for spaceflight applications, there are often limitations due to cost, image fidelity, or flexibility. In this paper, we demonstrate the use of an open-source image rendering software, Blender, for use in Terrain Relative Navigation (TRN) applications. A scene in Blender was generated based on elevation data and satellite imagery of the region of West Texas used by Blue Origin for the operation of their New Shepard suborbital rocket. The Blender scene was validated by reproducing imagery collected during a flight of New Shepard in October 2020 and was further used to generate reference maps for use by a TRN algorithm on a subsequent New Shepard flight in August 2021. The work was performed under the NASA Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) project, which is focused on technology advancement for precision landing and hazard avoidance. This work aims to lower the cost of entry and generally promote the adoption and advancement of vision-based navigation technologies.

Kyle W Smith↗

NASA NTRS1990

Computer Assembles Mosaics Of Satellite-SAR Imagery

Digital image-processing system assembles maplike mosaic images of large areas of Earth from overlapping images of smaller areas generated by spaceborne synthetic-aperture radar (SAR). Automatically registers and blends smaller images with each other. Eliminates need for time-consuming, tedious manual processing. Modifiable to accept images from spaceborne optical sensors.

Kwok, R.↗

NASA NTRSDate not supplied

Improving Sim-to-Real Transfer in Vision-Based Robot Navigation Via Instance-Level GAN-Based Data Augmentation

Achieving robust vision-based robotic tasks requires large amounts of data, which are often difficult to obtain in real-world scenarios. Simulators and synthetic data offer a cost-effective alternative, but the visual gap between simulation and reality hinders the performance of models when deployed in real-world environments. In this paper, we present a data augmentation pipeline that integrates a foundation model (Segment Anything Model) with an unsupervised image-to-image translation model (CycleGAN) for instance-level domain transfer from simulation to reality. This pipeline enables the generation of realistic labeled data from synthetic images for training supervised machine learning models in vision-based navigation tasks. We evaluate our approach on real-world data for ego-vehicle pose estimation, a critical autonomous navigation task involving the prediction of cross-track position and heading angle relative to road center line markings. The results of our tests show that our GAN-based data augmentation pipeline significantly outperforms models trained solely on simulation data or on data processed with standard image augmentation methods for sim-to-real transfer, enhancing model robustness and generalizability in real-world scenarios. Our method provides a scalable and flexible data augmentation tool for leveraging large synthetic datasets to enhance vision-based robotic navigation tasks.

artificial intelligence↗

NASA NTRS2024

A Feasibility Study of 4-D Tomography of Soft X-ray Magnetosheath Emissivities Using Multi-Spacecraft Measurements

Upcoming heliophysics missions utilize state-of-the-art wide field-of-view (FOV) imaging technology to measure and investigate the space plasma environment on a global scale. At Earth, remote sensing of soft X-ray emissions, which are generated via the charge exchange interaction between heavy solar wind ions and exospheric neutral atoms, is a promising means to investigate the global magnetosheath structure, its response to varying solar wind conditions, and the spatiotemporal properties of the dayside magnetic reconnection. Data analysis techniques such as optical tomography can provide additional structural and time-varying information from the observed target and thus enhance the mission’s scientific return. In this work, we simulate multiple and simultaneous observations of the dayside magnetosphere using soft X-ray imagers located at long-distance vantage points to reconstruct the time-dependent, three-dimensional (3-D) structure of the magnetosheath using a dynamic tomographic approach. The OpenGCCM MHD model is used to simulate the time-varying response of the magnetosheath to solar wind conditions and, subsequently, generate synthetic soft X-ray images from multiple spacecraft vantage points separated along a common orbit. A detailed analysis is then performed to identify the nominal set of spacecraft that produces the highest fidelity tomographic reconstruction of the magnetopause. This work aims to (i) demonstrate, for the first time, the use of dynamic tomography to retrieve the time-varying magnetosheath structure and (ii) identify a nominal mission design for multi-spacecraft configurations aiming for optical tomography.

3-D/4_d tomography↗

DOE OSTI2025

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2013

Software for Generating Troposphere Corrections for InSAR Using GPS and Weather Model Data

Atmospheric errors due to the troposphere are a limiting error source for spaceborne interferometric synthetic aperture radar (InSAR) imaging. This software generates tropospheric delay maps that can be used to correct atmospheric artifacts in InSAR data. The software automatically acquires all needed GPS (Global Positioning System), weather, and Digital Elevation Map data, and generates a tropospheric correction map using a novel algorithm for combining GPS and weather information while accounting for terrain. Existing JPL software was prototypical in nature, required a MATLAB license, required additional steps to acquire and ingest needed GPS and weather data, and did not account for topography in interpolation. Previous software did not achieve a level of automation suitable for integration in a Web portal. This software overcomes these issues. GPS estimates of tropospheric delay are a source of corrections that can be used to form correction maps to be applied to InSAR data, but the spacing of GPS stations is insufficient to remove short-wavelength tropospheric artifacts. This software combines interpolated GPS delay with weather model precipitable water vapor (PWV) and a digital elevation model to account for terrain, increasing the spatial resolution of the tropospheric correction maps and thus removing short wavelength tropospheric artifacts to a greater extent. It will be integrated into a Web portal request system, allowing use in a future L-band SAR Earth radar mission data system. This will be a significant contribution to its technology readiness, building on existing investments in in situ space geodetic networks, and improving timeliness, quality, and science value of the collected data

Moore, Angelyn W.↗

NASA NTRS2023

Finding the magnetopause location using soft X-ray observations and a statistical inverse method

Variability in the location and shape of the dayside magnetopause is attributed to magnetic reconnection, a fundamental process that enables the transfer of mass, energy, and momentum from the solar wind into the magnetosphere. The spatial and temporal properties of the magnetopause, under varying solar and magnetospheric conditions, remain largely unknown because empirical studies using in-situ observations are challenging to interpret. Global wide field-of-view (FOV) imaging is the only means to simultaneously observe the spatial distribution of the plasma properties over the vast dayside magnetospheric region and, subsequently, quantify the energy transport from the interplanetary medium into the terrestrial magnetosphere. Two upcoming missions, ESA/CAS SMILE and NASA’s LEXI will provide wide-field imagery of the dayside magnetosheath in soft X-rays, an emission generated by charge exchange interactions between high charge-state heavy ions of solar wind origin and exospheric neutral atoms. High-cadence two-dimensional observations of the magnetosheath will allow the estimation of dynamic properties of its inner boundary, the magnetopause, and enable studies of its response to changes in the solar wind dynamic pressure and interplanetary magnetic field orientation. This work introduces a statistically-based estimation approach based on inverse theory to estimate the spatial distribution of magnetosheath soft X-ray emissivities and, with this, identify the location of the magnetopause over the Sun−Earth line. To do so, we simulate the magnetosheath structure using the MHD-based OpenGGCM model and generate synthetic soft X-ray images using LEXI’s orbit and attitude information. Our results show that 3-D estimations using the described statistically-based technique are robust against Poisson-distributed shot noise inherent to soft X-ray images. Also, our proposed methodology shows that the accuracy of both three-dimensional (3-D) estimation and the magnetopause standoff distance calculation highly depends on the observational point.

Gonzalo Cucho-Padin↗

NASA NTRS1978

Digital enhancement of computerized axial tomograms

A systematic evaluation was conducted of certain digital image enhancement techniques performed in image space. Three types of images were used, computer generated phantoms, tomograms of a synthetic phantom, and axial tomograms of human anatomy containing images of lesions, artificially introduced into the tomograms. Several types of smoothing, sharpening, and histogram modification were explored. It was concluded that the most useful enhancement techniques are a selective smoothing of singular picture elements, combined with contrast manipulation. The most useful tool in applying these techniques is the gray-scale histogram.

Roberts, E., Jr.↗

NASA NTRS2007

Synthetic Vision Systems - Operational Considerations Simulation Experiment

Synthetic vision is a computer-generated image of the external scene topography that is generated from aircraft attitude, high-precision navigation information, and data of the terrain, obstacles, cultural features, and other required flight information. A synthetic vision system (SVS) enhances this basic functionality with real-time integrity to ensure the validity of the databases, perform obstacle detection and independent navigation accuracy verification, and provide traffic surveillance. Over the last five years, NASA and its industry partners have developed and deployed SVS technologies for commercial, business, and general aviation aircraft which have been shown to provide significant improvements in terrain awareness and reductions in the potential for Controlled-Flight-Into-Terrain incidents/accidents compared to current generation cockpit technologies. It has been hypothesized that SVS displays can greatly improve the safety and operational flexibility of flight in Instrument Meteorological Conditions (IMC) to a level comparable to clear-day Visual Meteorological Conditions (VMC), regardless of actual weather conditions or time of day. An experiment was conducted to evaluate SVS and SVS-related technologies as well as the influence of where the information is provided to the pilot (e.g., on a Head-Up or Head-Down Display) for consideration in defining landing minima based upon aircraft and airport equipage. The "operational considerations" evaluated under this effort included reduced visibility, decision altitudes, and airport equipage requirements, such as approach lighting systems, for SVS-equipped aircraft. Subjective results from the present study suggest that synthetic vision imagery on both head-up and head-down displays may offer benefits in situation awareness; workload; and approach and landing performance in the visibility levels, approach lighting systems, and decision altitudes tested.

Kramer, Lynda J.↗

NASA NTRS2019

Target Optimal Aperture Selection

This document describes the computation of optimal pixels for planetary transit targets. The method we describe is based on that used in the End-to-End Model (ETEM), which simulates Kepler science output. An optimal aperture for a target is defined as the set of pixels which maximizes the signal-to-noise ratio (SNR) for that target. The optimal aperture for a target is determined by using catalog data to generate, for that target, a synthetic image with all background stars and signals and a second synthetic image with the target star's flux only. These images are incorporated into a noise model, from which the SNR of each pixel is computed. The pixels around a target are summed in an order that maximizes the SNR with each term. As dimmer and dimmer pixels contribute to this sum, the SNR reaches a maximum and further terms decrease the SNR. The set of pixels whose SNR sums to this maximum value defines the optimal aperture.

Bryson, Stephen↗

NASA NTRS2012

Simulation of Image Performance Characteristics of the Landsat Data Continuity Mission (LDCM) Thermal Infrared Sensor (TIRS)

The next Landsat satellite, which is scheduled for launch in early 2013, will carry two instruments: the Operational Land Imager (OLI) and the Thermal Infrared Sensor (TIRS). Significant design changes over previous Landsat instruments have been made to these sensors to potentially enhance the quality of Landsat image data. TIRS, which is the focus of this study, is a dual-band instrument that uses a push-broom style architecture to collect data. To help understand the impact of design trades during instrument build, an effort was initiated to model TIRS imagery. The Digital Imaging and Remote Sensing Image Generation (DIRSIG) tool was used to produce synthetic "on-orbit" TIRS data with detailed radiometric, geometric, and digital image characteristics. This work presents several studies that used DIRSIG simulated TIRS data to test the impact of engineering performance data on image quality in an effort to determine if the image data meet specifications or, in the event that they do not, to determine if the resulting image data are still acceptable.

Landsat↗