Search NASA⌕ Search

SEARCH · Search NASA

Results for “Synthetic Image Generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Earth as an Extrasolar Planet: Earth Model Validation Using EPOXI Earth Observations

The EPOXI Discovery Mission of Opportunity reused the Deep Impact flyby spacecraft to obtain spatially and temporally resolved visible photometric and moderate resolution near-infrared (NIR) spectroscopic observations of Earth. These remote observations provide a rigorous validation of whole disk Earth model simulations used to better under- stand remotely detectable extrasolar planet characteristics. We have used these data to upgrade, correct, and validate the NASA Astrobiology Institute s Virtual Planetary Laboratory three-dimensional line-by-line, multiple-scattering spectral Earth model (Tinetti et al., 2006a,b). This comprehensive model now includes specular reflectance from the ocean and explicitly includes atmospheric effects such as Rayleigh scattering, gas absorption, and temperature structure. We have used this model to generate spatially and temporally resolved synthetic spectra and images of Earth for the dates of EPOXI observation. Model parameters were varied to yield an optimum fit to the data. We found that a minimum spatial resolution of approx.100 pixels on the visible disk, and four categories of water clouds, which were defined using observed cloud positions and optical thicknesses, were needed to yield acceptable fits. The validated model provides a simultaneous fit to the Earth s lightcurve, absolute brightness, and spectral data, with a root-mean-square error of typically less than 3% for the multiwavelength lightcurves, and residuals of approx.10% for the absolute brightness throughout the visible and NIR spectral range. We extend our validation into the mid-infrared by comparing the model to high spectral resolution observations of Earth from the Atmospheric Infrared Sounder, obtaining a fit with residuals of approx.7%, and temperature errors of less than 1K in the atmospheric window. For the purpose of understanding the observable characteristics of the distant Earth at arbitrary viewing geometry and observing cadence, our validated forward model can be used to simulate Earth s time dependent brightness and spectral properties for wavelengths from the far ultraviolet to the far infrared.brightness

Robinson, Tyler D.↗

Magnetic Resonance–Based Automatic Air Segmentation for Generation of Synthetic Computed Tomography Scans in the Head Region

Purpose: To incorporate a novel imaging sequence for robust air and tissue segmentation using ultrashort echo time (UTE) phase images and to implement an innovative synthetic CT (synCT) solution as a first step toward MR-only radiation therapy treatment planning for brain cancer. Methods and Materials: Ten brain cancer patients were scanned with a UTE/Dixon sequence and other clinical sequences on a 1.0 T open magnet with simulation capabilities. Bone-enhanced images were generated from a weighted combination of water/fat maps derived from Dixon images and inverted UTE images. Automated air segmentation was performed using unwrapped UTE phase maps. Segmentation accuracy was assessed by calculating segmentation errors (true-positive rate, false-positive rate, and Dice similarity indices using CT simulation (CT-SIM) as ground truth. The synCTs were generated using a voxel-based, weighted summation method incorporating T2, fluid attenuated inversion recovery (FLAIR), UTE1, and bone-enhanced images. Mean absolute error (MAE) characterized Hounsfield unit (HU) differences between synCT and CT-SIM. A dosimetry study was conducted, and differences were quantified using γ-analysis and dose-volume histogram analysis. Results: On average, true-positive rate and false-positive rate for the CT and MR-derived air masks were 80.8% ± 5.5% and 25.7% ± 6.9%, respectively. Dice similarity indices values were 0.78 ± 0.04 (range, 0.70-0.83). Full field of view MAE between synCT and CT-SIM was 147.5 ± 8.3 HU (range, 138.3-166.2 HU), with the largest errors occurring at bone–air interfaces (MAE 422.5 ± 33.4 HU for bone and 294.53 ± 90.56 HU for air). Gamma analysis revealed pass rates of 99.4% ± 0.04%, with acceptable treatment plan quality for the cohort. Conclusions: A hybrid MRI phase/magnitude UTE image processing technique was introduced that significantly improved bone and air contrast in MRI. Segmented air masks and bone-enhanced images were integrated into our synCT pipeline for brain, and results agreed well with clinical CTs, thereby supporting MR-only radiation therapy treatment planning in the brain.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Radar Back End for NASA/ISRO Synthetic Aperture Radar (NISAR) Instrument

In this paper we present design, manufacture and qualification of a Radar Back End (RBE) for NISAR Mission’s Synthetic Aperture Radar (SAR) Instrument. The instrument uses Sweep SAR technique to generate high fidelity radar images while capturing an image over a large swath. It requires highly stable clocks to accomplish that. NISAR RBE is the heart of the L-band Synthetic Aperture Radar (LSAR) instrument. It generates radar’s transmit chirp signals, ultra-stable clocks and oscillators signals. In order to generate ultra-stable clocks some novel filtering and frequency multiplication techniques were utilized. These techniques have been presented in this paper. NISAR mission requires over 200 chirps to perform science measurements. Hardware and firmware architecture utilized to generate chirps have been presented in this paper. Unique space qualified techniques for DC to DC conversion has been presented in this paper. In addition, RBE was designed to be block redundant space qualified assembly. Novel cross strapping techniques were implemented to achieve that. Validation and qualification process employed to certify RBE flight hardware for flight has been presented in this paper.

Quddus, Momin↗

Heterogeneous energetic material damage simulator (HEDS): A deep learning approach to simulate damage–sensitivity linkages

Damage in the microstructures of energetic materials (EMs), such as propellants and plastic bonded explosives (PBXs), can significantly alter their response to external loads. Both sensitization and desensitization can occur, causing concerns with safety and performance in the field; predictive models that connect damage and the sensitivity of EMs can enable design and provide confidence in their robustness and reliability. However, modeling of damage evolution is challenging for real microstructures of EMs; samples of damaged EMs are difficult to obtain, thereby hindering experiments and direct numerical simulations to determine the sensitivity of EMs at various stages of damage. Here, we develop an approach to generate synthetic, i.e., in silico produced, damaged microstructures for use in simulations to connect damage levels to sensitivity. The development of the present workflow to generate and impose varying levels of damage in microstructures, known as HEDS (Heterogeneous Energetic Material Damage Simulator), begins with a small set of images of damaged PBXs and combines a collection of deep neural network techniques to generate microstructures with varying levels of damage. By making the synthetic microstructures conform closely to those observed in available real, imaged microstructures, we develop an ensemble of damaged microstructures that can be used for in silico shock experiments. HEDS develops these microstructure ensembles as level set fields, which are directly employed in a sharp interface Eulerian hydrocode where shock simulations are performed to quantify the energy release rate from hotspot fields generated in the microstructure. These capabilities can be useful for the analysis and assessment of changes in the sensitivity of EMs and to design formulations that are less susceptible to damage-induced changes in sensitivity and performance.

Fang, Irene (ORCID:0009000844557122)↗

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗

Enhanced/Synthetic Vision Systems for Advanced Flight Decks

One of the most challenging arenas for enhanced and synthetic vision systems is the flight deck. Here, pilots must perform active and supervisory control behaviors based on imagery generated in real time or transduced from imaging sensors. Although enhanced and synthetic vision technologies have been used in military vehicles for more than two decades, they have only recently been considered for civilian transport aircraft. In this paper we discuss the human performance issues still to be resolved for these systems, and consider the special constraints that must be considered for their use in the transport domain.

Kaiser, Mary K.↗

Database Integrity Monitoring for Synthetic Vision Systems Using Machine Vision and SHADE

In an effort to increase situational awareness, the aviation industry is investigating technologies that allow pilots to visualize what is outside of the aircraft during periods of low-visibility. One of these technologies, referred to as Synthetic Vision Systems (SVS), provides the pilot with real-time computer-generated images of obstacles, terrain features, runways, and other aircraft regardless of weather conditions. To help ensure the integrity of such systems, methods of verifying the accuracy of synthetically-derived display elements using onboard remote sensing technologies are under investigation. One such method is based on a shadow detection and extraction (SHADE) algorithm that transforms computer-generated digital elevation data into a reference domain that enables direct comparison with radar measurements. This paper describes machine vision techniques for making this comparison and discusses preliminary results from application to actual flight data.

Cooper, Eric G.↗

Detecting Seasonal Ice Dynamics in Satellite Images

Fully understanding how glaciers respond to environmental change will require new methods to help us identify the onset of ice acceleration events and observe how dynamic signals propagate within glaciers. In particular, observations of ice dynamics on seasonal timescales may offer insights into how a glacier interacts with various forcing mechanisms throughout the year. The task of generating continuous ice velocity time series that resolve seasonal variability is made more difficult by a spotty satellite record that contains no optical observations throughout the dark, polar winters. Furthermore, velocities obtained by feature tracking are marked by high noise when image pairs are separated by short time intervals and contain no direct insights into variability that occurs between images separated by long time intervals. In this paper, we describe a method of analyzing optical or SAR-derived feature-tracked velocities to characterize the magnitude and timing of seasonal ice dynamic variability. Our method is agnostic to data gaps and is able to recover climatological average winter velocities regardless of the availability of direct observations during winter. Using characteristic image acquisition times and error distributions from Antarctic image pairs in the ITS_LIVE dataset, we generate synthetic ice velocity time series, then apply our method to recover imposed magnitudes of seasonal variability within ±1.4 m yr−1. We then validate the techniques by comparing our results to GPS data collected on Russell Glacier in Greenland. The methods presented here may be applied to better understand how ice dynamic signals propagate on seasonal timescales, and what mechanisms control the flow of the world’s ice.

Chad A. Greene↗

Apparatus, system and method for highlighting activity-induced change in multi-pass synthetic aperture radar imagery

Described herein are various technologies relating to constructing a differenced change product (DCP) image. A plurality of synthetic aperture radar (SAR) images of a scene are generated based upon radar signals directed towards and reflected off of the scene, and a plurality of coherence change detection (CCD) images of the scene are generated based upon the SAR images. The CCD images are registered with one another, and their pixel values re-scaled according to a monotonic mapping function. The DCP image is generated based upon a computed pixel-wise difference between a pair of the re-scaled CCD images. The DCP image identifies locations in the scene where human activity-induced change is likely to have occurred between a pair of SAR passes of the scene.

42 ENGINEERING↗

Mapping and simulating systematics due to spatially-varying observing conditions in DES science verification data

Spatially-varying depth and characteristics of observing conditions, such as seeing, airmass, or sky background, are major sources of systematic uncertainties in modern galaxy survey analyses, in particular in deep multi-epoch surveys. We present a framework to extract and project these sources of systematics onto the sky, and apply it to the Dark Energy Survey (DES) to map the observing conditions of the Science Verification (SV) data. The resulting distributions and maps of sources of systematics are used in several analyses of DES SV to perform detailed null tests with the data, and also to incorporate systematics in survey simulations. We illustrate the complementarity of these two approaches by comparing the SV data with the BCC-UFig, a synthetic sky catalogue generated by forward-modelling of the DES SV images. We then analyse the BCC-UFig simulation to construct galaxy samples mimicking those used in SV galaxy clustering studies. We show that the spatially-varying survey depth imprinted in the observed galaxy densities and the redshift distributions of the SV data are successfully reproduced by the simulation and well-captured by the maps of observing conditions. The combined use of the maps, the SV data and the BCC-UFig simulation allows us to quantify the impact of spatial systematics on N(z), the redshift distributions inferred using photometric redshifts. We conclude that spatial systematics in the SV data are mainly due to seeing fluctuations and are under control in current clustering and weak lensing analyses. However, they will need to be carefully characterised in upcoming phases of DES in order to avoid biasing the inferred cosmological results. The framework presented is relevant to all multi-epoch surveys, and will be essential for exploiting future surveys such as the Large Synoptic Survey Telescope, which will require detailed null-tests and realistic end-to-end image simulations to correctly interpret the deep, high-cadence observations of the sky.

79 ASTRONOMY AND ASTROPHYSICS↗

A hybrid approach for fusing 4D-MRI temporal information with 3D-CT for the study of lung and lung tumor motion

Purpose: Accurate visualization of lung motion is important in many clinical applications, such as radiotherapy of lung cancer. Advancement in imaging modalities [e.g., computed tomography (CT) and MRI] has allowed dynamic imaging of lung and lung tumor motion. However, each imaging modality has its advantages and disadvantages. The study presented in this paper aims at generating synthetic 4D-CT dataset for lung cancer patients by combining both continuous three-dimensional (3D) motion captured by 4D-MRI and the high spatial resolution captured by CT using the authors’ proposed approach. Methods: A novel hybrid approach based on deformable image registration (DIR) and finite element method simulation was developed to fuse a static 3D-CT volume (acquired under breath-hold) and the 3D motion information extracted from 4D-MRI dataset, creating a synthetic 4D-CT dataset. Results: The study focuses on imaging of lung and lung tumor. Comparing the synthetic 4D-CT dataset with the acquired 4D-CT dataset of six lung cancer patients based on 420 landmarks, accurate results (average error <2 mm) were achieved using the authors’ proposed approach. Their hybrid approach achieved a 40% error reduction (based on landmarks assessment) over using only DIR techniques. Conclusions: The synthetic 4D-CT dataset generated has high spatial resolution, has excellent lung details, and is able to show movement of lung and lung tumor over multiple breathing cycles.

60 APPLIED LIFE SCIENCES↗

Benefits of adaptive radiation therapy in lung cancer as a function of replanning frequency

Purpose: To quantify the potential benefit associated with daily replanning in lung cancer in terms of normal tissue dose sparing and to characterize the tradeoff between adaptive benefit and replanning frequency. Methods: A set of synthetic images and contours, derived from weekly active breathing control images of 12 patients who underwent radiation therapy treatment for nonsmall cell lung cancer, is generated for each fraction of treatment using principal component analysis in a way that preserves temporal anatomical trends (e.g., tumor regression). Daily synthetic images and contours are used to simulate four different treatment scenarios: (1) a “no-adapt” scenario that simulates delivery of an initial plan throughout treatment, (2) a “midadapt” scenario that implements a single replan for fraction 18, (3) a “weekly adapt” scenario that simulates weekly adaptations, and (4) a “full-adapt” scenario that simulates daily replanning. An initial intensity modulated radiation therapy plan is created for each patient and replanning is carried out in an automated fashion by reoptimizing beam apertures and weights. Dose is calculated on each image and accumulated to the first in the series using deformable mappings utilized in synthetic image creation for comparison between simulated treatments. Results: Target coverage was maintained and cord tolerance was not exceeded for any of the adaptive simulations. Average reductions in mean lung dose (MLD) and volume of lung receiving 20 Gy or more (V20{sub lung}) were 65 ± 49 cGy (p = 0.000 01) and 1.1% ± 1.2% (p = 0.0006), respectively, for all patients. The largest reduction in MLD for a single patient was 162 cGy, which allowed an isotoxic escalation of the target dose of 1668 cGy. Average reductions in cord max dose, mean esophageal dose (MED), dose received by 66% of the heart (D66{sub heart}), and dose received by 33% of the heart (D33{sub heart}), were 158 ± 280, 117 ± 121, 37 ± 77, and 99 ± 120 cGy, respectively. Average incremental reductions in MLD for the midadapt, weekly adapt, and full-adapt treatments were 38, 18, and 8 cGy, respectively. Incremental reductions in MED for the same treatments were 57, 37, and 23 cGy. Reductions in MLD and MED for the full-adapt treatment were correlated with the absolute decrease in the planning target volume (r = 0.34 and r = 0.26). Conclusions: Adaptive radiation therapy for lung cancer yields clinically relevant reductions in normal tissue doses for frequencies of adaptation ranging from a single replan up to daily replanning. Increased frequencies of adaptation result in additional benefit while magnitude of benefit decreases.

60 APPLIED LIFE SCIENCES↗

Advanced studies of electromagnetic scattering

In radar signature applications it is often desirable to generate the range profiles and inverse synthetic aperture radar (ISAR) images of a target. They can be used either as identification tools to distinguish and classify the target from a collection of possible targets, or as diagnostic/design tools to pinpoint the key scattering centers on the target. The simulation of synthetic range profiles and ISAR images is usually a time intensive task and computation time is of prime importance. Our research has been focused on the development of fast simulation algorithms for range profiles and ISAR images using the shooting and bouncing ray (SBR) method, a high frequency electromagnetic simulation technique for predicting the radar returns from realistic aerospace vehicles and the scattering by complex media.

Ling, Hao↗

High Resolution Surface Geometry and Albedo by Combining Laser Altimetry and Visible Images

The need for accurate geometric and radiometric information over large areas has become increasingly important. Laser altimetry is one of the key technologies for obtaining this geometric information. However, there are important application areas where the observing platform has its orbit constrained by the other instruments it is carrying, and so the spatial resolution that can be recorded by the laser altimeter is limited. In this paper we show how information recorded by one of the other instruments commonly carried, a high-resolution imaging camera, can be combined with the laser altimeter measurements to give a high resolution estimate both of the surface geometry and its reflectance properties. This estimate has an accuracy unavailable from other interpolation methods. We present the results from combining synthetic laser altimeter measurements on a coarse grid with images generated from a surface model to re-create the surface model.

Morris, Robin D.↗

Rectification of terrain induced distortions in radar imagery

This paper describes a technique to generate geocoded synthetic aperture radar (SAR) imagery corrected for terrain induced geometric distortions. This algorithm transforms the raw slant range image, generated by the signal processor, into a map registered product, resampled to either Universal Transverse Mercator (UTM) or Polar Stereographic projections, and corrected for foreshortening. The technique utilizes the space platform trajectory information in conjunction with a digital elevation map (DEM) of the target area to generate an ortho-radar map with near-autonomous operation. The current procedure requires only two to three tie-points to compensate for the platform position uncertainty that results in translational error between the image and the DEM. This approach is unique in that it does not require generation of a simulated radar image from the DEM or a grid of tie-points to characterize the image-to-map distortions. Rather, it models the inherent distortions based on knowledge of the radar data collection characteristics, the signal Doppler parameters, and the local terrain height to automatically predict the registration transformation. This algorithm has been implemented on a minicomputer system equipped with an array processor and a large random-access memory to optimize the throughput.

Kwok, Ronald↗

Technical Note: MRI only prostate radiotherapy planning using the statistical decomposition algorithm

Purpose: In order to enable a magnetic resonance imaging (MRI) only workflow in radiotherapy treatment planning, methods are required for generating Hounsfield unit (HU) maps (i.e., synthetic computed tomography, sCT) for dose calculations, directly from MRI. The Statistical Decomposition Algorithm (SDA) is a method for automatically generating sCT images from a single MR image volume, based on automatic tissue classification in combination with a model trained using a multimodal template material. This study compares dose calculations between sCT generated by the SDA and conventional CT in the male pelvic region. Methods: The study comprised ten prostate cancer patients, for whom a 3D T2 weighted MRI and a conventional planning CT were acquired. For each patient, sCT images were generated from the acquired MRI using the SDA. In order to decouple the effect of variations in patient geometry between imaging modalities from the effect of uncertainties in the SDA, the conventional CT was nonrigidly registered to the MRI to assure that their geometries were well aligned. For each patient, a volumetric modulated arc therapy plan was created for the registered CT (rCT) and recalculated for both the sCT and the conventional CT. The results were evaluated using several methods, including mean average error (MAE), a set of dose-volume histogram parameters, and a restrictive gamma criterion (2% local dose/1 mm). Results: The MAE within the body contour was 36.5 ± 4.1 (1 s.d.) HU between sCT and rCT. Average mean absorbed dose difference to target was 0.0% ± 0.2% (1 s.d.) between sCT and rCT, whereas it was −0.3% ± 0.3% (1 s.d.) between CT and rCT. The average gamma pass rate was 99.9% for sCT vs rCT, whereas it was 90.3% for CT vs rCT. Conclusions: The SDA enables a highly accurate MRI only workflow in prostate radiotherapy planning. The dosimetric uncertainties originating from the SDA appear negligible and are notably lower than the uncertainties introduced by variations in patient geometry between imaging sessions.

60 APPLIED LIFE SCIENCES↗

Realistic galaxy image simulation via score-based generative models

ABSTRACT We show that a denoising diffusion probabilistic model (DDPM), a class of score-based generative model, can be used to produce realistic mock images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic Instrument (DESI) grz imaging of galaxies from the Photometry and Rotation curve OBservations from Extragalactic Surveys (PROBES) sample and galaxies selected from the Sloan Digital Sky Survey. Subjectively, the generated galaxies are highly realistic when compared with samples from the real data set. We quantify the similarity by borrowing from the deep generative learning literature, using the ‘Fréchet inception distance’ to test for subjective and morphological similarity. We also introduce the ‘synthetic galaxy distance’ metric to compare the emergent physical properties (such as total magnitude, colour, and half-light radius) of a ground truth parent and synthesized child data set. We argue that the DDPM approach produces sharper and more realistic images than other generative methods such as adversarial networks (with the downside of more costly inference), and could be used to produce large samples of synthetic observations tailored to a specific imaging survey. We demonstrate two potential uses of the DDPM: (1) accurate inpainting of occluded data, such as satellite trails, and (2) domain transfer, where new input images can be processed to mimic the properties of the DDPM training set. Here we ‘DESI-fy’ cartoon images as a proof of concept for domain transfer. Finally, we suggest potential applications for score-based approaches that could motivate further research on this topic within the astronomical community.

79 ASTRONOMY AND ASTROPHYSICS↗