Search NASA⌕ Search

SEARCH · Search NASA

Results for “Synthetic Image Generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Proton Radiography Imager:Generates Synthetic Proton Radiographs

ProRad is a computer program that is used to generate synthetic images of proton (or other charged particles) radiographs. The proton radiographs arc images that arc obtained by sending energetic protons (or electrons or positrons, for example) through 11 plasma where electric and/or magnetic fields alter the particles trajectory, Dnd the variations me imaged on RC film, image plate, or equivalent

Wilks, ScottC.↗

Proton Radiography Imager:Generates Synthetic Proton Radiographs

ProRad is a computer program that is used to generate synthetic images of proton (or other charged particles) radiographs. The proton radiographs arc images that arc obtained by sending energetic protons (or electrons or positrons, for example) through 11 plasma where electric and/or magnetic fields alter the particles trajectory, Dnd the variations me imaged on RC film, image plate, or equivalent

Wilks, Scott C.↗

PIV/BOS synthetic image generation in variable density environments for error analysis and experiment design

In this work, we present an image generation methodology based on ray tracing that can be used to render realistic images of Particle Image Velocimetry (PIV) and Background Oriented Schlieren (BOS) experiments in the presence of density/refractive index gradients. This methodology enables the simulation of aero-thermodynamics experiments for experiment design, error, and uncertainty analysis. Images are generated by emanating light rays from the particles or dot pattern, and propagating them through the density gradient field and the optical elements, up to the camera sensor. The rendered images are realistic, and can replicate the features of a given experimental setup, like optical aberrations and perspective effects, which can be deliberately introduced for error analysis. We demonstrate this methodology by simulating a BOS experiment with a known density field obtained from direct numerical simulations (DNS) of homogeneous buoyancy driven turbulence, and comparing the light ray displacements from ray tracing to results from BOS theory. The light ray displacements show good agreement with the reference data. This methodology provides a framework for further development of simulation tools for use in experiment design and development of image analysis tools for PIV and BOS applications. Finally, an implementation of the proposed methodology in a Python-CUDA program is made available as an open source software for researchers.

47 OTHER INSTRUMENTATION↗

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗

Implementation of a Novel Algorithm For Generating Synthetic CT Images From Magnetic Resonance Imaging Data Sets for Prostate Cancer Radiation Therapy

Purpose: To describe and evaluate a method for generating synthetic computed tomography (synCT) images from magnetic resonance simulation (MR-SIM) data for accurate digitally reconstructed radiograph (DRR) generation and dose calculations in prostate cancer radiation therapy. Methods and Materials: A retrospective evaluation was performed in 9 prostate cancer patients who had undergone MR-SIM in addition to CT simulation (CT-SIM). MR-SIM data were used to generate synCT images by using a novel, voxel-based weighted summation approach. A subset of patients was used for weight optimization, and the number of patients to use during optimization was determined. Hounsfield unit (HU) differences between CT-SIM and synCT images were analyzed via mean absolute error (MAE). Original, CT-based treatment plans were mapped onto synCTs. DRRs were generated, and agreement between CT and synCT-generated DRRs was evaluated via Dice similarity coefficient (DSC). Dose was recalculated, and dose-volume metrics and gamma analysis were used to evaluate resulting treatment plans. Results: Full field-of-view synCT MAE across all patients was 74.3 ± 10.9 HU with differences from CTs of 2.0 ± 8.1 HU and 11.9 ± 46.7 HU for soft tissue structures (prostate, bladder, and rectum) and femoral bones, respectively. Calculated DSCs for anterior-posterior and lateral DRRs were 0.90 ± 0.04 and 0.92 ± 0.05, respectively. Differences in D99%, mean dose, and maximum dose to the clinical target volume from CT-SIM dose calculations were 0.75% ± 0.35%, 0.63% ± 0.34%, and 0.54% ± 0.33%, respectively, for synCT-generated plans. Gamma analysis (2%/2 mm dose difference/distance to agreement) revealed pass rates of 99.9% ± 0.1% (range, 99.7%-100%). Conclusion: Generated synCTs enabled accurate DRR generation and dose computation for prostate MR-only simulation. Dose recalculated on synCTs agreed well with original planning distributions. Further validation using a larger patient cohort is warranted.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

RockFlow: Fast Generation of Synthetic Source Rock Images Using Generative Flow Models

Image-based evaluation methods are a valuable tool for source rock characterization. The time and resources needed to obtain images has spurred development of machine-learning generative models to create synthetic images of pore structure and rock fabric from limited image data. While generative models have shown success, existing methods for generating 3D volumes from 2D training images are restricted to binary images and grayscale volume generation requires 3D training data. Shale characterization relies on 2D imaging techniques such as scanning electron microscopy (SEM), and grayscale values carry important information about porosity, kerogen content, and mineral composition of the shale. Here, we introduce RockFlow, a method based on generative flow models that creates grayscale volumes from 2D training data. We apply RockFlow to baseline binary micro-CT image volumes and compare performance to a previously proposed model. We also show the extension of our model to 2D grayscale data by generating grayscale image volumes from 2D SEM and dual modality nanoscale shale images. The results show that our method underestimates the porosity and surface area on the binary baseline datasets but is able to generate realistic grayscale image volumes for shales. With improved binary data preprocessing, we believe that our model is capable of generating synthetic porous media volumes for a very broad class of rocks from shale to carbonates to sandstone.

58 GEOSCIENCES↗

Assessing the Dosimetric Accuracy of Magnetic Resonance-Generated Synthetic CT Images for Focal Brain VMAT Radiation Therapy

Purpose: The purpose of this study was to assess the dosimetric accuracy of synthetic CT (MRCT) volumes generated from magnetic resonance imaging (MRI) data for focal brain radiation therapy. Methods and Materials: A study was conducted in 12 patients with gliomas who underwent both MR and CT imaging as part of their simulation for external beam treatment planning. MRCT volumes were generated from MR images. Patients' clinical treatment planning directives were used to create 12 individual volumetric modulated arc therapy (VMAT) plans, which were then optimized 10 times on each of their respective CT and MRCT-derived electron density maps. Dose metrics derived from optimization criteria, as well as monitor units and gamma analyses, were evaluated to quantify differences between the imaging modalities. Results: Mean differences between planning target volume (PTV) doses on MRCT and CT plans across all patients were 0.0% (range: −0.1 to 0.2%) for D{sub 95%}; 0.0% (−0.7 to 0.6%) for D{sub 5%}; and −0.2% (−1.0 to 0.2%) for D{sub max}. MRCT plans showed no significant changes in monitor units (−0.4%) compared to CT plans. Organs at risk (OARs) had average D{sub max} differences of 0.0 Gy (−2.2 to 1.9 Gy) over 85 structures across all 12 patients, with no significant differences when calculated doses approached planning constraints. Conclusions: Focal brain VMAT plans optimized on MRCT images show excellent dosimetric agreement with standard CT-optimized plans. PTVs show equivalent coverage, and OARs do not show any overdose. These results indicate that MRI-derived synthetic CT volumes can be used to support treatment planning of most patients treated for intracranial lesions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The LSST DESC data challenge 1: generation and analysis of synthetic images for next-generation surveys

Data Challenge 1 (DC1) is the first synthetic data set produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST data set. DC1 is comprised of r -band observations of 40 deg 2 to 10 yr LSST depth. In this paper, we present each stage of the simulation and analysis process: (a) generation, by synthesizing sources from cosmological N -body simulations in individual sensor-visit images with different observing conditions; (b) reduction using a development version of the LSST Science Pipelines; and (c) matching to the input cosmological catalogue for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star–galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: (i) survey properties have an impact of 50 per cent of the statistical uncertainty for the scales and models used in DC1; (ii) a selection to eliminate artefacts in the catalogues is necessary to avoid biases in the measured clustering; and (iii) the presence of bright objects has a significant impact (2σ–6σ) in the estimated power spectra at small scales (ℓ > 1200), highlighting the impact of blending in studies at small angular scales in LSST.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗

The Characterization of a DIRSIG Simulation Environment to Support the Inter-Calibration of Spaceborne Sensors

Climate change studies require long-term, continuous records that extend beyond the lifetime, and the temporal resolution, of a single remote sensing satellite sensor. The inter-calibration of spaceborne sensors is therefore desired to provide spatially, spectrally, and temporally homogeneous datasets. The Digital Imaging and Remote Sensing Image Generation (DIRSIG) tool is a first principle-based synthetic image generation model that has the potential to characterize the parameters that impact the accuracy of the inter-calibration of spaceborne sensors. To demonstrate the potential utility of the model, we compare the radiance observed in real image data to the radiance observed in simulated image from DIRSIG. In the present work, a synthetic landscape of the Algodones Sand Dunes System is created. The terrain is facetized using a 2-meter digital elevation model generated from NASA Goddard's LiDAR, Hyperspectral, and Thermal (G-LiHT) imager. The material spectra are assigned using hyperspectral measurements of sand collected from the Algodones Sand Dunes System. Lastly, the bidirectional reflectance distribution function (BRDF) properties are assigned to the modeled terrain using the Moderate Resolution Imaging Spectroradiometer (MODIS) BRDF product in conjunction with DIRSIG's Ross-Li capability. The results of this work indicate that DIRSIG is in good agreement with real image data. The potential sources of residual error are identified and the possibilities for future work are discussed..

Ambeau, Brittany L.↗

Benchmark Imagery Project: Report on Generation of Synthetic Images

The “Benchmark Imagery” project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities (e.g., auto-annotation). The project is a collaborative effort between Los Alamos National Laboratory (LANL) and the Lawrence Livermore National Laboratory (LLNL). Although a variety of image modalities are used to capture overhead photographs of terrestrial facilities, the current focus of the effort of this project is on collecting and annotating conventional visual-band (RGB or RGB/NIR) images. Presently, the set of images consists of 114 airborne images of various US industrial facilities. We have annotated all of the images in the imagery set, using a constrained vocabulary of about a dozen general terms such as “building,” ”tower,” or “electrical substation.” The project plans to include synthetic and composite images in addition to actual photographs. In preparation for using synthetic images, we have built a proof-of-principle synthetic image of a fictitious nuclear power plant. This report describes the key aspects of creating that image.

97 MATHEMATICS AND COMPUTING↗

Obstacle Detection Algorithms for Rotorcraft Navigation

In this research we addressed the problem of obstacle detection for low altitude rotorcraft flight. In particular, the problem of detecting thin wires in the presence of image clutter and noise was studied. Wires present a serious hazard to rotorcrafts. Since they are very thin, their detection early enough so that the pilot has enough time to take evasive action is difficult, as their images can be less than one or two pixels wide. After reviewing the line detection literature, an algorithm for sub-pixel edge detection proposed by Steger was identified as having good potential to solve the considered task. The algorithm was tested using a set of images synthetically generated by combining real outdoor images with computer generated wire images. The performance of the algorithm was evaluated both, at the pixel and the wire levels. It was observed that the algorithm performs well, provided that the wires are not too thin (or distant) and that some post processing is performed to remove false alarms due to clutter.

Kasturi, Rangachar↗

Wire Detection Algorithms for Navigation

In this research we addressed the problem of obstacle detection for low altitude rotorcraft flight. In particular, the problem of detecting thin wires in the presence of image clutter and noise was studied. Wires present a serious hazard to rotorcrafts. Since they are very thin, their detection early enough so that the pilot has enough time to take evasive action is difficult, as their images can be less than one or two pixels wide. Two approaches were explored for this purpose. The first approach involved a technique for sub-pixel edge detection and subsequent post processing, in order to reduce the false alarms. After reviewing the line detection literature, an algorithm for sub-pixel edge detection proposed by Steger was identified as having good potential to solve the considered task. The algorithm was tested using a set of images synthetically generated by combining real outdoor images with computer generated wire images. The performance of the algorithm was evaluated both, at the pixel and the wire levels. It was observed that the algorithm performs well, provided that the wires are not too thin (or distant) and that some post processing is performed to remove false alarms due to clutter. The second approach involved the use of an example-based learning scheme namely, Support Vector Machines. The purpose of this approach was to explore the feasibility of an example-based learning based approach for the task of detecting wires from their images. Support Vector Machines (SVMs) have emerged as a promising pattern classification tool and have been used in various applications. It was found that this approach is not suitable for very thin wires and of course, not suitable at all for sub-pixel thick wires. High dimensionality of the data as such does not present a major problem for SVMs. However it is desirable to have a large number of training examples especially for high dimensional data. The main difficulty in using SVMs (or any other example-based learning method) is the need for a very good set of positive and negative examples since the performance depends on the quality of the training set.

Kasturi, Rangachar↗

Statistical characterization of experimental magnetized liner inertial fusion stagnation images using deep-learning-based fuel–background segmentation

Significant variety is observed in spherical crystal x-ray imager (SCXI) data for the stagnated fuel–liner system created in Magnetized Liner Inertial Fusion (MagLIF) experiments conducted at the Sandia National Laboratories Z-facility. As a result, image analysis tasks involving, e.g., region-of-interest selection (i.e. segmentation), background subtraction and image registration have generally required tedious manual treatment leading to increased risk of irreproducibility, lack of uncertainty quantification and smaller-scale studies using only a fraction of available data. We present a convolutional neural network (CNN)-based pipeline to automate much of the image processing workflow. This tool enabled batch preprocessing of an ensemble of N scans = 139 SCXI images across N exp = 67 different experiments for subsequent study. The pipeline begins by segmenting images into the stagnated fuel and background using a CNN trained on synthetic images generated from a geometric model of a physical three-dimensional plasma. The resulting segmentation allows for a rules-based registration. Our approach flexibly handles rarely occurring artifacts through minimal user input and avoids the need for extensive hand labelling and augmentation of our experimental dataset that would be needed to train an end-to-end pipeline. Here we also fit background pixels using low-degree polynomials, and perform a statistical assessment of the background and noise properties over the entire image database. Our results provide a guide for choices made in statistical inference models using stagnation image data and can be applied in the generation of synthetic datasets with realistic choices of noise statistics and background models used for machine learning tasks in MagLIF data analysis. We anticipate that the method may be readily extended to automate other MagLIF stagnation imaging applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Unreal Engine Testbed for Computer Vision of Tall Lunar Tower Assembly

The Tall Lunar Tower project at the NASA Langley Research Center is focused on the design, modeling, fabrication, and testing of a supervised autonomously assembly engineering development unit for tall lunar towers. The lunar south pole environment poses many challenges for robotic assembly of the tall tower, particularly to computer vision camera systems due to a high-contrast lighting environment. This paper will present an Unreal Engine 5 video game engine Lunar South Pole Lighting Testbed to simulate realistic lunar lighting conditions for synthetic image generation. The fidelity of the simulation environment is investigated by comparing the accuracy of computer vision models trained using synthetic image data and trained from real image data collected in a lunar analog environment.

Unreal Engine↗

Unreal Engine Testbed for Computer Vision of Tall Lunar Tower Assembly

The Tall Lunar Tower project at the NASA Langley Research Center is focused on the design, modeling, fabrication, and testing of a supervised autonomously assembled engineering development unit for tall lunar towers. The lunar south pole environment poses many challenges for robotic assembly of the tall tower, particularly to computer vision camera systems due to a high-contrast lighting environment. This paper will present an Unreal Engine 5 video game engine Lunar South Pole Lighting Testbed to simulate realistic lunar lighting conditions for synthetic image generation. The fidelity of the simulation environment is investigated by comparing the accuracy of computer vision models trained using synthetic image data and trained from real image data collected in a lunar analog environment.

Unreal Engine↗

Unreal Engine Testbed for Computer Vision of Tall Lunar Tower Assembly

The Tall Lunar Tower project at the NASA Langley Research Center is focused on the design, modeling, fabrication, and testing of a supervised autonomously assembly engineering development unit for tall lunar towers. The lunar south pole environment poses many challenges for robotic assembly of the tall tower, particularly to computer vision camera systems due to a high-contrast lighting environment. This paper will present an Unreal Engine 5 video game engine Lunar South Pole Lighting Testbed to simulate realistic lunar lighting conditions for synthetic image generation. The fidelity of the simulation environment is investigated by comparing the accuracy of computer vision models trained using synthetic image data and trained from real image data collected in a lunar analog environment.

Unreal Engine↗