Search NASA⌕ Search

SEARCH · Search NASA

Results for “image synthesis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Geometrically Matched Multi-source Microscopic Image Synthesis Using Bidirectional Adversarial Networks

Microscopic images from multiple modalities can produce plentiful experimental information. In practice, biological or physical constraints under a given observation period may prevent researchers from acquiring enough microscopic scanning. Recent studies demonstrate that image synthesis is one of the popular approaches to release such constraints. Nonetheless, most existing synthesis approaches only translate images from the source domain to the target domain without solid geometric associations. To embrace this challenge, we propose an innovative model architecture, BANIS, to synthesize diversified microscopic images from multi-source domains with distinct geometric features. The experimental outcomes indicate that BANIS successfully synthesizes favorable image pairs on C. elegans microscopy embryonic images. To the best of our knowledge, BANIS is the first application to synthesize microscopic images that associate distinct spatial geometric features from multi-source domains.

Wang, Dali↗
DOE OSTI2025

Multiscale aperture synthesis imager

Synthetic aperture imaging has enabled breakthrough observations from radar to astronomy. However, optical implementation remains challenging due to stringent wavefield synchronization requirements among multiple receivers. Here we present the multiscale aperture synthesis imager (MASI), which utilizes parallelism to break complex optical challenges into tractable sub-problems. MASI employs a distributed array of coded sensors that operate independently yet coherently to surpass the diffraction limit of single receiver. It combines the propagated wavefields from individual sensors through a computational phase synchronization scheme, eliminating the need for overlapping measurement regions to establish phase coherence. Light diffraction in MASI naturally expands the imaging field, generating phase-contrast visualizations that are substantially larger than sensor dimensions. Without using lenses, MASI resolves sub-micron features at ultralong working distances and reconstructs 3D shapes over centimeter-scale fields. MASI transforms the intractable optical synchronization problem into a computational one, enabling practical deployment of scalable synthetic aperture systems at optical wavelengths.

electrical and electronic engineering↗
DOE OSTI2020

InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations

We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations.

deep learning↗
DOE OSTI2024

Designing workflows for materials characterization

Experimental science is enabled by the combination of synthesis, imaging, and functional characterization organized into evolving discovery loop. Synthesis of new material is typically followed by a set of characterization steps aiming to provide feedback for optimization or discover fundamental mechanisms. However, the sequence of synthesis and characterization methods and their interpretation, or research workflow, has traditionally been driven by human intuition and is highly domain specific. Here, we explore concepts of scientific workflows that emerge at the interface between theory, characterization, and imaging. In this study, we discuss the criteria by which these workflows can be constructed for special cases of multiresolution structural imaging and functional characterization, as a part of more general material synthesis workflows. Some considerations for theory–experiment workflows are provided. We further pose that the emergence of user facilities and cloud labs disrupts the classical progression from ideation, orchestration, and execution stages of workflow development. To accelerate this transition, we propose the framework for workflow design, including universal hyperlanguages describing laboratory operation, ontological domain matching, reward functions and their integration between domains, and policy development for workflow optimization. These tools will enable knowledge-based workflow optimization; enable lateral instrumental networks, sequential and parallel orchestration of characterization between dissimilar facilities; and empower distributed research.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Report on the AAPM grand challenge on deep generative modeling for learning medical image statistics

Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.

Radiology, Nuclear Medicine & Medical Imaging↗
DOE OSTI2020

ALMA Band-to-band Phase Referencing: Imaging Capabilities on Long Baselines and High Frequencies

High-frequency long-baseline experiments with the Atacama Large Millimeter/submillimeter Array were organized to test the high angular resolution imaging capabilities in the submillimeter wave regime using baselines up to 16 km. Four experiments were conducted, two Band 7 (289 GHz) and two Band 8 (405 GHz) observations. Phase correction using band-to-band (B2B) phase referencing was used with a phase calibrator only [[Formula]] away observed in Band 3 (96 GHz) and Band 4 (135 GHz), respectively. In Band 8, we achieved the highest resolution of 14 × 11 mas. We compared the synthesis images of the target quasar using 20 and 60 s switching cycle times in the phase referencing. In Band 7, the atmosphere had good stability in phase rms (<0.5 rad over 2 minutes), and there was little difference in image coherence between the 20 and 60 s switching cycle times. One Band 8 experiment was conducted under a worse phase rms condition (>1 rad over 2 minutes), which led to a significantly reduced coherence when using the 60 s switching cycle time. One of our four experiments indicates that the residual phase rms error after phase referencing can be reduced to 0.16 rad at 289 GHz in using the 20 s switching cycle time. Such conditions would meet the phase correction requirement of image coherence of >70% in Band 10, assuming a similar phase calibrator separation angle, emphasizing the need for such B2B phase referencing observing at high frequencies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗
DOE OSTI2025

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗
DOE OSTI2021

Fluorescent toxins as ion channel activity sensors.

Voltage gated ion channels (VGICs) shape the electrical character of cells by undergoing structural changes in response to membrane depolarization. High-resolution techniques have provided a wealth of data on individual VGIC structures, but the conformational changes of endogenous channels in live cell membranes have remained unexplored. Here, we describe methods for imaging structural changes of voltage-gated K + channels in living cells, using peptidyl toxins labeled with fluorophores that report specific protein conformations. These Endogenous Voltage-sensor Activity Probes (EVAPs) enable study of both VGIC allostery and function in the context of endogenous live-cell membranes under different physiological states. In this chapter, we describe methods for the synthesis, imaging, and analysis of dynamic EVAPs, which can report K + channel activity in complex tissue preparations via 2-photon excitation microscopy, and environment-sensitive EVAPs, which report voltage-dependent conformational changes at the VGIC-toxin interface. The methods here present the utility of current EVAPs and lay the groundwork for the development of other probes that act by similar mechanisms. EVAPs can be correlated with electrophysiology, offering insight into the molecular details of endogenous channel function and allostery in live cells. This enables investigation of conformational changes of channels in their native, functional states, putting structures and models into a context of live-cell membranes. The expansive array of state-dependent ligands and optical probes should enable probes more generally for investigating the molecular motions of endogenous proteins.

Stewart, Robert↗
DOE OSTI2023

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Radioimaging for real-time tracking of high-voltage breakdown

Development of a radioimaging diagnostic for high-voltage component reliability testing and electrical breakdown computational model validation is described. Radioimaging has its roots in radio astronomy, where aperture synthesis (also known as synthesis imaging) has been utilized for decades to image radio sources far from Earth. Radioimaging as described herein, in contrast, seeks to image radio sources in close proximity to its receivers (i.e., in a laboratory environment). Here it is shown that corona discharge, a non-destructive precursor to catastrophic (thermal) arc discharge, electromagnetically radiates strongly within a 250 kHz – 2.5 GHz bandwidth, and is readily detected and located by postprocessing the received radio signals. The ability of radioimaging to detect both corona and arc discharge (grouped together herein as high voltage breakdown or HVB) makes it a valuable tool for 100% HVB detection in materials, components, and devices, and has the ability to indicate electrical weakness (via corona detection) prior to a destructive arc discharge event. Radioimaging enables HVB to be located both internal and external to dielectric components under test in near-real-time, with multiple and/or extended HVB events located simultaneously. In contrast, existing non-destructive diagnostics (at the time of this writing) either indicate electrical breakdown without resolving failure locations (e.g., current, voltage, and chemical measurements), locate external HVB (e.g., high-speed optical and ultraviolet (UV) measurements or photography), or locate both external and internal HVB but with low fidelity (e.g., a single HVB source can be located by existing time-of-arrival (TOA) UHF or acoustic emissions). Radioimaging instead creates a sequence of high-fidelity images similar to an optical high-speed camera but at radiofrequencies (RF), and is not limited to two-dimensions. Moreover, radioimaging has already served one internal and two external industry customers, the results of which are detailed in this report. The radioimaging results described herein were part of a three-year effort funded by the Sandia Lab Directed Research and Development (LDRD) program within the Radiation, Electromagnetic, High Energy Density Science (REHEDS) investment area.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

High-throughput chemical imaging for optimizing biofuel synthesis using synthetic biology (Final Technical Report)

Fatty acids can be produced biosynthetically in microbes and these compounds can serve as precursors to biodiesels and other high value oleochemicals. However, progress on engineering fatty acid biosynthesis, and biofuel synthesis more generally, has been hindered by current quantification methods that are either indirect or not amenable to high-throughput or single-cell resolution screening. In this project, we assembled an interdisciplinary team with complimentary expertise in synthetic biology and microscopy, metabolic engineering, and chemical imaging to address these challenges. We used chemical imaging to directly measure lipid biosynthesis in Escherichia coli engineered to produce fatty acids, obtaining detailed single-cell resolution measurements. We deployed stimulated Raman scattering (SRS) microscopy in concert with multiplexed genome engineering and gene circuit design strategies from synthetic biology to optimize production of fatty acids. These results provided novel insight into cell-to-cell heterogeneity present in biofuel production strains. In addition, we introduced new chemical imaging methods which are label-free and do not require fluorescent reporters. These efforts were complemented by other studied developing foundational tools for regulation and control, which offer excellent potential for advancing researchers’ ability to rapidly design, build, and test strains for enhanced biofuel synthesis.

09 BIOMASS FUELS↗
DOE OSTI2025

De novo synthesis and near atomic resolution imaging of host immune receptors critical for pathogen recognition (Abbreviated Final Report)

The innate immune system serves as the body’s first line of defense against invading pathogens, responding rapidly through the deployment of immune cells at common sites of infection, such as the skin and airways. These immune-cell sentinels express a range of highly conserved receptors, including Toll-like receptors (TLRs), which recognize and bind to pathogen-derived components. This recognition event triggers intracellular signaling cascades that initiate and coordinate immune responses. Despite their significance, the complete structural characterization of full-length TLRs, including their extracellular domain (ECD), transmembrane domain (TMD), and Toll/interleukin-1 receptor (TIR) domain, remains incomplete. In this study, we examined the expression and isolation of human TLR4 incorporated into nanodiscs using two approaches: a cell-free synthesis system and a cell-based transfection strategy employing Expi293F cells derived from the human embryonic kidney lineage. Our findings demonstrate that NLP-bound human TLR4 produced via the cell-based method yielded functional protein suitable for time-resolved single-particle cryo-electron microscopy (cryo-EM). This advancement enables structural characterization of full-length TLR4, maintaining the integrity of its extracellular domain, transmembrane domain, and Toll/Interleukin-1 receptor (TIR) domain.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

High-temperature thermal imaging to inform the arc-melt synthesis of nuclear materials

The advancement of nuclear energy technology necessitates the development of novel materials and synthesis methods to produce materials which enable new fuel cycles. Alongside the maturation of R&D scale technologies to produce these materials, there is an ongoing effort to develop in situ monitoring capabilities to reduce the time to the discovery and development of these fuels. Monitoring data can be leveraged in artificial intelligence platforms to detect phenomena which lead to varied macro- and microstructural features which impact the application and performance of samples synthesized. The present study presents early-stage findings of the implementation of high-temperature, high-frame-rate infrared thermal imaging to monitor the arc-melt synthesis of novel fuels and compounds relevant to advanced nuclear reactors. The study illustrates both the challenges and opportunities of this methodology, highlighting the importance of internal standards while determining emissivity and transmission values as well as visualizing volatilization during melt synthesis.

Stone, Jordan↗