Search NASA⌕ Search

SEARCH · Search NASA

Results for “GANS image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Non-Blind Deblurring for Fluorescence: A Deformable Latent Space Approach with Kernel Parameterization

We report N\non-blind deblurring (NBD) is a modeling method of the image deblurring problem in computer vision, where the blurring kernel is known or can be externally estimated. In this paper, we attempt to solve a parametric NBD problem, inspired by the simultaneous acquisition of ptychography and fluorescent imaging (FI). Ptychography is an imaging method that favors larger probes, i.e. convolutional kernels, while FI relies on a small probe for high resolution. Also, the kernel can be solved during ptychographic reconstruction. With Ptycho-FI using the same larger kernel, we can perform NBD on the blurred fluorescent images to achieve high-resolution FI, and thus speed up the experiments. To this end, we design a deep latent space deformation network that is directly parameterized by the kernel. The network consists of three components: encoder, deformer, and decoder, where the deformer is specifically meant to rectify the latent space representations of blurred images to a standard latent space, regardless of the kernel. The deformation network is trained with a two-stage training scheme. We conduct extensive experiments to confirm that our parametric model can adapt to drastically different blurring kernels and perform robust deblurring.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

A Dataset of CFD Simulated Industrial Furnace Images for Conditional Automatic Generation with GANs

The steel industry is constantly looking for ways to automate processes and improve efficiency. A standard practice in industry is to simulate how complex systems will operate before they are actually used. Some complex systems, including steel industry processes such as blast furnaces, require complex physics-based simulations utilizing computational fluid dynamics (CFD). These CFD physics-based simulations are very accurate but can take significant time and computational resources to process, resulting in challenges for the implementation of the models in real-world operational environments. In recent years, deep learning (DL) has been considered as a substitute for these CFD models. DL models can be trained on validated CFD simulation data and then used for industrial process inference. Previous DL-based solutions have made great contributions for industrial automation but are currently missing the additional visualization component that CFD simulations also provide. In this paper, we propose a dataset for simple DL generative approaches that can help to address this issue. The dataset and methodology under development to approach this prediction are discussed in this work.

Calix, Ricardo↗
DOE OSTI2025

Three-dimensional photoluminescence imaging of threading dislocations in GaN by sub-band optical excitation

GaN is rapidly gaining attention for implementation in power electronics but is still impacted by its high density of threading dislocations (TDs), which have been shown to facilitate current leakage through devices limiting their performance and reliability. Here, we discuss a novel implementation of photoluminescence (PL) imaging to study TDs in regions within vertically structured p-i-n GaN (PIN) diodes consisting of metalorganic chemical vapor deposition (MOCVD) epitaxial layers grown on ammonothermal GaN (am-GaN) substrates. PL imaging with a sub-bandgap excitation energy (3.1 eV) reveals TDs with excellent clarity in three dimensions within the am-GaN substrate. Galvanometric-driven PL imaging allows the microstructure of hundreds of devices to be characterized in a single session, enhancing the screening process through the addition of device specific TD location tracking and density mapping. The visibility, structural characteristics, luminescent nature and evolution of TDs through the GaN growth process are described, potentially providing the ability to define TD structures associated with leakage current.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Recent development of thermoelectric nanofibers and their composites

This review deals with the recent development of thermoelectric (TE) nanofibers and their composite materials. Typical processing and manufacturing technologies for preparing nanofibers are introduced. Specifically, electrospinning, electrochemical oxidation, and liquid phase chemical deposition approaches are discussed. Various kinds of TE nanofibers are introduced one-by-one. Several important inorganic and organic nanofibers including carbon-based nanofibers, conducting polymer-based nanofibers, and transition metal oxide-based nanofibers with significant thermoelectric responses are shown. Thermoelectric properties of some important nanofibers are compared. The applications of TE nanofibers for energy conversion, thermal imaging and temperature sensing are illustrated. Perspectives and concluding remarks are presented.

42 ENGINEERING↗
DOE OSTI2023

Parameters, Properties, and Process: Conditional Neural Generation of Realistic SEM Imagery Toward ML-Assisted Advanced Manufacturing

Abstract The research and development cycle of advanced manufacturing processes traditionally requires a large investment of time and resources. Experiments can be expensive and are hence conducted on relatively small scales. This poses problems for typically data-hungry machine learning tools which could otherwise expedite the development cycle. We build upon prior work by applying conditional generative adversarial networks (GANs) to scanning electron microscope (SEM) imagery from an emerging advanced manufacturing process, shear-assisted processing and extrusion (ShAPE). We generate realistic images conditioned on temper and either experimental parameters or material properties. In doing so, we are able to integrate machine learning into the development cycle, by allowing a user to immediately visualize the microstructure that would arise from particular process parameters or properties. This work forms a technical backbone for a fundamentally new approach for understanding manufacturing processes in the absence of first-principle models. By characterizing microstructure from a topological perspective, we are able to evaluate our models’ ability to capture the breadth and diversity of experimental scanning electron microscope (SEM) samples. Our method is successful in capturing the visual and general microstructural features arising from the considered process, with analysis highlighting directions to further improve the topological realism of our synthetic imagery.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A Scalable & Non-Destructive Characterization Strategy to Study Semiconductor/Dielectric Interfaces and Predict Wafer-Level Device Performance

The defect density present at the dielectric-semiconductor interface in an MOS structure directly influences the channel carrier characteristics in semiconductor devices, especially in wide bandgap material systems used in power devices. While these trap defects are typically quantified through electrical characterization of MOS-capacitor test structures, this treatment offers very little insight into the physical nature of interface defects. Such shortcomings demand a physical characterization strategy to guide fabrication optimization. X-ray photoelectron spectroscopy (XPS) is suggested as a viable technique to determine chemical data for dielectric interfaces formed using atomic layer deposition (ALD) on GaN substrates. Previously, 1-D XPS characterization has confirmed the presence of a Ga x O y interlayer between ALD dielectrics and the GaN substrate. In this work, XPS data is serially collected to form 2-D images of an ALD-Al 2 O 3 /GaN interface as a proof-of-concept experiment for in-situ XPS quality monitoring during ALD processing. The information provided by this work reveals some of the challenges for incorporating XPS characterization as an in-situ strategy during fabrication of GaN-based devices. Separately, electrical mapping of a 2-D array of ALD-Al 2 O 3 /GaN MOS-capacitor devices provide a means to quantify the spatial variations in interface quality across a single wafer. Physical characterization techniques, such as time-of-flight secondary ion mass spectroscopy, provide additional chemical information about the Al 2 O 3 /Ga x O y /GaN structure that complement the electrical mapping results. This analysis shows that a higher Ga x O y content correlates with higher interface state defects for trap energies deep in the band gap.

42 ENGINEERING↗
DOE OSTI2024

Image processing tools for petabyte-scale light sheet microscopy data

Light sheet microscopy is a powerful technique for high-speed three-dimensional imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present PetaKit5D, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are optimized for memory and performance. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson–Lucy deconvolution and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Constrained GAN-Generated X-Ray CT Data For Self-Supervised And Foundation-Model Segmentation Of Concrete Microstructures

Three-dimensional characterization of materials using X-ray computed tomography (XCT) is challenging due to the complexity of internal structures, noise, and variations in resolution. Traditional computer vision models often struggle to accurately segment these images, particularly in domain-specific applications like materials science. While supervised deep learning approaches have been developed to address the limitations of conventional algorithms, they typically require large amounts of labeled training data and often fail to generalize across different datasets. Self-supervised, few-and zero-shot learning methods have gained prominence in natural image processing and segmentation tasks, but their application to scientific imaging remains limited due to the unique structural complexity, noise, and textural artifacts present in materials science data. In this work, we investigate how domain adaptation, leveraging physics-based and GAN-generated synthetic data, impacts segmentation performance. We introduce a modified Contrastive Unpaired Translation (CUT) model designed to generate realistic labeled data, which can be used for training, pre-training, and fine-tuning segmentation models for real XCT microstructure data. We evaluate the performance of two segmentation approaches: a self-supervised network (SSL-ALPNet) and a foundation model (Segment Anything Model), assessing their improvements when pre-trained and/or fine-tuned on the synthesized data. Our results demonstrate that leveraging synthetic data significantly enhances segmentation performance, particularly in challenging materials science applications.

Ziabari, Amir [ORNL] (ORCID:000000034776457X)↗
DOE OSTI2024

Thermal Transport and Mechanical Stress Mapping of a Compression Bonded GaN/Diamond Interface for Vertical Power Devices

Bonding diamond to the back side of gallium nitride (GaN) electronics has been shown to improve thermal management in lateral devices; however, engineering challenges remain with the bonding process and characterizing the bond quality for vertical device architectures. Here, in this study, integration of these two materials is achieved by room-temperature compression bonding centimeter-scale GaN and a diamond die via an intermetallic bonding layer of Ti/Au. Recent attempts at GaN/diamond bonding have utilized a modified surface activation bonding (SAB) method, which requires Ar fast atom bombardment immediately followed by bonding within the same tool under ultrahigh vacuum (UHV) conditions. The method presented here does not require a dedicated SAB tool yet still achieves bonding via a room-temperature metal–metal compression process. Imaging of the buried interface and the total bonding area is achieved via transmission electron microscopy (TEM) and confocal acoustic scanning microscopy (C-SAM), respectively. The thermal transport quality of the bond is extracted from spatially resolved frequency-domain thermoreflectance (FDTR) with the bonded areas boasting a thermal boundary conductance of >100 MW/m 2 ·K. Additionally, Raman maps of GaN near the GaN–diamond interface reveal a low level of compressive stress, <80 MPa, in well-bonded regions. FDTR and Raman were coutilized to map these buried interfaces and revealed some poor thermally bonded areas bordered by high-stress regions, highlighting the importance of spatial sampling for a complete picture of bond quality. Overall, this work demonstrates a novel method for thermal management in vertical GaN devices that maintains low intrinsic stresses while boasting high thermal boundary conductances.

Raman↗
DOE OSTI2021

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Geometrical-Based Generative Adversarial Network to Enhance Digital Rock Image Quality

X-ray microcomputed tomography (micro-CT) is a common tool for the study of porous media structures and properties. High-quality micro-CT data are required to accurately capture pore structures. Acquiring high-quality micro-CT data, however, is not always possible, owing to application limitations and experimental constraints. Therefore, we propose a geometrical-based generative adversarial network (GAN) to rapidly restore noisy micro-CT images to their clean counterparts. The training data and related ground-truth (GT) data are scanned for 7 min and 9.5 h, respectively. To evaluate the performance of the geometrical-based GAN, a 6003 voxel image that has never been used for training is reconstructed and compared with the corresponding GT image. Histogram matching and linear normalization are implemented to adjust the histogram of the reconstructed image to that of the GT image. A watershed-based segmentation method is then applied to delineate pore and solid phases. Lastly, we measure the Minkowski functionals and petrophysical properties, including absolute permeability, pore size distribution, drainage capillary pressure-saturation curve, and imbibition relative permeability, to estimate the physical accuracy of the denoised image. The results show that the proposed geometrical-based GAN can accurately restore noisy micro-CT data. By reducing the scanning time from 9.5 h to 7 min, the expenditure of collecting micro-CT can be decreased significantly. This is particularly important for applications where time-lapse images of a dynamic process are required, high-throughput imaging is necessary for real-time data analysis, or where the quantification of large sample volumes is required.

58 GEOSCIENCES↗
DOE OSTI2022

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Massive all-atom analysis of 2D materials with quantum properties (Final report)

Improvements in microscopy have enabled the acquisition of data at a scale that is difficult to process manually, making automated machine learning approaches to analyzing experimental images essential. In this project, we developed and applied machine learning (ML) workflows for atomic resolution scanning transmission electron microscopy (STEM) images. This development included improving both methodology as well as generating user-friendly codes. We developed machine learning architectures which, after training, automatically identify the location and types of defects throughout a material. We used these data to produce class-averaged images of 2D atomic coordinates with up to 0.3 pm precision, uncovering the structure and oscillations of long-range strain fields around point defects in WSe 2-2x Te 2x . We also resolved a long-standing problem in this field in the training of ML models, a lack of labeled experimental data, by developing a cycle-GAN that transformed simulated-generated labeled data into labeled data indistinguishable from experiment and therefore suitable for training. This removed the remaining parts of the ML data processing workflow where human intervention was still critical and therefore a bottleneck to working at scale. Codes have been developed and released for this full machine learning workflow. ML approaches to partially automate STEM acquisition were also developed. Finally we applied ML and other advanced data processing methods to several materials science problems in two-dimensional materials, including studying the evolution of hyperuniformity with defect concentration in WSe2, understanding phase transformations in transition metal dichalcogenides during in-situ heating in the STEM, and exploring how 2D interfaces transform from twisted into aligned structures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Technical Performance and Cost Optimization of Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) for Wide-area Surveillance and Identification of Marine Life at Marine Energy Installations

Florida Atlantic University developed an underwater optical monitoring system prototype - Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) - suitable for marine energy full project lifecycle observation (baseline, commissioning, and decommissioning), with an automated real-time classification of marine animals. With precursor 2014 DOE funding (award DE-EE0006787), a prototype UMSLI was demonstrated in a controlled laboratory environment and achieved a TRL 6. This EERE DE-EE0007828 award aimed to both increase the TRL of the UMSLI by improving the technology performance (e.g., increase distance of marine animal target detection capability, add additional species classification capabilities, improve the system performance during the day, etc.) and reduce the cost. The UMSLI presents a novel application of underwater distributed Light Detection And Ranging (LiDAR), an advanced remote sensing method that uses light in the form of laser pulses for an application, this paired with an algorithm provides 360 degrees underwater detection, imaging, and classification of marine life. This solution for underwater monitoring of biota preserves the advantages of traditional optical and acoustic solutions while overcoming many associated disadvantages for marine energy site environmental monitoring, such as difficulties in species detection and classification in low light or night and turbid environments. This new approach is a purposefully designed, reconfigurable adaptation of an existing class 3B laser technology into one UMSLI instrument that can be easily mounted on or around different classes of marine energy equipment, such as devices to capture ocean current energy or wave energy. The system uses relatively low average power, utilizes far-red (> 635nm) laser illumination to be invisible and eye-safe to marine animals, is compact, and cost-effective. The equipment is designed for long-term, maintenance-free operations (i.e., current design is targeting more than 7 days continuous operation), to inherently generate a sparse primary dataset that only includes detected anomalies, and to allow robust real-time automated animal classification and identification with a low data bandwidth requirement. The technology’s overarching goal for application, is a system that can be deployed to collect pre-installation baseline species observations at a proposed marine energy deployment site with minimal post-processing overhead. The envisioned system will also produce high-resolution imagery of marine animals through a wide range of conditions and support automated tracking and notification of the presence of managed animals within established perimeters of marine energy equipment to satisfy deployed marine energy projects’ endangered and threatened species monitoring requirements. Through the current project, we demonstrated the UMSLI prototype in an operational environment and increased the UMSLI’s Technology Readiness Level from 6 to 7. The project resulted in many novel technologies, including: 1) an eye-safe red laser based, low-cost LiDAR system that can detect targets up to 10 meters distance; 2) the GAN-based machine learning underwater LiDAR image enhancement technique (this is the first known application of GAN technique in underwater LiDAR); 3) LiDAR-based real-time automated detection capabilities; and 4) a template matching based automated classification tool. These technologies build a solid foundation for future efforts to develop an extended range electro-optical monitoring system suitable for marine energy deployments. In addition to technology development, a key lesson learned is that addressing regulatory and safety requirements must be front and center in any marine energy monitoring applications.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Fabrication and field emission properties of vertical, tapered GaN nanowires etched via phosphoric acid

The controlled fabrication of vertical, tapered, and high-aspect ratio GaN nanowires via a two-step top-down process consisting of an inductively coupled plasma reactive ion etch followed by a hot, 85% H 3 PO 4 crystallographic wet etch is explored. The vertical nanowires are oriented in the $[0001]$ direction and are bound by sidewalls comprising of $\{33\bar{6}2\}$ semipolar planes which are at a 12° angle from the [0001] axis. High temperature H3PO4 etching between 60 °C and 95 °C result in smooth semipolar faceting with no visible micro-faceting, whereas a 50 °C etch reveals a micro-faceted etch evolution. High-angle annular dark-field scanning transmission electron microscopy imaging confirms nanowire tip dimensions down to 8–12 nanometers. The activation energy associated with the etch process is 0.90 ± 0.09 eV, which is consistent with a reaction-rate limited dissolution process. The exposure of the $\{33\bar{6}2\}$ type planes is consistent with etching barrier index calculations. The field emission properties of the nanowires were investigated via a nanoprobe in a scanning electron microscope as well as by a vacuum field emission electron microscope. Finally, the measurements show a gap size dependent turn-on voltage, with a maximum current of 33 nA and turn-on field of 1.92 V nm -1 for a 50 nm gap, and uniform emission across the array.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

All-optical phase conjugation using diffractive wavefront processing

Abstract Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with applications ranging from imaging to beam focusing. Here, we present a diffractive wavefront processor to approximate all-optical phase conjugation. Leveraging deep learning, a set of diffractive layers was optimized to all-optically process an arbitrary phase-aberrated input field, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated this wavefront processor by 3D-fabricating diffractive layers and performing OPC on phase distortions never seen during training. Employing terahertz radiation, our diffractive processor successfully performed OPC through a shallow volume that axially spans tens of wavelengths. We also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and multi-wavelength nature, this diffractive wavefront processor can be used for various applications, e.g., turbidity suppression and aberration correction across different spectral bands.

42 ENGINEERING↗
DOE OSTI2021

Universal scaling laws of keyhole stability and porosity in 3D printing of metals

Metal three-dimensional (3D) printing includes a vast number of operation and material parameters with complex dependencies, which significantly complicates process optimization, materials development, and real-time monitoring and control. We leverage ultrahigh-speed synchrotron X-ray imaging and high-fidelity multiphysics modeling to identify simple yet universal scaling laws for keyhole stability and porosity in metal 3D printing. The laws apply broadly and remain accurate for different materials, processing conditions, and printing machines. We define a dimensionless number, the Keyhole number, to predict aspect ratio of a keyhole and the morphological transition from stable at low Keyhole number to chaotic at high Keyhole number. Furthermore, we discover inherent correlation between keyhole stability and porosity formation in metal 3D printing. By reducing the dimensions of the formulation of these challenging problems, the compact scaling laws will aid process optimization and defect elimination during metal 3D printing, and potentially lead to a quantitative predictive framework.

42 ENGINEERING↗
DOE OSTI2022

Analysis of Defects in Metal Additive Manufacturing with Augmented Data Generation

Laser powder bed fusion (LPBF) is a method of additive manufacturing (AM) that selectively melts and fuses together microscopic metallic powder. LPBF offers the benefit of producing custom structures out of high strength metals that can be difficult to fabricate with conventional methods. The challenge of LPBF is that 3D printed structures often have internal pores due to process flaws. Pulsed thermal tomography (PTT) is a method for reconstructing the depth profile of materials, allowing the visualization internal voids in solids. In prior work, we developed a convolutional neural network (CNN) which, having been trained on simulated 2D PTT images of subsurface elliptical defects, was able to classify the semi-major radii, semi-minor radii, and angular orientation of the best-fit ellipses in previously unseen PTT images. The unseen PTT images contained subsurface irregular defect shapes imported from scanning electron microscopy (SEM) images of metallic LPBF-printed specimens. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN.

36 MATERIALS SCIENCE↗