Search NASASearch

SEARCH · Search NASA

Results for “Image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Neural network denoising of x-ray images from high-energy-density experiments

Noise is a consistent problem for x-ray transmission images of High-Energy-Density (HED) experiments because it can significantly affect the accuracy of inferring quantitative physical properties from these images. We consider experiments that use x-ray area backlighting to image a thin layer of opaque material within a physics package to observe its hydrodynamic evolution. The spatial variance of the x-ray transmission across the system due to changing opacity serves as an analog for measuring density in this evolving layer. The noise in these images adds nonphysical variations in measured intensity, which can significantly reduce the accuracy of our inferred densities, particularly at small spatial scales. Denoising these images is thus necessary to improve our quantitative analysis, but any denoising method also affects the underlying information in the image. In this paper, we present a method for denoising HED x-ray images via a deep convolutional neural network model with a modified DenseNet architecture. In our denoising framework, we estimate the noise present in the real (data) images of interest and apply the inferred noise distribution to a set of natural images. These synthetic noisy images are then used to train a neural network model to recognize and remove noise of that character. We show that our trained denoiser network significantly reduces the noise in our experimental images while retaining important physical features.

47 OTHER INSTRUMENTATION

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Report on the AAPM grand challenge on deep generative modeling for learning medical image statistics

Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.

Radiology, Nuclear Medicine & Medical Imaging

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao

Advancing X-ray quantum imaging through Monte-Carlo simulations

Imaging with X-rays poses fundamental limits due to radiation damage of the highly energetic photons. This becomes problematic for sensitive biological systems such as subcellular structures. Lowering the radiation dose, without sacrificing the signal-to-noise ratio, would be desirable for any kind of imaging modalities involving X-rays. To achieve this goal, quantum imaging with entangled X-ray photons constitutes a promising route. Production of biphotons have been demonstrated in the X-ray regime by the process of Spontaneous Parametric Down-Conversion (SPDC). However, compared to SPDC in the regime of visible light, the production rate for X-ray biphotons is extremely low. With the introduction of new high average brightness X-ray sources, such as 4th generation synchrotrons and high repetition rate Free-Electron X-ray Lasers (XFEL), quantum imaging may become practical. We introduce a ray tracing approach using Monte-Carlo sampling, specifically designed for quantum imaging with entangled X-ray photons generated by SPDC. By simulation, the superior image quality of quantum over classical imaging methods is demonstrated using realistic experimental conditions available at high repetition rate XFELs. With these simulations, we can efficiently assist the design of future experiments at beam lines, which can substantially accelerate the advancement of X-ray quantum imaging and reduce costs.

Entangled Photons

Fresnel diffraction imaging of surface nanostructure using coherent resonant x-ray scattering

We investigated surface nanostructures on an antiferromagnet MnBi 2 Te 4 using a novel imaging technique, direct (real)-space and real time coherent x-ray imaging (direct-CXI). This technique has provided new insights into antiferromagnetic textures, including the formation of anti-phase antiferromagnetic (AFM) domains and thermal dynamics of AFM domains and domain walls. While this method produces real-space images of AFM textures without requiring a complex imaging retrieval process, its underlying imaging mechanism has not been fully understood, limiting a deep understanding of AFM textures and the information they contain. By investigating the well-defined structural characteristics of the nanostructures fabricated on MnBi 2 Te 4 ⁠, we elucidate the imaging principle of this novel technique. We find that the observed images can be well explained by the Fresnel diffraction integral. Using a simple model from classical optics, our calculations successfully reproduce the experimentally observed images of the nanostructures. This demonstrates that direct-CXI not only provides straightforward real-space imaging but also contains phase information through its Fresnel diffraction integral.

36 MATERIALS SCIENCE

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). Imaging systematics refers to the false fluctuation of galaxy densities due to varying observing conditions and astrophysical foregrounds corresponding to the imaging surveys from which DESI LRG target galaxies are selected. We update the Obiwan pipeline, which we previously developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition allows simulating the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We inject these data evenly throughout the DESI Legacy Imaging Survey footprint at declinations between -30 and 32.375 degrees. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing source of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying systematic contamination in the Galactic extinction maps is a likely root cause (e.g., Cosmic-Infrared Background, dust temperature correction). We additionally observe a morphological change of the DESI LRGs population evidenced by a correlation between OII emission line average intensity and the size of the z-band PSF. This effect most likely results from uncertainties in background subtraction. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRGs sample.

79 ASTRONOMY AND ASTROPHYSICS

Neutron and Gamma-Ray Imaging of Th-232 and Cm-244 Using Organic Glass Scintillators

Modern nuclear safeguards require detection and characterization capabilities suitable for a wide variety of radiation sources and applications. Field-deployable detection systems have also had to modernize to meet changing needs. Recent developments in organic scintillator technology have resulted in the creation of an organic glass scintillator (OGS) at Sandia National Laboratory which is composed of a 9:1 mixture of glass compounds C42H36Si and C51H44Si. The novel scintillator composition was implemented into the design for a dual-particle capable imaging system at the University of Michigan. This work presents new results from two experiments demonstrating the gamma-ray and fast-neutron imaging capabilities of the organic glass system. Gamma spectroscopy was also performed using CeBr3 scintillators that are part of the imager design. Measurements were performed at Lawrence Livermore National Laboratory using 232Th metal hemishells and an encapsulated 244Cm oxide source. Successful gamma-ray imaging of the 232Th distributed sources is demonstrated with the glass imager, but there were no appreciable neutrons from the 232Th for neutron imaging. Promising neutron and gamma-ray imaging results of 244Cm are demonstrated despite limited imaging event statistics available in this measurement. Gamma-ray spectroscopy results were able to identify 232Th using prominent emissions at 239, 338, 583, and 911 keV. 244Cm was identified from emissions of 43, 99, and 153 keV. These results demonstrate the potential of organic glass imaging for nuclear nonproliferation or characterization efforts.

Lopez, Ricardo [Univ. of Michigan, Ann Arbor, MI (

Ultra-high Information-content Chemical Imaging with Broadband Coherent Anti-Stokes Raman and Two-photon Fluorescence Lifetime Microscopy

Raman fingerprint spectroscopy and fluorescence lifetime imaging are emerging tools for studying metabolic profiles of biological specimens. While Raman fingerprint spectroscopy detects intrinsic molecular vibrations that reflect the molecular composition and chemical environment of a sample, fluorescence lifetime imaging measures changes in the excited-state lifetime of fluorophores that are sensitive to their microenvironments. Here, we present a multimodal imaging platform combining broadband coherent anti-Stokes Raman scattering (BCARS) and two-photon fluorescence lifetime imaging (2p-FLIM) microscopy that can acquire biologically relevant Raman fingerprint spectra and fluorescence lifetime signals in vivo and simultaneously. The tremendous chemical information obtained from spatially co-registered BCARS and 2p-FLIM images allows us to characterize the subtle differences between sub-cellular compartments and verify the potential false-positive results generated by fluorescence imaging alone. This is demonstrated by directly comparing the BCARS, 2p-FLIM, and two-photon excitation fluorescence(TPEF) signals simultaneously obtained from the same dye-stained organelle in the live, intact C. elegans expressing a green fluorescent protein (GFP) marker. In this work, we introduce the BCARS/2p-FLIM/TPEF setup scheme, the image acquisition steps, data processing, and representative results showing that the cross-modality imaging method enables rigorous characterization and in vivo detection at sub-cellular resolution. Furthermore, this protocol provides a framework for simultaneous chemical and fluorescence lifetime imaging to improve the accuracy of biological interpretation in complex living systems.

Xu, Haoyu [Georgia Institute of Technology, Atlant

Original images, ground truth annotations, and precited masks from U-NET for a fungal species x nitrogen experiment

This document describes the “MicroVision-MV003” dataset. This folder contains three subfolders: “originals”, “predicted_masks”, and “gt_masks”. The “originals” folder contains 720 original images acquired using two imaging modalities: 360 images from overhead imaging and 360 images from transmission (raw) imaging. Naming scheme:YYYY-MM-dd__plate_strain_nitrogen-level_replication_experiment_imaging-modalityYYYY-MM-dd: 2024-12-20, 2024-12-21, 2024-12-22,2024-12-23,2024-12-24,2024-12-25,2024-12-26,2024-12-27,2024-12-28,2024-12-29,2024-12-30,2024-12-31.plate: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30.strain: FG, LE.nitrogen-level: N-1, N-10, N-100.replication: 1, 2, 3, 4, 5.experiment: MV.003.imaging-modality: overhead, transmission (raw). For example, the image2024-12-20__1_FG_N-10_3_MV.003_overheadwas taken on 2024-12-20. The plate number is 1, the fungal strain is FG, the nitrogen treatment is N-10, and the replication number is 3 for experiment MV.003, acquired using the overhead imaging modality. The “predicted_masks” folder contains masks generated by a trained U-Net model for the transmission imaging modality.The “gt_masks” folder contains 326 human hand-traced masks that serve as ground truth.

09 BIOMASS FUELS

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne

Single-Objective Airy Light-Sheet Imaging

Despite its massive potential, standard light-sheet imaging (LSI) faces key challenges, such as the incompatibility with common sample mounting techniques and low-resolution imaging. Single-objective LSI attempts to address these issues but often suffers from limited fields-of-view and throughput rates, or requires multiple optics that increase costs, alignment complexity, and losses. To overcome these challenges of standard single-objective LSI, we introduce single-objective Airy light-sheet imaging (SoALSI). SoALSI leverages the extraordinary self-acceleration properties of the Airy beam, achieving 5× higher imaging rates and enhanced imaging efficiency than standard single-objective LSI. Here, we demonstrate SoALSI’s versatility through rigorous contrast and resolution characterizations and by high-resolution imaging of diverse biological specimens, including malaria parasite-infected red blood cells and plant root tissue. SoALSI seamlessly integrates with any standard inverted microscope frame, enabling broader accessibility for the bioimaging community to explore biological processes in a wide range of specimens with enhanced resolution and imaging contrast.

airy beam

High-speed quantitative X-ray multi-contrast imaging with deep learning based modulated pattern analysis

The advent of X-ray multi-contrast imaging methods, providing absorption, phase, and dark-field images, holds tremendous promise for complementary and non-destructive visualization of inner structures within materials and bio-samples. However, the low efficiency in measuring and analyzing X-ray modulated patterns has hindered their application in high-resolution in situ imaging. In this work, the Enhanced Scanning Pattern-based Imaging Neural Network (ESPINNet) is introduced as a powerful tool for achieving high-speed, high-resolution quantitative imaging. ESPINNet is faster than correlation-based speckle tracking methods such as XSVT and UMPA, and provides a balanced performance in terms of resolution and speed for data collection by using fewer scanning images. In comparison with our previously developed neural network, ESPINNet introduces the capability to generate dark-field images, further enhancing its versatility. By leveraging scanning patterns, ESPINNet significantly improves resolution and measurement precision. Furthermore, its adaptability to various modulation patterns, including those produced by sandpaper, coded masks, or gratings, ensures broad applicability. These features enable real-time 2D and 3D multi-contrast imaging, positioning ESPINNet as a transformative solution for applications in materials science and biomedical research, particularly for high-speed and in situ measurements.

X-ray at-wavelength metrology

Zone plate-based extreme ultraviolet mask microscope with through-pellicle imaging capability

Mirror-based and zone plate-based imaging systems are being used in actinic extreme ultraviolet (EUV) reticle review tools. With regard to zone plates, a short working distance is advantageous in terms of the required spectral bandwidth, manufacturability, and potential throughput and imaging performance. Zone plates therefore typically have a short working distance. The industry has adopted the use of an EUV pellicle to protect the photomask. Imaging photomask through-pellicle requires a working distance larger than 2.5 mm. A zone-plate-based EUV mask microscope with a 3-mm working distance has been commissioned at beamline 11.3.2 of the Advanced Light Source. Through-pellicle imaging at an exposure time of 2 s is demonstrated. The instrument achieves an image contrast of 95% on large features on a photomask with a tantalum-based absorber. Imaging down to 45-nm half pitch (mask scale) is demonstrated. A NILS of 2.55 is achieved on 60-nm half-pitch (mask scale) lines and spaces. These results demonstrate that zone-plate-based imaging systems can meet the requirements of an actinic EUV mask review tool in terms of imaging performance and throughput in an instrument compatible with EUV pellicles.

Extreme ultraviolet

End–to–End Metasurface Design for Temperature Imaging via Broadband Planck‐Radiation Regression

A theoretical framework is presented for temperature imaging from long-wavelength infrared (LWIR) thermal radiation (e.g., 8–12 µm) through the end-to-end design of a metasurface-optics frontend and a computational-reconstruction backend. A new nonlinear reconstruction algorithm, “Planck regression”, is introduced to reconstruct the temperature map from a gray scale sensor image, even in the presence of severe chromatic aberration, by exploiting black body and optical physics particular to thermal imaging. This algorithm is combined with an end-to-end approach that optimizes manufacturable, single-layer metasurfaces to yield the most accurate reconstruction. The designs demonstrate high-quality, noise-robust reconstructions of arbitrary temperature maps (including completely random images) in simulations of an ultra-compact thermal-imaging device. Here, it is also shown that Planck regression is much more generalizable to arbitrary images than a straightforward neural-network reconstruction, which requires a large training set of domain-specific images.

36 MATERIALS SCIENCE

Multimodal Defect Imaging of Pure Tungsten Components Fabricated via Electron Beam Powder Bed Fusion

The utilization of additive manufacturing (AM) techniques for refractory materials in high-temperature environments has significantly expanded because of the ability to fabricate geometrically complex components. Electron beam powder bed fusion (EB-PBF), which provides lower residual stress, a cleaner vacuum environment, and better efficiency for high melting point, is one of the best-suited AM methods to produce advanced refractory components. However, the property variation attributed to the heterogeneous microstructure and process-induced defects has hindered the widespread adoption of EB-PBF-produced material like tungsten. While numerous in-situ monitoring and defect detection methods have been demonstrated for EB-PBF, a workflow that compares and evaluates process-induced abnormalities from different imaging perspectives is still limited. This study examines a feature-embedded tungsten component manufactured via the EB-PBF process to demonstrate the defect detection capabilities of a multimodal defect imaging workflow. The predefined and process-induced defects are evaluated by harnessing various imaging techniques, including in-situ electron imaging, layerwise near-infrared (NIR) imaging, post-build high-energy x-ray computed tomography (CT), and conventional destructive metallography. The results highlight the strengths and limitations of distinctive defect imaging techniques concerning specific defect types, sizes, and conditions. It was found that electron imaging can provide more abnormal detection capabilities while maintaining a higher measuring accuracy, against the conventional metallography in this case study, compared with NIR and CT imaging techniques.

36 MATERIALS SCIENCE

Toward more-robust, AI-enabled subsurface seismic imaging for geotechnical applications

Non-invasive seismic imaging has the potential to cost-effectively evaluate large volumes of subsurface material to inform geotechnical site investigation. However, seismic imaging using full waveform inversion (FWI) requires significant computational time and is dependent on an initial starting model. As a result, FWI has not yet been widely adopted into geotechnical practice. Previous efforts, on relatively simple two-layered models, indicate that data-driven artificial intelligence (AI) models may be as effective as FWI at predicting 2D images of shear wave velocity (V s ). Furthermore, the AI model predictions can be made almost instantaneously after data acquisition and do not require an initial starting model. We examine the generality of these findings by developing a new AI model for subsurface seismic imaging, whereby we make several notable contributions. First, we architect a multimodal AI model that combines time- and frequency-domain representations of the seismic wavefield to predict a 50 m by 20 m subsurface image of V s . Second, we developed a new diverse dataset of 100,000 images with their corresponding seismic wavefields to train the AI model. Third, we propose four physics-informed data augmentations for data-driven seismic imaging. Fourth, we develop two prediction consistency tests to evaluate the model’s performance when the true subsurface is unknown. Our final model, which has been made publicly available, is capable of predicting a subsurface V s image from a single seismic wavefield with an average, mean absolute percent error (MAPE) of 24 %. The predictive model is applied to a field dataset and shown to be consistent with local geology and shear-wave refraction measurements from the same location.

Artificial intelligence