Search NASASearch

SEARCH · Search NASA

Results for “Image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Wide-field microwave magnetic field imaging with nitrogen-vacancy centers in diamond

Non-invasive imaging of microwave (MW) magnetic fields with microscale lateral resolution is pivotal for various applications, such as MW technologies and integrated circuit failure analysis. Diamond nitrogen-vacancy (NV) center magnetometry has emerged as an ideal tool, offering micrometer-scale resolution, millimeter-scale field of view, high sensitivity, and non-invasive imaging compatible with diverse samples. However, up until now, it has been predominantly used for imaging of static or low-frequency magnetic fields or, concerning MW field imaging, to directly characterize the same microwave device used to drive the NV spin transitions. In this work, we leverage an NV center ensemble in diamond for wide-field imaging of MW magnetic fields generated by a test device employing a differential measurement protocol. The microscope is equipped with a MW loop to induce Rabi oscillations between NV spin states, and the MW field from the device-under-test is measured through local deviations in the Rabi frequency. This differential protocol yields magnetic field maps of a 2.57 GHz MW field with a sensitivity of ∼9 μT Hz −1/2 for a total measurement duration of T=357 s, covering a 340 × 340 μm 2 field of view with a micrometer-scale spatial resolution and a device-under-test input power dynamic range of 30 dB. This work demonstrates a novel NV magnetometry protocol, based on differential Rabi frequency measurement, that extends NV wide-field imaging capabilities to imaging of weak MW magnetic fields that would be difficult to measure directly through standard NV Rabi magnetometry.

crystallographic defects

Mitigating imaging systematics for DESI 2024 emission Line Galaxies and beyond

Emission Line Galaxies (ELGs) are one of the main tracers that the Dark Energy Spectroscopic Instrument (DESI) uses to probe the universe. However, they are afflicted by strong spurious correlations between target density and observing conditions known as imaging systematics. In this paper, we present the imaging systematics mitigation applied to the DESI Data Release 1 (DR1) large-scale structure catalogs used in the DESI 2024 cosmological analyses. We also explore extensions of the fiducial treatment. This includes a combined approach, through forward image simulations (Obiwan) in conjunction with neural network-based regression, to obtain an angular selection function that mitigates the imaging systematics observed in the DESI DR1 ELGs target density. We further derive a line of sight selection function from the forward model that removes the strong redshift dependence between imaging systematics and low redshift ELGs. Combining both angular and redshift-dependent systematics, we construct a three-dimensional selection function and assess the impact of all selection functions on clustering statistics. We quantify differences between these extended treatments and the fiducial treatment in terms of the measured 2-point statistics. We find that the results are generally consistent with the fiducial treatment and conclude that the differences are far less than the imaging systematics uncertainty included in DESI 2024 full-shape measurements. We extend our investigation to the ELGs at 0.6 < z < 0.8, i.e., beyond the redshift range (0.8 < z < 1.6) adopted for the DESI clustering catalog, and demonstrate that determining the full three-dimensional selection function is necessary in this redshift range. Our tests showed that all changes are consistent with statistical noise for BAO analyses indicating they are robust to even severe imaging systematics. Specific tests for the full-shape analysis will be presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS

Individual and Simultaneous Imaging of ⁹⁹mTc and ¹⁷⁷Lu With a Preclinical Broad Energy-Spectrum CZT-Based SPECT

Radiopharmaceutical therapy has demonstrated a high efficacy in the treatment of various tumor types. One of the radionuclides already used in the clinic is 177Lu, a beta emitter that also emits several photons imageable with SPECT. Quantitative imaging of 177Lu is critical for developing new radiopharmaceuticals. Energy resolution is an important factor when imaging multiple photon emissions. Solid-state detectors offer a superior performance over scintillators, that are commonly used in commercially-available preclinical SPECT scanners. This study demonstrates the feasibility of 99m Tc and 177Lu quantitative imaging in mouse phantoms, individually and simultaneously, with a SPECT prototype built with four CdZnTe (CZT) detector heads and a custom-designed and energy-optimized parallel-hole tungsten collimator. With a custom implementation of the one-step late (OSL) image reconstruction algorithm, the system is capable of imaging energies from ~70 keV to 250 keV. Above 250 keV, images were significantly affected by septal penetration, consistent with the collimator design. A recovery coefficient within 25% was obtained for activities as low as 2 kBq/mL for 99m Tc and 45% for 177Lu. Compared to a commercial NaI-based preclinical SPECT (VECTor4/CT), our prototype showed a superior energy resolution (< 5% at 140 keV), a similar uniformity with a high-compact design.

Encarnação, Pedro M C C

Wafer-scale waveguide sidewall roughness scattering loss characterization by image processing

Photonic integrated circuits (PICs) are vital for developing affordable, high-performance optoelectronic devices that can be manufactured at an industrial scale, driving innovation and efficiency in various applications. Optical loss of modes in thin film waveguides and devices is a critical measure of their performance. Thin film growth, lithography, masking, and etching processes are imperfect processes that introduce significant sidewall and top-surface roughness and cause dominating optical losses in waveguides and photonic structures. This roughness, as perturbations couple light from guided to far-field radiation modes, leads to scattering losses that can be estimated from theoretical models. Typically, with UV-based lithography, sidewall roughness is significantly larger than wafer-top surface roughness. Atomic force microscopy (AFM) imaging measurement gives a 3D and high-resolution roughness profile, but the measurement is inconvenient, costly, and unscalable for large-scale PICs and at wafer-scale. Here, we evaluate the sidewall roughness profile based on 2D high-resolution scanning electron microscope (SEM) imaging. We characterized the loss on two homemade nitride and oxide films on 3-inch silicon wafers with 12 waveguide devices on each and correlated the scattering loss estimated from a 2D image-based sidewall profile and theoretical Payne model. The lowest loss of guided fundamental transverse electric (TE 0 ) mode is found at 0.075 dB/cm at 633 nm across 24 devices, a record at visible wavelength. Our work shows 100% success (edge continuity span exceeding 95% of image width/height) in edge detection in image processing of all images to estimate autocorrelation function and optical mode loss. These demonstrations offer valuable insights into waveguide sidewall roughness and a comparison of experimental and 2D SEM image processing based loss estimations with applications in loss characterization at wafer-scale PICs.

Khurana, Mohit (ORCID:0000000207898672)

Dual-Image Color Normalization to Enable High-Performance Concentrating Solar Optical Metrology

Concentrating Solar Power (CSP) requires precision mirrors, and these in turn require metrology systems to measure their optical slope. In this project we studied a color-based approach to the correspondence problem, which is the association of points on an optical target with their corresponding points seen in a reflection. This is a core problem in deflectometry-based metrology, and a color solution would enable important new capabilities. We modeled color as a vector in the [R,G,B] space measured by a digital camera, and explored a dual-image approach to compensate for inevitable changes in illumination color. Through a series of experiments including color target design and dual-image setups both indoors and outdoors, we collected reference/measurement image pairs for a variety of configurations and light conditions. We then analyzed the resulting image pairs by selecting example [R,G,B] pixels in the reference image, and seeking matching [R,G,B] pixels in the measurement image. Modulating a tolerance threshold enabled us to assess both match reliability and match ambiguity, and for some configurations, orthorectification enabled us to assess match accuracy. Using direct-direct imaging, we demonstrated color correspondence achieving average match accuracy values of 0.004 h, where h is the height of the color pattern. We found that wide-area two-dimensional and linear one-dimensional color targets outperformed hybrid linear/lateral gradient targets in the cases studied. Introducing a mirror degraded performance under our current techniques, and we did not have time to evaluate whether matches could be reliably achieved despite varying light conditions. Nonetheless, our results thus far are promising.

14 SOLAR ENERGY

H420 Imager Calibration Procedure: Field of View Scan

Gamma-ray imagers with coded apertures have a finite field of view (FOV) within which an image of a source can be generated. A “FOV scan” is a facet of imager calibration procedure that involves collecting specialized data for a range of source locations filling the FOV in order to understand and correct for differences in imager performance. Systematic distortions reveal relative displacements between internal imager components, which can be accounted for in data analysis. The success of this scan requires a stable imager position during the full measurement duration (~hours). This document summarizes the hardware and software tools required to conduct a FOV calibration scan of an H3D H420 Coded Aperture Gamma-Ray Imager.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

Adaptive Patching for High-resolution Image Segmentation with Transformers

Attention-based models are proliferating in the space of image analytics, including segmentation. The standard method of feeding images to transformer encoders is to divide the images into patches and then feed the patches to the model as a linear sequence of tokens. For high-resolution images, e.g. microscopic pathology images, the quadratic compute and memory cost prohibits the use of an attention-based model, if we are to use smaller patch sizes that are favorable in segmentation. The solution is to either use custom complex multi-resolution models or approximate attention schemes. We take inspiration from Adapative Mesh Refinement (AMR) methods in HPC by adaptively patching the images, as a pre-processing step, based on the image details to reduce the number of patches being fed to the model, by orders of magnitude. This method has a negligible overhead, and works seamlessly with any attention-based model, i.e. it is a pre-processing step that can be adopted by any attention-based model without friction. We demonstrate superior segmentation quality over SoTA segmentation models for realworld pathology datasets while gaining a geomean speedup of 6.9× for resolutions up to 64K2, on up to 2, 048 GPUs.

Zhang, Enzhi

New perspectives on materials and device dynamics using time-resolved full-field diffraction X-ray imaging

Understanding how materials evolve during synthesis, processing, or device operation requires experimental access to structural dynamics across wide ranges of length and time scales, often in bulk samples or even within packaged devices. Time-resolved full-field diffraction X-ray microscopy has recently emerged as a powerful way to meet this need by combining the penetration and structural sensitivity of X-ray diffraction with objective-lens-based magnification, sensitive high-resolution X-ray imaging detectors, and pump-probe and real-time imaging strategies. Advances in full-field X-ray diffraction microscopy, often termed dark-field X-ray microscopy (DFXM), enable simultaneous imaging of extended fields of view while retaining crystallographic selectivity. Time-resolved DFXM promises to enable advances in materials processing and dynamics, electrochemical and photochemical processes, and the design of electronic devices. This Perspective summarizes the key instrumental concepts that define the performance of these methods, including the choice of imaging optics, detector considerations, and the impact of source time structure at synchrotron light sources and X-ray free-electron lasers (XFELs). We discuss the simultaneous use of complementary imaging modes that are increasingly used in practice. The early demonstrations of the potential of time-resolved DFXM include real-time defect and grain-boundary dynamics during metal annealing, stroboscopic imaging of functional devices with high strain sensitivity, and ultrafast pump-probe implementations at XFELs that directly visualize acoustic-wave propagation and energy dissipation in bulk crystals.

Dark-field X-ray microscopy

Computing virtual dark-field X-ray microscopy images of complex discrete dislocation structures from large-scale molecular dynamics simulations

Dark-field X-ray microscopy (DFXM) is a novel diffraction-based imaging technique that non-destructively maps the local deformation from crystalline defects in bulk materials. While studies have demonstrated that DFXM can spatially map 3D defect geometries, it is still challenging to interpret DFXM images of the high-dislocation-density systems relevant to macroscopic crystal plasticity. This work develops a scalable forward model to calculate virtual DFXM images for complex discrete dislocation structure(s) (DDS) obtained from atomistic simulations. Our new DDS-DFXM model integrates a non-singular formulation for calculating the local strain from the DDS and an efficient geometrical optics algorithm for computing the DFXM image from the strain field. We apply the model to complex DDS obtained from a large-scale mol­ecular dynamics simulation of compressive loading on single-crystal silicon. Simulated DFXM images exhibit prominent contrast for dislocation features between the multiple slip systems, demonstrating the potential of DFXM to resolve features from dislocation multiplication. In conclusion, the integrated DDS-DFXM model provides a toolbox for DFXM experimental design and image interpretation in the context of bulk crystal plasticity for a range of measurements across shock plasticity and the broader materials science community.

X-ray imaging

Ultraviolet Fluorescence Imaging for Photovoltaic Module Metrology: Best Practices and Survey of Features Observed in Fielded Modules

As the photovoltaics (PV) industry grows in sophistication, so must the extent to which systems are characterized. UV Fluorescence (UVF) imaging is a valuable, easy-to-perform, high-throughput, nonintrusive technique for characterizing modules in the field and in the lab. However, UVF is still a relatively new technique, and many in the PV industry are still unaware of its potential. We provide a guideline for obtaining, processing, and interpreting UVF images. We have provided a list of considerations for imaging hardware and settings, a suggested pipeline for image processing, and details on a survey of features shown in UVF images. As a result, a new database with UVF images of 7190 modules and another database curated by BrightSpot Automation are publicly available.

14 SOLAR ENERGY

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems

A Machine Learning Approach to Quantitative Analysis of Enamel Microstructure from Scanning Electron Microscopy Images

Dental enamel, the outermost tissue of mammalian teeth, must withstand a lifetime of wear and cyclic contact. To meet this demand, enamel possesses a combination of high hardness and resistance to fracture, properties that are typically mutually exclusive. The impressive damage tolerance has been attributed largely to decussation of the enamel rods, the principal unit of its microstructure. As such, enamel is inspiring the design of next‐generation structural materials. However, quantitative descriptions of the decussated enamel rod microstructure remain limited due to challenges encountered in applying computed tomography and in acquiring quality images appropriate for traditional digital processing methods. Here, a machine learning segmentation method is applied to images of the enamel obtained using scanning electron microscopy to support quantitative analysis of the microstructure. A pretrained convolutional neural network is used to expand the input training image dataset to allow the training of a random forest classifier, which ultimately segments the image with a very small training set ( n = 3 images). A validation of this segmentation method is presented, in addition to its application to calculate relevant microstructural parameters for images of tooth enamel from selected mammalian species. The methodology applied here is equally applicable to other hard tissues.

36 MATERIALS SCIENCE

Visualizing the Three-Dimensional Arrangement of Hydrogen Atoms in Organic Molecules by Coulomb Explosion Imaging

Structure-sensitive methods based on femtosecond light or electron pulses are now making it possible to measure how molecular structures change during light-induced processes. Despite significant progress, high-fidelity imaging of nuclear positions remains a challenge even for relatively small molecular systems and, notably, regarding the positions of hydrogen atoms. As demonstrated in recent work, X-ray-induced Coulomb explosion imaging (CEI) may overcome this obstacle, as its sensitivity does not depend on the mass of the imaged atoms. The photoinduced ring opening of the heterocyclic molecule 2(5 H )-thiophenone has attracted recent interest. Here, in this work, we show that CEI offers a powerful route to imaging the peripheral H atoms in this molecule and thus, more generally, to tracking detailed nuclear motions (e.g., isomerizations) in organic molecules on ultrafast time scales. Specifically, we record momentum-space Coulomb explosion images that report on the three-dimensional positioning of all nuclei within the molecule, for instance, distinguishing H atoms in C–H bonds that lie within or are directed out of the plane defined by the heavy atoms. The prospect of imaging peripheral H atoms to probe photochemical dynamics is explored by coupling ab initio molecular dynamics with classical Coulomb explosion simulations, thereby differentiating potential photoproduct isomers, including those whose structures primarily differ in the position of the hydrogens.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

X-ray free-electron lasers offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate free-electron lasers enable single particle imaging, where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray single particle reconstruction algorithms, which estimate the particle orientation for each image independently, are slow and memory-intensive when handling the massive datasets generated by emerging free-electron lasers. Here, we introduce X-RAI (X-Ray single particle imaging with Amortized Inference), an online reconstruction framework that estimates the structure of 3D macromolecules from large X-ray single particle datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray single particle imaging towards real-time reconstruction.

Computer science

Energy-resolved neutron imaging and diffraction including grain orientation mapping using event camera technology

Time-of-flight neutron diffraction and energy-resolved imaging each provide unique perspectives into material properties. Neutron diffraction is useful for assessing microstructural parameters such as phase composition, texture, and dislocation densities, though it typically provides averaged data over the sampled volume. Energy-resolved imaging, on the other hand, offers both spatial and spectral information by detecting Bragg edges and neutron absorption resonances, which enables detailed mapping of microstructure and isotopic composition. When combined, these techniques have the potential to enrich our understanding of material behavior across different scales, enhancing our understanding of complex materials. Traditionally, these modalities are conducted on separate instruments, which is time-consuming and poses challenges for data integration. Here, we report the integration of the LumaCam, an event-mode energy-resolved neutron imaging camera with the HIPPO time-of-flight diffractometer at LANSCE. This integration enables simultaneous diffraction and imaging across the full spectrum, with analysis optimized for diffraction and Bragg-edge imaging in the thermal range (0.45–10 Å) and resonance imaging in the epithermal range (0.5–3000 eV), facilitating comprehensive multi-modal analysis. We demonstrate its capabilities through case studies, including spatial mapping of grain orientations in a steel sample and accurate thickness estimations for irregular samples including a depleted uranium cylinder and a natural silver-containing mineral specimen. The combined setup enhances real-time sample alignment and provides comprehensive data for crystal structure, texture, and isotopic composition analysis. This approach opens new possibilities for advanced applications in nuclear engineering, archaeology, and materials science.

36 MATERIALS SCIENCE

Experimental study of multiple-orientation muon tomography with image optimization in sparse data environments

Due to the high penetrating power of cosmic-ray muons, they can be used to probe very thick and dense objects. As muons are charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object to measure particle direction change, scattering information within the object can be found. This can be used to produce a scattering-intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies were published with multiorientation tomography, which can form a three-dimensional representation faster than a single-orientation view. In this study, experimental muon-scatter-based tomography was performed using a concrete filled steel drum with several different metal wedges inside, with the drum between detector planes. Data were collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were combined using two different tomographic methods. A traditional inverse Radon transform approach used for computed tomography and a combination of multiple depth-of-field reconstructions were applied to the data. As cosmic-ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedges.

47 OTHER INSTRUMENTATION

Fidelity-preserving enhancement of ptychography with foundational text-to-image models

Ptychographic phase retrieval enables high-resolution imaging of complex samples but often suffers from artifacts such as grid pathology and multislice crosstalk, which degrade reconstructed images. We propose a plug-and-play (PnP) framework that integrates physics model-based phase retrieval with text-guided image editing using foundational diffusion models. By employing the alternating direction method of multipliers, our approach ensures consensus between data fidelity and artifact removal subproblems, maintaining physical consistency while enhancing image quality. Artifact removal is achieved using a text-guided diffusion image editing method (LEDITS++) with a pre-trained foundational diffusion model, allowing users to specify artifacts for removal in natural language. Demonstrations on simulated and experimental datasets show significant improvements in artifact suppression and structural fidelity, validated by metrics such as peak signal-to-noise ratio and diffraction pattern consistency. This work highlights the combination of text-guided generative models and model-based phase retrieval algorithms as a transferable and fidelity-preserving method for high-quality diffraction imaging.

image editing

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks