Search NASASearch

SEARCH · Search NASA

Results for “microscopy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Microscopy modality transfer of steel microstructures: Inferring scanning electron micrographs from optical microscopy using generative AI

Scanning electron microscopy (SEM) is resource intensive, which limits its throughput in some applications. As an alternative, we propose applying computer vision and machine learning to generate high-quality synthetic SEM micrographs from micrographs obtained using light optical microscopy (LOM). Working with a correlated LOM/SEM dataset of dual-phase steel images, we test generative models of various architectures, including encoder-decoder networks, generative adversarial networks (GANs), and diffusion-based models. We find that the diffusion models significantly outperform other methods on both qualitative and quantitative assessments, while preserving key metallurgical meaning. This work establishes diffusion as the state-of-the-art for microscopy modality transfer and demonstrates the potential of AI-powered microscopy to enhance LOM with micron scale structural recreation.

Computer vision

Freeze It or Leave It? Evaluating the Role of Cryo-Electron Microscopy in Battery Research

Cryogenic electron microscopy (cryo-EM) continues to gain prominence in materials science, particularly in battery research where it has enabled high-resolution, multimodal characterization of electrode materials and interfaces that otherwise degrade quickly under electron beam irradiation. But as anyone who has attempted cryo-EM techniques knows, freezing comes at a cost; cryo-EM experiments are time-consuming, highly sensitive, and carry an increased risk of artifacts due to issues such as frost contamination. Thus, when planning new characterization of battery materials or other beam-sensitive samples, it is critical to consider whether (and which) cryo-EM techniques are appropriate, based on study goals and an understanding of electron beam-sample interactions. Here we review such considerations for battery materials to elucidate the questions of when, why, and how to freeze to achieve high-quality characterization.

25 ENERGY STORAGE

Electron Microscopy Transfer System to Protect Atmosphere‐Sensitive Materials for Scanning Electron Microscopy Characterization

Atmosphere- and/or moisture-sensitive materials can be challenging to characterize using electron microscopy techniques due to sample preparation workflows that generally require exposure to ambient conditions. Here, we describe a novel preparation method that uses aluminum foil in combination with a commercial cryo-EM transfer system to circumvent undesired exposure to the atmosphere. First, hygroscopic MgCl 2 was used as a model material, and prepared samples (both protected and unprotected) were placed in a controlled-humidity environment (> 80% relative humidity) for various exposure lengths (circa seconds to hours). Following this, the effectiveness of the sample preparation method was determined by comparing qualitative photos and quantitative X-ray diffraction patterns between the two sample subsets. The combined results of these experiments suggest that the outlined preparation method effectively protects MgCl 2 from atmospheric contamination compared to MgCl 2 samples that had no protective measures taken. Finally, the preparation method was utilized to protect a highly hygroscopic crystalline BaO thin film for characterization via scanning electron microscopy, thereby demonstrating a functional application of the outlined preparation technique and an additional use for the commercial cryo-EM transfer system beyond its intended application.

atmosphere-sensitive materials

Mic-hackathon 2024: hackathon on machine learning for electron and scanning probe microscopy

Microscopy is one of the primary sources of information on materials structure and functionality at the nanometer and atomic scales. The data generated through microscopy is often contained in well-structured datasets, enriched with extensive metadata and sample histories, although not always with the same level of detail or storage format. The broad incorporation of data management plans by major funding agencies ensures the preservation and accessibility of this data. However, deriving insights from these rich datasets remains challenging due to the lack of established code ecosystems, standardized benchmarks, and integration strategies. Correspondingly, the efficiency of data usage is very low, and time expenditures at the analysis stage are enormous. In addition to post-acquisition data analysis, the emergence of application programming interfaces by major microscope manufacturers now creates opportunities for real-time ML-based data analytics to enable automated decision making, and particularly ML-agent controlled real-time microscope operation. Despite these opportunities, there is a significant gap in integrating the ML community with the broader microscopy community, limiting the value that these methods bring to physics and materials discovery and materials optimization. Hackathons address these challenges by fostering collaboration between ML experts and microscopy professionals, encouraging the development of innovative solutions that leverage ML for microscopy and preparing the workforce of the future both for microscopy-intensive domains areas, instrument manufacturers, and ML scientists interested in real world applications for fundamental research, materials optimization, and manufacturing. The hackathon generated benchmark datasets and digital twins of microscopes that further contribute to the development of the field and establish data analysis ecosystems. All the codes can be found at GitHub(https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1) and Zenodo (https://zenodo.org/records/15579940).

97 MATHEMATICS AND COMPUTING

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy

Illuminating the Material World: Autonomous Microscopy to Understand Order, Disorder, and Everything In Between

Artificial intelligence (AI) holds immense promise for revolutionizing microscopy, yet its widespread adoption has been hindered by challenges ranging from user inexperience to limited model transferability and difficulties in operationalizing machine learning. This presentation showcases our approach to developing practical autonomy for materials discovery, aiming to accelerate the integration of AI into everyday microscopy workflows. As shown in Fig. 1, I will focus on three key areas: understanding order-disorder transitions, quantifying point defects, and achieving truly device-scale microscopy. First, I will demonstrate the power of multi-modal knowledge graphs for integrating diverse microscopy data. By combining imaging, spectroscopy, and diffraction data, these graphs provide a holistic view of material behavior, capturing the intricate relationships between different modalities [1,2]. I will present a case study on how these models illuminate the structural and chemical changes associated with irradiation in oxide thin films, revealing critical insights for designing materials for extreme environments like spaceflight and nuclear energy. Specifically, I will show how multi-modal analysis clarifies the evolution of order-disorder transitions under irradiation, a key factor influencing material performance in these applications. Next, I will address the challenge of quantifying point defects in 2D materials. We demonstrate the application of computer vision and transfer learning to accurately identify and classify various defect types, such as vacancies and substitutional atoms, and to quantify their concentrations. This information is crucial for understanding and tailoring the properties of 2D materials for applications in electronics, optoelectronics, and catalysis. For example, I will show how our models can characterize the topological distribution of point defects in MXene transition metal carbides, providing valuable insights for optimizing their performance in energy storage and separation science. Finally, I will discuss our progress toward autonomous device-scale microscopy [3,4]. We are fundamentally redesigning electron microscopes around the principles of machine reasoning, enabling automation beyond basic tasks like sample navigation and data acquisition to include sophisticated experimental design. This approach paves the way for truly reproducible and massively scaled analysis campaigns. I will emphasize the importance of autonomous microscopy platforms for high-throughput materials discovery and characterization, facilitating the rapid screening of materials for a broad range of applications and accelerating the development of next-generation technologies.

36 MATERIALS SCIENCE

Accelerating Structure–Property Relationship Discovery with Multimodal Machine Learning and Self-Driving Microscopy

Microscopy combined with local spectroscopy is widely used to correlate nanoscale structure with functional properties in materials, but conventional measurements rely heavily on human-selected sampling locations and predefined targets, limiting data set diversity and the potential for discovery. Here, we present a framework that integrates autonomous microscopy with dual-novelty deep kernel learning (DN-DKL) for adaptive data acquisition and a dual variational autoencoder (VAE) for representation learning. DN-DKL actively guides the microscopy toward structurally and spectroscopically novel regions, enabling efficient collection of large spectral data sets. Dual-VAE embeds local structures and spectroscopic responses into a shared latent manifold that serves as a structure–property relationship map. We applied this framework for the investigation of halide perovskite films by using conductive atomic force microscopy. The results reveal distinct hysteresis behaviors that are linked to specific nanoscale structural motifs, including grain boundary junction points that show hysteresis under different bias conditions and asymmetric grain boundaries that suppress the charge transport. This framework establishes a general strategy that leverages the complementary strengths of self-driving microscopy, machine learning, and human expertise to accelerate scientific discovery in functional materials.

atomic force microscopy

Scanning Electrochemical Microscopy: An Evolving Toolbox for Revealing the Chemistry within Electrochemical Processes

The parallel development of ultramicroelectrodes (UMEs) and groundbreaking scanning probe microscopy techniques in the late 1980s led to the development of the scanning electrochemical microscope. Scanning electrochemical microscopy (SECM) was born from the idea of using a tiny electrode to measure the local electrochemical behavior at operating electrodes. From its foundations, the technique displayed an inherent versatility in measuring sample properties beyond topography. It allowed experimenters to measure and map chemical reactions occurring at diverse interfaces, from inspecting the reversibility of redox mediators at metal electrodes, to detecting the hallmarks of cellular respiration on living plant leaves. Related but distinct electrochemical scanning probe techniques, such as electrochemical atomic force microscopy (EC-AFM), scanning ion conductance microscopy (SICM), and scanning electrochemical cell microscopy (SECCM) have developed in parallel. These techniques have demonstrated exquisite spatial resolution down to the nanoscale regime. However, it is the proposition of this review that SECM remains unmatched at revealing the chemical aspects of electrochemistry. Furthermore, it is our intention to review and demonstrate that the versatile architecture of SECM continues to evolve and address fundamental and emerging challenges in the fields of energy storage and conversion, chemical biology, materials science, and environmental chemistry, among others.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

The ABCs of phase retrieval: Connecting the acronyms of scanning transmission electron microscopy

High-resolution scanning transmission electron microscopy (S/TEM) is an indispensable tool for characterizing the structure and properties of materials down to the atomic scale. Conventional S/TEM imaging, however, is limited by the phase problem, whereby the phase of the electron exit wave is lost upon detection. Recent advances in diffractive imaging and 4D-STEM have enabled a range of phase-retrieval techniques that computationally reconstruct the missing information encoded in the phase of the transmission function. These approaches offer improved dose efficiency and enhanced sensitivity to weakly scattering signals, extending quantitative imaging to beam-sensitive materials composed of light elements. In this work, we introduce the phase problem in electron microscopy and survey the diverse landscape of phase-retrieval techniques used in the field. Despite their many acronyms and algorithmic variations, these techniques share a common physical and mathematical foundation. We present a unified framework that connects these seemingly distinct methods, from parallax imaging and tilt-corrected bright-field (tcBF-STEM), to aberration-corrected bright-field (acBF-STEM), optimum bright-field (OBF-STEM) and single-sideband (SSB) ptychography, as well as first-moment integrated center of mass techniques (iCOM) and iterative ptychographic algorithms. Based on these insights, we discuss the opportunities and practical limitations of applying these methods across different materials systems, detector designs, and microscope configurations.Graphical abstractRepresentative electron microscopy configurations used for phase retrieval and diffractive imaging in S/TEM: (a) Zernike phase-contrast transmission electron microscopy (TEM), (b) small-convergence-angle four-dimensional scanning transmission electron microscopy (4D-STEM) for nanobeam-based phase reconstruction methods, and (c) large-convergence-angle 4D-STEM for ptychographic and related diffractive imaging techniques reviewed in this work.

36 MATERIALS SCIENCE

Crystallographic Texture, Structure, and Stress Transmission in Nugget Sandstone Examined With X‐Ray Tomography and Diffraction Microscopy

Subsurface processes in sandstones are controlled by porosity, permeability, and deformation mechanisms, all of which are controlled by a complex interplay of crystallographic rock texture, structure, and micromechanics. Texture, structure, and micromechanics have historically been studied using optical and electron microscopy of thin-sections. Here, we employed a new combination of in situ X-ray tomography and ray diffraction microscopy to study crystallographic texture, structure, and grain stresses in 3D. We examined these features in a sample of Nugget sandstone, a sandstone constituting hydrocarbon reservoirs across the American West. Our aims are threefold. First, we demonstrate the utility of X-ray diffraction microscopy probes for revealing texture, structure, and stress transmission in 3D. Second, we apply these techniques to Nugget sandstone and discuss findings in the context of prior work. Third, we study grain stress tensor evolution during mechanical compression to examine whether their heterogeneity and orientation evolution reflect that of inter-particle forces in granular materials. Our results show: (a) larger grains featured higher intra-granular misorientations, possibly from an increased prevalence of cements; (b) pores closed parallel to the loading direction and opened normal to loading; (c) grain stresses featured heterogeneity and orientations similar to inter-particle forces in non-cohesive granular materials; (d) grains featured compressive stresses in the loading direction and tensile stresses orthogonal to the loading direction, the latter resisting sample dilation and grain separation. Our work demonstrates the first known application of multi-modal X-ray tomography and diffraction microscopy to sandstone, providing new 3D insight into the nature of quartz cement and stress evolution.

high energy diffraction microscopy

Laser-driven ultrafast transmission electron microscopy

Recent advances in lasers and electron optics technology have allowed transmission electron microscopes to achieve high spatial and temporal resolution, making them capable of tracking atoms, charges and spin motions down to the attosecond and nanometre scales. This Primer discusses the most common and practical experimental implementation of time-resolved transmission electron microscopy and the stroboscopic mode for evaluating ultrafast reversible dynamics. An in-depth discussion of photo-induced near-field electron microscopy, a technique unique to laser-assisted electron microscopy, is also provided, covering its prospective applications in the study of coherent phenomena in quantum materials. The experimental strategies and limitations in investigating the structural dynamics of materials and nanostructures by imaging, diffraction and spectroscopy are also described in detail, with a direct comparison with more conventional and established techniques. Here, we provide key information for new researchers who intend to use ultrafast transmission electron microscopy to address new challenges in specific materials science, condensed matter and nanophotonics.

Transmission electron microscopy

Lattice light-sheet microscopy allows for super-resolution imaging of receptors in leaf tissue

Plant leaf tissues are difficult to image via fluorescent microscopy, largely due to the presence of chlorophyll and other pigments that provide large background fluorescence. An advantage of Lattice Light-Sheet microscopy is its use of Bessel beams that illuminate a thin focal region of interest for microscopy, allowing for the excitation of fluorescent molecules within this region without surrounding chlorophyll-like objects outside of the region of interest. Here, we apply STORM Super-resolution techniques to observe Receptor-Like Kinases in Arabidopsis thaliana leaf cells. By applying this technique with the Lattice Light-Sheet, we can localize immune response proteins in sub-100 nm length scales and reconstruct three-dimensional locations of proteins within individual leaf cells. Using this technique, we observed the effect of the elicitors ATP and flg22, where we observed a significant degree of internalization of cognate receptors P2K1 and FLS2. We were also able to similarly observe differences in colocalization due to stimulation with these elicitors, where we observe proteins on the membrane becoming less colocalized as a result of stimulation, suggesting an immune response mechanism involving receptors internalizing via pathways distinct to the receptor. Further, these data show the Lattice Light-Sheet’s capabilities for imaging tissue with problematic background fluorescence that otherwise makes super-resolution fluorescence microscopy difficult.

59 BASIC BIOLOGICAL SCIENCES

Scanning transmission election microscopy observations of twisted epitaxial gold nanodiscs in twisted molybdenum disulfide bilayers

Atomic scale, scanning transmission electron microscopy (STEM) analysis of the moiré structures in twisted epitaxial gold nanodiscs encapsulated in twisted bilayer molybdenum disulfide is presented. High angle annular dark field STEM imaging reveals that the period of the moiré patterns between gold and molybdenum disulfide varies with different twist angles of the bilayer molybdenum disulfide, ranging from 1.80 nm (epitaxial alignment of gold) to 1.53 nm (twisted epitaxial alignment of gold). Additionally, bright field STEM imaging reveals a faint, larger "moiré of moiré" structure in cases where the bilayer molybdenum disulfide twist angle is small (~6°), arising from the overlapping three-layers, which is not visible in conventional transmission electron microscopy images. In conclusion, our experiments indicate that scanning transmission electron microscopy as a suitable tool for moiré analysis of twisted multilayer planar heterostructures, complementary to information provided by conventional transmission electron microscopy and diffraction.

Au

Raw electron microscopy images for "The Importance of Nano-edges in Atomic Stencilling and Chiroptically Active Assembly of Patchy Gold Tetrahedra"

This dataset contains the raw transmission electron microscopy (TEM) and scanning electron microscopy (SEM) images used in the main figures of the paper “The Importance of Nano-edges in Atomic Stencilling and Chiroptically Active Assembly of Patchy Gold Tetrahedra (2026).” All the images were acquired at the Materials Research Laboratory, University of Illinois at Urbana-Champaign, by Qian Chen group. 1. We provide five subfolders, each named according to the corresponding figure numbers in the paper. 2. All files in the subfolders for Figures 1–3 and 5 are named as "Panel [letter]_*", where [letter] (e.g., a, b, c) represents the raw images used for the corresponding panels. 3. All files in the subfolder for Figure 4 correspond to panel f and show the configurations of patchy tetrahedra synthesized at varying concentrations of iodide and 2-naphthalenethiol. They are named "Experiment_[number]", where [number] represents the corresponding data points in the phase diagram. 4. In TEM images, the bright and dark regions indicate the polymer patches and nanoparticle cores, respectively. 5. In SEM images, the bright and dark regions indicate the nanoparticle cores and polymer patches, respectively. 6. Abbreviations in file names: HAADF-STEM (high-angle annular dark-field scanning transmission electron microscopy), PINEM (photon-induced near-field electron microscopy), and RCP/LCP (left-/right-handed circularly polarized).

chirality

Modal focal adaptive optics for Bessel-focus two-photon fluorescence microscopy

Adaptive optics (AO) improves the spatial resolution of microscopy by correcting optical aberrations. While its application has been well established in microscopy modalities utilizing a circular pupil, its adaptation to systems with non-circular pupils, such as Bessel-focus two-photon fluorescence microscopy (2PFM) with an annular pupil, remains relatively uncharted. Herein, we present a modal focal AO (MFAO) method for Bessel-focus 2PFM. Measuring and correcting aberration using a spatial light modulator placed in conjugation with the focal plane of the microscope objective, MFAO employs Zernike annular polynomials — a first in AO implementation — to achieve performance on par with a previous zonal AO method, but with a notably simplified optical configuration. We validated the performance of MFAO in correcting artificial and sample-induced aberrations, as well as in in vivo imaging of zebrafish larvae and mouse brains. By expanding the application of modal AO to annular pupils as well as aberration measurement and correction to a wavefront modulator at the objective focal plane, MFAO represents a notable advancement in the implementation of AO in microscopy.

47 OTHER INSTRUMENTATION

Mind the gap: Bridging the divide between AI aspirations and the reality of autonomous microscopy

What does materials science look like in the “Age of Artificial Intelligence?” Each material’s domain—synthesis, characterization, and modeling—has a different answer to this question, motivated by unique challenges and constraints. This work focuses on the tremendous potential of autonomous characterization within electron microscopy. We present our recent advancements in developing domain-aware, multimodal models for microscopy analysis capable of describing complex atomic systems. We then address the critical gap between the theoretical promise of autonomous microscopy and its current practical limitations, showcasing recent successes while highlighting the necessary developments to achieve robust, real-world autonomy.

2D materials

Multiscale Characterization of Additive Manufacturing Components with Computed Tomography, 3D X-ray Microscopy, and Deep Learning

Additive manufacturing (AM) facilitates the creation of complex-geometry parts, driving advancements in lightweight aerospace components, high-efficiency engine cooling channels, and customized medical implants. However, ensuring the quality and reliability of AM parts remains challenging due to internal defects, surface irregularities, porosity, and residual trapped powder, which are often inaccessible to traditional inspection methods. Recent developments in X-ray computed tomography (XCT) and 3D X-ray microscopy (XRM), particularly systems equipped with resolution-at-a-distance (RaaD™) capabilities, enable high-resolution, non-destructive evaluation of AM components across multiple scales, from sub-micrometer to macroscopic levels. This paper explores modern XCT and XRM techniques for multiscale characterization of AM parts, focusing on their ability to detect and analyze defects such as porosity, cracks, inclusions, and surface roughness, while offering insights into defect formation mechanisms, material properties, and process-induced variations. The integration of deep learning (DL) frameworks, including Simurgh, DeepRecon, and DeepScout, enhances XCT/XRM workflows by reducing scan times, improving resolution recovery, and enabling accurate defect detection even with limited projection data. These DL-based methods overcome limitations of traditional reconstruction techniques, enabling faster, more reliable characterization of dense materials like Inconel 718 and novel alloys such as AlCe. Applications include process parameter optimization, high-throughput quality control, and multistage AM process evaluation, with DL-enhanced workflows accelerating analysis times from weeks to days. Correlative imaging approaches further validate XCT and XRM data against scanning electron microscopy (SEM) images of physically sectioned samples, confirming the accuracy of DL-based reconstructions and enabling comprehensive defect analysis. While challenges remain in generalizing DL models to diverse materials and imaging conditions, improvements in resolution, noise reduction, and defect detection highlight the transformative potential of these methods. This multiscale and correlative approach enables precise identification and correlation of microstructural features with the overall performance of AM components. By integrating advanced XCT, XRM, and DL techniques, this paper demonstrates a significant leap forward in AM characterization, offering valuable insights into the relationships between processing parameters, microstructure, and part performance, and driving innovations that enhance the quality and reliability of AM products for demanding industrial applications.

Additive manufacturing

Electron Microscopy Approaches to Unraveling the Structure of Amorphous Materials

Determining atomic structures in crystalline materials—where atoms are arranged in rigid, periodic lattices—has been highly successful using probes such as electrons, X-rays, and neutrons. In contrast, amorphous materials, despite their ubiquity and technological importance, remain far more challenging to characterize with comparable accuracy and precision. This review highlights existing, emerging, and potential (scanning) transmission electron microscopy ((S)TEM) techniques for probing short- and medium-range order in amorphous materials. Approaches ranging from high-resolution (S)TEM imaging and selected electron diffraction pattern to four-dimensional STEM (4D-STEM) based pair distribution function, fluctuation electron microscopy, tomography, ptychography, and spectroscopic methods are discussed, emphasizing their ability to provide complementary insights across multiple length scales—from sub-angstrom local environments to nanometer-scale correlations. Here, we further explore the promise of multimodal and correlative strategies, as well as the growing role of machine learning and physics-informed AI in enabling real-time, quantitative interpretation of complex structural signatures. Together, these advances point toward a future where electron microscopy not only reveals the hidden order in amorphous systems but also establishes robust structure–property relationships, paving the way for materials innovation in disordered matter.

77 NANOSCIENCE AND NANOTECHNOLOGY