Search NASA⌕ Search

SEARCH · Search NASA

Results for “microscopy automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Grain Boundary Plane Measurement Using Transmission Electron Microscopy Automated Crystallographic Orientation Mapping for Atom Probe Tomography Specimens

Abstract Grain boundaries are critical in determining the properties of materials, including mechanical stability, conductivity, and corrosion resistance. The specific properties of materials depend not only on the misorientation of the crystals, the three most commonly characterized parameters, but also on the angle of the grain boundary plane between the two crystals, the final two parameters in the five-parameter macroscopic description of the grain boundary. The method presented here allows for the direct measurement of all five parameters of the grain boundary in a transmission electron microscopy specimen of various morphologies. This is especially applicable to atom probe specimens, where only a single-tilt axis is generally available, allowing the crystallographic description to be matched to the detailed chemical data available in the atom probe tomography. This method provides a platform for efficient grain boundary analysis in unique samples, saving operator time and allowing for ease of acquisition and interpretation in comparison with traditional electron diffraction methods.

Materials Science↗
DOE OSTI2026

Do We Really Need All That Data: From Data to Agency in Automated Microscopy

Microscopy is entering an era of automated laboratories and AI-enabled instruments, often justified by a simple narrative of automating experiments to collect more data and train better models. In this work, we argue that, for microscopy, this framing is incomplete and can be counterproductive.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Designing Antifouling and Antimicrobial Interfaces: Structural Characterization using CryoEM, Automated Microscopy, and AI Image Segmentation

The design of functionalized surfaces for interactions with biological systems is critical across sectors such as healthcare, energy, and agriculture. Tailoring materials for specific applications, such as antifouling and antimicrobial surfaces, demands a comprehensive understanding of topology and chemistry across multiple length and time scales on both biological and materials systems. This work presents the development and characterization of nanostructured surfaces with controlled topographies and chemistries that enhance bacterial membrane disruption, reduce biofilm formation, and improve antimicrobial and antifouling capabilities. Two specific use cases will be presented - the use of cellulose nanocrystals (CNCs) for bacterial growth inhibition and the development of antifouling surfaces to prevent protein and bacterial adsorption [1-4]. By leveraging large language models (LLMs) for image segmentation and training [5], we enable automated analysis of terabyte-scale cryogenic electron microscopy (cryoEM) datasets. This analysis provides statistical insights into the biotic/abiotic interface and facilitates automated electron microscopy experiments to mitigate time and dose. The integration of cryogenic electron tomography (cryoET) and cryogenic focused ion beam (cryoFIB) milling enables high-resolution, near-native-state imaging and 3D reconstructions of bio/material interfaces [6]. Orthogonal characterization techniques and computational modeling further enhances our understanding, offering a robust platform for the design and optimization of next-generation functional surfaces [7].

Williams, Alexis [ORNL] (ORCID:0000000252835822)↗
DOE OSTI2024

A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network

Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.

36 MATERIALS SCIENCE↗
DOE OSTI2024

AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation

Microscopy has been pivotal in improving the understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most characterization labs. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, in this work, a coupled software–hardware platform is developed that consists of a software package termed AEcroscopy (short for Automated Experiments in Microscopy), along with a field-programmable-gate-array device with LabView-built customized acquisition scripts, which overcome these limitations and provide the necessary abstractions toward full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine-learning libraries and simulations, to provide automated decision-making and active theory-experiment optimization to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

The Art of Automation: Translating Electron Microscopy Workflows Into Automated Processes

Acquiring data using a scanning transmission electron microscope (STEM) is a complex, multi-step process. The intricacy of the process depends on the type of sample, composition of the material, desired results of the experiment, resolution requirement and other experimental factors. Each experiment presents unique complications, such as sample drift and contamination, that the microscopist must consider when acquiring data. All these challenges are handled fluidly and expertly by experienced microscopists, but to reach new levels of innovation in material development, including greater reproducibility, throughput, and precision, the automation of these workflows is essential. The initial phase of this work involved translating intuition-based workflows into discrete, programmable steps. Some common key stages in STEM workflows are the initial tuning, scanning the sample for areas of interest, and then acquiring the data. Each stage can be broken further into specific parameter adjustments, such as aberration correction and dwell time optimization, depending on the experiment. When deconstructing various experiments each step was assessed for automation feasibility based on the amount of real time operator decisions. There are steps that lend themselves to automation more readily than others, such as course focusing and sample screening, but there is potential for full automation of all stages with time. As an initial step, an automated montage routine was developed, allowing for the efficient acquisition of large portions of the sample without requiring continuous intervention from the operator. The automation of this small process of the procedure demonstrates the value of this capability. A major challenge in automation arises from discrepancies between commanded, reported and actual stage movements. Using systematic tests, stage movement was quantified. This error can be corrected algorithmically for more accurate workflows in the future. Expanding automation capabilities would result in larger, more efficient data acquisition which allows for more robust statistical analysis. Additionally, this work lays the groundwork for a closed loop system where machine learning algorithms would intake automatically acquired data and make real time decisions. By progressively automating this instrument, this work establishes the foundation for fully automated experimentation in transmission electron microscopy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Evaluating Stage Motion for Automated Electron Microscopy

Abstract Precise control is an essential and elusive quality of emerging self-driving transmission electron microscopes (TEMs). It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major barriers to artificial intelligence-directed microscope designs that require repeatable, precise movements. To guide design of emerging instruments, it is necessary to understand the behavior of existing mechanisms to identify rate limiting steps for full autonomy. Here, we describe a general framework to evaluate stage motion in any TEM. We define metrics to evaluate stage degrees of freedom, propose solutions to improve performance, and comment on fundamental limits to automated experimentation using present hardware.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

JOINT APPOINTEE: Evolution of ferroelectric properties in SmxBi1-xFeO3 via automated Piezoresponse Force Microscopy across combinatorial spread libraries

Combinatorial spread libraries offer a innovative approach to explore the evolution of material properties over broad concentration, temperature, and growth parameter spaces. However, traditional limitation of this approach is the requirement for the read-out of functional properties across the library. Here we develop automated Piezoresponse Force Microscopy (PFM) for the exploration of combinatorial spread libraries and demonstrate its application in the SmxBi1-xFeO3 system with the ferroelectric-antiferroelectric morphotropic phase boundary. This approach relies on the synergy of the quantitative nature of PFM and the implementation of automated experiments that allow PFM-based sampling over macroscopic samples. The concentration dependence of pertinent ferroelectric parameters has been determined and used to develop the mathematical framework based on Ginzburg-Landau theory describing the evolution of these properties across the concentration space. We pose that a combination of automated scanning probe microscope and combinatorial spread library approach will emerge as an efficient research paradigm to close the characterization gap in the high-throughput materials discovery. We make the data sets open to the community and hope that this will stimulate other efforts to interpret and understand the physics of these systems.

Automated Microscopy, Combinatorial Library, Ferro↗
DOE OSTI2024

Machine Learning-Enabled Image Classification for Automated Electron Microscopy

Abstract Traditionally, materials discovery has been driven more by evidence and intuition than by systematic design. However, the advent of “big data” and an exponential increase in computational power have reshaped the landscape. Today, we use simulations, artificial intelligence (AI), and machine learning (ML) to predict materials characteristics, which dramatically accelerates the discovery of novel materials. For instance, combinatorial megalibraries, where millions of distinct nanoparticles are created on a single chip, have spurred the need for automated characterization tools. This paper presents an ML model specifically developed to perform real-time binary classification of grayscale high-angle annular dark-field images of nanoparticles sourced from these megalibraries. Given the high costs associated with downstream processing errors, a primary requirement for our model was to minimize false positives while maintaining efficacy on unseen images. We elaborate on the computational challenges and our solutions, including managing memory constraints, optimizing training time, and utilizing Neural Architecture Search tools. The final model outperformed our expectations, achieving over 95% precision and a weighted F-score of more than 90% on our test data set. This paper discusses the development, challenges, and successful outcomes of this significant advancement in the application of AI and ML to materials discovery.

Materials Science↗
DOE OSTI2023

Investigation of Nanoparticle Degradation in Hydrogen Fuel Cell Systems through Automated Electron Microscopy

Proton exchange membrane fuel cells (PEMFC) are promising devices for the deployment of hydrogen-powered heavy-duty vehicles, providing a higher efficiency for similar driving range and fueling time than the existing ones. However, PEMFCs still encounter durability challenges mainly due to catalyst degradation in the cathode. Mitigating these performance losses requires a better understanding of the degradation mechanisms under heavy-duty accelerated stress tests (ASTs) [1]. Scanning transmission electron microscopy (STEM) combined with energy dispersive X-ray spectroscopy (EDS) are key tools for the analysis of Pt and PtCo nanoparticle size, spatial distribution and composition [2]. Electron tomography is also used to determine the rate and type of degradation of catalyst nanoparticles as a function of their position on the carbon support. In this work, automated data acquisition software, paired with a custom Python code, have been used to study the effect of different accelerated stress tests (ASTs) on nanoparticle coarsening [2]. Figure 1 shows high-angle annular dark-field (HAADF)-STEM images and EDS maps comparing the cathodes of membrane electrode assemblies (MEAs) following an electrocatalyst AST performed under H2/N2 with that of the heavy-duty AST performed under H2/air. We will discuss how AST conditions affect considerably the spatial distribution of the nanoparticles across the electrode between the membrane and microporous layer. Although the median particle size increased more in the MEA aged under the heavy-duty AST, as determined using a high-throughput image analysis, the quantitative EDS measurements demonstrate that the electrocatalyst AST resulted in more Pt and Co dissolution from the cathode, which is another important indicator of electrocatalyst degradation. We will further present the impact of the relative humidity (% RH) on the degradation mechanisms demonstrated using the same approach. Electron tomography has been used to distinguish the Pt nanoparticles residing on the carbon support surface (exterior) from those within the pore structure (interior) in order to determine the relative stability of interior and exterior nanoparticles. As shown in Figure 2, we will compare the Pt catalyst particle size at the beginning of test (BOT) and end of test (EOT), and discuss the importance of automating the electron tomography workflow, i.e. acquisition, reconstruction, and visualization, to increase sampling and determine the standard deviation of these measurement. The outlook for utilizing low-dose cryo-tomography for limiting damage to the catalyst, support, and especially proton-conducting ionomer will also be discussed [3].

Amichi, Lynda↗
DOE OSTI2024

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Multi defect detection and analysis of electron microscopy images with deep learning

Electron microscopy is widely used to explore defects in crystal structures, but human detecting of defects is often time-consuming, error-prone, and unreliable, and is not scalable to large numbers of images or real-time analysis. In this work, we discuss the application of machine learning approaches to find the location and geometry of different defect clusters in irradiated steels. We show that a deep learning based Faster R-CNN analysis system has a performance comparable to human analysis with relatively small training data sets. Furthermore, this study proves the promising ability to apply deep learning to assist the development of automated microscopy data analysis even when multiple features are present and paves the way for fast, scalable, and reliable analysis systems for massive amounts of modern electron microscopy data.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Visualization and modeling of inhibition of IL-1β and TNF-α mRNA transcription at the single-cell level

Abstract IL-1β and TNF-α are canonical immune response mediators that play key regulatory roles in a wide range of inflammatory responses to both chronic and acute conditions. Here we employ an automated microscopy platform for the analysis of messenger RNA (mRNA) expression of IL-1β and TNF-α at the single-cell level. The amount of IL-1β and TNF-α mRNA expressed in a human monocytic leukemia cell line (THP-1) is visualized and counted using single-molecule fluorescent in-situ hybridization (smFISH) following exposure of the cells to lipopolysaccharide (LPS), an outer-membrane component of Gram-negative bacteria. We show that the small molecule inhibitors MG132 (a 26S proteasome inhibitor used to block NF-κB signaling) and U0126 (a MAPK Kinase inhibitor used to block CCAAT-enhancer-binding proteins C/EBP) successfully block IL-1β and TNF-α mRNA expression. Based upon this single-cell mRNA expression data, we screened 36 different mathematical models of gene expression, and found two similar models that capture the effects by which the drugs U0126 and MG132 affect the rates at which the genes transition into highly activated states. When their parameters were informed by the action of each drug independently, both models were able to predict the effects of the combined drug treatment. From our data and models, we postulate that IL-1β is activated by both NF-κB and C/EBP, while TNF-α is predominantly activated by NF-κB. Our combined single-cell experimental and modeling efforts show the interconnection between these two genes and demonstrates how the single-cell responses, including the distribution shapes, mean expression, and kinetics of gene expression, change with inhibition.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Evaluating the feasibility of LA-ICP-TOF-MS for the analysis of environmental particle collections

Laser ablation-inductively coupled plasma-time-of-flight-mass spectrometry (LA-ICP-TOF-MS) was employed to rapidly analyze environmental particle samples collected using aerosol contaminate extractors (ACE). The ACE particle collectors were placed at various distances (0.5, 1.3, and 4.5 km) from a source that released Ru-bearing particles. Samples for measurement were then generated (as sub-samples) from the ACE collection plates via particle “lift off” with gunshot residue (GSR) tabs. The LA-ICP-TOF-MS method was employed such that 10+ samples could be analyzed in a single unattended analytical session. A 3 × 1 mm area of individual GSR tab samples were analyzed in less than 30 minutes. This provided spatially resolved elemental and isotopic measurements of the particulate content and confirmed the presence of Ru-bearing particles within the complex background environmental particle loading. As anticipated, measurements showed collectors closest to the source had the highest concentration of the released Ru-bearing particles, while all collectors, regardless of distance, contained similar levels of background particles (e.g., Fe and Sr). Sequential scanning electron microscopy – automated particle analysis (SEM-APA) and LA-ICP-TOF-MS analysis was employed for method validation and a demonstration of the multi-modal approach. The same 2-dimensional region was analyzed by both methods and the particles identified via SEM-APA were also detected using LA-ICP-TOF-MS, with 100% accuracy. Overall, LA-ICP-TOF-MS demonstrated its utility for rapid elemental and isotopic particle analysis from environmental air samples.

Manard, Benjamin T. [Oak Ridge National Laboratory↗
DOE OSTI2021

Characterization and differentiation of aluminum powders used in improvised explosive devices. Part 2: Micromorphometric method refinement and preliminary statistical analysis

Abstract Aluminum (Al) powder is commonly encountered in improvised explosive devices (IEDs) as a metallic fuel due to its availability and low cost. Although available commercially in powder form, amateur bomb‐makers also produce their own Al powder via simple methods found online. In order to provide investigative leads and forensic intelligence, it is important to evaluate not only the composition of homemade devices, but also to distinguish between the various forms of Al powder they contain. To achieve this goal, a method using automated microscopy in combination with statistical techniques has been demonstrated to have the potential to provide source discrimination and investigative leads in source attribution of Al powders in IEDs. The present research refined this method and investigated 59 industrially and amateurly produced Al powder sources with seven subsamples per source using two traditional linear discriminant analyses (LDA), one with a standard data split for training and testing, and another using leave‐one‐out cross‐validation. Averaging the classification accuracies for the two LDA‐based analyses, LDA has the ability to correctly classify 59.26%, 83.35%, and 80.69% of the samples based on their powder source, type, and production method, respectively. This classification accuracy represents a 3407%, 317%, and 61.38% increase in accuracy from random class assignment, respectively. Further, in most instances of incorrect data attribution to a particular source, the subsample has been misidentified with another sample of the same powder type or production method.

Ommen, Danica M.↗
DOE OSTI2023

Automated piezoresponse force microscopy domain tracking during fast thermally stimulated phase transition in CuInP 2 S 6

Real-time tracking of dynamic nanoscale processes such as phase transitions by scanning probe microscopy is a challenging task, typically requiring extensive and laborious human supervision. Smart strategies to track specific regions of interest (ROI) in the system during such transformations in a fast and automated manner are necessary to study the evolution of the microscopic changes in such dynamic systems. In this work, we realize automated ROI tracking in piezoresponse force microscopy during a fast (≈0.8 °C s –1 ) thermally stimulated ferroelectric-to-paraelectric phase transition in CuInP 2 S 6 . We use a combination of fast (1 frame per second) sparse scanning with compressed sensing image reconstruction and real-time offset correction via phase cross correlation. The applied methodology enables in situ fast and automated functional nanoscale characterization of a certain ROI during external stimulation that generates sample drift and changes local functionality.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Automated scanning probe microscopy of combinatorial ferroelectric libraries: Gaussian-process-guided exploration and noise-aware experiment planning

Combinatorial materials libraries provide an efficient route for mapping composition–property relationships, but their broader impact depends on rapid, quantitative, and functionally relevant characterization. Scanning Probe Microscopy (SPM), including piezoresponse force microscopy (PFM), offers significant potential for quantitative, functionally relevant combi-library readouts. Here, we implement a fully automated SPM workflow for ferroelectric combinatorial libraries and benchmark Gaussian-process-based Bayesian optimization strategies for autonomous experiment planning. The workflow integrates automated probe motion, contact optimization, imaging, and dual amplitude resonance tracking-PFM spectroscopy, and uses scalarized spectroscopic observables to guide subsequent measurements. Stage motion, probe engagement, in-contact tuning, imaging, spectroscopy, and the choice of the next measurement location all proceed without human input. We demonstrate the approach on Sm-doped BiFeO 3 and Zn x Mg 1−x O libraries. By comparing vanilla Bayesian optimization with a measured-noise variant, we show that explicit treatment of local reproducibility can improve modeling of composition-dependent response when the measured variance is physically meaningful, but can also reduce robustness when variability is dominated by outliers or topographic artifacts. Furthermore, these results establish automated SPM as a bridge between combinatorial synthesis and quantitative functional characterization.

Liu, Yu [University of Tennessee, Knoxville, TN (U↗
DOE OSTI2024

Development of a liquid-helium free cryogenic sample holder with mK temperature control for autonomous electron microscopy

The automated and autonomous cryogenic transmission electron microscopy (Cryo-EM) demands a sample holder capable of maintaining temperatures below 10 K with precise control, long holding times, and minimal helium use. Rising to this challenge, we initiated an ambitious project to develop a novel closed-cycle cryocooler-based cryogenic sample holder that operates without the use of liquid helium and the consumption of gaseous helium. Here, this article presents the design, construction, and experimental testing of the initial prototype, which achieves an ultimate temperature of 5.6 K with exceptional stability close to 1mK, while providing a wide temperature control range from 295 K to 5.6 K, marking a clear advancement in cryo-EM holder development. While the prototype was not designed for atomic resolution imaging and thus lacks a sturdy support system to mitigate mechanical vibrations from the cryocooler's pulsed tube, this innovative approach successfully demonstrates proof of concept. It offers unprecedented capabilities for state-of-the-art cryogenic microscopy and microanalysis in materials and biological sciences.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗