Search NASA⌕ Search

SEARCH · Search NASA

Results for “image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Image registration for in situ X-ray nano-imaging of a composite battery cathode with deformation

The structural and chemical evolution of battery electrodes at the nanoscale plays an important role in affecting the cell performance. Nano-resolution X-ray microscopy has been demonstrated as a powerful technique for characterizing the evolution of battery electrodes under operating conditions with sensitivity to their morphology, compositional distribution and redox heterogeneity. In real-world batteries, the electrode could deform upon battery operation, causing challenges for the image registration which is necessary for several experimental modalities, e.g. XANES imaging. To address this challenge, this work develops a deep-learning-based method for automatic particle identification and tracking. This approach was not only able to facilitate image registration with good robustness but also allowed quantification of the degree of sample deformation. The effectiveness of the method was first demonstrated using synthetic datasets with known ground truth. The method was then applied to an experimental dataset collected on an operating lithium battery cell, revealing a high degree of intra- and interparticle chemical complexity in operating batteries.

25 ENERGY STORAGE↗
DOE OSTI2025

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗
DOE OSTI2026

SpaceNet 9—Cross-Sensor Alignment of Optical and SAR Imagery

Precise registration of high-resolution synthetic aperture radar (SAR) and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR–optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge, including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 m to under 13 m for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 m on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR–optical image registration and offer opportunities for future benchmarking in this domain. The baseline algorithm, winning solutions, and datasets are available at https://spacenet.ai/sn9-challenge/.

benchmark datasets↗
DOE OSTI2023

CIEL ∗ Ch color map for visualization and analysis of sea ice motion

The International Commission on Illumination (CIE) designed its color space to be perceptually uniform so that a given numerical change in the color code corresponds to perceived change in color. This color encoding is demon- strated to be advantageous in scientific visualization and analysis of vector fields. The specific application is analysis of ice motion in the Arctic where patterns in smooth monthly-averaged ice motion are seen. Furthermore, fractures occurring in the ice cover result in discontinuities in the ice motion. This vector jump in displacement can also be visualized. We then analyze modeled and observed fractures through the use of a metric on the color space, and image amplitude and phase metrics. Amplitude and phase met- rics arise from image registration that is accomplished by sampling images using space filling curves, thus reducing the image registration problem to the more reliable functional alignment problem. We demonstrate this through an exploration of the metrics to compare model runs to an observed ice crack.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗
DOE OSTI2024

Intern Poster

Digital Image Correlation (DIC) is an optical technique that combines image registration and tracking methods for accurate two-dimensional and three-dimensional changes in images. DIC software can be used to track the contour, deformation, and strain of a sample. In the Advanced Test Reactor (ATR) at INL (Idaho National Laboratory) there exists a small working window of samples that can become irradiated. Hundreds of graphite disks called piggybacks have undergone this irradiation as part of the Advanced Reactor Technologies (ART) program. After irradiation, it is desirable to understand the change in tensile strength as a function of dose. Due to the limited space in the ATR, typical dog bone tensile tests reduce the number of graphite samples from hundreds to tens. However, there does exist an ASTM standard, D8289, which uses disc compression of graphite to estimate the tensile strength of the specimen with the Brazilian Disk test fixture. While only used as an estimate, which is typically off by a third, it is the purpose of this study to identify how to amend D8289 to remove the word "estimate" with the help of DIC.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Sub‐Diffraction Correlation of Quantum Emitters and Local Strain Fields in Strain‐Engineered WSe 2 Monolayers

Strain-engineering in atomically thin metal dichalcogenides is a useful method for realizing single-photon emitters (SPEs) for quantum technologies. Correlating SPE position with local strain topography is challenging due to localization inaccuracies from the diffraction limit. Currently, SPEs are assumed to be positioned at the highest strained location and are typically identified by randomly screening narrow-linewidth emitters, of which only a few are spectrally pure. In this work, hyperspectral quantum emitter localization microscopy is used to locate 33 SPEs in nanoparticle-strained WSe 2 monolayers with sub-diffraction-limit resolution (≈30 nm) and correlate their positions with the underlying strain field via image registration. In this system, spectrally pure emitters are not concentrated at the highest strain location due to spectral contamination; instead, isolable SPEs are distributed away from points of peak strain with an average displacement of 240 nm. These observations point toward a need for a change in the design rules for strain-engineered SPEs and constitute a key step toward realizing next-generation quantum optical architectures.

2D material↗
DOE OSTI2025

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy↗
DOE OSTI2024

Predicting ptychography probe positions using single-shot phase retrieval neural network

Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of 10 2 pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗
DOE OSTI2024

Nuclear imaging to diagnose and correct target-driver registration at high-repetition-rate for improved reactor efficiency

Inertial Confinement Fusion produces energy from a burning plasma lasting a fraction of a nanosecond. Power plant designs based on Inertial Fusion Energy (IFE) will need to ignite targets 1-10 times a second, fired as projectiles into a chamber and delivering the driver to the target location. Driver asymmetry is known to impact ICF experiments at gain near unity and remains a candidate for primary yield degradation, and therefore fusion power plant energy output, for high-gain target designs. For a Fusion Power Plant (FPP), continuous and real-time monitoring of target performance provides an opportunity to stabilize or correct the target-driver registration. This requires x-ray and neutron imaging with a large field-of-view, sufficiently high resolution, fast analysis and to subtend a minimal solid angle. We introduce design criteria for such an imaging system that uses a coded aperture and time-gated, lens-coupled scintillators as a viable solution and outline the research steps required to field such a system. Integrating the imaging system into an IFE power plant as part of an active feedback loop could increase average power output by reducing the failure rate due to mis-aligned drivers with respect to the target.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

STEM Imaging of Materials: Final Report for DE-FG02-08ER46547

This project supported research advancing the state of the art in scanning transmission electron microscopy (STEM) imaging and characterization of materials, especially electronic materials. The project began with studies of point defects in materials using high-resolution Z-contrast STEM, then evolved to including methods in four-dimensional (4D) STEM and machine learning. Highlights include: (1) the discovery of stable, p-type ZnO via Sb doping, (2) demonstration that the high performance of InGaN LEDs is not due to In composition fluctuations as previously proposed, (3) the demonstration of the first sub-pm precision high-resolution STEM images using non-rigid registration of a series of STEM images, (4) the extension of high-precision STEM to low dose imaging and spectrum imaging, (5) discovery of a synthesis method for twisted spiral growth of transition-metal dichalcogenide materials via chemical vapor deposition, and (6) development of machine-learning methods for analysis and denoising of enormous 4D STEM data sets.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Z Line VISAR Analysis with the LineVISAR SMASH Class

The Z line VISAR system (ZLV) is a spatially-resolved velocimeter that measures surface velocities in high-energy density experiments on the Z Pulsed Power Facility to facilitate the investigation of fusion, power flow, and dynamic material physics. The data measured in these experiments are analyzed with the LineVISAR SMASH class, a MATLAB software suite that provides tools for data importation, streak image correction, spatiotemporal registration, wrapped phase computation, phase unwrapping, shock handling, and velocity calculation. This report overviews the LineVISAR class, discusses its use, provides example implementations, and supplies analysis specifics not typically recorded in journal publications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

3D imaging of magnetic domains in Nd 2 Fe 14 B using scanning hard X-ray nanotomography

Nanoscale structural and electronic heterogeneities are prevalent in condensed matter physics. Investigating these heterogeneities in 3D has become an important task for understanding material properties. To provide a tool to unravel the connection between nanoscale heterogeneity and macroscopic emergent properties in magnetic materials, scanning transmission X-ray microscopy (STXM) is combined with X-ray magnetic circular dichroism. A vector tomography algorithm has been developed to reconstruct the full 3D magnetic vector field without any prior noise assumptions or knowledge about the sample. Two tomographic scans around the vertical axis are acquired on single-crystalline Nd 2 Fe 14 B pillars tilted at two different angles, with 2D STXM projections recorded using a focused 120 nm X-ray beam with left and right circular polarization. Image alignment and iterative registration have been implemented based on the 2D STXM projections for the two tilts. Dichroic projections obtained from difference images are used for the tomographic reconstruction to obtain the 3D magnetization distribution at the nanoscale.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Positron emission tomography harmonization in the Alzheimer's Disease Neuroimaging Initiative: A scalable and rigorous approach to multisite amyloid and tau quantification

Abstract INTRODUCTION A key goal of the Alzheimer's Disease NeuroImaging Initiative (ADNI) positron emission tomography (PET) Core is to harmonize quantification of β‐amyloid (Aβ) and tau PET image data across multiple scanners and tracers. METHODS We developed an analysis pipeline (Berkeley PET Imaging Pipeline, B‐PIP) for ADNI Aβ and tau PET images and applied it to PET data from other multisite studies. Steps include image pre‐processing, refacing, magnetic resonance imaging (MRI)/PET co‐registration, visual quality control (QC), quantification of tracer uptake, and standardization of Aβ and tau standardized uptake value ratios (SUVrs) across tracers. RESULTS Measurements from 10,105 cross‐sectional and longitudinal Aβ and tau PET scans acquired in several studies between 2010 and 2024 can be processed, harmonized, and directly merged across tracers and cohorts. DISCUSSION The B‐PIP developed in ADNI is a scalable image harmonization approach used in several observational studies and clinical trials that facilitates rigorous Aβ and tau PET quantification and data sharing. Highlights Quantitative results from ADNI Aβ and tau PET data are generated using a rigorous, scalable image processing pipeline This pipeline has been applied to PET data from several other large, multisite studies and trials Quantitative outcomes are harmonizable across studies and are shared with the scientific community

Neurosciences & Neurology↗
DOE OSTI2023

Multiparametric optical label-free imaging to analyze plant cell wall assembly and metabolism. (Final Report)

Plant tissues are often considered not ideal for fluorescence imaging because of the pervasive intrinsic fluorescence of many plant metabolites and the intricate interactions with light of the many semi-crystalline polymers at the cell wall. Our project aims to take advantage of this observed shortcoming by developing a label-free, optical microscopy platform for characterizing multiple fingerprints of important cell wall components and stress-related, at subcellular scale resolution. The new imaging system can collect fingerprints from both emitted and scattered light that can inform on the chemical nature, subcellular distribution, anisotropy, and molecular environment of multiple cell wall components in intact plant tissues. We are combining these imaging capabilities with computational tools that enable correlated registration, integration, and analysis. This fully integrated, multiparametric optical system will be used to address biological problems connected to cell wall assembly in grasses. This includes a focus on developmental and environmental variation of cell wall impregnation with silica, lignin, suberin, and cutin in different tissues and cell types. Our research plan comprises three main goals: (1) To develop an accessible imaging platform and associated open-source software able to extract and integrate fingerprints from fluorescence-associated (multispectral emission, lifetime, and polarization), wide-field polarimetry, second harmonic generation (SHG), and stimulated Raman scattering signals (SRS); (2) To determine unique combination of fingerprints for various cell wall components and selected metabolites; (3) To analyze the process of cell wall silicification in grasses and determine how silicification affects cell wall properties and lignin, cutin, and suberin deposition in other cell types under differ stress conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗