SEARCH · Search NASA

Results for “Advanced Image Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Time-resolved spray characterization via unified optical flow and binarization technique

This work leverages an unsupervised machine learning and advanced image processing techniques to characterize the breakup of fuel sprays in a small-scale combustor under reacting conditions, providing valuable insights into near-nozzle flow phenomenology. The proposed methodology integrates an improved optical flow model on a convolutional neural network to extract flow vectors with a binarization technique to assess droplets’ size and shape across the region of interest. The velocimetry approach demonstrates superior performance compared to a state-of-the-art optical flow model when applied to high-speed X-ray phase contrast spray images, achieving more accurate and reliable flow predictions. Moreover, breakup processes are quantified by breakup length and sphericity in accordance with velocity estimations, allowing a more complete characterization of the flow. This study establishes a robust methodology for analyzing spray morphology and primary breakup in compact combustors, contributing valuable means of understanding and optimizing fuel spray behavior in advanced combustion systems.

42 ENGINEERING↗

DOE OSTI2024

LLM integration into EPICS

The utilization of large language models (LLMs) such as ChatGPT has seen a remarkable increase in various fields over the past few years. These models have demonstrated their versatility and capability in understanding and generating human-like text, making them invaluable tools in numerous applications. In this project, we explore the integration of a LLM into the Experimental Physics and Industrial Control System (EPICS). The primary focus of this integration is to employ the LLM for advanced image processing and spatial analysis on images obtained from the beamlines. By leveraging the capabilities of the LLM, we aim to enhance the accuracy and efficiency of image interpretation, enabling more precise data analysis and decision-making within the EPICS framework. This integration not only showcases the potential of LLMs in scientific and industrial applications but also sets the stage for future advancements in automated control systems.

Adams, Ethan↗

DOE OSTI2025

Evaluating User Errors and Temporal Trends in Marine Fish Communities Using 360-Degree Underwater Photography

The use of environmental DNA (eDNA) sampling has been proposed as a complementary method to monitor fish species in marine environments, offering a non-invasive and potentially more efficient approach to marine species observations. eDNA monitoring could be especially useful in and around sites targeted for marine energy generation as these regions need regular monitoring that would be impractical with traditional techniques. Before we can fully rely upon eDNA, we must first verify its accuracy against other proven methods, such as the use of underwater photography. In this study, I deployed a 360-degree camera in the tidal channel of Sequim Bay once a month during several hours overlapping slack tide. I investigated how having multiple people identify and count fish on underwater images could affect the overall results. Using chi square tests in R, I compared my fish identifications and counts to those made by another intern on the same images recorded in August. I found significant differences in the number of species identified and the total individual counts between the two different datasets. I also tested the statistical differences in both Shannon diversity and Pielou evenness indices between the August, September, and November camera deployments using a Hutcheson t-test. Only one significant difference was found in the Shannon index comparisons, and none were found between the Pielou evenness comparisons. These findings show that if multiple identifiers are used to process underwater images, quality control checks must be made to reduce the potential for error. This also points toward the possibility to leverage more advanced image analysis processes, such as automated image analysis software. The findings from this study also show that the dynamics of marine fish communities can vary over a few months; however, further analysis is needed to determine the extent of the seasonal changes in Sequim Bay.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗

DOE OSTI2024

Extraction of Vibration Data with Imaging

To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Scaling deep learning for material imaging with a pseudo 3D model for domain transfer

The recent introduction of deep learning methods for image processing has greatly advanced the characterization of materials using three-dimensional (3D) X-ray imaging techniques. However, deep learning models often have difficulty performing consistently across images owing to unavoidable variations in imaging conditions, which create inconsistencies even for the same material. As a result, networks must frequently be retrained for new datasets, limiting their applicability and generalization. Thus, it is critical to reduce the variations between images to enable a single model to process multiple datasets. Herein, we introduce P3T-Net, a pseudo-3D domain transfer network that transfers diverse 3D images into a uniform domain before processing using deep learning models. Remarkably, P3T-Net enables the reuse of previously trained networks for processing new images and considerably reduces the computational cost of transferring 3D images across domains. These unique capabilities were demonstrated in the following scenarios: (i) image enhancement of fast scans for geological rock and hydrogen fuel cells, (ii) enhancement of images to match the quality of multi-source imaging for lithium-ion batteries, (iii) accurate segmentation of images captured under different conditions, and (iv) tera-scale 3D transfer (10 11 voxels) on a single GPU. Overall, the proposed approach addresses cross-domain inconsistencies across various materials and conditions, thereby enabling more robust and generalizable deep learning solutions for a wide range of material imaging tasks.

25 ENERGY STORAGE↗

DOE OSTI2025

Review of High‐Speed Digital Image Correlation: Advancements and Good Practices

This paper reviews the current state of the art in high‐speed (HS) and ultrahigh‐speed (UHS) digital image correlation (DIC) techniques, emphasizing their critical role in experimental research across various scientific domains. HS and UHS DIC have evolved significantly, driven by advancements in camera systems, image processing algorithms and experimental methodologies. These developments have opened new avenues for capturing and analysing dynamic events with unprecedented temporal and spatial detail, but not without introducing challenges such as optical distortions, motion blur and lighting issues that can affect measurement quality. This review advocates for standardized reporting practices in HS/UHS DIC methodologies to improve reproducibility and reliability across studies, drawing on guidelines from the International Digital Image Correlation Society (iDICs). Through a comprehensive analysis of over 150 articles, this review identifies key advancements in imaging technology and their application in six research domains: material characterization, test development, fracture mechanics, model validation, ballistic and explosive phenomena assessment and measurement uncertainties. Distinctions between two‐dimensional (2D) and stereo‐DIC applications are explored, offering insights into their practical implementation and trade‐offs. Good practices for HS/UHS DIC applications are proposed along with suggestions for future directions for this evolving field, highlighting the indispensable role of technological innovation in expanding the capabilities of optical metrology.

experimental mechanics↗

DOE OSTI2025

The Satellite Image Simulation Toolkit

The Satellite Image Simulation Toolkit (SatIST) is a python software package designed to generate diverse and realistic satellite imaging scenarios. It serves as a toolkit for simulating data that supports the development and testing of algorithms used in satellite detection, calibration, and characterization. SIST provides a suite of simulation tools that allow users to replicate various satellite observation conditions, including sidereal and target tracking. By enabling the creation of scenarios that mimic real-world satellite operations, SIST facilitates advancements in satellite image data processing and the study of satellite behavior under different observational parameters.

Perloff, AlexxS [Lawrence Livermore National Labor↗

DOE OSTI2024

Integrated photonic encoder for low power and high-speed image processing

Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Image processing tools for petabyte-scale light sheet microscopy data

Light sheet microscopy is a powerful technique for high-speed three-dimensional imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present PetaKit5D, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are optimized for memory and performance. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson–Lucy deconvolution and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Imaging from Macro to Nanoscale: Multimodal Advances in Chemical and Biomedical Imaging

Imaging increasingly serves as a multiscale framework for linking molecular mechanisms to cellular behavior, tissue architecture, and organ phenotypes in biology and unraveling fundamental processes in chemistry, physics and materials science. This Perspective highlights recent advances in chemical and biomedical imaging across macro-, micro-, and nanoscales, using representative examples published in Chemical and Biomedical Imaging (CBMI). At the macroscale, we discuss chemically selective MRI, including endogenous and exogenous CEST strategies, together with photoacoustic imaging as a hybrid modality with functional and chemical contrast. At the microscale, we consider fluorescence, label-free optical and vibrational imaging, and selected X-ray approaches that expand sensitivity, specificity, and temporal resolution in biological and materials systems. At the nanoscale, we highlight super-resolution fluorescence microscopy, single-molecule methods, tip-enhanced Raman spectroscopy, and correlative imaging strategies that resolve local heterogeneity and molecular organization. Across scales, a common theme emerges that advances in probes, contrast mechanisms, instrumentation, and sample handling are enabling chemically informed imaging that connects molecular specificity with biological context.

multiscale imaging↗

DOE OSTI2024

The Evolution of Galaxies and Clusters at High Spatial Resolution with Advanced X-ray Imaging Satellite (AXIS)

Stellar and black hole feedback heat and disperse surrounding cold gas clouds, launching gas flows off circumnuclear and galactic disks, producing a dynamic interstellar medium. On large scales bordering the cosmic web, feedback drives enriched gas out of galaxies and groups, seeding the intergalactic medium with heavy elements. In this way, feedback shapes galaxy evolution by shutting down star formation and ultimately curtailing the growth of structure after the peak at redshift 2–3. To understand the complex interplay between gravity and feedback, we must resolve both the key physics within galaxies and map the impact of these processes over large scales, out into the cosmic web. The Advanced X-ray Imaging Satellite (AXIS) is a proposed X-ray probe mission for the 2030s with arcsecond spatial resolution, large effective area, and low background. AXIS will untangle the interactions of winds, radiation, jets, and supernovae with the surrounding interstellar medium across the wide range of mass scales and large volumes driving galaxy evolution and trace the establishment of feedback back to the main event at cosmic noon. This white paper is part of a series commissioned for the AXIS Probe mission concept; additional AXIS white papers can be found at the AXIS website.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

New perspectives on materials and device dynamics using time-resolved full-field diffraction X-ray imaging

Understanding how materials evolve during synthesis, processing, or device operation requires experimental access to structural dynamics across wide ranges of length and time scales, often in bulk samples or even within packaged devices. Time-resolved full-field diffraction X-ray microscopy has recently emerged as a powerful way to meet this need by combining the penetration and structural sensitivity of X-ray diffraction with objective-lens-based magnification, sensitive high-resolution X-ray imaging detectors, and pump-probe and real-time imaging strategies. Advances in full-field X-ray diffraction microscopy, often termed dark-field X-ray microscopy (DFXM), enable simultaneous imaging of extended fields of view while retaining crystallographic selectivity. Time-resolved DFXM promises to enable advances in materials processing and dynamics, electrochemical and photochemical processes, and the design of electronic devices. This Perspective summarizes the key instrumental concepts that define the performance of these methods, including the choice of imaging optics, detector considerations, and the impact of source time structure at synchrotron light sources and X-ray free-electron lasers (XFELs). We discuss the simultaneous use of complementary imaging modes that are increasingly used in practice. The early demonstrations of the potential of time-resolved DFXM include real-time defect and grain-boundary dynamics during metal annealing, stroboscopic imaging of functional devices with high strain sensitivity, and ultrafast pump-probe implementations at XFELs that directly visualize acoustic-wave propagation and energy dissipation in bulk crystals.

Dark-field X-ray microscopy↗

DOE OSTI2025

Predicting High‐Resolution Spatial and Spectral Features in Mass Spectrometry Imaging with Machine Learning and Multimodal Data Fusion

Recent advancements in molecular Mass Spectrometry Imaging have sparked interest in integrating high spatial resolution methods with molecular mass-spectrometry-based chemical imaging. Fusion-based algorithms have proven effective in generating high spatial-resolution molecular mass spectra. However, a significant challenge stems from the differing physical mechanisms underlying image generation and data upsampling techniques, potentially leading to discrepancies in integrated information channels. Integrating physical constraints into data processing workflows is essential to tackle this issue. In this study, we propose an innovative approach that merges data from Fourier transform ion cyclotron resonance (FTICR), time-of-flight matrix-assisted laser desorption/ionization, and time-of-flight secondary ion mass spectrometry imaging techniques. By leveraging FT-ICR's unparalleled spectral resolution and ToF-SIMS's exceptional spatial resolution, we achieve submicron spatial resolution, enabling the observation of intact molecular species with remarkable spectral precision. Canonical correlation analysis is employed to incorporate physical constraints. Through sophisticated image processing and machine learning techniques, the results of this fusion hold significant promise for advancing our comprehension of complex systems and unveiling concealed molecular intricacies.

canonical correlation analysis↗

DOE OSTI2025

Fiber-Optic Sensing for Earthquake Hazards Research, Monitoring, and Early Warning

The use of fiber‐optic sensing systems in seismology has exploded in the past decade. Despite an ever‐growing library of ground‐breaking studies, questions remain about the potential of fiber‐optic sensing technologies as tools for advancing if not revolutionizing earthquake‐hazards‐related research, monitoring, and early warning systems. A working group convened to explore these topics; we comprehensively examined the application of fiber optics in various aspects of earthquake hazards, encompassing earthquake source processes, crustal imaging, data archiving, and technological challenges. There is great potential for fiber‐optic systems to advance earthquake monitoring and understanding, but to fully unlock their capabilities requires continued progress in key areas of research and development, including instrument testing and validation, increased dynamic range for applications focused on larger earthquakes, and continued improvement in subsurface and source imaging methods. A key current stumbling block results from the lack of clear data archiving requirements, and we propose an initial strategy that balances data volume requirements with preserving key data for a broad range of future studies. In addition, we demonstrate the potential for fiber‐optic sensing to impact monitoring efforts by documenting the data completeness in a number of long‐term experiments. Finally, we outline the features of a instrument testing facility that would enable progress toward reliable and standardized distributed acoustic sensing data. Overcoming these current obstacles would facilitate progress in fiber‐optic sensing and unlock its potential application to a broad range of earthquake hazard problems.

58 GEOSCIENCES↗

DOE OSTI2024

Multicolor Inks of Black Phosphorus for Midwave‐Infrared Optoelectronics

Abstract Black phosphorus (bP) based ink with a bulk bandgap of 0.33 eV ( λ = 3.7 µm) has recently been shown to be promising for large‐area, high performance mid‐wave infrared (MWIR) optoelectronics. However, the development of multicolor bP inks expanding across the MWIR wavelength range has been challenging. Here a multicolor ink process based on bP with spectral emission tuned from 0.28 eV ( λ = 4.4 µm) to 0.8 eV ( λ = 1.5 µm) is demonstrated. Specifically, through the reduction of bP particle size distribution (i.e., lateral dimension and thickness), the optical bandgap systematically blueshifts, reaching up to 0.8 eV. Conversely, alloying bP with arsenic (bP 1− x As x ) induces a redshift in the bandgap to 0.28 eV. The ink processed films are passivated with an infrared‐transparent epoxy for stable infrared emission in ambient air. Utilizing these multicolor bP‐based inks as an infrared light source, a gas sensing system is demonstrated that selectively detects gases, such as CO 2 and CH 4 whose absorption band varies around 4.3 and 3.3 µm, respectively. The presented ink formulation sets the stage for the advancement of multiplex MWIR optoelectronics, including spectrometers and spectral imaging using a low‐cost material processing platform.

Kim, Jae Ik↗

DOE OSTI2025

Jupyter notebooks for analyzing transmission SAXS/WAXS from beamline 7.3.3 during operando membrane fouling experiments v1.0

This software consists of python-based Jupyter Notebooks for processing transmission x-ray scattering images collected at beamline 7.3.3 at the Advanced Light Source. The measurements considered in these analyses are collected during membrane fouling experiments, where contaminants in the water deposit on/attach to the membrane surface. This software is used to elucidate the mechanisms of membrane fouling that occur during these operando membrane fouling experiments, but the analyses provided in these scripts can be extended to other scientific cases.

Landsman, Matthew [Lawrence Berkeley National Labo↗

DOE OSTI2024

Geophysical Signatures of Crack Network Coalescence in Rocks at Multiple Length Scales

The main goal of the research project was to identify the geophysical signatures of fracture growth in natural rocks by utilizing novel geophysical techniques. The research objectives were to (a) investigate the potential for geophysical methods to determine when cracks initiate, the types and locations of propagated cracks, and the coalescence of networks of cracks in natural rocks at multiple scales, (b) determine how damage at the microscale evolved into damage at the macroscale and then link the microscopic and macroscopic observations, (c) quantify crack coalescence in rocks under realistic stress conditions using coupled mechanical-geophysical-optical visualization, and (d) identify the precursors in geophysical signals to crack coalescence. The following research thrusts were explored to achieve the research objectives: (1) uniaxial compression testing of rock specimens with and without a set of pre‐existing flaws and (2) triaxial compression testing of natural rock specimens. These thrusts allowed for exploring fracturing in rocks under realistic in situ environments and at multiple scales. This project provided educational opportunities for nine graduate and undergraduate students and resulted in 27 peer-reviewed publications. This first research thrust focused on investigating the micromechanics of fractures in rocks through uniaxial compression testing combined with advanced geophysical and imaging techniques, specifically acoustic emission (AE) monitoring, ultrasonic imaging, and 2-dimensional Digital Image Correlation (2D-DIC). By examining damage processes under time-independent and time-dependent loading conditions, insights into damage localization, crack initiation, and fracturing mechanisms were gained. It was observed that the AE signals and the strain-based measurements directly reflect the state of damage in the rock specimen and could be used to identify the cracking levels, such as the crack initiation (CI) and crack damage (CD), and the mode of deformation. A novel calibration apparatus was developed to enhance the accuracy of AE sensors, allowing for the estimation of key parameters such as magnitude, source dimension, stress drop, and radiated seismic energy associated with the fractures. The findings highlighted significant variations in the temporal evolution of AE source parameters during the primary, secondary, and tertiary stages of creep, identifying tensile cracking as the primary deformation mode. The second research thrust focused on enhancing the understanding of fracturing processes in natural rocks through triaxial compression testing, real-time AE monitoring, and ultrasonic monitoring. We investigated the impact of various factors such as fracture propagation regimes, injection parameters, rock types, and pre-existing conditions on the hydraulic fracture (HF) behavior using scaled true-triaxially loaded specimens of Barre granite and Lyons sandstone. Custom sensor housing facilitated concurrent active and passive monitoring to analyze hydro-mechanical responses and microseismicity associated with different HF scenarios. A coupled investigation of passive microseismicity and active signal attributes permitted a detailed comprehension of the various HF processes (aseismic deformation, fracture initiation and propagation, fluid permeation, and leak-off) and their dependence on the specific rock type. The findings of this research demonstrated the effectiveness of AE monitoring techniques in providing valuable insights into the impact of various factors on the behavior and dynamics of HF processes. The advancements in monitoring techniques, offering a more thorough and precise approach, represent a significant step towards optimizing HF practices and ensuring sustainable resource extraction.

58 GEOSCIENCES↗