Search NASA⌕ Search

SEARCH · Search NASA

Results for “image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Ptychography at all wavelengths

Ptychography is a computational imaging technique that operates across multiple wavelength regimes, from electron (picometres) to X-ray (~0.1 nm), extreme ultraviolet (~10 nm) and visible light (micrometres). By reconstructing both amplitude and phase from diffraction patterns, ptychography enables high-resolution, quantitative imaging without conventional limitations imposed by lens-based optics. Ptychography has enabled advances across a range of scales: achieving deep-sub-angstrom resolution with electron microscopy, becoming an indispensable tool at X-ray synchrotron facilities worldwide and overcoming the trade-offs between resolution and field-of-view in optical imaging. This Primer provides a unified treatment of ptychography across these wavelength regimes. First, we discuss theoretical foundations, reconstruction algorithms, experimental considerations and wavelength-specific challenges. We then give examples of raw and processed data from various configurations and wavelengths. Next, we highlight key applications of ptychography in life sciences, materials science and industry. We also discuss data standards, open-source software implementations and best practices for ensuring reproducibility across different wavelength regimes. Finally, we consider limitations and future opportunities for ptychography. Together with accompanying datasets and code implementations, this Primer aims to serve newcomers and experienced practitioners in the field, facilitating broader adoption of ptychography across different disciplines.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Molecules are essential building blocks of life and their different conformations (i.e., shapes) crucially determine the functional role that they play in living organisms. Cryogenic Electron Microscopy (cryo-EM) allows for acquisition of large image datasets of individual molecules. Recent advances in computational cryo-EM have made it possible to learn latent variable models of conformation landscapes. However, interpreting these latent spaces remains a challenge as their individual dimensions are often arbitrary. The key message of our work is that this interpretation challenge can be viewed as an Independent Component Analysis (ICA) problem where we seek models that have the property of identifiability. That means, they have an essentially unique solution, representing a conformational latent space that separates the different degrees of freedom a molecule is equipped with in nature. Thus, we aim to advance the computational field of cryo-EM beyond visualizations as we connect it with the theoretical framework of (nonlinear) ICA and discuss the need for identifiable models, improved metrics, and benchmarks. Moving forward, we propose future directions for enhancing the disentanglement of latent spaces in cryo-EM, refining evaluation metrics and exploring techniques that leverage physics-based decoders of biomolecular systems. Moreover, we discuss how future technological developments in time-resolved single particle imaging may enable the application of nonlinear ICA models that can discover the true conformation changes of molecules in nature. The pursuit of interpretable conformational latent spaces will empower researchers to unravel complex biological processes and facilitate targeted interventions. This has significant implications for drug discovery and structural biology more broadly. More generally, latent variable models are deployed widely across many scientific disciplines. Thus, the argument we present in this work has much broader applications in AI for science if we want to move from impressive nonlinear neural network models to mathematically grounded methods that can help us learn something new about nature.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Two 28-nm front-end ASICs for ultra-fine spatial resolution and precision timing to be 3D integrated with 12 LGADs

The 3DIntSenS Collaboration—a joint effort between SLAC, Fermilab, and LLNL—is developing enabling technologies for next-generation radiation imaging detectors that combine ultra-fine spatial resolution (about 10 µm) with precision timing (<20 ps), while maintaining low power <1 W/cm2 and high data throughput. The approach leverages 3D integration between advanced CMOS readout ASICs and finely pixelated LGAD sensors to achieve the performance and scalability required for large-area, high-rate applications. High-granularity, precision-timing detectors are essential for scientific advances in HEP, NP, BES, and FES, but widespread adoption is limited by the cost and complexity of 3D integration. To close this gap, the collaboration is developing LGAD sensors compatible with 12-inch commercial CMOS processes, enabling cost-effective integration with high-performance ASICs under development. We present two 28 nm CMOS ASIC prototypes, including a low-jitter front end, and in-pixel TDC demonstrating sub-10 ps timing resolution. These advances represent a critical step toward scalable, high-resolution radiation imaging systems for future scientific instrumentation.

England, Troy [Fermilab] (ORCID:0000000154405255)↗
DOE OSTI2026

Two 28-nm front-end ASICs for ultra-fine spatial resolution and precision timing to be 3D integrated with 12 LGADs

The 3DIntSenS Collaboration—a joint effort between SLAC, Fermilab, and LLNL—is developing enabling technologies for next-generation radiation imaging detectors that combine ultra-fine spatial resolution (about 10 µm) with precision timing (<20 ps), while maintaining low power <1 W/cm2 and high data throughput. The approach leverages 3D integration between advanced CMOS readout ASICs and finely pixelated LGAD sensors to achieve the performance and scalability required for large-area, high-rate applications. High-granularity, precision-timing detectors are essential for scientific advances in HEP, NP, BES, and FES, but widespread adoption is limited by the cost and complexity of 3D integration. To close this gap, the collaboration is developing LGAD sensors compatible with 12-inch commercial CMOS processes, enabling cost-effective integration with high-performance ASICs under development. We present two 28 nm CMOS ASIC prototypes, including a low-jitter front end, and in-pixel TDC demonstrating sub-10 ps timing resolution. These advances represent a critical step toward scalable, high-resolution radiation imaging systems for future scientific instrumentation.

England, Troy [Fermilab] (ORCID:0000000154405255)↗
DOE OSTI2025

Data and Scripts associated with a manuscript on ecosystem responses to wildfires in the Columbia River Basin

This data package is associated with the publication “Ecosystem leaf area, gross primary production, and evapotranspiration responses to wildfire in the Columbia River Basin” submitted to Biogeosciences (Shi et al., 2024; doi: 10.22541/au.171053013.30286044/v1). In this research, data products, leaf area index (LAI), gross primary production (GPP), and evapotranspiration (ET), from the Moderate Resolution Imaging Spectroradiometer (MODIS) are used to quantify the resistance and resilience of different ecosystem types in the Columbia River Basin (CRB). A machine learning algorithm, random forest (RF), was used to examine the impacts of precipitation, vapor pressure deficit (VPD), and burn severity from Monitoring Trends in Burn Severity (MTBS) on ecosystem resilience. The data package includes the processed MODIS data products, precipitation, VPD, and burn severity in 138 fire regions in CRB and the input files for RF model training. This data package includes six folders. The MODIS products are included in three MODIS_* folders with shell scripts for data clipping and *ncl files for data processing: (1) “/MODIS_LAI_CRB”; (2) “/MODIS_GPP_CRB”; and (3) “/MODIS_ET_CRB”. All the processed data for each fire event are NetCDF formatted. The MTBS burn severity data and the shell and *ncl scripts used for data processing are in the folder named (4) “MTBS_fire”. The ERA meteorological fields and the data processing scritps are in (5) “ERA_Var_CR”. All the scripts for figure development are in the format of *ncl and in the folder (6) “paper_scripts”. See the file ending in “flmd.csv” for a list of all files contained in this data package and descriptions for each. Tabular column headers and units are described in the data dictionary file ending in “dd.csv”.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

3D Reconstruction of a High-Energy Diffraction Microscopy Sample Using Multi-modal Serial Sectioning with High-Precision EBSD and Surface Profilometry

High-energy diffraction microscopy (HEDM) combined with in situ mechanical testing is a powerful nondestructive technique for tracking the evolving microstructure within polycrystalline materials during deformation. This technique relies on a sophisticated analysis of X-ray diffraction patterns to produce a three-dimensional reconstruction of grains and other microstructural features within the interrogated volume. However, it is known that HEDM can fail to identify certain microstructural features, particularly smaller grains or twinned regions. Characterization of the identical sample volume using high-resolution surface-specific techniques, particularly electron backscatter diffraction (EBSD), can not only provide additional microstructure information about the interrogated volume but also highlight opportunities for improvement of the HEDM reconstruction algorithms. In this study, a sample fabricated from undeformed “low solvus, high refractory” nickel-based superalloy was scanned using HEDM. The volume interrogated by HEDM was then carefully characterized using a combination of surface-specific techniques, including epi-illumination optical microscopy, zero-tilt secondary and backscattered electron imaging, scanning white light interferometry, and high-precision EBSD. Custom data fusion protocols were developed to integrate and align the microstructure maps captured by these surface-specific techniques and HEDM. The raw and processed data from HEDM and serial sectioning have been made available via the Materials Data Facility (MDF) at https://doi.org/10.18126/4y0p-v604 for further investigation.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Effective Defect Detection Using Instance Segmentation for NDI

Ultrasonic testing is a common Non-Destructive Inspection (NDI) method used in aerospace manufacturing. However, the complexity and size of the ultrasonic scans make it challenging to identify defects through visual inspection or machine learning models. Using computer vision techniques to identify defects from ultrasonic scans is an evolving research area. In this study, we used instance segmentation to identify the presence of defects in the ultrasonic scan images of composite panels that are representative of real components manufactured in aerospace. We used two models based on Mask- RCNN (Detectron 2) and YOLO 11 respectively. Additionally, we implemented a simple statistical pre-processing technique that reduces the burden of requiring custom-tailored pre-processing techniques. Our study demonstrates the feasibility and effectiveness of using instance segmentation in the NDI pipeline by significantly reducing data pre-processing time, inspection time, and overall costs.

computer vision techniques↗
DOE OSTI2026

Extremized nonlinear and linearized responses in soft metamaterials enabled by gradient-based design and grayscale digital light processing

In this study, we develop a gradient-based design approach that exploits grayscale digital light processing (DLP) 3D printing for extremizing the nonlinear and linearized response of soft metamaterials — materials that harness engineered geometric instabilities to undergo large and programmable changes in configuration. Grayscale DLP approaches modulate local mechanical properties at the pixel scale by tuning the light intensity within a single grayscale image, unlocking an exceptionally large design space. To effectively navigate this space, we develop smooth mappings between local light intensity values and global quantities of interest that characterize the behavior of soft metamaterials. Enabling these smooth mappings are robust and differentiable nonlinear finite element simulations powered by a trust region solver. A PDE-constrained optimization problem is then solved to invert these mappings and produce light intensity distributions that endow the printed part with varying stiffness and flexibility in distinctive regions. It is shown that optimizing the distribution of soft and stiff phases throughout a metamaterial structure results in markedly different buckling and self-contact configurations to drive extremized nonlinear compression and linearized vibration responses. Optimized light intensity distributions are translated to grayscale images and directly used to print soft metamaterial samples, showing remarkable agreement between the buckling and self-contact response in simulated and measured deformed configurations.

Additive manufacturing↗
DOE OSTI2026

Opportunities for imaging light nuclei with a second interaction region at the Electron-Ion Collider

The upcoming Electron-Ion Collider (EIC) will address several outstanding puzzles in modern nuclear physics. Key questions—such as the partonic structure of nucleons and nuclei and the origin of their mass and spin—can be explored through high-energy electron-proton and electron-nucleus collisions. Here, to maximize its scientific reach, the EIC community has advocated for the addition of a second interaction region equipped with a detector complementary to the EIC general purpose collider detector, ePIC. The preconceptual design of this interaction region aims to provide a different configuration from the first interaction region, which enhances forward acceptance at very small scattering angles (𝜃 ∼0 mrad). This machine configuration would significantly benefit exclusive, tagging, and diffractive physics programs, complementing those of the ePIC experiment. In particular, accessing coherent diffractive processes on light nuclei by tagging of the full, intact nucleus is essential for mapping their spatial parton distributions. In this work, we present an exploratory study of the detection capabilities for light nuclei at a second EIC interaction region, with a detailed discussion of the accessible kinematic phase space and its implications for imaging.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

In situ formation of pseudohalide anions induced by humid air and light passivates formamidinium‐based halide perovskites

Abstract Metal halide perovskites based on formamidinium (FA), or FA‐rich compositions have shown great promise for high‐performance photovoltaics. A deeper understanding of the impact of ambient conditions (e.g., moisture, oxygen, and illumination) on the possible reactions of FA‐based perovskite films and their processing sensitivities has become critical for further advances toward commercialization. Herein, we investigate reactions that take place on the surface of the FA 0.7 Cs 0.3 , mixed Br/I wide bandgap perovskite thin films in the presence of humid air and ambient illumination. The treatment forms a surface layer containing O, OH, and N‐based anions. We propose the latter originates from formamidine trapped at the perovskite/oxide interface reacting further to cyanide and/or formamidinate—an understudied class of pseudohalides that bind to Pb. Optimized treatment conditions improve photoluminescence quantum yield owing to both reduced surface recombination velocity and increased bulk carrier lifetime. The corresponding perovskite solar cells also exhibit improved performance. Identifying these reactions opens possibilities for better utilizing cyanide and amidinate ligands, species that may be expected during vapor processing of FA‐based perovskites. Our work also provides new insights into the self‐healing or self‐passivating of MA‐free perovskite compositions where FA and iodide damage could be partially offset by advantageous reaction byproducts. image

14 SOLAR ENERGY↗
DOE OSTI2025

Quantum frequency resampling

In signal processing, resampling algorithms can modify the number of resources encoding a collection of data points. Downsampling reduces the cost of storage and communication, while upsampling interpolates new data from limited one, e.g., when resizing a digital image. We present a toolset of quantum algorithms to resample data encoded in the probabilities of a quantum register, using the quantum Fourier transform to adjust the number of high-frequency encoding qubits. We discuss advantage over classical resampling algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

TEAMER: Twin Ocean Power Wave Energy Converter Comprehensive Overview

These files collectively provide a comprehensive overview of the testing process, data analysis, and validation for the Twin Ocean Power device tested at the O.H. Hinsdale Wave Research Laboratory, supported by TEAMER funding. This resource includes an overview of power results for a series of 7 trials. The files included in this comprehensive overview include a comprehensive log sheet for each trial, a summary of all trials, and processing scripts for the raw data. It includes all raw data in .tsv and MATLAB compatible formats, an average power chart, angular velocity charts for each trial, trial metrics, and power output files. This resource includes images of the Twin Ocean Power Wave Energy Converter device components and movement during testing and video recordings of each trial.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

ExtremeMETA: High-speed Lightweight Image Segmentation Model by Remodeling Multi-channel Metamaterial Imagers

Deep neural networks (DNNs) have heavily relied on traditional computational units, such as CPUs and GPUs. However, this conventional approach brings significant computational burden, latency issues, and high power consumption, limiting their effectiveness. This has sparked the need for lightweight networks such as ExtremeC3Net. Meanwhile, there have been notable advancements in optical computational units, particularly with metamaterials, offering the exciting prospect of energy-efficient neural networks operating at the speed of light. Yet, the digital design of metamaterial neural networks (MNNs) faces precision, noise, and bandwidth challenges, limiting their application to intuitive tasks and low-resolution images. In this study, we proposed a large kernel lightweight segmentation model, ExtremeMETA. Based on ExtremeC3Net, our proposed model, ExtremeMETA maximized the ability of the first convolution layer by exploring a larger convolution kernel and multiple processing paths. With the large kernel convolution model, we extended the optic neural network application boundary to the segmentation task. To further lighten the computation burden of the digital processing part, a set of model compression methods was applied to improve model efficiency in the inference stage. The experimental results on three publicly available datasets demonstrated that the optimized efficient design improved segmentation performance from 92.45 to 95.97 on mIoU while reducing computational FLOPs from 461.07 MMacs to 166.03 MMacs. The large kernel lightweight model ExtremeMETA showcased the hybrid design’s ability on complex tasks.

large convolution kernel↗
DOE OSTI2024

Improvements in Optical Surface Measurement Using Reflected Computer Vision Targets

Since 2021, NREL has been developing a system to measure heliostats by measuring the deflection of printed computer vision targets, called the Reflected Target Non-intrusive Assessment (ReTNA) [6], [7]. While this system will have lower resolution than a fringe deflectometry system, it has several important advantages that make it a complimentary technology: 2D surface slope measurement can be generated from a single image, it can operate in ambient lighting, target points can be directly located in 3D space with photogrammetry allowing for a non-flat target, and it's well suited to using a smaller target, and multiple images to measure larger optical surfaces. ReTNA has undergone several significant changes and improvements, described below. This talk will summarize new system layouts designed for commercial use, new computer vision algorithms used to automate the analysis process and validation campaigns for the ReTNA software.

computer vision↗
DOE OSTI2025

Imaging nanoscale carrier, thermal, and structural dynamics with time-resolved and ultrafast electron energy-loss spectroscopy

Time-resolved and ultrafast electron energy-loss spectroscopy (EELS) is an emerging technique for measuring photoexcited carriers, lattice dynamics, and near-fields across femtosecond to microsecond timescales. When performed in either a specialized scanning transmission electron microscope or ultrafast electron microscope (UEM), time-resolved and ultrafast EELS can directly image charge carriers, lattice vibrations, and heat dissipation following photoexcitation or applied bias. Yet, recent advances in theoretical calculations and electron optics are often required to realize the full potential of ultrafast EEL spectrum imaging. Here, in this review, we present a comprehensive overview of the recent progress in the theory and instrumentation of time-resolved and ultrafast EELS. We begin with an introduction to the technique, followed by a physical description of the loss function. We outline approaches for calculating and interpreting ground-state and transient EEL spectra spanning low-loss plasmons to core-level excitations analogous to x-ray absorption. We then survey the current state of time-resolved and ultrafast EELS techniques beyond photon-induced near-field electron microscopy, highlighting abilities to image carrier and thermal dynamics. Finally, we examine future directions enabled by emerging technologies, including electron beam monochromation, in situ and operando cells, laser-free UEM, and high-speed direct electron detectors. These advances position time-resolved and ultrafast EELS as a critical tool for uncovering nanoscale dynamic processes in quantum materials and solar energy conversion devices.

Computational methods↗
DOE OSTI2024

Unveiling mechanisms and onset threshold of humping in high-speed laser welding

The fabrication of fuel cells relies on a rapid laser welding process. However, challenges arise with the occurrence of humping when the welding speed surpasses a critical threshold, which poses difficulties in achieving a smooth surface finish and a consistent weld strength. This study aims to elucidate the humping mechanisms by analyzing the morphology of molten pool and the characteristics of melt flow at varying welding speeds via in situ synchrotron high-speed X-ray imaging and computational fluid dynamics simulations. Our findings indicate that the short keyhole rear wall, the high backward melt velocity, and the prolonged tail of molten pool are the primary factors contributing to the onset of humping. Furthermore, a dimensionless humping index (π h ) was introduced, which successfully captured the onset threshold of humping across different literatures. This index not only provides a quantitative description of the humping formation tendency but also serves as a valuable tool for optimizing the laser welding process.

42 ENGINEERING↗
DOE OSTI2024

Thermomechanical Degradation of Sintered Copper Under High-Temperature Thermal Shock

The need for reliable bonded interface materials is critical to realize the performance benefits of wide-bandgap devices in power electronics modules, especially in operating temperatures greater than 150 degrees C. In this paper, we investigate the thermomechanical performance of sintered copper (Cu) as a large-area attachment, bonded between Cu baseplates and active-metal-bonded substrates, under accelerated thermal shock (-40 degrees C to 200 degrees C) conditions. In the fabrication phase of the samples, we used different stencil patterns and found that the grid and stripe patterns resulted in a better outgassing of the residual organics during the sintering process, thereby ensuring a substantially improved bond quality compared to a full-area print. The paste consisted of Cu microflakes, and we performed sintering using a Budatec SP300 sintering press at 275 degrees C with 15 MPa of bonding pressure for 5 minutes in a nitrogen atmosphere. Under accelerated experiments, we monitored the degradation of the sintered Cu bond in the samples through C-mode scanning acoustic microscope (C-SAM) images. To quantify the defect percentage in C-SAM images, we investigated image denoising techniques to exclude the pattern prints. Finally, we cross-sectioned a sample and obtained scanning electron microscope images, which revealed adhesive fracture as the dominant failure mechanism.

ADVANCED PROPULSION SYSTEMS,INORGANIC, ORGANIC, PH↗
DOE OSTI2024

First-Principles Simulation of Beam-Induced Processes Underlying Atomic Manipulation in Electron Microscopes

The development of experimental methods and apparatuses capable of promoting atomically precise material manipulations holds great promise for realizing the ultimate limit of feature miniaturization in materials and devices. The ability to modify materials atom by atom is anticipated to usher in new technologies in areas as diverse as separation science, medicine, and quantum information science. Historically, scanning probe-based techniques have been the most prominent approaches in this space. However, these methods are best suited for the manipulation of surface-exposed regions of materials, as the strong perturbations required for bond scission are delivered most effectively to atoms in the near-proximity to the scanning probe. In contrast, convergent electron beams with energies tuned slightly below the threshold for inducing irreversible knock-on damage have recently been employed (within scanning transmission electron microscopy) to promote atomic-scale bond rearrangements in various beam-stable solids. Currently, however, the efficiency and selectivity of beam-induced atomic manipulation processes with focused electron beams are such that long irradiation times are required to induce a desired atomic rearrangement. With a better understanding of the underlying physics dictating the outcome of a given irradiation event, methods can be devised to improve the efficiency of these techniques so that their promise can be fully realized through widespread adoption.To this end, this Account details our recent efforts to develop and apply tractable first-principles simulation approaches for studying the response of materials to electric beam-like external electric potentials applied in real space. We briefly review the concepts and capabilities in the area of atomically precise materials manipulation and review the early demonstrations of accomplishments in this area, focusing on studies using scanned convergent electron beam probes in particular. We expound upon the depth of the challenge and identify critical shortcomings of theoretical methods that have previously been employed in the simulation of beam-induced processes. We then describe the computational methods that we have generalized from the concepts and tools most commonly applied to the study of molecular photochemistry and how our adaptations of these methods can be employed to capture the relevant dynamical phenomena for beam-induced processes ranging from the initial electron scattering to the ensuing multistate reactions. Here, we contextualize these methods within the current state of the art in this area, which has historically focused primarily on the simulation of inelastic image formation in the electron microscope for the purpose of interpreting the results of quantitative electron microscopy experiments. We demonstrate that the spatial distribution of state-specific excitation rates due to the presence of an external (probe) electric charge is inhomogeneous, such that irradiation at particular locations in materials can favor specific electronic transitions (and disallow others). In addition to the potential for excited-state reaction pathways to be accessed through the initial inelastic scattering of the tightly focused electron beam from the targeted atoms, we also identify favorable conditions for the electronically nonadiabatic evolution of the highly vibrationally excited system to open complex multistate reaction pathways. Implications of the early results for understanding the mechanisms and potential routes to improved efficiency and selectivity in beam-induced reactions are discussed. We conclude with a summary of the current state of theory and modeling capabilities in this area and provide our perspective on future directions for theoretical and experimental developments that we view as crucial to advancing the use of convergent electron beams in mode-specific, atomically precise platforms for direct-write materials modifications.

36 MATERIALS SCIENCE↗