Search NASA⌕ Search

SEARCH · Search NASA

Results for “image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Predicting U 3 O 8 powder processing conditions: An AI/ML approach analyzing deep learning embeddings of SEM micrographs

High-resolution SEM images of uranium-oxide powders encode micro- and nanoscale clues to their synthesis route and calcination temperature. We trained a ResNet-50 model on 11 commercial-scale U₃O₈ classes, ammonium diuranate (ADU) or uranyl peroxide (H₂O₂) precursors calcined at temperatures ranging from 400 to 750 °C and added a 256-D projection head before the classifier to analyze the learned representation. The best of eight seeds reached 92.4 % accuracy on reserved testing data, but our focus is the structure of the embedding space rather than the accuracy and labels. We quantify class relatedness in the original 256-D space using centroid similarity and distributional distances, and we use Uniform Manifold Approximation Projection (UMAP) for visualization. ‘Unknown’ images from different preparation methods, SEM operators, and from the literature localized near the expected classes under a nearest-centroid analysis without retraining, as well as clustered in similar UMAP space. In conclusion, this embedding-centered workflow complements black-box classification by providing quantitative, similarity-based comparisons of U₃O₈ morphologies and reduces storage space by up to 98 % for image data used in millisecond vector search comparisons.

36 MATERIALS SCIENCE↗

High-resolution high-throughput spatiotemporal strain imaging reveals loss mechanisms in a surface acoustic wave device

Surface acoustic wave devices are key components for processing radio frequency signals in wireless communication because these devices offer simultaneously high performance, compact size and low cost. The optimization of the device structure requires a quantitative understanding of energy conversion and loss mechanisms. Here we use stroboscopic full-field diffraction x-ray microscopy to reveal an unanticipated acoustic loss in a prototypical one-port resonator device. A non-uniform acoustic excitation in the active area was responsible for the substantial end and side leakages observed at the design frequency. Quantitative analysis of the strain amplitude using a wave decomposition method allowed the determination of several key device parameters. This high-resolution high-throughput spatiotemporal strain imaging technique is more generally applicable to the study of dynamic strain modulation in nanoscale acoustic, electronic, optical and quantum devices. The high sensitivity allows precise measurement of the strain modulation with picometer-scale amplitude.

Zhou, Tao [ESRF - The European Synchrotron, Grenob↗

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗

Physics-based reward driven image analysis in microscopy

The rise of electron microscopy has expanded our ability to acquire nanometer and atomically resolved images of complex materials. The resulting vast datasets are typically analyzed by human operators, an intrinsically challenging process due to the multiple possible analysis steps and the corresponding need to build and optimize complex analysis workflows. We present a methodology based on the concept of a Reward Function coupled with Bayesian Optimization, to optimize image analysis workflows dynamically. The Reward Function is engineered to closely align with the experimental objectives and broader context and is quantifiable upon completion of the analysis. Here, cross-section, high-angle annular dark field (HAADF) images of ion-irradiated (Y, Dy)Ba 2 Cu 3 O 7–δ thin-films were used as a model system. The reward functions were formed based on the expected materials density and atomic spacings and used to drive multi-objective optimization of the classical Laplacian-of-Gaussian (LoG) method. These results can be benchmarked against the DCNN segmentation. This optimized LoG* compares favorably against DCNN in the presence of the additional noise. We further extend the reward function approach towards the identification of partially-disordered regions, creating a physics-driven reward function and action space of high-dimensional clustering. We pose that with correct definition, the reward function approach allows real-time optimization of complex analysis workflows at much higher speeds and lower computational costs than classical DCNN-based inference, ensuring the attainment of results that are both precise and aligned with the human-defined objectives.

47 OTHER INSTRUMENTATION↗

The Evolution of Galaxies and Clusters at High Spatial Resolution with Advanced X-ray Imaging Satellite (AXIS)

Stellar and black hole feedback heat and disperse surrounding cold gas clouds, launching gas flows off circumnuclear and galactic disks, producing a dynamic interstellar medium. On large scales bordering the cosmic web, feedback drives enriched gas out of galaxies and groups, seeding the intergalactic medium with heavy elements. In this way, feedback shapes galaxy evolution by shutting down star formation and ultimately curtailing the growth of structure after the peak at redshift 2–3. To understand the complex interplay between gravity and feedback, we must resolve both the key physics within galaxies and map the impact of these processes over large scales, out into the cosmic web. The Advanced X-ray Imaging Satellite (AXIS) is a proposed X-ray probe mission for the 2030s with arcsecond spatial resolution, large effective area, and low background. AXIS will untangle the interactions of winds, radiation, jets, and supernovae with the surrounding interstellar medium across the wide range of mass scales and large volumes driving galaxy evolution and trace the establishment of feedback back to the main event at cosmic noon. This white paper is part of a series commissioned for the AXIS Probe mission concept; additional AXIS white papers can be found at the AXIS website.

47 OTHER INSTRUMENTATION↗

Ultrafast x-ray imaging of coherently controlled molecular dynamics in real space and time

Coherent control aims to manipulate chemical processes on the latent length and timescales of atoms and bonds, scales that are intrinsic to molecular dynamics but not directly resolved by most experimental probes. As a result, existing coherent-control experiments, which overwhelmingly rely on spectroscopic observables, leave a crucial blind spot: the direct, real-space recovery of all atomic and molecular rearrangements in response to coherently controlled excitations. Here, we overcome this limitation by integrating a Tannor-Kosloff-Rice pump-control-probe scheme with ultrafast X-ray scattering to capture snapshots of the wavepacket motion in a benchmark molecular system. We demonstrate this by photoexciting diatomic iodine vapor with a visible pump pulse, selectively steering the wavepacket toward ground-state recombination or dissociative pathways with a time-delayed near-IR control pulse, and recording the dynamics with angstrom and femtosecond precision with an ultrashort hard X-ray probe pulse. By comparing these structural observations with numerical solutions of the time-dependent Schrödinger equation, we reveal how coherent control actively reshapes the molecular charge density distribution. Our results pave the way for leveraging structural feedback as a control handle and provide a fundamental microscopic visualization of quantum decoherence and energy redistribution at the atomic level.

Hopper, Thomas R. [SLAC National Accelerator Labor↗

Open Specy 1.0: Automated (Hyper)spectroscopy for Microplastics

Microplastic spectral analysis is one of the most time-consuming processes in studying microplastic pollution, often requiring days per sample. Researchers are transitioning to automated batch and hyperspectral image analysis techniques to enhance efficiency. Open Specy, initially aimed at manual single-spectrum analysis, has now integrated automated methods. This updated version, Open Specy 1.0, introduces several new features, including two algorithms for automated processing (smoothing and particle compression), an extensive library containing over 40,000 open-source Raman and FTIR spectra, and two machine learning classifiers (logistic regression and k medoids) developed from this library. Furthermore, it includes a revamped user interface, an R package, and a benchmark data set for testing future advancements in automated techniques. Researchers evaluated various configurations for hyperspectral smoothing, particle identification, compression, and splitting, to achieve combined recovery rates between 50 and 150% particle counts, identities, and sizes with a coefficient of variation (CV) of less than 40% (the accredited standard). Mean absorbance times the standard deviation provided a consistent particle identification. Hyperspectral smoothing led to a 96% combined recovery rate and reduced variability (CV = 38%) compared to the 86% recovery (CV = 83%) of nonsmoothed controls. Additionally, compressing spectra for particles was significantly faster (>3x) and showed similar accuracy but with reduced variability than processing each pixel individually. Key challenges persist in automating spectral analysis, particularly in refining particle splitting algorithms, and improving identification routines to minimize false positives and negatives. In conclusion, new methods in sample preparation for better stabilization and dispersion of particles could overcome some of these issues.

13 HYDRO ENERGY↗

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. In conclusion, the results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

42 ENGINEERING↗

Distinguishing isotropic and anisotropic signals for X-ray total scattering using machine learning

Understanding structure–property relationships is essential for advancing technologies based on thin films. X-ray pair distribution function (PDF) analysis can access relevant atomic structure details spanning local-, mid- and long-range structure. While X-ray PDF has been adapted for thin films on amorphous substrates, measurements on single-crystal substrates are necessary to accurately determine structure origins for some thin film materials, especially those for which the substrate changes the accessible structure and properties. However, when measuring films on single-crystal substrates, high-intensity anisotropic Bragg spots saturate 2D detector images, overshadowing the thin films' isotropic scattering signal. This renders previous data processing methods for films on amorphous substrates unsuitable for films on single-crystal substrates. To address this measurement need, we developed IsoDAT2D, an innovative data processing approach using unsupervised machine learning algorithms. The program combines dimensionality reduction and clustering algorithms to separate thin film and single-crystal substrate X-ray scattering signals. We use SimDAT2D , a program we developed to generate simulated thin film data, to validate IsoDAT2D . Here we also use IsoDAT2D to isolate X-ray total scattering signal from a thin film on a single-crystal substrate. The resulting PDF data are compared with similar data processed using previous methods, especially substrate subtraction for single-crystal and amorphous substrates. PDF data from IsoDAT2D -identified X-ray total scattering data are significantly better than from single-crystal substrate subtraction, but not as reliable as PDF data from amorphous substrate subtraction. With IsoDAT2D , there are new opportunities to expand PDF to a wider variety of thin films, including those on single-crystal substrates, with which new structure–property relationships can be elucidated to enable fundamental understanding and technological advances.

36 MATERIALS SCIENCE↗

NuMI/LBNF Horn and Stripline Welding

Focusing horns for secondary particles are critical components for creating a stable beam of neutrinos. These components need to survive in a harsh environment and withstand high stresses. Extending the lifetime of the horns is critical as spare fabrication takes approximately two years and has many subcomponents with strict quality control. Two key aspects of the fabrication process include the inner conductor CNC TIG welding and the friction stir welding of the stripline pieces. The process for welding requires steps such as sample welding, x-ray imaging, and tensile pull tests. Having a perfect weld retains as much of the original strength of the base metal and reduces the risk of failure. As FNAL ramps up in power to 2.4MW, the lifetime of the horn and stripline will more heavily rely on continuing to have high quality welding procedures and thorough quality assurance.

Orea, Adrian↗

Enhanced Feedstock Characterization and Modeling to Facilitate Optimal Preprocessing and Deconstruction of Corn Stover (Final Report)

This project addresses the challenge of processing corn stover by fractionating this biomass feedstock to both streamline processing and generate new potential co-products. Additionally, the project developed new field-deployable analytical tools that can be coupled with empirical models that were used to predict feedstock properties and processing performance. The overall scope of this project was: (1) identify conditions for optimal corn stover fractionation using a two- stage physical fractionation, (2) assess how physical fractionation impacts properties, partitioning of biomass, and response to processing, (3) further adapt, develop, and validate several advanced characterization tools for assessing biomass properties that can be linked to processing behavior, and (4) develop and validate predictive models based on measurements that can be performed “in the field” or “at the biorefinery gate” to predict feedstock processing behavior (preprocessing and deconstruction). The first objective employed pre-separation processing (size reduction) which was next subjected to enhanced separations to yield fractions enriched or depleted in select compositional components or properties. For the second objective, fractions were screened for their response to post-separation processing (pretreatment and enzymatic hydrolysis). Detailed characterization profiles were developed and dynamic image analysis to assess distribution of particle size and morphology. For the final objective, we utilized these tools to develop empirical models to assess the relative abundance of tissue type in order to assess fractionation efficacy and to predict fraction performance during pretreatment and enzymatic hydrolysis.

09 BIOMASS FUELS↗

Expedition UT-GOM2-2 Methods

Methods used during the University of Texas (UT) Deepwater Hydrate Coring Expedition (UT-GOM2-2) include work done onboard the Helix Q4000 in the offshore Gulf of America (Gulf of Mexico), herein “the Gulf”, “dockside” in Salt Lake City, Utah, and some shore-based work in individual laboratories. The goal of this report is two-fold: to provide enough detail on the methods so they can be repeated by others; and to provide a reference document for the team to enhance cross-disciplinary understanding and knowledge. Methods include drilling operations, depth references and depth modification, downhole tool deployment, coring tool performance assessment, core processing, lithostratigraphy, biostratigraphy, as well as physical properties, including core logging and imaging, rock magnetism, dissolved methane concentration, hydrate saturation, microbiology, and geochemistry. An extensive amount of operational work and planning was required before mobilization of the expedition to permit, build mobile labs, and test downhole tools for deepwater drilling.

03 NATURAL GAS↗

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking interpretability, an essential aspect for deriving neuroscientific insight. To address this gap, we propose MoRE-Brain, a neuro-inspired framework designed for high-fidelity, adaptable, and interpretable visual reconstruction. MoRE-Brain uniquely employs a hierarchical Mixture-of-Experts architecture where distinct experts process fMRI signals from functionally related voxel groups, mimicking specialized brain networks. The experts are first trained to encode fMRI into the frozen CLIP space. A finetuned diffusion model then synthesizes images, guided by expert outputs through a novel dual-stage routing mechanism that dynamically weighs expert contributions across the diffusion process. MoRE-Brain offers three main advancements: First, it introduces a novel Mixture-of-Experts architecture grounded in brain network principles for neuro-decoding. Second, it achieves efficient cross-subject generalization by sharing core expert networks while adapting only subject-specific routers. Third, it provides enhanced mechanistic insight, as the explicit routing reveals precisely how different modeled brain regions shape the semantic and spatial attributes of the reconstructed image. Extensive experiments validate MoRE-Brain’s high reconstruction fidelity, with bottleneck analyses further demonstrating its effective utilization of fMRI signals, distinguishing genuine neural decoding from over-reliance on generative priors. Consequently, MoRE-Brain marks a substantial advance towards more generalizable and interpretable fMRI-based visual decoding.

Wei, Yuxiang [Georgia Institute of Technology]↗

Utility of near‐surface phenology in estimating productivity and evapotranspiration across diverse ecosystems

Abstract Agroecosystems, which include row crops, pasture, and grass and shrub grazing lands, are sensitive to changes in management, weather, and genetics. To better understand how these systems are responding to changes, we need to improve monitoring and modeling carbon and water dynamics. Vegetation Indices (VIs) are commonly used to estimate gross primary productivity (GPP) and evapotranspiration (ET), but these empirical relationships are often location and crop specific. There is a need to evaluate if VIs can be effective and, more general, predictors of ecosystem processes through time and across different agroecosystems. Near‐surface photographic (red‐green‐blue) images from PhenoCam can be used to calculate the VI green chromatic coordinate (G CC ) and offer a pathway to improve understanding of field‐scale relationships between VIs and GPP and ET. We synthesized observations spanning 76 site‐years across 15 agroecosystem sites with PhenoCam G CC and GPP or ET estimates from eddy covariance (EC) to quantify interannual variability (IAV) in the relationship between GPP and ET and G CC across. We uncovered a high degree of variability in the strength and slopes of the G CC ∼ GPP and ET relationships (R 2 = 0.1 ‐ 0.9) within and across production systems. Overall, G CC is a better predictor of GPP than ET (R 2 = 0.64 and 0.54, respectively), performing best in croplands (R 2 = 0.91). Shrub‐dominated systems exhibit the lowest predictive power of G CC for GPP and ET but have less IAV in slope. We propose that PhenoCam estimates of G CC could provide an alternative approach for predictions of ecosystem processes.

Environmental Sciences & Ecology↗

Mid-infrared photodetection with 2D metal halide perovskites at ambient temperature

The detection of mid-infrared (MIR) light is technologically important for applications such as night vision, imaging, sensing, and thermal metrology. Traditional MIR photodetectors either require cryogenic cooling or have sophisticated device structures involving complex nanofabrication. Here, we conceive spectrally tunable MIR detection by using two-dimensional metal halide perovskites (2D-MHPs) as the critical building block. Leveraging the ultralow cross-plane thermal conductivity and strong temperature-dependent excitonic resonances of 2D-MHPs, we demonstrate ambient-temperature, all-optical detection of MIR light with sensitivity down to 1 nanowatt per square micrometer, using plastic substrates. Through the adoption of membrane-based structures and a photonic enhancement strategy unique to our all-optical detection modality, we further improved the sensitivity to sub–10 picowatt-per-square-micrometer levels. The detection covers the mid-wave infrared regime from 2 to 4.5 micrometers and extends to the long-wave infrared wavelength at 10.6 micrometers, with wavelength-independent sensitivity response. Our work opens a pathway to alternative types of solution-processable, long-wavelength thermal detectors for molecular sensing, environmental monitoring, and thermal imaging.

Li, Yanyan [Yale University, New Haven, CT (United↗

Multiscale Characterization of Additive Manufacturing Components with Computed Tomography, 3D X-ray Microscopy, and Deep Learning

Additive manufacturing (AM) facilitates the creation of complex-geometry parts, driving advancements in lightweight aerospace components, high-efficiency engine cooling channels, and customized medical implants. However, ensuring the quality and reliability of AM parts remains challenging due to internal defects, surface irregularities, porosity, and residual trapped powder, which are often inaccessible to traditional inspection methods. Recent developments in X-ray computed tomography (XCT) and 3D X-ray microscopy (XRM), particularly systems equipped with resolution-at-a-distance (RaaD™) capabilities, enable high-resolution, non-destructive evaluation of AM components across multiple scales, from sub-micrometer to macroscopic levels. This paper explores modern XCT and XRM techniques for multiscale characterization of AM parts, focusing on their ability to detect and analyze defects such as porosity, cracks, inclusions, and surface roughness, while offering insights into defect formation mechanisms, material properties, and process-induced variations. The integration of deep learning (DL) frameworks, including Simurgh, DeepRecon, and DeepScout, enhances XCT/XRM workflows by reducing scan times, improving resolution recovery, and enabling accurate defect detection even with limited projection data. These DL-based methods overcome limitations of traditional reconstruction techniques, enabling faster, more reliable characterization of dense materials like Inconel 718 and novel alloys such as AlCe. Applications include process parameter optimization, high-throughput quality control, and multistage AM process evaluation, with DL-enhanced workflows accelerating analysis times from weeks to days. Correlative imaging approaches further validate XCT and XRM data against scanning electron microscopy (SEM) images of physically sectioned samples, confirming the accuracy of DL-based reconstructions and enabling comprehensive defect analysis. While challenges remain in generalizing DL models to diverse materials and imaging conditions, improvements in resolution, noise reduction, and defect detection highlight the transformative potential of these methods. This multiscale and correlative approach enables precise identification and correlation of microstructural features with the overall performance of AM components. By integrating advanced XCT, XRM, and DL techniques, this paper demonstrates a significant leap forward in AM characterization, offering valuable insights into the relationships between processing parameters, microstructure, and part performance, and driving innovations that enhance the quality and reliability of AM products for demanding industrial applications.

Additive manufacturing↗

Advanced Instrumentation for Metal Additive Manufacturing

Laser powder bed fusion (LPBF) is the most widely used process for metal additive manufacturing (AM), particularly where complex geometries provide performance advantages unattainable with traditional manufacturing techniques. However, LPBF is highly sensitive to innate variability in both the powder spreading and fusion steps, often leading to defects such as pores that are difficult to detect yet significantly impair component mechanical properties and fatigue life. This thesis presents a range of novel instruments enabling both precise assessment of powder layer characteristics and in-situ thermal metrology of metal AM to advance the quality control of LPBF. First, leveraging a custom X-ray microscope and a radiation-transport model developed through this work, transmission X-ray imaging is used to study spreading of thin metal powder layers. Effective layer depth is directly mapped at a process-relevant size scale, surpassing optical techniques that can only estimate local deposition from layer surface topography. Layer packing density and quality are shown to be influenced by powder flowability and particle size relative to nominal powder layer thickness. Layer quality is additionally connected to the geometry of the spreading implement and its velocity. This technique and its presented findings enable pairing feedstocks with spreading strategies that create layers with consistent packing density and uniformity. Second, a twofold approach is employed to optically interrogate the laser fusion step of LPBF for observing signatures of defect formation. Aperture division multiplexing is conceptualized, providing for simultaneous laser delivery and high-fidelity infrared (IR) process monitoring through a common optic. In-situ microscopy at 50 μm spatial resolution and at mid-wave IR wavelengths is proven readily achievable with the first purpose-built optic of this type. Next, a bespoke imaging spectrometer, along with a temperature-emissivity separation technique, is used to retrieve accurate process temperatures over a 1000 K range. Data from these instruments are correlated to porosity as fine as 4.3 μm in two LPBF test artifacts, as verified using computed tomography (CT), establishing the viability of robust optically-based component qualification.

Penny, Ryan↗

ESIAS Pseudocode

The Explosive Shock Image Analysis System (ESAIS) is designed to provide a semiautomated quantitative analysis of fast-frame imagery taken during the detonation of high explosive (HE) rate sticks. ESIAS does this by assisting the user in identifying the HE stick geometry on the image (i.e., sides of the undetonated HE stick, detonation front, an axial reference point to assist in the inter-comparison of images); scaling the images based on the known diameter of the undetonated HE stick; identifying the profiles of various surfaces resulting from the detonation process such as the shock wave and product gases or the outer pipe surface; calculating the detonation speed of the HE by tracking the distance it travels between two images with a known time lapse between the images; and determining the slit velocities resulting from the detonation. ESIAS will also import scope traces from oscilloscopes and assist in identifying the time of arrival of significant peaks.

97 MATHEMATICS AND COMPUTING↗