Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗
DOE OSTI2024

Boundary detection evaluation

Illustrative embodiments are directed to a method and apparatus for evaluating boundary detection in an image. A processed image is received, wherein a detected boundary of an image of an object is identified in the processed image. A Radon transform is applied to the processed image for a plurality of angles to form a processed image histogram corresponding to the detected boundary for each of the plurality of angles. The processed image histogram for each of the plurality of angles and a corresponding ground truth histogram for each of the plurality of angles is normalized to provide a normalized processed image histogram and a normalized ground truth histogram for each of the plurality of angles, wherein the ground truth histogram corresponds to a ground truth boundary of the object for a corresponding angle. An indication of the edges of the normalized processed image histogram for each of the plurality of angles is plotted to form a boundary detection evaluation visualization.

Wantuch, Andrew C.↗
DOE OSTI2025

Broadband Fourier-Transform Optical Photothermal Infrared Spectroscopy and Imaging

Infrared (IR) spectroscopy is a powerful method for mapping chemical heterogeneity on the microscale. Synchrotron IR radiation uniquely provides a high brightness and broad bandwidth to further extend the capabilities of IR spectroscopic imaging. However, the diffraction-limited spatial resolution of IR spectroscopy is insufficient for studies requiring submicrometer spatial differentiation. Optical photothermal IR (O-PTIR) microscopy is a powerful, emerging method that overcomes the IR diffraction limit in IR hyperspectral imaging by employing a modulated IR beam and a visible probe laser beam to detect local temperature-induced modulation at the visible diffraction limit. In this work, we extend the spectral range of photothermal infrared measurements by incorporating a synchrotron IR source, demonstrating a combined synchrotron-based O-PTIR modality that enables high spatial resolution far-field chemical imaging spanning the entire mid-IR range. Both optical- and fluorescence-detected photothermal modalities were performed using a step-scan interferometer, demonstrating improved spectral range (541-4000 cm-1) when compared to optical photothermal microscopy with commercial laser sources (800-1800 cm-1 for this particular source) and improved spatial resolution, when compared to synchrotron microspectroscopy measurements. Following these initial validation studies, synchrotron Fourier-transform fluorescence-detected photothermal IR spectroscopy in combination with synchrotron microspectroscopy measurements was used to differentiate cells in mouse brain tissue sections, which requires submicron spatial resolutions beyond those accessible by IR spectroscopy alone.

Razumtcev, Aleksandr↗
DOE OSTI2024

Correlative multimodal chemical imaging via machine learning

Machine learning approach can combine mass spectral imaging (MSI) techniques, one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The machine learning approach can perform transformations on the spectral image data of the two MSI techniques to reduce dimensionality, and using a correlation technique, find relationships between the transformed spectral image data. The determined relationships can be used to generate MSI spectra of desired resolution.

Ovchinnikova, Olga S.↗
DOE OSTI2025

SHF: Symmetrical Hierarchical Forest with Pretrained Vision Transformer Encoder for High-Resolution Medical Segmentation

This paper presents a novel approach to addressing the long-sequence problem in high-resolution medical images for Vision Transformers (ViTs). Using smaller patches as tokens can enhance ViT performance, but quadratically increases computation and memory requirements. Therefore, the common practice for applying ViTs to high-resolution images is either to: (a) employ complex sub-quadratic attention schemes or (b) use large to medium-sized patches and rely on additional mechanisms within the model to capture the spatial hierarchy of details. We propose Symmetrical Hierarchical Forest (SHF), a lightweight approach that adaptively patches the input image to increase token information density and encode hierarchical spatial structures into the input embedding. We then apply a reverse depatching scheme to the output embeddings of the transformer encoder, eliminating the need for convolution-based decoders. Unlike previous methods that modify attention mechanisms or use a complex hierarchy of interacting models, SHF can be retrofitted to any ViT model to allow it to learn the hierarchical structure of details in high-resolution images without requiring architectural changes. Experimental results demonstrate significant gains in computational efficiency and performance: on the PAIP WSI dataset, we achieved a 3∼32×speedup or a 2.95%∼7.03% increase in accuracy (measured by Dice score) at a 64K2 resolution with the same computational budget, compared to state-of-the-art production models. On the 3D medical datasets BTCV and KiTS, training was 6×faster, with accuracy gains of 6.93% and 5.9%, respectively, compared to models without SHF.

Zhang, Enzhi [Hokkaido University, Japan]↗
DOE OSTI2025

High-Multiplicity Muon Airshower Analysis at NOvA Far Detector

We process and analyze muon airshower data from the NOvA far detector using various image processing algorithms, such as Fast Fourier Transformation, and Hough line transformation. From the processed event images, we calculate multiple parameters for our study. We are looking for physics features, including East-West Asymmetry, anisotropies in right ascension, and seasonal variation. Additionally, we have developed an algorithm to count the multiplicity of muons in the airshower events using the single muon data.

Lima, Aklima Khanam [Syracuse U.]↗
DOE OSTI2026

Infrared triggered dwell and active cooling thermal control effects on microstructural uniformity in DED

Directed Energy Deposition (DED) offers rapid large scale fabrication, but difficulty in delivering consistent microstructures and properties hinders the use of DED fabricated components in safety or performance critical applications. Variability stems from the complex thermal cycles generated by the toolpath used to print the required geometry. Several practical methods have become established in DED to regulate overheating, such as active cooling of the baseplate structure or the use of an infrared camera to inject interlayer pauses to ensure the top layer of the component cools to a set temperature, which have been shown to affect microstructure. However, no critical assessment has been performed as to how effective these controls are in promoting microstructural uniformity in the context of complex layer timing commonly generated by non-prismatic geometries. Here we show how controls influence the thermal field, phase transformations, and dynamic annealing of a low-temperature transformation steel using infrared imaging and operando neutron diffraction. Counterintuitively, common thermal homogenization process controls can reduce microstructural uniformity because these approaches stabilize peak temperature while overlooking temperatures near the solid-state phase transformation fronts. Instead, the cyclic reheating induces spatially-variant dynamically annealed regions which can be modulated via control parameters. We show that these controls have spatially linked effects centimeters away from the active weld, which implies that microstructure control must co-optimize thermal input across many subsequent layers. In conclusion, our results demonstrate the pressing need for higher order controls that integrate predictive elements of simulation data to stabilize printed properties for future qualification of DED components.

Directed energy deposition↗
DOE OSTI2025

MultiTaskDeltaNet: change detection-based image segmentation for operando ETEM with application to carbon gasification kinetics

Transforming in situ transmission electron microscopy (TEM) imaging into a tool for spatially-resolved operando characterization of solid-state reactions requires automated, high-precision semantic segmentation of dynamically evolving features. However, traditional deep learning methods for semantic segmentation often face limitations due to the scarcity of labeled data, visually ambiguous features of interest, and scenarios involving small objects. To tackle these challenges, we introduce MultiTaskDeltaNet (MTDN), a novel deep learning architecture that creatively reconceptualizes the segmentation task as a change detection problem. By implementing a unique Siamese network with a U-Net backbone and using paired images to capture feature changes, MTDN effectively leverages minimal data to produce high-quality segmentations. Furthermore, MTDN utilizes a multi-task learning strategy to exploit correlations between physical features of interest. In an evaluation using data from in situ environmental TEM (ETEM) videos of filamentous carbon gasification, MTDN demonstrated a significant advantage over conventional segmentation models, particularly in accurately delineating fine structural features. Notably, MTDN achieved a 10.22% performance improvement over conventional segmentation models in predicting small and visually ambiguous physical features. This work bridges key gaps between deep learning and practical TEM image analysis, advancing automated characterization of nanomaterials in complex experimental settings.

08 HYDROGEN↗
DOE OSTI2025

Physics-constrained superresolution diffusion for six-dimensional phase space diagnostics

Adaptive physics-constrained superresolution diffusion is developed for noninvasive virtual diagnostics of the six-dimensional (6D) phase space density of charged particle beams. An adaptive variational autoencoder embeds initial beam condition images and scalar measurements to a low-dimensional latent space from which a 32 6 pixel 6D tensor representation of the beam's 6D phase space density is generated. Projecting from a 6D tensor generates physically consistent two-dimensional projections. Physics-guided superresolution diffusion transforms low-resolution images of the 6D density to high resolution 256 × 256 pixel images. Unsupervised adaptive latent space tuning enables tracking of time-varying beams without knowledge of time-varying initial conditions. The method is demonstrated with experimental data and multiparticle simulations at the HiRES UED. The general approach is applicable to a wide range of complex dynamic systems evolving in high-dimensional phase space. The method is shown to be robust to distribution shift without retraining. Published by the American Physical Society 2025

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

In-Situ Atomic-Scale Revelation of Amorphous Metallic Iron Formation during Hydrogen-Driven Reduction of Iron Oxides

The transition to hydrogen as a green reductant in metal production is critical for decarbonizing the metallurgical industry, yet atomic-scale mechanisms governing reduction pathways and phase evolution remain unresolved. Using in-situ environmental transmission electron microscopy, we identify a hidden pathway that reveals dynamic formation of amorphous metallic iron (Fe) during the hydrogen-driven reduction of ferrous oxides of Fe 3 O 4 and FeO. Real-time imaging uncovers three coexisting transformation routes: (i) Fe 3 O 4 → FeO, (ii) Fe 3 O 4 → amorphous Fe, and (iii) FeO → amorphous Fe. The resulting amorphous Fe exhibits fluid-like mobility, enabling its rapid aggregation and crystallization into core-shell nanostructures, with a crystalline core enveloped by an amorphous shell. Complementary ab initio molecular dynamics simulations trace the amorphous Fe formation to interfacial strain at the metal/oxide interfaces, where large lattice mismatches destabilize the metal lattice during initial metallization. This interplay between thermodynamics and kinetics governs phase evolution: thermodynamics favors a self-limiting amorphous Fe overlayer, while rapid oxide reduction kinetics drives amorphous overgrowth. Our findings demonstrate that amorphous intermediates bypass rate-limiting crystalline steps, providing mechanistic insights to optimize H 2 -based processes for sustainable steelmaking. In conclusion, these insights bridge the gap between macroscopic process engineering and atomic-scale dynamics, with broader implications for catalysis and nanostructured material synthesis, where oxide reduction pathways critically shape functional phases and microstructures.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Size and Structural Control of Mechanoluminescent ZnS:Mn 2+ Nanocrystals for Optogenetic Neuromodulation

Mechanoluminescent materials hold immense potential for various transformative applications, from medical imaging and diagnostics to health monitoring and wearable displays. Conventionally produced as bulk powders or microparticles, they face significant size limitations for advanced applications, particularly in biological systems and microscale devices. Here, this work presents an approach to ZnS:Mn 2+ nanocrystal synthesis that involves self-assembly and subsequent calcination. In addition to effective size control within the nanoscale, this approach promotes the formation of abundant stacking faults, significantly enhancing piezoelectric and mechanoluminescent properties by increasing trap density and reducing trap depth. Unlike mechanoluminescent materials produced using conventional methods, these nanocrystals demonstrate strong mechanoluminescence without requiring UV pre-excitation, and the light emission persists even after mechanical stress is removed. These advantageous properties make them promising candidates for optogenetic neuromodulation, as they can effectively trigger electrical signals in neurons upon ultrasound stimulation both with and without UV pre-excitation. The persistent mechanoluminescence prolongs the duration of neuronal electrical activity, providing an extended temporal window for neuromodulation compared to conventional mechanoluminescent materials. This study provides a scalable method for producing efficient mechanoluminescent nanoparticles and reveals the crucial role of particle size and defect structures in determining their mechanoluminescent behavior.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2024

Provable Repair of Vision Transformers

Vision Transformers have emerged as state-of-the-art image recognition tools, but may still exhibit incorrect behavior. Incorrect image recognition can have disastrous consequences in safety-critical real-world applications such as self-driving automobiles. In this paper, we present Provable Repair of Vision Transformers (PRoViT), a provable repair approach that guarantees the correct classification of images in a repair set for a given Vision Transformer without modifying its architecture. PRoViT avoids negatively affecting correctly classified images (drawdown) by minimizing the changes made to the Vision Transformer’s parameters and original output. Here, we observe that for Vision Transformers, unlike for other architectures such as ResNet or VGG, editing just the parameters in the last layer achieves correctness guarantees and very low drawdown. We introduce a novel method for editing these last-layer parameters that enables PRoViT to efficiently repair state-of-the-art Vision Transformers for thousands of images, far exceeding the capabilities of prior provable repair approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Nanodiffraction imaging of ionically driven phase separation in cobaltite heterostructures

Controlling the anionic stoichiometry and distribution of perovskite cobaltites presents a powerful method for tailoring the magnetic and electronic properties for magneto-ionic applications. Nevertheless, the influence of nanoscale morphology, including phase separation and defects in cobaltite heterostructures, remains largely unexplored. We used x-ray nanodiffraction to directly image the nanoscale topotactic phase transformation in La 1−x Sr x CoO 3 (LSCO) heterostructures capped with a reactive aluminum (Al) layer (i.e., oxygen “getter”) of varying thicknesses (0.5, 3, and 7 nm). Nanodiffraction images reveal the formation of highly elongated BM filaments extending over mesoscopic lengths (>67 μm), indicating a strong tendency toward oxygen vacancy ordering in both P and BM phases in all heterostructures. Local strain and strain gradient analysis shows a strong correlation between the depletion of the P phase and strain gradients. Our measurements suggest that elongation of the BM filaments is the predominant mechanism for topotactic transformation in LSCO/Al heterostructures, preferred over coarsening, branching, and fractal growth. Our study provides a detailed nanoscale analysis of ionically driven phase transitions in LSCO/Al heterostructures, which is crucial for tailoring the functional properties of cobaltites for magneto-ionic devices.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Deep-ultraviolet ptychographic pocket-scope (DART): mesoscale lensless molecular imaging with label-free spectroscopic contrast

The mesoscale characterization of biological specimens has traditionally required compromises between resolution, field-of-view, depth-of-field, and molecular specificity, with most approaches relying on external labels. Here we present the Deep-ultrAviolet ptychogRaphic pockeT-scope (DART), a handheld platform that transforms label-free molecular imaging through intrinsic deep-ultraviolet spectroscopic contrast. By leveraging biomolecules’ natural absorption fingerprints and combining them with lensless ptychographic microscopy, DART resolves down to 308-nm linewidths across centimeter-scale areas while maintaining millimeter-scale depth-of-field. The system’s virtual error-bin methodology effectively eliminates artifacts from limited temporal coherence and other optical imperfections, enabling high-fidelity molecular imaging without lenses. Through differential spectroscopic imaging at deep-ultraviolet wavelengths, DART quantitatively maps nucleic acid and protein distributions with femtogram sensitivity, providing an intrinsic basis for explainable virtual staining. We demonstrate DART’s capabilities through imaging of tissue sections, cytopathology specimens, blood cells, and neural populations, revealing detailed molecular contrast without external labels. The combination of high-resolution molecular mapping and broad mesoscale imaging in a portable platform opens new possibilities from rapid clinical diagnostics, tissue analysis, to biological characterization in space exploration.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗
DOE OSTI2025

Deep image reconstruction for background subtraction in heavy-ion collisions

Jet reconstruction in an ultrarelativistic heavy-ion collision suffers from a notoriously large, fluctuating thermal background. Traditional background‐subtraction methods struggle to remove this soft background while preserving the jet's hard substructure. In this Letter, we present DeepSub, a machine-learning-based approach for full-event background‐subtraction. DeepSub utilizes a model based on Swin Transformer layers to denoise jet images and disentangle hard jets from the heavy-ion background. DeepSub significantly outperforms existing subtraction techniques by reproducing key jet observables such as jet 𝑝 T and mass, and substructure observables such as girth and the energy correlation function, at the subpercent to percent level. As such, DeepSub paves the way for precision heavy-ion measurements in hitherto inaccessible kinematic regimes.

Qureshi, Umar Sohail [Stanford University, CA (Uni↗