Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Discovering Strong Gravitational Lenses in the Dark Energy Survey with Interactive Machine Learning and Crowd-sourced Inspection with Space Warps

We conduct a search for strong gravitational lenses in the Dark Energy Survey (DES) Year 6 imaging data. We implement a pre-trained Vision Transformer (ViT) for our machine learning (ML) architecture and adopt interactive machine learning to construct a training sample with multiple classes to address common types of false positives. Our ML model reduces ∼236 million DES cutout images to 22,564 targets of interest, including ∼85% of previously reported galaxy–galaxy lens candidates discovered in DES. These targets were visually inspected by citizen scientists, who ruled out ∼90% as false positives. Of the remaining 2618 candidates, 149 were expert-classified as “definite” lenses and 516 as “probable” lenses, for a total of 665 systems, with 147 of these candidates being newly identified. Additionally, we trained a second ViT to find double-source plane lens systems, finding at least one double-source system. Our main ViT excels at identifying galaxy–galaxy lenses, consistently assigning high scores to candidates with high expert assessments. The top 800 ViT-scored images include ∼100 of our “definite” lens candidates. This selection is an order of magnitude higher in purity than previous convolutional neural-network-based lens searches and demonstrates the feasibility of applying our methodology for discovering large samples of lenses in future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. In conclusion, the results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

42 ENGINEERING↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
DOE OSTI2024

Dynamic STEM-EELS for single-atom and defect measurement during electron beam transformations

This study introduces the integration of dynamic computer vision–enabled imaging with electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). This approach involves real-time discovery and analysis of atomic structures as they form, allowing us to observe the evolution of material properties at the atomic level, capturing transient states traditional techniques often miss. Rapid object detection and action system enhances the efficiency and accuracy of STEM-EELS by autonomously identifying and targeting only areas of interest. This machine learning (ML)–based approach differs from classical ML in that it must be executed on the fly, not using static data. We apply this technology to V-doped MoS 2 , uncovering insights into defect formation and evolution under electron beam exposure. This approach opens uncharted avenues for exploring and characterizing materials in dynamic states, offering a pathway to increase our understanding of dynamic phenomena in materials under thermal, chemical, and beam stimuli.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

SwinCell: a 3D transformer and flow-based framework for improved cell segmentation

Segmentation of three-dimensional (3D) cellular images is fundamental for studying and understanding cell structure and function. However, 3D cellular segmentation is challenging, particularly for dense cells and tissues. This challenge arises mainly from the complex contextual information within 3D images, anisotropic properties, and the sensitivity to internal cellular structures, which often lead to incorrect segmentation. In this work, we introduce SwinCell, a 3D transformer-based framework that leverages Swin-transformer to predict flow and differentiate individual cell instances. We demonstrate SwinCell’s utility in the segmentation of nuclei, colon tissue cells, and densely cultured cells. SwinCell strikes a balance between maintaining detailed local feature recognition and understanding broader contextual information. Through extensive testing with both public and in-house 3D cell imaging datasets, SwinCell shows utility in segmenting dense cells, making it a valuable tool for 3D segmentation in cellular analysis that could expedite research in cell biology and tissue engineering.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Image processing tools for petabyte-scale light sheet microscopy data

Light sheet microscopy is a powerful technique for high-speed three-dimensional imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present PetaKit5D, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are optimized for memory and performance. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson–Lucy deconvolution and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Concept Lens: Visual Comparison and Evaluation of Generative Model Manipulations

Generative models are becoming a transformative technology for the creation and editing of images. However, it remains challenging to harness these models for precise image manipulation. These challenges often manifest as inconsistency in the editing process, where both the type and amount of semantic change, depend on the image being manipulated. Moreover, there exist many methods for computing image manipulations, whose development is hindered by the matter of inconsistency. This paper aims to address these challenges by improving how we evaluate, compare, and explore the space of manipulations offered by a generative model. We present Concept Lens, a visual interface that is designed to aid users in understanding semantic concepts carried in image manipulations, and how these manipulations vary over generated images. Given the large space of possible images produced by a generative model, Concept Lens is designed to support the exploration of both generated images, and their manipulations, at multiple levels of detail. To this end, the layout of Concept Lens is informed by two hierarchies: a hierarchical organization of (1) original images, grouped by their similarities, and (2) image manipulations, where manipulations that induce similar changes are grouped together. This layout allows one to discover the types of images that consistently respond to a group of manipulations, and vice versa, manipulations that consistently respond to a group of codes. We show the benefits of this design across multiple use cases, specifically, studying the quality of manipulations for a single method, and offering a means of comparing different methods.

clustering↗
DOE OSTI2025

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Reconfigurable unitary transformations of optical beam arrays

Spatial transformations of light are ubiquitous in optics, with examples ranging from simple imaging with a lens to quantum and classical information processing in waveguide meshes. Multi-plane light converter (MPLC) systems have emerged as a platform that promises completely general spatial transformations, i.e., a universal unitary. However, until now, MPLC systems have demonstrated transformations that are far from general, e.g., converting from a Gaussian to Laguerre-Gauss mode. Here, we demonstrate the promise of an MLPC, the ability to impose an arbitrary unitary transformation that can be reconfigured dynamically. Specifically, we consider transformations on superpositions of parallel free-space beams arranged in an array, which is a common information encoding in photonics. We experimentally test the full gamut of unitary transformations for a system of two parallel beams and make a map of their fidelity. We obtain an average transformation fidelity of 0.85 ± 0.03. This high-fidelity suggests that MPLCs are a useful tool for implementing the unitary transformations that comprise quantum and classical information processing.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

HAMscope: a snapshot Hyperspectral Autofluorescence Miniscope for real-time molecular imaging

We introduce HAMscope, a compact, snapshot hyperspectral autofluorescence miniscope that enables real-time, label-free molecular imaging in a wide range of biological systems. By integrating a thin polymer diffuser into a widefield miniscope, HAMscope spectrally encodes each frame and employs a probabilistic deep learning framework to reconstruct 30-channel hyperspectral stacks (452-703 nm) or directly infer molecular composition maps from single images. A scalable multi-pass U-Net architecture with transformer-based attention and per pixel uncertainty estimation enables high spatio-spectral fidelity (mean absolute error ∼0.0048) at video rates. While initially demonstrated in plant systems, including lignin, chlorophyll, and suberin imaging in intact poplar and cork tissues, the platform is readily adaptable to other applications such as neural activity mapping, metabolic profiling, and histopathology. We show that the system generalizes to out-of-distribution tissue types and supports direct molecular mapping without the need for spectral unmixing. HAMscope establishes a general framework for compact, uncertainty-aware spectral imaging that combines minimal optics with advanced deep learning, offering broad utility for real-time biochemical imaging across neuroscience, environmental monitoring, and biomedicine.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

In-situ sensor monitoring of multi-class gas porosity formation in laser powder bed fusion using convolutional neural network

In-situ monitoring of defect formation remains a significant challenge in the laser powder bed fusion (LPBF) process. Recent advances have enabled real-time defect detection with machine learning and in-situ sensing technologies; however, most studies focus on binary classification of keyhole pores, limiting nuanced multi-class pore differentiation and formation mechanisms. This work introduces a multi-class pore detection framework (no pore, small pores < 15 µm, and large pores > 15 µm) by leveraging photodiode sensor data alongside high-fidelity synchrotron X-ray imaging. The 15 µm threshold is selected to distinguish between two fundamentally different defect mechanisms, following the physical size-mechanism boundary established by prior high-resolution synchrotron X-ray characterization of Al6061 LPBF. Distinguishing these classes is critical because large keyhole pores are structurally detrimental, whereas small gas pores are often benign, requiring different process control strategies. Thermal emission monitoring data collected simultaneously with high-speed X-ray imaging at the Stanford Synchrotron Radiation Lightsource (SSRL), are correlated with subsurface melt pool dynamics to establish ground truth. Continuous Wavelet Transform (CWT) with optimized parameters converts the photodiode time-series signals into time–frequency images, facilitating feature extraction. Convolutional Neural Networks (CNN) are then applied for real-time multi-class pore classification in an average inference time of 1 ms per signal window. It achieves 79% accuracy and an Area Under the Receiver Operating Characteristic curve (AUC ROC) score of 0.89 with five-fold cross-validation. The results demonstrate that coupling CWT-based feature engineering with CNN architecture enables reliable multi-class pore detection in Al6061 builds using affordable in-situ sensors. This approach advances scalable and affordable quality assurance in additive manufacturing by moving beyond binary defect detection toward more nuanced classification of porosity mechanisms with in-situ sensors and machine learning.

Laser powder bed fusion, Multi-class pores, In-sit↗
DOE OSTI2025

Permeability Prediction Using Vision Transformers

Accurate permeability predictions remain pivotal for understanding fluid flow in porous media, influencing crucial operations across petroleum engineering, hydrogeology, and related fields. Traditional approaches, while robust, often grapple with the inherent heterogeneity of reservoir rocks. With the advent of deep learning, convolutional neural networks (CNNs) have emerged as potent tools in image-based permeability estimation, capitalizing on micro-CT scans and digital rock imagery. This paper introduces a novel paradigm, employing vision transformers (ViTs)—a recent advancement in computer vision—for this crucial task. ViTs, which segment images into fixed-sized patches and process them through transformer architectures, present a promising alternative to CNNs. We present a methodology for implementing ViTs for permeability prediction, its results on diverse rock samples, and a comparison against conventional CNNs. The prediction results suggest that, with adequate training data, ViTs can match or surpass the predictive accuracy of CNNs, especially in rocks exhibiting significant heterogeneity. This study underscores the potential of ViTs as an innovative tool in permeability prediction, paving the way for further research and integration into mainstream reservoir characterization workflows.

58 GEOSCIENCES↗
DOE OSTI2025

Review: Recent advances of ToF-SIMS for environmental analysis and imaging

Background: Time-of-flight secondary ion mass spectrometry (ToF-SIMS) is a powerful surface analysis technique, initially developed and applied in inorganic materials and semiconductors. In past decades, ToF-SIMS has attracted more attention in its analysis capabilities of organic materials, with increased applications in biology, medical, and health development. It has also become a versatile and effective tool in environmental analysis due to its high mass resolution, mass accuracy, and depth profiling. Results: In this review, we first give an overview of the principle of ToF-SIMS and follow with recent ToF-SIMS applications in exemplary environmental study cases, including atmospheric aerosol, soil, water, plant, and organic solvent analysis. Moreover, sample preparation techniques are summarized in relation to corresponding environmental applications. Specifically, we call attention to ToF-SIMS investigations showcasing studies in surface chemical compositions, images, and depth profile analysis. These findings emphasize the important role of interfacial chemistry in environmental processes and provide valuable insights into dynamic processes, such as chemical transformation, particle formation, plant biology, and microbial inspired biotechnology development. The mass spectral imaging results acquired by ToF-SIMS offer a deeper understanding of intermediate stages and transient phases for environmental specimens. Significance: In situ and operando imaging offer new possibilities in studying phenomena in real time with high spatial resolution. Furthermore, it is anticipated that more research groups will use ToF-SIMS in environmental research given recent advances in measurement capabilities and surging needs in chemical mapping of complex analytes and systems.

Aerosol↗
DOE OSTI2026

Computer vision-based rock bolt detection in orthomosaic imagery obtained in the Waste Isolation Pilot Plant underground facility

Assessing structural integrity of large underground tunnel facilities is often a time consuming and human-labor intensive task. Thus, research using various modes of sensing and automated detection of key structural components in mines is posed to aid in safety assessments and establishing overall structural health. We propose an approach utilizing off-the-shelf camera and lidar technology fixed to a custom sensing platform, image stitching techniques, fine-tuned object detection models, and specialized model-inference methods to automatically detect, count, and map roof bolts for assessment of structural safety in man-made underground tunnels. Results show a novel workflow for effective object counting in orthomosaic tunnel ceiling images generated from collections in GPS-denied mining environments. Additionally, we demonstrate effective fine-tuning of EfficientDet object detectors utilizing state-of-the-art image augmentation techniques known as the mosaic and mixup transformations. Our work is demonstrated on sensed data and imagery collected from the Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP) where miles of tunnel ceiling must be assessed for structural integrity.

42 ENGINEERING↗
DOE OSTI2025

Calibration and characterization of the line-VISAR diagnostic at the HED-HIBEF instrument at the European XFEL

In dynamic-compression experiments, the line-imaging Velocity Interferometer System for Any Reflector (VISAR) is a well-established diagnostic used to probe the velocity history, including wave profiles derived from dynamically compressed interfaces and wavefronts, depending on material optical properties. Knowledge of the velocity history allows for the determination of the pressure achieved during compression. Such a VISAR analysis is often based on Fourier transform techniques and assumes that the recorded interferograms are free from image distortions. In this paper, we describe the VISAR diagnostic installed at the HED-HIBEF instrument located at the European XFEL along with its calibration and characterization. It comprises a two-color (532, 1064 nm), three-arm (with three velocity sensitivities) line imaging system. We provide a procedure to correct VISAR images for geometric distortions and evaluate the performance of the system using Fourier analysis. We finally discuss the spatial and temporal calibrations of the diagnostic. As an example, we compare the pressure extracted from the VISAR analysis of shock-compressed polyimide and silicon.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Automated Image Segmentation and Processing Pipeline Applied to X–Ray Computed Tomography Studies of Pitting Corrosion in Aluminum Wires

Understanding pitting corrosion is critical, yet its kinetics and morphology remain challenging to study from X-ray computed tomography (XCT) due to manual segmentation barriers. To address this, an automated pipeline leveraging deep learning for efficient large-scale XCT analysis is developed, revealing new corrosion insights. The pipeline enables pit segmentation, 3D reconstruction, statistical characterization, and a topological transformation for visualization. Here, the pipeline is applied to 87 648 XCT images capturing commercial purity aluminum (1100 Al) wire exposed to sodium chloride (NaCl) salt particles over a period of 122 h. The pipeline achieves complete feature extraction and statistical quantification across the entire XCT dataset, leveraging distributed computing environment for high efficiency. Global growth kinetics such as high-level stepwise sigmoidal volume loss patterns and granular individual pit developments are both captured for 36 detected pits. By combining automation, computer vision, and extensive XCT datasets, this research accelerates precise corrosion assessment to enable materials science discoveries at scale.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Pre-training Vision Models for the Classification of Alerts from Wide-field Time-domain Surveys

Modern wide-field time-domain surveys facilitate the study of transient, variable and moving phenomena by conducting image differencing and relaying alerts to their communities. Machine learning tools have been used on data from these surveys and their precursors for more than a decade, and convolutional neural networks (CNNs), which make predictions directly from input images, saw particularly broad adoption through the 2010s. Since then, continually rapid advances in computer vision have transformed the standard practices around using such models. It is now commonplace to use standardized architectures pre-trained on large corpora of everyday images (e.g., ImageNet). In contrast, time-domain astronomy studies still typically design custom CNN architectures and train them from scratch. Here, we explore the effects of adopting various pre-training regimens and standardized model architectures on the performance of alert classification. We find that the resulting models match or outperform a custom, specialized CNN like what is typically used for filtering alerts. Moreover, our results show that pre-training on galaxy images from Galaxy Zoo tends to yield better performance than pre-training on ImageNet or training from scratch. We observe that the design of standardized architectures are much better optimized than the custom CNN baseline, requiring significantly less time and memory for inference despite having more trainable parameters. On the eve of the Legacy Survey of Space and Time and other image-differencing surveys, these findings advocate for a paradigm shift in the creation of vision models for alerts, demonstrating that greater performance and efficiency, in time and in data, can be achieved by adopting the latest practices from the computer vision field.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Molecular-Resolution Electron Imaging of Defects and Dynamics at the Ice-Water Interface

Water crystallization into hexagonal ice (type I h ) is one of the most critical processes relevant to the Earth’s environment and human activities. However, despite recent breakthroughs in imaging non-equilibrium condensed ice structures, the ice-water interface has never been imaged at a molecular resolution. This is primarily due to the low stability of the hydrogen bonds in ice under high-resolution microscopy conditions and a lack of methods to prepare compatible samples. Here, this presentation describes the first molecular-resolution imaging of ice crystallized from liquid water and the ice-water interface using high-resolution transmission electron microscopy (HRTEM). By encapsulating deionized (DI) water between two amorphous carbon (a-C) TEM grids and subsequently freezing it with liquid N 2 on a cryo sample stage, we generated two types of ice: non-equilibrium, condensed ice from the atmosphere and encapsulated ice from the DI water (Fig. 1A). Condensed ice usually shows irregular, spherulitic shapes (Fig. 1B). Selected area electron diffraction (SAED) shows that they are a mixture of cubic and hexagonal crystals (Fig. 1C). On the contrary, encapsulated ice forms thin films that contain large-area single-crystalline regions of hexagonal ice oriented along the [0001] zone axis (Fig. 1D). Differential electron energy-loss spectroscopy (EELS) confirmed the high purity of the encapsulated ice free from organic contaminations that are common in other encapsulation methods for HRTEM such as graphene liquid cells. These single-crystalline areas are robust under the electron beam up to ~100 e/Å 2 s. Aberration-corrected HRTEM imaging in these areas achieved a line resolution of ~1.3 Å (Fig. 1E and F). This platform allows us to study near-equilibrium ice structures and dynamics at an unprecedented spatial resolution (Fig. 2). For example, we discovered subdomain-rich regions near the defective crystal edges despite the structure appearing single-crystalline according to diffraction criteria. These subdomains connect via low-angle grain boundaries with flat energy landscapes as a function of tilt angles (according to simulations), showing the high tolerance of ice to defect structures. When we tuned the sample temperature and electron flux rate, we observed radiolysis-controlled bubble generation and dissolution in ice single crystals near a steady state of bubble dynamics. Furthermore, rich beam-induced melting and recrystallization dynamics were observed at the ice-water interface with lattice resolution. These data represent the first observation of the ice-water phase transformation at the sub-nanometer level. In summary, the methods developed in this work enabled molecular-resolution observations of ice and the ice-water interface and shed light on the microstructures and phase transformation pathways. Finer control on the temperature, electron irradiation profile, and imaging detector could eventually lead to real-time observation of ice nucleation in water and address long-standing questions in the nucleation pathways.

74 ATOMIC AND MOLECULAR PHYSICS↗