Search NASA⌕ Search

SEARCH · Search NASA

Results for “super-resolution imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Deploying Adversarial Attacks in Super-Resolution Models

Reliable super-resolution methods are crucial for applications like remote sensing, grid resilience and disaster impact analysis, and standoff biometrics. These methods infuse additional high-frequency information into reconstructions, allowing for better contextualization and image intelligence. However, super-resolution models can also introduce hallucinations or other unseen vulnerabilities that could be exploited by an adversary. This is further compounded by the prominence of deep learning in these models, as models are often blindly applied on out-of-distribution images. In this work, we implement adversarial attacks in common open-source super-resolution models and examine their impact on reconstructions and downstream classification tasks. We find that an adversarially trained super-resolution model can produce high-quality reconstructions that degrade downstream classifications. Moreover, these attacks do not require access to low-resolution imagery or class labels at inference time. These results demonstrate the vulnerability of super-resolution methods to malicious actors and motivates the development of a detector for super-resolution adversarial attacks. Further exploration of adversarial attacks in this domain is required to ensure trustworthiness and robustness of super-resolution models for national security applications.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

In situ Detection of Plasma Induced Surface Interaction based on Deep Learning based Visual Diagnostics (Technical Report)

It is characteristic for many plasma devices to undergo plasma-material interaction leading to surface erosion. These processes, often not easily detectable, lead to changes in device performance and lifespan. State-of-the-art lifetime tests and wear experiments require over 1000s hours. A self-consistent model for accurately predicting the erosion's effects is not available. In situ detection of these processes is not a trivial task since the surface variations at the early stages have a micron scale. Such limitations not only restrict testing and prediction capabilities but also slow the development of new thrusters and limit mission duration. To address these challenges, an in-situ diagnostic for real-time erosion assessment has been developed, aiming to expedite lifetime testing and broaden experimental campaigns. Several works were dedicated to real-time and in situ monitoring of material erosion during plasma exposure using laser holography, microscopy, and with telemicroscopes. However, the applicability of these approaches is limited due to complexity, cost and less flexibility as they often require placing diagnostic equipment inside the vacuum chamber. In collaboration with Princeton Collaborative Research Facility (PCRF), Princeton Plasma Physics Laboratory (PPPL), a new diagnostic approach is developed, where geometry modifications to the ceramic channel walls were introduced that would result in accelerated channel erosion. We employed Long-distance microscope (LDM) imagery, combined with Deep-Learning based Shape from focus or depth from focus (DFF or SFF) approach, that provides an accessible and cost-effective solution. LDM employs focus variation techniques to continuously capture multiple images of the target object at distinct focal planes. DFF, an optical focus variation method, generates a 3D topographical surface depth map from a sequence of variably focused images. Combined with the developed diagnostic, this approach offers a controllable means to study erosion under accelerated conditions. In this work, we develop Neural Network-based DFF algorithm applicable for LDM data to quantitatively evaluate plasma induced surface modification from LDM data. Next, we develop Deep Learning-based super-resolution depth map image reconstruction technique to increase the resolution of depth maps obtained from DFF algorithm to improve the accuracy of erosion measurements. Thirdly, we develop several image processing techniques to remove noise and improve the quality of depth map image. Here we report the results of initial tests for this approach. An experimental setup designed and built in PPPL was employed that consists of a 3-cm gridded ion source that produces a neutralized argon beam with energies up to 600 eV. A hexagonal boron nitride (h-BN) ceramic target, designed based on computational predictions, was used. Tests were conducted to reconstruct the complex geometry of the target under the lighting conditions of the operated ion source.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

World-Wide Web Tools for Locating Planetary Images

The explosive growth of the World-Wide Web (WWW) in the past year has made it feasible to provide interactive graphical tools to assist scientists in locating planetary images. The highest available resolution images of any site of interest can be quickly found on a map or plot, and, if online, displayed immediately on nearly any computer equipped with a color screen, an Internet connection, and any of the free WWW browsers. The same tools may also be of interest to educators, students, and the general public. Image finding tools have been implemented covering most of the solar system: Earth, Mars, and the moons and planets imaged by Voyager. The Mars image-finder, which plots the footprints of all the high-resolution Viking Orbiter images and can be used to display any that are available online, also contains a complete scrollable atlas and hypertext gazetteer to help locating areas. The Earth image-finder is linked to thousands of Shuttle images stored at NASA/JSC, and displays them as red dots on a globe. The Voyager image-finder plots images as dots, by longitude and apparent target size, linked to online images. The locator (URL) for the top-level page is http: //ic-www.arc.nasa.gov/ic/projects/bayes-group/Atlas/. Through the efforts of the Planetary Data System and other organizations, hundreds of thousands of planetary images are now available on CD-ROM, and many of these have been made available on the WWW. However, locating images of a desired site is still problematic, in practice. For example, many scientists studying Mars use digital image maps, which are one third the resolution of Viking Orbiter survey images. When they douse Viking Orbiter images, they often work with photographically printed hardcopies, which lack the flexibility of digital images: magnification, contrast stretching, and other basic image-processing techniques offered by off-the-shelf software. From the perspective of someone working on an experimental image processing technique for super-resolution, the discovery that potential users are often not using the highest resolution already available, nor using conventional image processing techniques, was surprising. This motivated the present work.

Kanefsky, Bob↗

Multidimensional Distributional Neural Network Output Demonstrated in Super‐Resolution of Surface Wind Speed

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic uncertainty, few offer closed-form, multidimensional distributions that preserve spatial correlation while remaining computationally tractable. In this work, we present a framework for training neural networks with a multidimensional Gaussian loss, generating a closed-form predictive distribution over outputs informed by non-identically distributed training data. Our approach captures aleatoric uncertainty by iteratively estimating the means and covariance matrices, and is demonstrated on a super-resolution example out-of-training-sample. We leverage a Fourier representation of the covariance matrix to stabilize network training and preserve spatial correlation. We introduce a novel regularization strategy—referred to as information sharing—that interpolates between image-specific and global covariance estimates, enabling convergence of the super-resolution downscaling network trained on image-specific distributional loss functions. This framework allows for efficient sampling, explicit correlation modeling, and extensions to more complex distribution families all without disrupting prediction performance. We demonstrate the method on a surface wind speed downscaling task and discuss its broader applicability to uncertainty-aware prediction in scientific models.

17 WIND ENERGY↗

Label-free nanoscopy of cell metabolism by ultrasensitive reweighted visible stimulated Raman scattering

Nanoscopic imaging of cell metabolism is hindered by the incompatibility of small metabolites with fluorescent dyes and the limited resolution of imaging mass spectrometry. We present ultrasensitive reweighted visible stimulated Raman scattering (URV-SRS), a label-free vibrational nanoscopy technique that enables multiplexed detection of metabolic nanostructures within cells. We developed an extensively chirped spectral focusing visible SRS microscope that achieves a detection limit of 4,000 molecules and introduced a self-supervised learning-based denoiser to robustly suppress non-independent SRS noise by over 7.2 dB. The instrumentation-based signal enhancement and computation-based noise suppression synergistically improved the detection sensitivity by 50 times over near-infrared SRS. Leveraging this enhanced sensitivity, we further pushed the resolution to nanoscopic levels by introducing Fourier reweighting to amplify sub-100 nm spatial frequencies previously overwhelmed by noise. Validated by Fourier ring correlation, URV-SRS achieves a lateral resolution of 86 nm in cellular imaging. Here, we applied URV-SRS to elucidate the reprogramming of metabolic nanostructures associated with virus replication in Vero E6 host cells and to compositionally delineate subcellular fatty acid synthesis in engineered Escherichia coli, demonstrating its capability towards nanoscopic spatial metabolomics.

59 BASIC BIOLOGICAL SCIENCES↗

Characterizing Absolute Orientations in DNA Self-Assembly of Single Molecules

DNA self-assembly of single molecules (i.e., dyes) with deterministic orientations is a powerful approach for engineering mo-lecular excitons. However, current determination methods of the dye orientation relative to DNA do not account for the orien-tation of the dye plane, which is a missing degree of freedom needed to define absolute three-dimensional orientations. In this work, we combine fluorescence-detected linear dichroism, defocused dipole imaging, and DNA points accumulation for imaging in nanoscale topography (DNA-PAINT) super-resolution microscopy to determine the absolute three-dimensional orientations of single Cy5 dyes relative to host DNA duplexes which includes the dye plane orientation. The data revealed that the absorption and emission dipoles are perpendicular to the DNA duplex, and the mean dye plane is parallel to the DNA bases, which supports the notion that Cy5 dyes intercalate between DNA base pairs. The presented methodology will inspire the investigation of the dye plane orientation for controlling dye arrangement configurations beyond spontaneous π-stacking between dyes as well as achieving novel dye-DNA arrangements.

36 MATERIALS SCIENCE↗

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Context dependent anti-aliasing image reconstruction

Image Reconstruction has been mostly confined to context free linear processes; the traditional continuum interpretation of digital array data uses a linear interpolator with or without an enhancement filter. Here, anti-aliasing context dependent interpretation techniques are investigated for image reconstruction. Pattern classification is applied to each neighborhood to assign it a context class; a different interpolation/filter is applied to neighborhoods of differing context. It is shown how the context dependent interpolation is computed through ensemble average statistics using high resolution training imagery from which the lower resolution image array data is obtained (simulation). A quadratic least squares (LS) context-free image quality model is described from which the context dependent interpolation coefficients are derived. It is shown how ensembles of high-resolution images can be used to capture the a priori special character of different context classes. As a consequence, a priori information such as the translational invariance of edges along the edge direction, edge discontinuity, and the character of corners is captured and can be used to interpret image array data with greater spatial resolution than would be expected by the Nyquist limit. A Gibb-like artifact associated with this super-resolution is discussed. More realistic context dependent image quality models are needed and a suggestion is made for using a quality model which now is finding application in data compression.

Beaudet, Paul R.↗

Imaging from Macro to Nanoscale: Multimodal Advances in Chemical and Biomedical Imaging

Imaging increasingly serves as a multiscale framework for linking molecular mechanisms to cellular behavior, tissue architecture, and organ phenotypes in biology and unraveling fundamental processes in chemistry, physics and materials science. This Perspective highlights recent advances in chemical and biomedical imaging across macro-, micro-, and nanoscales, using representative examples published in Chemical and Biomedical Imaging (CBMI). At the macroscale, we discuss chemically selective MRI, including endogenous and exogenous CEST strategies, together with photoacoustic imaging as a hybrid modality with functional and chemical contrast. At the microscale, we consider fluorescence, label-free optical and vibrational imaging, and selected X-ray approaches that expand sensitivity, specificity, and temporal resolution in biological and materials systems. At the nanoscale, we highlight super-resolution fluorescence microscopy, single-molecule methods, tip-enhanced Raman spectroscopy, and correlative imaging strategies that resolve local heterogeneity and molecular organization. Across scales, a common theme emerges that advances in probes, contrast mechanisms, instrumentation, and sample handling are enabling chemically informed imaging that connects molecular specificity with biological context.

multiscale imaging↗

DNA-PAINT Imaging with Hydrogel Imprinting and Clearing

Hydrogel-embedding is a versatile technique in fluorescence microscopy, offering stabilization, optical clearing, and the physical expansion of biological specimens. DNA-PAINT is a super-resolution microscopy approach based on the diffusion and transient binding of fluorescently labeled oligos, but its feasibility in hydrogels has not yet been explored. In this study, we demonstrate that polyacrylamide hydrogels support sufficient diffusion for effective DNA-PAINT imaging. Using acrydite-anchored oligonucleotides imprinted from patterned DNA origami nanostructures and microtubule filaments in fixed cells, we find that hydrogel embedding preserves docking strand positioning at the nanoscale. Sample clearing via protease treatment had minor structural effects on the microtubule structure and enhanced diffusion and accessibility to hydrogel-imprinted docking strands. Our work demonstrates promising potential for diffusion and binding-based fluorescence imaging applications in hydrogel-embedded samples.

DNA origami↗

Super-Resolution Ptychography with Small Segmented Detectors

To overcome the spatial resolution limit set by aperture-limited diffraction in traditional scanning transmission electron microscopy, microscopists have developed ptychography enabled by iterative phase retrieval algorithms and high-dynamic-range pixel array detectors. Current detector designs are limited by the data rate off chip, so a high-pixel-count detector has a proportionally lower frame rate than the few-segment detectors used for differential phase contrast (DPC) imaging. This slower acquisition speed leads to heightened vulnerability to scan noise, drift, and potential sample damage. This creates opportunities for repurposing fast segmented detectors for ptychography by trading a reduction in reciprocal space pixels for an increase in real space pixels. Here, we explore a strategy of oversampling in real space and instead apply detector pixel upsampling during the reconstruction process. Further, we demonstrate the viability of achieving super-resolution ptychography on thin objects using only 2 × 2 detector pixels, surpassing the resolution of integrated DPC (iDPC) imaging. With optimization using simulated datasets and experiments on MoTe 2 /WSe 2 bilayer moiré superlattices, we achieved super-resolution ptychography reconstructions under rapid acquisition conditions (37.5 pA, 1 μs dwell time), yielding over 50% improvements in contrast and information limit compared to annular dark field and iDPC imaging on the same detectors.

2D materials↗

Advances in Image-Domain Multi-Resolution and Super-Resolution Algorithms for Industrial X-Ray Computed Tomography: A Literature Survey and New Insights

Industrial X-ray Computed Tomography (XCT) is a nondestructive method for inspection and character ization of materials and parts. XCT captures images of a part from various angles, and these images are then used to construct Three-Dimensional (3D) representations of that part. This method enables assessing the quality of the parts, identifying defects and understanding their physical properties without damaging them.

36 MATERIALS SCIENCE↗

Global Multimodal Dataset for Nighttime Light Super-Resolution

The dataset is a collection of spatially and temporally registered high-resolution and low-resolution nighttime light (NTL) images, high-resolution land-use binary masks, and high-resolution road density images from around the world. The NTL images are sourced from the NASA Black Marble product VNP46A2 and the LuoJia1-01 satellite. The land-use binary masks are derived from Google's and the World Resources Institute's DynamicWorld dataset, and the road density images are sourced from OpenStreetMap.

Nighttime lights↗

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗

Imaging a terahertz superfluid plasmon in a two-dimensional superconductor

The superconducting gap defines the fundamental energy scale for the emergence of dissipationless transport and collective phenomena in a superconductor. In layered high-temperature cuprate superconductors, in which the Cooper pairs are confined to weakly coupled two-dimensional (2D) copper–oxygen (CuO 2 ) planes, terahertz (THz) spectroscopy at subgap millielectronvolt (meV) energies has provided crucial insights into the collective superfluid response perpendicular to the superconducting layers. However, within the CuO 2 planes, the collective superfluid response manifests as plasmonic charge oscillations at energies far exceeding the superconducting gap, obscured by strong dissipation. Here, in this study, we present spectroscopic evidence of a below-gap, 2D superfluid plasmon in few-layer Bi 2 Sr 2 CaCu 2 O 8+x and spatially resolve its deeply subdiffractive THz electrodynamics. By placing the superconductor in the near field of a spintronic THz emitter, we reveal this distinct resonance—absent in bulk samples and observed only in the superconducting phase—and determine its plasmonic nature by mapping the geometric anisotropy and dispersion. Crucially, these measurements offer a direct view of the momentum-dependent and frequency-dependent superconducting transition in two dimensions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Deep Learning Super-Resolution X-Ray Computed Tomography Algorithms for Additive Manufacturing

Industrial X-ray computed tomography (XCT) is a nondestructive method for inspection and characterization of additively manufactured (AM) materials and parts. In practice, the resolution of XCT can be limited by factors such as detector binning, restricted field of view for large-scale objects, system blur, motion during scanning, and acquisition settings. These limitations can reduce the detectability of critical flaws such as pores, cracks, and lack of fusion. Super-resolution (SR) techniques offer a promising solution for improving the effective resolution and image quality of XCT reconstructions without the need for expensive hardware upgrades or laborious, time-consuming scans. In particular, deep learning-based SR methods have garnered attention in recent years as powerful tools for reconstructing high-resolution volumes from low-resolution inputs. In this work, a novel deep learning-based SR method is proposed for XCT scans of AM parts, and compared against several existing state-of-the-art (SOTA) methods. The proposed method, Simurgh-SR, is built on the pre-existing Simurgh framework and consists of a 2.5D U-Net trained to map low-quality inputs containing noise and artifacts to high-quality reconstructions characterized by higher flaw contrast, better noise texture, and reduced artifacts. The experimental results demonstrate superior performance of Simurgh-SR in performing 4× SR on real industrial XCT scans of thick 316L components, enhancing the structural similarity score and peak signal-to-noise ratio (>7dB) compared to the LR counterpart while improving the F1-score for flaw detection by more than 2.3× when compared to alternative SOTA SR methods. This improvement enables more accurate and significantly faster characterization of metal AM components. Additionally, Simurgh-SR was trained for both 2X and 4X SR and performs effectively at both levels, enabling the use of a single model for various SR factors.

Rahman, Obaid [ORNL] (ORCID:0000000277810840)↗

Hires and beyond

The High-Resolution image construction program (HiRes) used at IPAC is based on the Maximum Correlation Method. After HiRes intensity images are constructed from IRAS data, additional images are needed to aid in scientific interpretation. Some of the images that are available for this purpose show the fitting noise, estimates of the achieved resolution, and detector track maps. Two methods have been developed for creating color maps without discarding any more spatial information than absolutely necessary: the 'cross-band simulation' and 'prior-knowledge' methods. These maps are demonstrated using the survey observations of a 2 x 2 degree field centered on M31. Prior knowledge may also be used to achieve super-resolution and to suppress ringing around bright point sources observed against background emission. Tools to suppress noise spikes and for accelerating convergence are also described.

Fowler, John W.↗