Search NASASearch

SEARCH · Search NASA

Results for “super resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)

Deploying Adversarial Attacks in Super-Resolution Models

Reliable super-resolution methods are crucial for applications like remote sensing, grid resilience and disaster impact analysis, and standoff biometrics. These methods infuse additional high-frequency information into reconstructions, allowing for better contextualization and image intelligence. However, super-resolution models can also introduce hallucinations or other unseen vulnerabilities that could be exploited by an adversary. This is further compounded by the prominence of deep learning in these models, as models are often blindly applied on out-of-distribution images. In this work, we implement adversarial attacks in common open-source super-resolution models and examine their impact on reconstructions and downstream classification tasks. We find that an adversarially trained super-resolution model can produce high-quality reconstructions that degrade downstream classifications. Moreover, these attacks do not require access to low-resolution imagery or class labels at inference time. These results demonstrate the vulnerability of super-resolution methods to malicious actors and motivates the development of a detector for super-resolution adversarial attacks. Further exploration of adversarial attacks in this domain is required to ensure trustworthiness and robustness of super-resolution models for national security applications.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF

Advances in Image-Domain Multi-Resolution and Super-Resolution Algorithms for Industrial X-Ray Computed Tomography: A Literature Survey and New Insights

Industrial X-ray Computed Tomography (XCT) is a nondestructive method for inspection and character ization of materials and parts. XCT captures images of a part from various angles, and these images are then used to construct Three-Dimensional (3D) representations of that part. This method enables assessing the quality of the parts, identifying defects and understanding their physical properties without damaging them.

36 MATERIALS SCIENCE

A Super-Resolution Algorithm for Enhancement of FLASH LIDAR Data: Flight Test Results

This paper describes the results of a 3D super-resolution algorithm applied to the range data obtained from a recent Flash Lidar helicopter flight test. The flight test was conducted by the NASA's Autonomous Landing and Hazard Avoidance Technology (ALHAT) project over a simulated lunar terrain facility at NASA Kennedy Space Center. ALHAT is developing the technology for safe autonomous landing on the surface of celestial bodies: Moon, Mars, asteroids. One of the test objectives was to verify the ability of 3D super-resolution technique to generate high resolution digital elevation models (DEMs) and to determine time resolved relative positions and orientations of the vehicle. 3D super-resolution algorithm was developed earlier and tested in computational modeling, and laboratory experiments, and in a few dynamic experiments using a moving truck. Prior to the helicopter flight test campaign, a 100mX100m hazard field was constructed having most of the relevant extraterrestrial hazard: slopes, rocks, and craters with different sizes. Data were collected during the flight and then processed by the super-resolution code. The detailed DEM of the hazard field was constructed using independent measurement to be used for comparison. ALHAT navigation system data were used to verify abilities of super-resolution method to provide accurate relative navigation information. Namely, the 6 degree of freedom state vector of the instrument as a function of time was restored from super-resolution data. The results of comparisons show that the super-resolution method can construct high quality DEMs and allows for identifying hazards like rocks and craters within the accordance of ALHAT requirements.

Bulyshev, Alexander

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VIIRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project at https://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Using 2.5D super-resolution to improve flaw detection in metal additive manufacturing parts

Industrial X-ray computed tomography (XCT) enables non-destructive inspection of additively manufactured (AM) parts, but high-resolution scanning requires long acquisition times and significant computational resources, limiting throughput in production environments. Super-resolution techniques can recover high-resolution information from low-resolution scans, but existing methods face a trade-off between 2D approaches that ignore inter-slice information and 3D methods that are computationally prohibitive for practical deployment. To address this trade-off, we propose a 2.5D deep learning-based super-resolution approach that uses seven neighbouring low-resolution slices to super-resolve the centre slice. This work evaluates the method on real XCT scans of steel AM parts, comparing reconstruction quality and flaw detection performance of 2D, 2.5D, and 3D ESRGAN-based super-resolution methods. Results demonstrate that 2.5D super-resolution significantly improves detection of small, process-induced flaws (e.g. porosity) compared to 2D methods, while avoiding the prohibitive computational burden of full 3D approaches. These findings provide initial evidence of 2.5D super-resolution as a practical, deployable solution for improving flaw detection in high-throughput industrial XCT inspection.

X-ray CT

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VI-IRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project athttps://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2.5D Super-Resolution Approaches for X-Ray Computed Tomography-Based Inspection of Additively Manufactured Parts

X-ray computed tomography (XCT) is a key tool in non-destructive evaluation of additively manufactured (AM) parts, allowing for internal inspection and defect detection. Despite its widespread use, obtaining high-resolution CT scans can be extremely time consuming. This issue can be mitigated by performing scans at lower resolutions; however, reducing the resolution compromises spatial detail, limiting the accuracy of defect detection. Super-resolution algorithms offer a promising solution for overcoming resolution limitations in XCT reconstructions of AM parts, enabling more accurate detection of defects. While 2D super-resolution methods have demonstrated state-of-the-art performance on natural images, they tend to under-perform when directly applied to XCT slices. On the other hand, 3D super-resolution methods are computationally expensive, making them infeasible for large-scale applications. To address these challenges, we propose a 2.5D super-resolution approach tailored for XCT of AM parts. Our method enhances the resolution of individual slices by leveraging multi-slice information from neighboring 2D slices without the significant computational overhead of full 3D methods. Specifically, we use neighboring low-resolution slices to super-resolve the center slice, exploiting inter-slice spatial context while maintaining computational efficiency. This approach bridges the gap between 2D and 3D methods, offering a practical solution for high-throughput defect detection in AM parts.

Sullivan, Haley

A Super-Resolution Algorithm for Enhancement of FLASH LIDAR data

A novel method for enhancement of the spatial resolution of 3-dimensional Flash Lidar images is being proposed for generation of elevation maps of terrain from a moving platform. NASA recognizes the Flash LIDAR technology as an important tool for enabling safe and precision landing in future unmanned and crewed lunar and planetary missions. The ability of the Flash LIDAR to generate 3-dimensional maps of the landing site area during the final stages of the descent phase for detection of hazardous terrain features such as craters, rocks, and steep slopes is under study in the frame of the Autonomous Landing and Hazard Avoidance (ALHAT) project. Since single frames of existing FLASH LIDAR systems are not sufficient to build a map of entire landing site with acceptable spatial resolution and precision, a super-resolution approach utilizing multiple frames has been developed to overcome the instrument s limitations. Performance of the super-resolution algorithm has been analyzed through a series of simulation runs obtained from a high fidelity Flash LIDAR model and a high resolution synthetic lunar elevation map. For each simulation run, a sequence of FLASH LIDAR frames are recorded and processed as the spacecraft descends toward the landing site. Simulations runs having different trajectory profiles and varying LIDAR look angles of the terrain are also analyzed. The results show that adequate levels of accuracy and precision are achieved for detecting hazardous terrain features and identifying safe areas of the landing site.

Bulyshev, Alexander

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. In conclusion, the results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

42 ENGINEERING

DiffLense: a conditional diffusion model for super-resolution of gravitational lensing data

Abstract Gravitational lensing data is frequently collected at low resolution due to instrumental limitations and observing conditions. Machine learning-based super-resolution techniques offer a method to enhance the resolution of these images, enabling more precise measurements of lensing effects and a better understanding of the matter distribution in the lensing system. This enhancement can significantly improve our knowledge of the distribution of mass within the lensing galaxy and its environment, as well as the properties of the background source being lensed. Traditional super-resolution techniques typically learn a mapping function from lower-resolution to higher-resolution samples. However, these methods are often constrained by their dependence on optimizing a fixed distance function, which can result in the loss of intricate details crucial for astrophysical analysis. In this work, we introduce DiffLense , a novel super-resolution pipeline based on a conditional diffusion model specifically designed to enhance the resolution of gravitational lensing images obtained from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). Our approach adopts a generative model, leveraging the detailed structural information present in Hubble space telescope (HST) counterparts. The diffusion model, trained to generate HST data, is conditioned on HSC data pre-processed with denoising techniques and thresholding to significantly reduce noise and background interference. This process leads to a more distinct and less overlapping conditional distribution during the model’s training phase. We demonstrate that DiffLense outperforms existing state-of-the-art single-image super-resolution techniques, particularly in retaining the fine details necessary for astrophysical analyses.

Computer Science

Super-resolution stimulated X-ray Raman spectroscopy

Propagation of intense X-ray pulses through dense media has led to the observation of phenomena such as atomic X-ray lasing, self-induced transparency and stimulated X-ray Raman scattering (SXRS)4. SXRS has been long predicted as a means to launch and probe valence-electron wavepackets and as a building block for nonlinear X-ray spectroscopies. However, experimental observations of SXRS to date have not provided spectroscopic information, and theoretical modelling has largely implemented hard-to-realize phase-coherent attosecond pulses. Here we demonstrate SXRS with spectroscopic precision, that is, detection of valence-excited states in neon with a near Fourier-limited joint energy–time resolution of 0.1 eV–40 fs. We used a new covariance analysis between statistically spiky broadband incident X-ray and scattered X-ray Raman pulses. Using 18,000 single shots, we beat not only the incident (about 8 eV) bandwidth but also the approximately 0.2 eV instrumental energy resolution, thus creating super-resolution conditions, in analogy to super-resolved fluorescence microscopy. Our experimental results, supported by ab initio propagation simulations, reveal the competition between lasing in the ion and stimulated Raman scattering in the neutral. We demonstrate enhanced signal collection efficiency and a broad excitation window, surpassing spontaneous Raman efficiencies by orders of magnitude. This stochastic SXRS approach represents a first step towards tracking elementary events that determine chemical outcomes.

nonlinear x-ray spectroscopy

A Super-Resolution Laser Altimetry Concept

A super-resolution laser altimetry technique has been proposed to provide improved lidar altimetry from Cloud Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) lidar data, and it is applicable to other similar atmospheric profiling lidar with low-pass filters. To achieve high altimetry resolution, the new technique relies on an empirical relationship between the peak signal ratio and the distance between land surface and the peak signal range bin center, which is directly derived from the CALIPSO lidar measurements and does not require the CALIPSO's transient response. The CALIPSO surface elevation results in Northern America retrieved by the new technique agree with the National Elevation Database high resolution elevation maps, and the comparisons suggest that the precision of the technique is much better than 1.4 m. The preliminary data product of land surface elevation retrieved by the new technique from CALIPSO lidar measurements is available to the altimetry community for evaluation.

Lu, Xiaomei

Stochastic frequency fluctuation super-resolution imaging

The inherent non-linearity of intensity correlation functions can be used to spatially distinguish identical emitters beyond the diffraction limit, as achieved, for example, in super-resolution optical fluctuation imaging (SOFI). Here, we propose a complementary concept based on spectral correlation functions, termed spectral fluctuation super-resolution (SFSR) imaging. Through theoretical and computational analysis, we show that spatially resolving time-frequency correlation functions in the image plane can improve the imaging resolution by a factor of $\sqrt2$ in most cases and up to twofold for strictly two emitters. This improvement is achieved by quantifying the degree of correlation in spectral fluctuations across the spatial domain. Experimentally, SFSR can be implemented using a combination of interferometry and photon-correlation measurements. The method works for non-blinking emitters and stochastic spectral fluctuations with arbitrary temporal statistics. This suggests its utility in super-resolution microscopy of quantum emitters at low temperatures, where spectral diffusion is often more pronounced than emitter blinking.

47 OTHER INSTRUMENTATION

Mesh-based super-resolution of fluid flows with multiscale graph neural networks

A graph neural network (GNN) approach is introduced in this work which enables mesh-based three-dimensional super-resolution of fluid flows. In this framework, the GNN is designed to operate not on the full mesh-based field at once, but on localized meshes of elements (or cells) directly. To facilitate mesh-based GNN representations in a manner similar to spectral (or finite) element discretizations, a baseline GNN layer (termed a message passing layer, which updates local node properties) is modified to account for synchronization of coincident graph nodes, rendering compatibility with commonly used element-based mesh connectivities. Furthermore, the architecture is multiscale in nature, and is comprised of a combination of coarse-scale and fine-scale message passing layer sequences (termed processors) separated by a graph unpooling layer. The coarse-scale processor embeds a query element (alongside a set number of neighboring coarse elements) into a single latent graph representation using coarse-scale synchronized message passing over the element neighborhood, and the fine-scale processor leverages additional message passing operations on this latent graph to correct for interpolation errors. Demonstration studies are performed using hexahedral mesh-based data from Taylor–Green Vortex and backward-facing step flow simulations at Reynolds numbers of 1600 and 3200. Through analysis of both global and local errors, the results ultimately show how the GNN is able to produce accurate super-resolved fields compared to targets in both coarse-scale and multiscale model configurations. Reconstruction errors for fixed architectures were found to increase in proportion to the Reynolds number. Geometry extrapolation studies on a separate cavity flow configuration show promising cross-mesh capabilities of the super-resolution strategy.

Backward-facing step

Multimodal super-resolution: discovering hidden physics and its application to fusion plasmas

Understanding complex physical systems often requires integrating data from multiple diagnostics, each with limited resolution or coverage. We present a machine learning framework that reconstructs synthetic high-temporal-resolution data for a target diagnostic using information from other diagnostics, without direct target measurements during the inference. This multimodal super-resolution technique improves diagnostic robustness and enables monitoring even in case of measurement failures or degradation. Applied to fusion plasmas, our method targets edge-localized modes (ELMs), which can damage plasma-facing materials. By reconstructing super-resolution Thomson Scattering data from complementary diagnostics, we uncover fine-scale plasma dynamics and validate the role of resonant magnetic perturbations (RMPs) in ELM suppression through magnetic island formation. The approach provides new observation supporting the plasma profile flattening due to these islands. Our results demonstrate the framework’s ability to generate high-fidelity synthetic diagnostics, offering a powerful tool for ELM control development in future reactors like ITER. The approach is broadly transferable to other domains facing sparse, incomplete, or degraded diagnostic data, opening new avenues for discovery.

Jalalvand, Azarakhsh [Princeton Univ., NJ (United

Learning turbulent flows with generative models for super resolution and sparse flow reconstruction

Neural operators are promising surrogates for dynamical systems but when trained with standard L 2 losses they tend to oversmooth fine-scale turbulent structures. Here, we show that combining operator learning with generative modeling overcomes this limitation. We consider three practical turbulent-flow challenges where conventional neural operators fail: spatio-temporal super-resolution, forecasting, and sparse flow reconstruction. For Schlieren jet super-resolution, an adversarially trained neural operator (adv-NO) reduces the energy-spectrum error by 15 × while preserving sharp gradients at neural operator-like inference cost. For 3D homogeneous isotropic turbulence, adv-NO trained on only 160 timesteps from a single trajectory forecasts accurately for five eddy-turnover times and offers 114 × wall-clock speed-up at inference than the baseline diffusion-based forecasters, enabling near-real-time rollouts. For reconstructing cylinder wake flows from highly sparse Particle Tracking Velocimetry-like inputs, a conditional generative model infers full 3D velocity and pressure fields with correct phase alignment and statistics. These advances enable accurate reconstruction and forecasting at low compute cost, bringing near-real-time analysis and control within reach in experimental and computational fluid mechanics.

Fluid dynamics

Super Resolution Image Enhancement for a Flash Lidar: Back Projection Method

In this paper a new image processing technique for flash LIDAR data is presented as a potential tool to enable safe and precise spacecraft landings in future robotic or crewed lunar and planetary missions. Flash LIDARs can generate, in real-time, range data that can be interpreted as a 3-dimensional (3-D) image and transformed into a corresponding digital elevation map (DEM). The NASA Autonomous Landing and Hazard Avoidance (ALHAT) project is capitalizing on this new technology by developing, testing and analyzing flash LIDARs to detect hazardous terrain features such as craters, rocks, and slopes during the descent phase of spacecraft landings. Using a flash LIDAR for this application looks very promising, however through theoretical and simulation analysis the ALHAT team has determined that a single frame, or mosaic, of flash LIDAR data may not be sufficient to build a landing site DEM with acceptable spatial resolution, precision, size, or for a mosaic, in time, to meet current system requirements. One way to overcome this potential limitation is by enhancing the flash LIDAR output images. We propose a new super-resolution algorithm applicable to flash LIDAR range data that will create a DEM with sufficient accuracy, precision and size to meet current ALHAT requirements. The performance of our super-resolution algorithm is analyzed by processing data generated during a series of simulation runs by a high fidelity model of a flash LIDAR imaging a high resolution synthetic lunar elevation map. The flash LIDAR model is attached to a simulated spacecraft by a gimbal that points the LIDAR to a target landing site. For each simulation run, a sequence of flash LIDAR frames is recorded and processed as the spacecraft descends toward the landing site. Each run has a different trajectory profile with varying LIDAR look angles of the terrain. We process the output LIDAR frames using our SR algorithm and the results show that the achieved level of accuracy and precision of the SR generated landing site DEM is more than adequate for detecting hazardous terrain features and identifying safe areas.

Bulyshev, Alexander