Search NASA⌕ Search

SEARCH · Search NASA

Results for “sub-pixel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Quantification of Sub-Pixel Dynamics in High-Speed Neutron Imaging

The high penetration depth of neutrons through many metals and other common materials makes neutron imaging an attractive method for non-destructively probing the internal structure and dynamics of objects or systems that may not be accessible by conventional means, such as X-ray or optical imaging. While neutron imaging has been demonstrated to achieve a spatial resolution below 10 μm and temporal resolution below 10 μs, the relatively low flux of neutron sources and the limitations of existing neutron detectors have, until now, dictated that these cannot be achieved simultaneously, which substantially restricts the applicability of neutron imaging to many fields of research that could otherwise benefit from its unique capabilities. In this work, we present an attenuation modeling approach to the quantification of sub-pixel dynamics in cyclic ensemble neutron image sequences of an automotive gasoline direct injector at a 5 μs time scale with a spatial noise floor in the order of 5 μm.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Sub-pixel high-resolution imaging of high-energy x-rays inspired by sub-wavelength optical imaging

We have developed and demonstrated an image super-resolution method—XR-UNLOC: X-Ray UNsupervised particle LOCalization—for hard x-rays measured with fast-frame-rate detectors that is an adaptation of the principle of photo-activated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), which enabled biological fluorescence imaging at sub-optical-wavelength scales. We demonstrate the approach on experimental coherent Bragg diffraction data measured with 52 keV x-rays from a nanocrystalline sample. From this sample, we resolve the fine fringe detail of a high-energy x-ray Bragg coherent diffraction pattern to an upsampling factor of 16 of the native pixel pitch of 30 μ m of a charge-integrating fastCCD detector. This was accomplished by analysis of individual photon locations in a series of “nearly-dark” instances of the diffraction pattern that each contain only a handful of photons. Central to our approach was the adaptation of the UNLOC photon fitting routine for PALM/STORM to the hard x-ray regime to handle much smaller point spread functions, which required a different statistical test for photon detection and for sub-pixel localization. A comparison to a photon-localization strategy used in the x-ray community (“droplet analysis”) showed that XR-UNLOC provides significant improvement in super-resolution. We also developed a metric by which to estimate the limit of reliable upsampling with XR-UNLOC under a given set of experimental conditions in terms of the signal-to-noise ratio of a photon detection event and the size of the point spread function for guiding future x-ray experiments in many disciplines where detector pixelation limits must be overcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Correction and verification of x-ray imaging crystal spectrometer analysis on Wendelstein 7-X through x-ray ray tracing

X-ray ray tracing is used to develop ion-temperature corrections for the analysis of the X-ray Imaging Crystal Spectrometer (XICS) used at Wendelstein 7-X (W7-X) and perform verification on the analysis methods. The XICS is a powerful diagnostic able to measure ion-temperature, electron-temperature, plasma flow, and impurity charge state densities. While these systems are relatively simple in design, accurate characterization of the instrumental response and validation of analysis techniques are difficult to perform experimentally due to the requirement of extended x-ray sources. For this reason, a ray tracing model has been developed that allows characterization of the spectrometer and verification of the analysis methods while fully considering the real geometry of the XICS system and W7-X plasma. Through the use of ray tracing, several important corrections have been found that must be accounted for in order to accurately reconstruct the ion-temperature profiles. The sources of these corrections are described along with their effect on the analyzed profiles. The implemented corrections stem from three effects: (1) effect of sub-pixel intensity distribution during de-curving and spatial binning, (2) effect of sub-pixel intensity distribution during forward model evaluation and generation of residuals, and (3) effect of defocus and spherical aberrations on the instrumental response. Possible improvements to the forward model and analysis procedures are explored, along with a discussion of trade-offs in terms of computational complexity. Finally, the accuracy of the tomographic inversion technique in stellarator geometry is investigated, providing for the first time a verification exercise for inversion accuracy in stellarator geometry and a complete XICS analysis tool-chain.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗
DOE OSTI2026

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗
DOE OSTI2021

Multiscale assessment of land surface phenology from harmonized Landsat 8 and Sentinel-2, PlanetScope, and PhenoCam imagery

As the spatial and temporal resolution of remotely sensed imagery has improved over the last four decades, algorithms for monitoring and mapping seasonal changes in surface properties have evolved rapidly. Most recently, the availability of daily PlanetScope imagery has created new opportunities for monitoring the land surface phenology (LSP) of terrestrial ecosystems at high spatial resolution. However, the quality and value of LSP information from PlanetScope imagery have not been systematically examined. In this paper, we evaluate the character and quality of LSP information derived from PlanetScope by comparing time series of vegetation indices and LSP metrics from PlanetScope to corresponding time series and LSP metrics derived from Harmonized Landsat 8 and Sentinel-2 (HLS) imagery and PhenoCams at six sites that span a diverse range of land cover types and climate. Results show that vegetation index time series from all three data sources show high temporal correlation, and LSP metrics derived from HLS, PlanetScope, and PhenoCam show high agreement with negligible bias. Semi-variograms for phenometrics estimated from PlanetScope imagery indicate that the majority of spatial variance captured in PlanetScope phenometrics occurs well below the spatial resolution HLS imagery. At the same time, LSP metrics from HLS are most strongly correlated with the 50–75% quantiles of 3 m LSP metrics from PlanetScope. This indicates that HLS captures the average phenology at sub-pixel scale captured in PlanetScope imagery. Here, our results represent the first comprehensive comparison of LSP metrics estimated from PlanetScope and publicly available moderate spatial resolution imagery, and provide insights regarding: (1) the quality and character of LSP metrics derived from HLS and PlanetScope; and (2) the relative merits and trade-offs associated with the use of each data source for LSP studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Hyperspectral radiance mapping and chromatic correction for temperature measurement in laser-heated diamond anvil cells

In laser-heated diamond anvil cell (DAC) experiments, the effective heated region typically decreases in size with increasing pressure, leading to steeper thermal gradients. Under these conditions, chromatic aberration in the optical path from sample to detector can significantly create bias in spectro-radiometric temperature measurement. We present a radiance-mapping approach using a hyperspectral camera that records 25 spectral channels spanning 605–875 nm at each pixel in a single exposure, providing spatially and spectrally resolved radiance in each frame. This enables chromatic effects to be recorded and corrected in data processing. We developed a procedure for hyperspectral mapping, involving per-camera calibration, crosstalk removal, measured spectral throughput functions, and optional sub-pixel co-registration to minimize chromatic distortion. The calibrated radiance maps are then used to derive temperature maps of the laser-heated hotspots. For smaller heating spots, the radiance mapping approach reveals chromatic shifts that conventional spectro-radiometric methods cannot quantify. Ambient-pressure heating experiments confirm accurate temperature retrieval. At high pressure, application of the hyperspectral system to a platinum-heating experiment at 12 GPa demonstrates stable temperature reconstruction under steep thermal gradients. Beyond mitigating chromatic aberrations, the ability to diagnose optical artifacts separately from emissivity variations during controlled test experiments or in situ suggests a path toward more rigorous spectral emissivity analysis and improved modeling of thermal transport in laser-heated DAC experiments.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Mitigation of the Brighter-fatter Effect in the LSST Camera

Abstract Thick, fully depleted charge-coupled devices are known to exhibit nonlinear behavior at high signal levels due to the dynamic behavior of charges collecting in the potential wells of pixels, called the brighter-fatter effect (BFE). The effect results in distorted images of bright calibration stars, creating a flux-dependent point-spread function that if left unmitigated, could make up a large fraction of the error budget in Stage IV weak-lensing (WL) surveys such as the Legacy Survey of Space and Time (LSST). In this paper, we analyze image measurements of flat fields and artificial stars taken at different illumination levels with the LSST Camera (LSSTCam) at SLAC National Accelerator Laboratory in order to quantify this effect in the LSSTCam before and after a previously introduced correction technique. We observe that the BFE evolves anisotropically as a function of flux due to higher-order BFEs, which violates the fundamental assumption of this correction method. We then introduce a new method based on a physically motivated model to account for these higher-order terms in the correction, and then we test the modified correction on both data sets. We find that the new method corrects the effect in flat fields better than it corrects the effect in artificial stars, which we suggest is the result of sub-pixel physics not included in this correction model. We use these results to define a new metric for the full-well capacity of our sensors and advise image processing strategies to further limit the impact of the effect on LSST WL science pathways.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Landscape-scale characterization of Arctic tundra vegetation composition, structure, and function with a multi-sensor unoccupied aerial system

The Arctic is experiencing some of the most rapid climate change on Earth, with strong impacts on tundra ecosystems that are characterized by high land-surface and vegetation heterogeneity. Previous studies have explored this complexity using satellite remote sensing, however these typically coarse spatial resolution data have generally missed sub-pixel heterogeneity, leaving critical gaps in our understanding of tundra vegetation dynamics from the community to landscape scales. To address these gaps, we collected very high-resolution (1-5 cm) optical, structural, and thermal data at three low-Arctic tundra sites on the Seward Peninsula, Alaska, using a multi-sensor unoccupied aerial system (UAS). We examined the application of these data to studying tundra vegetation dynamics, by quantifying (1) canopy height and thermoregulation (leaf-air temperature) of representative plant functional types (PFTs), (2) fine-scale patterns of vegetation composition across landscapes, and (3) impacts of fine-scale vegetation composition on landscape-scale variation of canopy height and thermoregulation. Our results show that deciduous tall shrubs (those that can potentially grow >2 m) had a strong cooling effect, with canopy temperatures significantly lower than local air temperatures and other PFTs. Increased cover of tall shrubs also had the potential to reduce the cover of low-stature PFTs across the landscape, potentially associated with their closed canopy (i.e., increased light competition) and strong thermoregulation. To understand the connections between fine-scale vegetation composition and large-scale ecosystem processes, we produced a random forest model which showed that fine-scale PFT composition accounted for 86.8% and 74.2% of the landscape-scale variation in canopy height and thermoregulation, respectively. These findings highlight the importance of spatially detailed characterization of tundra PFTs to improve our ecological understanding and model representation of tundra vegetation, also transcend our study to show the need for continued collection of similar datasets to better understand the impacts of surface heterogeneity on the mapping and modeling of tundra ecosystem dynamics, as well as assist with conservation management and biodiversity monitoring strategies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Extracting forces from noisy dynamics in dusty plasmas

Extracting environmental forces from noisy data is a common yet challenging task in complex physical systems. Machine learning (ML) represents a robust approach to this problem, yet is mostly tested on simulated data with known parameters. Here we use supervised ML to extract the electrostatic, dissipative, and stochastic forces acting on micron-sized charged particles levitated in an argon plasma (dusty plasma). By tracking the sub-pixel motion of particles in subsequent images, we successfully estimated these forces from their random motion. The experiments contained important sources of non-Gaussian noise, such as drift and pixel-locking, representing a data mismatch from methods used to analyze simulated data with purely Gaussian noise. Our model was trained on simulated particle trajectories that included all of these artifacts, and used more than 100 dynamical and statistical features, resulting in a prediction with 50\% better accuracy than conventional methods. Lastly, in systems with two interacting particles, the model provided non-contact measurements of the particle charge and Debye length in the plasma environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Discorpy : algorithms and software for camera calibration and correction

Camera or lens-based detector calibration is essential for spatial accuracy in applications like dimensional tomography, optical metrology, and computer vision. Many methods and software exist yet there is still a lack of approaches that achieve both high accuracy and robustness while being easy to use and capable of handling a wide range of distortions. Radial lens distortion is common in high-resolution X-ray detector optics used in parallel-beam tomography at synchrotrons. Achieving sub-pixel accuracy requires calibrating with an optical target image. Although methods for characterizing radial distortion are well established, acquired images often also include perspective distortion and optical center offset. Here, we present our approaches to individually characterize and correct both types of distortion using a single calibration image, implemented in the Discorpy software.

36 MATERIALS SCIENCE↗
DOE OSTI2023

coloring v.1.0

SAND2024-02435O The software coloring allows applications written in the C++ language to generate publication-quality 2D plots. Its functionality is similar to Microsoft Excel's chart functionality or the Python language's matplotlib package. The value of coloring is that it is written purely in C++ and thus can be compiled on systems where Python is not available and linked into high performance computing software. For drawing shapes onto an image, coloring uses the mathematical definition of quadratic Bezier splines and uses Newton's method to search for the closest point on a spline to a given query point. This is then used to do accurate sub-pixel sampling to get clean, non-pixelated images. For working with the actual plot data, coloring has basic statistical methods such as finding maxima and minima as well as axis scaling such as logarithms. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ibanez, Daniel↗
DOE OSTI2020

Radar Super Resolution using a Deep Convolutional Neural Network

Super-resolution involves synthetically increasing the resolution of gridded data beyond its native resolution. Typically, this is done using interpolation schemes, which estimate sub-grid scale values from neighboring data, and perform the same operation everywhere regardless of the large-scale context, or by requiring a network of radars with overlapping fields of view. Recently, significant progress has been made in single image super resolution using convolutional neural networks. Conceptually, a neural network may be able to learn relations between large scale precipitation features and the associated sub-pixel scale variability and outperform interpolation schemes. Here, we use a deep convolutional neural network to artificially enhance the resolution of NEXRAD PPI scans. The model is trained on 6-months of reflectivity observations from the Langley Hill WA (KLGX) radar, and we find that it substantially outperforms common interpolation schemes for x4 and x8 resolution increases based on several objective error and perceptual quality metrics.

radar, machine learning, super resolution, Remote ↗
DOE OSTI2022

Assessment of the Imaging Properties of Plastic Scintillators at FP60R for Neutron Imaging Applications [Slides]

4mm thick Stilbene gives the brightest signal but at the cost of resolution. 1 and 2 cm BC412 gave the highest resolution images. The HI-LY scintillator is better suited for DD neutrons. Future work includes: measurements this summer using an event-mode imaging camera which promises sub-pixel resolution through center-of-mass techniques, opportunities for DD neutron tests during laser-driven z-pinch experiments at UNR, and assess scatter within scintillator.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Unrolled Video Super-Resolution Network with Autoregressive Prior for the Case of Known Motion

Real-time detection and classification of distant objects is necessary for many national security applications. However, when objects are far from the sensor, they occupy only a small number of pixels in the captured video, limiting the amount of visual detail available for recognition. State-of-the-art classification methods typically rely on high-resolution (HR) video streams to capture characteristic object features, but obtaining such detail is challenging for distant objects that occupy only a few pixels. This motivates the development of video super-resolution (VSR) methods that enhance object classification by recovering fine details from low-pixel representations. Current VSR methods rely either on model-based optimization, which is interpretable but computationally expensive, or on learning-based approaches, which are efficient and high-performing but often lack flexibility and interpretability. In this report, we propose an end-to-end trainable unrolled VSR network, UVSRNet, which super-resolves each frame in a video by exploiting sub-pixel motion between neighboring low-resolution (LR) frames as well as incorporating high-frequency detail from previously super-resolved frames. In particular, by unrolling a plug-and-play (PnP) half-quadratic splitting (HQS) algorithm, we leverage a model-based data-fitting module alongside a learning-based autoregressive prior module. This combination yields a method that maintains the flexibility and interpretability of model-based methods while achieving the performance advantages of learning-based methods.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus ‘super-resolution’). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path towards ultrafast high-resolution multi-modal radiographic imaging and tomography applications.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Deep Learning Classification of Cheatgrass Invasion in the Western United States Using Biophysical and Remote Sensing Data

Cheatgrass (Bromus tectorum) invasion is driving an emerging cycle of increased fire frequency and irreversible loss of wildlife habitat in the western US. Yet, detailed spatial information about its occurrence is still lacking for much of its presumably invaded range. Deep learning (DL) has demonstrated success for remote sensing applications but is less tested on more challenging tasks like identifying biological invasions using sub-pixel phenomena. We compare two DL architectures and the more conventional Random Forest and Logistic Regression methods to improve upon a previous effort to map cheatgrass occurrence at >2% canopy cover. High-dimensional sets of biophysical, MODIS, and Landsat-7 ETM+ predictor variables are also compared to evaluate different multi-modal data strategies. All model configurations improved results relative to the case study and accuracy generally improved by combining data from both sensors with biophysical data. Cheatgrass occurrence is mapped at 30 m ground sample distance (GSD) with an estimated 78.1% accuracy, compared to 250-m GSD and 71% map accuracy in the case study. Furthermore, DL is shown to be competitive with well-established machine learning methods in a limited data regime, suggesting it can be an effective tool for mapping biological invasions and more broadly for multi-modal remote sensing applications.

54 ENVIRONMENTAL SCIENCES↗