Search NASA⌕ Search

SEARCH · Search NASA

Results for “image deconvolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Image Deconvolution and Point-spread Function Reconstruction with STARRED: A Wavelet-based Two-channel Method Optimized for Light-curve Extraction

We present starred, a point-spread function (PSF) reconstruction, two-channel deconvolution, and light-curve extraction method designed for high-precision photometric measurements in imaging time series. An improved resolution of the data is targeted rather than an infinite one, thereby minimizing deconvolution artifacts. In addition, starred performs a joint deconvolution of all available data, accounting for epoch-to-epoch variations of the PSF and decomposing the resulting deconvolved image into a point source and an extended source channel. The output is a high-signal-to-noise-ratio, high-resolution frame combining all data and the photometry of all point sources in the field of view as a function of time. Of note, starred also provides exquisite PSF models for each data frame. We showcase three applications of starred in the context of the imminent LSST survey and of JWST imaging: (i) the extraction of supernovae light curves and the scene representation of their host galaxy; (ii) the extraction of lensed quasar light curves for time-delay cosmography; and (iii) the measurement of the spectral energy distribution of globular clusters in the "Sparkler," a galaxy at redshift z = 1.378 strongly lensed by the galaxy cluster SMACS J0723.3-7327. starred is implemented in jax, leveraging automatic differentiation and graphics processing unit acceleration. This enables the rapid processing of large time-domain data sets, positioning the method as a powerful tool for extracting light curves from the multitude of lensed or unlensed variable and transient objects in the Rubin-LSST data, even when blended with intervening objects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Scattered–light–sheet microscopy with sub–cellular resolving power

Since its first demonstration over 100 years ago, scattering-based light-sheet microscopy has recently re-emerged as a key modality in label-free tissue imaging and cellular morphometry; however, scattering-based light-sheet imaging with subcellular resolution remains an unmet target to date. This is because related approaches inevitably superimpose speckle or granular intensity modulation on to the native subcellular features. Here, we addressed this challenge by deploying a time-averaged pseudo-thermalized light-sheet illumination. While pseudo-thermalizing the illumination sheet increased its lateral dimensions, we achieved subcellular resolving power at ultralow irradiance levels after image deconvolution. We validated this approach by imaging cytosolic carbon depots in yeast and bacteria with increased specificity and no staining. Altogether, we expect this scattering-based light-sheet microscopy approach will advance live single-cell imaging investigations by conferring low-irradiance and label-free operation towards eradicating phototoxicity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Point spread function deconvolution using a convolutional autoencoder

A major issue in optical astronomical image analysis is the combined effect of the instrument’s point spread function (PSF) and the atmospheric seeing that blurs images and changes their shape in a way that is band and time-of-observation dependent. In this work we present a very simple neural network based approach to nonblind image deconvolution that relies on feeding a convolutional autoencoder (CAE) input images that have been preprocessed by convolution with the corresponding PSF and its regularized inverse, a method which is both conceptually simple and computationally less intensive. We also present here, a new approach for dealing with limited input dynamic range of neural networks compared to the dynamic range present in astronomical images.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Quantifying concentration distributions in redox flow batteries with neutron radiography

Abstract The continued advancement of electrochemical technologies requires an increasingly detailed understanding of the microscopic processes that control their performance, inspiring the development of new multi-modal diagnostic techniques. Here, we introduce a neutron imaging approach to enable the quantification of spatial and temporal variations in species concentrations within an operating redox flow cell. Specifically, we leverage the high attenuation of redox-active organic materials (high hydrogen content) and supporting electrolytes (boron-containing) in solution and perform subtractive neutron imaging of active species and supporting electrolyte. To resolve the concentration profiles across the electrodes, we employ an in-plane imaging configuration and correlate the concentration profiles to cell performance with polarization experiments under different operating conditions. Finally, we use time-of-flight neutron imaging to deconvolute concentrations of active species and supporting electrolyte during operation. Using this approach, we evaluate the influence of cell polarity, voltage bias and flow rate on the concentration distribution within the flow cell and correlate these with the macroscopic performance, thus obtaining an unprecedented level of insight into reactive mass transport. Ultimately, this diagnostic technique can be applied to a range of (electro)chemical technologies and may accelerate the development of new materials and reactor designs.

Science & Technology - Other Topics↗
DOE OSTI2021

Vector elastic deconvolution migration with dual wavefield decomposition

Here, we report elastic-wave imaging using multicomponent data can provide more useful subsurface information than acoustic-wave imaging, but it is usually algorithmically challenging. We have developed a vector elastic deconvolution migration method for high-resolution imaging of subsurface structures in isotropic and anisotropic elastic media. Our new method uses a vector deconvolution imaging condition based on dual wavefield decomposition, including an explicit directional wavefield separation using the Hilbert transform and a P/S vector wavefield decomposition using the low-rank decomposition method. Using three elastic models, we numerically determine that our new method produces notably higher resolution and more amplitude-balanced elastic images compared with a crosscorrelation-based vector elastic reverse time migration method.

58 GEOSCIENCES↗
DOE OSTI2024

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Super-resolution computational saturated absorption microscopy

Imaging beyond the diffraction limit barrier has attracted wide attention due to the ability to resolve previously hidden image features. Of the various super-resolution microscopy techniques available, a particularly simple method called saturated excitation microscopy (SAX) requires only simple modification of a laser scanning microscope: The illumination beam power is sinusoidally modulated and driven into saturation. SAX images are extracted from the harmonics of the modulation frequency and exhibit improved spatial resolution. Unfortunately, this elegant strategy is hindered by the incursion of shot noise that prevents high-resolution imaging in many realistic scenarios. Here, we demonstrate a technique for super-resolution imaging that we call computational saturated absorption (CSA) in which a joint deconvolution is applied to a set of images with diversity in spatial frequency support among the point spread functions (PSFs) used in the image formation with saturated laser scanning fluorescence microscopy. CSA microscopy allows access to the high spatial frequency diversity in a set of saturated effective PSFs, while avoiding image degradation from shot noise.

Murray, Gabe (ORCID:0000000295655485)↗
DOE OSTI2024

Deep learning-based temporal deconvolution for photon time-of-flight distribution retrieval

The acquisition of the time of flight (ToF) of photons has found numerous applications in the biomedical field. Over the last decades, a few strategies have been proposed to deconvolve the temporal instrument response function (IRF) that distorts the experimental time-resolved data. However, these methods require burdensome computational strategies and regularization terms to mitigate noise contributions. Herein, we propose a deep learning model specifically to perform the deconvolution task in fluorescence lifetime imaging (FLI). The model is trained and validated with representative simulated FLI data with the goal of retrieving the true photon ToF distribution. Its performance and robustness are validated with well-controlled in vitro experiments using three time-resolved imaging modalities with markedly different temporal IRFs. The model aptitude is further established with in vivo preclinical investigation. Overall, these in vitro and in vivo validations demonstrate the flexibility and accuracy of deep learning model-based deconvolution in time-resolved FLI and diffuse optical imaging.

Pandey, Vikas (ORCID:0000000154771095)↗
DOE OSTI2022

Colorectal Cancer Metastases in the Liver Establish Immunosuppressive Spatial Networking between Tumor-Associated SPP1 + Macrophages and Fibroblasts

Abstract Purpose: The liver is the most frequent metastatic site for colorectal cancer. Its microenvironment is modified to provide a niche that is conducive for colorectal cancer cell growth. This study focused on characterizing the cellular changes in the metastatic colorectal cancer (mCRC) liver tumor microenvironment (TME). Experimental Design: We analyzed a series of microsatellite stable (MSS) mCRCs to the liver, paired normal liver tissue, and peripheral blood mononuclear cells using single-cell RNA sequencing (scRNA-seq). We validated our findings using multiplexed spatial imaging and bulk gene expression with cell deconvolution. Results: We identified TME-specific SPP1-expressing macrophages with altered metabolism features, foam cell characteristics, and increased activity in extracellular matrix (ECM) organization. SPP1+ macrophages and fibroblasts expressed complementary ligand–receptor pairs with the potential to mutually influence their gene-expression programs. TME lacked dysfunctional CD8 T cells and contained regulatory T cells, indicative of immunosuppression. Spatial imaging validated these cell states in the TME. Moreover, TME macrophages and fibroblasts had close spatial proximity, which is a requirement for intercellular communication and networking. In an independent cohort of mCRCs in the liver, we confirmed the presence of SPP1+ macrophages and fibroblasts using gene-expression data. An increased proportion of TME fibroblasts was associated with the worst prognosis in these patients. Conclusions: We demonstrated that mCRC in the liver is characterized by transcriptional alterations of macrophages in the TME. Intercellular networking between macrophages and fibroblasts supports colorectal cancer growth in the immunosuppressed metastatic niche in the liver. These features can be used to target immune-checkpoint–resistant MSS tumors.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Three Photon Excited Image Scanning Microscopy for in-Depth Super-Resolution Studies of Biological Samples

Multiphoton laser scanning microscopy is a powerful tool for deep imaging of thick biological samples. Image scanning microscopy (ISM) has demonstrated significant improvements in the signal-to-noise ratio in confocal laser scanning microscopy, while at the same time improving upon the effectively attainable resolution. Two-photon excitation (2PE), combined with ISM, has been shown to allow for deep tissue imaging with enhanced resolution compared to 2PE microscopy. Three-photon excitation (3PE) has enabled record imaging depth and contrast for multiphoton imaging, due to the superior suppression of out-of-focus signal generation. In this paper, we demonstrate super-resolution 3PE ISM. This is achieved using a single-photon avalanche detector array, and 1040-nm pulses for 3PE of blue fluorescence. This method enables subdiffraction limited resolution imaging of biological samples stained with blue fluorescent markers, such as mouse myocardial and spinal cord tissues stained with 4 ′ , 6 -diamidino-2-phenylindole. Deconvolution improves the resolving power further and allows for imaging with better than λ / 8 resolution with respect to the 3PE wavelength λ . With the ISM pixel reassignment procedure, we demonstrate a resolution enhancement of ∼ 1.6 laterally, compared to the resolution attained using a photomultiplier tube in a non-descanned detection arrangement, and a factor of ∼ 1.8 enhancement in axial resolution. The experimentally measured three-dimensional point spread function volume is shrunk ∼ 4.4 -fold, which is close to the theoretically expected enhancement. Published by the American Physical Society 2024

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Optimising the processing and storage of visibilities using lossy compression

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.

Techniques: interferometric↗
DOE OSTI2022

Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning

ABSTRACT In this work, we explore the possibility of applying machine learning methods designed for 1D problems to the task of galaxy image classification. The algorithms used for image classification typically rely on multiple costly steps, such as the point spread function deconvolution and the training and application of complex Convolutional Neural Networks of thousands or even millions of parameters. In our approach, we extract features from the galaxy images by analysing the elliptical isophotes in their light distribution and collect the information in a sequence. The sequences obtained with this method present definite features allowing a direct distinction between galaxy types. Then, we train and classify the sequences with machine learning algorithms, designed through the platform Modulos AutoML. As a demonstration of this method, we use the second public release of the Dark Energy Survey (DES DR2). We show that we are able to successfully distinguish between early-type and late-type galaxies, for images with signal-to-noise ratio greater than 300. This yields an accuracy of $86{{\ \rm per\ cent}}$ for the early-type galaxies and $93{{\ \rm per\ cent}}$ for the late-type galaxies, which is on par with most contemporary automated image classification approaches. The data dimensionality reduction of our novel method implies a significant lowering in computational cost of classification. In the perspective of future data sets obtained with e.g. Euclid and the Vera Rubin Observatory, this work represents a path towards using a well-tested and widely used platform from industry in efficiently tackling galaxy classification problems at the peta-byte scale.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Image processing tools for petabyte-scale light sheet microscopy data

Light sheet microscopy is a powerful technique for high-speed three-dimensional imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present PetaKit5D, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are optimized for memory and performance. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson–Lucy deconvolution and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Stellar Population Properties in the Stellar Streams around SPRC047

Abstract We have investigated the properties (e.g., age, metallicity) of the stellar populations of a ringlike tidal stellar stream (or streams) around the edge-on galaxy SPRC047 (z= 0.031) using spectral energy distribution (SED) fits to integrated broadband aperture flux densities. We used visual images in six different bands and Spitzer/IRAC 3.6μm data. We have attempted to derive best-fit stellar population parameters (metallicity, age) in three noncontiguous segments of the stream. Due to the very low surface brightness of the stream, we have performed a deconvolution with a Richardson–Lucy–type algorithm of the low spatial resolution 3.6μm IRAC image, thereby reducing the effect of the point-spread function aliasedemissionfrom the bright edge-on central galaxy at the locations of our three stream segments. Our SED fits that used several different star formation (SF) history priors, from an exponentially decaying SF burst to continuous SF, indicate that the age–metallicity–dust degeneracy is not resolved, most likely because of inadequate wavelength coverage and low signal-to-noise ratios of the low surface brightness features. We also discuss how future deep visual–near-infrared observations, combined with absolute flux calibration uncertainties at or below the 1% level, complemented by equally well absolute flux-calibrated observations in ultraviolet and mid-infrared bands, would improve the accuracy of broadband SED fitting results for low surface brightness targets, such as stellar streams around nearby galaxies that are not resolved into stars.

Astronomy & Astrophysics↗
DOE OSTI2025

Scatter and Blur Corrections for High-Energy X-Ray Radiography

High-energy X-ray radiography is useful as a highly penetrating method for imaging through dense materials. However, the primary modes of interaction of X-rays at these energies involve scattering or the production of secondary high-energy photons, which can interfere with the image. In addition, detector blurring, often resulting from scatter within the detector, can reduce image sharpness. Both of these processes can be mitigated with the use of convolution kernels, with the main challenge being that the proper kernel to use is not known, particularly for the scatter contribution. By radiographing solid slabs of uniform attenuation, we show that point spread functions and material-specific point scatter functions can be determined to significantly reduce the effect of detector blurring and object scatter. Constraining the fits to the slabs and uniform transmission within the slabs is sufficient to recover these functions. A functional form that reproduces the angular distribution of high-energy bremsstrahlung X-rays is presented for recovering point scatter functions. In conclusion, the method is applied to radiographs of objects from bremsstrahlung X-ray sources operating at 4- and 7.5-MV endpoint energies and a significant increase in sharpness is observed.

Blind deconvolution↗
DOE OSTI2023

Single-Filament Imaging Mass Spectrometry Lipidomics in Arthrospira platensis

Elucidating intra-organismal biochemical and lipid organization in photosynthetic biological cell factories of filamentous cyanobacteria, i.e., Arthrospira platensis (Spirulina), is important to track physiological response mechanisms during growth. Little is known about the filaments' biochemical organization and cellular structure and no label-free imaging techniques exist that provide molecular mapping. We applied ultra-high resolution mass spectrometry (7T FT-ICR-MS) matrix-assisted laser desorption ionization (MALDI) imaging to immobilized Spirulina filaments to investigate the localization of lipids across distinct physiological regions. We optimized matrix selection and deposition methods with the goal of facilitating high spatial, and intra-filament, resolution using untargeted multivariate statistical spectral deconvolution across MS pixels. Our results demonstrate an improved two step application with an optimized procedure for intra-organismal lipid profiling to improve analyte sensitivity and achieve higher spatial resolution, whereby we evaluate three conventional matrices 2,5-dihydroxybenzoic acid (DHB), a 9:1 ratio of DHB:superDHB (sDHB), 1,5- diaminonaphthalene (DAN) and a 50:50 mix of DHB:sDHB and compare delineation and pixel-based elucidation of intra-filament lipidomics. We identified a total of 1,626 features that could be putatively assigned a lipid-like formula based on database query and 46 unique features, with associated lipid assignments that were significantly distinct in their intra-filament location. MALDI- imaging MS with untargeted statistical spectral deconvolution was used to visualize intra-filament lipidomics organization in Spirulina filaments. Improvements in matrix deposition, including sequential sublimation and pneumatic spraying, increased signal abundance at high spatial resolution and allowed for identification of distinct lipid composition regions. Here in this work outlines a methodology that may be used for micro-ecological untargeted molecular phenotyping.

09 BIOMASS FUELS↗