Search NASA⌕ Search

SEARCH · Search NASA

Results for “image compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis↗
DOE OSTI2024

Integrated photonic encoder for low power and high-speed image processing

Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Zero-Power Analog Optical Processing

The motivation behind this research is the growing challenge of handling the massive amounts of data generated by modern imaging systems. Conventional digital image processing techniques are struggling to keep pace with the demands of high-resolution and high-speed imaging systems for remote sensing due to their high-power consumption and data storage requirements. We present a novel approach based on analog photonics to address this challenge. The proposed system utilizes a silicon-photonics-based image encoder positioned after image formation and initial optical-to-electrical conversion. The photonic encoder compresses image data using a passive disordered photonic structure to perform kernel-type random projections of the raw data. The compressed data is then processed by a back-end neural network, which reconstructs the original image with high fidelity (structural similarity exceeding 90%). Our proposed approach has the potential to compress images with ~ 1000X lower power consumption compared to digital approaches with data rates exceeding 1 terapixel/second.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Best Practices for Measuring the Modulation Transfer Function of Video Endoscopes

Endoscopes are crucial for assisting in surgery and disease diagnosis, including the early detection of cancer. The effective use of endoscopes relies on their optical performance, which can be characterized with a series of metrics such as resolution, vital for revealing anatomical details. The modulation transfer function (MTF) is a key metric for evaluating endoscope resolution. However, the 2020 version of the ISO 8600-5 standard, while introducing an endoscope MTF measurement method, lacks empirical validation and excludes opto-electronic video endoscopes, the largest family of endoscopes. Measuring the MTF of video endoscopes requires tailored standards that address their unique characteristics. This paper aims to expand the scope of ISO 8600-5:2020 to include video endoscopes, by optimizing the MTF test method and addressing parameters affecting measurement accuracy. We studied the effects of intensity and uniformity of image luminance, chart modulation compensation, linearity of image digital values, auto gain control, image enhancement, image compression and the region of interest dimensions on images of slanted-edge test charts, and thus the MTF based on these images. By analyzing these effects, we provided recommendations for setting and controlling these factors to obtain accurate MTF curves. Our goal is to enhance the standard’s relevance and effectiveness for measuring the MTF of a broader range of endoscopic devices, with potential applications in the MTF measurement of other digital imaging devices.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Data-Driven Compression of Electron-Phonon Interactions

First-principles calculations of electron interactions in materials have seen rapid progress in recent years, with electron-phonon ( e − ph ) interactions being a prime example. However, these techniques use large matrices encoding the interactions on dense momentum grids, which reduces computational efficiency and obscures interpretability. For e − ph interactions, existing interpolation techniques leverage locality in real space, but the high dimensionality of the data remains a bottleneck to balance cost and accuracy. Here we show an efficient way to compress e − ph interactions based on singular value decomposition (SVD), a widely used matrix and image compression technique. Leveraging (un)constrained SVD methods, we accurately predict material properties related to e − ph interactions—including charge mobility, spin relaxation times, band renormalization, and superconducting critical temperature—while using only a small fraction (1%–2%) of the interaction data. These findings unveil the hidden low-dimensional nature of e − ph interactions. Furthermore, they accelerate state-of-the-art first-principles e − ph calculations by about 2 orders of magnitude without sacrificing accuracy. Our Pareto-optimal parametrization of e − ph interactions can be readily generalized to electron-electron and electron-defect interactions, as well as to other couplings, advancing quantitative studies of condensed matter. Published by the American Physical Society 2024

Physics↗
DOE OSTI2024

Concurrent measurement of strain and chemical reaction rates in a calcite grain pack undergoing pressure solution: Evidence for surface-reaction controlled dissolution

Pressure solution is inferred to be a significant contributor to sediment compaction and lithification, especially in carbonate sediments. For a sediment deforming primarily by pressure solution, the compaction rate should be directly related to the rate of calcite dissolution, transport along grain contacts, and calcite reprecipitation. Previous experimental work has shown that there is evidence that deformation in wet calcite grain packs is consistent with control by pressure solution, but considerable ambiguity remains regarding the rate limiting mechanism. We present the results of laboratory compaction experiments designed to directly measure calcite dissolution and precipitation rates (recrystallization rates) concurrently with strain rate to test whether measured rates are consistent with predicted rates both in absolute magnitude and time evolution. Recrystallization rates are measured using trace element chemistry (Sr/Ca, Mg/Ca) and isotopes (87Sr/86Sr) of fluids flowing slowly through a compacting grain pack as it is being triaxially compressed. Imaging techniques are used to characterize the grain contacts and strain effects in the post-experiment grain pack. Our data show that calcite recrystallization rates calculated from all three geochemical parameters are in approximate agreement and that the rates closely track strain rate. The geochemically inferred rates are close to predicted rates in absolute magnitude. Uncertainty in grain contact dimensions makes distinguishing between surface reaction control and diffusion control difficult. Measured reaction rates decrease faster than predicted from standard pressure solution creep flow laws. This inconsistency may indicate that calcite dissolution rates at grain contacts are more complex, and more time-dependent, than suggested by geometric models designed to predict grain contact stresses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2019

Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the Brookhaven National Laboratory (BNL) TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2019. Images were captured from early spring (4 April) through to mid fall (30 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour, then from 2019-06-27 to 2019-10-02 images were recorded every 10 minutes, then at hourly intervals until the end of data collection on 2019-10-30. Files were renamed with the date and time of the image. jpg images have been compressed in *.tar.gz format (5.6 GB). Closer fields of view (northeasterly) were also captured using 4 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. These cameras were operated from 2019-06-23 to 2019-09-25, with images recorded every 30 minutes from 9:00 to 16:30 Alaska daylight time (AKDT, UTC-8). Individual jpg images have been compressed in zip format for each camera and also presented as mp4 timelapse movies.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2018

Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the BNL TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2018. Images were captured from early spring (13 April) through to mid fall (18 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour until 16 June, and then every 10 minutes. Files were renamed with the date and time of the image. jpg images have been compressed in *.tar.gz format (7.9 GB). Different fields of view (northeasterly) were also captured using 3 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. Images were recorded from 21 June to 24 September, 2018, at 30 minute intervals, from 11:00 - 14:30, Alaska daylight time (AKDT, UTC-8). Movie files (.mp4) of each Wingscapes camera dataset. Additional metadata included in *.pdf and *.csv files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗
DOE OSTI2025

Multiphoton and Harmonic Imaging of Microarchitected Materials

Microadditive manufacturing has revolutionized the production of complex, nano- to microscale components across various fields. This work investigates two-photon (2P) and three-photon (3P) fluorescence imaging, as well as third-harmonic generation (THG) microscopy, to examine periodic microarchitected lattice structures fabricated using multiphoton lithography (MPL). By immersing the structures in refractive index matching fluids, we demonstrate high-fidelity 3D reconstructions of both fluorescent structures using 2P and 3P microscopy as well as low-fluorescence structures using THG microscopy. These results show that multiphoton fluorescence (MPF) imaging offers reduced signal decay with respect to depth compared to single-photon techniques in the examined structures. We further demonstrate the ability to nondestructively identify intentional internal modifications of the structure that are not immediately visible with scanning electron microscope (SEM) images and compression-induced fractures, highlighting the potential of these techniques for quality control and defect detection in microadditively manufactured components.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Optimising the processing and storage of visibilities using lossy compression

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.

Techniques: interferometric↗
DOE OSTI2024

Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2017

Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Barrow (now Utqiagvik), Alaska. The camera was installed to remotely monitor plant phenology and operation of the BNL TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2017. Images were captured from early spring (24 April) through to late fall (15 November). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every 10 minutes. jpg images have been compressed in *.tar.gz format (12.1 GB) and additional information in *.pdf and *.txt files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Calibration and characterization of the line-VISAR diagnostic at the HED-HIBEF instrument at the European XFEL

In dynamic-compression experiments, the line-imaging Velocity Interferometer System for Any Reflector (VISAR) is a well-established diagnostic used to probe the velocity history, including wave profiles derived from dynamically compressed interfaces and wavefronts, depending on material optical properties. Knowledge of the velocity history allows for the determination of the pressure achieved during compression. Such a VISAR analysis is often based on Fourier transform techniques and assumes that the recorded interferograms are free from image distortions. In this paper, we describe the VISAR diagnostic installed at the HED-HIBEF instrument located at the European XFEL along with its calibration and characterization. It comprises a two-color (532, 1064 nm), three-arm (with three velocity sensitivities) line imaging system. We provide a procedure to correct VISAR images for geometric distortions and evaluate the performance of the system using Fourier analysis. We finally discuss the spatial and temporal calibrations of the diagnostic. As an example, we compare the pressure extracted from the VISAR analysis of shock-compressed polyimide and silicon.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Distributed Tomographic Reconstruction with Quantization

Conventional tomographic reconstruction typically depends on centralized servers for both data storage and computation, leading to concerns about memory limitations and data privacy. Distributed reconstruction algorithms mitigate these issues by partitioning data across multiple nodes, reducing server load and enhancing privacy. However, these algorithms often encounter challenges related to memory constraints and communication overhead between nodes. In this paper, we introduce a decentralized Alternating Directions Method of Multipliers (ADMM) with configurable quantization. By distributing local objectives across nodes, our approach is highly scalable and can efficiently reconstruct images while adapting to available resources. To overcome communication bottlenecks, we propose two quantization techniques based on K-means clustering and JPEG compression. Numerical experiments with benchmark images illustrate the tradeoffs between communication efficiency, memory use, and reconstruction accuracy.

Miao, Runxuan↗