Search NASA⌕ Search

SEARCH · Search NASA

Results for “compression algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Assessing the Effects of Data Compression in Simulations Using Physically Motivated Metrics

This paper examines whether lossy compression can be used effectively in physics simulations as a possible strategy to combat the expected data-movement bottleneck in future high performance computing architectures. We show that, for the codes and simulations we tested, compression levels of 3–5X can be applied without causing significant changes to important physical quantities. Rather than applying signal processing error metrics, we utilize physics-based metrics appropriate for each code to assess the impact of compression. We evaluate three different simulation codes: a Lagrangian shock-hydrodynamics code, an Eulerian higher-order hydrodynamics turbulence modeling code, and an Eulerian coupled laser-plasma interaction code. We compress relevant quantities after each time-step to approximate the effects of tightly coupled compression and study the compression rates to estimate memory and disk-bandwidth reduction. We find that the error characteristics of compression algorithms must be carefully considered in the context of the underlying physics being modeled.

Laney, Daniel↗

MrHyDE v.1.0

SAND2024-01324O MrHyDE, which stands for Multi-resolution Hybridized Differential Equations, is a general-purpose C++ package for the solution of coupled multiphysics and multiscale systems on massively parallel computing systems. MrHyDE is designed to enable moving beyond forward simulation for multiscale applications which includes optimization, control, uncertainty quantification, and stochastic inversion. The framework provides interfaces to several packages within the Trilinos framework and leverages automatic differentiation to enable adjoint capabilities for large-scale, gradient-based optimization. MrHyDE provides automated multiscale capabilities through a subgrid model interface and multiscale Dirichlet-to-Neumann maps. For extreme-scale applications, MrHyDE provides in situ data-compression algorithms to reduce memory requirements while maintaining performance. MrHyDE is a general-purpose, computational framework for the solution of multiscale and multiphysics applications. It uses a combination of structure-preserving, physics-compatible discretizations, fully implicit methods, multi-resolution schemes, or fully explicit methods. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗

The Center for Momentum Transport and Flow Organization in Plasmas - Final Scientific Report

Overview of University of Colorado Efforts: The University of Colorado group has focused on two primary fronts during the grant period: development of a variety of multi-point diagnostic and/or imaging analysis techniques, and momentum-transport related experiments on a variety of devices (NSTX at PPPL, CSDX at UCSD, LAPD at UCLA, DIII-D at GA). Experimental work has taken advantage of several diagnostic instruments, including fast-framing cameras for imaging of electron density fluctuations (either directly or using injected gas puffs), ECEI for imaging of electron temperature fluctuations, and multi-tipped Langmuir and magnetic probes for corroborating measurements of Reynolds and Maxwell stresses. Mode Characterization in CSDX: We have performed a series of experiments at the CSDX linear device at UCSD, in collaboration with Center PI G. Tynan's group. The experiments included a detailed study of velocity estimation techniques, including direct comparisons between Langmuir probes and image-based velocimetry from fast-framing camera data. We used the camera data in a second set of studies to identify the spatial and spectral structure of coherent modes, which illuminates wave behavior to a level of detail previously unavailable, and enables direct comparison of dispersion curves to theoretical estimates. In another CSDX study, similar techniques were used to demonstrate a controlled transition from nonlinearly coupled discrete eigenmodes to fully developed broadband turbulence. The axial magnetic field was varied from 40-240 mT, which drove the transition. At low magnetic fields, the plasma is dominated by drift waves. As the magnetic field is increased, a strong potential gradient at the edge introduces an ExB shear-driven instability. At the transition, another mode with signatures of a rotation-induced Rayleigh–Taylor instability appears at the central plasma region. Concurrently, large axial velocities were found in the plasma core. For larger magnetic fields, all of the instabilities co-exist, leading to rich plasma dynamics and fully developed broadband turbulence. Edge-Turbulence and Flow Experiments in NSTX: A series of Gas Puff Imaging (GPI) observations on NSTX revealed a quasi-periodic oscillation in the plasma edge preceding the L-H transition in a limited set of neutral beam heated plasmas. These ~3 kHz flow oscillations exhibit both long wavelength and long correlation lengths, suggesting they are zonal-flow-like. The flow oscillations are strongly correlated with modulations of the level of edge turbulence, thus the system appears to undergo a predator--prey-type limit-cycle preceding the L-H transition. However, a clear trigger for the L-H transition was not observed. Reynolds stress profiles were obtained directly from image velocimetry for L-mode periods ELM-Precursor Studies in NSTX: A separate study based on NSTX-GPI data captured the two-dimensional evolution of edge-localized mode (ELM) precursors. Precursor events were observed preceding ELMs and ELM-induced H–L back-transitions in radio-frequency heated H-mode plasmas, and the growth of the precursor mode through the ELM filamentation was imaged in the plane perpendicular to the local B-field. Strong edge intensity modulations appeared to propagate in the electron diamagnetic direction while steadily drifting radially outwards. Intensity fluctuations were observed at frequencies around 20 kHz and wavenumbers of 0.05-0.2 cm -1 . Upon growing to a trigger point, precursor fluctuations were seen to form filamentary structures and move into the scrape-off layer (SOL) explosively with radial velocities peaking at 8 km/s. Once in the SOL, filaments reverse their propagation direction and travel in the ion diamagnetic direction. Edge intensity fluctuations were strongly correlated with magnetic signals from Mirnov coils, and toroidally distributed coils estimated toroidal mode numbers of n=5-10. Quantitatively similar precursors have been observed in ohmic H-mode plasmas as well, though significantly fewer events are seen in the ohmic cases and none were observed in the near-threshold NBI H-modes studied. Development of Velocimetry and Image Analysis Techniques: Along with the experiments listed above, the Colorado group has continued to explore various velocimetry techniques and their range of validity. We have developed a “linear optical flow” code, which calculates smooth velocity maps while accurately assessing local regions of high curl. This is critical for separating spatial scales of velocity behavior, and thus transport. This code has recently come on-line, and we are currently using it to revisit a number of older datasets. Additionally, we have worked on developing pattern-recognition techniques for imaging diagnostics, based on established digital image compression algorithms. This has the potential to open the analysis of turbulent plasma behavior beyond the well-trodden Fourier and wavelet approaches. Finally, we have extended several of these image-analysis routines to multiple other diagnostic sets, including GPI datasets in NSTX and ECEI imaging on DIII-D. In one study, correlation maps were used to measure the full 2-D mode structure of drift-wave level structures using ECEI for the first time. This enabled direct comparison to gyrokinetic simulations using the GEM code, from which is was determined that TEM modes were being measured in DIII-D.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Efficient Data Query for Gaussian Process Compressed Data through Value Range Estimation [Slides]

When the resolution of the data increases, data reduction methods are applied to simulation output, including Gaussian process, neural representation and compression algorithms. Lots of data analysis/visualization techniques requires data query, but data query from reduced representation is still challenging. This report will provide examples and provide possible answers to why data query from reduced representation is still challenging.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

TDD LoRa and Delta Encoding in Low-Power Networks of Environmental Sensor Arrays for Temperature and Deformation Monitoring: Supporting Data

This dataset was used to assess the performance of a compression algorithm for Soil Deformation and Temperature Monitoring data. The development of this technology is presented in the article named time division duplex (TDD) "TDD LoRa and Delta Encoding in Low-Power Networks of Environmental Sensor Arrays for Temperature and Deformation Monitoring" and published in Springer's Journal on Signal Processing Systems. [Time Division Duplex (TDD); Long Range (LoRa)]Field experiment data includes: 1) soil temperature measurements, 2) snow temperature data, 3) soil temperature and deformation data. In these files, the first column contains the time (UTC), followed by the sensor's battery voltage and temperature and acceleration values (X, Y, Z) in subsequent columns. The measurements were acquired every 15 minutes. Lists included for probe, datalogger, and packaging components. The two temperature data sets were acquired at a site at the East River Watershed, Colorado, while the temperature/deformation data were collected at the Teller Road (mile 27) site near Nome, Alaska. The package includes 8 comma-separated files (.csv) and one .pdf file.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

The development of machine technology processing for earth resource survey

The following technologies are considered for automatic processing of earth resources data: (1) registration of multispectral and multitemporal images, (2) digital image display systems, (3) data system parameter effects on satellite remote sensing systems, and (4) data compression techniques based on spectral redundancy. The importance of proper spectral band and compression algorithm selections is pointed out.

Landgrebe, D. A.↗

Flexible format, computer accessed telemetry system

With this system, it is possible to sample and generate two or more simultaneous formats; one can be transmitted to ground station in real time, and other is stored for later transmission. Sensor output comparison data, plus information to control format, compression algorithm, and allowable degree of sensor activity, are stored in memory.

Easton, R. A.↗

The question of the possibility of using Associative Computer Devices (ACD) for parallel adaptive discretization of multichannel telemetry information

The method of parallel adaptive discretization of data is considered the most promising and allows the effective compression algorithms to be used for high information-capacity radio telemetry systems. An associative computer device (ACD), i.e., parallel computers based on associative memory units (AMU), are recommended for realization of this method. A detailed discussion of the problems of application of AMU is followed by description of a particular ACD and its recommended use.

Kantor, A. V.↗

An advanced imaging communication system for planetary exploration

An advanced imaging communication system (AICS) for planetary exploration is presented. The system offers 'end-to-end' information rate improvements of 3 to 5 times over existing systems in addition to extensive user flexibility to adapt his rate/fidelity priorities to fit a particular mission. AICS contains two major system elements. The first is a concatenated Reed-Solomon/Viterbi coded channel. This provides a powerful, yet practical, solution to the usual 'error vulnerability' problem associated with compressed data. The second major element is an extremely adaptive image data compression algorithm called RM2. The details of this algorithm as presently simulated are discussed in considerable detail. Used in conjunction with the virtually error free performance of the Reed-Solomon/Viterbi channel the stated AICS advantages are obtained.

Rice, R. F.↗

Pioneer Venus Sounder Probe Neutral Gas Mass Spectrometer

A neutral gas mass spectrometer was flown to Venus as part of the Pioneer Venus Multiprobe to measure the composition of its lower atmosphere. The instrument, mounted in the Sounder Probe, was activated after the probe entered the top of the atmosphere, and it obtained data during the descent from 62 km to the surface. Atmospheric gases were sampled through a pair of microleaks, the effluent from which was pumped by a combination of ion and getter pumping. A pneumatically operated valve, controlled by the ambient atmospheric pressure, maintained the ion source pressure at a nearly constant value during descent while the atmospheric pressure varied by three orders of magnitude. A single focusing magnetic sector field mass spectrometer with mass resolution sufficient to reasonably separate argon from C3H4 at 40 amu provided the mass analysis and relative abundance measurements. A microprocessor controlled the operation of the mass spectrometer through a highly efficient peak-tip stepping routine and data compression algorithm that effected a scan of the mass spectrum from 1 to 208 amu in 64 sec while requiring an information rate of only 40 bits/sec to return the data to earth. A subscale height altitude resolution was thus obtained. Weight, size, and power requirements were minimized to be consistent with interplanetary flight contraints.

Hoffman, J. H.↗

A concept for dynamic control of RPV information system parameters

A globally adaptive image compression structure has been developed for use in the tactical environment of a remotely piloted vehicle. The control structure is based on an image compression algorithm RM2 but can be easily extended to standard algorithms. It is shown that this structure provides an operator with the flexibility to dynamically maximize the usefulness of a limited and changing bit rate and should significantly improve overall system performance in tactical environments.

Rice, R. F.↗

Analysis of AIS Data of the Recluse Oil Field, Recluse, Wyoming

Airborne Imaging Spectrometer (AIS) data were flown over the Recluse, Wyoming oil field on September 9, 1984. Processing software was developed at Earth Satellite Corporation (EarthSat) for interactive analysis of the AIS data. EarthSat's AIS processing capabilities include destriping, solar irradiance corrections, residual calculations, geometric resampling, equal energy normalization, interactive spectral classifications and a variety of compressive algorithms to reduce the data to 8-bit format with a minimum of information loss. The in-house photolab facilities of EarthSat can routinely produce high-quality color renditions of the enhanced AIS data. A total of 80 lithologic samples were collected under the AIS flight lines. Correlation (within the atmospheric windows) between the laboratory and the AIS spectra of sample sites was generally poor. Reasonable correlation was only possible in large, freshly plowed fields. Mixed pixels and contrast between the natural and sample's surfaces were believed responsible for the poor correlation. Finally, a drift of approximately three channels was observed in the diffraction grating position within the 1.8 to 2.1 micron quadrant.

Dykstra, J. D.↗