Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression (Computer science)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Quantum pixel representations and compression for N-dimensional images

Abstract We introduce a novel and uniform framework for quantum pixel representations that overarches many of the most popular representations proposed in the recent literature, such as (I)FRQI, (I)NEQR, MCRQI, and (I)NCQI. The proposed QPIXL framework results in more efficient circuit implementations and significantly reduces the gate complexity for all considered quantum pixel representations. Our method scales linearly in the number of pixels and does not use ancilla qubits. Furthermore, the circuits only consist of $$R_y$$ R y gates and $$\text {CNOT}$$ CNOT gates making them practical in the NISQ era. Additionally, we propose a circuit and image compression algorithm that is shown to be highly effective, being able to reduce the necessary gates to prepare an FRQI state for example scientific images by up to 90% without sacrificing image quality. Our algorithms are made publicly available as part of , a Quantum Image Pixel Library.

97 MATHEMATICS AND COMPUTING↗

A method for characterization of multiple dynamic constitutive parameters of FRCs

We propose a method to measure multiple dynamic material constitutive parameters of unidirectional fiber reinforced composites (FRCs) in a single experiment. Dynamic short-beam shear (DSBS) experiments were performed on a modified Kolsky compression bar, with integration of high-speed imaging and digital image correlation (DIC). The unidirectional FRCs investigated were S-2 glass fiber reinforced matrix of TGDDM-Jeffamine® D230 with monoamine functionalized partially reacted substructures (mPRS) and commercially available SC-15. Analytical solutions of normal and shear strains of a composite beam were derived based on Timoshenko beam theory, assuming material to be transversely isotropic and have different moduli in tension and compression in each principle material orientation. Tensile and compressive moduli were inversely computed through monitoring normal strain slope when specimen was constantly loaded at a speed of ~7.3 m/s within a small deflection. Non-linear shear stress-strain behavior of the composite was described via Ramberg–Osgood equation. Finite element (FE) analysis was conducted in ABAQUS, simultaneously defining via user subroutine UMAT the transverse isotropy of material, bi-modulus constitutive model, and non-linear shear stress-strain relation. The method proposed in this work was validated by comparing strain distributions computed by FE model and DIC measurements. Comparing with traditional dynamic tensile, compressive, and shear experiments on FRCs, this method significantly simplifies the specimen preparation and design of complicated gripping fixtures for multiple experiments. Here, systematic errors resulting from variations of specimen geometry and dimension, loading direction, and instrumentation are reduced, thereby providing compatible data for numerical studies on impact behavior of composites.

36 MATERIALS SCIENCE↗

Calibrating the SPECTACULAR constitutive model using legacy Sandia data for two filled epoxy systems: 828/CTBN/DEA/GMB and 828/DEA/GMB

The SPECTACULAR model is a development extension of the Simplified Potential Energy Clock (SPEC) model. Both models are nonlinear viscoelastic constitutive models used to predict a wide range of time-dependent behaviors in epoxies and other glass-forming materials. This report documents the procedures used to generate SPECTACULAR calibrations for two particulate-filled epoxy systems, 828/CTBN/DEA/GMB and 828/DEA/GMB. No previous SPECTACULAR or SPEC calibration exists for 828/CTBN/DEA/GMB, while a legacy SPEC calibration exists for 828/DEA/GMB. To generate the SPECTACULAR calibrations, a step-by-step procedure was executed to determine parameters in groups with minimal coupling between parameter groups. This procedure has often been deployed to calibrate SPEC, therefore the resulting SPECTACULAR calibration is backwards compatible with SPEC (i.e. none of the extensions specific to SPECTACULAR are used). The calibration procedure used legacy Sandia experimental data stored on the Polymer Properties Database website. The experiments used for calibration included shear master curves, isofrequency temperature sweeps under oscillatory shear, the bulk modulus at room temperature, the thermal strain during a temperature sweep, and compression through yield at multiple temperatures below the glass transition temperature. Overall, the calibrated models fit the experimental data remarkably well. However, the glassy shear modulus varies depending on the experiment used to calibrate it. For instance, the shear master curve, isofrequency temperature sweep under oscillatory shear, and the Young's modulus in glassy compression yield values for the glassy shear modulus at the reference temperature that vary by as much as 15 %. Also, for 828/CTBN/DEA/GMB, the temperature dependence of the glassy shear modulus when fit to the Young's modulus at different temperatures is approximately four times larger than when it is determined from the isofrequency temperature sweep under oscillatory shear. For 828/DEA/GMB, the temperature dependence of the shear modulus determined from the isofrequency temperature sweep under oscillatory shear accurately predicts the Young's modulus at different temperatures. When choosing values for the shear modulus, fitting the glassy compression data was prioritized. The new and legacy calibrations for 828/DEA/GMB are similar and appear to have been calibrated from the same data. However, the new calibration improves the fit to the thermal strain data. In addition to the standard calibrations, development calibrations were produced that take advantage of development features of SPECTACULAR , including an updated equilibrium Helmholtz free energy that eliminates undesirable behavior found in previous work. In addition to the previously mentioned experimental data, the development calibrations require data for the heat capacity during a stress-free temperature sweep to calibrate thermal terms.

36 MATERIALS SCIENCE↗

High-performance compression of astronomical images

Astronomical images have some rather unusual characteristics that make many existing image compression techniques either ineffective or inapplicable. A typical image consists of a nearly flat background sprinkled with point sources and occasional extended sources. The images are often noisy, so that lossless compression does not work very well; furthermore, the images are usually subjected to stringent quantitative analysis, so any lossy compression method must be proven not to discard useful information, but must instead discard only the noise. Finally, the images can be extremely large. For example, the Space Telescope Science Institute has digitized photographic plates covering the entire sky, generating 1500 images each having 14000 x 14000 16-bit pixels. Several astronomical groups are now constructing cameras with mosaics of large CCD's (each 2048 x 2048 or larger); these instruments will be used in projects that generate data at a rate exceeding 100 MBytes every 5 minutes for many years. An effective technique for image compression may be based on the H-transform (Fritze et al. 1977). The method that we have developed can be used for either lossless or lossy compression. The digitized sky survey images can be compressed by at least a factor of 10 with no noticeable losses in the astrometric and photometric properties of the compressed images. The method has been designed to be computationally efficient: compression or decompression of a 512 x 512 image requires only 4 seconds on a Sun SPARCstation 1. The algorithm uses only integer arithmetic, so it is completely reversible in its lossless mode, and it could easily be implemented in hardware for space applications.

White, Richard L.↗

Anelasticity and Phase Transition During Ramp-Release in Tin

This study examines the qualitative features of an anelasticity model associated with the bowing of dislocations in the presence of phase transition. A simple physically plausible mechanism is introduced to describe the interaction of anelasticity and the transformation. Varying the anelastic parameters results in strong differences in the deviatoric stress response. The model is applied to study the behavior of tin (Sn) and compared to data from ramp driven compression-release experiments. Tin exhibits a complex phase diagram within a relatively accessible range of temperature and pressures and the characterization of its phases is considered an open problem with significant scientific merit. The coupling between anelasticity, plasticity, and phase transformation contributes to release wave features traditionally associated with the phase transition effect alone suggesting the importance of accounting for the effects jointly. Posterior distributions of the plastic and anelastic parameters are computed using Bayesian-inference-based methods, further highlighting the importance of anelasticity in this regime.

36 MATERIALS SCIENCE↗

An adaptive technique to maximize lossless image data compression of satellite images

Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.

Stewart, Robert J.↗

Transparent dense sodium

Under pressure, metals exhibit increasingly shorter interatomic distances. Intuitively, this response is expected to be accompanied by an increase in the widths of the valence and conduction bands and hence a more pronounced free-electron-like behaviour. But at the densities that can now be achieved experimentally, compression can be so substantial that core electrons overlap. This effect dramatically alters electronic properties from those typically associated with simple free-electron metals such as lithium and sodium, leading in turn to structurally complex phases and superconductivity with a high critical temperature. But the most intriguing prediction- that the seemingly simple metals Li and Na will transform under pressure into insulating states, owing to pairing of alkali atoms - has yet to be experimentally confirmed. Here we report experimental observations of a pressure-induced transformation of Na into an optically transparent phase at {approx}200 GPa (corresponding to {approx}5.0-fold compression). Experimental and computational data identify the new phase as a wide bandgap dielectric with a six-coordinated, highly distorted double-hexagonal close-packed structure. We attribute the emergence of this dense insulating state not to atom pairing, but to p-d hybridizations of valence electrons and their repulsion by core electrons into the lattice interstices. We expect that such insulating states may also form in other elements and compounds when compression is sufficiently strong that atomic cores start to overlap strongly.

36 MATERIALS SCIENCE↗

The basic matrix library (BML) for quantum chemistry

The basic matrix library package (BML) provides a common application programming interface (API) for linear algebra and matrix functions in C and Fortran for quantum chemistry codes. The BML API is matrix format independent. Currently the dense, compressed sparse row, and ELLPACK-R sparse matrix data types are available, each with different implementations. We show how the second-order spectral projection (SP2) algorithm used to compute the electronic structure of a molecular system represented with a tight-binding Hamiltonian can be successfully implemented with the aid of this library.

97 MATHEMATICS AND COMPUTING↗

Utilizing computer vision and artificial intelligence algorithms to predict and design the mechanical compression response of direct ink write 3D printed foam replacement structures

Additive Manufacturing (AM) of porous polymeric materials, such as foams, recently became a topic of intensive research due their unique combination of low density, impressive mechanical properties, and stress dissipation capabilities. Conventional methods for fabricating foams rely on complex and stochastic processes, making it challenging to achieve precise architectural control of structured porosity. In contrast, AM provides access to a wide range of printable materials, where precise spatial control over structured porosity can be modulated during the fabrication process enabling the production of foam replacement structures (FRS). Current approaches for designing FRS are based on intuitive understanding of their properties or an extensive number of finite element method (FEM) simulations. These approaches, however, are computationally expensive and time consuming. As such, in this work, we present a novel methodology for determining the mechanical compression response of direct ink write (DIW) 3D printed FRS using a simple cross-sectional image. By obtaining measurement data for a relatively small number of samples, an artificial neural network (ANN) was trained, and a computer vision algorithm was used to make inferences about foam compression characteristics from a single cross-sectional image. Finally, a genetic algorithm (GA) was used to solve the inverse design problem, generating the AM printing parameters that an engineer should use to achieve a desired compression response from a DIW printed FRS. The methods developed herein present an avenue for entirely autonomous design and analysis of additively manufactured structures using artificial intelligence.

36 MATERIALS SCIENCE↗

A semi-agnostic ansatz with variable structure for variational quantum algorithms

Quantum machine learning—and specifically Variational Quantum Algorithms (VQAs)—offers a powerful, flexible paradigm for programming near-term quantum computers, with applications in chemistry, metrology, materials science, data science, and mathematics. Here, one trains an ansatz, in the form of a parameterized quantum circuit, to accomplish a task of interest. However, challenges have recently emerged suggesting that deep ansatzes are difficult to train, due to flat training landscapes caused by randomness or by hardware noise. This motivates our work, where we present a variable structure approach to build ansatzes for VQAs. Our approach, called VAns (Variable Ansatz), applies a set of rules to both grow and (crucially) remove quantum gates in an informed manner during the optimization. Consequently, VAns is ideally suited to mitigate trainability and noise-related issues by keeping the ansatz shallow. We employ VAns in the variational quantum eigensolver for condensed matter and quantum chemistry applications, in the quantum autoencoder for data compression and in unitary compilation problems showing successful results in all cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On DESTINY Science Instrument Electrical and Electronics Subsystem Framework

Future space missions are going to require large focal planes with many sensing arrays and hundreds of millions of pixels all read out at high data rates'' . This will place unique demands on the electrical and electronics (EE) subsystem design and it will be critically important to have high technology readiness level (TRL) EE concepts ready to support such missions. One such omission is the Joint Dark Energy Mission (JDEM) charged with making precise measurements of the expansion rate of the universe to reveal vital clues about the nature of dark energy - a hypothetical form of energy that permeates all of space and tends to increase the rate of the expansion. One of three JDEM concept studies - the Dark Energy Space Telescope (DESTINY) was conducted in 2008 at the NASA's Goddard Space Flight Center (GSFC) in Greenbelt, Maryland. This paper presents the EE subsystem framework, which evolved from the DESTINY science instrument study. It describes the main challenges and implementation concepts related to the design of an EE subsystem featuring multiple focal planes populated with dozens of large arrays and millions of pixels. The focal planes are passively cooled to cryogenic temperatures (below 140 K). The sensor mosaic is controlled by a large number of Readout Integrated Circuits and Application Specific Integrated Circuits - the ROICs/ASICs in near proximity to their sensor focal planes. The ASICs, in turn, are serviced by a set of "warm" EE subsystem boxes performing Field Programmable Gate Array (FPGA) based digital signal processing (DSP) computations of complex algorithms, such as sampling-up-the-ramp algorithm (SUTR), over large volumes of fast data streams. The SUTR boxes are supported by the Instrument Control/Command and Data Handling box (ICDH Primary and Backup boxes) for lossless data compression, command and low volume telemetry handling, power conversion and for communications with the spacecraft. The paper outlines how the JDEM DESTINY concept instrument EE subsystem can be built now, a design; which is generally U.S. Government work not protected by U.S. copyright IEEEAC paper # 1429. Version 4. Updated October 19, 2009 applicable to a wide variety of missions using large focal planes with lar ge mosaics of sensors.

Kizhner, Semion↗

vdisdrops (b1)

A disdrometer measures the drop size distribution and velocity of falling hydrometeors. The 2-dimensional video-disdrometer (VDIS) comprises video cameras capable of observing individual hydrometeors from views perpendicular to each other. Two CCD line scan cameras are directed towards the measurement area. Objects passing through the measurement area—which is determined by the cross-section of the two optical paths as seen from above—obstruct the light and are detected as shadows by the cameras. Each camera contains a small embedded computer responsible for handling the data-capture process, analysis of the data, and their conversion and compression into a format suitable for further processing. Subsequently the data are transferred to the computer used for instrument control and final analysis. In order to identify individual precipitation particles by matching their views as seen by each of the cameras, it is necessary to synchronize the shutter and control both cameras with a synchronous line trigger signal. To reconstruct observables like falling velocity, oblateness, etc. from the datastreams of the two cameras, the two optical paths are displaced vertically by about 6mm, typically. Measuring this distance and adjusting the background illumination are the two major calibration and maintenance tasks necessary for successful operation of the device.

54 ENVIRONMENTAL SCIENCES↗

Mesoscale Modeling of LX-17 Under Isentropic Compression

Mesoscale simulations of LX-17 incorporating different equilibrium mixture models were used to investigate the unreacted equation-of-state (UEOS) of TATB. Candidate TATB UEOS were calculated using the equilibrium mixture models and benchmarked with mesoscale simulations of isentropic compression experiments (ICE). X-ray computed tomography (XRCT) data provided the basis for initializing the simulations with realistic microstructural details. Three equilibrium mixture models were used in this study. The single constituent with conservation equations (SCCE) model was based on a mass-fraction weighted specific volume and the conservation of mass, momentum, and energy. The single constituent equation-of-state (SCEOS) model was based on a mass-fraction weighted specific volume and the equation-of-state of the constituents. The kinetic energy averaging (KEA) model was based on a mass-fraction weighted particle velocity mixture rule and the conservation equations. The SCEOS model yielded the stiffest TATB EOS (0.121{micro} + 0.4958{micro}{sup 2} + 2.0473{micro}{sup 3}) and, when incorporated in mesoscale simulations of the ICE, demonstrated the best agreement with VISAR velocity data for both specimen thicknesses. The SCCE model yielded a relatively more compliant EOS (0.1999{micro}-0.6967{micro}{sup 2} + 4.9546{micro}{sup 3}) and the KEA model yielded the most compliant EOS (0.1999{micro}-0.6967{micro}{sup 2}+4.9546{micro}{sup 3}) of all the equilibrium mixture models. Mesoscale simulations with the lower density TATB adiabatic EOS data demonstrated the least agreement with VISAR velocity data.

36 MATERIALS SCIENCE↗

Development of a fast framing detector for electron microscopy

A high frame rate detector system is described that enables fast real-time data analysis of scanning diffraction experiments in scanning transmission electron microscopy (STEM). This is an end-to-end development that encompasses the data producing detector, data transportation, and real-time processing of data. The detector will consist of a central pixel sensor that is surrounded by annular silicon diodes. Both components of the detector system will synchronously capture data at almost 100 kHz frame rate, which produces an approximately 400 Gb/s data stream. Low-level preprocessing will be implemented in firmware before the data is streamed from the National Center for Electron Microscopy (NCEM) to the National Energy Research Scientific Computing Center (NERSC). Live data processing, before it lands on disk, will happen on the Cori supercomputer and aims to present scientists with prompt experimental feedback. This online analysis will provide rough information of the sample that can be utilized for sample alignment, sample monitoring and verification that the experiment is set up correctly. Only a compressed version of the relevant data is then selected for more in-depth processing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Differentiable Earth mover’s distance for data compression at the high-luminosity LHC

Abstract The Earth mover’s distance (EMD) is a useful metric for image recognition and classification, but its usual implementations are not differentiable or too slow to be used as a loss function for training other algorithms via gradient descent. In this paper, we train a convolutional neural network (CNN) to learn a differentiable, fast approximation of the EMD and demonstrate that it can be used as a substitute for computing-intensive EMD implementations. We apply this differentiable approximation in the training of an autoencoder-inspired neural network (encoder NN) for data compression at the high-luminosity LHC at CERN The goal of this encoder NN is to compress the data while preserving the information related to the distribution of energy deposits in particle detectors. We demonstrate that the performance of our encoder NN trained using the differentiable EMD CNN surpasses that of training with loss functions based on mean squared error.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

OpenMSI: A High-Performance Web-Based Platform for Mass Spectrometry Imaging

Mass spectrometry imaging (MSI) enables researchers to directly probe endogenous molecules directly within the architecture of the biological matrix. Unfortunately, efficient access, management, and analysis of the data generated by MSI approaches remain major challenges to this rapidly developing field. Despite the availability of numerous dedicated file formats and software packages, it is a widely held viewpoint that the biggest challenge is simply opening, sharing, and analyzing a file without loss of information. Here we present OpenMSI, a software framework and platform that addresses these challenges via an advanced, high-performance, extensible file format and Web API for remote data access (http://openmsi.nersc.gov). The OpenMSI file format supports storage of raw MSI data, metadata, and derived analyses in a single, self-describing format based on HDF5 and is supported by a large range of analysis software (e.g., Matlab and R) and programming languages (e.g., C++, Fortran, and Python). Careful optimization of the storage layout of MSI data sets using chunking, compression, and data replication accelerates common, selective data access operations while minimizing data storage requirements and are critical enablers of rapid data I/O. The OpenMSI file format has shown to provide >2000-fold improvement for image access operations, enabling spectrum and image retrieval in less than 0.3 s across the Internet even for 50 GB MSI data sets. To make remote high-performance compute resources accessible for analysis and to facilitate data sharing and collaboration, we describe an easy-to-use yet powerful Web API, enabling fast and convenient access to MSI data, metadata, and derived analysis results stored remotely to facilitate high-performance data analysis and enable implementation of Web based data sharing, visualization, and analysis.

59 BASIC BIOLOGICAL SCIENCES↗

Determination of a Density Functional Tight Binding Model with an Extended Basis Set and Three-Body Repulsion for Carbon Under Extreme Pressures and Temperatures

In this paper, we report here on development of a density functional tight binding (DFTB) simulation approach for carbon under extreme pressures and temperatures that includes an expanded basis set and an environmentally dependent repulsive energy. We find that including d-orbital interactions in the DFTB Hamiltonian improves determination of the electronic states at high pressure–temperature conditions, compared to standard DFTB implementations that utilize s- and p-orbitals only for carbon. We then determine a three-body repulsive energy through fitting to diamond, BC8, and simple cubic cold compression curve data, as well pressures from metallic liquid configurations from density functional theory (DFT) simulations. Our new model (DFTB-p3b) yields approximately 2 orders of magnitude increase in computational efficiency over standard DFT while retaining its accuracy for condensed phases of carbon under a wide range of conditions, including the metallic liquid phase at conditions up to 2000 GPa and 30 000 K. Finally, our results provide a straightforward method by which DFTB can be extended to studies of covalently bonded materials under extremely high pressures and temperatures such as the interiors of planets and other large celestial bodies.

36 MATERIALS SCIENCE↗

Ultrafast processing of pixel detector data with machine learning frameworks

Modern photon science performed at high repetition rate free-electron laser (FEL) facilities and beyond relies on 2D pixel detectors operating at increasing frequencies (towards 100 kHz at LCLS-II) and producing rapidly increasing amounts of data (towards TB/s). This data must be rapidly stored for offline analysis and summarized in real time for online feedback to the scientists. While at LCLS all raw data has been stored, at LCLS-II this would lead to a prohibitive cost; instead, enabling real time processing of pixel detector data (dark, gain, common mode, background, charge summing, subpixel position, photon counting, data summarization) allows reducing the size and cost of online processing, offline processing and storage by orders of magnitude while preserving full photon information. This could be achieved by taking advantage of the compressibility of sparse data typical for LCLS-II applications. Faced with a similar big data challenge a decade ago, computer vision stimulated revolutionary advances in machine learning hardware and software. We investigated if these developments are useful in the field of data processing for high speed pixel detectors and found that typical deep learning models and autoencoder architectures failed to yield useful noise reduction while preserving full photon information, presumably because of the very different statistics and feature sets in computer vision and radiation imaging. However, the raw performance of modern frameworks like Tensorflow inspired us to redesign in Tensorflow mathematically equivalent versions of the state-of-the-art, “classical” algorithms used at LCLS. The novel Tensorflow models resulted in elegant, compact and hardware agnostic code, gaining 1 to 2 orders of magnitude faster processing on an inexpensive consumer GPU, reducing by 3 orders of magnitude the projected cost of online analysis and compression without photon loss at LCLS-II. The novel Tensorflow models also enabled ongoing development of a pipelined hardware system expected to yield an additional 3 to 4 orders of magnitude speedup, necessary for meeting the data acquisition and storage requirements at LCLS-II, potentially enabling acquiring every single FEL pulse at full speed. Computer vision a decade ago was dominated by hand-crafted filters; their structure inspired the deep learning revolution resulting in modern deep convolutional networks; similarly, our novel Tensorflow filters provide inspiration for designing future deep learning models for ultrafast and efficient processing and classification of pixel detector images at FEL facilities.

47 OTHER INSTRUMENTATION↗