Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression (Computer science)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

The Kepler Science Operations Center Pipeline Framework Extensions

The Kepler Science Operations Center (SOC) is responsible for several aspects of the Kepler Mission, including managing targets, generating on-board data compression tables, monitoring photometer health and status, processing the science data, and exporting the pipeline products to the mission archive. We describe how the generic pipeline framework software developed for Kepler is extended to achieve these goals, including pipeline configurations for processing science data and other support roles, and custom unit of work generators that control how the Kepler data are partitioned and distributed across the computing cluster. We describe the interface between the Java software that manages the retrieval and storage of the data for a given unit of work and the MATLAB algorithms that process these data. The data for each unit of work are packaged into a single file that contains everything needed by the science algorithms, allowing these files to be used to debug and evolve the algorithms offline.

Klaus, Todd C.↗

Exact reconstruction of gene regulatory networks using compressive sensing

We consider the problem of reconstructing a gene regulatory network structure from limited time series gene expression data, without any a priori knowledge of connectivity. We assume that the network is sparse, meaning the connectivity among genes is much less than full connectivity. We develop a method for network reconstruction based on compressive sensing, which takes advantage of the network’s sparseness. For the case in which all genes are accessible for measurement, and there is no measurement noise, we show that our method can be used to exactly reconstruct the network. For the more general problem, in which hidden genes exist and all measurements are contaminated by noise, we show that our method leads to reliable reconstruction. In both cases, coherence of the model is used to assess the ability to reconstruct the network and to design new experiments. We demonstrate that it is possible to use the coherence distribution to guide biological experiment design effectively. By collecting a more informative dataset, the proposed method helps reduce the cost of experiments. For each problem, a set of numerical examples is presented. The method provides a guarantee on how well the inferred graph structure represents the underlying system, reveals deficiencies in the data and model, and suggests experimental directions to remedy the deficiencies.

59 BASIC BIOLOGICAL SCIENCES↗

Simulation and Emulation of X-Ray Diffraction from Dynamic Compression Experiments

Many important aspects of the dynamic thermo-mechanical response of materials occur at the mesoscale, i.e. a physical scale of interactions smaller than what can be adequately described by homogenous behaviors, yet larger than the scale of the atomic lattice. Concurrent advancements in computational power, continuum theory, and experimental diagnostics are enabling unprecedented understanding of such interactions. However, we cannot develop a sufficient level of confidence in such mesoscale capability until the constitutive description of the underlying constituents is reliably representative of their actual physical behavior. Therefore, there is a strong need to combine experimental, modeling, and data-science techniques to validate models of the thermomechanical response of individual single crystals. One experimental diagnostic with high potential impact to shock physics and materials science is in-situ x-ray diffraction. This paper is primarily focused on simulation of x-ray diffraction in shock physics, but with an aim toward quantifying parametric uncertainty of simulation models. Here, we develop and demonstrate a data-science and model-driven approach to constrain the parameterization of continuum models of crystal lattice deformation associated with the shock response of crystalline materials. The framework is built around the connection between continuum hydrodynamic simulations of lattice deformation and a new Bragg diffraction simulation code, BarberShop. The dynamic deformation of a crystal lattice is modeled using the DiscoFlux model within an arbitrary Lagrangian-Eulerian hydrodynamic code, FLAG. These detailed continuum simulations of lattice deformation can be computationally slow, thus a statistical model is used to emulate the evolution of lattice deformation fields in time and across the considered model parameter space. Emulated lattice deformation fields can then be generated rapidly for any combination of physics model parameters. In turn, these fields can be fed into BarberShop to realize a rapid prediction of Bragg diffraction patterns associated with particular values of physics model parameters. The framework enables parameterization of the single crystal model to obtain Bragg diffraction patterns that most closely resemble a corresponding measurement. Furthermore, the framework naturally provides sensitivities of the lattice deformation to the physics parameters. We highlight the utility of this framework through the application to a synthetic closed-loop inverse problem leading to the parameterization of a single crystal material model. As a model problem, we consider the dynamic response of the energetic molecular crystal, cyclotrimethylenetrinitramine (or RDX), under dynamic compression induced by simulated flyer plate impact experiments.

36 MATERIALS SCIENCE↗

Compressed sensing for phase contrast CT

Modern x-ray techniques opened the possibility to retrieve phase information. Phase-contrast computed tomography (PCCT) has the potential to significantly improve soft tissue contrast. Radiation dose, however, continues to be an issue when moving from bench to bedside. Dose reduction in this work is achieved by sparsely acquiring PCCT data. To compensate for appearing aliasing artifacts we introduce a compressed sensing (CS) reconstruction framework. We present the feasibility of CS on PCCT with numerical as well as measured phantom data. The results proof that CS compensates for under-sampling artifacts and maintains the superior soft tissue contrast and detail visibility in the reconstructed images.

60 APPLIED LIFE SCIENCES↗

Predicting wind-driven spatial deposition through simulated color images using deep autoencoders

Abstract For centuries, scientists have observed nature to understand the laws that govern the physical world. The traditional process of turning observations into physical understanding is slow. Imperfect models are constructed and tested to explain relationships in data. Powerful new algorithms can enable computers to learn physics by observing images and videos. Inspired by this idea, instead of training machine learning models using physical quantities, we used images, that is, pixel information. For this work, and as a proof of concept, the physics of interest are wind-driven spatial patterns. These phenomena include features in Aeolian dunes and volcanic ash deposition, wildfire smoke, and air pollution plumes. We use computer model simulations of spatial deposition patterns to approximate images from a hypothetical imaging device whose outputs are red, green, and blue (RGB) color images with channel values ranging from 0 to 255. In this paper, we explore deep convolutional neural network-based autoencoders to exploit relationships in wind-driven spatial patterns, which commonly occur in geosciences, and reduce their dimensionality. Reducing the data dimension size with an encoder enables training deep, fully connected neural network models linking geographic and meteorological scalar input quantities to the encoded space. Once this is achieved, full spatial patterns are reconstructed using the decoder. We demonstrate this approach on images of spatial deposition from a pollution source, where the encoder compresses the dimensionality to 0.02% of the original size, and the full predictive model performance on test data achieves a normalized root mean squared error of 8%, a figure of merit in space of 94% and a precision-recall area under the curve of 0.93.

54 ENVIRONMENTAL SCIENCES↗

Wavelet-Smoothed Interpolation of Masked Scientific Data for JPEG 2000 Compression [Slides]

How should we manage scientific data with 'holes'? Some applications, like JPEG 2000, expect logically rectangular data, but some sources, like the Parallel Ocean Program (POP), generate data that isn't defined on certain subsets. We refer to grid points that lack well-defined, scientifically meaningful sample values as 'masked' samples. Wavelet-smoothing is a highly scalable interpolation scheme for regions with complex boundaries on logically rectangular grids. Computation is based on forward/inverse discrete wavelet transforms, so runtime complexity and memory scale linearly with respect to sample count. Efficient state-of-the-art minimal realizations yield small constants (O(10)) for arithmetic complexity scaling, and in-situ implementation techniques make optimal use of memory. Implementation in two dimensions using tensor product filter banks is straighsorward and should generalize routinely to higher dimensions. No hand-tuning required when the interpolation mask changes, making the method aeractive for problems with time-varying masks. Well-suited for interpolating undefined samples prior to JPEG 2000 encoding. The method outperforms global mean interpolation, as judged by both SNR rate-distortion performance and low-rate artifact mitigation, for data distributions whose histograms do not take the form of sharply peaked, symmetric, unimodal probability density functions. These performance advantages can hold even for data whose distribution differs only moderately from the peaked unimodal case, as demonstrated by POP salinity data. The interpolation method is very general and is not tied to any particular class of applications, could be used for more generic smooth interpolation.

42 ENGINEERING↗

Modeling and Simulation of Compression Molding Process for Sheet Molding Compound (SMC) of Chopped Carbon Fiber Composites

Compression molded SMC composed of chopped carbon fiber and resin polymer which balances the mechanical performance and manufacturing cost presents a promising solution for vehicle lightweight strategy. However, the performance of the SMC molded parts highly depends on the compression molding process and local microstructure, which greatly increases the cost for the part level performance testing and elongates the design cycle. ICME (Integrated Computational Material Engineering) approaches are thus necessary tools to reduce the number of experiments required during part design and speed up the deployment of the SMC materials. As the fundamental stage of the ICME workflow, commercial software packages for SMC compression molding exist yet remain not fully validated especially for chopped fiber systems. In this study, SMC plaques are prepared through compression molding process. The corresponding simulation models are built in Autodesk Moldflow with the same part geometry and processing conditions as in the molding tests. The output variables of the compression molding simulations, including press force history and fiber orientation of the part, are compared with experimental data. Influence of the processing conditions to the fiber orientation of the SMC plaque is also discussed. It is found that generally Autodesk Moldflow can achieve a good simulation of the compression molding process for chopped carbon fiber SMC, yet quantitative discrepancies still remain between predicted variables and experimental results.

36 MATERIALS SCIENCE↗

Deep compressed seismic learning for fast location and moment tensor inferences with natural and induced seismicity

Fast detection and characterization of seismic sources is crucial for decision-making and warning systems that monitor natural and induced seismicity. However, besides the laying out of ever denser monitoring networks of seismic instruments, the incorporation of new sensor technologies such as Distributed Acoustic Sensing (DAS) further challenges our processing capabilities to deliver short turnaround answers from seismic monitoring. In response, this work describes a methodology for the learning of the seismological parameters: location and moment tensor from compressed seismic records. In this method, data dimensionality is reduced by applying a general encoding protocol derived from the principles of compressive sensing. The data in compressed form is then fed directly to a convolutional neural network that outputs fast predictions of the seismic source parameters. Thus, the proposed methodology can not only expedite data transmission from the field to the processing center, but also remove the decompression overhead that would be required for the application of traditional processing methods. An autoencoder is also explored as an equivalent alternative to perform the same job. We observe that the CS-based compression requires only a fraction of the computing power, time, data and expertise required to design and train an autoencoder to perform the same task. Implementation of the CS-method with a continuous flow of data together with generalization of the principles to other applications such as classification are also discussed.

54 ENVIRONMENTAL SCIENCES↗

Thermodynamic properties of ε -Fe with thermal electronic excitation effects on vibrational spectra

The thermodynamic properties of hexagonal-close-packed iron (ε–Fe) are essential for investigating the internal structure and dynamic properties of planetary cores. Despite their importance to planetary sciences, experimental investigations of ε–Fe at relevant conditions are still challenging. Therefore, ab initio calculations are crucial to elucidating the thermodynamic properties of this system. Here, we use a free energy calculation scheme based on the phonon gas model compatible with temperature-dependent phonon frequencies. We investigate the effects of electronic thermal excitations, which introduces a temperature dependence on phonon frequencies, and the implication for the thermodynamic properties of ε–Fe at extreme pressure (P) and temperature (T) conditions. We disregard phonon-phonon interactions, i.e., anharmonicity and their effect on phonon frequencies. Nevertheless, the current scheme is also applicable to T -dependent anharmonic frequencies. We conclude that the impact of thermal electronic excitations on vibrational properties is not significant up to ~4000 K at 200 GPa but should not be ignored at higher temperatures or pressures. However, the static free energy F st must always include the effect of thermal excitation fully in a continuum of T. Furthermore, our results for isentropic equations of state show good agreement with data from recent ramp compression experiments up to 1400 GPa conducted at the National Ignition Facility.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Development of ab initio techniques critical for future science-based explosives R&D

Density Functional Theory (DFT) has emerged as an indispensable tool in materials research, since it can accurately predict properties of a wide variety of materials at both equilibrium and extreme conditions. However, for organic molecular crystal explosives, successful application of DFT has largely failed due to the inability of current exchange-correlation functionals to correctly describe intermolecular van der Waals (vdWs) forces. Despite this, we have discovered that even with no treatment of vdWs bonding, the AM05 functional and DFT based molecular dynamics (MD) could be used to study the properties of molecular crystals under compression. We have used DFT-MD to predict the unreacted Hugoniots for PETN and HNS and validated the results by comparison with crystalline and porous experimental data. Since we are also interested in applying DFT methods to study the equilibrium volume properties of explosives, we studied the nature of the vdWs bonding in pursuit of creating a new DFT functional capable of accurately describing equilibrium bonding of molecular crystals. In this report we discuss our results for computing shock Hugoniots of molecular crystals and also what was learned about the nature of bonding in these materials.

36 MATERIALS SCIENCE↗

Dynamic compressive behavior of Pr-Nd alloy at high strain rates and temperatures

Based on compressive tests, static on 810 material test system and dynamic on the first compressive loading in split Hopkinson pressure bar (SHPB) tests for Pr-Nd alloy cylinder specimens at high strain rates and temperatures, this study determined a J-C type [G. R. Johnson and W. H. Cook, in Proceedings of Seventh International Symposium on Ballistics (The Hague, The Netherlands, 1983), pp. 541-547] compressive constitutive equation of Pr-Nd alloy. It was recorded by a high speed camera that the Pr-Nd alloy cylinder specimens fractured during the first compressive loading in SHPB tests at high strain rates and temperatures. From high speed camera images, the critical strains of the dynamic shearing instability for Pr-Nd alloy in SHPB tests were determined, which were consistent with that estimated by using Batra and Wei's dynamic shearing instability criterion [R. C. Batra and Z. G. Wei, Int. J. Impact Eng. 34, 448 (2007)] and the determined compressive constitutive equation of Pr-Nd alloy. The transmitted and reflected pulses of SHPB tests for Pr-Nd alloy cylinder specimens computed with the determined compressive constitutive equation of Pr-Nd alloy and Batra and Wei's dynamic shearing instability criterion could be consistent with the experimental data. The fractured Pr-Nd alloy cylinder specimens of compressive tests were investigated by using 3D supper depth digital microscope and scanning electron microscope.

36 MATERIALS SCIENCE↗

Hyperspectral image reconstruction for x-ray fluorescence tomography

A penalized maximum-likelihood estimation is proposed to perform hyperspectral (spatio-spectral) image reconstruction for X-ray fluorescence tomography. The approach minimizes a Poisson-based negative log-likelihood of the observed photon counts, and uses a penalty term that has the effect of encouraging local continuity of model parameter estimates in both spatial and spectral dimensions simultaneously. The performance of the reconstruction method is demonstrated with experimental data acquired from a seed of arabidopsis thaliana collected at the 13-ID-E microprobe beamline at the Advanced Photon Source. The resulting element distribution estimates with the proposed approach show significantly better reconstruction quality than the conventional analytical inversion approaches, and allows for a high data compression factor which can reduce data acquisition times remarkably. In particular, this technique provides the capability to tomographically reconstruct full energy dispersive spectra without compromising reconstruction artifacts that impact the interpretation of results.

Fluorescence microscopy↗

Adaptive-mesh algorithms for computational fluid dynamics

The basic goal of adaptive-mesh algorithms is to distribute computational resources wisely by increasing the resolution of 'important' regions of the flow and decreasing the resolution of regions that are less important. While this goal is one that is worthwhile, implementing schemes that have this degree of sophistication remains more of an art than a science. In this paper, the basic pieces of adaptive-mesh algorithms are described and some of the possible ways to implement them are discussed and compared. These basic pieces are the data structure to be used, the generation of an initial mesh, the criterion to be used to adapt the mesh to the solution, and the flow-solver algorithm on the resulting mesh. Each of these is discussed, with particular emphasis on methods suitable for the computation of compressible flows.

Powell, Kenneth G.↗

On Convergence of Development Costs and Cost Models for Complex Spaceflight Instrument Electronics

Development costs of a few recent spaceflight instrument electrical and electronics subsystems have diverged from respective heritage cost model predictions. The cost models used are Grass Roots, Price-H and Parametric Model. These cost models originated in the military and industry around 1970 and were successfully adopted and patched by NASA on a mission-by-mission basis for years. However, the complexity of new instruments recently changed rapidly by orders of magnitude. This is most obvious in the complexity of representative spaceflight instrument electronics' data system. It is now required to perform intermediate processing of digitized data apart from conventional processing of science phenomenon signals from multiple detectors. This involves on-board instrument formatting of computational operands from row data for example, images), multi-million operations per second on large volumes of data in reconfigurable hardware (in addition to processing on a general purpose imbedded or standalone instrument flight computer), as well as making decisions for on-board system adaptation and resource reconfiguration. The instrument data system is now tasked to perform more functions, such as forming packets and instrument-level data compression of more than one data stream, which are traditionally performed by the spacecraft command and data handling system. It is furthermore required that the electronics box for new complex instruments is developed for one-digit watt power consumption, small size and that it is light-weight, and delivers super-computing capabilities. The conflict between the actual development cost of newer complex instruments and its electronics components' heritage cost model predictions seems to be irreconcilable. This conflict and an approach to its resolution are addressed in this paper by determining the complexity parameters, complexity index, and their use in enhanced cost model.

Kizhner, Semion↗

Predictive multiscale modeling for Unidirectional Carbon Fiber Reinforced Polymers

This paper presents a predictive multiscale modeling scheme for Unidirectional (UD) Carbon Fiber Reinforced Polymers (CFRP). A bottom-up modeling procedure is discussed for predicting the performance of UD structures. UD material responses are computed from high fidelity Representative Volume Elements (RVEs). A data-driven Reduced Order Modeling approach compresses RVEs into Reduced Order Models so material responses can be computed in a concurrent fashion along with the structural level simulation. The approach presented in this paper is validated against experimental data and is believed to provide design guidance for future fiber reinforced polymers development.

36 MATERIALS SCIENCE↗

High performance compression of science data

In the future, NASA expects to gather over a tera-byte per day of data requiring space for levels of archival storage. Data compression will be a key component in systems that store this data (e.g., optical disk and tape) as well as in communications systems (both between space and Earth and between scientific locations on Earth). We propose to develop algorithms that can be a basis for software and hardware systems that compress a wide variety of scientific data with different criteria for fidelity/bandwidth tradeoffs. The algorithmic approaches we consider are specially targeted for parallel computation where data rates of over 1 billion bits per second are achievable with current technology.

Storer, James A.↗

High performance compression of science data

In the future, NASA expects to gather over a tera-byte per day of data requiring space for levels of archival storage. Data compression will be a key component in systems that store this data (e.g., optical disk and tape) as well as in communications systems (both between space and Earth and between scientific locations on Earth). We propose to develop algorithms that can be a basis for software and hardware systems that compress a wide variety of scientific data with different criteria for fidelity/bandwidth tradeoffs. The algorithmic approaches we consider are specially targeted for parallel computation where data rates of over 1 billion bits per second are achievable with current technology.

Storer, James A.↗

Experimental Studies of Elementary Particle Interactions at High Energies

This is the final report of a program of research on "Experimental Studies of Elementary Particle Interactions at High Energies'' of the High Energy Physics (HEP) group of The Rockefeller University. The research was carried out using the Collider Detector at Fermilab (CDF) and the Compact Muon Solenoid (CMS) detector at the Large Hadron Collider (LHC) at CERN. Three faculty members, two research associates, and two postdoctoral associates participated in this project. At CDF, we studied proton-antiproton collisions at an energy of 1.96 TeV. We focused on diffractive interactions, in which the colliding antiproton loses a small fraction of its momentum, typically less than 1%, while the proton is excited into a high mass state retaining its quantum numbers. The study of such collisions provides insight into the nature of the diffractive exchange, conventionally referred to as Pomeron exchange. In studies of W and Z production, we found results that point to a QCD-based interpretation of the diffractive exchange, as predicted in a data-driven phenomenology developed within the Rockefeller HEP group. At CMS, we worked on diffraction, supersymmetry (SUSY), dark matter, large extra dimensions, and statistical applications to data analysis projects. In diffraction, we extended our CDF studies to higher energies working on two fronts: measurement of the single/double diffraction and of the rapidity gap cross sections at 7 TeV, and development of a simulation of diffractive processes along the lines of our successful model used at CDF. Working with the PYTHIA8 Monte Carlo simulation authors, we implemented our model as a PYTHIA8-MBR option in PYTHIA8 and used it in our data analysis. Preliminary results indicate good agreement. We searched for SUSY by measuring parameters in the Constrained Minimal Supersymmetric extension of the Standard Model (CMSSM) and found results which, combined with other experimental constraints and theoretical considerations, indicate that the CMSSM is not a viable model. Expressing our results in terms of simple topologies, we exclude squark masses below 0.75 TeV and gluino masses below 1.1 TeV. Astrophysical measurements suggest that about 80% of the matter density of the Universe is non-luminous. One of the theories on dark matter attributes it to Weakly Interacting Massive Particles (WIMPs). We searched for WIMPs in 7 TeV and 8 TeV collisions at CMS and set limits on WIMP production rates, which are competitive and complementary to those of direct detection experiments. Searching for monojets (events with only one jet), which in a popular model could be produced by a jet paired by a gravitino that escapes into extra dimensions, we significantly improved the previously set limit. Our results have been used to set limits on Higgs decay to invisible particles and on production of top squarks in compressed SUSY scenarios. Statistics. We computed Bayesian reference priors for several types of measurement and used them in the analysis of CMS data; investigated the applicability of bootstrap methods to HEP measurements; studied several issues associated with simple-versus-simple hypothesis testing and applied the resulting methods to the measurement of some properties of the top quark and Higgs boson.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗