Search NASA⌕ Search

SEARCH · Search NASA

Results for “entropy coding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Conditional Entropy-Constrained Residual VQ with Application to Image Coding

This paper introduces an extension of entropy-constrained residual vector quantization (VQ) where intervector dependencies are exploited. The method, which we call conditional entropy-constrained residual VQ, employs a high-order entropy conditioning strategy that captures local information in the neighboring vectors. When applied to coding images, the proposed method is shown to achieve better rate-distortion performance than that of entropy-constrained residual vector quantization with less computational complexity and lower memory requirements. Moreover, it can be designed to support progressive transmission in a natural way. It is also shown to outperform some of the best predictive and finite-state VQ techniques reported in the literature. This is due partly to the joint optimization between the residual vector quantizer and a high-order conditional entropy coder as well as the efficiency of the multistage residual VQ structure and the dynamic nature of the prediction.

Kossentini, Faouzi↗

Coding For Compression Of Low-Entropy Data

Improved method of encoding digital data provides for efficient lossless compression of partially or even mostly redundant data from low-information-content source. Method of coding implemented in relatively simple, high-speed arithmetic and logic circuits. Also increases coding efficiency beyond that of established Huffman coding method in that average number of bits per code symbol can be less than 1, which is the lower bound for Huffman code.

Yeh, Pen-Shu↗

Entropy-Based Bounds On Redundancies Of Huffman Codes

Report presents extension of theory of redundancy of binary prefix code of Huffman type which includes derivation of variety of bounds expressed in terms of entropy of source and size of alphabet. Recent developments yielded bounds on redundancy of Huffman code in terms of probabilities of various components in source alphabet. In practice, redundancies of optimal prefix codes often closer to 0 than to 1.

Smyth, Padhraic J.↗

High-resolution imaging of globular cluster cores

An approach based on the maximum entropy method aimed at increasing angular resolution to study globular cluster cores is presented. To perform the image restoration the Gull-Skilling (1989) MEMSYS-3 code for maximum entropy reconstruction of arbitrary data sets was used. This software was recently applied to restoration of ESO images of the R136 object in the core of the 30 Doradus nebula. It was demonstrated that the software made it possible to restore an image at subpixel spatial scales which facilitates the detection of very high-resolution structure in the restored image.

Weir, N.↗

The development of a CFD potential method for the analysis of tilt-rotors

A new CFD potential code, FPX (eXtended Full-Potential), has been developed for application to both helicopters and tilt-rotors. The code solves the unsteady, three-dimensional full potential equation and is an extension of the rotor code, FPR. Both entropy and viscosity corrections are included to enhance the physical modeling capabilities. A number of efficiency related modifications have yielded a factor of two speed-up in the code. An axial flow capability has been added to treat tilt-rotor in forward flight (cruise mode). In order to employ streamwise periodicity and accurately solve for the propagation of acoustic signals in the tip region, an H-H topology has been added to the basic O-H grid system. Computations are performed for the XV-15 Standard and ATB blades at high-speed conditions. Comparisons are made for the blade aerodynamics and the induced fuselage cabin pressure for a range of Mach numbers. Grid generation, wake treatment, and far-field wall treatment are identified as problem areas with recommendations for future research.

Bridgeman, John O.↗

On the Information Content of Program Traces

Program traces are used for analysis of program performance, memory utilization, and communications as well as for program debugging. The trace contains records of execution events generated by monitoring units inserted into the program. The trace size limits the resolution of execution events and restricts the user's ability to analyze the program execution. We present a study of the information content of program traces and develop a coding scheme which reduces the trace size to the limit given by the trace entropy. We apply the coding to the traces of AIMS instrumented programs executed on the IBM SPA and the SCSI Power Challenge and compare it with other coding methods. Our technique shows size of the trace can be reduced by more than a factor of 5.

Frumkin, Michael↗

Utilizing Amino Acid Composition and Entropy of Potential Open Reading Frames to Identify Protein-Coding Genes

One of the main steps in gene-finding in prokaryotes is determining which open reading frames encode for a protein, and which occur by chance alone. There are many different methods to differentiate the two; the most prevalent approach is using shared homology with a database of known genes. This method presents many pitfalls, most notably the catch that you only find genes that you have seen before. The four most popular prokaryotic gene-prediction programs (GeneMark, Glimmer, Prodigal, Phanotate) all use a protein-coding training model to predict protein-coding genes, with the latter three allowing for the training model to be created ab initio from the input genome. Different methods are available for creating the training model, and to increase the accuracy of such tools, we present here GOODORFS, a method for identifying protein-coding genes within a set of all possible open reading frames (ORFS). Our workflow begins with taking the amino acid frequencies of each ORF, calculating an entropy density profile (EDP), using KMeans to cluster the EDPs, and then selecting the cluster with the lowest variation as the coding ORFs. To test the efficacy of our method, we ran GOODORFS on 14,179 annotated phage genomes, and compared our results to the initial training-set creation step of four other similar methods (Glimmer, MED2, PHANOTATE, Prodigal). We found that GOODORFS was the most accurate (0.94) and had the best F1-score (0.85), while Glimmer had the highest precision (0.92) and PHANOTATE had the highest recall (0.96).

59 BASIC BIOLOGICAL SCIENCES↗

An adaptive technique to maximize lossless image data compression of satellite images

Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.

Stewart, Robert J.↗

Investigation of thermal protection systems effects on viscid and inviscid flow fields for manned entry systems

Procedures and methods for predicting aerothermodynamic heating to delta orbiter shuttle vehicles were reviewed. A number of approximate methods were found to be adequate for large scale parameter studies, but are considered inadequate for final design calculations. It is recommended that final design calculations be based on a computer code which accounts for nonequilibrium chemistry, streamline spreading, entropy swallowing, and turbulence. It is further recommended that this code be developed with the intent that it can be directly coupled with an exact inviscid flow field calculation when the latter becomes available. A nonsimilar, equilibrium chemistry computer code (BLIMP) was used to evaluate the effects of entropy swallowing, turbulence, and various three dimensional approximations. These solutions were compared with available wind tunnel data. It was found study that, for wind tunnel conditions, the effect of entropy swallowing and three dimensionality are small for laminar boundary layers but entropy swallowing causes a significant increase in turbulent heat transfer. However, it is noted that even small effects (say, 10-20%) may be important for the shuttle reusability concept.

Bartlett, E. P.↗

Impact and Collisional Processes in the Solar System

A series of impact experiments on anhydrite CaSO4, in which vaporized sample accelerates an element in a velocity interferometer, generate velocity data that we have recently reanalyzed using an explicit entropy generating finite difference code. The shock pressure required from the onset, and complete vaporization of 30% porous and 70% crystal density anhydrite is 52 +/- 3 and 122 +/- 13 GPa. Using observed acid leaching in non-marine K/T ejecta in North America, and the sharp global increase in Sr-87/Sr-86 ratios recorded at 65 Ma in marine rocks, we demonstrated that global acidification is primarily due to the SO2 released by anhydrite volatilization, and not HNO3 formed from bolide-induced air pyrolysis. Shock temperatures for crystal CaCO3 are measured from 3000 to 7000 K in the 90 to 160 GPa pressure range. These temperatures are much lower than calculated theoretically indicating that possibly bond breakdown at the shock front is occurring. This is the first mineral in which this effect has ever been seen. New data defining the ion species which are produced upon impact of volatilization of metals and minerals using a pulse ultraviolet laser to simulate intense shock heating from a projectile impact indicate that in shock experiments we can for the first time study the speciation of neutrals using a moderate resolution time-of-flight mass spectrometer. Measurements of the gas species from a series of proposed impact experiments appear to be quite feasible. We will attempt these experiments in the next year. Measurements of the impact induced shock wave decay in SiO2 and GeO2 glass are underway to measure these pure oxide properties. Predictive calculations indicate that the pressure will decay as r(exp -2.7) in the phase transition regime, versus a much lower rate of r(exp -1.18), if a phase transition does not occur.

Ahrens, Thomas J.↗

Entanglement wedge reconstruction and the information paradox

When absorbing boundary conditions are used to evaporate a black hole in AdS/CFT, we show that there is a phase transition in the location of the quantum Ryu-Takayanagi surface, at precisely the Page time. The new RT surface lies slightly inside the event horizon, at an infalling time approximately the scrambling time β/2 π logS BH into the past. We can immediately derive the Page curve, using the Ryu-Takayanagi formula, and the Hayden-Preskill decoding criterion, using entanglement wedge reconstruction. Because part of the interior is now encoded in the early Hawking radiation, the decreasing entanglement entropy of the black hole is exactly consistent with the semiclassical bulk entanglement of the late-time Hawking modes, despite the absence of a firewall.By studying the entanglement wedge of highly mixed states, we can understand the state dependence of the interior reconstructions. A crucial role is played by the existence of tiny, non-perturbative errors in entanglement wedge reconstruction. Directly after the Page time, interior operators can only be reconstructed from the Hawking radiation if the initial state of the black hole is known. As the black hole continues to evaporate, reconstructions become possible that simultaneously work for a large class of initial states. Using similar techniques, we generalise Hayden-Preskill to show how the amount of Hawking radiation required to reconstruct a large diary, thrown into the black hole, depends on both the energy and the entropy of the diary. Finally we argue that, before the evaporation begins, a single, state-independent interior reconstruction exists for any code space of microstates with entropy strictly less than the Bekenstein-Hawking entropy, and show that this is sufficient state dependence to avoid the AMPSS typical-state firewall paradox.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Channel capacity: limitation of entropy rate during cell signal transduction

Cellular signal transduction is mediated through chain activation reactions involving signalling molecules. Information thermodynamics may be a promising approach for quantifying signal transduction. A cell signal is transduced through the signal molecule activation as a step of a signal transduction cascade. In each step, two types of entropy can be defined. First, the signal transduction was defined using thermodynamic entropy production during the chemical activation of signal molecules. Second, the chronology was described as a code string, and the logarithm of the number of signal code strings corresponded to the information entropy. Finally, the total entropy during signal transduction was determined by summing the two entropies. When maximising the total entropy, the total entropy rate per signalling molecule concentration was found to be consistent independently of each transduction step (i.e., signal molecule types). Consequently, the speed limit of the entropy rate can be calculated, providing the capacity, which is an essential property of the signal transduction cascade. The theory introduced here is expected to provide a basic framework for understanding new methods of discovering signal cascades and intracellular signal transduction.

59 BASIC BIOLOGICAL SCIENCES↗

Transonic cascade flow analysis using viscous/inviscid coupling concepts

Transonic two-dimensional cascade flows have been analyzed using viscous/inviscid coupling concepts. A full potential cascade code is coupled with an inverse integral boundary layer/wake method that permits calculation of separated laminar or turbulent flow. The semi-inverse coupling method of Wigton converges slowly in the case of a strong shock in the region between the shock and the trailing edge. The location of a strong shock is not well predicted by the coupling method, which indicates the need for an entropy correction in the potential code or the inclusion of a shock-boundary layer interaction module.

Olling, C. R.↗

Statistical and linguistic features of DNA sequences

We present evidence supporting the idea that the DNA sequence in genes containing noncoding regions is correlated, and that the correlation is remarkably long range--indeed, base pairs thousands of base pairs distant are correlated. We do not find such a long-range correlation in the coding regions of the gene. We resolve the problem of the "non-stationary" feature of the sequence of base pairs by applying a new algorithm called Detrended Fluctuation Analysis (DFA). We address the claim of Voss that there is no difference in the statistical properties of coding and noncoding regions of DNA by systematically applying the DFA algorithm, as well as standard FFT analysis, to all eukaryotic DNA sequences (33 301 coding and 29 453 noncoding) in the entire GenBank database. We describe a simple model to account for the presence of long-range power-law correlations which is based upon a generalization of the classic Levy walk. Finally, we describe briefly some recent work showing that the noncoding sequences have certain statistical features in common with natural languages. Specifically, we adapt to DNA the Zipf approach to analyzing linguistic texts, and the Shannon approach to quantifying the "redundancy" of a linguistic text in terms of a measurable entropy function. We suggest that noncoding regions in plants and invertebrates may display a smaller entropy and larger redundancy than coding regions, further supporting the possibility that noncoding regions of DNA may carry biological information.

Non-NASA Center↗