Search NASA⌕ Search

SEARCH · Search NASA

Results for “INFORMATION THEORY”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Information Theory Applied to Decision Making Structures

Decision making structures, such as control boards, process information on many topics as they select options for the system and project. The decisions are based on the information known to the board members and presenters (subject matter experts) and shared at the board during discussion. This information flow through this process can be modelled using information theory. Information theory provides a mathematical basis to understand the flow of information through the decision making process and the information needed for a particular decision. Information theory also provides the mathematical relationships on which to base the optimal decision making structure for a specific system development and organizational structure. Since decision making bodies provide control for the system or project, control theory can be used to construct a decision making model. This provides a starting point for adding cognitive science models. Information processing by each individual board participant can be represented through cognitive processes which are integrated across the board participants through information theory relationship. The set theory view of information theory provides a structure in which to look at the relationships between the participants in a decision making structure.

Watson, Michael D.↗
NASA NTRS2018

Information Theory Applied to Decision Making Structures

Decision making structures, such as control boards, process information on many topics as they select options for the system and project. The decisions are based on the information known to the board members and presenters (subject matter experts) and shared at the board during discussion. This information flow through this process can be modelled using information theory. Information theory provides a mathematical basis to understand the flow of information through the decision making process and the information needed for a particular decision. Information theory also provides the mathematical relationships on which to base the optimal decision making structure for a specific system development and organizational structure. Since decision making bodies provide control for the system or project, control theory can be used to construct a decision making model. This provides a starting point for adding cognitive science models. Information processing by each individual board participant can be represented through cognitive processes which are integrated across the board participants through information theory relationship. The set theory view of information theory provides a structure in which to look at the relationships between the participants in a decision making structure.

Watson, Michael D.↗
NASA NTRS1981

Information theory lateral density distribution for Earth inferred from global gravity field

Information Theory Inference, better known as the Maximum Entropy Method, was used to infer the lateral density distribution inside the Earth. The approach assumed that the Earth consists of indistinguishable Maxwell-Boltzmann particles populating infinitesimal volume elements, and followed the standard methods of statistical mechanics (maximizing the entropy function). The GEM 10B spherical harmonic gravity field coefficients, complete to degree and order 36, were used as constraints on the lateral density distribution. The spherically symmetric part of the density distribution was assumed to be known. The lateral density variation was assumed to be small compared to the spherically symmetric part. The resulting information theory density distribution for the cases of no crust removed, 30 km of compensated crust removed, and 30 km of uncompensated crust removed all gave broad density anomalies extending deep into the mantle, but with the density contrasts being the greatest towards the surface (typically + or 0.004 g cm 3 in the first two cases and + or - 0.04 g cm 3 in the third). None of the density distributions resemble classical organized convection cells. The information theory approach may have use in choosing Standard Earth Models, but, the inclusion of seismic data into the approach appears difficult.

Rubincam, D. P.↗
NASA NTRS2022

Molecular information theory meets protein folding

We propose an application of molecular information theory to analyze the folding of single domain proteins. We analyze results from various areas of protein science, such as sequence-based potentials, reduced amino acid alphabets, backbone configurational entropy, secondary structure content, residue burial layers, and mutational studies of protein stability changes. We found that the average information contained in the sequences of evolved proteins is very close to the average information needed to specify a fold ~2.2 ± 0.3 bits/(site operation). The effective alphabet size in evolved proteins equals the effective number of conformations of a residue in the compact unfolded state at around 5. We calculated an energy-to-information conversion efficiency upon folding of around 50%, lower than the theoretical limit of 70%, but much higher than human built macroscopic machines. We propose a simple mapping between molecular information theory and energy landscape theory and explore the connections between sequence evolution, configurational entropy and the energetics of protein folding.

Ignacio E. Sánchez↗
NASA NTRS1992

Algorithmic information theory and the hidden variable question

The admissibility of certain nonlocal hidden-variable theories are explained via information theory. Consider a pair of Stern-Gerlach devices with fixed nonparallel orientations that periodically perform spin measurements on identically prepared pairs of electrons in the singlet spin state. Suppose the outcomes are recorded as binary strings l and r (with l sub n and r sub n denoting their n-length prefixes). The hidden-variable theories considered here require that there exists a recursive function which may be used to transform l sub n into r sub n for any n. This note demonstrates that such a theory cannot reproduce all the statistical predictions of quantum mechanics. Specifically, consider an ensemble of outcome pairs (l,r). From the associated probability measure, the Shannon entropies H sub n and H bar sub n for strings l sub n and pairs (l sub n, r sub n) may be formed. It is shown that such a theory requires that the absolute value of H bar sub n - H sub n be bounded - contrasting the quantum mechanical prediction that it grow with n.

Fuchs, Christopher↗
NASA NTRS1979

Information Theory and the Earth's Density Distribution

An argument for using the information theory approach as an inference technique in solid earth geophysics. A spherically symmetric density distribution is derived as an example of the method. A simple model of the earth plus knowledge of its mass and moment of inertia lead to a density distribution which was surprisingly close to the optimum distribution. Future directions for the information theory approach in solid earth geophysics as well as its strengths and weaknesses are discussed.

Rubincam, D. P.↗
NASA NTRS1978

Information theory and the earth's density distribution

The present paper argues for using the information theory approach as an inference technique in solid earth geophysics. A spherically symmetric density distribution is derived as an example of the method. A simple model of the earth plus knowledge of its mass and moment of inertia leads to a density distribution. Future directions for the information theory approach in solid earth geophysics as well as its strengths and weaknesses are discussed.

Rubincam, D. P.↗
NASA NTRS1992

An information theory approach for evaluating earth radiation budget (ERB) measurements - Nonuniform sampling of reflected shortwave radiation

An information theory approach to examine the temporal nonuniform sampling characteristics of shortwave (SW) flux for earth radiation budget (ERB) measurements is suggested. The information gain is computed by computing the information content before and after the measurements. A stochastic diurnal model for the SW flux is developed, and measurements for different orbital parameters are examined. The methodology is applied to specific NASA Polar platform and Tropical Rainfall Measuring Mission (TRMM) orbital parameters. The information theory approach, coupled with the developed SW diurnal model, is found to be promising for measurements involving nonuniform orbital sampling characteristics.

Barkstrom, Bruce R.↗
NASA NTRS1977

An information theory approach to the density of the earth

Information theory can develop a technique which takes experimentally determined numbers and produces a uniquely specified best density model satisfying those numbers. A model was generated using five numerical parameters: the mass of the earth, its moment of inertia, three zero-node torsional normal modes (L = 2, 8, 26). In order to determine the stability of the solution, six additional densities were generated, in each of which the period of one of the three normal modes was increased or decreased by one standard deviation. The superposition of the seven models is shown. It indicates that current knowledge of the torsional modes is sufficient to specify the density in the upper mantle but that the lower mantle and core will require smaller standard deviations before they can be accurately specified.

Graber, M. A.↗
NASA NTRS1981

Application of information theory to the design of line-scan imaging systems

Information theory is used to formulate a single figure of merit for assessing the performance of line scan imaging systems as a function of their spatial response (point spread function or modulation transfer function), sensitivity, sampling and quantization intervals, and the statistical properties of a random radiance field. Computational results for the information density and efficiency (i.e., the ratio of information density to data density) are intuitively satisfying and compare well with experimental and theoretical results obtained by earlier investigators concerned with the performance of TV systems.

Huck, F. O.↗
NASA NTRS1983

Information theory analysis of sensor-array imaging systems for computer vision

Information theory is used to assess the performance of sensor-array imaging systems, with emphasis on the performance obtained with image-plane signal processing. By electronically controlling the spatial response of the imaging system, as suggested by the mechanism of human vision, it is possible to trade-off edge enhancement for sensitivity, increase dynamic range, and reduce data transmission. Computational results show that: signal information density varies little with large variations in the statistical properties of random radiance fields; most information (generally about 85 to 95 percent) is contained in the signal intensity transitions rather than levels; and performance is optimized when the OTF of the imaging system is nearly limited to the sampling passband to minimize aliasing at the cost of blurring, and the SNR is very high to permit the retrieval of small spatial detail from the extensively blurred signal. Shading the lens aperture transmittance to increase depth of field and using a regular hexagonal sensor-array instead of square lattice to decrease sensitivity to edge orientation also improves the signal information density up to about 30 percent at high SNRs.

Huck, F. O.↗
NASA NTRS1991

An information theory approach for evaluating earth radiation budget (ERB) measurements - Nonuniform sampling of diurnal longwave flux variations

Satellite measurements are subject to a wide range of uncertainties due to their temporal, spatial, and directional sampling characteristics. An information-theory approach is suggested to examine the nonuniform temporal sampling of ERB measurements. The information (i.e., its entropy or uncertainty) before and after the measurements is determined, and information gain (IG) is defined as a reduction in the uncertainties involved. A stochastic model for the diurnal outgoing flux variations that affect the ERB is developed. Using Gaussian distributions for the a priori and measured radiant exitance fields, the IG is obtained by computing the a posteriori covariance. The IG for the monthly outgoing flux measurements is examined for different orbital parameters and orbital tracks, using the Earth Observing System orbital parameters as specific examples. Variations in IG due to changes in the orbit's inclination angle and the initial ascending node local time are investigated.

Halyo, Nesim↗