Search NASA⌕ Search

SEARCH · Search NASA

Results for “Information theory entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Comparison of the information contents of Landsat TM and MSS data

A communications-theory approach is taken to analyze the dispersion and concentration of signal values in various data spaces, irrespective of specific class membership. Entropy is used to quantify information, and mutual information is used to measure the information represented by subsets of spectral variables. Several different comparisons of information content are made. These include comparisons of system design capacities, of data volumes occupied by agricultural data in the spaces defined by original bands and by transformed spectral (Tasseled Cap) variables, of the information contents of original bands and Tasseled Cap variables, and of the information contents of TM and MSS for the given agricultural data sets. Also, the effects of sample size, scene content, and quantization level are examined.

Malila, W. A.↗

Comparison of the information contents of LANDSAT TM and MSS data

A communications-theory approach is taken to analyze the dispersion and concentration of signal values in various data spaces, irrespective of specific class membership. Entropy is used to quantify information, and mutual information is used to measure the information represented by subsets of spectral variables. Several different comparisons of information content are made. These include comparisons of system design capacities, of data volumes occupied by agricultural data in the spaces defined by original bands and by transformed spectral (Tasseled Cap) variables, of the information contents of original bands and Tasseled Cap variables, and of the information contents of TM and MSS for the given agricultural data sets. Also, the effects of sample size, scene content, and quantization level are examined.

Malila, W. A.↗

Mutual information superadditivity and unitarity bounds

We derive the property of strong superadditivity of mutual information arising from the Markov property of the vacuum state in a conformal field theory and strong subadditivity of entanglement entropy. We show this inequality encodes unitarity bounds for different types of fields. These unitarity bounds are precisely the ones that saturate for free fields. This has a natural explanation in terms of the possibility of localizing algebras on null surfaces. A particular continuity property of mutual information characterizes free fields from the entropic point of view. We derive a general formula for the leading long distance term of the mutual information for regions of arbitrary shape which involves the modular flow of these regions. We obtain the general form of this leading term for two spheres with arbitrary orientations in spacetime, and for primary fields of any tensor representation. For free fields we further obtain the explicit form of the leading term for arbitrary regions with boundaries on null cones.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Study of Feature Extraction Using Divergence Analysis of Texture Features

An empirical study of texture analysis for feature extraction and classification of high spatial resolution remotely sensed imagery (10 meters) is presented in terms of specific land cover types. The principal method examined is the use of spatial gray tone dependence (SGTD). The SGTD method reduces the gray levels within a moving window into a two-dimensional spatial gray tone dependence matrix which can be interpreted as a probability matrix of gray tone pairs. Haralick et al (1973) used a number of information theory measures to extract texture features from these matrices, including angular second moment (inertia), correlation, entropy, homogeneity, and energy. The derivation of the SGTD matrix is a function of: (1) the number of gray tones in an image; (2) the angle along which the frequency of SGTD is calculated; (3) the size of the moving window; and (4) the distance between gray tone pairs. The first three parameters were varied and tested on a 10 meter resolution panchromatic image of Maryville, Tennessee using the five SGTD measures. A transformed divergence measure was used to determine the statistical separability between four land cover categories forest, new residential, old residential, and industrial for each variation in texture parameters.

Hallada, W. A.↗

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

Entanglement Cost for Infinite-Dimensional Physical Systems

We prove that the entanglement cost equals the regularized entanglement of formation for any infinite-dimensional quantum state ρ ΑΒ with finite quantum entropy on at least one of the subsystems A or B. This generalizes a foundational result in quantum information theory that was previously formulated only for operations and states on finite-dimensional systems. The extension to infinite-dimensional systems is nontrivial because the conventional tools for establishing both the direct and converse bounds, i.e., strong typicality, monotonicity, and asymptotic continuity, are no longer directly applicable. To address this problem, we construct a new entanglement dilution protocol for infinite-dimensional states implementable by local operations and a finite amount of one-way classical communication (one-way LOCC), using weak and strong typicality multiple times. We also prove the optimality of this protocol among all protocols, even under infinite-dimensional separable operations, by developing an argument based on alternative forms of monotonicity and asymptotic continuity of the entanglement of formation for infinite-dimensional states. Along the way, we derive a new integral representation for the quantum entropy of infinite-dimensional states, which we believe to be of independent interest. Our results allow us to fully characterize an important operational entanglement measure—the entanglement cost—for all infinite-dimensional physical systems.

Complexity↗

An information theory approach for evaluating earth radiation budget (ERB) measurements - Nonuniform sampling of diurnal longwave flux variations

Satellite measurements are subject to a wide range of uncertainties due to their temporal, spatial, and directional sampling characteristics. An information-theory approach is suggested to examine the nonuniform temporal sampling of ERB measurements. The information (i.e., its entropy or uncertainty) before and after the measurements is determined, and information gain (IG) is defined as a reduction in the uncertainties involved. A stochastic model for the diurnal outgoing flux variations that affect the ERB is developed. Using Gaussian distributions for the a priori and measured radiant exitance fields, the IG is obtained by computing the a posteriori covariance. The IG for the monthly outgoing flux measurements is examined for different orbital parameters and orbital tracks, using the Earth Observing System orbital parameters as specific examples. Variations in IG due to changes in the orbit's inclination angle and the initial ascending node local time are investigated.

Halyo, Nesim↗

Horocycle regulator: Exact cutoff-independence in AdS/CFT

While the entanglement entropy of a single subregion in quantum field theory is formally infinite and requires regularization, certain combinations of entropies are perfectly finite in the limit that the regulator is removed, the mutual information being a common example. For generic regulator schemes, such as a holographic calculation with a uniform radial cutoff, these quantities show nontrivial dependence on the regulator at finite values of the cutoff. We investigate a holographic regularization scheme defined in three-dimensional anti-de Sitter space constructed from , curves in two-dimensional hyperbolic space perpendicular to all geodesics approaching a single point on the boundary, that leads to finite information measures that are cutoff independent, even at finite values of the regulator. We describe a broad class of such information measures, and describe how the field theory dual to the horocycle regulator is inherently nonlocal. Published by the American Physical Society 2024

Agrawal, Sristy↗

Perturbation theory for the logarithm of a positive operator

In various contexts in mathematical physics, such as out-of-equilibrium physics and the asymptotic information theory of many-body quantum systems, one needs to compute the logarithm of a positive unbounded operator. Examples include the von Neumann entropy of a density matrix and the flow of operators with the modular Hamiltonian in the Tomita-Takesaki theory. Often, one encounters the situation where the operator under consideration, which we denote by ∆, can be related by a perturbative series to another operator ∆ 0 , whose logarithm is known. We set up a perturbation theory for the logarithm log ∆. It turns out that the terms in the series possess a remarkable algebraic structure, which enables us to write them in the form of nested commutators plus some “contact terms”.

97 MATHEMATICS AND COMPUTING↗

Information transfer with a twist

Holographic duals for CFTs compactified on a Riemann surface Σ with a twist are cast in the language of wedge holography. Σ starts as part of the field theory geometry in the UV and becomes part of the internal space in the IR. This allows to associate entanglement entropies with splits of the internal space in the IR geometry. Decomposing the internal space in the IR and geometrizing the corresponding subsystems separately leads to two interacting gravitational systems, similar to the intermediate holographic description in braneworld models. For Σ = T 2 the setups are used to model information transfer from a black hole to a gravitating bath. This leads to Page curves with a phase structure which precisely mirrors that in braneworld models. The transition from geometric to non-geometric entropies is also discussed for Σ = S 2 as a model for more general internal spaces in AdS/CFT.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Black hole entropy from soft hair

We start by looking at why we believe that black holes have entropy. According to Boltzmann, the entropy is a measure of the number of microstates of a system. We suggest here that the entropy arises from a holographic conformal field theory on the black hole horizon. Finally, we discuss some of the implications for the information paradox.

Astronomy & Astrophysics↗

Replica wormhole and information retrieval in the SYK model coupled to Majorana chains

Motivated by recent studies of the information paradox in (1+1)-D anti-de Sitter spacetime with a bath described by a (1+1)-D conformal field theory, we study the dynamics of second Ŕenyi entropy of the Sachdev-Ye-Kitaev (SYK) model (χ) coupled to a Majorana chain bath (ψ). The system is prepared in the thermofield double (TFD) state and then evolved by HL + HR. For small system-bath coupling, we find that the second Rényi entropy $S^(2)_{χL,χR}$ of the SYK model undergoes a first order transition during the evolution. In the sense of holographic duality, the long-time solution corresponds to a “replica wormhole”. The transition time corresponds to the Page time of a black hole coupled to a thermal bath. We further study the information scrambling and retrieval by introducing a classical control bit, which controls whether or not we add a perturbation in the SYK system. The mutual information between the bath and the control bit shows a positive jump at the Page time, indicating that the entanglement wedge of the bath includes an island in the holographic bulk.

1/N Expansion↗

Entanglement phase transitions in random stabilizer tensor networks

Here we explore a class of random tensor network models with “stabilizer” local tensors which we name random stabilizer tensor networks (RSTNs). For RSTNs defined on a two-dimensional square lattice, we perform extensive numerical studies of entanglement phase transitions between volume-law and area-law entangled phases of the one-dimensional boundary states. These transitions occur when either (a) the bond dimension D of the constituent tensors is varied or (b) the tensor network is subject to random breaking of bulk bonds, implemented by forced measurements. In the absence of broken bonds, we find that the RSTN supports a volume-law entangled boundary state with bond dimension D ≥ 3 where D is a prime number, and an area-law entangled boundary state for D = 2. Upon breaking bonds at random in the bulk with probability p, there exists a critical measurement rate p c for each D ≥ 3 above which the boundary state becomes area-law entangled. To explore the conformal invariance at these entanglement transitions for different prime D, we consider tensor networks on a finite rectangular geometry with a variety of boundary conditions, and extract universal operator scaling dimensions via extensive numerical calculations of the entanglement entropy, mutual information, and mutual negativity at their respective critical points. Our results at large D approach known universal data of percolation conformal field theory, while showing clear discrepancies at smaller D, suggesting a distinct entanglement transition universality class for each prime D. We further study universal entanglement properties in the volume-law phase and demonstrate quantitative agreement with the recently proposed description in terms of a directed polymer in a random environment.

36 MATERIALS SCIENCE↗

Investigation of Causal Relationships of the Cross‐Scale Wave Coupling Through Information Theoretical Approach

On 2015 October 2, MMS spacecraft observed an electron micro-injection event near the southern hemispheric high-altitude cusp, coinciding with intense wave activity across several frequency bands. Here, we investigated the MMS magnetic field and plasma during this event to explore cross-scale coupling among the wave modes. Employing the Hilbert-Huang transform, we perform an empirical mode decomposition to extract frequencies and amplitudes of the intrinsic mode functions (IMFs). In this analysis, we establish both linear and nonlinear relationships and examine the information transfer between the IMFs. Notably, the transfer entropy suggests that high frequency ion cyclotron waves may be driven by the mirror mode structures. Our case study effectively demonstrates the utility of the information theory based tools for studying cross-scale wave coupling phenomena.

Rivera, Elmer C. [Andrews University, Berrien Spri↗

Frustrated mixed-spin ladders: Evidence for a bond-order wave phase between rung-singlet and Haldane phases

In frustrated spin ladders, the interplay of frustration and correlations leads to the familiar Haldane (H) and rung-singlet (RS) phases. The nature of the transition between these two phases is still under debate. In this paper we tackle this issue using tools of quantum information theory. We consider frustrated mixed-spin-(1, 1/2) ladders with antiferromagnetic leg, rung and diagonal couplings, and calculate various quantities, such as the entanglement entropy (EE), the Schmidt gap, and the level degeneracy of the entanglement spectrum (ES). We use two numerical techniques, the infinite time-evolving block decimation (iTEBD) and the density matrix renormalization group (DMRG). We demonstrate that there exists an intermediate phase in which the ES levels do not exhibit the characteristic degeneracies of the H and RS phases. To understand the underlying physics in this phase, here we investigate short-range spin correlations along legs, rungs and diagonals and show that in this intermediate phase long-wavelength modulations occur, akin to bond-order waves.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Slow thermalization and subdiffusion in $U$(1) conserving Floquet random circuits

Random quantum circuits are paradigmatic models of minimally structured and analytically tractable chaotic dynamics. We study a family of Floquet unitary circuits with Haar random U(1) charge conserving dynamics; the minimal such model has nearest-neighbor gates acting on spin-1/2 qubits, and a single layer of even/odd gates repeated periodically in time. We find that this minimal model is not robustly thermalizing at numerically accessible system sizes, and displays slow subdiffusive dynamics for long times. We map out the thermalization dynamics in a broader parameter space of charge conserving circuits, and understand the origin of the slow dynamics in terms of proximate localized and integrable regimes in parameter space. In contrast, we find that small extensions to the minimal model are sufficient to achieve robust thermalization; these include (i) increasing the interaction range to three-site gates, (ii) increasing the local Hilbert space dimension by appending an additional unconstrained qubit to the conserved charge on each site, or (iii) using a larger Floquet period comprised of two independent layers of gates. Furthermore, our results should inform future studies of charge conserving circuits, which are relevant for a wide range of topical theoretical questions.

1-dimensional spin chains↗

Generalised squeezing and information theory approach to quantum entanglement

It is shown that the usual one- and two-mode squeezing are based on reducible representations of the SU(1,1) group. Generalized squeezing is introduced with the use of different SU(1,1) rotations on each irreducible sector. Two-mode squeezing entangles the modes and information theory methods are used to study this entanglement. The entanglement of three modes is also studied with the use of the strong subadditivity property of the entropy.

Vourdas, A.↗