Search NASA⌕ Search

SEARCH · Search NASA

Results for “Information theory entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The entropy of galaxy spectra: how much information is encoded?

Abstract The inverse problem of extracting the stellar population content of galaxy spectra is analysed here from a basic standpoint based on information theory. By interpreting spectra as probability distribution functions, we find that galaxy spectra have high entropy, thus leading to a rather low effective information content. The highest variation in entropy is unsurprisingly found in regions that have been well studied for decades with the conventional approach. We target a set of six spectral regions that show the highest variation in entropy – the 4000 Å break being the most informative one. As a test case with real data, we measure the entropy of a set of high-quality spectra from the Sloan Digital Sky Survey, and contrast entropy-based results with the traditional method based on line strengths. The data are classified into star-forming (SF), quiescent (Q), and active galactic nucleus (AGN) galaxies, and show – independently of any physical model – that AGN spectra can be interpreted as a transition between SF and Q galaxies, with SF galaxies featuring a more diverse variation in entropy. The high level of entanglement complicates the determination of population parameters in a robust, unbiased way, and affects traditional methods that compare models with observations, as well as machine learning (especially deep learning) algorithms that rely on the statistical properties of the data to assess the variations among spectra. Entropy provides a new avenue to improve population synthesis models so that they give a more faithful representation of real galaxy spectra.

Ferreras, Ignacio (ORCID:0000000345843127)↗
DOE OSTI2021

Entanglement in Gravity and Quantum Field Theory (Final Report)

It is becoming increasingly clear that ideas from quantum information theory, particularly the notion of quantum entanglement, play a fundamental role in some of the deepest aspects of our modern theories of quantum fields and gravity. The aim of this research was to explore the role that quantum entanglement plays in quantum field theories and in the nature of space-time and gravity. Building on a variety of earlier results obtained in these regards at the University of Illinois, we explored the constraints on the dynamical content of quantum field theories that follow from their entanglement properties. Topological field theories are important examples of particularly simple quantum field theories whose patterns of entanglement make connections between high energy physics, condensed matter physics and mathematics. These theories are directly relevant to low energy properties of certain materials. The study of such theories allowed us to investigate ideas that are relevant to quantum information research, such as new notions of entanglement between multiple parties and the quantum properties of interfaces between different phases of such materials. In addition, we employed new results in mathematics which strengthen monotonicity constraints on relative entropy to study their ramifications in quantum field theories, and we used quantum information methods to study the emergence of quantum gravity and string theory in holographic quantum field theories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Time dependence of reflected entropy in rational and holographic conformal field theories

We calculate the time dependence of the reflected entropy of two disconnected regions after a global quench in (1 + 1)-dimensional conformal field theories and in large temperature limit. For rational conformal field theories, we find that the time evolution of the reflected entropy is the same as that of the mutual information. We get the same result for holographic theories in the limit where the separation between disconnected regions is much smaller than their respective sizes. We discuss how this result is consistent with the quasi-particle picture of Calabrese and Cardy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗
DOE OSTI2020

The dual of non-extremal area: differential entropy in higher dimensions

The Ryu-Takayanagi formula relates entanglement entropy in a field theory to the area of extremal surfaces anchored to the boundary of a dual AdS space. It is interesting to ask if there is also an information theoretic interpretation of the areas of non-extremal surfaces that are not necessarily boundary-anchored. In general, the physics outside such surfaces is associated to observers restricted to a time-strip in the dual boundary field theory. When the latter is two-dimensional, it is known that the differential entropy associated to the strip computes the length of the dual bulk curve, and has an interpretation in terms of the information cost in Bell pairs of restoring correlations inaccessible to observers in the strip. A general realization of this formalism in higher dimensions is unknown. We first prove a no-go theorem eliminating candidate expressions for higher dimensional differential entropy based on entropic c-theorems. Then we propose a new formula in terms of an integral of shape derivatives of the entanglement entropy of ball shaped regions. Our proposal stems from the physical requirement that differential entropy must be locally finite and conformally invariant. Demanding cancelation of the well-known UV divergences of entanglement entropy in field theory guides us to our conjecture, which we test for surfaces in AdS 4 . Our results suggest a candidate c-function for field theories in arbitrary dimensions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Environmental Controls on Water Vapor Deuterium Excess in the Coastal Boundary Layer: An Information Theory Perspective

We use information theory to quantify the environmental controls on water vapor deuterium excess (D-excess) in coastal Southern California from June 2023 through February 2024. Using Shannon entropy, mutual information (MI), and joint mutual information, metrics that capture both linear and nonlinear relationships, we identify the most informative variables and variable combinations governing D-excess across contrasting marine and continental regimes. Relative humidity with respect to sea surface temperature (RHS) is consistently the strongest individual predictor, explaining up to 27% of D-excess variability during marine conditions but only 10% in continental air masses. The Relative humidity(RHS) + sea surface temperature (SST) combination demonstrates synergistic effects, where their joint influence (explaining up to 36% of D-excess variability) exceeds what either variable achieves individually, confirming their coupled influence on deuterium excess. Wind direction complements RHS most effectively during continental conditions. The best three-variable combination (RHS + SST + Planetary Boundary Layer height) explains 38% of D-excess variability in marine air, while no combination exceeds 20% explanatory power during continental periods. Information theory shows that heteroscedasticity in D-excess relationships indicates regime shifts in controlling processes and quantifies fundamental constraints on predictor variables: some environmental factors like surface pressure or water vapor flux contain insufficient information content to explain D-excess variability regardless of their physical relevance. These results highlight the different predictability limits between marine and continental regimes, challenging the adequacy of linear models and providing a rigorous framework for quantifying the information content of isotope-climate relationships with implications for both modern and paleoclimate applications.

information theory↗
DOE OSTI2024

The expressivity of classical and quantum neural networks on entanglement entropy

Abstract Analytically continuing the von Neumann entropy from Rényi entropies is a challenging task in quantum field theory. While then-th Rényi entropy can be computed using the replica method in the path integral representation of quantum field theory, the analytic continuation can only be achieved for some simple systems on a case-by-case basis. In this work, we propose a general framework to tackle this problem using classical and quantum neural networks with supervised learning. We begin by studying several examples with known von Neumann entropy, where the input data is generated by representing$${\text {Tr}}\rho _A^n$$ Tr ρ A n with a generating function. We adopt KerasTuner to determine the optimal network architecture and hyperparameters with limited data. In addition, we frame a similar problem in terms of quantum machine learning models, where the expressivity of the quantum models for the entanglement entropy as a partial Fourier series is established. Our proposed methods can accurately predict the von Neumann and Rényi entropies numerically, highlighting the potential of deep learning techniques for solving problems in quantum information theory.

Physics↗
DOE OSTI2021

Mutual information superadditivity and unitarity bounds

We derive the property of strong superadditivity of mutual information arising from the Markov property of the vacuum state in a conformal field theory and strong subadditivity of entanglement entropy. We show this inequality encodes unitarity bounds for different types of fields. These unitarity bounds are precisely the ones that saturate for free fields. This has a natural explanation in terms of the possibility of localizing algebras on null surfaces. A particular continuity property of mutual information characterizes free fields from the entropic point of view. We derive a general formula for the leading long distance term of the mutual information for regions of arbitrary shape which involves the modular flow of these regions. We obtain the general form of this leading term for two spheres with arbitrary orientations in spacetime, and for primary fields of any tensor representation. For free fields we further obtain the explicit form of the leading term for arbitrary regions with boundaries on null cones.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Entanglement Cost for Infinite-Dimensional Physical Systems

We prove that the entanglement cost equals the regularized entanglement of formation for any infinite-dimensional quantum state ρ ΑΒ with finite quantum entropy on at least one of the subsystems A or B. This generalizes a foundational result in quantum information theory that was previously formulated only for operations and states on finite-dimensional systems. The extension to infinite-dimensional systems is nontrivial because the conventional tools for establishing both the direct and converse bounds, i.e., strong typicality, monotonicity, and asymptotic continuity, are no longer directly applicable. To address this problem, we construct a new entanglement dilution protocol for infinite-dimensional states implementable by local operations and a finite amount of one-way classical communication (one-way LOCC), using weak and strong typicality multiple times. We also prove the optimality of this protocol among all protocols, even under infinite-dimensional separable operations, by developing an argument based on alternative forms of monotonicity and asymptotic continuity of the entanglement of formation for infinite-dimensional states. Along the way, we derive a new integral representation for the quantum entropy of infinite-dimensional states, which we believe to be of independent interest. Our results allow us to fully characterize an important operational entanglement measure—the entanglement cost—for all infinite-dimensional physical systems.

Complexity↗
DOE OSTI2024

Horocycle regulator: Exact cutoff-independence in AdS/CFT

While the entanglement entropy of a single subregion in quantum field theory is formally infinite and requires regularization, certain combinations of entropies are perfectly finite in the limit that the regulator is removed, the mutual information being a common example. For generic regulator schemes, such as a holographic calculation with a uniform radial cutoff, these quantities show nontrivial dependence on the regulator at finite values of the cutoff. We investigate a holographic regularization scheme defined in three-dimensional anti-de Sitter space constructed from , curves in two-dimensional hyperbolic space perpendicular to all geodesics approaching a single point on the boundary, that leads to finite information measures that are cutoff independent, even at finite values of the regulator. We describe a broad class of such information measures, and describe how the field theory dual to the horocycle regulator is inherently nonlocal. Published by the American Physical Society 2024

Agrawal, Sristy↗
DOE OSTI2023

Perturbation theory for the logarithm of a positive operator

In various contexts in mathematical physics, such as out-of-equilibrium physics and the asymptotic information theory of many-body quantum systems, one needs to compute the logarithm of a positive unbounded operator. Examples include the von Neumann entropy of a density matrix and the flow of operators with the modular Hamiltonian in the Tomita-Takesaki theory. Often, one encounters the situation where the operator under consideration, which we denote by ∆, can be related by a perturbative series to another operator ∆ 0 , whose logarithm is known. We set up a perturbation theory for the logarithm log ∆. It turns out that the terms in the series possess a remarkable algebraic structure, which enables us to write them in the form of nested commutators plus some “contact terms”.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Information transfer with a twist

Holographic duals for CFTs compactified on a Riemann surface Σ with a twist are cast in the language of wedge holography. Σ starts as part of the field theory geometry in the UV and becomes part of the internal space in the IR. This allows to associate entanglement entropies with splits of the internal space in the IR geometry. Decomposing the internal space in the IR and geometrizing the corresponding subsystems separately leads to two interacting gravitational systems, similar to the intermediate holographic description in braneworld models. For Σ = T 2 the setups are used to model information transfer from a black hole to a gravitating bath. This leads to Page curves with a phase structure which precisely mirrors that in braneworld models. The transition from geometric to non-geometric entropies is also discussed for Σ = S 2 as a model for more general internal spaces in AdS/CFT.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Black hole entropy from soft hair

We start by looking at why we believe that black holes have entropy. According to Boltzmann, the entropy is a measure of the number of microstates of a system. We suggest here that the entropy arises from a holographic conformal field theory on the black hole horizon. Finally, we discuss some of the implications for the information paradox.

Astronomy & Astrophysics↗
DOE OSTI2020

Replica wormhole and information retrieval in the SYK model coupled to Majorana chains

Motivated by recent studies of the information paradox in (1+1)-D anti-de Sitter spacetime with a bath described by a (1+1)-D conformal field theory, we study the dynamics of second Ŕenyi entropy of the Sachdev-Ye-Kitaev (SYK) model (χ) coupled to a Majorana chain bath (ψ). The system is prepared in the thermofield double (TFD) state and then evolved by HL + HR. For small system-bath coupling, we find that the second Rényi entropy $S^(2)_{χL,χR}$ of the SYK model undergoes a first order transition during the evolution. In the sense of holographic duality, the long-time solution corresponds to a “replica wormhole”. The transition time corresponds to the Page time of a black hole coupled to a thermal bath. We further study the information scrambling and retrieval by introducing a classical control bit, which controls whether or not we add a perturbation in the SYK system. The mutual information between the bath and the control bit shows a positive jump at the Page time, indicating that the entanglement wedge of the bath includes an island in the holographic bulk.

1/N Expansion↗
DOE OSTI2022

Entanglement phase transitions in random stabilizer tensor networks

Here we explore a class of random tensor network models with “stabilizer” local tensors which we name random stabilizer tensor networks (RSTNs). For RSTNs defined on a two-dimensional square lattice, we perform extensive numerical studies of entanglement phase transitions between volume-law and area-law entangled phases of the one-dimensional boundary states. These transitions occur when either (a) the bond dimension D of the constituent tensors is varied or (b) the tensor network is subject to random breaking of bulk bonds, implemented by forced measurements. In the absence of broken bonds, we find that the RSTN supports a volume-law entangled boundary state with bond dimension D ≥ 3 where D is a prime number, and an area-law entangled boundary state for D = 2. Upon breaking bonds at random in the bulk with probability p, there exists a critical measurement rate p c for each D ≥ 3 above which the boundary state becomes area-law entangled. To explore the conformal invariance at these entanglement transitions for different prime D, we consider tensor networks on a finite rectangular geometry with a variety of boundary conditions, and extract universal operator scaling dimensions via extensive numerical calculations of the entanglement entropy, mutual information, and mutual negativity at their respective critical points. Our results at large D approach known universal data of percolation conformal field theory, while showing clear discrepancies at smaller D, suggesting a distinct entanglement transition universality class for each prime D. We further study universal entanglement properties in the volume-law phase and demonstrate quantitative agreement with the recently proposed description in terms of a directed polymer in a random environment.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Investigation of Causal Relationships of the Cross‐Scale Wave Coupling Through Information Theoretical Approach

On 2015 October 2, MMS spacecraft observed an electron micro-injection event near the southern hemispheric high-altitude cusp, coinciding with intense wave activity across several frequency bands. Here, we investigated the MMS magnetic field and plasma during this event to explore cross-scale coupling among the wave modes. Employing the Hilbert-Huang transform, we perform an empirical mode decomposition to extract frequencies and amplitudes of the intrinsic mode functions (IMFs). In this analysis, we establish both linear and nonlinear relationships and examine the information transfer between the IMFs. Notably, the transfer entropy suggests that high frequency ion cyclotron waves may be driven by the mirror mode structures. Our case study effectively demonstrates the utility of the information theory based tools for studying cross-scale wave coupling phenomena.

Rivera, Elmer C. [Andrews University, Berrien Spri↗
DOE OSTI2022

Frustrated mixed-spin ladders: Evidence for a bond-order wave phase between rung-singlet and Haldane phases

In frustrated spin ladders, the interplay of frustration and correlations leads to the familiar Haldane (H) and rung-singlet (RS) phases. The nature of the transition between these two phases is still under debate. In this paper we tackle this issue using tools of quantum information theory. We consider frustrated mixed-spin-(1, 1/2) ladders with antiferromagnetic leg, rung and diagonal couplings, and calculate various quantities, such as the entanglement entropy (EE), the Schmidt gap, and the level degeneracy of the entanglement spectrum (ES). We use two numerical techniques, the infinite time-evolving block decimation (iTEBD) and the density matrix renormalization group (DMRG). We demonstrate that there exists an intermediate phase in which the ES levels do not exhibit the characteristic degeneracies of the H and RS phases. To understand the underlying physics in this phase, here we investigate short-range spin correlations along legs, rungs and diagonals and show that in this intermediate phase long-wavelength modulations occur, akin to bond-order waves.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗