Search NASA⌕ Search

SEARCH · Search NASA

Results for “relative entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Monitoring of Liquid Metal Reactor Heater Zones with Recurrent Neural Network Learning of Temperature Time Series

Advanced high-temperature fluid reactors (ARs), such as sodium fast reactors (SFRs) and molten salt cooled reactors (MSCRs) utilize high-temperature fluids at ambient pressure. To melt the fluid during reactor startup and prevent fluid freezing during cooldown, the thermal–hydraulic systems of such ARs include heater zones consisting of specific heaters with controllers, temperature sensors, and thermal insulation. The failure of heater zones due to insulation material degradation or improper installation, resulting in parasitic heat losses, can lead to fluid freezing. The detection of faults using a heat-transfer model is difficult because of a lack of knowledge of the experimental details. Data-driven machine learning of heater zone temperature time series offers a viable alternative. In this study, we benchmarked the performance of recurrent neural networks (RNNs) in an analysis of heat-up transient temperature time series of heater zones installed on a liquid sodium vessel. The RNN models include long short-term memory (LSTM) and gated recurrent unit (GRU) networks, as well as their bi-directional variants, BiLSTM and BiGRU. Anomalous temperature points were designated using a percentile-based threshold applied to residual fluctuations in the detrended temperature time series. Additionally, the impact of the exponentially weighted moving average (EWMA) method on detection accuracy was examined. The RNN models’ performance was assessed using precision, recall, and F 1 score metrics. Results demonstrated that RNN models effectively detect anomalies in temperature time series with the best models for each heater zone achieving F 1 scores of over 93%. To explain the variations in RNN model performance across different heater zones, we used Kullback–Leibler (KL) divergence to quantify the relative entropy between training and testing data, and the Detrended Fluctuation Analysis (DFA) to assess long-range temporal correlations. For datasets with strong long-range correlations and minimal relative entropy between training and testing data, GRU is the best-performing model. When the data exhibits weaker long-term correlations and a significant relative entropy between training and testing distributions, BiGRU shows the best performance. For the data sets with intermediate values of both KL divergence and DFA, the best performance is obtained with LSTM and BiLSTM, respectively.

gated recurrent unit↗
DOE OSTI2025

Entropy of the Quantum–Classical Interface: A Potential Metric for Security

Hybrid quantum–classical systems are emerging as key platforms in quantum computing, sensing, and communication technologies, but the quantum–classical interface (QCI)—the boundary enabling these systems—introduces unique and largely unexplored security vulnerabilities. This position paper proposes using entropy-based metrics to monitor and enhance security, specifically at the QCI. We present a theoretical security outline that leverages well-established information-theoretic entropy measures, such as Shannon entropy, von Neumann entropy, and quantum relative entropy, to detect anomalous behaviors and potential breaches at the QCI. By linking entropy fluctuations to scenarios of practical relevance—including quantum key distribution, quantum sensing, and hybrid control systems—we promote the potential value and applicability of entropy-based security monitoring. While explicitly acknowledging practical limitations and theoretical assumptions, we argue that entropy-based metrics provide a complementary approach to existing security methods, inviting further empirical studies and theoretical refinements that can strengthen future quantum technologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

An improved dataset for predicting mammal infecting viruses from genetic sequence information

There have been several attempts to develop machine learning (ML) models to identify human infecting viruses from their genomic sequences, with varying degrees of success. Direct comparison between models is problematic, because these models are typically trained and evaluated on different datasets with alternative data splitting schemes, features, and model performance metrics. In this paper we present a standardized dataset of mammal infecting and non-infecting viral pathogens, refined from the previous work of Mollentze et al. to include the latest literature evidence, roughly doubling the number of curated host-virus records available to the community, and new host target labels, primate and mammal. The new host labels were included for several reasons, including previous reports that classification performance is better at broader taxonomic ranks and the idea that there may be more data for primate infection that might serve as a suitable proxy for zoonotic potential and avoidance of false positives for human infection due to absence of evidence. On this dataset, we report the performance of eight machine learning models for predicting mammal-infecting viruses from their genomic sequences. We find that randomly assigning cases in our improved dataset to training/testing sets, when compared to the original assignments into training/testing in Mollentze et al., increases the overall average ROC AUC of prediction of human infection from 0.663 ± 0.070 to 0.784 ± 0.013, consistent with the reduction in phylogenetic distance between train and test sets (relative entropy change from 3.00 to 0.08). The broadest host category of mammal infection can be predicted most reliably at 0.850 ± 0.020. We share our improved dataset and code to enable standardized comparisons of machine learning methods to predict human host infections. Overall, we have presented preliminary evidence that classification of virus host infection is more tractable at higher taxonomic ranks, that unsurprisingly reducing the phylogenetic distance between training and test sets can improve predictive performance, that peptide kmer features appear to be harmful to out of sample model performance, and we are left with the question of whether models for virus host prediction can reasonably be expected to perform well in out of sample scenarios given the likelihood that viruses do not share a common ancestor. Consistent with this concern, when the data is resampled such that there is no overlap between viral families in training and test sets (relative entropy > 24), models perform no better than random chance at prediction of human infection regardless of whether kmers are included (ROC AUC 0.50 ± 0.08) or not (ROC AUC 0.50 ± 0.04).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Nonperturbative gravity corrections to bulk reconstruction

Abstract We introduce a new algebraic framework for understanding nonperturbative gravitational aspects of bulk reconstruction with a finite or infinite-dimensional boundary Hilbert space. We use relative entropy equivalence between bulk and boundary with an inclusion of nonperturbative gravitational errors, which give rise to approximate recovery. We utilize the privacy/correctability correspondence to prove that the reconstruction wedge, the intersection of all entanglement wedges in pure and mixed states, manifestly satisfies bulk reconstruction. We explicitly demonstrate that local operators in the reconstruction wedge of a given boundary region can be recovered in a state-independent way for arbitrarily large code subspaces, up to nonperturbative errors in G N . We further discuss state-dependent recovery beyond the reconstruction wedge and the use of the twirled Petz map as a universal recovery channel. We discuss our setup in the context of quantum islands and the information paradox.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Absolute entropy and the observer’s no-boundary state

We investigate the no-boundary proposal for closed universes with an observer. We argue that the observer’s no-boundary state is the identity operator on the physical Hilbert space, i.e., the maximum entropy state and show this explicitly in Jackiw-Teitelboim gravity. Geometrically, the no-boundary state is a bra-ket wormhole. Expectation values in the no-boundary state provide a trace for the observer’s algebra, which allows one to define von Neumann entropy for observers in different universes as the relative entropy with respect to the no-boundary state. This result is consistent with all previously discussed cases of traces for invariantly defined regions.

Cosmological models↗
DOE OSTI2024

Entanglement entropy of a color flux tube in (2+1)D Yang-Mills theory

We construct a novel flux tube entanglement entropy (FTE 2 ), defined as the excess entanglement entropy relative to the vacuum of a region of color flux stretching between a heavy quark-anti-quark pair in pure gauge Yang-Mills theory. We show that FTE 2 can be expressed in terms of correlators of Polyakov loops, is manifestly gauge-invariant, and therefore free of the ambiguities in computations of the entanglement entropy in gauge theories related to the choice of the center algebra. Employing the replica trick, we compute FTE 2 for SU(2) Yang-Mills theory in (2+1)D and demonstrate that it is finite in the continuum limit. We explore the properties of FTE 2 for a half-slab geometry, which allows us to vary the width and location of the slab, and the extent to which the slab cross-cuts the color flux tube. Following the intuition provided by computations of FTE 2 in (1+1)D, and in a thin string model, we examine the extent to which our FTE 2 results can be interpreted as the sum of an internal color entropy and a vibrational entropy corresponding to the transverse excitations of the string.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Mixed Enthalpy–Entropy Descriptor for the Rational Design of Synthesizable High-Entropy Materials Over Vast Chemical Spaces

The practically unlimited high-dimensional composition space of high-entropy materials (HEMs) has emerged as an exciting platform for functional material design and discovery. However, the identification of stable and synthesizable HEMs and robust design rules remains a daunting challenge. Here, we propose a mixed enthalpy–entropy descriptor (MEED) that enables highly efficient, robust, high-throughput prediction of synthesizable HEMs across vast chemical spaces from first-principles. The MEED is based on two parameters: the relative formation enthalpy with respect to the most stable competing compound and the spread of the point-defect formation energy spectrum. The former measures the relative synthesizability of an HEM to its most stable competing phase, going beyond the conventional thermodynamic understanding. Further, the latter gauges the relative entropy forming ability of an HEM, entailing no sampling over numerous alloy configurations. By applying the MEED to two structurally distinct representative material systems (i.e., 3D rocksalt carbides and 2D layered sulfides), we not only successfully identify all experimentally reported HEMs within these systems but also reveal a cutoff criterion for assessing their relative synthesizability within each system. By the MEED, tens of new high-entropy carbides and 2D high-entropy sulfides are also predicted, which have the potential for a wide variety of applications such as coating in aerospace devices, energy conversion and storage, and flexible electronics.

36 MATERIALS SCIENCE↗
DOE OSTI2026

X-ray and γ-ray beam interstellar communication and implications for SETI

The possibility of detecting artificial signals transmitted by alien civilizations via collimated X-ray or gamma-ray beams is investigated. The prospect of using such beams for human communication within the solar system and beyond is also discussed. Detector responses were simulated for input signals and analyzed using relative entropy. For simplicity, all signals were assumed to use on-off keying (OOK) modulation. “Real” signals were generated by taking digital files and sequentially feeding their raw binary data to the detector simulator, the resulting normalized information content of the detector signals was plotted and compared to random noise signals. Since jpeg files contain compressed information, these served as a proxy for artificial alien signals. This showed that there is a clear difference in measured information content between natural and artificial signals, even with relatively poor time resolution in the detector causing the signals to be smeared (dead-time/rise-time intervals many times longer than the duration between signal pulses). It was found that so long as the signal lasts for at least several rise-time/dead-time intervals, the distinction between random and artificial signals is obvious. A space-telescope with high time resolution for searching for such signals is briefly described and its basic requirements are outlined.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Out-of-time-order correlators bridge classical transport and quantum dynamics

The out-of-time-order correlator (OTOC) has emerged as a central tool for quantifying decoherence across wide-ranging physical platforms. Here, we demonstrate its direct measurement in a classical ensemble using nuclear magnetic resonance with a modulated gradient spin echo sequence and extend the method into a multidimensional correlation to track exchange phenomena. Position is encoded through magnetic field gradients and momentum through the velocity autocorrelation function, enabling experimental access to OTOCs for proton motion confined within the self-similar lattice of the metal–organic framework MOF-808. Here, water confined to specified geometries within the MOF pores gives rise to spatially distinct diffusive eigenmodes with characteristic relative entropies. We demonstrate that periodic radio frequency driving combined with gradient modulation yields entropy evolution through the selection of distinct diffusion modes. Frequency-resolved diffusion spectra connect these entropy dynamics to classical heat exchange laws, revealing how operational features of quantum systems are mirrored in confined, macroscopic spin ensembles.

Fricke, Sophia N. [University of California, Berke↗
DOE OSTI2024

Cosmic neutrino decoupling and its observable imprints: insights from entropic-dual transport

Abstract Very different processes characterize the decoupling of neutrinos to form the cosmic neutrino background (CνB) and the much later decoupling of photons from thermal equilibrium to form the cosmic microwave background (CMB). The CνB emerges from the fuzzy, energy-dependent neutrinosphere and encodes the physics operating in the early universe in the temperature rangeT∼ 10 MeV toT∼ 10 keV. This is the epoch where beyond Standard Model (BSM) physics, especially in the neutrino sector, may be influential in setting the light element abundances, the necessarily distorted fossil neutrino energy spectra, and other light particle energy density contributions. Here we use techniques honed in extensive CMB studies to analyze the CνB as calculated in detailed neutrino energy transport and nuclear reaction simulations of the protracted weak decoupling and primordial nucleosynthesis epochs. Our moment method, relative entropy, and differential visibility approach can leverage future high precision CMB and light element primordial abundance measurements to provide new insights into the CνB and any BSM physics it encodes. We demonstrate that the evolution of the energy spectrum of the CνB throughout the weak decoupling epoch is accurately captured in the Standard Model by only three parameters per species, a non-trivial conclusion given the deviation from thermal equilibrium and the impact of the decrease of electron-positron pairs. Furthermore, we can interpret each of the three parameters as physical characteristics of a non-equilibrium system. Though the treatment presented here makes some simplifying assumptions including ignoring neutrino flavor oscillations, the success of our compact description within the Standard Model motivates its use also in BSM scenarios. We further demonstrate how observations of primordial light element abundances can be used to place constraints on the CνB energy spectrum, deriving response functions that can be applied for general deviations from a thermal spectrum. Combined with the description of those deviations that we develop here, our methods provide a convenient and powerful framework to constrain the impact of BSM physics on the CνB.

Astronomy & Astrophysics↗
DOE OSTI2024

Exploring the non-Gaussianity of the cosmic infrared background and its weak gravitational lensing

ABSTRACT Gravitational lensing deflects the paths of photons, altering the statistics of cosmic backgrounds and distorting their information content. We take the cosmic infrared background (CIB), which provides plentiful information about galaxy formation and evolution, as an example to probe the effect of lensing on non-Gaussian statistics. Using the Websky simulations, we first quantify the non-Gaussianity of the CIB, revealing additional detail on top of its well-measured power spectrum. To achieve this, we use needlet-like multipole-band filters to calculate the variance and higher-point correlations. Using our simulations, we show the two-, three- and four-point spectra, and compare our calculated power spectra and bispectra to Planck values. We then lens the CIB, shell-by-shell with corresponding convergence maps, to capture the broad redshift extent of both the CIB and its lensing convergence. The lensing of the CIB changes the three- and four-point functions by a few tens of per cent at large scales, unlike with the power spectrum, which changes by less than two per cent. We expand our analyses to encompass the full intensity probability distribution functions (PDFs) involving all n-point correlations as a function of scale. In particular, we use the relative entropy between lensed and unlensed PDFs to create a spectrum of templates that can allow estimation of lensing. The underlying CIB model is missing the important role of star bursting, which we test by adding a stochastic lognormal term to the intensity distributions. The novel aspects of our filtering and lensing pipeline should prove useful for any radiant background, including line intensity maps.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Diagnostics of Mixed-State Topological Order and Breakdown of Quantum Memory

Topological quantum memory can protect information against local errors up to finite error thresholds. Such thresholds are usually determined based on the success of decoding algorithms rather than the intrinsic properties of the mixed states describing corrupted memories. Here we provide an intrinsic characterization of the breakdown of topological quantum memory, which both gives a bound on the performance of decoding algorithms and provides examples of topologically distinct mixed states. We employ three information-theoretical quantities that can be regarded as generalizations of the diagnostics of ground-state topological order, and serve as a definition for topological order in error-corrupted mixed states. We consider the topological contribution to entanglement negativity and two other metrics based on quantum relative entropy and coherent information. In the concrete example of the two-dimensional (2D) Toric code with local bit-flip and phase errors, we map three quantities to observables in 2D classical spin models and analytically show they all undergo a transition at the same error threshold. This threshold is an upper bound on that achieved in any decoding algorithm and is indeed saturated by that in the optimal decoding algorithm for the Toric code. Published by the American Physical Society 2024

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Fast and converged classical simulations of evidence for the utility of quantum computing before fault tolerance

A recent quantum simulation of observables of the kicked Ising model on 127 qubits implemented circuits that exceed the capabilities of exact classical simulation. We show that several approximate classical methods, based on sparse Pauli dynamics and tensor network algorithms, can simulate these observables orders of magnitude faster than the quantum experiment and can also be systematically converged beyond the experimental accuracy. Our most accurate technique combines a mixed Schrödinger and Heisenberg tensor network representation with the Bethe free entropy relation of belief propagation to compute expectation values with an effective wave function–operator sandwich bond dimension >16,000,000, achieving an absolute accuracy, without extrapolation, in the observables of <0.01, which is converged for many practical purposes. We thereby identify inaccuracies in the experimental extrapolations and suggest how future experiments can be implemented to increase the classical hardness.

Science & Technology - Other Topics↗
DOE OSTI2026

Score-based deterministic density sampling

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density π given only its score ∇ log π. Our method approximates the Wasserstein gradient flow on KL($f_t$∥π) by learning the time-varying score ∇ log $f_t$ on the fly using score matching. While having the same marginal distribution as Langevin dynamics, our method produces smooth deterministic trajectories, resulting in monotone noise-free convergence. We prove that our method dissipates relative entropy at the same rate as the exact gradient flow, provided sufficient training. Numerical experiments validate our theoretical findings: our method converges at the optimal rate, has smooth trajectories, and is often more sample efficient than its stochastic counterpart. Experiments on high-dimensional image data show that our method produces high-quality generations in as few as 15 steps and exhibits natural exploratory behavior. The memory and runtime scale linearly in the sample size.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Probabilistic and maximum entropy modeling of chemical reaction systems: Characteristics and comparisons to mass action kinetic models

We demonstrate and characterize a first-principles approach to modeling the mass action dynamics of metabolism. Starting from a basic definition of entropy expressed as a multinomial probability density using Boltzmann probabilities with standard chemical potentials, we derive and compare the free energy dissipation and the entropy production rates. We express the relation between entropy production and the chemical master equation for modeling metabolism, which unifies chemical kinetics and chemical thermodynamics. Because prediction uncertainty with respect to parameter variability is frequently a concern with mass action models utilizing rate constants, we compare and contrast the maximum entropy model, which has its own set of rate parameters, to a population of standard mass action models in which the rate constants are randomly chosen. We show that a maximum entropy model is characterized by a high probability of free energy dissipation rate and likewise entropy production rate, relative to other models. We then characterize the variability of the maximum entropy model predictions with respect to uncertainties in parameters (standard free energies of formation) and with respect to ionic strengths typically found in a cell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Tightening the thermodynamic uncertainty relations with null-entropy events: What we learn when nothing happens

Fluctuation theorems establish that thermodynamic processes at the microscale can occasionally result in negative entropy production. At the microscale, another distinct possibility becomes more likely: processes where no entropy is produced overall. In this work, we explore the constraints imposed by such null-entropy events on the fluctuations of thermodynamic currents. By incorporating the probability of null-entropy events, we obtain tighter bounds on finite-time thermodynamic uncertainty relations derived from fluctuation theorems. We validate this framework using an example of a qudit SWAP engine.

FOS: Physical sciences↗
DOE OSTI2025

Elastic cross section is entanglement entropy

We present universal relations between entanglement entropy, which quantifies the quantum correlation between subsystems, and the cross section, which is the primary observable for high-energy particle scattering, by employing a careful formulation of wave packets for the incoming particles. For 2-to-2 elastic scattering with no initial entanglement and subdividing the system along particle labels, we show that both the Rényi and Tsallis entropies in the final states are directly proportional to the elastic cross section in units of the transverse size for the initial wave packets, which is then interpreted as the elastic scattering probability. The relations do not depend on the underlying dynamics of the quantum field theory and are valid to all orders in coupling strengths. Furthermore, computing quantum correlations between momentum and nonkinematic data leads to entanglement entropies expressed as various semi-inclusive elastic cross sections. Our result gives rise to a novel “area law” for entanglement entropy in a two-body system. Published by the American Physical Society 2025

Low, Ian (ORCID:0000000275709597)↗
DOE OSTI2023

A simple coin for a 2d entangled walk

We analyze the effect of a simple coin operator, built out of Bell pairs, in a 2d Discrete Quantum Random Walk (DQRW) problem. The specific form of the coin enables us to find analytical and closed form solutions to the recursion relations of the DQRW. The coin induces entanglement between the spin and position degrees of freedom, which oscillates with time and reaches a constant value asymptotically. We probe the entangling properties of the coin operator further, by two different measures. First, by integrating over the space of initial tensor product states, we determine the Entangling Power of the coin operator. Secondly, we compute the Generalized Relative Rényi Entropy between the corresponding density matrices for the entangled state and the initial pure unentangled state. Both the Entangling Power and Generalized Relative Rényi Entropy behaves similar to the entanglement with time. Finally, in the continuum limit, the specific coin operator reduces the 2d DQRW into two 1d massive fermions coupled to synthetic gauge fields, where both the mass term and the gauge fields are built out of the coin parameters.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗