Search NASA⌕ Search

SEARCH · Search NASA

Results for “Maximum Entropy Principle”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A model distribution function for relativistic bi-Maxwellian with drift

A model distribution function for relativistic bi-Maxwellian with drift is proposed, based on the maximum entropy principle and the relativistic canonical transformation. Since the obtained expression is compatible with the existing distribution functions and has a relatively simple form as well as smoothness, it might serve as a useful tool in the research fields of space or high temperature fusion plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling of dissociation and energy transfer in shock-heated nitrogen flows

This work addresses the modeling of dissociation and energy transfer processes in shock heated nitrogen flows by means of the maximum entropy linear model and a newly proposed hybrid bin vibrational collisional model. Both models aim at overcoming two of the main limitations of the state of the art non-equilibrium models: (i) the assumption of equilibrium between rotational and translational energy modes of the molecules and (ii) the reliance on the quasi-steady-state distribution for the description of the population of the internal levels. The formulation of the coarse-grained models is based on grouping the energy levels into bins, where the population is assumed to follow a Maxwell-Boltzmann distribution at its own temperature. Different grouping strategies are investigated. Following the maximum entropy principle, the governing equations are obtained by taking the zeroth and first-order moments of the rovibrational master equations. The accuracy of the proposed models is tested against the rovibrational master equation solution for both flow quantities and population distributions. Calculations performed for free-stream velocities ranging from 5 km/s to 10 km/s demonstrate that dissociation can be accurately predicted by using only 2-3 bins. It is also shown that a multi-temperature approach leads to an under-prediction of dissociation, due to the inability of the former to account for the faster excitation of high-lying vibrational states.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Note on one-fluid modeling of low-frequency Alfvénic fluctuations in a solar wind plasma with multi-ion components

A simple point of view that non-zero Alfvén ratio (residual energy) appears as a consequence of one-fluid modeling of uni-directional Alfvén waves in a solar wind plasma is presented. Since relative speeds among ions are incorporated into the one-fluid model as a pressure anisotropy, the Alfvén ratio can be finite due to the decrease in the phase velocity. It is shown that a proton beam component typically found in the solar wind plasma can contribute to generating non-zero Alfvén ratio observed in the solar wind plasma. Local equilibrium velocity distribution functions of each ion component are also discussed by using maximum entropy principle.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Local entropy of a nonequilibrium fermion system

The local entropy of a nonequilibrium system of independent fermions is investigated and analyzed in the context of the laws of thermodynamics. It is shown that the local temperature and chemical potential can only be expressed in terms of derivatives of the local entropy for linear deviations from local equilibrium. The first law of thermodynamics is shown to lead to an inequality, not equality, for the change in the local entropy as the nonequilibrium state of the system is changed. The maximum entropy principle (second law of thermodynamics) is proven: a nonequilibrium distribution has a local entropy less than or equal to a local equilibrium distribution satisfying the same constraints. It is shown that the local entropy of the system tends to zero when the local temperature tends to zero, consistent with the third law of thermodynamics

74 ATOMIC AND MOLECULAR PHYSICS↗

Stochastic fluctuations in relativistic fluids: Causality, stability, and the information current

We develop a general formalism for introducing stochastic fluctuations around thermodynamic equilibrium which takes into account, for the first time, recent developments in the causality and stability properties of relativistic hydrodynamic theories. The method is valid for any covariantly stable theory of relativistic viscous fluid dynamics derived from a covariant maximum entropy principle. We illustrate the formalism with some applications, showing how it could be used to consistently introduce fluctuations in a model of relativistic heat diffusion and in conformally invariant Israel-Stewart theory in a general hydrodynamic frame. Furthermore, the latter example is used to study the hydrodynamic frame dependence of the symmetric two-point function of fluctuations of the energy-momentum tensor.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantum maximum entropy closure for small flavor coherence

Quantum angular moment transport schemes are an important avenue toward describing neutrino flavor mixing phenomena in dense astrophysical environments such as supernovae and merging neutron stars. Successful implementation will require new closure relations that go beyond those used in classical transport. In this paper, we derive the first analytic expression for a quantum M1 closure, valid in the limit of small flavor coherence, based on the maximum entropy principle. We verify that the resulting closure relation has the appropriate limits and characteristic speeds in the diffusive and free-streaming regimes. We then use this new closure in a moment linear stability analysis to search for fast flavor instabilities in a binary neutron star merger simulation and find better results as compared with previously designed, ad hoc , semiclassical closures.

astrophysical & cosmological simulations↗

Prediction of Spatiotemporal Patterns of Neural Activity from Pairwise Correlations

We designed a model-based analysis to predict the occurrence of population patterns in distributed spiking activity. Using a maximum entropy principle with a Markovian assumption, we obtain a model that accounts for both spatial and temporal pairwise correlations among neurons. This model is tested on data generated with a Glauber spin-glass system and is shown to correctly predict the occurrence probabilities of spatiotemporal patterns significantly better than Ising models only based on spatial correlations. This increase of predictability was also observed on experimental data recorded in parietal cortex during slow-wave sleep. This approach can also be used to generate surrogates that reproduce the spatial and temporal correlations of a given data set.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Tissue Radiation Response with Maximum Tsallis Entropy

The expression of survival factors for radiation damaged cells is currently based on probabilistic assumptions and experimentally fitted for each tumor, radiation, and conditions. Here, we show how the simplest of these radiobiological models can be derived from the maximum entropy principle of the classical Boltzmann-Gibbs expression. We extend this derivation using the Tsallis entropy and a cutoff hypothesis, motivated by clinical observations. The obtained expression shows a remarkable agreement with the experimental data found in the literature.

60 APPLIED LIFE SCIENCES↗

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗

Boundary-induced classical generalized Gibbs ensemble with angular momentum

We investigate how confinement geometry leads to the emergence of a Generalized Gibbs Ensemble (GGE) in classical systems. Unlike the standard Gibbs ensemble, the GGE includes additional conserved quantities, such as angular momentum, that arise from boundary-induced symmetries. Using analytical arguments based on the maximum entropy principle, we show that circular boundaries preserve angular momentum and drive the system toward a chiral, non-ergodic GGE that violates time-reversal symmetry. This ensemble differs fundamentally from the Gibbs case, producing near-boundary condensation and revealing how geometry alone can alter thermal equilibration. To quantify these effects, we introduce an order parameter measuring deviations from Gibbs behavior and demonstrate that conventional Monte Carlo methods must incorporate angular momentum conservation under such conditions. Our study highlights how geometric constraints shape non-equilibrium statistical ensembles and lead to subtle departures from the Bohr-van Leeuwen theorem. These predictions are validated through detailed simulations of confined classical hard-disk gases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Efficient First-Order Algorithms for Large-Scale, Non-Smooth Maximum Entropy Models with Application to Wildfire Science

Maximum entropy (MaxEnt) models are a class of statistical models that use the maximum entropy principle to estimate probability distributions from data. Due to the size of modern data sets, MaxEnt models need efficient optimization algorithms to scale well for big data applications. State-of-the-art algorithms for MaxEnt models, however, were not originally designed to handle big data sets; these algorithms either rely on technical devices that may yield unreliable numerical results, scale poorly, or require smoothness assumptions that many practical MaxEnt models lack. In this paper, we present novel optimization algorithms that overcome the shortcomings of state-of-the-art algorithms for training large-scale, non-smooth MaxEnt models. Our proposed first-order algorithms leverage the Kullback–Leibler divergence to train large-scale and non-smooth MaxEnt models efficiently. For MaxEnt models with discrete probability distribution of n elements built from samples, each containing m features, the stepsize parameter estimation and iterations in our algorithms scale on the order of O(mn) operations and can be trivially parallelized. Moreover, the strong ℓ1 convexity of the Kullback–Leibler divergence allows for larger stepsize parameters, thereby speeding up the convergence rate of our algorithms. To illustrate the efficiency of our novel algorithms, we consider the problem of estimating probabilities of fire occurrences as a function of ecological features in the Western US MTBS-Interagency wildfire data set. Our numerical results show that our algorithms outperform the state of the art by one order of magnitude and yield results that agree with physical models of wildfire occurrence and previous statistical analyses of wildfire drivers.

Physics↗

Principle of Maximum Entanglement Entropy and Local Physics of Strongly Correlated Materials

We argue that, because of quantum entanglement, the local physics of strongly correlated materials at zero temperature is described in a very good approximation by a simple generalized Gibbs distribution, which depends on a relatively small number of local quantum thermodynamical potentials. We demonstrate that our statement is exact in certain limits and present numerical calculations of the iron compounds FeSe and FeTe and of the elemental cerium by employing the Gutzwiller approximation that strongly support our theory in general.

36 MATERIALS SCIENCE↗

Latent Laplacian Maximum Entropy Discrimination for Detection of High-Utility Anomalies

Data-driven anomaly detection methods suffer from the drawback of detecting all instances that are statistically rare, irrespective of whether the detected instances have realworld significance or not. In this paper, we are interested in the problem of specifically detecting anomalous instances that are known to have high real-world utility, while ignoring the low-utility statistically anomalous instances. To this end, we propose a novel method called Latent Laplacian Maximum Entropy Discrimination (LatLapMED) as a potential solution. This method uses the EM algorithm to simultaneously incorporate the Geometric Entropy Minimization principle for identifying statistical anomalies, and the Maximum Entropy Discrimination principle to incorporate utility labels, in order to detect highutility anomalies. Here, we apply our method in both simulated and real datasets to demonstrate that it has superior performance over existing alternatives that independently pre-process with unsupervised anomaly detection algorithms before classifying.

97 MATHEMATICS AND COMPUTING↗

Online Robot Dead Reckoning Localization Using Maximum Relative Entropy Optimization With Model Constraints

The principle of Maximum relative Entropy optimization was analyzed for dead reckoning localization of a rigid body when observation data of two attached accelerometers was collected. Model constraints were derived from the relationships between the sensors. The experiment's results confirmed that accelerometers each axis' noise can be successfully filtered utilizing dependency between channels and the dependency between time series data. Dependency between channels was used for a priori calculation, and a posteriori distribution was derived utilizing dependency between time series data. There was revisited data of autocalibration experiment by removing the initial assumption that instantaneous rotation axis of a rigid body was known. Performance results confirmed that such an approach could be used for online dead reckoning localization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Statistical Theory on the Functional Form of Cloud Particle Size Distributions

Abstract Several functional forms of cloud particle size distributions (PSDs) have been used in numerical modeling and remote sensing retrieval studies of clouds and precipitation, including exponential, gamma, lognormal, and Weibull distributions. However, there is no satisfying theoretical explanation as to why certain distribution forms preferentially occur instead of others. Intuitively, the analytical form of a PSD can be derived by directly solving the general dynamic equation, but no analytical solutions have been found yet. Instead of a process-level approach, the use of the principle of maximum entropy (MaxEnt) for determining the theoretical form of PSDs from the perspective of system is examined here. MaxEnt theory states that the probability density function with the largest information entropy among a group satisfying the given properties of the variable should be chosen. Here, the issue of variability under coordinate transformations that arises using the Gibbs–Shannon definition of entropy is identified, and the use of the concept of relative entropy to avoid these problems is discussed. Focusing on cloud physics, the four-parameter generalized gamma distribution is proposed as the analytical form of a PSD using the principle of maximum (relative) entropy with assumptions on power-law relations among state variables, scale invariance, and a further constraint on the expectation of one state variable (e.g., bulk water mass). The four-parameter generalized gamma distribution is very flexible to accommodate various type of constraints that could be assumed for cloud PSDs.

54 ENVIRONMENTAL SCIENCES↗

Hydrodynamic Relaxation of an Electron Plasma to a Near-Maximum Entropy State

Dynamical relaxation of a pure electron plasma in a Malmberg-Penning trap is studied, comparing experiments, numerical simulations and statistical theories of weakly dissipative two-dimensional (2D) turbulence. Simulations confirm that the dynamics are approximated well by a 2D hydrodynamic model. Statistical analysis favors a theoretical picture of relaxation to a near-maximum entropy state with constrained energy, circulation, and angular momentum. This provides evidence that 2D electron fluid relaxation in a turbulent regime is governed by principles of maximum entropy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗

Proximal Galerkin: A Structure-Preserving Finite Element Method for Pointwise Bound Constraints

The proximal Galerkin finite element method is a high-order, low iteration complexity, nonlinear numerical method that preserves the geometric and algebraic structure of pointwise bound constraints in infinite-dimensional function spaces. This paper introduces the proximal Galerkin method and applies it to solve free boundary problems, enforce discrete maximum principles, and develop a scalable, mesh-independent algorithm for optimal design with pointwise bound constraints. This paper also introduces the latent variable proximal point (LVPP) algorithm, from which the proximal Galerkin method derives. When analyzing the classical obstacle problem, we discover that the underlying variational inequality can be replaced by a sequence of second-order partial differential equations (PDEs) that are readily discretized and solved with, e.g., the proximal Galerkin method. Throughout this work, we arrive at several contributions that may be of independent interest. These include (1) a semilinear PDE we refer to as the entropic Poisson equation; (2) an algebraic/geometric connection between high-order positivity-preserving discretizations and certain infinite-dimensional Lie groups; and (3) a gradient-based, bound-preserving algorithm for two-field, density-based topology optimization. The complete proximal Galerkin methodology combines ideas from nonlinear programming, functional analysis, tropical algebra, and differential geometry and can potentially lead to new synergies among these areas as well as within variational and numerical analysis. Open-source implementations of our methods accompany this work to facilitate reproduction and broader adoption.

97 MATHEMATICS AND COMPUTING↗