Search NASA⌕ Search

SEARCH · Search NASA

Results for “Maximum Entropy Principle”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

18 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Maximum Entropy Principle in Deep Thermalization and in Hilbert-Space Ergodicity

We report universal statistical properties displayed by ensembles of pure states that naturally emerge in quantum many-body systems. Specifically, two classes of state ensembles are considered: those formed by (i) the temporal trajectory of a quantum state under unitary evolution or (ii) the quantum states of small subsystems obtained by partial, local projective measurements performed on their complements. These cases, respectively, exemplify the phenomena of “Hilbert-space ergodicity” and “deep thermalization.” In both cases, the resultant ensembles are defined by a simple principle: The distributions of pure states have maximum entropy, subject to constraints such as energy conservation, and effective constraints imposed by thermalization. We present and numerically verify quantifiable signatures of this principle by deriving explicit formulas for all statistical moments of the ensembles, proving the necessary and sufficient conditions for such universality under widely accepted assumptions, and describing their measurable consequences in experiments. We further discuss information-theoretic implications of the universality: Our ensembles have maximal information content while being maximally difficult to interrogate, establishing that generic quantum state ensembles that occur in nature hide (scramble) information as strongly as possible. Our results generalize the notions of Hilbert-space ergodicity to time-independent Hamiltonian dynamics and deep thermalization from infinite to finite effective temperature. Our work presents new perspectives to characterize and understand universal behaviors of quantum dynamics using statistical and information-theoretic tools.

Eigenstate thermalization↗
DOE OSTI2023

Maximum entropy distributions of dark matter in ΛCDM cosmology

Context. Small-scale challenges to ΛCDM cosmology require a deeper understanding of dark matter physics. Aims. This paper aims to develop the maximum entropy distributions for dark matter particle velocity (denoted by X ), speed (denoted by Z ), and energy (denoted by E ) that are especially relevant on small scales where system approaches full virialization. Methods. For systems involving long-range interactions, a spectrum of halos of different sizes is required to form to maximize system entropy. While the velocity in halos can be Gaussian, the velocity distribution throughout the entire system, involving all halos of different sizes, is non-Gaussian. With the virial theorem for mechanical equilibrium, we applied the maximum entropy principle to the statistical equilibrium of entire system, such that the maximum entropy distribution of velocity (the X distribution) could be analytically derived. The halo mass function was not required in this formulation, but it did indeed result from the maximum entropy. Results. The predicted X distribution involves a shape parameter α and a velocity scale, v 0 . The shape parameter α reflects the nature of force ( α → 0 for long-range force or α → ∞ for short-range force). Therefore, the distribution approaches Laplacian with α → 0 and Gaussian with α → ∞. For an intermediate value of α , the distribution naturally exhibits a Gaussian core for v ≪ v 0 and exponential wings for v ≫ v 0 , as confirmed by N -body simulations. From this distribution, the mean particle energy of all dark matter particles with a given speed, v , follows a parabolic scaling for low speeds (∝ v 2 for v ≪ v 0 in halo core region, i.e., “Newtonian”) and a linear scaling for high speeds (∝ v for v ≫ v 0 in halo outskirt, i.e., exhibiting “non-Newtonian” behavior due to long-range gravity). We compared our results against N -body simulations and found a good agreement.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Model-Free Approach for Profiling of Polydisperse Soft Matter Using Small Angle Scattering

A strategy for determining the size polydispersity of systems from their small angle coherent scattering is outlined. Here, using the method of moment expansion, we show that the various central moments representing the average particle size, variance of particle size, and skewness of size distribution function (SDF) for polydisperse systems can be extracted from spectral analysis without bias. When the degree of polydispersity is moderate, SDF can be further reconstructed based on the maximum entropy principle. Numerical benchmarking of a model study over a wide range of size nonuniformity demonstrates the validity of this analytical approach for quantifying the size distribution of general soft matter systems in a model-free manner. Furthermore, the efficacy of this method was validated by successfully applying it to the fitting of small-angle neutron scattering data obtained from L64 Pluronic micelles using various form factor models. The numerical and experimental verification underscores the reliability and versatility of this method in accurately characterizing the size distribution of complex soft matter systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Stochastic fluctuations in relativistic fluids: Causality, stability, and the information current

We develop a general formalism for introducing stochastic fluctuations around thermodynamic equilibrium which takes into account, for the first time, recent developments in the causality and stability properties of relativistic hydrodynamic theories. The method is valid for any covariantly stable theory of relativistic viscous fluid dynamics derived from a covariant maximum entropy principle. We illustrate the formalism with some applications, showing how it could be used to consistently introduce fluctuations in a model of relativistic heat diffusion and in conformally invariant Israel-Stewart theory in a general hydrodynamic frame. Furthermore, the latter example is used to study the hydrodynamic frame dependence of the symmetric two-point function of fluctuations of the energy-momentum tensor.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Quantum maximum entropy closure for small flavor coherence

Quantum angular moment transport schemes are an important avenue toward describing neutrino flavor mixing phenomena in dense astrophysical environments such as supernovae and merging neutron stars. Successful implementation will require new closure relations that go beyond those used in classical transport. In this paper, we derive the first analytic expression for a quantum M1 closure, valid in the limit of small flavor coherence, based on the maximum entropy principle. We verify that the resulting closure relation has the appropriate limits and characteristic speeds in the diffusive and free-streaming regimes. We then use this new closure in a moment linear stability analysis to search for fast flavor instabilities in a binary neutron star merger simulation and find better results as compared with previously designed, ad hoc , semiclassical closures.

astrophysical & cosmological simulations↗
DOE OSTI2026

Boundary-induced classical generalized Gibbs ensemble with angular momentum

We investigate how confinement geometry leads to the emergence of a Generalized Gibbs Ensemble (GGE) in classical systems. Unlike the standard Gibbs ensemble, the GGE includes additional conserved quantities, such as angular momentum, that arise from boundary-induced symmetries. Using analytical arguments based on the maximum entropy principle, we show that circular boundaries preserve angular momentum and drive the system toward a chiral, non-ergodic GGE that violates time-reversal symmetry. This ensemble differs fundamentally from the Gibbs case, producing near-boundary condensation and revealing how geometry alone can alter thermal equilibration. To quantify these effects, we introduce an order parameter measuring deviations from Gibbs behavior and demonstrate that conventional Monte Carlo methods must incorporate angular momentum conservation under such conditions. Our study highlights how geometric constraints shape non-equilibrium statistical ensembles and lead to subtle departures from the Bohr-van Leeuwen theorem. These predictions are validated through detailed simulations of confined classical hard-disk gases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Efficient First-Order Algorithms for Large-Scale, Non-Smooth Maximum Entropy Models with Application to Wildfire Science

Maximum entropy (MaxEnt) models are a class of statistical models that use the maximum entropy principle to estimate probability distributions from data. Due to the size of modern data sets, MaxEnt models need efficient optimization algorithms to scale well for big data applications. State-of-the-art algorithms for MaxEnt models, however, were not originally designed to handle big data sets; these algorithms either rely on technical devices that may yield unreliable numerical results, scale poorly, or require smoothness assumptions that many practical MaxEnt models lack. In this paper, we present novel optimization algorithms that overcome the shortcomings of state-of-the-art algorithms for training large-scale, non-smooth MaxEnt models. Our proposed first-order algorithms leverage the Kullback–Leibler divergence to train large-scale and non-smooth MaxEnt models efficiently. For MaxEnt models with discrete probability distribution of n elements built from samples, each containing m features, the stepsize parameter estimation and iterations in our algorithms scale on the order of O(mn) operations and can be trivially parallelized. Moreover, the strong ℓ1 convexity of the Kullback–Leibler divergence allows for larger stepsize parameters, thereby speeding up the convergence rate of our algorithms. To illustrate the efficiency of our novel algorithms, we consider the problem of estimating probabilities of fire occurrences as a function of ecological features in the Western US MTBS-Interagency wildfire data set. Our numerical results show that our algorithms outperform the state of the art by one order of magnitude and yield results that agree with physical models of wildfire occurrence and previous statistical analyses of wildfire drivers.

Physics↗
DOE OSTI2024

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗
DOE OSTI2024

Proximal Galerkin: A Structure-Preserving Finite Element Method for Pointwise Bound Constraints

The proximal Galerkin finite element method is a high-order, low iteration complexity, nonlinear numerical method that preserves the geometric and algebraic structure of pointwise bound constraints in infinite-dimensional function spaces. This paper introduces the proximal Galerkin method and applies it to solve free boundary problems, enforce discrete maximum principles, and develop a scalable, mesh-independent algorithm for optimal design with pointwise bound constraints. This paper also introduces the latent variable proximal point (LVPP) algorithm, from which the proximal Galerkin method derives. When analyzing the classical obstacle problem, we discover that the underlying variational inequality can be replaced by a sequence of second-order partial differential equations (PDEs) that are readily discretized and solved with, e.g., the proximal Galerkin method. Throughout this work, we arrive at several contributions that may be of independent interest. These include (1) a semilinear PDE we refer to as the entropic Poisson equation; (2) an algebraic/geometric connection between high-order positivity-preserving discretizations and certain infinite-dimensional Lie groups; and (3) a gradient-based, bound-preserving algorithm for two-field, density-based topology optimization. The complete proximal Galerkin methodology combines ideas from nonlinear programming, functional analysis, tropical algebra, and differential geometry and can potentially lead to new synergies among these areas as well as within variational and numerical analysis. Open-source implementations of our methods accompany this work to facilitate reproduction and broader adoption.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Energy efficiency in industrial drying: A hybrid ultrasonic system with a novel dynamic optimization framework

Drying processes are among the most energy-consuming operations in industrial and manufacturing settings, demanding strategic selection, design, and control for enhanced efficiency. Advancing drying technologies is critical for improving sustainability, lowering energy use, reducing carbon emissions, and minimizing waste. This study explores two innovative strategies aimed at transforming drying processes into sustainable, low-carbon systems by reducing energy consumption, minimizing waste, and maintaining a strong emphasis on preserving product quality. The first strategy showcases a sub-pilot scale hybrid ultrasonic-convective dryer for agrifood products. This technology, powered by electricity (process electrification), integrates non-thermal ultrasonic dehydration with convective heating and is presented as a sustainable and energy-efficient solution that enhances eco-friendly practices. The second strategy involves introducing and implementing a novel, multiobjective, mixed integer dynamic optimization technique to determine the optimal time-dependent process parameter values for the drying operation. This optimization technique yields operating conditions that are piecewise constant in time aiming to maximize the energy efficiency of the hybrid ultrasonic-convective dryer while ensuring strict adherence to product quality constraints. By adopting the hybrid ultrasonic-convective dryer, a notable 35% improvement in energy efficiency was achieved compared to conventional hot-air drying systems for drying apple slices. The proposed optimization framework further enhanced energy efficiency by nearly 14% over the most efficient process on the identical testbed, under static operating conditions. The reported enhancements have been experimentally validated. Regarding drying time (thereby improving production yield), the developed hybrid ultrasonic-convective dryer demonstrates as much as a 41% reduction in total processing time, which is further optimized by an additional 10% using our proposed optimization framework. The research outcomes have profound implications for the design and operation of drying systems, encompassing crucial aspects such as process electrification, cost-effectiveness, energy savings, time efficiency, product yield, product quality, and process automation.

Dynamic optimization↗
DOE OSTI2025

Bayesian Entropy Neural Networks for physics-aware prediction

This article addresses the need for deep learning models to integrate well-defined constraints into their outputs, driven by their application in surrogate models, learning with limited data and partial information, and scenarios requiring flexible model behavior to incorporate non-data sample information. We introduce Bayesian Entropy Neural Networks (BENN), a framework grounded in Maximum Entropy (MaxEnt) principles, designed to impose constraints on Bayesian Neural Network (BNN) predictions. BENN is capable of constraining not only the predicted values but also their derivatives and variances, ensuring a more robust and reliable model output. To achieve simultaneous uncertainty quantification and constraint satisfaction, we employ the method of multipliers approach. This allows for the concurrent estimation of neural network parameters and the Lagrangian multipliers associated with the constraints. Our experiments, spanning diverse applications such as beam deflection modeling and microstructure generation, demonstrate the effectiveness of BENN. The results highlight significant improvements over traditional BNNs and showcase competitive performance relative to contemporary constrained deep learning methods.

14 SOLAR ENERGY↗
DOE OSTI2025

Physics-based stabilized finite element approximations of the Poisson–Nernst–Planck equations

We present and analyze two stabilized finite element methods for solving numerically the Poisson–Nernst–Planck equations. The stabilization we consider is carried out by using a shock detector and a discrete graph Laplacian operator for the ion equations, whereas the discrete equation for the electric potential need not be stabilized. Discrete solutions stemmed from the first algorithm preserve both maximum and minimum discrete principles. For the second algorithm, its discrete solutions are conceived so that they hold discrete principles and obey an entropy law provided that an acuteness condition is imposed for meshes. Remarkably the latter is found to be unconditionally stable. We validate our methodology through transient numerical experiments that show convergence toward steady-state solutions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Probabilistic and maximum entropy modeling of chemical reaction systems: Characteristics and comparisons to mass action kinetic models

We demonstrate and characterize a first-principles approach to modeling the mass action dynamics of metabolism. Starting from a basic definition of entropy expressed as a multinomial probability density using Boltzmann probabilities with standard chemical potentials, we derive and compare the free energy dissipation and the entropy production rates. We express the relation between entropy production and the chemical master equation for modeling metabolism, which unifies chemical kinetics and chemical thermodynamics. Because prediction uncertainty with respect to parameter variability is frequently a concern with mass action models utilizing rate constants, we compare and contrast the maximum entropy model, which has its own set of rate parameters, to a population of standard mass action models in which the rate constants are randomly chosen. We show that a maximum entropy model is characterized by a high probability of free energy dissipation rate and likewise entropy production rate, relative to other models. We then characterize the variability of the maximum entropy model predictions with respect to uncertainties in parameters (standard free energies of formation) and with respect to ionic strengths typically found in a cell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

First principles prediction of the Al-Li phase diagram including configurational and vibrational entropic contributions

The whole Al-Li phase diagram is predicted from first principles calculations and statistical mechanics including the effect of configurational and vibrational entropy. The formation enthalpy of different configurations at different temperatures was accurately predicted by means of cluster expansions that were fitted from first principles calculations. The vibrational entropic contribution of each configuration was determined from the bond length vs. bond stiffness relationships for each type of bond and the Gibbs free energy of the different phases was obtained as a function of temperature from Monte Carlo simulations. The predicted phase diagram was in excellent agreement with the currently accepted experimental one in terms of the stable (AlLi, Al 2 Li 3 , AlLi 2 , Al 4 Li 9 ) and metastable (Al 3 Li) phases, of the phase boundaries between them and of the maximum stability temperature of line compounds. In addition, it provided accurate information about the gap between Al 3 Li and AlLi solvus lines. Finally, the influence of the vibrational entropy on the correct prediction of the phase diagram is discussed. Overall, the methodology shows that accurate phase diagrams of alloys of technological interest can be predicted from first principles calculations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Rational design of septenary high-entropy alloy for direct ethanol fuel cells

Promoting C–C bond cleavage of ethanol by a complete 12-electron (12e) ethanol oxidation reaction (EOR) is a grand challenge for the development of highly efficient direct ethanol fuel cells (DEFCs). Most state-of-the-art catalysts only implement the EOR in an incomplete 4e or 2e pathway because of the poisoning of the catalysts by strongly adsorbed CO, leading to the poor output performance and low cell efficiency of DEFCs. Herein, a septenary PtPdFeCoNiSnMn high-entropy alloy (PtPd HEA) with a PtPd-rich surface but super-low platinum group metals loading was developed. We identified and proved the functions of each element in the PtPd HEA. The DEFCs assembled with the PtPd HEA (0.12 mg PtPd ∙cm -2 ) achieved a maximum power density of 0.72 W cm -2 and a durable operation for 1,200 h, which outperforms state-of-the-art catalysts for DEFCs. This work will be a design principle for nanostructured alloy development for renewable energy and sustainability applications.

25 ENERGY STORAGE↗
DOE OSTI2024

Semi-Lagrangian nodal discontinuous Galerkin method for the BGK model

In this work, we propose a semi-Lagrangian (SL) nodal discontinuous Galerkin (DG) solver for the BGK equation. The BGK model was introduced by Bhatnagar, Gross, and Krook [1] as a relaxation model for the fundamental Boltzmann equation [5], which describes the kinetic dynamic of rarefied gases with a probability distribution function. The challenges of designing efficient numerical schemes for the Boltzmann equation mainly come from its high dimensionality and complicated nonlinear collision operator. The BGK model gains interests since it has much lower computational cost, due to the relatively simple structure of the relaxation operator in replacement of the collision operator, while simultaneously preserving several important physical properties, such as macroscopic quantities and dissipation of entropy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A first-principles investigation of point defect structure and energetics in ThO 2

The structure and energetics of charged point defects in thorium dioxide (ThO 2 ) have been investigated using the density functional theory (DFT) and phonon simulations. DFT simulations were performed under both zero-pressure and constant volume conditions. Termed as the free volume change of the point defects, the change in volume of the supercell has been computed in the zero-pressure case. Supercell expansion was observed with the increase of the (nominal) charge state of anion (O) interstitials and cation (Th) vacancies from neutral to its maximum. On the contrary, contraction of the supercell has been observed with anion vacancies and cation interstitials as the defect charge increases. The supercell volume change with respect to the charge state has been correlated with the resulting defect energetics. It has been observed that, as the defect charge increased, the internal energy and entropy of defect formation of the cation vacancies and anion interstitials were found to increase, while that of the cation interstitials and anion vacancies decreased. Here, the temperature dependence of internal energy and entropy has also been examined. It was found that, as the temperature increases, the internal energies of the formation of cation vacancies and anion interstitials decrease, while those of the cation interstitials and anion vacancies increase. An opposite observation is seen for the entropies of formation defects when above room temperatures.

42 ENGINEERING↗