Search NASA⌕ Search

SEARCH · Search NASA

Results for “Entropy minimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Monitoring of Liquid Metal Reactor Heater Zones with Recurrent Neural Network Learning of Temperature Time Series

Advanced high-temperature fluid reactors (ARs), such as sodium fast reactors (SFRs) and molten salt cooled reactors (MSCRs) utilize high-temperature fluids at ambient pressure. To melt the fluid during reactor startup and prevent fluid freezing during cooldown, the thermal–hydraulic systems of such ARs include heater zones consisting of specific heaters with controllers, temperature sensors, and thermal insulation. The failure of heater zones due to insulation material degradation or improper installation, resulting in parasitic heat losses, can lead to fluid freezing. The detection of faults using a heat-transfer model is difficult because of a lack of knowledge of the experimental details. Data-driven machine learning of heater zone temperature time series offers a viable alternative. In this study, we benchmarked the performance of recurrent neural networks (RNNs) in an analysis of heat-up transient temperature time series of heater zones installed on a liquid sodium vessel. The RNN models include long short-term memory (LSTM) and gated recurrent unit (GRU) networks, as well as their bi-directional variants, BiLSTM and BiGRU. Anomalous temperature points were designated using a percentile-based threshold applied to residual fluctuations in the detrended temperature time series. Additionally, the impact of the exponentially weighted moving average (EWMA) method on detection accuracy was examined. The RNN models’ performance was assessed using precision, recall, and F 1 score metrics. Results demonstrated that RNN models effectively detect anomalies in temperature time series with the best models for each heater zone achieving F 1 scores of over 93%. To explain the variations in RNN model performance across different heater zones, we used Kullback–Leibler (KL) divergence to quantify the relative entropy between training and testing data, and the Detrended Fluctuation Analysis (DFA) to assess long-range temporal correlations. For datasets with strong long-range correlations and minimal relative entropy between training and testing data, GRU is the best-performing model. When the data exhibits weaker long-term correlations and a significant relative entropy between training and testing distributions, BiGRU shows the best performance. For the data sets with intermediate values of both KL divergence and DFA, the best performance is obtained with LSTM and BiLSTM, respectively.

gated recurrent unit↗
DOE OSTI2022

Numerical schemes for a multi-species BGK model with velocity-dependent collision frequency

Here, we consider a kinetic description of multi-species gas mixture modeled with Bhatnagar-Gross-Krook (BGK) collision operators, in which the collision frequency varies not only in time and space but also with the microscopic velocity. In this model, the Maxwellians typically used in standard BGK operators are replaced by a generalization of such target functions, which are defined by a variational procedure. In this paper we present a numerical method for simulating this model, which uses an Implicit-Explicit (IMEX) scheme to minimize a certain potential function, mimicking the Lagrange functional that appears in the theoretical derivation. We show that theoretical properties such as conservation of mass, total momentum and total energy as well as positivity of the distribution functions are preserved by the numerical method, and illustrate its usefulness and effectiveness with numerical examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Consistent BGK Model with Velocity-Dependent Collision Frequency for Gas Mixtures

Abstract We derive a multi-species BGK model with velocity-dependent collision frequency for a non-reactive, multi-component gas mixture. The model is derived by minimizing a weighted entropy under the constraint that the number of particles of each species, total momentum, and total energy are conserved. We prove that this minimization problem admits a unique solution for very general collision frequencies. Moreover, we prove that the model satisfies an H-Theorem and characterize the form of equilibrium.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Spontaneous Symmetry–Breaking of Nonequilibrium Steady–States Caused by Nonlinear Electrical Transport

Negative differential resistance (NDR) in certain materials has been attributed to spontaneous emergence of symmetry-breaking electrical current density localization from a previously homogeneous distribution, which is postulated to occur due to the nonequilibrium thermodynamic force of minimization of entropy production. However, this phenomenon has not been quantitatively predicted based on intrinsic material properties and an applied electrical stimulus. Herein an instability criterion is derived for localization of current density and temperature from a thermal fluctuation in a parallel conductor model of a thin film that is subject to Newton's law of cooling. The conditions for steady–state electro-thermal localization is predicted, verifying a decrease in entropy production upon localization. Electro-thermal localization accompanied by a decrease of entropy production is confirmed in a multiphysics simulation of current flow in a thin film. The instability criterion predicts conditions for spontaneous current density localization, relating symmetry breaking fundamentally to dynamical instability via Local Activity theory.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Dynamic Performance Enhancement for Nonlinear Stochastic Systems Using RBF Driven Nonlinear Compensation with Extended Kalman Filter

In this paper, a novel hybrid control method is proposed to enhance the control performance of the PI based control system for a class of nonlinear and non-Gaussian stochastic dynamic processes with unmeasurable states. Firstly, to enhance the tracking performance of the PI controller where the PI parameters are fixed in many actual control systems, the compensative signal is formed using the extended Kalman filter(EKF) based state estimator and driven by the radial basis function (RBF) neural network based compensator. In addition, the weights of RBF is trained to minimize the entropy criterion of tracking error as the process is subjected to non-Gaussian disturbances. Meanwhile, since the precise statistical property of noises is hard to obtain for many industrial processes, the kernel density estimation (KDE) technique is employed in this paper to estimate the entropy. The convergence of RBF network is discussed and the stability of the resulted closed-loop hybrid control system is analyzed in mean square sense. Finally, a numerical example and a practical system testing are given to illustrate the effectiveness of the proposed control method.

stochastic systems, PI Controller, Entropy, Extend↗
NASA NTRS2021

An Information Theory Approach to Physical Domain Discovery

The project of physics discovery is often equivalent to finding the most concise description of a physical system. The description with optimum predictive capability for a dataset generated by a physical system is one that minimizes both predictive error on the dataset and the complexity of the description. The discovery of the governing physics of a system can therefore be viewed as a mathematical optimization problem. We outline here a method to optimize the description of arbitrarily complex physical systems by minimizing the entropy of the description of the system. The Recursive Domain Partitioning (RDP) procedure finds the optimum partitioning of each physical domain into subdomains, and the optimum predictive function within each subdomain. Penalty functions are introduced to limit the complexity of the predictive function within each domain. Examples are shown in 1D and 2D. In 1D, the technique effectively discovers the elastic and plastic regions within a stress-strain curve generated by simulations of amorphous carbon material, while in 2D the technique discovers the free-flow region and the inertially-obstructed flow region in the simulation of fluid flow across a plate.

Daniel Shea↗
NASA NTRS1990

A Boltzmann machine for the organization of intelligent machines

A three-tier structure consisting of organization, coordination, and execution levels forms the architecture of an intelligent machine using the principle of increasing precision with decreasing intelligence from a hierarchically intelligent control. This system has been formulated as a probabilistic model, where uncertainty and imprecision can be expressed in terms of entropies. The optimal strategy for decision planning and task execution can be found by minimizing the total entropy in the system. The focus is on the design of the organization level as a Boltzmann machine. Since this level is responsible for planning the actions of the machine, the Boltzmann machine is reformulated to use entropy as the cost function to be minimized. Simulated annealing, expanding subinterval random search, and the genetic algorithm are presented as search techniques to efficiently find the desired action sequence and illustrated with numerical examples.

Moed, Michael C.↗
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Evaluation of entropy driven jet symmetry transitions

Here we determine whether entropy drives planar turbulent jets into round turbulent jets. Determining when a jet flow transitions from one symmetry to the next is an important but incompletely resolved problem. The constructal view argues that the transition between symmetries of jet flows is governed by the minimization or maximization of entropy. Here we explore whether entropy increases with the transition of a planar turbulent jet into a round turbulent jet and whether entropy maximization (or minimization) predicts the same location of symmetry transition as velocity matching. We find that entropy considerations presented do not predict this transition.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Refractory high entropy alloy compact heat exchanger

Several innovative technologies, including pressure-drop minimization, advanced refractory high entropy alloys, and advanced manufacturing can provide a compact heat exchanger that extends the state-of-the-art heat-exchanger operating range. The compact heat exchanger can reduce pressure drop losses by 100 to 500%, while retaining most of the heat transfer. The compact heat exchanger can be fabricated from refractory high entropy alloys that have favorable corrosion, thermal fatigue, and creep properties at high temperatures and pressures. Therefore, the compact heat exchanger using high entropy alloys can operate at >800° C. and 80 bars.

Kustas, Andrew↗
NASA NTRS1987

Analytical design of intelligent machines

The problem of designing 'intelligent machines' to operate in uncertain environments with minimum supervision or interaction with a human operator is examined. The structure of an 'intelligent machine' is defined to be the structure of a Hierarchically Intelligent Control System, composed of three levels hierarchically ordered according to the principle of 'increasing precision with decreasing intelligence', namely: the organizational level, performing general information processing tasks in association with a long-term memory; the coordination level, dealing with specific information processing tasks with a short-term memory; and the control level, which performs the execution of various tasks through hardware using feedback control methods. The behavior of such a machine may be managed by controls with special considerations and its 'intelligence' is directly related to the derivation of a compatible measure that associates the intelligence of the higher levels with the concept of entropy, which is a sufficient analytic measure that unifies the treatment of all the levels of an 'intelligent machine' as the mathematical problem of finding the right sequence of internal decisions and controls for a system structured in the order of intelligence and inverse order of precision such that it minimizes its total entropy. A case study on the automatic maintenance of a nuclear plant illustrates the proposed approach.

Saridis, George N.↗
DOE OSTI2024

ASb 3 Mn 9 O 19 (A = K or Rb): New Mn-Based 2D Magnetoplumbites with Geometric and Magnetic Frustration

Magnetoplumbites are one of the most broadly studied families of hexagonal ferrites, typically with high magnetic ordering temperatures, making them excellent candidates for permanent magnets. However, magnetic frustration is rarely observed in magnetoplumbites. Herein, the discovery, synthesis, and characterization of the first Mn-based magnetoplumbite, as well as the first magnetoplumbite involving pnictogens (Sb), ASb 3 Mn 9 O 19 (A = K or Rb) are reported. The Mn 3+ ( S = 2) cations, further confirmed by DC magnetic susceptibility and X-ray photoelectron spectroscopy, construct three geometrically frustrated sublattices, including Kagome, triangular, and puckered honeycomb lattices. Magnetic properties measurements revealed strong antiferromagnetic spin–spin coupling as well as multiple low-temperature magnetic features. Heat capacity data does not show any prominent λ-anomaly, suggesting minimal associated magnetic entropy. Moreover, neutron powder diffraction (NPD) implied the absence of long-range magnetic ordering in KSb 3 Mn 9 O 19 down to 3 K. However, several magnetic peaks are observed in RbSb 3 Mn 9 O 19 at 3 K, corresponding to an incommensurate magnetic structure. Interestingly, strong diffuse scattering is seen in the NPD patterns of both compounds at low angles and is analyzed by reverse Monte Carlo refinements, indicating short-range spin ordering related to frustrated magnetism as well as 2D magnetic correlations in ASb 3 Mn 9 O 19 (A = K or Rb).

2-D magnetic correlation↗
DOE OSTI2020

Reactivity descriptors in acid catalysis: acid strength, proton affinity and host–guest interactions

Brønsted acids mediate chemical transformations via proton transfer to bound species and interactions between the conjugate anion and bound cationic intermediates and transition states that are also stabilized by van der Waals forces within voids of molecular dimensions in inorganic hosts. This Feature Article describes the relevant descriptors of reactivity in terms of the properties of acids and molecules that determine their ability to donate and accept protons and to reorganize their respective charges to optimize their interactions at bound states. The deprotonation energy (DPE) of the acids and the protonation energy (Eprot) of the gaseous analogs of bound intermediates and transition states reflect their respective properties as species present at non-interacting distances. These properties accurately describe the reactivity of acids of a given type, such as polyoxometalates (POM) with a given type of addenda atom but different central atoms and heterosilicates, for different families of reactions. They do not fully capture, however, differences among acid types (e.g., Mo and W POM, heterosilicates, mineral acids) for diverse types of chemical transformations (e.g., elimination, isomerization, dimerization, condensation). The incompleteness of such descriptors reflects their inability to describe how protonated molecular species and conjugate anions restructure their respective charges when present as a binding pair at interacting distances. Such interaction energies represent electrostatic forces that depend on charge distributions in the cations and anions and the ability to reorganize the distributions to maximize the interactions. In the case of deprotonation, the electrostatic and charge reorganization components of DPE for various acids solely reflect the ability of the conjugate anion to accept and distribute the negative charge, a characteristic unique of each type of solid acid and specifically of the composition of its extended conjugate anion framework. The energy required to accept and rearrange the positive charge in bound intermediates and transition states reflects, in turn, their respective ability to recover the ionic and covalent components of DPE, the energy required to detach proton from conjugate anions. The DPE components and the recovery fractions together lead to a modified DPE, which captures only the part of DPE that remains unrecovered by the ion-pair interactions at bound intermediates and transition states, as the unifying descriptor for broad families of acids and reactions. The electrostatic and charge reorganization energies involved in these general descriptors are placed in historical context by assessing their connections to the heuristics of hard–soft acid–base displacements. Further development of these concepts requires benchmarking and extension of electrostatic and reorganization components of energies for a more diverse set of reaction types and acid families and advancement of methods for more efficient calculations of electrostatic interactions. Reactivity descriptors must also account for dispersive interactions between host cavities and guest molecules, requiring a framework analogous to the one described here for ion-pair interactions; these dispersive interactions depend on the fit between their shapes and sizes as well as their ‘‘structural stiffness’’ that determines the ability to modify the shapes of molecules and voids to minimize free energy. Entropy considerations and estimates of their dependence on properties of catalysts and molecules are also required for accurately determining Gibbs free energies that ultimately determine reaction rates.

Deshlahra, Prashant↗
DOE OSTI2025

Dual-unitary shadow tomography

We introduce a classical shadow tomography scheme based on dual-unitary brick-wall circuits termed "dual-unitary shadow tomography" (DUST). For this we study operator spreading and Pauli weight dynamics in one-dimensional qubit systems, evolved by random two-local dual-unitary gates arranged in a brick-wall structure, ending with a final measurement layer. We do this by deriving general constraints on the Pauli weight transfer matrix and specializing to the case of dual-unitarity. We first show that dual-unitaries must have a minimal amount of entropy production. Remarkably, we find that operator spreading in these circuits have a rich structure resembling that of relativistic quantum field theories, with massless chiral excitations that can decay or fuse into each other, which we call left- or right-movers. We develop a mean-field description of the Pauli weight in terms of $\rho(x,t)$, which represents the probability of having nontrivial support at site $x$ and depth $t$ starting from a fixed weight distribution. We develop an equation of state for $\rho(x,t)$, and simulate it numerically using Monte Carlo simulations. Lastly, we demonstrate that the fast-thermalizing properties of dual-unitary circuits make them better at predicting large operators than shallow brick-wall Clifford circuits. Our results are robust to finite-size effects due to the chirality of dual-unitary brick-wall circuits.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1984

Optimation of cooled shields in insulations

A method to optimize the location, temperature, and heat dissipation rate of each cooled shield inside an insulation layer was developed. The method is based on the minimization of the entropy production rate which is proportional to the heat leak across the insulation. It is shown that the maximum number of shields to be used in most practical applications is three. However, cooled shields are useful only at low values of the overall, cold wall to hot wall absolute temperature ratio. The performance of the insulation system is relatively insensitive to deviations from the optimum values of the temperature and location of the cooling shields. Design curves for rapid estimates of the locations and temperatures of cooling shields in various types of insulations, and an equation for calculating the cooling loads for the shields are presented.

Chato, J. C.↗
DOE OSTI2024

Photovoltaics Based on Direct and Indirect Gap Semiconductors

Direct and thin, or indirect and thick absorbers can yield cells close to 30% but there are practical limits due to defects, cost, reliability. Tandems and new ideas are needed to minimize thermalization and entropy losses and to enable high absorptance in thin Si layers. Direct-gap absorbers have ~1000x higher recombination losses than Si, but being 100x thinner, the limiting 1-sun efficiencies are similar due to 100x higher G.

direct-gap↗
DOE OSTI2022

Non-topological logarithmic corrections in minimal gauged supergravity

We compute the logarithmic correction to the entropy of asymptotically AdS4 black holes in minimal N = 2 gauged supergravity. We show that for extremal black holes the logarithmic correction computed in the near horizon geometry agrees with the result in the full geometry up to zero mode contributions, thus clarifying where the quantum degrees of freedom lie in AdS spacetimes. In contrast to flat space, we observe that the logarithmic correction for supersymmetric black holes can be non-topological in AdS as it is controlled by additional four-derivative terms other than the Euler density. The available microscopic data and results in 11d supergravity indicate that the full logarithmic correction is topological, which suggests that the topological nature of logarithmic corrections could serve as a diagnosis of whether a low-energy gravity theory admits an ultraviolet completion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗