Search NASA⌕ Search

SEARCH · Search NASA

Results for “Entropy minimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Multimodal Data Fusion via Entropy Minimization

The use of gradient-based data-driven models to solve a range of real-world remote sensing problems can in practice be limited by the uniformity of available data. Use of data from disparate sensor types, resolutions, and qualities typically requires compromises based on assumptions that are made prior to model training and may not necessarily be optimal given over-arching objectives. For example, while deep neural networks (NNs) are state-of-the-art in a variety of target detection problems, training them typically requires either limiting the training data to a subset over which uniformity can be enforced or training independent models which subsequently require additional score fusion. The method we introduce here seeks to leverage the benefits of both approaches by allowing correlated inputs from different data sources to co-influence preferred model solutions, while maintaining flexibility over missing and mismatching data. In this work we propose a new data fusion technique for gradient updated models based on entropy minimization and experimentally validate it on a hyperspectral target detection dataset. We demonstrate superior performance compared to currently available techniques using a range of realistic data scenarios, where available data has limited spacial overlap and resolution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Data Fusion via Neural Network Entropy Minimization for Target Detection and Multi-Sensor Event Classification

Broadly applicable solutions to multimodal and multisensory fusion problems across domains remain a challenge because effective solutions often require substantive domain knowledge and engineering. The chief questions that arise for data fusion are in when to share information from different data sources, and how to accomplish the integration of information. The solutions explored in this work remain agnostic to input representation and terminal decision fusion approaches by sharing information through the learning objective as a compound objective function. The objective function this work uses assumes a one-to-one learning paradigm within a one-to-many domain which allows the assumption that consistency can be enforced across the one-to-many dimension. The domains and tasks we explore in this work include multi-sensor fusion for seismic event location and multimodal hyperspectral target discrimination. We find that our domain- informed consistency objectives are challenging to implement in stable and successful learning because of intersections between inherent data complexity and practical parameter optimization. While multimodal hyperspectral target discrimination was not enhanced across a range of different experiments by the fusion strategies put forward in this work, seismic event location benefited substantially, but only for label-limited scenarios.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Optimization of Dimensions of Smooth and Twisted-Tape-Inserted Tubes for Heat Transfer with NaCl/KCl/MgCl 2 Molten Salts by Principle of Entropy Generation Minimization

The entropy generation minimization principle is used as the criterion to optimize the flow and heat transfer of solar collectors and heat exchangers that use molten salts NaCl–KCl–MgCl 2 and KCl–MgCl 2 . The Gnielinski correlation for the Nusselt number versus Reynolds number, as well as the Moody friction factor given by Petukhov, was used for the calculation of the convective heat transfer coefficient and pressure loss due to friction in smooth tubes. For twisted-tap-inserted tube, equations of Nu and friction factor provided by Manglik and Bergles were used. The objective function, the entropy generation rate of the heat transfer system, was expressed as the function of Reynolds number, Prandtl number, heating flux, tube diameter, etc. As a result of the analysis, the optimum Reynolds number was determined and thereby to determine the optimum Nusselt number, convective heat transfer coefficient, friction factor, and tube diameter, which also allows the calculation of optimum flow velocity. The analysis was conducted in the fluid temperature range of 500–700 °C, which covers the operation temperature for supercritical CO 2 power cycles in concentrated solar power (CSP) system. Here, optimized results from the smooth tube and twisted-tap-inserted tube are compared, which is important to the design of solar receivers for CSP systems.

14 SOLAR ENERGY↗
DOE OSTI2023

KiT-RT: An Extendable Framework for Radiative Transfer and Therapy

Here, in this article, we present Kinetic Transport Solver for Radiation Therapy (KiT-RT), an open-source C++-based framework for solving kinetic equations in therapy applications available at https://github.com/CSMMLab/KiT-RT . This software framework aims to provide a collection of classical deterministic solvers for unstructured meshes that allow for easy extendability. Therefore, KiT-RT is a convenient base to test new numerical methods in various applications and compare them against conventional solvers. The implementation includes spherical harmonics, minimal entropy, neural minimal entropy, and discrete ordinates methods. Solution characteristics and efficiency are presented through several test cases ranging from radiation transport to electron radiation therapy. Due to the variety of included numerical methods and easy extendability, the presented open-source code is attractive for both developers, who want a basis to build their numerical solvers, and users or application engineers, who want to gain experimental insights without directly interfering with the codebase.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Energy, Exergy, Entropy Generation Minimization, and Exergoenvironmental Analyses of Energy Systems-A Mini-Review

Meeting the growing energy demands has become a crucial challenge, which should employ energy integration and benefit from the extraction of the maximum thermodynamic potential of the resources consumed. This brief review presents an overview of the essential elements of the methods of energy, exergy, entropy generation minimization, and exergoenvironmental analyses. In combination, these methodologies constitute a powerful toolbox for the design, analysis, and optimization of energy systems. The quantification of energy and environmental impacts provided by them is essential in guiding toward system designs that are consistent with current energy and environmental needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques— Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)— and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ~20%. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

galaxies: interactions↗
DOE OSTI2021

Inverse design of equilibrium cluster fluids applied to a physically informed model

Inverse design strategies have proven highly useful for the discovery of interaction potentials that prompt self-assembly of a variety of interesting structures. However, often the optimized particle interactions do not have a direct relationship to experimental systems. In this work, we show that Relative Entropy minimization is able to discover physically meaningful parameter sets for a model interaction built from depletion attraction and electrostatic repulsion that yield self-assembly of size-specific clusters. Here, we then explore the sensitivity of the optimized interaction potentials with respect to deviations in the underlying physical quantities, showing that clustering behavior is largely preserved even as the optimized parameters are perturbed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Computer Simulation of Proton Transport in Fuel Cell Membranes (Final Report)

This DOE-supported research grant focused on understanding the nature of proton transport in complex systems such as proton exchange membranes (PEMs). The most unique aspect of the research was the development and implementation of a novel multiscale reactive molecular dynamics (MS-RMD) methodology. In this approach, covalent bonds can dynamically break and form, allowing one to accurately treat the proton hopping process essential to capturing the physics of proton transport. The Voth group applied this method to proton exchange membrane systems, providing insight into their proton transport mechanism. They found that protons can diffuse most rapidly in the water-rich regions, but that protons actually spend so little time in such regions that transport along the hydrophobic – hydrophilic interface controls the membrane performance. In addition, the group worked to increase understanding of acidic solutions, developing methods for simulating and interpreting experimental infrared vibrational spectroscopy for excess protons (acidic solutions). The group also implemented novel tools for developing proton transport reactive MD models using a relative entropy minimization scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Monitoring of Liquid Metal Reactor Heater Zones with Recurrent Neural Network Learning of Temperature Time Series

Advanced high-temperature fluid reactors (ARs), such as sodium fast reactors (SFRs) and molten salt cooled reactors (MSCRs) utilize high-temperature fluids at ambient pressure. To melt the fluid during reactor startup and prevent fluid freezing during cooldown, the thermal–hydraulic systems of such ARs include heater zones consisting of specific heaters with controllers, temperature sensors, and thermal insulation. The failure of heater zones due to insulation material degradation or improper installation, resulting in parasitic heat losses, can lead to fluid freezing. The detection of faults using a heat-transfer model is difficult because of a lack of knowledge of the experimental details. Data-driven machine learning of heater zone temperature time series offers a viable alternative. In this study, we benchmarked the performance of recurrent neural networks (RNNs) in an analysis of heat-up transient temperature time series of heater zones installed on a liquid sodium vessel. The RNN models include long short-term memory (LSTM) and gated recurrent unit (GRU) networks, as well as their bi-directional variants, BiLSTM and BiGRU. Anomalous temperature points were designated using a percentile-based threshold applied to residual fluctuations in the detrended temperature time series. Additionally, the impact of the exponentially weighted moving average (EWMA) method on detection accuracy was examined. The RNN models’ performance was assessed using precision, recall, and F 1 score metrics. Results demonstrated that RNN models effectively detect anomalies in temperature time series with the best models for each heater zone achieving F 1 scores of over 93%. To explain the variations in RNN model performance across different heater zones, we used Kullback–Leibler (KL) divergence to quantify the relative entropy between training and testing data, and the Detrended Fluctuation Analysis (DFA) to assess long-range temporal correlations. For datasets with strong long-range correlations and minimal relative entropy between training and testing data, GRU is the best-performing model. When the data exhibits weaker long-term correlations and a significant relative entropy between training and testing distributions, BiGRU shows the best performance. For the data sets with intermediate values of both KL divergence and DFA, the best performance is obtained with LSTM and BiLSTM, respectively.

gated recurrent unit↗
DOE OSTI2022

Numerical schemes for a multi-species BGK model with velocity-dependent collision frequency

Here, we consider a kinetic description of multi-species gas mixture modeled with Bhatnagar-Gross-Krook (BGK) collision operators, in which the collision frequency varies not only in time and space but also with the microscopic velocity. In this model, the Maxwellians typically used in standard BGK operators are replaced by a generalization of such target functions, which are defined by a variational procedure. In this paper we present a numerical method for simulating this model, which uses an Implicit-Explicit (IMEX) scheme to minimize a certain potential function, mimicking the Lagrange functional that appears in the theoretical derivation. We show that theoretical properties such as conservation of mass, total momentum and total energy as well as positivity of the distribution functions are preserved by the numerical method, and illustrate its usefulness and effectiveness with numerical examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Consistent BGK Model with Velocity-Dependent Collision Frequency for Gas Mixtures

Abstract We derive a multi-species BGK model with velocity-dependent collision frequency for a non-reactive, multi-component gas mixture. The model is derived by minimizing a weighted entropy under the constraint that the number of particles of each species, total momentum, and total energy are conserved. We prove that this minimization problem admits a unique solution for very general collision frequencies. Moreover, we prove that the model satisfies an H-Theorem and characterize the form of equilibrium.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Spontaneous Symmetry–Breaking of Nonequilibrium Steady–States Caused by Nonlinear Electrical Transport

Negative differential resistance (NDR) in certain materials has been attributed to spontaneous emergence of symmetry-breaking electrical current density localization from a previously homogeneous distribution, which is postulated to occur due to the nonequilibrium thermodynamic force of minimization of entropy production. However, this phenomenon has not been quantitatively predicted based on intrinsic material properties and an applied electrical stimulus. Herein an instability criterion is derived for localization of current density and temperature from a thermal fluctuation in a parallel conductor model of a thin film that is subject to Newton's law of cooling. The conditions for steady–state electro-thermal localization is predicted, verifying a decrease in entropy production upon localization. Electro-thermal localization accompanied by a decrease of entropy production is confirmed in a multiphysics simulation of current flow in a thin film. The instability criterion predicts conditions for spontaneous current density localization, relating symmetry breaking fundamentally to dynamical instability via Local Activity theory.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Dynamic Performance Enhancement for Nonlinear Stochastic Systems Using RBF Driven Nonlinear Compensation with Extended Kalman Filter

In this paper, a novel hybrid control method is proposed to enhance the control performance of the PI based control system for a class of nonlinear and non-Gaussian stochastic dynamic processes with unmeasurable states. Firstly, to enhance the tracking performance of the PI controller where the PI parameters are fixed in many actual control systems, the compensative signal is formed using the extended Kalman filter(EKF) based state estimator and driven by the radial basis function (RBF) neural network based compensator. In addition, the weights of RBF is trained to minimize the entropy criterion of tracking error as the process is subjected to non-Gaussian disturbances. Meanwhile, since the precise statistical property of noises is hard to obtain for many industrial processes, the kernel density estimation (KDE) technique is employed in this paper to estimate the entropy. The convergence of RBF network is discussed and the stability of the resulted closed-loop hybrid control system is analyzed in mean square sense. Finally, a numerical example and a practical system testing are given to illustrate the effectiveness of the proposed control method.

stochastic systems, PI Controller, Entropy, Extend↗
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗