Search NASA⌕ Search

SEARCH · Search NASA

Results for “maximum entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A homotopy algorithm for synthesizing robust controllers for flexible structures via the maximum entropy design equations

One well known deficiency of LQG compensators is that they do not guarantee any measure of robustness. This deficiency is especially highlighted when considering control design for complex systems such as flexible structures. There has thus been a need to generalize LQG theory to incorporate robustness constraints. Here we describe the maximum entropy approach to robust control design for flexible structures, a generalization of LQG theory, pioneered by Hyland, which has proved useful in practice. The design equations consist of a set of coupled Riccati and Lyapunov equations. A homotopy algorithm that is used to solve these design equations is presented.

Collins, Emmanuel G., Jr.↗

Using Regionalized Air Quality Model Performance and Bayesian Maximum Entropy Data Fusion to Map Global Surface Ozone Concentration and Associated Uncertainty

Estimates of ground-level ozone concentrations have been improved through data fusion of observations and atmospheric chemistry models. Our previous global ozone estimates for the Global Burden of Disease study corrected for bias uniformly across continents and then corrected near monitoring stations using the Bayesian Maximum Entropy (BME) framework for data fusion. Here, we use the Regionalized Air Quality Model Performance (RAMP) framework to correct model bias over a much larger spatial range than BME can, accounting for the spatial inhomogeneity of bias and nonlinearity as a function of modeled ozone. RAMP bias correction is applied to a composite of 9 global chemistry-climate models, based on the nearest set of monitors. These estimates are then fused with observations using BME, which matches observations at measurement stations, with the influence of observations declining with distance in space and time. We create global ozone maps for each year from 1990 to 2017 at fine spatial resolution. RAMP is shown to create unrealistic discontinuities due to the spatial clustering of ozone monitors, which we overcome by applying a weighting for RAMP based on the number of monitors nearby. Incorporating RAMP before BME has little effect on model performance near stations, but strongly increases R 2 by 0.15 at locations farther from stations, shown through a checkerboard cross-validation. Corrections to estimates differ based on location in space and time, confirming heterogeneity. We quantify the likelihood of exceeding selected ozone levels, finding that parts of the Middle East, India, and China are most likely to exceed 55 parts per billion (ppb) in 2017. About 96% of the global population was exposed to ozone levels above the World Health Organization guideline of 60 µg m −3 (30 ppb) in 2017. Our annual fine-resolution ozone estimates may be useful for several applications including epidemiology and assessments of impacts on health, agriculture, and ecosystems.

Ozone↗

Using the maximum entropy distribution to describe electrons in reconnecting current sheets

Particle distributions in weakly collisional environments such as the magnetosphere have been observed to show deviations from the Maxwellian distribution. These can often be reproduced in kinetic simulations, but fluid models, which are used in global simulations of the magnetosphere, do not necessarily capture any of this. We apply the maximum entropy fluid closure of Levermore, which leads to well posed moment equations, to reconstruct particle distributions from a kinetic simulation in a reconnection region. Our results show that without information other than the moments, the model can reproduce the general structure of the distributions but not all of the finer details. In conclusion, the advantages of the closure over the traditional Grad closure are also discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Entropy Maximum in Scale-Invariant Processes with 1/f {sup α} Power Spectrum: the Effect of White Noise Anisotropy

Extreme fluctuations are simulated by a system of nonlinear stochastic equations describing the interacting phase transitions. Random 1/f {sup α} processes are formed under the action of anisotropic white noise with α-dependence of the power spectra on frequency and exponent α ranging from 0.7 to 1.7. It is shown that fluctuations with 1/f {sup α} power spectra in the studied range of α correspond to the entropy maximum, which indicates the stability of such processes at different values of exponent α.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Solvent effects determine the sign of the charges of maximum entropy and capacitance at silver electrodes

Fully harnessing electrochemical interfaces for reactions requires a detailed understanding of solvent effects in the electrochemical double layer. Predicting the significant impact of solvents on entropic and electronic properties of electrochemical interfaces has remained an open challenge of computational electrochemistry. Using molecular dynamics simulations of silver–water and silver–acetonitrile interfaces, we show that switching the solvent changes the signs for both the charge of maximum capacitance (CMC) and charge of maximum entropy (CME). Contrasting the capacitance and CME behavior of these two interfaces, we demonstrate that the preferred orientation of the solvent molecule and the corresponding charge density determine the sign of the CMC and CME and, hence, the qualitatively different charge asymmetry of the electrochemical interface.

Chemistry↗

Quantum maximum entropy closure for small flavor coherence

Quantum angular moment transport schemes are an important avenue toward describing neutrino flavor mixing phenomena in dense astrophysical environments such as supernovae and merging neutron stars. Successful implementation will require new closure relations that go beyond those used in classical transport. In this paper, we derive the first analytic expression for a quantum M1 closure, valid in the limit of small flavor coherence, based on the maximum entropy principle. We verify that the resulting closure relation has the appropriate limits and characteristic speeds in the diffusive and free-streaming regimes. We then use this new closure in a moment linear stability analysis to search for fast flavor instabilities in a binary neutron star merger simulation and find better results as compared with previously designed, ad hoc , semiclassical closures.

astrophysical & cosmological simulations↗

Mapping Yearly Fine Resolution Global Surface Ozone through the Bayesian Maximum Entropy Data Fusion of Observations and Model Output for 1990–2017

Estimates of ground-level ozone concentrations are necessary to determine the human health burden of ozone. To support the Global Burden of Disease Study, we produce yearly fine resolution global surface ozone estimates from 1990 to 2017 through a data fusion of observations and models. As ozone observations are sparse in many populated regions, we use a novel combination of the M3Fusion and Bayesian Maximum Entropy (BME) methods. With M3Fusion, we create a multi-model composite by bias-correcting and weighting nine global atmospheric chemistry models based on their ability to predict observations (8,834 sites globally)in each region and year. BME is then used to integrate observations, such that estimates match observations at each monitoring site with the observational influence decreasing smoothly across space and time until the output matches the multi-model composite. After estimating at 0.5° resolution using BME, we add fine spatial detail from an additional model, yielding estimates at 0.1° resolution. Observed ozone is predicted more accurately (R2=0.81 at test point, 0.63 at 0.1°,0.62 at 0.5°) than the multi-model mean (R2=0.28 at 0.5°). Global ozone exposure is estimated to be increasing, driven by highly populated regions of Asia and Africa, despite decreases in the United States and Russia.

environmental modeling↗

Test images for the maximum entropy image restoration method

One of the major activities of any experimentalist is data analysis and reduction. In solar physics, remote observations are made of the sun in a variety of wavelengths and circumstances. In no case is the data collected free from the influence of the design and operation of the data gathering instrument as well as the ever present problem of noise. The presence of significant noise invalidates the simple inversion procedure regardless of the range of known correlation functions. The Maximum Entropy Method (MEM) attempts to perform this inversion by making minimal assumptions about the data. To provide a means of testing the MEM and characterizing its sensitivity to noise, choice of point spread function, type of data, etc., one would like to have test images of known characteristics that can represent the type of data being analyzed. A means of reconstructing these images is presented.

Mackey, James E.↗

A Modified Maximum Entropy Inverse Reinforcement Learning Approach for Microgrid Energy Scheduling

Increasing popularity of integrating distributed energy resources (DERs) into the power system brings a challenge to optimize the microgrid dispatch policy. The reinforcement learning methods suffer from a long-time problem with the theoretical assumption of the objective/reward function for the microgrid system. Although the traditional inverse reinforcement learning (IRL) approaches can solve this problem to some extent, they encounter a limitation of complex computations for state visitation frequency in the large and continuous state space. To alleviate this limitation, we propose a modified maximum entropy IRL (MMIRL) method to extract the reward function from the expert demonstrations for solving the microgrid energy scheduling problem. The proposed MMIRL algorithm is promising in recovering the reward function and learning the dispatch policy compared to conventional approaches. Case studies are performed in an energy arbitrage problem and a microgrid system with DERs. Results substantiate that the proposed MMIRL approach can learn the dispatch policy with more than 99% efficiency and outperforms other comparative methods.

artificial intelligence, reinforcement learning, m↗

Maximum Entropy Principle in Deep Thermalization and in Hilbert-Space Ergodicity

We report universal statistical properties displayed by ensembles of pure states that naturally emerge in quantum many-body systems. Specifically, two classes of state ensembles are considered: those formed by (i) the temporal trajectory of a quantum state under unitary evolution or (ii) the quantum states of small subsystems obtained by partial, local projective measurements performed on their complements. These cases, respectively, exemplify the phenomena of “Hilbert-space ergodicity” and “deep thermalization.” In both cases, the resultant ensembles are defined by a simple principle: The distributions of pure states have maximum entropy, subject to constraints such as energy conservation, and effective constraints imposed by thermalization. We present and numerically verify quantifiable signatures of this principle by deriving explicit formulas for all statistical moments of the ensembles, proving the necessary and sufficient conditions for such universality under widely accepted assumptions, and describing their measurable consequences in experiments. We further discuss information-theoretic implications of the universality: Our ensembles have maximal information content while being maximally difficult to interrogate, establishing that generic quantum state ensembles that occur in nature hide (scramble) information as strongly as possible. Our results generalize the notions of Hilbert-space ergodicity to time-independent Hamiltonian dynamics and deep thermalization from infinite to finite effective temperature. Our work presents new perspectives to characterize and understand universal behaviors of quantum dynamics using statistical and information-theoretic tools.

Eigenstate thermalization↗

On the maximum-entropy/autoregressive modeling of time series

The autoregressive (AR) model of a random process is interpreted in the light of the Prony's relation which relates a complex conjugate pair of poles of the AR process in the z-plane (or the z domain) on the one hand, to the complex frequency of one complex harmonic function in the time domain on the other. Thus the AR model of a time series is one that models the time series as a linear combination of complex harmonic functions, which include pure sinusoids and real exponentials as special cases. An AR model is completely determined by its z-domain pole configuration. The maximum-entropy/autogressive (ME/AR) spectrum, defined on the unit circle of the z-plane (or the frequency domain), is nothing but a convenient, but ambiguous visual representation. It is asserted that the position and shape of a spectral peak is determined by the corresponding complex frequency, and the height of the spectral peak contains little information about the complex amplitude of the complex harmonic functions.

Chao, B. F.↗

Stochastic model of the NASA/MSFC ground facility for large space structures with uncertain parameters: The maximum entropy approach, part 2

A validated technology data base is being developed in the areas of control/structures interaction, deployment dynamics, and system performance for Large Space Structures (LSS). A Ground Facility (GF), in which the dynamics and control systems being considered for LSS applications can be verified, was designed and built. One of the important aspects of the GF is to verify the analytical model for the control system design. The procedure is to describe the control system mathematically as well as possible, then to perform tests on the control system, and finally to factor those results into the mathematical model. The reduction of the order of a higher order control plant was addressed. The computer program was improved for the maximum entropy principle adopted in Hyland's MEOP method. The program was tested against the testing problem. It resulted in a very close match. Two methods of model reduction were examined: Wilson's model reduction method and Hyland's optimal projection (OP) method. Design of a computer program for Hyland's OP method was attempted. Due to the difficulty encountered at the stage where a special matrix factorization technique is needed in order to obtain the required projection matrix, the program was successful up to the finding of the Linear Quadratic Gaussian solution but not beyond. Numerical results along with computer programs which employed ORACLS are presented.

Hsia, Wei Shen↗

Microcanonical rates from ring-polymer molecular dynamics: Direct-shooting, stationary-phase, and maximum-entropy approaches

We address the calculation of microcanonical reaction rates for processes involving significant nuclear quantum effects using ring-polymer molecular dynamics (RPMD), both with and without electronically non-adiabatic transitions. After illustrating the shortcomings of the naive free-particle direct-shooting method, in which the temperature of the internal ring-polymer modes is set to the translational energy scale, we investigate alternative strategies based on the expression for the microcanonical rate in terms of the inverse Laplace transform of the thermal reaction rate. It is shown that simple application of the stationary-phase approximation (SPA) dramatically improves the performance of the microcanonical rates using RPMD, particularly in the low-energy region where tunneling dominates. Using the SPA as a Bayesian prior, numerically exact RPMD microcanonical rates are then obtained using maximum entropy inversion of the thermal reaction rates for both electronically adiabatic and non-adiabatic model systems. Finally, the direct-shooting method is revisited using the SPA-determined temperature for the internal ring-polymer modes, leading to a simple, direct-simulation method with improved accuracy in the tunneling regime. This work suggests a general strategy for the extraction of microcanonical dynamical quantities from RPMD (or other approximate thermal) simulations.

Tao, Xuecheng↗

Complex Structural Disorder in a Polar Orthorhombic Perovskite Observed through the Maximum Entropy Method/Rietveld Technique

Ambient pressure stable perovskite oxides with all Bi3+ on the A-site are rare, with only four examples known. Due to the lone pair on Bi 3+ , these materials are seen as the best alternative to Pb-based piezoelectrics, which are used widely in society. The industry standard piezoelectric, Pb (Zr 1 – x Ti x )O 3 , relies on the [001] polarization of PbTiO 3 , but there are currently no ambient pressure stable Bi-based perovskites with this polarization vector, preventing the creation of an analogous system. We present the full structural analysis of the orthorhombic phase of (1 – x)Bi (Ti 3/8 Fe 2/8 Mg 3/8 )O 3 – x CaTiO 3 , which crystallizes in Pna2 1 symmetry with [001] polarization. This symmetry is rare and has only been reported twice for perovskites at ambient conditions. Analysis of maximum entropy method (MEM) models using synchrotron radiation powder X-ray diffraction reveals a disordered A-site configuration, and the MEM/Rietveld technique generates a structural model of this extreme disorder. Combined Rietveld analysis of X-ray and neutron diffraction data yields an accurate description of the local A-site configuration, which we use to understand our dielectric, ferroelectric, and piezoelectric measurements. These results give insight into how to stabilize this unique symmetry and inspire new design principles for Bi-based piezoelectrics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Maximum entropy modeling to identify physical drivers of shallow snowpack heterogeneity using unpiloted aerial system (UAS) lidar

Understanding the spatial variability of the snowpack is valuable for hydrologists and ecologists seeking to predict hydrological processes in a cold region. Snow distribution is a function of interactions among static variables, such as terrain, vegetation, and soil properties, and dynamic meteorological variables, such as solar radiation, wind speed and direction, and soil moisture. However, identifying the dominant physical drivers responsible for spatial patterns of the snowpack, particularly for ephemeral, shallow snowpacks, has been challenging due to the lack of the high-resolution snowpack and physical variables with high vertical accuracy as well as inherent limitations in traditional approaches. This study uses an Unpiloted Aerial System (UAS) lidar-based snow depth and static variables (1-m spatial resolution) to analyze field-scale spatial structures of snow depth and apply the Maximum Entropy (MaxEnt) model to identify primary controls over open terrain and forests at the University of New Hampshire Thompson Farm Research Observatory, New Hampshire, United States. We found that, among nine topographic and soil variables, plant functional type and terrain roughness contribute up to 80% and 76% of relative importance in the MaxEnt framework to predict locations of deeper or shallower snowpacks, respectively, across a mixed temperate forested and field landscape. Soil variables, such as organic matter and saturated hydraulic conductivity, were also important controls (up to 70% and 81%) on snow depth spatial variations for both open and forested landscapes suggesting spatial variations in soil variables under snow can control thermal transfer among soil, snowpack, and surface-atmosphere. This work contributes to improving land surface and snow models by informing parameterization of the sub-grid scale snow depths, down-scaling remotely sensed snow products, and understanding field scale snow states.

Eunsang Cho↗

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗

Optimal resolution in maximum entropy image reconstruction from projections with multigrid acceleration

We consider the problem of image reconstruction from a finite number of projections over the space L(sup 1)(Omega), where Omega is a compact subset of the set of Real numbers (exp 2). We prove that, given a discretization of the projection space, the function that generates the correct projection data and maximizes the Boltzmann-Shannon entropy is piecewise constant on a certain discretization of Omega, which we call the 'optimal grid'. It is on this grid that one obtains the maximum resolution given the problem setup. The size of this grid grows very quickly as the number of projections and number of cells per projection grow, indicating fast computational methods are essential to make its use feasible. We use a Fenchel duality formulation of the problem to keep the number of variables small while still using the optimal discretization, and propose a multilevel scheme to improve convergence of a simple cyclic maximization scheme applied to the dual problem.

Limber, Mark A.↗

Exact Maximum-Entropy Estimation with Feynman Diagrams

A longstanding open problem in statistics is finding an explicit expression for the probability measure which maximizes entropy with respect to given constraints. In this paper a solution to this problem is found, using perturbative Feynman calculus. The explicit expression is given as a sum over weighted trees.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗