Search NASA⌕ Search

SEARCH · Search NASA

Results for “Maximum Entropy Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

242 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reference data, predictors, and probability grids for forest degradation classes in three sites in the Brazilian Amazon

Forest degradation by fires and selective logging is widespread in the Amazon region. We implemented a gradient boosted classification modeling framework to classify intact, logged, and burned forests at three Amazonian sites: Feliz Natal Municipality and Xingu Indigenous Territory in Mato Grosso State, and Saracá-Taquera National Forest in Pará State. We used forest degradation history from Landsat time-series as reference data and textural metrics derived from PlanetScope images as predictors. Textural metrics were computed using the Gray-Level Co-Occurrence Matrix (GLCM) textural technique. Included in the attached zip file are ten files: - a shapefile containing the reference data (fire and selective logging polygons and year of event) for each site; - a multiband tif file containing the 8 GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, Correlation) at the original PlanetScope resolution (3.125m) for each site; - a multiband tif file containing the 72 aggregated GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, and Correlation aggregated using the mean, first quartile, third quartile, maximum, median, minimum, root mean square, standard deviation, and skewness statistics) at 562m resolution for each site; - a multiband tif file containing the 3 probability grids for either intact, logged, or burned forests at the aggregation resolution (562m) for each site.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

The Bayesian reconstruction of the in-medium heavy quark potential from lattice QCD and its stability

We report recent results of a non-perturbative determination of the static heavy-quark potential in quenched and dynamical lattice QCD at finite temperature. The real and imaginary part of this complex quantity are extracted from the spectral function of Wilson line correlators in Coulomb gauge. To obtain spectral information from Euclidean time numerical data, our study relies on a novel Bayesian prescription that differs from the Maximum Entropy Method. We perform simulations on quenched 32{sup 3} × N{sub τ} (β = 7.0, ξ = 3.5) lattices with N{sub τ} = 24, …, 96, which cover 839MeV ≥ T ≥ 210MeV. To investigate the potential in a quark-gluon plasma with light u,d and s quarks we utilize N{sub f} = 2 + 1 ASQTAD lattices with m{sub l} = m{sub s}/20 by the HotQCD collaboration, giving access to temperatures between 286MeV ≥ T ≥ 148MeV. The real part of the potential exhibits a clean transition from a linear, confining behavior in the hadronic phase to a Debye screened form above deconfinement. Interestingly its values lie close to the color singlet free energies in Coulomb gauge at all temperatures. We estimate the imaginary part on quenched lattices and find that it is of the same order of magnitude as in hard-thermal loop perturbation theory. From among all the systematic checks carried out in our study, we discuss explicitly the dependence of the result on the default model and the number of datapoints.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2017

Diagnosing Undersampling Biases in Monte Carlo Eigenvalue and Flux Tally Estimates

Here, this study focuses on understanding the phenomena in Monte Carlo simulations known as undersampling, in which Monte Carlo tally estimates may not encounter a sufficient number of particles during each generation to obtain unbiased tally estimates. Steady-state Monte Carlo simulations were performed using the KENO Monte Carlo tools within the SCALE code system for models of several burnup credit applications with varying degrees of spatial and isotopic complexities, and the incidence and impact of undersampling on eigenvalue and flux estimates were examined. Using an inadequate number of particle histories in each generation was found to produce a maximum bias of ~100 pcm in eigenvalue estimates and biases that exceeded 10% in fuel pin flux tally estimates. Having quantified the potential magnitude of undersampling biases in eigenvalue and flux tally estimates in these systems, this study then investigated whether Markov Chain Monte Carlo convergence metrics could be integrated into Monte Carlo simulations to predict the onset and magnitude of undersampling biases. Five potential metrics for identifying undersampling biases were implemented in the SCALE code system and evaluated for their ability to predict undersampling biases by comparing the test metric scores with the observed undersampling biases. Finally, of the five convergence metrics that were investigated, three (the Heidelberger-Welch relative half-width, the Gelman-Rubin $\hat{R}_c$ diagnostic, and tally entropy) showed the potential to accurately predict the behavior of undersampling biases in the responses examined.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1981

Information theory lateral density distribution for Earth inferred from global gravity field

Information Theory Inference, better known as the Maximum Entropy Method, was used to infer the lateral density distribution inside the Earth. The approach assumed that the Earth consists of indistinguishable Maxwell-Boltzmann particles populating infinitesimal volume elements, and followed the standard methods of statistical mechanics (maximizing the entropy function). The GEM 10B spherical harmonic gravity field coefficients, complete to degree and order 36, were used as constraints on the lateral density distribution. The spherically symmetric part of the density distribution was assumed to be known. The lateral density variation was assumed to be small compared to the spherically symmetric part. The resulting information theory density distribution for the cases of no crust removed, 30 km of compensated crust removed, and 30 km of uncompensated crust removed all gave broad density anomalies extending deep into the mantle, but with the density contrasts being the greatest towards the surface (typically + or 0.004 g cm 3 in the first two cases and + or - 0.04 g cm 3 in the third). None of the density distributions resemble classical organized convection cells. The information theory approach may have use in choosing Standard Earth Models, but, the inclusion of seismic data into the approach appears difficult.

Rubincam, D. P.↗
DOE OSTI2025

Comparing three generations of D-Wave quantum annealers for minor embedded combinatorial optimization problems

Abstract Quantum annealing (QA) is a novel type of analog computation that aims to use quantum mechanical fluctuations to search for optimal solutions of Ising problems. QA in the transverse Ising model, implemented on D-Wave quantum processing units, are available as cloud computing resources. In this study we report concise benchmarks across three generations of D-Wave quantum annealers, consisting of four different devices, for the NP-hard discrete combinatorial optimization problems unweighted maximum clique and unweighted maximum cut on random graphs. The Ising, or equivalently quadratic unconstrained binary optimization, formulation of these problems do not require auxiliary variables for order reduction, and their overall structure and weights are not highly variable, which makes these problems simple test cases to understand the sampling capability of current D-Wave quantum annealers. All-to-all minor embeddings of size 52, with relatively uniform chain lengths, are used for a direct comparison across the Chimera, Pegasus, and Zephyr device topologies. A grid-search over annealing times and the minor embedding chain strengths is performed in order to determine the level of reasonable performance for each device and problem type. Experiment metrics that are reported are approximation ratios for non-broken chain samples, chain break proportions, and time-to-solution for the maximum clique problem instances. How fairly the quantum annealers sample optimal maximum cliques, for instances which contain multiple maximum cliques, is quantified using entropy of the measured ground state distributions. The newest generation of quantum annealing hardware, which has a Zephyr hardware connectivity, performed the best overall with respect to approximation ratios and chain break frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Maximum Entropy Principle in Deep Thermalization and in Hilbert-Space Ergodicity

We report universal statistical properties displayed by ensembles of pure states that naturally emerge in quantum many-body systems. Specifically, two classes of state ensembles are considered: those formed by (i) the temporal trajectory of a quantum state under unitary evolution or (ii) the quantum states of small subsystems obtained by partial, local projective measurements performed on their complements. These cases, respectively, exemplify the phenomena of “Hilbert-space ergodicity” and “deep thermalization.” In both cases, the resultant ensembles are defined by a simple principle: The distributions of pure states have maximum entropy, subject to constraints such as energy conservation, and effective constraints imposed by thermalization. We present and numerically verify quantifiable signatures of this principle by deriving explicit formulas for all statistical moments of the ensembles, proving the necessary and sufficient conditions for such universality under widely accepted assumptions, and describing their measurable consequences in experiments. We further discuss information-theoretic implications of the universality: Our ensembles have maximal information content while being maximally difficult to interrogate, establishing that generic quantum state ensembles that occur in nature hide (scramble) information as strongly as possible. Our results generalize the notions of Hilbert-space ergodicity to time-independent Hamiltonian dynamics and deep thermalization from infinite to finite effective temperature. Our work presents new perspectives to characterize and understand universal behaviors of quantum dynamics using statistical and information-theoretic tools.

Eigenstate thermalization↗
NASA NTRS1993

Application of the target decomposition theorem to a polarimetric random media model

With advances in polarimetric radar measurements of land surfaces, the need for understanding the underlying scattering mechanisms and dominant target features has become the focus of many studies. In particular, the maximum use of the polarimetric information to identify and/or separate parameters related to the surface features such as vegetation thickness, structure, water content, and soil surface characteristics will enhance the possibility of using polarimetric radars for monitoring the earth's surface from space. In this paper, Cloude's decomposition theorem is applied to a polarimetric random media model to simulate the radar measurements of vegetated canopies. The vegetated canopies are modeled as a three layer discrete random medium with leaves and branches in the first layer, tree trunks in the second layer, and a half space of homogeneous ground with rough interface as the bottom layer. The distorted born approximation (DBA) has been used to compute full Mueller matrix of the canopy, using canonical dielectric objects such as thin discs and cylinders as leaves, branches, and trunks, respectively. The Mueller matrix and the derived covariance matrix contain information on the second order statistics of radar signals at various polarizations from the canopy. To decompose the covariance matrix to its constituent targets, the eigenvalues and eigenvectors of the covariance matrix are computed in terms of the physical parameters of the canopy. In addition, each eigenvector explicitly shows the scattering mechanisms such as odd and even reflections in the canopy. Cloude's decomposition theorem is applied using the Pauli spin matrices as a basis and an expression for the degree of disorder or the entropy for the vegetated surface is found. Then, the physical parameters estimated from in situ measurements are used in the random media to obtain realistic covariance matrices. As a result, the sensitivity of the eigenvalue spectrums and the coefficients resulting from the target decomposition theorem to the physical parameters of the canopy are examined and the possible use of Cloude's theorem to estimate vegetation and soil parameters is discussed.

Saatchi, Sasan S.↗