SEARCH · Search NASA

Results for “Gaussian mean-field”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗

DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Quasi-Newton Variational Bayes v.3.0

SAND2024-09052O Quasi-Newton Variational Bayes (QNVB) is a training algorithm that performs high-dimensional variational inference on machine learning models. It provides mechanisms to calibrate and control model uncertainty during training. The PyTorch implementation of projective integral updates for Gaussian mean-fields supports the manuscript, "Projective Integral Updates for High-Dimensional Variational Inference." Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Duersch, Jed↗

DOE OSTI2026

Robust negativity in the quantum-to-classical transition of Kerr dynamics

Here, we quantify the quantum-to-classical transition of the single-mode Kerr nonlinear dynamics in the presence of loss. We establish three timescales that govern the dynamics, each with distinct characteristics. For times short compared with the Ehrenfest time, the evolution is classical, characterized by Gaussian dynamics. For sufficiently long times, as we increase the initial photon number, unitary Kerr evolution would generate macroscopic superpositions of coherent states (so-called kitten states). However, this is severely restricted in the presence of small photon loss, and the expectation values of observables coincide with their classical values. The intermediate timescale, however, shows resilient quantum behavior in the macroscopic limit. We show that in the mean-field non-Gaussian regime, the Kerr Hamiltonian (with small photon loss) generates a significant amount of Wigner-negativity, and classical flow is recovered only if the loss rate grows with system size. Our results broaden the usual understanding of quantum-to-classical transitions and demonstrate the potential for creating robust nonclassical resources for continuous-variable quantum information processing in the presence of loss.

Raza, Mohsin [University of New Mexico, Albuquerqu↗

DOE OSTI2025

Physics-Driven Construction of Compact Primitive Gaussian Density Fitting Basis Sets

We present a model-assisted density fitting (MADF) basis set generator, an algorithm for generating primitive atomic Gaussian density fitting (DF) basis sets (DFBSs) from a contracted Gaussian orbital basis set (OBS). The MADF algorithm produces DFBSs suitable for accurate robust DF approximation of 2-particle interactions in mean-field and correlated electronic structures. The algorithm is designed to (a) saturate the OBS product space by a large regularized set of primitive solid-harmonic Gaussian shells with nonuniform distribution of exponents, followed by (b) pruning of the shells according to their contributions to the 2- body energy of a correlated atomic ensemble. Building the DFBS generator model almost exclusively on mathematical and physical principles allows one to limit the number of parameters that control the density fitting error to three, with a single set of parameters sufficient for computations with all basis cardinal numbers, with and without correlation of core electrons, with and without scalar and spin-dependent relativistic effects, spanning almost all of the Periodic Table. Performance assessment included basis sets up to quadruple-ζ quality from several major basis set families, using molecules composed of main-group, d-block, and f-block elements. The resulting DF errors in Hartree−Fock and second-order MP2 energies (with relativistic all-electron treatments, when appropriate) were on the order of 20 and 10 μE h per electron, respectively.

Approximation↗

DOE OSTI2022

The density distribution and physical origins of intermittency in supersonic, highly magnetized turbulence with diverse modes of driving

The probability density function (PDF) of the logarithmic density contrast, s = ln (ρ/ρ 0 ), with gas density ρ and mean density ρ 0 , for hydrodynamical supersonic turbulence is well known to have significant non-Gaussian (intermittent) features that monotonically increase with the turbulent Mach number, M. By studying the mass- and volume-weighted s-PDF for an ensemble of 36 sub-to-trans-Alfvenic mean-field, supersonic, isothermal turbulence simulations with different modes of driving, relevant to molecular gas in the cool interstellar medium, we show that a more intricate picture emerges for the non-Gaussian nature of s. Using four independent measures of the non-Gaussian components, we find hydrodynamical-like structure in the highly magnetized plasma for M≲4. However, for M≳4, the non-Gaussian signatures disappear, leaving approximately Gaussian s-statistics – exactly the opposite of hydrodynamical turbulence in the high-M limit. We also find that the non-Gaussian components of the PDF increase monotonically with more compressive driving modes. To understand the M≲4 non-Gaussian features, we use one-dimensional pencil beams to explore the dynamics along and across the large-scale magnetic field, B 0 . Here we discuss kinetic, density, and magnetic field fluctuations from the pencil beams, and identify physical sources of non-Gaussian components to the PDF as single, strong shocks coupled to fast magnetosonic compressions that form along B 0 . We discuss the Gaussianization of the M≳4 s-fields through the lens of two phenomenologies: the self-similarity of the s-field and homogenization of the dynamical time-scales between the over- and underdense regions in the compressible gas.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Exploring the energy landscape of RBMs: reciprocal space insights into bosons, hierarchical learning and symmetry breaking

Deep generative models have become ubiquitous due to their ability to learn and sample from complex distributions. Despite the proliferation of various frameworks, the relationships among these models remain largely unexplored, a gap that hinders the development of a unified theory of AI learning. In this work, we address two central challenges: clarifying the connections between different deep generative models and deepening our understanding of their learning mechanisms. We focus on Restricted Boltzmann Machines (RBMs), a class of generative models known for their universal approximation capabilities for discrete distributions. By introducing a reciprocal space formulation for RBMs, we reveal a connection between these models, diffusion processes, and systems of coupled bosons. Our analysis shows that at initialization, the RBM operates at a saddle point, where the local curvature is determined by the singular values of the weight matrix, whose distribution follows the Marc̆enko-Pastur law and exhibits rotational symmetry. During training, this rotational symmetry is broken due to hierarchical learning, where different degrees of freedom progressively capture features at multiple levels of abstraction. This leads to a symmetry breaking in the energy landscape, reminiscent of Landau’s theory. This symmetry breaking in the energy landscape is characterized by the singular values and the weight matrix eigenvector matrix. We derive the corresponding free energy in a mean-field approximation. We show that in the limit of infinite size RBM, the reciprocal variables are Gaussian distributed. Our findings indicate that in this regime, there will be some modes for which the diffusion process will not converge to the Boltzmann distribution. To illustrate our results, we trained replicas of RBMs with different hidden layer sizes using the MNIST dataset. Our findings not only bridge the gap between disparate generative frameworks but also shed light on the fundamental processes underpinning learning in deep generative models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Determining Gyration Tensor of Orienting Macromolecules through Their Scattering Signature

A method is presented for quantitatively evaluating the shape and size of deformed particles in dispersion from their two-dimensional anisotropic spectra by small-angle scattering. By means of real spherical harmonic expansion, we derive analytical expressions of the gyration tensor R in terms of experimentally measured anisotropic scattering functions, yielding a tensorial extension of the Guinier law. We demonstrate the usefulness of this approach by a model study of an affinely deformed Gaussian chain. We further show that radius of gyration R g is the source term of intraparticle structure factor at the mean-field limit, and from this perspective, we address the connection between R and conformation asphericity. As a result, the developed method not only facilitates quantitative scattering studies of deforming materials, but also provides insightful information regarding their deformation behavior at the molecular level based on the symmetric properties of real spherical harmonics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2019

Composite-particle decay widths by the generator coordinate method

We study the feasibility of applying the Generator Coordinate Method (GCM) of self-consistent mean-field theory to calculate decay widths of composite particles to composite-particle final states. The main question is how well the GCM can approximate continuum wave functions in the decay channels. The analysis is straightforward under the assumption that the GCM wave functions are separable into internal and Gaussian center-of-mass wave functions. Two methods are examined for calculating decay widths. In one method, the density of final states is computed entirely in the GCM framework. In the other method, it is determined by matching the GCM wave function to an asymptotic scattering wave function. Both methods are applied to a numerical example and are found to agree within their determined uncertainties.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Inhomogeneous mean-field approach to collective excitations near the superfluid–Mott glass transition

Highlights: • Unconventional collective excitations across the superfluid–Mott glass transition. • Higgs mode localized in superfluid and insulating phases. • Broad uncritical amplitude response function at quantum phase transition. • Goldstone mode delocalizes in the superfluid phase. We develop an inhomogeneous quantum mean-field approach to the behavior of collective excitations across the superfluid–Mott glass quantum phase transition in two dimensions, complementing recent quantum Monte Carlo simulations (Puschmann et al. 2020). In quadratic (Gaussian) approximation, the Goldstone (phase) and Higgs (amplitude) modes completely decouple. Each is described by a disordered Bogoliubov Hamiltonian which can be solved by an inhomogeneous multi-mode Bogoliubov transformation. We find that the Higgs mode is spatially localized in both phases. The corresponding scalar spectral function shows a broad peak that is noncritical in the sense that its peak frequency does not soften but remains nonzero across the quantum phase transition. In contrast, the lowest-energy Goldstone mode delocalizes in the superfluid phase, leading to a zero-frequency spectral peak. We compare these findings to the results of the quantum Monte Carlo simulations. We also relate them to general results on the localization of bosonic excitations, and we discuss the limits and generality of our approach.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Alternating and Gaussian Fermionic Isometric Tensor Network States

Isometric tensor networks in two dimensions enable efficient and accurate study of quantum many-body states, yet the effect of the isometric restriction on the represented quantum states is not fully understood. We address this question in two main contributions. First, we introduce an improved variant of isometric tensor network states (isoTNS) in two dimensions, where the isometric arrows on the columns of the network alternate between pointing upward and downward; hence the name alternating isometric tensor network states. Second, we introduce a numerical tool—the isometric Gaussian fermionic TNS (isoGfTNS)—that incorporates isometric constraints into the framework of Gaussian fermionic tensor network states. We demonstrate in numerous ways that alternating isoTNSs represent many-body ground states of two-dimensional quantum systems significantly better than the original isoTNSs. First, we show that the entanglement in an isoTNS is mediated along the isometric arrows and that alternating isoTNSs mediate entanglement more efficiently than conventional isoTNSs. Second, alternating isoTNSs correspond to a deeper, and thus more representative, sequential-circuit construction of depth 𝒪⁢(𝐿𝑥 ⋅𝐿𝑦) compared to the original isoTNSs of depth 𝒪⁢(𝐿𝑥 +𝐿𝑦). Third, using the Gaussian framework and gradient-based energy minimization, we provide numerical evidence of better bond-dimension scaling and variational energy of alternating isoGfTNSs for ground states of various free-fermionic models, including the Fermi surface, the band insulator, and the 𝑝𝑥 +𝑖⁢𝑝𝑦 mean-field superconductor. Finally, benchmarking on the transverse-field Ising model, we demonstrate that an alternating isoTNS provides substantially improved performance and stability relative to the original isoTNS for the ground-state search algorithm in interacting systems.

Wu, Yantao [Chinese Academy of Sciences, Beijing (↗

DOE OSTI2022

Role of non-Gaussian quantum fluctuations in neutrino entanglement

The flavor evolution of neutrinos in environments with large neutrino number densities is an open problem at the nexus of astrophysics and neutrino flavor physics. Among the many unanswered questions pertaining to this problem, it remains to be determined whether neutrino-neutrino coherent scattering can give rise to nontrivial quantum entanglement among neutrinos, and whether this can affect the flavor evolution in a meaningful way. To gain further insight into this question, here we study a simple system of two interacting neutrino beams and obtain the exact phase space explored by this system using the Husimi quasiprobability distribution. We observe that the entanglement induced by the coupling leads to strong delocalization in phase-space with largely non-Gaussian quantum fluctuations. The link between the neutrino entanglement and quantum fluctuations is illustrated using the one- and two-neutrino entropy. In addition, we propose an approximate phase-space method to describe the interacting neutrinos problem, where the exact evolution is replaced by a set of independent mean-field evolutions with a statistical sampling of the initial conditions. The phase-space approach provides a simple and accurate method to describe the gross features of the neutrino entanglement problem. Applications are shown using time-independent and time-dependent Hamiltonians in the nonadiabatic regime.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Role of non-gaussian quantum fluctuations in neutrino entanglement

The flavor evolution of neutrinos in environments with large neutrino number densities is an open problem at the nexus of astrophysics and neutrino flavor physics. Among the many unanswered questions pertaining to this problem, it remains to be determined whether neutrino-neutrino coherent scattering can give rise to nontrivial quantum entanglement among neutrinos, and whether this can affect the flavor evolution in a meaningful way. To gain further insight into this question, here we study a simple system of two interacting neutrino beams, and obtain the exact phase-space explored by this system using the Husimi quasi-probability distribution. We observe that the entanglement induced by the coupling leads to strong delocalization in phase-space with largely non-Gaussian quantum fluctuations. The link between the neutrino entanglement and quantum fluctuations is illustrated using the one- and two-neutrino entropy. In addition, we propose an approximate phase-space method to describe the interacting neutrinos problem, where the exact evolution is replaced by a set of independent mean-field evolutions with a statistical sampling of the initial conditions. The phase-space approach provides a simple and accurate method to describe the gross features of the neutrino entanglement problem. Applications are shown using time-independent and time-dependent Hamiltonians in the non-adiabatic regime.

Patwardhan, Amol↗

DOE OSTI2020

TurboRVB: A many-body toolkit for ab initio electronic simulations by quantum Monte Carlo

TurboRVB is a computational package for ab initio Quantum Monte Carlo (QMC) simulations of both molecular and bulk electronic systems. The code implements two types of well established QMC algorithms: Variational Monte Carlo (VMC) and diffusion Monte Carlo in its robust and efficient lattice regularized variant. A key feature of the code is the possibility of using strongly correlated many-body wave functions (WFs), capable of describing several materials with very high accuracy, even when standard mean-field approaches [e.g., density functional theory (DFT)] fail. The electronic WF is obtained by applying a Jastrow factor, which takes into account dynamical correlations, to the most general mean-field ground state, written either as an antisymmetrized geminal power with spin-singlet pairing or as a Pfaffian, including both singlet and triplet correlations. This WF can be viewed as an efficient implementation of the so-called resonating valence bond (RVB) Ansatz, first proposed by Pauling and Anderson in quantum chemistry [L. Pauling, The Nature of the Chemical Bond (Cornell University Press, 1960)] and condensed matter physics [P.W. Anderson, Mat. Res. Bull 8, 153 (1973)], respectively. The RVB Ansatz implemented in TurboRVB has a large variational freedom, including the Jastrow correlated Slater determinant as its simplest, but nontrivial case. Moreover, it has the remarkable advantage of remaining with an affordable computational cost, proportional to the one spent for the evaluation of a single Slater determinant. Therefore, its application to large systems is computationally feasible. The WF is expanded in a localized basis set. Several basis set functions are implemented, such as Gaussian, Slater, and mixed types, with no restriction on the choice of their contraction. The code implements the adjoint algorithmic differentiation that enables a very efficient evaluation of energy derivatives, comprising the ionic forces. Thus, one can perform structural optimizations and molecular dynamics in the canonical NVT ensemble at the VMC level. For the electronic part, a full WF optimization (Jastrow and antisymmetric parts together) is made possible, thanks to state-of-the-art stochastic algorithms for energy minimization. In the optimization procedure, the first guess can be obtained at the mean-field level by a built-in DFT driver. The code was efficiently parallelized by using a hybrid MPI-OpenMP protocol, which is also an ideal environment for exploiting the computational power of modern Graphics Processing Unit accelerators.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Efficient Probabilistic Visualization of Local Divergence of 2D Vector Fields with Independent Gaussian Uncertainty

This work focuses on visualizing uncertainty of local divergence of two-dimensional vector fields. Divergence is one of the fundamental attributes of fluid flows, as it can help domain scientists analyze potential positions of sources (positive divergence) and sinks (negative divergence) in the flow. However, uncertainty inherent in vector field data can lead to erroneous divergence computations, adversely impacting downstream analysis. While Monte Carlo (MC) sampling is a classical approach for estimating divergence uncertainty, it suffers from slow convergence and poor scalability with increasing data size and sample counts. Thus, we present a two-fold contribution that tackles the challenges of slow convergence and limited scalability of the MC approach. (1) We derive a closed-form approach for highly efficient and accurate uncertainty visualization of local divergence, assuming independently Gaussian-distributed vector uncertainties. (2) We further integrate our approach into Viskores, a platform-portable parallel library, to accelerate uncertainty visualization. In our results, we demonstrate significantly enhanced efficiency and accuracy of our serial analytical (speed-up up to 1946×) and parallel Viskores (speed-up up to 19698×) algorithms over the classical serial MC approach. We also demonstrate qualitative improvements of our probabilistic divergence visualizations over traditional mean-field visualization, which disregards uncertainty. We validate the accuracy and efficiency of our methods on wind forecast and ocean simulation datasets.

Ouermi, Timbwaoga [University of Utah]↗

DOE OSTI2022

Stochastic exciton-scattering theory of optical line shapes: Renormalized many-body contributions

Spectral line shapes provide a window into the local environment coupled to a quantum transition in the condensed phase. In this paper, we build upon a stochastic model to account for non-stationary background processes produced by broad-band pulsed laser stimulation, as distinguished from those for stationary phonon bath. In particular, we consider the contribution of pair-fluctuations arising from the full bosonic many-body Hamiltonian within a mean-field approximation, treating the coupling to the system as a stochastic noise term. Herein, using the Itô transformation, we consider two limiting cases for our model, which lead to a connection between the observed spectral fluctuations and the spectral density of the environment. In the first case, we consider a Brownian environment and show that this produces spectral dynamics that relax to form dressed excitonic states and recover an Anderson–Kubo-like form for the spectral correlations. In the second case, we assume that the spectrum is Anderson–Kubo like and invert to determine the corresponding background. Using the Jensen inequality, we obtain an upper limit for the spectral density for the background. The results presented here provide the technical tools for applying the stochastic model to a broad range of problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2015

Two-Yukawa fluid at a hard wall: Field theory treatment

We apply a field-theoretical approach to study the structure and thermodynamics of a two-Yukawa fluid confined by a hard wall. We derive mean field equations allowing for numerical evaluation of the density profile which is compared to analytical estimations. Beyond the mean field approximation, analytical expressions for the free energy, the pressure, and the correlation function are derived. Subsequently, contributions to the density profile and the adsorption coefficient due to Gaussian fluctuations are found. Both the mean field and the fluctuation terms of the density profile are shown to satisfy the contact theorem. We further use the contact theorem to improve the Gaussian approximation for the density profile based on a better approximation for the bulk pressure. The results obtained are compared to computer simulation data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗