Search NASA⌕ Search

SEARCH · Search NASA

Results for “Function approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Closed-Form Approximation of the Total Variation Proximal Operator

Total variation (TV) is a widely used function for regularizing imaging inverse problems that is particularly appropriate for images whose underlying structure is piecewise constant. TV regularized optimization problems are typically solved using proximal methods, but the way in which they are applied is constrained by the absence of a closed-form expression for the proximal operator of the TV function. A closed-form approximation of the TV proximal operator has previously been proposed, but its accuracy was not theoretically explored in detail. Here, we address this gap by making several new theoretical contributions, proving that the approximation leads to a proximal operator of some convex function, it is equivalent to a gradient descent step on a smoothed version of TV, and that its error can be fully characterized and controlled with its scaling parameter. We experimentally validate our theoretical results on image denoising and sparse-view computed tomography (CT) image reconstruction.

97 MATHEMATICS AND COMPUTING↗

Optimization of the Reax force field for the lithium–oxygen system using a high fidelity charge model

Studies using molecular dynamics (MD) have long struggled to simulate the failure modes of materials, predicting unrealistically high ductility and failing to capture brittle fracture. The primary cause of this shortcoming is an inadequate description of bond breaking. While reactive force fields such as ReaxFF show improvements compared to traditional force fields, the charge models used yield unphysical partial charges, especially during dissociation of ionic bonds. This flaw may be remedied by using the atom-condensed Kohn–Sham density functional theory (DFT) approximated to a second order (ACKS2) charge model for determining partial charges. In this work, we present a new ACKS2-enabled Reax force field for fracture simulations of lithium oxide systems, which was obtained by training against an extensive set of DFT, multireference configuration interaction (MRCI), and MRCI+Q reference data using genetic optimization techniques. This new force field significantly improves the bond breaking behavior, but still cannot fully capture the brittle fracture in MD simulations, suggesting more research is needed to improve simulation of brittle fracture.

36 MATERIALS SCIENCE↗

Advances and Challenges of SCAN and r 2 SCAN Density Functionals in Transition‐Metal Compounds

ABSTRACT Transition‐metal compounds (TMCs) with open‐shell d ‐electrons are characterized by a complex interplay of lattice, charge, orbital, and spin degrees of freedom, giving rise to various fascinating applications. Often exhibiting exotic properties, these compounds are commonly classified as correlated systems due to strong inter‐electronic interactions called Hubbard U . This inherent complexity presents significant challenges to Kohn‐Sham density functional theory (KS‐DFT), the most widely used electronic structure method in condensed matter physics and materials science. While KS‐DFT is, in principle, exact for the ground‐state total energy, its exchange‐correlation energy must be approximated in practice. The mean‐field nature of KS implementations, combined with the limitations of current exchange‐correlation density functional approximations, has led to the perception that DFT is inadequate for correlated systems, particularly TMCs. Consequently, a common workaround involves augmenting DFT with an on‐site Hubbard‐like U correction. In recent years, the strongly constrained and appropriately normed (SCAN) density functional, along with its refined variant r 2 SCAN, has achieved remarkable progress in accurately describing the structural, energetic, electronic, magnetic, and vibrational properties of TMCs, challenging the traditional perception of DFT's limitations. This review explores the design principles of SCAN and r 2 SCAN, highlights their key advancements in studying TMCs, explains the mechanisms driving these improvements, and addresses the remaining challenges in this evolving field.

Zhang, Yubo [Minjiang Collaborative Center for The↗

A unified and constructive framework for the universality of neural networks

Abstract One of the reasons why many neural networks are capable of replicating complicated tasks or functions is their universal approximation property. Though the past few decades have seen tremendous advances in theories of neural networks, a single constructive and elementary framework for neural network universality remains unavailable. This paper is an effort to provide a unified and constructive framework for the universality of a large class of activation functions including most of the existing ones. At the heart of the framework is the concept of neural network approximate identity (nAI). The main result is as follows: any nAI activation function is universal in the space of continuous functions on compacta. It turns out that most of the existing activation functions are nAI, and thus universal. The framework induces several advantages over the contemporary counterparts. First, it is constructive with elementary means from functional analysis, probability theory, and numerical analysis. Second, it is one of the first unified and constructive attempts that is valid for most of the existing activation functions. Third, it provides new proofs for most activation functions. Fourth, for a given activation and error tolerance, the framework provides precisely the architecture of the corresponding one-hidden neural network with a predetermined number of neurons and the values of weights/biases. Fifth, the framework allows us to abstractly present the first universal approximation with a favorable non-asymptotic rate. Sixth, our framework also provides insights into the developments, and hence providing constructive derivations, of some of the existing approaches.

97 MATHEMATICS AND COMPUTING↗

MCML: Combining physical constraints with experimental data for a multi-purpose meta-generalized gradient approximation

The predictive power of density functional theory for materials properties can be improved without increasing the overall computational complexity by extending the generalized gradient approximation (GGA) for electronic exchange and correlation to density functionals depending on the electronic kinetic energy density in addition to the charge density and its gradient, resulting in a meta-GGA. Here, we propose an empirical meta-GGA model that is based both on physical constraints and on experimental and quantum chemistry reference data. Overall, the resulting optimized meta-GGA MCML yields improved surface and gas phase reaction energetics without sacrificing the accuracy of bulk property predictions of existing meta-GGA approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Search for Higgs boson pair production in the γγ$b\overline{b} $ final state with 13 TeV pp collision data collected by the ATLAS experiment

A search is performed for resonant and non-resonant Higgs boson pair production in the γγ$b\overline{b} $ final state. The data set used corresponds to an integrated luminosity of 36.1 fb -1 of proton-proton collisions at a centre-of-mass energy of 13 TeV recorded by the ATLAS detector at the CERN Large Hadron Collider. No significant excess relative to the Standard Model expectation is observed. The observed limit on the non-resonant Higgs boson pair cross-section is 0.73 pb at 95% confidence level. This observed limit is equivalent to 22 times the predicted Standard Model cross-section. The Higgs boson self-coupling (κ λ = λ HHH /λ HHH SM ) is constrained at 95% confidence level to -8.2 < κ λ < 13.2. For resonant Higgs boson pair production through X→HH→γγ$b\overline{b} $, the limit is presented, using the narrow-width approximation, as a function of mX in the range 260 GeV < m X < 1000 GeV. The observed limits range from 1.1 pb to 0.12 pb over this mass range. Open image in new window

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Assessing entropy for catalytic processes at complex reactive interfaces

When chemical reactions are accelerated by a catalyst, entropy differences between reactants and their transient intermediates can be the driving force behind the promotion or inhibition of desired and parasitic chemical pathways. Understanding and controlling catalytic processes therefore requires both a fundamental and practicable understanding of entropy in addition to enthalpy. In unstructured media such as the vapor phase equilibrated with sparsely covered surfaces, entropy can be adequately accounted for by well-established approaches based on translational, rotational, and harmonic vibrational partition functions. However, these approximations become inadequate in more complex condensed phase environments, e.g., solid liquid interfaces of confined reaction spaces. In this chapter, we provide an overview of the state-of-art in the computational quantification of entropy and its known ramifications on catalysis. The fundamental roles of thermodynamics and kinetics in catalysis are covered in enough detail to appreciate and contextualize the computational methods employed to compute chemically accurate estimates of entropy. These methods are discussed in appropriate detail and range from the ubiquitous harmonic oscillator approximation where entropy unrelated to high frequency oscillations is typically underestimated, to enhanced free energy sampling with molecular dynamics where the desired accuracy must be weighed against the associated computational cost of obtaining it. The rising importance of machine learning and artificial intelligence in accelerating methodological progress in this field is touched upon, as well. Finally, applications, successes, and pitfalls of using these methods are provided to showcase past and present accomplishments while clarifying where improvements in both understanding and methodology are still needed.

Kollias, Loukas↗

A two-dimensional electron gas suspended above a neutralizing background

Highlights: • Two-dimensional electron gas above a neutralizing jellium background. • Analytic results for the value of the total energy. • Energy contribution originating from separation. • Added energy behaves as an effective kinetic energy term. We consider a two-dimensional electron gas system consisting of a layer of electrons suspended above its jellium neutralizing background counterpart. We investigate the energy of the system in the Hartree–Fock approximation as a function of separation distance between the layer of electrons and the background. We find that the energy of the system is influenced by the separation distance in such a way that the new energy contribution originating from such a separation behaves as an effective kinetic energy term. The increase of the overall energy with increase of the separation distance adversely affects the stability of electron liquid states at high density. The results are derived for a fully spin-polarized (spinless) system of electrons in the thermodynamic limit, but can easily be generalized to a spin unpolarized state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Uniform-in-phase-space data selection with iterative normalizing flows

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that are routinely generated. In applications that are constrained by memory and computational intensity, excessively large datasets may hinder scientific discovery, making data reduction a critical component of data-driven methods. Datasets are growing in two directions: the number of data points and their dimensionality. Whereas dimension reduction typically aims at describing each data sample on lower-dimensional space, the focus here is on reducing the number of data points. A strategy is proposed to select data points such that they uniformly span the phase-space of the data. The algorithm proposed relies on estimating the probability map of the data and using it to construct an acceptance probability. An iterative method is used to accurately estimate the probability of the rare data points when only a small subset of the dataset is used to construct the probability map. Instead of binning the phase-space to estimate the probability map, its functional form is approximated with a normalizing flow. Therefore, the method naturally extends to high-dimensional datasets. The proposed framework is demonstrated as a viable pathway to enable data-efficient machine learning when abundant data are available.

97 MATHEMATICS AND COMPUTING↗

Predicting Bond Dissociation Energies and Bond Lengths of Coordinatively Unsaturated Vanadium–Ligand Bonds

Understanding the electronic structure of coordinatively unsaturated transition-metal compounds and predicting their physical properties are of great importance for catalyst design. Bond dissociation energy D e and bond length r e are two of the fundamental quantities for which good predictions are important for a successful design strategy. In the present work, recent experimentally measured bond energies and bond lengths of VX diatomic molecules (X = C, N, S) are used as a gauge to consider the utility of a number of electronic structure methods. Single-reference methods are one focus because of their efficiency and utility in practical calculations, and multireference configuration interaction (MRCISD) methods and a composite coupled cluster (CCC) method are a second focus because of their potential high accuracy. The comparison is especially challenging because of the large multireference M diagnostics of these molecules, in the range 0.15–0.19. For the single-reference methods, Kohn–Sham density functional theory (KS-DFT) has been tested with a variety of approximate exchange-correlation functionals. Of these, MOHLYP provides the bond dissociation energies in best agreement with experiments, and BLYP provides the bond lengths that are in best agreement with experiments; but by requiring good performance for both the D e and r e of the vanadium compounds, MOHLYP, MN12-L, MGGA_MS1, MGGA_MS0, O3LYP, and M06-L are the most highly recommended functionals. The CCC calculations include up to connected pentuple excitations for the valence electrons and up to connected quadruple excitations for the core–valence terms; this results in highly accurate dissociation energies and good bond lengths. In conclusion, averaged over the three molecules, the mean unsigned deviation of CCC bond energies from experimental ones is only 0.4 kcal/mol, demonstrating excellent convergence of theory and experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Extremely Slow Trap-Mediated Hole Relaxation in Room-Temperature InP/ZnSe/ZnS Quantum Dots

Time-resolved photoluminescence (PL) and transient absorption (TA) spectroscopy have been used to elucidate the hole relaxation dynamics in high-quality InP/ZnSe/ZnS quantum dots (QDs) at room temperature. In QDs having an In/P ratio close to 1:1, hole cooling is fast compared to the ~40 ps time-correlated photon-counting instrument response. However, in QDs that luminesce at wavelengths greater than around 600 nm and have excess indium, a significant fraction of the PL exhibits a slower rise time. In this case, the PL rises over a range of timescales varying from close to the instrument response to approximately 300–400 ps. The time constant of the slowest component increases with increasing InP core size and the fraction of the PL that has the slow rise time increases with excess indium in the particle. In all cases, a slow rise time and any spectral evolution on that timescale are absent in the TA results, indicating that the slow dynamics may be assigned to relaxation in the valence band. QDs emitting at wavelengths below 560 nm show very different dynamics, exhibiting a barely detectable <50 ps rise time. Based on these results and measured elemental compositions, the slow hole relaxation is assigned to the transient population of indium-based traps in the ZnSe shell that are above the valence band edge only for the larger, red-emitting QDs. Here, the relative trap to band edge relaxation rates can be understood in terms of effective mass approximation hole wave function calculations, which show that the relaxation rate is largely determined by the extent to which the hole wave function in the lowest exciton penetrates into the ZnSe shell, overlapping the trapped-hole wave functions.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Stable Surfaces That Bind Too Tightly: Can Range-Separated Hybrids or DFT+U Improve Paradoxical Descriptions of Surface Chemistry?

Approximate, semilocal density functional theory (DFT) suffers from delocalization error that can lead to a paradoxical model of catalytic surfaces that both overbind adsorbates yet are also too stable. We investigate the effect of two widely applied approaches for delocalization error correction, (i) affordable DFT+U (i.e., semilocal DFT augmented with a Hubbard U) and (ii) hybrid functionals with an admixture of Hartree–Fock (HF) exchange, on surface and adsorbate energies across a range of rutile transition metal oxides widely studied for their promise as water-splitting catalysts. We observe strongly row- and period-dependent trends with DFT+U, which increases surface formation energies only in early transition metals (e.g., Ti and V) and decreases adsorbate energies only in later transition metals (e.g., Ir and Pt). Both global and local hybrids destabilize surfaces and reduce adsorbate binding across the periodic table, in agreement with higher-level reference calculations. Density analysis reveals why hybrid functionals correct both quantities, whereas DFT+U does not. We recommend local, range-separated hybrids for the accurate modeling of catalysis in transition metal oxides at only a modest increase in computational cost over semilocal DFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Descriptors for Electrolyte-Renormalized Oxidative Stability of Solvents in Lithium-Ion Batteries

Electrolyte stability against oxidation is an important factor limiting the development of high energy density batteries. The highest occupied molecular orbital (HOMO) level of solvent molecules has been traditionally used for understanding trends in their oxidative stability, but this assumes a noninteracting environment. However, solvent HOMO levels are renormalized because of molecules in their solvation shells. In this work, we first demonstrate an inexpensive and accurate method to determine the HOMO level of the solvent followed by simple descriptors for renormalization of the HOMO level due to different electrolyte components. The descriptors are based on Gutmann donor and acceptor numbers of the solvent and other components. The method uses fast generalized gradient approximation-level density functional theory calculations compared to previously used expensive, experimental data-dependent methods. This method can be used to screen for unexplored stable solvents among the large number of known organic compounds to design novel high-voltage stable electrolytes.

25 ENERGY STORAGE↗

Dynamic Metal–Support Interaction Dictates Cu Nanoparticle Sintering on Al 2 O 3 Surfaces

Nanoparticle sintering remains a critical challenge in heterogeneous catalysis. In this work, we present a unified deep potential (DP) model based on the Perdew–Burke–Ernzerhof approximation of density functional theory for Cu nanoparticles on three Al 2 O 3 surfaces (γ-Al 2 O 3 (100), γ-Al 2 O 3 (110), and α-Al 2 O 3 (0001)). Using DP-accelerated simulations, we reveal that the nanoparticle size-mobility relationship strongly depends on the supporting surface. The diffusion of nanoparticles on the two γ-Al 2 O 3 surfaces is almost independent of the size of the nanoparticle, while the diffusion on α-Al 2 O 3 (0001) decreases rapidly with increasing size. Interestingly, nanoparticles with fewer than 55 atoms diffuse several times faster on α-Al 2 O 3 (0001) than on γ-Al 2 O 3 (100) at 800 K while expected to be more sluggish based on their larger binding energy at 0 K. The diffusion on α-Al 2 O 3 (0001) is facilitated by dynamic metal–support interaction (MSI), where Al atoms move out of the surface plane to optimize contact with the nanoparticle and relax back to the plane as the nanoparticle moves away. In contrast, the MSI on γ-Al 2 O 3 (100) and on γ-Al 2 O 3 (110) is dominated by more stable and directional Cu–O bonds, consistent with the limited diffusion observed on these surfaces. Our extended MD simulations provide insight into the sintering processes, showing that the dispersity of the nanoparticles strongly influences the coalescence driven by nanoparticle diffusion. We observed that the coalescence of Cu 13 nanoparticles on α-Al 2 O 3 (0001) can occur in a short time (10 ns) at 800 K even with an initial internanoparticle distance increased to 3 nm, while the coalescence on the two γ-Al 2 O 3 surfaces are inhibited significantly by increasing the initial internanoparticle distance. These findings demonstrate that the dynamics of the supporting surface is crucial to understanding the sintering mechanism and offer guidance for designing sinter-resistant catalysts by engineering the support morphology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning continuous models for continuous physics

Abstract Dynamical systems that evolve continuously over time are ubiquitous throughout science and engineering. Machine learning (ML) provides data-driven approaches to model and predict the dynamics of such systems. A core issue with this approach is that ML models are typically trained on discrete data, using ML methodologies that are not aware of underlying continuity properties. This results in models that often do not capture any underlying continuous dynamics—either of the system of interest, or indeed of any related system. To address this challenge, we develop a convergence test based on numerical analysis theory. Our test verifies whether a model has learned a function that accurately approximates an underlying continuous dynamics. Models that fail this test fail to capture relevant dynamics, rendering them of limited utility for many scientific prediction tasks; while models that pass this test enable both better interpolation and better extrapolation in multiple ways. Our results illustrate how principled numerical analysis methods can be coupled with existing ML training/testing methodologies to validate models for science and engineering applications.

97 MATHEMATICS AND COMPUTING↗

Collisional transport coefficients of dense high-temperature plasmas within the quantum Landau-Fokker-Planck framework

In this paper, we extend the long-established formulas for the transport coefficients of classical plasmas inside the dense plasma regime for temperatures and densities where the classical Landau equation breaks down but its quantum extension that includes quantum degeneracy effects is valid. To this end, the quantum Landau kinetic equation is solved by the Chapman-Enskog method. The mathematical derivation is done in full generality, i.e., for multicomponent systems and to all orders of the polynomials expansion used to approximate the distribution functions. We apply the general results to two important examples, the electron gas model and an electron-ion plasma model consisting of one type of ions of any charge. We discuss the combined effects of the Pauli exclusion principle, of the electron-electron, and of the electron-ion collisions on the transport coefficients and on the convergence of the Chapman-Enskog method. For the electron gas model, the effect of the Pauli exclusion principle on the transport coefficients rapidly becomes non-negligible outside the domain of validity of the classical Landau equation. For the electron-ion plasmas, the effect of the Pauli exclusion principle depends sensitively on the ion charge Z and varies non-monotonically with Θ. For instance, for ion charge Z = 1, the electrical conductivity is increased by up to ~30% compared to its classical value over the range of degeneracy parameters studied, the thermal conductivity is reduced by up to ~9%, and the shear viscosity coefficient is increased by up to ~13%. Finally, in the Lorentz gas ( Z → ∞ ) limit, the electrical conductivity is reduced by up to ~14% compared to its classical value over the range of degeneracy parameters studied, the thermal conductivity is reduced by up to ~39%, and the shear viscosity coefficient is not affected.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Learning the temporal evolution of multivariate densities via normalizing flows

In this work, we propose a method to learn multivariate probability distributions using sample path data from stochastic differential equations. Specifically, we consider temporally evolving probability distributions (e.g., those produced by integrating local or nonlocal Fokker–Planck equations). Here, we analyze this evolution through machine learning assisted construction of a time-dependent mapping that takes a reference distribution (say, a Gaussian) to each and every instance of our evolving distribution. If the reference distribution is the initial condition of a Fokker–Planck equation, what we learn is the time-T map of the corresponding solution. Specifically, the learned map is a multivariate normalizing flow that deforms the support of the reference density to the support of each and every density snapshot in time. We demonstrate that this approach can approximate probability density function evolutions in time from observed sampled data for systems driven by both Brownian and Lévy noise. We present examples with two- and three-dimensional, uni- and multimodal distributions to validate the method.

97 MATHEMATICS AND COMPUTING↗

On learning what to learn: Heterogeneous observations of dynamics and establishing possibly causal relations among them

Abstract Before we attempt to (approximately) learn a function between two sets of observables of a physical process, we must first decide what the inputs and outputs of the desired function are going to be. Here we demonstrate two distinct, data-driven ways of first deciding “the right quantities” to relate through such a function, and then proceeding to learn it. This is accomplished by first processing simultaneous heterogeneous data streams (ensembles of time series) from observations of a physical system: records of multiple observation processes of the system. We determine (i) what subsets of observables are common between the observation processes (and therefore observable from each other, relatable through a function); and (ii) what information is unrelated to these common observables, therefore particular to each observation process, and not contributing to the desired function. Any data-driven technique can subsequently be used to learn the input–output relation—from k-nearest neighbors and Geometric Harmonics to Gaussian Processes and Neural Networks. Two particular “twists” of the approach are discussed. The first has to do with the identifiability of particular quantities of interest from the measurements. We now construct mappings from a single set of observations from one process to entire level sets of measurements of the second process, consistent with this single set. The second attempts to relate our framework to a form of causality: if one of the observation processes measures “now,” while the second observation process measures “in the future,” the function to be learned among what is common across observation processes constitutes a dynamical model for the system evolution.

Sroczynski, David W.↗