Search NASASearch

SEARCH · Search NASA

Results for “approximation theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING

A new “gold standard”: Perturbative triples corrections in unitary coupled cluster theory and prospects for quantum computing

A major difficulty in quantum simulation is the adequate treatment of a large collection of entangled particles, synonymous with electron correlation in electronic structure theory, with coupled cluster (CC) theory being the leading framework for dealing with this problem. Augmenting computationally affordable low-rank approximations in CC theory with a perturbative account of higher-rank excitations is a tractable and effective way of accounting for the missing electron correlation in those approximations. This is perhaps best exemplified by the “gold standard” CCSD(T) method, which bolsters the baseline CCSD with the effects of triple excitations using considerations from many-body perturbation theory (MBPT). Despite this established success, such a synergy between MBPT and the unitary analog of CC theory (UCC) has not been explored. In this work, we propose a similar approach wherein converged UCCSD amplitudes are leveraged to evaluate energy corrections associated with triple excitations, leading to the UCCSD[T] method. In terms of quantum computing, this correction represents an entirely classical post-processing step that improves the energy estimate by accounting for triple excitation effects without necessitating new quantum algorithm developments or increasing demand for quantum resources. The rationale behind this choice is shown to be rigorous by studying the properties of finite-order UCC energy functionals, and our efforts do not support the addition of the fifth-order contributions as in the (T) correction. We assess the performance of these approaches on a collection of small molecules and demonstrate the benefits of harnessing the inherent synergy between MBPT and UCC theories.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Random Phase Approximation Correlation Energy Using Real-Space Density Functional Perturbation Theory

We present a real-space method for computing the random phase approximation (RPA) correlation energy within Kohn–Sham density functional theory, leveraging the low-rank nature of the frequency-dependent density response operator. In particular, we employ a cubic-scaling formalism based on density functional perturbation theory that circumvents the calculation of the response function matrix, instead relying on the ability to compute its product with a vector through the solution of the associated Sternheimer linear systems. We develop a large-scale parallel implementation of this formalism using the subspace iteration method in conjunction with the spectral quadrature method while employing the Kronecker product-based method for the application of the Coulomb operator and the conjugate orthogonal conjugate gradient method for the solution of the linear systems. We demonstrate convergence with respect to key parameters and verify the method’s accuracy by comparing with plane-wave results. We show that the framework achieves good strong scaling to many thousands of processors, reducing the time to solution for a lithium hydride system with 128 electrons to around 150 s on 4608 processors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep learning has exhibited remarkable results across diverse areas. To understand its success, substantial research has been directed towards its theoretical foundations. Nev- ertheless, the majority of these studies examine how well deep neural networks can model functions with uniform regularities. In this paper, we explore a different angle: how deep neural networks can adapt to varying degrees of smoothness in functions and nonuni- form data distributions across different locations and scales. More precisely, we focus on a broad class of functions defined by nonlinear tree-based approximation methods. This class encompasses a range of function types, such as functions with uniform regularities and discontinuous functions. We develop nonparametric approximation and estimation theories for this class using deep ReLU networks. Our results show that deep neural networks are adaptive to the nonuniform smoothness of functions and nonuniform data distributions at different locations and scales. We apply our results to several function classes, and derive the corresponding approximation and generalization errors. The validity of our results is demonstrated through numerical experiments.

97 MATHEMATICS AND COMPUTING

Shearing approach to gauge-invariant Trotterization

Universal quantum simulations of gauge field theories are exposed to the risk of gauge symmetry violations when it is not known how to compile the desired operations exactly using the available gate set. In this article, we show how time evolution can be compiled in an Abelian gauge theory—if only approximately—without compromising gauge invariance, by graphically motivating a block-diagonalization procedure. When gauge-invariant interactions are associated with a “spatial network” in the space of discrete quantum numbers, it is seen that cyclically shearing the spatial network converts simultaneous updates to many quantum numbers into conditional updates of a single quantum number; ultimately, this eliminates any need to pass through (and acquire overlap onto) unphysical intermediate configurations. Shearing is explicitly applied to gauge-matter and magnetic interactions of lattice quantum electrodynamics. The features that make shearing successful at preserving Abelian gauge symmetry may also be found in non-Abelian theories, bringing one closer to gauge-invariant simulations of quantum chromodynamics.

Gauge theories

Recent Developments in DFTB+, a Software Package for Efficient Atomistic Quantum Mechanical Simulations

DFTB+ is a flexible, open-source software package developed by its community, designed for fast and efficient atomistic quantum mechanical simulations. It employs various methods that approximate density functional theory (DFT), such as density functional-based tight binding (DFTB) and the extended tight binding (xTB) approach allowing simulations of large systems over extended time scales with reasonable accuracy, while being significantly faster than traditional ab initio methods. In recent years, several new extensions of the DFTB method have been developed and implemented in the DFTB+ program package in order to improve the accuracy and generality of the available simulation results. In this paper, we review those enhancements, show several use case examples and discuss the strengths and limitations of its features.

36 MATERIALS SCIENCE

Electronic Properties of Ultra‐Wide Bandgap B x Al 1− x N Computed from First‐Principles Simulations

Abstract Ultra‐wide bandgap (UWBG) materials such as AlN and BN hold great promise for future power electronics due to their exceptional properties. They exhibit large bandgaps, high breakdown fields, high thermal conductivity, and high mechanical strengths. AlN and BN have been extensively researched, however, their alloys, B x Al 1− x N, are much less studied despite their ability to offer tunable properties by adjusting x . In this article, the electronic properties of 17 recently predicted ground states of B x Al 1− x N in the x = 0 − 1 range are predicted using first‐principles density functional theory and many‐body perturbation theory within GW approximation. All the B x Al 1− x N structures are found to be UWBG materials and have bandgaps that vary linearly from that of wurtzite‐phase ( w ) AlN (6.19 eV) to that of w ‐BN (7.47 eV). The bandstructures of B x Al 1− x N show that a direct‐to‐indirect bandgap crossover occurs near x = 0.25. Furthermore, it is found that B x Al 1− x N alloys have much larger dielectric constants than the constituent bulk materials (AlN = 9.3 ɛ 0 or BN = 7.3 ɛ 0 ), with values reaching as high as 12.1 ɛ 0 . These alloys are found to exhibit large dielectric breakdown fields in the range 9–35 MV cm −1 with a linear dependence on x . This work provides the much needed advancement in the understanding of the properties of B x Al 1− x N to aid their application in next‐generation devices.

Milne, Cody L.

A Comparison of Electronic Structure Methods for Predicting the Hydrogenation Energies of Candidate Molecules for Hydrogen Storage

The development of novel energy materials and fuels is required to expand current available energy sources. Aiming to reach this goal, there is growing interest in using molecular hydrogen as an energy carrier due to its abundance and high energy density. Liquid organic hydrogen carriers (LOHCs) are a promising route to the large-scale storage and transport of hydrogen for use in the energy economy. The search for thermodynamically viable LOHC molecules for real world use has led to a set of constraints on the dehydrogenation enthalpy and the minimum gravimetric hydrogen capacity. These constraints allow one to formulate the search for an ideal LOHC candidate molecule as an optimization problem well suited to the strengths of machine learning and artificial intelligence computational approaches. A critical barrier to a large-scale, high-throughput screening of LOHC candidate molecules is the lack of reliable training data. Computational electronic structure methods including density functional theory, coupled cluster approximations, and diffusion Monte Carlo can be used to provide training data where experimental data are either unreliable or do not exist. In this work, we use these methods to calculate the dehydrogenation energies and enthalpies of candidate LOHC molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Substrate-Mediated Evaporation and Stochastic Evolution of Supported Au Nanoparticles

Here, we use in situ transmission electron microscopy with automated tracking to study supported gold nanoparticles (NPs) during high-temperature vacuum annealing. The average mass loss per NP is governed by a flat, nearly size-independent substrate-mediated evaporation profile. On top of this mean shrinkage, individual NPs show significant fluctuations in apparent growth or shrinkage, and NP volume follows a random-walk-like trajectory. To rationalize both the ensemble-mean behavior and the particle-resolved variability, we develop a self-consistent theory that couples substrate-mediated evaporation to collective 2D Ostwald-type mass exchange through a shared adatom field, described in terms of a renormalized screening length and background concentration. In the experimentally relevant regime, the theory predicts an approximately size-independent mean shrinkage rate and clarifies how net mass loss suppresses classical coarsening. Superimposed on this deterministic drift, we quantify stochastic volume trajectories and capture their fluctuation spectrum with a minimal Langevin description consistent with intermittent adatom attachment and detachment events. In addition, we characterize the lateral diffusive motion of NPs, which is responsible for their coalescence. Altogether, our results highlight that stochasticity is intrinsic at the nanoscale and that predicting the evolution of supported NPs at early and intermediate times requires a unified framework combining substrate-mediated evaporation, collective mass exchange, and stochastic fluctuations.

77 NANOSCIENCE AND NANOTECHNOLOGY

HDBind: encoding of molecular structure with hyperdimensional binary representations

Traditional methods for identifying “hit” molecules from a large collection of potential drug-like candidates rely on biophysical theory to compute approximations to the Gibbs free energy of the binding interaction between the drug and its protein target. These approaches have a significant limitation in that they require exceptional computing capabilities for even relatively small collections of molecules. Increasingly large and complex state-of-the-art deep learning approaches have gained popularity with the promise to improve the productivity of drug design, notorious for its numerous failures. However, as deep learning models increase in their size and complexity, their acceleration at the hardware level becomes more challenging. Hyperdimensional Computing (HDC) has recently gained attention in the computer hardware community due to its algorithmic simplicity relative to deep learning approaches. The HDC learning paradigm, which represents data with high-dimension binary vectors, allows the use of low-precision binary vector arithmetic to create models of the data that can be learned without the need for the gradient-based optimization required in many conventional machine learning and deep learning methods. This algorithmic simplicity allows for acceleration in hardware that has been previously demonstrated in a range of application areas (computer vision, bioinformatics, mass spectrometery, remote sensing, edge devices, etc.). To the best of our knowledge, our work is the first to consider HDC for the task of fast and efficient screening of modern drug-like compound libraries. We also propose the first HDC graph-based encoding methods for molecular data, demonstrating consistent and substantial improvement over previous work. We compare our approaches to alternative approaches on the well-studied MoleculeNet dataset and the recently proposed LIT-PCBA dataset derived from high quality PubChem assays. We demonstrate our methods on multiple target hardware platforms, including Graphics Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs), showing at least an order of magnitude improvement in energy efficiency versus even our smallest neural network baseline model with a single hidden layer. Our work thus motivates further investigation into molecular representation learning to develop ultra-efficient pre-screening tools. We make our code publicly available at https://github.com/LLNL/hdbind.

59 BASIC BIOLOGICAL SCIENCES

On finite-dimensional smoothed-particle Hamiltonian reductions of the Vlasov equation

The inclusion of spatial smoothing in finite-dimensional particle-based Hamiltonian reductions of the Vlasov equation and related models is considered. Here, this work investigates the underlying Hamiltonian structure of such smoothed particle-based methods for Hamiltonian systems and the small-scale regularization such methods implicitly make in approximating the continuum theory. In the context of the Vlasov–Poisson equation and other mean-field Lie–Poisson systems, of which Vlasov–Poisson is a special case, smoothing amounts to a convolutive regularization of the Hamiltonian. This regularization may be interpreted as a change of the inner product structure used to identify the dual space in the Lie–Poisson Hamiltonian formulation. In particular, the shape function used for spatial smoothing may be identified as the kernel function of a reproducing kernel Hilbert space whose inner product is used to define the Lie–Poisson Hamiltonian structure. It is likewise possible to introduce smoothing in the Vlasov–Maxwell system, but in this case the Poisson bracket must be modified rather than the Hamiltonian. The smoothing applied to the Vlasov–Maxwell system is incorporated by inserting smoothing in the map from canonical to kinematic coordinates. In the filtered system, the Lorentz force law and the current, the two terms coupling the Vlasov equation with Maxwell’s equations, are spatially smoothed.

Hamiltonian mechanics

Simulation and measurement of beam-induced heating of ceramic vacuum chambers

In this article, we summarize recent theoretical and experimental studies of the impedance and beam-induced heating of titanium-coated ceramic vacuum chambers used in the NSLS-II injection kickers. The impedance was calculated using the field matching theory assuming planar approximation and compared with the mpedanceake2 code. For the coating thickness of a few microns, we demonstrated that the beam-induced power is dissipated in the titanium coating and that the longitudinally averaged two-dimensional power density is approximated by an analytical expression, thus allowing the use of a simplified model of the power density as input for the code to simulate the temperature distribution with realistic nonuniform thickness of the Ti coating. For a few values of the NSLS-II beam current, we measured the beam-induced heating of two ceramic chambers using thermal sensors installed along the chamber and compared the measurement results with the simulations. Published by the American Physical Society 2024

36 MATERIALS SCIENCE

Second harmonic generation in topological insulators under quantizing magnetic fields

We theoretically investigate the second harmonic generation (SHG) of topological insulator surface states in a perpendicular magnetic field. Our theory is based on the microscopic expression of the second-order magneto-optical conductivity developed from the density matrix formalism, taking into account hexagonal warping effects on the surface states' band structure. Using numerically exact Landau-level energies and wave functions including hexagonal warping, we calculate the spectrum of SHG conductivities under normal incidence for different values of magnetic field and chemical potential. The imaginary parts of the SHG conductivities show prominent resonant peaks corresponding to one-photon and two-photon inter-Landau-level transitions. Treating the hexagonal warping term perturbatively, these transitions are clarified analytically within a perturbation theory from which approximate selection rules for the allowable optical transitions for SHG are determined. Furthermore, our results show extremely high SHG susceptibility that is easily tunable by magnetic field and doping level for topological surface states in the far-infrared regime, exceeding that of many conventional nonlinear materials. This work highlights the key role of hexagonal warping effects in generating second-order optical responses and provides insights into the nonlinear magneto-optical properties of the topological insulators.

Landau levels

Multireference diffusion Monte Carlo reaches 2D materials

Abstract Quantum confinement in 2D materials strongly enhances electronic correlation effects. Therefore, predicting the properties of these unique materials, with both a high level of accuracy and computational efficiency, without relying on adjustable parameters or functionals, remains an outstanding theoretical challenge. The majority of theoretical studies are based on the approximations of density functional theory (DFT). The reliability of DFT predictions are heavily dependent on the choice of an approximated exchange-correlation functional. Here, we estimate the magnitude of impact of correlation on the total energy for the quintessential 2D material, graphene, by performing and comparing state-of-the-art selected CI and quantum Monte Carlo extrapolated calculations for a single unit cell at the$$\Gamma$$point. We demonstrate that Self-Healing Diffusion Monte Carlo (SHDMC) obtains a very compact, but high-quality wavefunction for this system that lacks the strong basis set dependence displayed by state of the art quantum chemistry methods. The SHDMC wavefunction is of higher quality compared to that obtained from sCI, in the same orbital basis, while being$$\sim$$ 1000 times smaller in terms of determinant count compared to sCI. We also demonstrate that extrapolating SHDMC results to the infinite determinant limit compares extremely well with complete basis set extrapolated sCI. Our work paves the way for future validation of SHDMC applied to challenging 2D materials.

Science & Technology - Other Topics

A static quantum embedding scheme based on coupled cluster theory

Here, we develop a static quantum embedding scheme that utilizes different levels of approximations to coupled cluster (CC) theory for an active fragment region and its environment. To reduce the computational cost, we solve the local fragment problem using a high-level CC method and address the environment problem with a lower-level Møller–Plesset (MP) perturbative method. This embedding approach inherits many conceptual developments from the hybrid second-order Møller–Plesset (MP2) and CC works by Nooijen [J. Chem. Phys. 111, 10815 (1999)] and Bochevarov and Sherrill [J. Chem. Phys. 122, 234110 (2005)]. We go beyond those works here by primarily targeting a specific localized fragment of a molecule and also introducing an alternative mechanism to relax the environment within this framework. We will call this approach MP-CC. We demonstrate the effectiveness of MP-CC on several potential energy curves and a set of thermochemical reaction energies, using CC with singles and doubles as the fragment solver, and MP2-like treatments of the environment. The results are substantially improved by the inclusion of orbital relaxation in the environment. Using localized bonds as the active fragment, we also report results for N=N bond breaking in azomethane and for the central C–C bond torsion in butadiene. We find that when the fragment Hilbert space size remains fixed (e.g., when determined by an intrinsic atomic orbital approach), the method achieves comparable accuracy with both a small and a large basis set. Additionally, our results indicate that increasing the fragment Hilbert space size systematically enhances the accuracy of observables, approaching the precision of the full CC solver.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Evaluating the gradients of localized diabatic state energies and couplings at minimum cost

We calculate the gradients of Boys diabatic state energies and couplings when the electronic vector space is generated by configuration interaction singles. Our approach follows the Lagrangian approach of Paz and Glover (rather than direct differentiation of the adiabatic-to-diabatic approaches that have been published previously). The result is that we achieve a dramatic increase in savings over previous approaches, and the present approach should be immediately useful to scientists focused on electronic relaxation, especially chemists studying electron transfer who wish to go beyond the Condon approximation. Here, a future extension to time-dependent density functional theory in the Tamm–Dancoff approximation is clear.

Chemical physics

Sm 2 Ru 3 Sn 5 : A Noncentrosymmetric Cubic Member of the Ln 2 M 3 X 5 Family

An optimized synthetic method is presented for Sm 2 Ru 3 Sn 5 and investigate its physical properties and electronic structure. Sm 2 Ru 3 Sn 5 is prepared by arc-melting stoichiometric ratios of the elements and is confirmed by single crystal and powder X-ray diffraction. An antiferromagnetic transition is observed at T N = 3.8 K. A modified Curie-Weiss fit to the data in the range 50–150 K yields a Curie-Weiss temperature: θ CW = −36.6 K and an effective magnetic moment: μ eff = 0.83 μ B , in agreement with a Sm 3+ oxidation state. Field-dependent magnetization up to H = 7 T at 2 K shows a maximum response of 0.06 μ B , which is significantly lower than the expected Sm 3+ saturation moment (0.71 μ B ). Resistivity measurements indicate metallic behavior, and analysis of the magnetic entropy from the heat capacity reveals a doublet ground state due to crystal electric field splitting. The electronic structure and density of states are calculated with density function theory and further supported by the local density approximation with dynamical mean-field theory. Finally, the experimental and computational results highlight localized Sm 3+ moments and suggest a possible interplay between Ruddelman–Kitel–Kasuya–Yosida and Kondo interactions, positioning Sm 2 Ru 3 Sn 5 as a promising material for studying topology and complex physical phenomena.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND