Search NASA⌕ Search

SEARCH · Search NASA

Results for “Generalization Bounds”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

General bounds on holographic complexity

We prove a positive volume theorem for asymptotically AdS spacetimes: the maximal volume slice has nonnegative vacuum-subtracted volume, and the vacuum-subtracted volume vanishes if and only if the spacetime is identically pure AdS. Under the Complexity=Volume proposal, this constitutes a positive holographic complexity theorem. The result features a number of parallels with the positive energy theorem, including the assumption of an energy condition that excludes false vacuum decay (the AdS weak energy condition). Our proof is rigorously established in broad generality in four bulk dimensions, and we provide strong evidence in favor of a generalization to arbitrary dimensions. Our techniques also yield a holographic proof of Lloyd’s bound for a class of bulk spacetimes. We further establish a partial rigidity result for wormholes: wormholes with a given throat size are more complex than AdS-Schwarzschild with the same throat size.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Statistical analysis of astronomical data containing upper bounds - General methods and examples drawn from X-ray astronomy

Statistical procedures taken from the field of survival analysis have been adapted to astronomical usage and have been applied to a sample of stars in the B-V color range between 0.1 and 0.5 with measured soft X-ray luminosities and projected equatorial velocities. The two-sample problem and linear regression problem with arbitrarily censored data were studied. A new method for determining the linear regression between two random variables in the presence of arbitrary censoring has been developed which can also be used for a likelihood-ratio test for the independence of two random variables and for principal-component analysis in the presence of arbitrary censoring. The required numerical computations can be carried out straightforwardly and rapidly.

Schmitt, J. H. M. M.↗

When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?

Physics-informed neural networks (PINNs) have become a popular choice for solving high-dimensional partial differential equations (PDEs) due to their excellent approximation power and generalization ability. Recently, extended PINNs (XPINNs) based on domain decomposition methods have attracted considerable attention due to their effectiveness in modeling multiscale and multiphysics problems and their parallelization. However, theoretical understanding of their convergence and generalization properties remains unexplored. In this study, we take an initial step towards understanding how and when XPINNs outperform PINNs. Specifically, for general multilayer PINNs and XPINNs, we first provide a prior generalization bound via the complexity of the target functions in the PDE problem and a posterior generalization bound via the posterior matrix norms of the networks after optimization. Moreover, based on our bounds, we analyze the conditions under which XPINNs improve generalization. Concretely, our theory shows that the key building block of XPINN, namely, the domain decomposition, introduces a tradeoff for generalization. On the one hand, XPINNs decompose the complex PDE solution into several simple parts, which decreases the complexity needed to learn each part and boosts generalization. On the other hand, decomposition leads to less training data being available in each subdomain, and hence such a model is typically prone to overfitting and may become less generalizable. Empirically, we choose five PDEs to show when XPINNs perform better than, similar to, or worse than PINNs, hence demonstrating and justifying our new theory.

97 MATHEMATICS AND COMPUTING↗

Computable optimal value bounds for generalized convex programs

It has been shown by Fiacco that convexity or concavity of the optimal value of a parametric nonlinear programming problem can readily be exploited to calculate global parametric upper and lower bounds on the optimal value function. The approach is attractive because it involves manipulation of information normally required to characterize solution optimality. A procedure is briefly described for calculating and improving the bounds as well as its extensions to generalized convex and concave functions. Several areas of applications are also indicated.

Fiacco, Anthony V.↗

General upper bound on single-event upset rate

A technique of predicting an upper bound on the rate at which single-event upsets due to ionizing radiation occur in semiconducting memory cells is described. The upper bound on the upset rate, which depends on the high-energy particle environment in earth orbit and accelerator cross-section data, is given by the product of an upper-bound linear energy-transfer spectrum and the mean cross section of the memory cell. Plots of the spectrum are given for low-inclination and polar orbits. An alternative expression for the exact upset rate is also presented. Both methods rely only on experimentally obtained cross-section data and are valid for sensitive bit regions having arbitrary shape.

Chlouber, Dean↗

Learning linear optical circuits with coherent states

We analyze the energy and training data requirements for supervised learning of an M-mode linear optical circuit by minimizing an empirical risk defined solely from the action of the circuit on coherent states. When the linear optical circuit acts non-trivially only on k < M unknown modes (i.e. a linear optical k-junta), we provide an energy-efficient, adaptive algorithm that identifies the junta set and learns the circuit. We compare two schemes for allocating a total energy, E, to the learning algorithm. In the first scheme, each of the T random training coherent states has energy E/T. In the second scheme, a single random MT-mode coherent state with energy E is partitioned into T training coherent states. The latter scheme exhibits a polynomial advantage in training data size sufficient for convergence of the empirical risk to the full risk due to concentration of measure on the $(2MT-1)$-sphere. Specifically, generalization bounds for both schemes are proven, which indicate that for ε-approximation of the full risk by the empirical risk with high probability, $O(E^{2/3}M^{2/3}/\epsilon^{2/3})$ training states are sufficient for the first scheme and $O(E^{1/3}M^{1/3}/\epsilon^{2/3})$ training states are sufficient for the second scheme.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Causality, unitarity and symmetry in effective field theory

Sum rules in effective field theories, predicated upon causality, place restrictions on scattering amplitudes mediated by effective contact interactions. Through unitarity of the S -matrix, these imply that the size of higher dimensional corrections to transition amplitudes between different states is bounded by the strength of their contributions to elastic forward scattering processes. This places fundamental limits on the extent to which hypothetical symmetries can be broken by effective interactions. All analysis is for dimension 8 operators in the forward limit. Included is a thorough derivation of all positivity bounds for a chiral fermion in SU(2) and SU(3) global symmetry representations resembling those of the Standard Model, general bounds on flavour violation, new bounds for interactions between particles of different spin, inclusion of loops of dimension 6 operators and illustration of the resulting strengthening of positivity bounds over tree-level expectations, a catalogue of supersymmetric effective interactions up to mass dimension 8 and 4 legs and the demonstration that supersymmetry unifies the positivity theorems as well as the new bounds.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stability of an oscillated fluid with a uniform density gradient

Instabilities in a fluid with a constant density gradient that is subject to arbitrarily oriented oscillatory accelerations are considered. With the Boussinesq approximation and for the case of an unbounded fluid, transformation to Lagrangian coordinates allows the reduction of the problem to an ordinary differential equation for each three-dimensional wavenumber. The problem has three parameters: the nondimensional amplitude R of the base-state oscillation, the nondimensional level of background steady acceleration, which for some cases can be represented in terms of a local (in time) Richardson number Ri, and the Prandtl number Pr. Some general bounds on stability are derived. For Pr = 1 closed-form solutions are found for impulse (delta function) accelerations and a general asymptotic solution is constructed for large R and general imposed accelerations. The asymptotic solution takes advantage of the fact that at large R wave growth is concentrated at 'zero points'. These are times when the effective vertical wavenumber passes through zero. Kelvin-Helmholtz instabilities are found to dominate at low R, while Rayleigh-Taylor instabilities dominate at high R. At high R, the uniform shear of the Kelvin-Helmholtz case tends to distort and weaken instability waves. With unsteady flows, Ri = 1/4 is no longer an instability limit. Significant instabilities have been found for sinusoidal forcing for Ri up to 0.6.

Jacqmin, David↗

Out-of-distribution generalization for learning quantum dynamics

Abstract Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where training and testing data are drawn from the same data distribution. However, there are currently no results on out-of-distribution generalization in QML, where we require a trained model to perform well even on data drawn from a different distribution to the training distribution. Here, we prove out-of-distribution generalization for the task of learning an unknown unitary. In particular, we show that one can learn the action of a unitary on entangled states having trained only product states. Since product states can be prepared using only single-qubit gates, this advances the prospects of learning quantum dynamics on near term quantum hardware, and further opens up new methods for both the classical and quantum compilation of quantum circuits.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Out-of-distribution generalization for learning quantum dynamics

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where training and testing data are drawn from the same data distribution. However, there are currently no results on out-of-distribution generalization in QML, where we require a trained model to perform well even on data drawn from a different distribution to the training distribution. Here, we prove out-of-distribution generalization for the task of learning an unknown unitary. In particular, we show that one can learn the action of a unitary on entangled states having trained only product states. Since product states can be prepared using only single-qubit gates, this advances the prospects of learning quantum dynamics on near term quantum hardware, and further opens up new methods for both the classical and quantum compilation of quantum circuits.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spectral Bounds on Hyperbolic 3-Manifolds: Associativity and the Trace Formula

We constrain the low-energy spectra of Laplace operators on closed hyperbolic manifolds and orbifolds in three dimensions, including the standard Laplace--Beltrami operator on functions and the Laplacian on powers of the cotangent bundle. Our approach employs linear programming techniques to derive rigorous bounds by leveraging two types of spectral identities. The first type, inspired by the conformal bootstrap, arises from the consistency of the spectral decomposition of the product of Laplace eigensections, and involves the Laplacian spectra as well as integrals of triple products of eigensections. We formulate these conditions in the language of representation theory of PSL 2 (C) and use them to prove upper bounds on the first and second Laplacian eigenvalues. The second type of spectral identities follows from the Selberg trace formula. We use them to find upper bounds on the spectral gap of the Laplace--Beltrami operator on hyperbolic 3-orbifolds, as well as on the systole length of hyperbolic 3-manifolds, as a function of the volume. Further, we prove that the spectral gap λ 1 of the Laplace--Beltrami operator on all closed hyperbolic 3-manifolds satisfies λ 1 < 47.32. Along the way, we use the trace formula to estimate the low-energy spectra of a large set of example orbifolds and compare them with our general bounds, finding that the bounds are nearly sharp in several cases.

Bonifacio, James [University of Mississippi, MS (U↗

Effective Field Theory islands from perturbative and nonperturbative four-graviton amplitudes

Theoretical data obtained from physically sensible field and string theory models suggest that gravitational Effective Field Theories (EFTs) live on islands that are tiny compared to current general bounds determined from unitarity, causality, crossing symmetry, and a good high-energy behavior. In this work, we present explicit perturbative and nonperturbative 2 → 2 graviton scattering amplitudes and their associated low-energy expansion in spacetime dimensions D ≥ 4 to support this notion. Our new results include a first example of gravity weakly coupled to a nonperturbative effective action. We show that, at energies below the mass of its nonperturbative matter, the D = 4, $\mathcal{N}$ = 1 supersymmetric field theory in the confined phase lies on the same islands identified using four-dimensional perturbative models based on string theory and minimally-coupled matter circulating a loop. Furthermore, we generalize the previous four-dimensional perturbative models based on string theory and minimally-coupled massive spin-0 and spin-1 states circulating in the loop to D dimensions. Remarkably, we again find that the low-energy EFT coefficients lie on small islands. These results offer a useful guide towards constraining possible extensions of Einstein gravity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Insights into the dual cleavage activity of the GH16 laminarinase enzyme class on β-1,3 and β-1,4 glycosidic bonds

Glycoside hydrolases (GH) are involved in the degradation of a wide diversity of carbohydrates and present several biotechnological applications. Many GH families are composed of enzymes with a single well-defined specificity. In contrast, enzymes from the GH16 family can act on a range of different polysaccharides, including β-glucans and galactans. SCLam, a GH16 member derived from a soil metagenome, an endo-β-1,3(4)-glucanase (EC 3.2.1.6), can cleave both β-1,3 and β-1,4 glycosidic bonds in glucans, such as laminarin, barley β-glucan, and cello-oligosaccharides. A similar cleavage pattern was previously reported for other GH16 family members. However, the molecular mechanisms for this dual cleavage activity on (1,3)- and (1,4)-β-D-glycosidic bonds by laminarinases have not been elucidated. In this sense, we determined the X-ray structure of a presumably inactive form of SCLam co-crystallized with different oligosaccharides. The solved structures revealed general bound products that are formed due to residual activities of hydrolysis and transglycosylation. Biochemical and biophysical analyses and molecular dynamics simulations help to rationalize differences in activity towards different substrates. Our results depicted a bulky aromatic residue near the catalytic site critical to select the preferable configuration of glycosidic bonds in the binding cleft. Altogether, these data contribute to understanding the structural basis of recognition and hydrolysis of β-1,3 and β-1,4 glycosidic linkages of the laminarinase enzyme class, which is valuable for future studies on the GH16 family members and applications related to biomass conversion into feedstocks and bioproducts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning to classify quantum phases of matter with a few measurements

We study the identification of quantum phases of matter, at zero temperature, when only part of the phase diagram is known in advance. Following a supervised learning approach, we show how to use our previous knowledge to construct an observable capable of classifying the phase even in the unknown region. By using a combination of classical and quantum techniques, such as tensor networks, kernel methods, generalization bounds, quantum algorithms, and shadow estimators, we show that, in some cases, the certification of new ground states can be obtained with a polynomial number of measurements. An important application of our findings is the classification of the phases of matter obtained in quantum simulators, e.g. cold atom experiments, capable of efficiently preparing ground states of complex many-particle systems and applying simple measurements, e.g. single qubit measurements, but unable to perform a universal set of gates.

quantum machine learning↗

Dynamical simulation via quantum machine learning with provable generalization

Much attention has been paid to dynamical simulation and quantum machine learning (QML) independently as applications for quantum advantage, while the possibility of using QML to enhance dynamical simulations has not been thoroughly investigated. Here we develop a framework for using QML methods to simulate quantum dynamics on near-term quantum hardware. We use generalization bounds, which bound the error a machine learning model makes on unseen data, to rigorously analyze the training data requirements of an algorithm within this framework. Our algorithm is thus resource efficient in terms of qubit and data requirements. Furthermore, our preliminary numerics for the XY model exhibit efficient scaling with problem size, and we simulate 20 times longer than Trotterization on IBMQ-Bogota. Published by the American Physical Society 2024

97 MATHEMATICS AND COMPUTING↗

Universal Compiling and (No-)Free-Lunch Theorems for Continuous-Variable Quantum Learning

Quantum compiling, where a parameterized quantum circuit is trained to learn a target unitary, is an important primitive for quantum computing that can be used as a subroutine to obtain optimal circuits or as a tomographic tool to study the dynamics of an experimental system. While much attention has been paid to quantum compiling on discrete-variable hardware, less has been paid to compiling in the continuous-variable paradigm. Here we motivate several, closely related, short-depth continuous-variable algorithms for quantum compilation. We analyze the trainability of our proposed cost functions and numerically demonstrate our algorithms by learning arbitrary Gaussian operations and Kerr nonlinearities. We further make connections between this framework and quantum learning theory in the continuous-variable setting by deriving no-free-lunch theorems. These generalization bounds demonstrate a linear resource reduction for learning Gaussian unitaries using entangled coherent-Fock states and an exponential resource reduction for learning arbitrary unitaries using two-mode-squeezed states.

97 MATHEMATICS AND COMPUTING↗

The Stochastic Gause Predator-Prey model: Noise-induced extinctions and invariance

We consider the Gause predator-prey with general bounded or sub‑linear functional responses, – which includes those of Holling types Ⅰ–Ⅳ. – and multiplicative Gaussian noise. In contrast to previous studies, the prey in our model follows logistic dynamics while the predator's population is solely regulated by consumption of the prey. To ensure well-posedeness, we derive explicit Lyapunov‐type criteria ensuring global positivity and moment boundedness of solutions. We find conditions for noise‑induced extinctions, proving that stochasticity can drive either population to collapse even when the deterministic analogue predicts stable coexistence. In the case when the predator becomes extinct, we establish a limiting distribution for the predator's population. Last, for functional responses of Holling type Ⅰ, we provide sufficient conditions on the intensity of the noise for the existence and uniqueness of a stationary distribution.

Gause model↗

Convolutional codes. II - Maximum-likelihood decoding. III - Sequential decoding

Maximum-likelihood decoding is characterized as the determination of the shortest path through a topological structure called a trellis. Aspects of code structure are discussed along with questions regarding maximum-likelihood decoding on memoryless channels. A general bounding technique is introduced. The technique is used to obtain asymptotic bounds on the probability of error for maximum-likelihood decoding and list-of-2 decoding. The basic features of sequential algorithms are discussed along with a stack algorithm, questions of computational distribution, and the martingale approach to computational bounds.

Forney, G. D., Jr.↗