Search NASA⌕ Search

SEARCH · Search NASA

Results for “Nonlinear approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Asymptotic Behavior of Memristive Circuits

The interest in memristors has risen due to their possible application both as memory units and as computational devices in combination with CMOS. This is in part due to their nonlinear dynamics, and a strong dependence on the circuit topology. We provide evidence that also purely memristive circuits can be employed for computational purposes. In the present paper we show that a polynomial Lyapunov function in the memory parameters exists for the case of DC controlled memristors. Such a Lyapunov function can be asymptotically approximated with binary variables, and mapped to quadratic combinatorial optimization problems. This also shows a direct parallel between memristive circuits and the Hopfield-Little model. In the case of Erdos-Renyi random circuits, we show numerically that the distribution of the matrix elements of the projectors can be roughly approximated with a Gaussian distribution, and that it scales with the inverse square root of the number of elements. This provides an approximated but direct connection with the physics of disordered system and, in particular, of mean field spin glasses. Using this and the fact that the interaction is controlled by a projector operator on the loop space of the circuit. We estimate the number of stationary points of the approximate Lyapunov function and provide a scaling formula as an upper bound in terms of the circuit topology only.

97 MATHEMATICS AND COMPUTING↗

A parametric study of slow dynamic nonlinear elasticity with comparisons to models

Several phenomenological models that aspire to quantitative description of anomalous nonlinear mesoscopic elasticity are reviewed and compared with laboratory measurements. This class of nonlinearity, best known perhaps for slow dynamics and aging, is seen widely in imperfectly consolidated granular solids but is not well understood. Typical slow dynamic tests show that a modest conditioning oscillatory "pump" strain depresses material stiffness, which then recovers like the logarithm of time after conditioning ceases. Several phenomenological models based on physical arguments have been proposed that predict the material stiffness response to arbitrary pump strain histories during conditioning and recovery. Approximate closed form and numerical solutions to the models are presented that predict the quantitative influence of three key pump parameters: the pump's strain amplitude, the pump's strain rate, and the pump’s duration. Laboratory measurements on Berea sandstone, concrete and a confined single aluminum bead find that slow dynamic responses are linear in pump strain and independent of pump frequency. Measurements also show that, after pump-off, stiffness recovers over times far longer than the pump duration. These observations and others are compared to model predictions. One of the considered models, based on a picture of fast brittle damage and slow healing, successfully matches all these behaviors.

36 MATERIALS SCIENCE↗

On the stability and compressive nonlinearity of a physiologically based model of the cochlea

Hearing relies on a series of coupled electrical, acoustical (fluidic) and mechanical interactions inside the cochlea that enable sound processing. A positive feedback mechanism within the cochlea, called the cochlear amplifier, provides amplitude and frequency selectivity in the mammalian auditory system. The cochlear amplifier and stability are studied using a nonlinear, micromechanical model of the Organ of Corti (OoC) coupled to the electrical potentials in the cochlear ducts. It is observed that the mechano-electrical transduction (MET) sensitivity and somatic motility of the outer hair cell (OHC), control the cochlear stability. Increasing MET sensitivity beyond a critical value, while electromechanical coupling coefficient is within a specific range, causes instability. We show that instability in this model is generated through a supercritical Hopf bifurcation. A reduced order model of the system is approximated and it is shown that the tectorial membrane (TM) transverse mode effect on the dynamics is significant while the radial mode can be simplified from the equations. The cochlear amplifier in this model exhibits good agreement with the experimental data. A comprehensive 3-dimensional model based on the cross sectional model is simulated and the results are compared. It is indicated that the global model qualitatively inherits some characteristics of the local model, but the longitudinal coupling along the cochlea shifts the stability boundary (i.e., Hopf bifurcation point) and enhances stability.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Halo Profiles and the Concentration–Mass Relation for a ΛCDM Universe

Profiles of dark matter-dominated halos at the group and cluster scales play an important role in modern cosmology. Using results from two very large cosmological N-body simulations, which increase the available volume at their mass resolution by roughly two orders of magnitude, we robustly determine the halo concentration-mass (c-M) relation over a wide range of masses, employing multiple methods of concentration measurement. We then characterize individual halo profiles, as well as stacked profiles, relevant for galaxy-galaxy lensing and next-generation cluster surveys; the redshift range covered is 0 ≤ z ≤ 4, with a minimum halo mass of M 200c ~ 2 x 10 11 M ⊙ . Despite the complexity of a proper description of a halo (environmental effects, merger history, nonsphericity, relaxation state), when the mass is scaled by the nonlinear mass scale M * (z), we find that a simple non-power-law form for the c-M/M * relation provides an excellent description of our simulation results across eight decades in M/M * and for 0 ≤ z ≤ 4. Over the mass range covered, the c-M relation has two asymptotic forms: an approximate power law below a mass threshold M/M * ~500-1000, transitioning to a constant value, c 0 ~ 3 at higher masses. The relaxed halo fraction decreases with mass, transitioning to a constant value of ~0.5 above the same mass threshold. We compare Navarro-Frenk-White (NFW) and Einasto fits to stacked profiles in narrow mass bins at different redshifts; as expected, the Einasto profile provides a better description of the simulation results. At cluster scales at low redshift, however, both NFW and Einasto profiles are in very good agreement with the simulation results, consistent with recent weak lensing observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Automatic Differentiation in MetaPhysicL and Its Applications in MOOSE

Efficient solution via Newton’s method of nonlinear systems of equations requires an accurate representation of the Jacobian, corresponding to the derivatives of the component residual equations with respect to the degrees of freedom. In practice these systems of equations often arise from spatial discretization of partial differential equations used to model physical phenomena. These equations may involve domain motion or material equations that are complex functions of the systems’ degrees of freedom. Computing the Jacobian by hand in these situations is arduous and prone to error. Finite difference approximations of the Jacobian or its action are prone to truncation error, especially in multiphysics settings. Symbolic differentiation packages may be used, but often result in an excessive number of terms in realistic model scenarios. An alternative to symbolic and numerical differentiation is automatic differentiation (AD), which propagates derivatives with every elementary operation of a computer program, corresponding to continual application of the chain rule. Automatic differentiation offers the guarantee of an exact Jacobian at a relatively small overhead cost. In this work, we outline the adoption of AD in the Multiphysics Object Oriented Simulation Environment (MOOSE) via the MetaPhysicL package. We describe the application of MOOSE’s AD capability to several sets of physics that were previously infeasible to model via hand-coded or Jacobian-free simulation techniques, including arbitrary Lagrangian-Eulerian and level-set simulations of laser melt pools, phase-field simulations with free energies provided through neural networks, and metallic nuclear fuel simulations that require inner Newton loop calculation of nonlinear material properties.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Non-Gaussian wave packet dynamics in anharmonic potential: Cumulant expansion treatment

This manuscript utilizes cumulant expansion as an alternative algebraic approach to evaluating integrals and solving a system of nonlinear differential equations for probing anharmonic dynamics in condensed phase systems using Morse oscillator. These integrals and differential equations become harder to solve as the anharmonicity of the system goes beyond that of Morse oscillator description. This algebraic approach becomes critically important in case of Morse oscillator as it tends to exhibit divergent dynamics and numerical uncertainties at low temperatures. The autocorrelation function is calculated algebraically and compared to the exact one for they match perfectly. It is also compared to the approximate autocorrelation function using the differential equations technique reported in Toutounji (2014) for weak and strong electron–phonon coupling cases. It is found that the present cumulant method is more efficient, and easier to use, than the exact expression. Deviation between the approximate autocorrelation function and the exact autocorrelation function starts to arise as the electron–phonon coupling strength increases. The autocorrelation function obtained using cumulants identically matches the exact autocorrelation function, thereby surpassing the approach presented in Toutounji (2014). The advantage of the present methodology is its applicability to various types of electron–phonon coupling cases. Additionally, the herein approach only uses algebraic techniques, thereby avoiding both the divergence integral and solving a set of linear first- and second-order partial differential equations as was done in previous work. Model calculations are presented to demonstrate the accuracy of the herein work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Long-Range Interaction between Molecules with Electronic Degeneracy: Beyond the Born–Oppenheimer Approximation

Long-range intermolecular interaction plays an essential role in (ultra)cold collisions. For monomers with degenerate electronic states, an accurate description of the long-range interaction can be challenging due to the potential breakdown of the Born–Oppenheimer approximation. In this work, we developed a general method to construct long-range interaction potential energy surfaces (IPESs) between arbitrary molecules using the degenerate perturbation theory of Schrödinger. To further simplify the application of this method, a group-theoretical method is introduced to identify nonzero components of electrostatic properties of monomers, especially for the nonlinear molecules. To demonstrate this approach, we report the long-range IPESs of the O( 3 P)–OH( 2 Π) and OH( 2 Π)–OH( 2 Π) systems. The excellent agreement with ab initio calculations in large separations, even near electronic degeneracies, confirms the accuracy of our approach. The method is expected to lay the groundwork for the accurate investigation of (ultra)cold collisional dynamics involving open-shell species.

ab initio calculations↗

Learning Koopman Operators for Systems with Isolated Critical Points

The Koopman operator provides a way to transform a (potentially) nonlinear finite-dimensional dynamical system into an infinite-dimensional linear system by lifting the nonlinear state dynamics into a functional space of observables, where the dynamics are linear. Previous literature has claimed that it is not possible to represent nonlinear dynamics with multiple isolated critical points if the set of observables is finite and contains the state; more precisely, such a set cannot be invariant under the Koopman operator. In this paper, we investigate this claim in more detail and provide an analytical counterexample to disprove it. We also consider the convergence of discretetime Koopman approximation error to the continuous-time error: we show both how this convergence occurs in general and how it can fail for systems with multiple isolated critical points. In particular, discontinuities in Koopman observables at the boundaries of basins of attraction may cause the continuous-time error to diverge; the discretetime error also suffers from this as the sampling time step goes to zero.

Bakker, Craig KR↗

Solving the Dynamics-Aware Economic Dispatch Problem with the Koopman Operator

The dynamics-aware economic dispatch (DED) problem embeds low-level generator dynamics and operational constraints to enable near real-time scheduling of generation units in a power network. DED produces a more dynamic supervisory control policy than traditional economic dispatch (T-ED) that reduces overall generation costs. However, in contrast to T-ED, DED is a nonlinear, non-convex optimization problem that is computationally prohibitive to solve. We introduce a machine learning-based operator-theoretic approach for solving the DED problem efficiently. Specifically, we develop a novel discrete-time Koopman Operator (KO) formulation that embeds domain information into the structure of the KO to learn high-fidelity approximations of the generator dynamics. Using the KO approximation, the DED problem can be reformulated as a computationally tractable linear program (abbreviated DED-KO). We demonstrate the high solution quality and computational-time savings of the DED-KO model over the original DED formulation on a 9-bus test system.

King, Ethan↗

Minimizing total tardiness and energy cost by considering layout and scheduling in a flexible job shop

Most sustainable manufacturing studies have discussed scheduling with energy consumption (EC), while the effect of layout on both scheduling and EC can be significant. This paper therefore investigates the interaction between layout and scheduling in a flexible job shop, and shows how considering them together affects EC (energy cost) and a conventional performance measure (tardiness cost). A mixed-integer nonlinear programming is proposed in this study to integrate layout with scheduling, and the objective function of the model is designed to minimize total tardiness and energy cost. The efficacy of the proposed model is evaluated by solving an illustrative case study. The results show that the objective function value can be in average improved by approximately 21% using the integrated model when compared to a non-integrated model.

Ebrahimi, Ahmad↗

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Characteristics of Vertical Ground Motions and Their Effect on the Seismic Response of Bridges in the Near-Field: A State-of-the-Art Review

Despite the evidence from past earthquakes and several numerical investigations demonstrating the detrimental impact of vertical ground motions (VGMs) on the integrity of bridge structures, incorporating their effects into seismic assessment and design procedures has traditionally been given limited consideration. Current codes utilize rather simplistic approaches to account for the concurrent effects of vertical and horizontal motions in structural performance evaluations, potentially leading to unconservative estimates of structural demands. This paper reviews the main features of VGMs and their effect on the seismic response of bridges. The methods and empirical models available to estimate vertical motions for design purposes are discussed, and research gaps and related research needs are identified. Finally, the emerging role of physics-based ground-motion simulations, as well as their limitations, in supporting future research and informing the development of simplified design procedures is examined. The main areas of interest for future research are identified in the need to carry out systematic sensitivity studies to gain insight into the main earthquake parameters that influence key VGMs features, understand the influence of soil nonlinearities on VGMs amplitude and frequency content, inform the development of empirical models that cover a range of site conditions and source-to-site distances where current models are poorly constrained, generate arrays of motions to update coherency models to properly inform the analysis of distributed infrastructure, investigate the impulsive character of VGMs, and assess the approximations made in estimating VGMs with 1D site response analyses. Furthermore, specific focus is laid on large-magnitude earthquakes in the near-field.

Asynchronous ground motion↗

Barren Plateaus Preclude Learning Scramblers

Scrambling processes, which rapidly spread entanglement through many-body quantum systems, are difficult to investigate using standard techniques, but are relevant to quantum chaos and thermalization. In this Letter, we ask if quantum machine learning (QML) could be used to investigate such processes. In this study we prove a no-go theorem for learning an unknown scrambling process with QML, showing that it is highly probable for any variational Ansatz to have a barren plateau landscape, i.e., cost gradients that vanish exponentially in the system size. This implies that the required resources scale exponentially even when strategies to avoid such scaling (e.g., from Ansatz -based barren plateaus or no-free-lunch theorems) are employed. Furthermore, we numerically and analytically extend our results to approximate scramblers. Hence, our work places generic limits on the learnability of unitaries when lacking prior information.

97 MATHEMATICS AND COMPUTING↗

On the Existence of Steady-State Solutions to the Equations Governing Fluid Flow in Networks

The steady-state solution of fluid flow in pipeline infrastructure networks driven by junction/node potentials is a crucial ingredient in various decision-support tools for system design and operation. While the nonlinear system is known to have a unique solution (when one exists), the absence of a definite result on the existence of solutions hobbles the development of computational algorithms, for it is not possible to distinguish between algorithm failure and non-existence of a solution. In this letter, we show that for any fluid whose equation of state is a scaled monomial, a unique solution exists for such nonlinear systems if the term solution is interpreted in terms of potentials and flows rather than pressures and flows. However, for gases following the CNGA equation of state, while the question of existence remains open, we construct an alternative system that always has a unique solution and show that the solution to this system is a good approximant of the true solution. Further, the existence result for flow of natural gas in networks also applies to other fluid flow networks such as water distribution networks or networks that transport carbon dioxide in carbon capture and sequestration. Most importantly, our result enables correct diagnosis of algorithmic failure, problem stiffness, and non-convergence in computational algorithms.

42 ENGINEERING↗

Convergence Analysis of the Alternating Anderson–Picard Method for Nonlinear Fixed-Point Problems

Anderson acceleration (AA) has been widely used to solve nonlinear fixed-point problems due to its rapid convergence. This work focuses on a variant of AA in which multiple Picard iterations are performed between each AA step, referred to as the Alternating Anderson–Picard (AAP) method. Furthermore, despite introducing more “slow” Picard iterations, this method has been shown to be efficient and even more robust in both linear and nonlinear cases. However, there is a lack of theoretical analysis for AAP in the nonlinear case. In this paper, we address this gap by establishing the equivalence between AAP and a multisecant-GMRES method that uses GMRES to solve a multisecant linear system at each iteration. From this perspective, we show that AAP “converges” to the Newton-GMRES method. Specifically, as the residual approaches zero, the multisecant matrix, the approximate Jacobian inverse, the search direction, and the optimization gain of AAP converge to their counterparts in the Newton-GMRES method. These connections provide insights for analyzing the asymptotic convergence properties of AAP. Consequently, we show that AAP is locally 𝑞-linear convergent and provide an upper bound for the convergence factor of AAP. To validate the theoretical results, numerical examples are provided.

Anderson acceleration↗

Numerical analysis of a time discretized method for nonlinear filtering problem with Lévy process observations

Abstract In this paper, we consider a nonlinear filtering model with observations driven by correlated Wiener processes and point processes. We first derive a Zakai equation whose solution is an unnormalized probability density function of the filter solution. Then, we apply a splitting-up technique to decompose the Zakai equation into three stochastic differential equations, based on which we construct a splitting-up approximate solution and prove its half-order convergence. Furthermore, we apply a finite difference method to construct a time semi-discrete approximate solution to the splitting-up system and prove its half-order convergence to the exact solution of the Zakai equation. Finally, we present some numerical experiments to demonstrate the theoretical analysis.

Mathematics↗

Asymptotic-preserving dynamical low-rank method for the stiff nonlinear Boltzmann equation

In kinetic theory, numerically solving the full Boltzmann equation is extremely expensive. This is because the Boltzmann collision operator involves a high-dimensional, nonlinear integral that must be evaluated at each spatial grid point and every time step. The challenge becomes even more pronounced in the fluid (strong collisionality) regime, where the collision operator exhibits strong stiffness, causing explicit time integrators to impose severe stability restrictions. In this paper, we propose addressing this problem through a dynamical low-rank (DLR) approximation. The resulting algorithm requires evaluating the Boltzmann collision operator only r 2 times, where r, the rank of the approximation, is much smaller than the number of spatial grid points. We propose a novel DLR integrator, called the XL integrator, which reduces the number of steps compared to the available alternatives (such as the projector splitting or basis update & Galerkin (BUG) integrator). For a class of problems including the Boltzmann collision operator which enjoys a separation property between physical and velocity space, we further propose a specialized version of the XL integrator, called the sXL integrator. This version requires solving only one differential equation to update the low-rank factors. Furthermore, the proposed low-rank schemes are asymptotic-preserving, meaning they can capture the asymptotic fluid limit in the case of strong collisionality. Our numerical experiments demonstrate the efficiency and accuracy of the proposed methods across a wide range of regimes, from non-stiff (kinetic) to stiff (fluid).

97 MATHEMATICS AND COMPUTING↗