Search NASA⌕ Search

SEARCH · Search NASA

Results for “Numerical Methods for Ordinary Differential Equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Numerical simulation of low gravity draining

A boundary value problem was solved numerically for a liquid that is assumed to be inviscid and incompressible, having a motion that is irrotational and axisymmetric, and having a constant (5 degrees) solid-liquid contact angle. The avoidance of excessive mesh distortion, encountered with strictly Lagrangian or Eulerian kinematics, was achieved by introducing an auxiliary kinematic velocity field along the free surface in order to vary the trajectories used in integrating the ordinary differential equations simulating the moving boundary. The computation of the velocity potential was based upon a nonuniform triangular mesh which was automatically revised to varying depths to accommodate the motion of the free surface. These methods permitted calculation of draining induced axisymmetric slosh through the many (or fractional) finite amplitude oscillations that can occur depending upon the balance of draining, gravitational, and surface tension forces. Velocity fields, evolution of the free surface with time, and liquid residual volumes were computed for three and one half decades of Weber number and for two Bond numbers, tank fill levels, and drain radii. Comparisons with experimental data are very satisfactory.

Bizzell, G. D.↗

Approximation methods for inverse problems involving the vibration of beams with tip bodies

Two cubic spline based approximation schemes for the estimation of structural parameters associated with the transverse vibration of flexible beams with tip appendages are outlined. The identification problem is formulated as a least squares fit to data subject to the system dynamics which are given by a hybrid system of coupled ordinary and partial differential equations. The first approximation scheme is based upon an abstract semigroup formulation of the state equation while a weak/variational form is the basis for the second. Cubic spline based subspaces together with a Rayleigh-Ritz-Galerkin approach were used to construct sequences of easily solved finite dimensional approximating identification problems. Convergence results are briefly discussed and a numerical example demonstrating the feasibility of the schemes and exhibiting their relative performance for purposes of comparison is provided.

Rosen, I. G.↗

Quandary

Quandary numerically simulates and optimizes the time-evolution of open quantum systems. The underlying dynamics are modelled by Lindblad's master equation, a linear ordinary differential equation (ODE) describing quantum systems interacting with the environment. Quandary solves this ODE numerically by applying a time-stepping integration scheme, and utilizes a gradient-based optimization approach to determine optimal control pulses that drive the quantum system to a desired target state. Two optimization objectives are considered: (a) Unitary gate optimization that finds controls to realize a unitary gate transformation, and (b) optimal reset that aims to drive the quantum system to the ground states. Gradient-based optimization schemes utilizing Petsc's Tao optimization package are applied to generate control pulses that minimize the respective measure. To evaluate the gradient of the objective function, the discrete adjoint method is used while leveraging techniques from Algorithmic Differentiation to produce exact and consistent gradients. To mitigate excessive execution run times, the software can be build together with the XBraid software library which provides a parallelization strategy to distribute the time-evolution of the underlying dynamics onto multiple processor.

Petersson, NilsA.↗

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗

Three-Dimensional Postbuckling Analysis of Curved Beams

Presented here is a method of solving highly flexible curved beam undergoing huge static or quasi-static deformations. A geometrically exact beam theory based on the use of Jaumann stresses and strains and exact coordinate transformation is presented in terms of 17 first-order ordinary differential equations, and a multiple shooting method is used to solve the corresponding nonlinear two-point boundary value problems. The geometrically exact beam theory accounts far large rotations, large displacements, initial curvatures, extensionality, and transverse shear strains. Four examples are used to demonstrate this method, including a rotating clamped-free beam under the influence of gravity and centrifugal forces, an L-frame subjected to an in-plane tip load, a circular arch subjected to a concentrated load, and a clamped-hinged helical spring subjected to an axial displacement. Results show that the combination of the multiple shooting method and the geometrically exact beam theory works very well. Moreover, the obtained numerically exact solutions can be used to verify the accuracy of nonlinear finite element codes for nonlinear analysis of complex structures.

Pai, P. Frank↗

Global Asymptotic Behavior of Iterative Implicit Schemes

The global asymptotic nonlinear behavior of some standard iterative procedures in solving nonlinear systems of algebraic equations arising from four implicit linear multistep methods (LMMs) in discretizing three models of 2 x 2 systems of first-order autonomous nonlinear ordinary differential equations (ODEs) is analyzed using the theory of dynamical systems. The iterative procedures include simple iteration and full and modified Newton iterations. The results are compared with standard Runge-Kutta explicit methods, a noniterative implicit procedure, and the Newton method of solving the steady part of the ODEs. Studies showed that aside from exhibiting spurious asymptotes, all of the four implicit LMMs can change the type and stability of the steady states of the differential equations (DEs). They also exhibit a drastic distortion but less shrinkage of the basin of attraction of the true solution than standard nonLMM explicit methods. The simple iteration procedure exhibits behavior which is similar to standard nonLMM explicit methods except that spurious steady-state numerical solutions cannot occur. The numerical basins of attraction of the noniterative implicit procedure mimic more closely the basins of attraction of the DEs and are more efficient than the three iterative implicit procedures for the four implicit LMMs. Contrary to popular belief, the initial data using the Newton method of solving the steady part of the DEs may not have to be close to the exact steady state for convergence. These results can be used as an explanation for possible causes and cures of slow convergence and nonconvergence of steady-state numerical solutions when using an implicit LMM time-dependent approach in computational fluid dynamics.

Yee, H. C.↗

A numerical procedure for analysis of finite rate reacting flows

Combustion processes in rocket propulsion systems are characterized by the existence of multiple, vastly differing time and length scales, as well as flow-speeds at wide variation of Mach numbers. The chemical kinetics processes in the highly active reaction zone are characterized by much smaller scales compared to fluid convective and diffusive time scales. An operator splitting procedure for transient finite rate chemistry problems has been developed using a pressure based method, which can be applied to all speed flows without difficulties. The splitting of chemical kinetics terms formed the fluid-mechanical terms of the species equation ameliorated the difficulties associated with the disparate time scales and stiffness in the set of equations which describes highly exothermic combustion. A combined efficient ordinary differential equations (ODE) solver was used to integrate the effective chemical source terms over the residence time at each grid cell. One and two dimensional reacting flow situations were carried out to demonstrate and verify the current procedure. Different chemical kinetics with different degrees of nonlinearity have also been incorporated to test the robustness and generality of the proposed method.

Shang, H. M.↗

Low-Dimensional Dynamical Models of Thermal Convection

A low-dimensional dynamic model for transitional buoyancy-driven flow in a differentially heated tall enclosure is presented. The full governing partial differential equations with the associated boundary conditions are solved by a spectral element method for a cavity of aspect ratio A=20. Proper orthogonal decomposition is applied to the oscillatory solution at Prandtl number Pr=P tau (omega) = 0.71 and Grashof number G tau (omega) = 3.2 x 10 (exp 4) to construct empirical eigenfunctions. Using the four most energetic empirical eigenfunctions for the velocity and temperature as basis functions and applying Galerkin's method, a reduced model consisting of eight nonlinear ordinary differential equations is obtained. Close to the 'design' conditions (P tau(omega) G tau(omega)), the low-order model (LOM) predictions are in excellent agreement with the predictions of the full model. In particular, the critical Grashof number at the onset of the first temporal flow instability (Hopf bifurcation) was well as the frequency and amplitude of oscillations at supercritical conditions are in excellent agreement with the predictions of the full model. Far from the 'design' conditions, the LOM predicts the existence of multiple stable steady solutions at large values of G tau, and a unique stable steady solution at small values of G tau, and exhibits hysteretic behavior that is qualitatively similar to that observed in direct numerical simulations based on the full model.

Liakopoulos, Anthony↗

Implicit Multirate GARK Methods

This article considers multirate generalized-structure additively partitioned Runge–Kutta methods for solving stiff systems of ordinary differential equations with multiple time scales. These methods treat different partitions of the system with different timesteps for a more targeted and efficient solution compared to monolithic single rate approaches. With implicit methods used across all partitions, methods must find a balance between stability and the cost of solving nonlinear equations for the stages. In order to characterize this important trade-off, we explore multirate coupling strategies, problems for assessing linear stability, and techniques to efficiently implement Newton iterations for stage equations. Unlike much of the existing multirate stability analysis which is limited in scope to particular methods, we present general statements on stability and describe fundamental limitations for certain types of multirate schemes. New implicit multirate methods up to fourth order are derived, and their accuracy and efficiency properties are verified with numerical tests.

97 MATHEMATICS AND COMPUTING↗

Implementation of a practical Markov chain Monte Carlo sampling algorithm in PyBioNetFit

Abstract Summary Bayesian inference in biological modeling commonly relies on Markov chain Monte Carlo (MCMC) sampling of a multidimensional and non-Gaussian posterior distribution that is not analytically tractable. Here, we present the implementation of a practical MCMC method in the open-source software package PyBioNetFit (PyBNF), which is designed to support parameterization of mathematical models for biological systems. The new MCMC method, am, incorporates an adaptive move proposal distribution. For warm starts, sampling can be initiated at a specified location in parameter space and with a multivariate Gaussian proposal distribution defined initially by a specified covariance matrix. Multiple chains can be generated in parallel using a computer cluster. We demonstrate that am can be used to successfully solve real-world Bayesian inference problems, including forecasting of new Coronavirus Disease 2019 case detection with Bayesian quantification of forecast uncertainty. Availability and implementation PyBNF version 1.1.9, the first stable release with am, is available at PyPI and can be installed using the pip package-management system on platforms that have a working installation of Python 3. PyBNF relies on libRoadRunner and BioNetGen for simulations (e.g. numerical integration of ordinary differential equations defined in SBML or BNGL files) and Dask.Distributed for task scheduling on Linux computer clusters. The Python source code can be freely downloaded/cloned from GitHub and used and modified under terms of the BSD-3 license (https://github.com/lanl/pybnf). Online documentation covering installation/usage is available (https://pybnf.readthedocs.io/en/latest/). A tutorial video is available on YouTube (https://www.youtube.com/watch?v=2aRqpqFOiS4&t=63s). Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

Self-Similar Compressible Free Vortices

Lie group methods are used to find both exact and numerical similarity solutions for compressible perturbations to all incompressible, two-dimensional, axisymmetric vortex reference flow. The reference flow vorticity satisfies an eigenvalue problem for which the solutions are a set of two-dimensional, self-similar, incompressible vortices. These solutions are augmented by deriving a conserved quantity for each eigenvalue, and identifying a Lie group which leaves the reference flow equations invariant. The partial differential equations governing the compressible perturbations to these reference flows are also invariant under the action of the same group. The similarity variables found with this group are used to determine the decay rates of the velocities and thermodynamic variables in the self-similar flows, and to reduce the governing partial differential equations to a set of ordinary differential equations. The ODE's are solved analytically and numerically for a Taylor vortex reference flow, and numerically for an Oseen vortex reference flow. The solutions are used to examine the dependencies of the temperature, density, entropy, dissipation and radial velocity on the Prandtl number. Also, experimental data on compressible free vortex flow are compared to the analytical results, the evolution of vortices from initial states which are not self-similar is discussed, and the energy transfer in a slightly-compressible vortex is considered.

vonEllenrieder, Karl↗

On the implementation of modal filters for control of structures

The most common technique for the control of structures is modal control. In modal control, the differential equations in terms of actual coordinates are replaced by a set of ordinary differential equations in terms of the modal coordinates known as modal equations. In designing feedback controls in conjunction with the modal equations, one must know the modal states for the modes targeted for control. The sensors measure actual states, however. The modal states can be estimated by means of a Luenberger observer or modal filters. The modal filters produce estimates of the modal states from distributed measurements of the states. If distributed measurements are not available, then they can be reconstructed from measurements at discrete points via interpolation. This paper examines various questions associated with the implementation of modal filters, such as the effect of choice of interpolation functions and sensors locations, as well as of measurement errors, on the state estimation process. The method is demonstrated by means of two numerical examples.

Meirovitch, L.↗

WeakIdent: Weak formulation for identifying differential equation using narrow-fit and trimming

Data-driven identification of differential equations is an interesting but challenging problem, especially when the given data are corrupted by noise. When the governing differential equation is a linear combination of various differential terms, the identification problem can be formulated as solving a linear system, with the feature matrix consisting of linear and nonlinear terms multiplied by a coefficient vector. This product is equal to the time derivative term, and thus generates dynamical behaviors. The goal is to identify the correct terms that form the equation to capture the dynamics of the given data. We propose a general and robust framework to recover differential equations using a weak formulation with two new mechanisms, narrow-fit and trimming, for both ordinary and partial differential equations (ODEs and PDEs). The weak formulation facilitates an efficient and robust way to handle noise, and two new mechanisms, narrow-fit and trimming, improve the coefficient support and value recoveries respectively. For each sparsity level, Subspace Pursuit is utilized to find an initial set of support from the large dictionary. Then, we focus on highly dynamic regions (rows of the feature matrix), and error normalize the feature matrix in the narrow-fit step. The support is further updated via trimming the terms that contribute the least. Finally, the support set of features with the smallest Cross-Validation error is chosen as the result. A comprehensive set of numerical experiments are presented for both systems of ODEs and PDEs with various noise levels. The proposed method gives a robust recovery of the coefficients, and a significant denoising effect which can handle up to 100% noise-to-signal ratio for some equations. We compare the proposed method with several state-of-the-art algorithms for the recovery of differential equations.

97 MATHEMATICS AND COMPUTING↗

More accurate predictions with transonic Navier-Stokes methods through improved turbulence modeling

Significant improvements in predictive accuracies for off-design conditions are achievable through better turbulence modeling; and, without necessarily adding any significant complication to the numerics. One well established fact about turbulence is it is slow to respond to changes in the mean strain field. With the 'equilibrium' algebraic turbulence models no attempt is made to model this characteristic and as a consequence these turbulence models exaggerate the turbulent boundary layer's ability to produce turbulent Reynolds shear stresses in regions of adverse pressure gradient. As a consequence, too little momentum loss within the boundary layer is predicted in the region of the shock wave and along the aft part of the airfoil where the surface pressure undergoes further increases. Recently, a 'nonequilibrium' algebraic turbulence model was formulated which attempts to capture this important characteristic of turbulence. This 'nonequilibrium' algebraic model employs an ordinary differential equation to model the slow response of the turbulence to changes in local flow conditions. In its original form, there was some question as to whether this 'nonequilibrium' model performed as well as the 'equilibrium' models for weak interaction cases. However, this turbulence model has since been further improved wherein it now appears that this turbulence model performs at least as well as the 'equilibrium' models for weak interaction cases and for strong interaction cases represents a very significant improvement. The performance of this turbulence model relative to popular 'equilibrium' models is illustrated for three airfoil test cases of the 1987 AIAA Viscous Transonic Airfoil Workshop, Reno, Nevada. A form of this 'nonequilibrium' turbulence model is currently being applied to wing flows for which similar improvements in predictive accuracy are being realized.

Johnson, Dennis A.↗

Chemical Thermodynamics and the Mathematical Integration of Reaction Kinetics

Key advances in the development of numerical methods for non-reacting compressible flows have been enabled by translating physical requirements into concrete numerical guidelines, such as the satisfaction of entropy inequalities for shock-capturing techniques [Lax, Contributions to Nonlinear Functional Analysis (1971) 603-634]. In the present work, we present nonlinear numerical analysis tools that draw from Chemical Thermodynamics , the branch of Nonequilibrium Thermodynamics that deals with chemical reactions. Through Gibbs formalism, chemical thermodynamics provides a well-known theoretical expression for the chemical equilibrium constant of a reaction in terms of reduced chemical potentials. A less-known, yet extremely valuable result, due to [Krambeck, Arch. Ration. Mech. Anal. , 38 (1970) 317], states that when this expression is implemented, mass-action kinetic models are consistent with the dynamical prescriptions of the 2nd law of thermodynamics. For fixed-temperature ordinary differential equations modeling constant-volume reacting gas mixtures, this leads to a decreasing Helmholtz free energy. If the temperature is allowed to vary in accordance with conservation of energy (1st law), this leads to the statement of increasing entropy. These nonlinear prescriptions can, and should be, used to further develop temporal integration techniques for reaction kinetics. We demonstrate that Krambeck's result holds even when the equilibrium constants are approximated from data. We prove this result by constructing the implicit free energy and the implicit entropy inherent to a given approximation. This is first done for a 5-species, 17-reaction model problem for air. With this structure established, elements of discrete entropy-stability theory [Tadmor, Acta Numer. , 12 (2003) 451] are leveraged to examine the consistency of time-integration schemes with these prescriptions. Using chemical potentials, one can compute the respective contributions of the kinetics model and of the temporal scheme to free energy/entropy variations. We introduce a nonlinear-stable version of the Discontinuous-Galerkin (DG) scheme in time which shows robustness improvements over the standard linearly-stable version. Most notably, the maximum timestep that can be resolved with the nonlinearly-stable variant tends to grow with polynomial order, in contrast to the linearly-stable variant. We generalize our constructions to arbitrary systems of reversible chemical reactions, ultimately showing that the compressible reacting Euler system admits the opposite of the implicitly constructed thermodynamic entropy as a mathematical entropy . This lays important theoretical foundations towards robust scheme development [Harten, J. Comput. Phys. 49 (1983) 151-164].

STMD↗

The identification of a distributed parameter model for a flexible structure

A computational method is developed for the estimation of parameters in a distributed model for a flexible structure. The structure we consider (part of the RPL experiment) consists of a cantilevered beam with a thruster and linear accelerometer at the free end. The thruster is fed by a pressurized hose whose horizontal motion effects the transverse vibration of the beam. The Euler-Bernoulli theory is used to model the vibration of the beam and treat the hose thruster assembly as a lumped or point mass dashpot spring system at the tip. Measurements of linear acceleration at the tip are used to estimate the hose parameters (mass, stiffness, damping) and a Voigt-Kelvin viscoelastic structural damping parameter for the beam using a least squares fit to the data. Spline based approximations are considered to the hybrid (coupled ordinary and partial differential equations) systems; theoretical convergence results and numerical studies with both simulation and actual experimental data obtained from the structure are presented and discussed.

Banks, H. T.↗

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗

The identification of a distributed parameter model for a flexible structure

A computational method is developed for the estimation of parameters in a distributed model for a flexible structure. The structure we consider (part of the RPL experiment) consists of a cantilevered beam with a thruster and linear accelerometer at the free end. The thruster is fed by a pressurized hose whose horizontal motion effects the transverse vibration of the beam. The Euler-Bernoulli theory is used to model the vibration of the beam and treat the hose-thruster assembly as a lumped or point mass-dashpot-spring system at the tip. Using measurements of linear acceleration at the tip, it is estimated that the parameters (mass, stiffness, damping) and a Voight-Kelvin viscoelastic structural damping parameter for the beam using a least squares fit to the data. Spline based approximations to the hybrid (coupled ordinary and partial differential equations) system are considered; theoretical convergence results and numerical studies with both simulation and actual experimental data obtained from the structure are presented and discussed.

Banks, H. T.↗