Search NASA⌕ Search

SEARCH · Search NASA

Results for “Partial integral differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Solving high-dimensional partial integral differential equations: The finite expression method

Partial integro-differential equations (PIDEs) have broad applications in the sciences, from electro-magnetism to options pricing. Here, in this paper, we introduce a new finite expression method (FEX) to solve PIDEs. This approach builds upon the original FEX and its inherent advantages with new advances: 1) A novel method of parameter grouping is proposed to reduce the number of coefficients in high-dimensional function approximation; 2) A Taylor series approximation method is implemented to significantly improve the computational efficiency and accuracy of the evaluation of the integral terms of PIDEs. The new FEX based method, denoted FEX-PG to indicate the addition of the parameter grouping (PG) step to the algorithm, provides both high accuracy and interpretable numerical solutions, with the outcome being an explicit equation that facilitates intuitive understanding of the underlying solution structures. These features are often absent in traditional methods, such as finite element methods (FEM) and finite difference methods, as well as in deep learning-based approaches. To benchmark our method against recent advances, we apply the new FEX-PG to solve benchmark PIDEs in the literature. In high-dimensional settings, FEX-PG exhibits strong and robust performance, achieving relative errors on the order of single precision machine epsilon, significantly outperforming existing approaches based on neural networks.

Combinatorial optimization↗
DOE OSTI2015

Stochastic Differential Games for Fully Coupled FBSDEs with Jumps

This paper is concerned with stochastic differential games (SDGs) defined through fully coupled forward-backward stochastic differential equations (FBSDEs) which are governed by Brownian motion and Poisson random measure. The upper and the lower value functions are defined by the doubly controlled fully coupled FBSDEs with jumps. Using a new transformation introduced in Buchdahn (Stocha Process Appl 121:2715–2750, 2011), we prove that the upper and the lower value functions are deterministic. Then, after establishing the dynamic programming principle for the upper and the lower value functions of this SDGs, we prove that the upper and the lower value functions are the viscosity solutions to the associated upper and the lower second order integral-partial differential equations of Isaacs’ type combined with an algebraic equation, respectively. Furthermore, for a special case (when σ and h do not depend on (y,z,k)), under the Isaacs’ condition, we get the existence of the value of the game.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2019

Integrable coupled Liénard-type systems with balanced loss and gain

A Hamiltonian formulation of generic many-particle systems with space-dependent balanced loss and gain coefficients is presented. It is shown that the balancing of loss and gain necessarily occurs in a pair-wise fashion. Further, using a suitable choice of co-ordinates, the Hamiltonian can always be reformulated as a many-particle system in the background of a pseudo-Euclidean metric and subjected to an analogous inhomogeneous magnetic field with a functional form that is identical with space-dependent loss/gain co-efficient. The resulting equations of motion from the Hamiltonian are a system of coupled Liénard-type differential equations. Partially integrable systems are obtained for two distinct cases, namely, systems with (i) translational symmetry or (ii) rotational invariance in a pseudo-Euclidean space. A total number of m+1 integrals of motion are constructed for a system of 2m particles, which are in involution, implying that two-particle systems are completely integrable. A few exact solutions for both the cases are presented for specific choices of the potential and space-dependent gain/loss co-efficients, which include periodic stable solutions. Quantization of the system is discussed with the construction of the integrals of motion for specific choices of the potential and gain–loss coefficients. A few quasi-exactly solvable models admitting bound states in appropriate Stoke wedges are presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Verification of Bison fission product species conservation under TRISO reactor conditions

When assessing the reliability and predictive capabilities of a simulation tool, code verification is used to ensure that the implemented numerical algorithm is a faithful representation of its underlying mathematical model, including partial differential or integral equations, initial and boundary conditions, and auxiliary relationships. During this process, numerical results in a discrete solution are compared to the analytical solution of the mathematical model. Here, in this paper, the code verification process is applied to one-dimensional spatiotemporal problems that exercise partial differential equation governing the conservation of fission product species (or mass diffusion). Numerical experiments were performed in the Bison fuel performance code to evaluate its predictive capability under various TRISO reactor conditions such as base irradiation and safety heating test conditions for either short- or long-lived fission product species, as well as a case concerning evaporation from the outer surface of a particle. The code predictions were compared with the expected exact results obtained from the analytical expressions, and the fact that they demonstrate the correct analytical behavior provides strong evidence of proper numerical algorithm implementation.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2024

A High-Order Eulerian–Lagrangian Runge–Kutta Finite Volume (EL–RK–FV) Method for Scalar Nonlinear Conservation Laws

Abstract We present a class of high-order Eulerian–Lagrangian Runge–Kutta finite volume methods that can numerically solve Burgers’ equation with shock formations, which could be extended to general scalar conservation laws. Eulerian–Lagrangian (EL) and semi-Lagrangian (SL) methods have recently seen increased development and have become a staple for allowing large time-stepping sizes. Yet, maintaining relatively large time-stepping sizes post shock formation remains quite challenging. Our proposed scheme integrates the partial differential equation on a space-time region partitioned by linear approximations to the characteristics determined by the Rankine–Hugoniot jump condition. We trace the characteristics forward in time and present a merging procedure for the mesh cells to handle intersecting characteristics due to shocks. Following this partitioning, we write the equation in a time-differential form and evolve with Runge–Kutta methods in a method-of-lines fashion. High-resolution methods such as ENO and WENO-AO schemes are used for spatial reconstruction. Extension to higher dimensions is done via dimensional splitting. Numerical experiments demonstrate our scheme’s high-order accuracy and ability to sharply capture post-shock solutions with large time-stepping sizes.

Chen, Jiajie↗
DOE OSTI2025

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Verification of MOOSE/Bison's Heat Conduction Solver Using Combined Spatiotemporal Convergence Analysis

Bison is a computational physics code that uses the finite element method to model the thermo-mechanical response of nuclear fuel. Since Bison is used to inform high-consequence decisions, it is important that its computational results are reliable and predictive. One important step in assessing the reliability and predictive capabilities of a simulation tool is the verification process, which quantifies numerical errors in a discrete solution relative to the exact solution of the mathematical model. One step in the verification process—called code verification—ensures that the implemented numerical algorithm is a faithful representation of the underlying mathematical model, including partial differential or integral equations, initial and boundary conditions, and auxiliary relationships. In this paper, the code verification process is applied to spatiotemporal heat conduction problems in Bison. Simultaneous refinement of the discretization in space and time is employed to reveal any potential mistakes in the numerical algorithms for the interactions between the spatial and temporal components of the solution. For each verification problem, the correct spatial and temporal order of accuracy is demonstrated for both first- and second-order accurate finite elements and a variety of time-integration schemes. Furthermore, these results provide strong evidence that the Bison numerical algorithm for solving spatiotemporal problems reliably represents the underlying mathematical model in MOOSE. The selected test problems can also be used in other simulation tools that numerically solve for conduction or diffusion.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Parallel-in-Time Integration for Nonlinear Hyperbolic Problems (Final Report)

The work for the subcontract was situated in the area of parallel-in-time integration for hyperbolic partial differential equations (PDEs). Parallel-in-time integration is an active area of research due to its ability to enable faster numerical simulations for applications throughout many areas of science. Over the past two decades, much progress has been made in this area; however, this progress has largely been limited to diffusion-dominated PDEs, with some recent success in scalar linear hyperbolic PDEs. Given the ubiquity of numerical simulations of hyperbolic PDEs throughout the sciences, in particular, nonlinear hyperbolic systems, there is a strong need to develop efficient parallel-in-time techniques for hyperbolic problems beyond simple scalar and linear cases, which is the main topic of this subcontract. The main focus of the work was to further develop and perfect coarse-grid operators for the Multigrid Reduction-inTime (MGRIT) method applied to hyperbolic PDEs that were recently proposed in PhD thesis, based on a modified semi-Lagrangian approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Parallel-in-Time Methods for Method-of-Lines Discretizations of Nonlinear Hyperbolic PDEs and Systems (Final Report)

The work for the subcontract is situated in the area of parallel-in-time integration for hyperbolic partial differential equations (PDEs). Parallel-in-time integration is an active area of research due to its ability to enable faster numerical simulations for applications throughout many areas of science. The work in this subcontract builds on a variety of results that were obtained, as part of the work performed for Subcontract No. B648355, for the Multigrid Reduction-in-Time (MGRIT) method from [1] applied to hyperbolic PDEs. This subcontract extends these results further to more efficient methods and to the case of method-of-lines discretizations for nonlinear hyperbolic PDES and systems of PDEs. The following is a summary of the research performed and results achieved during milestone periods 1, 2 and 3 by the PI (Hans De Sterck) and Postdoctoral Research Associate (Oliver Krzysik), for required tasks 1-4 (as listed in the Statement of Work): Research over the previous year has been split into three main projects: (i) solution of acoustic equation system; (ii) solution of nonlinear scalar hyperbolic PDEs; (iii) solution of nonlinear hyperbolic systems of PDEs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Tempus v. 1.0

Tempus is a software framework for the time integration of ordinary differential equations (ODEs), partial differential equations (PDEs), and differential-algebraic equations (DAEs). Examples of time-integration methods available are Forward Euler, Backward Euler, Explicit Runge-Kutta and Implicit Runge-Kutta methods. Tempus can be used from small systems of equations (e.g., single ODEs for the time evolution of plasticity models) to large-scale transient simulations requiring exascale computing (e.g., flow fields around reentry vehicles and magneto-hydrodynamics). Tempus will be released as part of Trilinos under a BSD open source license.

Obert, CurtisC.↗
DOE OSTI2018

A non-intrusive parallel-in-time approach for simultaneous optimization with unsteady PDEs

This paper presents a non-intrusive framework for integrating existing unsteady partial differential equation (PDE) solvers into a parallel-in-time simultaneous optimization algorithm. The time-parallelization is provided by the non-intrusive software library XBraid [Parallel multigrid in time, software available at http://llnl.gov/casc/xbraid], which applies an iterative multigrid reduction technique to the time domain of existing time-marching schemes for solving unsteady PDEs. Its general user-interface has been extended in [S. Günther, N.R. Gauger, and J.B. Schroder, A non-intrusive parallel-in-time adjoint solver with the XBraid library, Comput. Vis. Sci. 19 (2018), pp. 85–95. Available at arXiv, math.OC/1705.00663] for computing adjoint sensitivities such that gradients of output quantities with respect to design changes can be computed parallel-in-time alongside with the primal PDE solution. In this paper, the primal and adjoint XBraid iterations are embedded into a simultaneous optimization framework, namely the One-shot method. In this method, design updates towards optimality are employed after each state and adjoint update such that optimality and feasibility of the design and the PDE solution are reached simultaneously. Finally, the time-parallel optimization method is validated on an advection-dominated flow control problem which shows significant speedup over a classical time-serial optimization algorithm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Axisymmetric hybrid Vlasov equilibria with applications to tokamak plasmas

We derive axisymmetric equilibrium equations in the context of the hybrid Vlasov model with kinetic ions and massless fluid electrons, assuming isothermal electrons and deformed Maxwellian distribution functions for the kinetic ions. The equilibrium system comprises a Grad–Shafranov partial differential equation and an integral equation. These equations can be utilized to calculate the equilibrium magnetic field and ion distribution function, respectively, for given particle density or given ion and electron toroidal current density profiles. The resulting solutions describe states characterized by toroidal plasma rotation and toroidal electric current density. Additionally, due to the presence of fluid electrons, these equilibria also exhibit a poloidal current density component. This is in contrast to the fully kinetic Vlasov model, where axisymmetric Jeans equilibria can only accommodate toroidal currents and flows, given the absence of a third integral of the microscopic motion.

Physics↗
DOE OSTI2018

The combined approach to obtain approximate analytical solution of instability phenomenon arising in secondary oil recovery process

Instability phenomenon mainly occurs in secondary oil recovery process due to viscosity difference of water and oil. Mathematical modeling of this phenomenon yields the non-linear partial differential equation. The homotopy perturbation new integral transform method has been proposed to solve this non-linear partial differential equation subject to appropriate initial and boundary conditions. It is concluded that the saturation of injected water S{sub w}(X,T) is increasing during instability phenomenon, when length of fingers(perturbance) and time increases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Multiscale modeling of HBV infection integrating intra- and intercellular viral propagation to analyze extracellular viral markers

Chronic infection with hepatitis B virus (HBV) is caused by the persistence of closed circular DNA (cccDNA) in the nucleus of infected hepatocytes. Despite available therapeutic anti-HBV agents, eliminating the cccDNA remains challenging. Thus, quantifying and understanding the dynamics of cccDNA are essential for developing effective treatment strategies and new drugs. However, such study requires repeated liver biopsy to measure the intrahepatic cccDNA, which is basically not accepted because liver biopsy is potentially morbid and not common during hepatitis B treatment. We here aimed to develop a noninvasive method for quantifying cccDNA in the liver using surrogate markers in peripheral blood. We constructed a multiscale mathematical model that explicitly incorporates both intracellular and intercellular HBV infection processes. The model, based on age-structured partial differential equations, integrates experimental data from in vitro and in vivo investigations. By applying this model, we roughly predicted the amount and dynamics of intrahepatic cccDNA within a certain range using specific viral markers in serum samples, including HBV DNA, HBsAg, HBeAg, and HBcrAg. Our study represents a significant step towards advancing the understanding of chronic HBV infection. The noninvasive quantification of cccDNA using our proposed method holds promise for improving clinical analyses and treatment strategies. By comprehensively describing the interactions of all components involved in HBV infection, our multiscale mathematical model provides a valuable framework for further research and the development of targeted interventions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Biocellion Version 2.0

This work extends Biocellion 1.0 to solve advection-reaction-diffusion and incompressible Navier-Stokes partial differential equations to model water/blood flow. Biocellion is a software framework to simulate a large number of cells using high-performance parallel computers. The version 1.0 allows software users to describe biological system behaviors as a set of rules describing how individual cells behave and how cells locally interact with neighboring cells or the surrounding micro-environment. However, the version 1.0 does not support users to incorporate water/blood flow into the model, which is important to properly capture long distance communications between distant cells. This extension (version 2.0) integrates two partial differential equation solvers to the Biocellion framework to solve this limitation. Navier-Stokes equation solvers (for incompressible flow) are added to compute flow rate, and advection-reaction-diffusion equation solvers are added to update molecular concentrations considering both advection (due to flow) and local diffusion.

Kang, Seunghwa↗