Search NASA⌕ Search

SEARCH · Search NASA

Results for “stiff problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Implementation of Parallel Adaptive-Krylov Exponential Solvers for Stiff Problems

Recently exponential integrators have been receiving increased attention as a means of solving large stiff systems of ODEs. Preliminary performance analysis demonstrated that exponential integrators hold promise compared to state-of-the-art implicit methods. However, much work remains to be done to understand in detail possible computational advantages these methods may offer in practice. This is particularly true for supercomputer-scale problems as there has been very little work on parallelizing exponential methods. In this paper we describe an implementation of a suite of parallel exponential solvers. Additionally, we present some performance tests on four stiff benchmark problems of a particular adaptive-Krylov exponential propagation iterative Runge--Kutta (EPIRK) method from the suite, and compare efficiency with the Newton--Krylov implicit solver CVODE.

97 MATHEMATICS AND COMPUTING↗

Physics constrained learning for data-driven inverse modeling from sparse observations

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that measures the discrepancy between predictions and observations in some chosen norm. This loss function often includes the PDE constraints as a penalty term when only sparse observations are available. As a result, the PDE is only satisfied approximately by the solution. However, the penalty term typically slows down the convergence of the optimizer for stiff problems. We present a new approach that trains the embedded DNNs while numerically satisfying the PDE constraints. We develop an algorithm that enables differentiating both explicit and implicit numerical solvers in reverse-mode automatic differentiation. This allows the gradients of the DNNs and the PDE solvers to be computed in a unified framework. We demonstrate that our approach enjoys faster convergence and better stability in relatively stiff problems compared to the penalty method. Furthermore, our approach allows for the potential to solve and accelerate a wide range of data-driven inverse modeling, where the physical constraints are described by PDEs and need to be satisfied accurately.

97 MATHEMATICS AND COMPUTING↗

Implicit fast sweeping method for hyperbolic systems of conservation laws

Implicit time-accurate methods are often used to integrate stiff problems where explicit schemes impose severe time step restrictions. This paper presents an efficient numerical framework based on the Fast Sweeping Method (FSM) for solving linear and nonlinear hyperbolic systems of conservation laws. The solution at each discrete location is computed by sweeping the numerical domain in several predetermined directions that follow the causality of the characteristic families. The use of a fractional step strategy eliminates the need for a solution selection criterion while one-sided stencils limit the number of sweeps to at most 2 d for d space dimensions. This work focuses on the first-order implicit upwind method since it constitutes the building block for high-order conservative schemes. For problems where the degree of stiffness evolves over time, implicit-explicit hybridization can be accomplished with the same algorithm by simply switching the stencil at each time level. As opposed to traditional implicit solvers, the sweeping method does not require a local time linearization of the fluxes thereby preserving the nonlinear stability properties of the original implicit scheme. It also avoids the large computational and memory requirements associated with solving large block-diagonal systems of equations. Here, a series of one- and two-dimensional test cases are presented for the inviscid Burgers' equation and the reactive Euler equations. The results indicate that the implicit FSM can allow a major reduction in the number of time steps even in the presence of discontinuous solution profiles.

74 ATOMIC AND MOLECULAR PHYSICS↗

Entropy–Preserving and Entropy–Stable Relaxation IMEX and Multirate Time–Stepping Methods

In this work, we propose entropy-preserving and entropy-stable partitioned Runge–Kutta (RK) methods. In particular, we extend the explicit relaxation Runge–Kutta methods to IMEX–RK methods and a class of explicit second-order multirate methods for stiff problems arising from scale-separable or grid-induced stiffness in a system. The proposed approaches not only mitigate system stiffness but also fully support entropy-preserving and entropy-stability properties at a discrete level. The key idea of the relaxation approach is to adjust the step completion with a relaxation parameter so that the time-adjusted solution satisfies the entropy condition at a discrete level. The relaxation parameter is computed by solving a scalar nonlinear equation at each timestep in general; however, as for a quadratic entropy function, we theoretically derive the explicit form of the relaxation parameter and numerically confirm that the relaxation parameter works the Burgers equation. Several numerical results for ordinary differential equations and the Burgers equation are presented to demonstrate the entropy-conserving/stable behavior of these methods. We also compare the relaxation approach and the incremental direction technique for the Burgers equation with and without a limiter in the presence of shocks.

97 MATHEMATICS AND COMPUTING↗

ORMATEX

The Oak Ridge Matrix Exponential (ORMATEX) software library contains methods to compute the matrix exponential and the action of the matrix exponential on a vector. Additionally, this package contains the related methods for the phi-functions which commonly appear in a wide class of exponential time integration methods. Krylov methods are provided to evaluate the matrix exponential-vector and phi-vector products for cases where the matrix is large and sparse. Utilizing these methods, ORMATEX implements performant exponential integrators for large systems of coupled ordinary differential equations (ODEs). The exponential time integration routines in ORMATEX are particularly suitable to large, stiff systems of equations. These routines may be utilized as a competitive alternative to classical implicit and explicit time integration schemes for certain classes of differential equations where the problem stiffness can be predominately explained by the linear terms.

Gurecky, William [Oak Ridge National Laboratory (O↗

Rejection-free stochastic simulation of BNGL-encoded models

Formal rules encoded using the BioNetGen language (BNGL) can be used to represent the system-level dynamics of molecular interactions. Rules allow one to compactly and implicitly specify the reaction network implied by a set of molecules and their interactions. Typically, the reaction network implied by a set of rules is large, which makes generation of the underlying rule-defined network expensive. Moreover, the cost of conventional simulation methods typically depends on network size. Together these factors have limited application of the rule-based modeling approach. To overcome this limitation, several methods have recently been developed for determining the reaction dynamics implied by rules while avoiding the expensive step of network generation. The cost of these 'network-free' simulation methods is independent of the number of reactions implied by rules. Software implementing such methods is needed for the analysis of rule-based models of biochemical systems. Here, we present a software tool called RuleMonkey that implements a network-free stochastic simulation method for rule-based models. The method is rejection free, unlike other network-free methods that introduce null events (i.e., steps in the simulation procedure that do not change the state of the reaction system being simulated), and the software is capable of simulating models encoded in BNGL, a general-purpose model-specification language. We verify that RuleMonkey produces correct simulation results, and we compare its performance against DYNSTOC, another BNGL-compliant general-purpose simulator for rule-based models, as well as various problem-specific codes that implement network-free simulation methods. RuleMonkey enables the simulation of models defined by rule sets that imply large-scale reaction networks. It is faster than DYNSTOC for stiff problems, although it requires the use of more computer memory. RuleMonkey is freely available for non-commercial use as a stand-alone application (http://public.tgen.org/rulemonkey).

59 BASIC BIOLOGICAL SCIENCES↗

A stiff order condition theory for Runge–Kutta methods applied to semilinear ODEs

Classical convergence theory of Runge–Kutta methods assumes that the time step is small relative to the Lipschitz constant of the ordinary differential equation (ODE). For stiff problems, that assumption is often violated, and a problematic degradation in accuracy, known as order reduction, can arise. Methods with high stage order, e.g., Gauss–Legendre and Radau, are known to avoid order reduction, but they must be fully implicit. For the broad class of semilinear ODEs, which consist of a stiff linear term and non-stiff nonlinear term, we show that weaker conditions suffice. Here, our new semilinear order conditions are formulated in terms of orthogonality relations and can be enumerated by rooted trees. Finally, we prove global error bounds that hold uniformly with respect to stiffness of the linear term.

Mathematics and Computing↗

Fully-Implicit Orthogonal Reconstructed Discontinuous Galerkin for Fluid Dynamics with Phase Change

A new reconstructed Discontinuous Galerkin (rDG) method, based on orthogonal basis/test functions, is developed for fluid flows on unstructured meshes. Orthogonality of basis functions is essential for enabling robust and efficient fully-implicit Newton-Krylov based time integration. The method is designed for generic partial differential equations, including transient, hyperbolic, parabolic or elliptic operators, which are attributed to many multiphysics problems. We demonstrate the method’s capabilities for solving compressible fluid-solid systems (in the low Mach number limit), with phase change (melting/solidification), as motivated by applications in Additive Manufacturing (AM). We focus on the method’s accuracy (in both space and time), as well as robustness and solvability of the system of linear equations involved in the linearization steps of Newton-based methods. The performance of the developed method is investigated for highly-stiff problems with melting/solidification, emphasizing the advantages from tight coupling of mass, momentum and energy conservation equations, as well as orthogonality of basis functions, which leads to better conditioning of the underlying (approximate) Jacobian matrices, and rapid convergence of the Krylov-based linear solver.

97 MATHEMATICS AND COMPUTING↗

Construction of the Nordsieck second derivative methods with RK stability for stiff ODEs

In this paper, we study the construction and implementation of special Nordsieck second derivative general linear methods of order p and stage order q=p in which the number of input and output values is r=p rather than r=p+1. We will construct A- and L-stable methods of orders three and four in this form with Runge–Kutta stability properties. The efficiency of the constructed methods and reliability of the proposed error estimates are shown by implementing of the methods in a variable stepsize environment on some well-known stiff problems.

97 MATHEMATICS AND COMPUTING↗

Concurrent implicit spectral deferred correction scheme for low-Mach number combustion with detailed chemistry

We present a parallel multi-implicit time integration scheme for the advection-diffusion-reaction systems arising from the equations governing low-Mach number combustion with complex chemistry. Here, our strategy employs parallelisation across the method to accelerate the serial Multi-Implicit Spectral Deferred Correction (MISDC) scheme used to couple the advection, diffusion, and reaction processes. In our approach, the diffusion solves and the reaction solves are performed concurrently by different processors. Our analysis shows that the proposed parallel scheme is stable for stiff problems and that the sweeps converge to the fixed-point solution at a faster rate than with serial MISDC. We present numerical examples to demonstrate that the new algorithm is high-order accurate in time, and achieves a parallel speedup compared to serial MISDC.

97 MATHEMATICS AND COMPUTING↗

On the Existence of Steady-State Solutions to the Equations Governing Fluid Flow in Networks

The steady-state solution of fluid flow in pipeline infrastructure networks driven by junction/node potentials is a crucial ingredient in various decision-support tools for system design and operation. While the nonlinear system is known to have a unique solution (when one exists), the absence of a definite result on the existence of solutions hobbles the development of computational algorithms, for it is not possible to distinguish between algorithm failure and non-existence of a solution. In this letter, we show that for any fluid whose equation of state is a scaled monomial, a unique solution exists for such nonlinear systems if the term solution is interpreted in terms of potentials and flows rather than pressures and flows. However, for gases following the CNGA equation of state, while the question of existence remains open, we construct an alternative system that always has a unique solution and show that the solution to this system is a good approximant of the true solution. Further, the existence result for flow of natural gas in networks also applies to other fluid flow networks such as water distribution networks or networks that transport carbon dioxide in carbon capture and sequestration. Most importantly, our result enables correct diagnosis of algorithmic failure, problem stiffness, and non-convergence in computational algorithms.

42 ENGINEERING↗

Verification of Multiphysics software: Space and time convergence studies for nonlinearly coupled applications

High-fidelity modeling of nuclear reactors requires the solution of a nonlinear coupled multi-physics stiff problem with widely varying time and length scales that need to be resolved correctly. A numerical method that converges the implicit nonlinear terms to a small tolerance is often referred to as nonlinearly consistent (or tightly coupled). This nonlinear consistency is still lacking in the vast majority of coupling techniques today. We present a tightly coupled multiphysics framework that tackles this issue and present code-verification and convergence analyses in space and time for several models of nonlinear coupled physics.

97 MATHEMATICS AND COMPUTING↗

PIROCK: A swiss-knife partitioned implicit–explicit orthogonal Runge–Kutta Chebyshev integrator for stiff diffusion–advection–reaction problems with or without noise

A partitioned implicit–explicit orthogonal Runge–Kutta method (PIROCK) is proposed for the time integration of diffusion–advection–reaction problems with possibly severely stiff reaction terms and stiff stochastic terms. The diffusion terms are solved by the explicit second order orthogonal Chebyshev method (ROCK2), while the stiff reaction terms (solved implicitly) and the advection and noise terms (solved explicitly) are integrated in the algorithm as finishing procedures. It is shown that the various coupling (between diffusion, reaction, advection and noise) can be stabilized in the PIROCK method. The method, implemented in a single black-box code that is fully adaptive, provides error estimators for the various terms present in the problem, and requires from the user solely the right-hand side of the differential equation. Numerical experiments and comparisons with existing Chebyshev methods, IMEX methods and partitioned methods show the efficiency and flexibility of our new algorithm.

97 MATHEMATICS AND COMPUTING↗

Numerical solution of the electron transport equation in the upper atmosphere

A new approach for solving the electron transport equation in the upper atmosphere is derived. The problem is a very stiff boundary value problem, and to obtain an accurate numerical solution, matrix factorizations are used to decouple the fast and slow modes. A stable finite difference method is applied to each mode. This solver is applied to a simplified problem for which an exact solution exists using various versions of the boundary conditions that might arise in a natural auroral display. The numerical and exact solutions are found to agree with each other, verifying the method.

97 MATHEMATICS AND COMPUTING↗

Simulation of Optical Phenomena in the Upper Atmosphere

This SAND report investigates the electron transport equation in the upper atmosphere and how it relates to auroral light emissions. The electron transport problem is a very stiff boundary value problem, so standard numerical methods such as symmetric collocation and shooting methods will not succeed unless if the boundary conditions are altered with unrealistic assumptions. We show this to be unnecessary and demon- strate a method in which the fast and slow modes of the boundary value problem are essentially decoupled. This allows for an upwind finite difference method to be applied to each mode as is appropriate. This greatly reduces the number of points needed in the mesh, and we demonstrate how this eliminates the need to define new boundary conditions. This method can be verified by showing that under certain restrictive as- sumptions, the electron transport equation has an exact solution that can be written as an integral. The connection between electron transport and the aurora is made explicit and a kinetic model for calculating auroral light emissions is given.

54 ENVIRONMENTAL SCIENCES↗

Efficient Integration of Algebraic Constraint for Exponential Time Integration

This work is a continuation of a previous project where the high efficiency of exponential integration methods for DRMHD systems was demonstrated. Often algebraic constraints must also be enforced for DRMHD systems of interest. Straightforward application of exponential methods to DRMHD equations with constraints leads to prohibitively computationally expensive methods. In this work, we propose new exponential schemes that allow the constraints to be removed from evaluation of exponential matrix functions which drastically reduces computational complexity by eliminating the need to perform computations enforcing constraints in exponential calculations while still preserving a high order of accuracy and allowing for a large time step even when the problem is stiff. This idea is similar to the W-methods and is achieved by carefully designing a method with the desired order of accuracy, even with an incomplete Jacobian matrix used as an argument of exponential-like functions. The constraints are accounted for by including them in the evaluation of the right-hand-side forcing function of the spatially discretized system. We study performance of the new methods on test problems and outline future research directions that this work opens.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗