Search NASASearch

SEARCH · Search NASA

Results for “Implicit gradients”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Towards Robust and Accurate Implicit Gradient Methods for Second- and Third-Order Nodal-Gradient Cell-Centered Finite-Volume Discretizations on Tetrahedral Grids

In this paper, we introduce implicit gradient methods as alternatives to conventional least-squares gradient methods for second- and third-order nodal-gradient cell-centered finite-volume discretizations, where solutions are stored at cells but gradients are stored at nodes. Because of the unique configuration of solutions and gradients, implicit gradient systems developed for the node-centered edge-based discretization method can be directly applied once the numerical solutions are interpolated from cells to nodes with sufficient accuracy. The resulting defect-correction solver can be loosely coupled with a flow-equation solver, and at convergence, solutions and gradients that satisfy the corresponding residual equations are obtained. Each iteration is relatively cheap compared with least-squares methods involving hundreds of neighbors. Numerical results are presented for accuracy verification studies and some simple but realistic flow problems.

Computational Fluid Dynamics

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES

Updates to Implicit Edge-Based Gradient Methods

In this paper, we report updates to the implicit edge-based gradient methods originally introduced in [H. Nishikawa, AIAA Paper 2020-3048, 2020]. First, we clarify the relationship between gradient accuracy and truncation error and show that the quadratic method involves a free parameter. Then, we provide a complete description and a simplified matrix form of the implicit gradient systems including a consistent boundary treatment, and derive a set of parameters for achieving fourth-order gradient accuracy on regular tetrahedral grids. A stability analysis is performed for a relaxation scheme used to solve the implicit gradient systems, and the result serves as a guide for choosing parameters. Numerical results are shown for accuracy verification and also for realistic inviscid flow problems in three dimensions, including flows with shock waves.

Weighted Least-Squares

A comparison of two closely-related approaches to aerodynamic design optimization

Two related methods for aerodynamic design optimization are compared. The methods, called the implicit gradient approach and the variational (or optimal control) approach, both attempt to obtain gradients necessary for numerical optimization at a cost significantly less than that of the usual black-box approach that employs finite difference gradients. While the two methods are seemingly quite different, they are shown to differ (essentially) in that the order of discretizing the continuous problem, and of applying calculus, is interchanged. Under certain circumstances, the two methods turn out to be identical. We explore the relationship between these methods by applying them to a model problem for duct flow that has many features in common with transonic flow over an airfoil. We find that the gradients computed by the variational method can sometimes be sufficiently inaccurate to cause the optimization to fail.

Shubin, G. R.

A B-spline based gradient-enhanced micropolar implicit material point method for large localized inelastic deformations

The quasi-brittle response of cohesive-frictional materials in numerical simulations is commonly represented by softening plasticity or continuum damage models, either individually or in combination. However, classical models, particularly when coupled with non-associated plasticity, often suffer from ill-posedness and a lack of objectivity in numerical simulations. Moreover, the performance of the finite element method significantly degrades in simulations involving finite strains when mesh distortion reaches excessive levels. This represents a challenge for modeling cohesive-frictional materials, given their tendency to experience strongly localized deformations, such as those occurring during shear band dominated failure. Hence, accurate modeling of the response of cohesive-frictional solids is a demanding task. To address these challenges, we present an extension of the material point method (MPM) for the unified gradient-enhanced micropolar continuum, aiming at the analysis of finite localized inelastic deformations in cohesive-frictional materials. The generalized gradient-enhanced micropolar continuum formulation is employed to tackle challenges related to localization and softening material behavior, while the MPM addresses issues arising from excessive deformations. The method utilizes a B-spline formulation for the rigid background mesh to mitigate the well-known cell crossing errors of the MPM. To demonstrate the performance of the method, 2D and 3D numerical studies on localized failure in sandstone in plane strain compression and triaxial extension tests are presented. A comparison with finite element results confirms the suitability of the formulation. Moreover, an efficient numerical implementation of the formulation is presented, and it is demonstrated that the additional MPM specific overhead is negligible.

B-spline

A finite element solution algorithm for nonlinear thermal problems with severe gradients

An implicit enthalpy - flux component finite element algorithm is presented for nonlinear thermal problems with severe gradients. The algorithm is formulated to permit efficient solution of nonlinear heat transfer problems for unstructured meshes with a large range of element sizes. Two transient conduction examples illustrate the effectiveness of the approach for problems with high temperatures and steep gradients.

Thornton, Earl A.

Extending an Economical Third-Order Inviscid Nodal-Gradient Cell-Centered Finite-Volume Method to Mixed-Element Grids

In this paper, we extend an economical third-order nodal-gradient cell-centered finite-volume method, originally developed for tetrahedral grids, to mixed-element grids. It is shown that the efficient quadratic interpolation formula essential to eliminating second derivatives from a third-order accurate discretization can be easily extended to an arbitrary cell type. For the surface flux integration, we consider a split-face approach, where a quadrilateral face is split into two triangles, and the third-order method for tetrahedra is directly applied. Also, we derive a second-derivative-free, high-order, volume quadrature formula for an arbitrary cell. Numerical results are presented for accuracy verification and applications with three-dimensional nontetrahedral grids.

Computational Fluid Dynamics

Comparison of Two Approaches to Constructing Second- and Third-Order Nodal-Gradient Cell-Centered Finite-Volume Methods for Mixed-Element Grids

In this paper, we introduce a third-order nodal-gradient cell-centered finite volume scheme applicable to mixed-element grids based on a single numerical flux per face. Previously, we considered a split-quadrilateral-face approach, where we split each quadrilateral face of a non-tetrahedral cell into two triangles and then apply second- and third-order schemes designed for tetrahedral grids. This approach is relatively simple to implement but expensive because it requires two numerical flux evaluations per quadrilateral face. In this study, we consider another approach, where the surface flux quadrature is performed with a single numerical flux per face with flux corrections. It requires a 3×3 correction matrix to be stored at each face but is more economical than the split-quadrilateral-face approach. The two approaches are compared for three-dimensional flows on irregular hexahedral grids, and their relative merits are discussed.

Third-order scheme

Liapunov functions for non-linear difference equation stability analysis.

Liapunov functions to determine the stability of non-linear autonomous difference equations can be developed through the use of auxiliary exact difference equations. For this purpose definitions are introduced for the gradient of an implicit function of a discrete variable, a principal sum, a definite sum and an exact difference equation, and a theorem for exactness of a difference form is proved. Examples illustrate the procedure.

Park, K. E.

Implicit Large-Eddy Simulations of Zero-Pressure Gradient, Turbulent Boundary Layer

A set of direct simulations of zero-pressure gradient, turbulent boundary layer flows are conducted using various span widths (62-630 wall units), to document their influence on the generated turbulence. The FDL3DI code that solves compressible Navier-Stokes equations using high-order compact-difference scheme and filter, with the standard recycling/rescaling method of turbulence generation, is used. Results are analyzed at two different Re values (500 and 1,400), and compared with spectral DNS data. They show that a minimum span width is required for the mere initiation of numerical turbulence. Narrower domains ((is) less than 100 w.u.) result in relaminarization. Wider spans ((is) greater than 600 w.u.) are required for the turbulent statistics to match reference DNS. The upper-wall boundary condition for this setup spawns marginal deviations in the mean velocity and Reynolds stress profiles, particularly in the buffer region.

Turblent boundary layer

Implicit finite-difference procedures for the computation of vortex wakes

Implicit finite-difference procedures for the primitive form of the incompressible Navier-Stokes and the compressible Euler equations are used to compute vortex wake flows. The partial differential equations in strong conservation-law form are transformed to cluster grid points in regions with large changes in vorticity. In addition to clustering, fourth-order accurate, spatial difference operators are used to help resolve the flow-field gradients. The use of implicit time-differencing permits large time steps to be taken since temporal variations are typically small. Computational efficiency is achieved by approximate factorization. Both two-dimensional and preliminary three-dimensional calculations are described and qualitatively compared with existing experimental data.

Steger, J. L.

Learning Constitutive Relations From Soil Moisture Data via Physically Constrained Neural Networks

Abstract The constitutive relations of the Richardson‐Richards equation encode the macroscopic properties of soil water retention and conductivity. These soil hydraulic functions are commonly represented by models with a handful of parameters. The limited degrees of freedom of such soil hydraulic models constrain our ability to extract soil hydraulic properties from soil moisture data via inverse modeling. We present a new free‐form approach to learning the constitutive relations using physically constrained neural networks. We implemented the inverse modeling framework in a differentiable modeling framework, JAX, to ensure scalability and extensibility. For efficient gradient computations, we implemented implicit differentiation through a nonlinear solver for the Richardson‐Richards equation. We tested the framework against synthetic noisy data and demonstrated its robustness against varying magnitudes of noise and degrees of freedom of the neural networks. We applied the framework to soil moisture data from an upward infiltration experiment and demonstrated that the neural network‐based approach was better fitted to the experimental data than a parametric model and that the framework can learn the constitutive relations.

54 ENVIRONMENTAL SCIENCES

Particle drift, diffusion, and acceleration at shocks

The gradient and curvature drifts implicit in change of the ambient magnetic field at a hydromagnetic shock wave are incorporated into the diffusive theory of shock acceleration of charged particles. The conventional jump condition at the shock is modified by a term incorporating the large drift along the shock plane. This term vanished identically for one-dimensional systems, but must be included in general for shocks which are finite in transverse extent or which have transverse structure. It is found that the effect of the drift is such that the transverse drift rate is proportional to the acceleration rate, and for perpendicular shocks is exactly equal to the rate of change of energy in the V x B electric field observed in the shock frame. This establishes a connection with the 'shock drift' models which neglect diffusion.

Jokipii, J. R.

Three-Dimensional Viscous Alternating Direction Implicit Algorithm and Strategies for Shape Optimization

A gradient-based shape optimization based on quasi-analytical sensitivities has been extended for practical three-dimensional aerodynamic applications. The flow analysis has been rendered by a fully implicit, finite-volume formulation of the Euler and Thin-Layer Navier-Stokes (TLNS) equations. Initially, the viscous laminar flow analysis for a wing has been compared with an independent computational fluid dynamics (CFD) code which has been extensively validated. The new procedure has been demonstrated in the design of a cranked arrow wing at Mach 2.4 with coarse- and fine-grid based computations performed with Euler and TLNS equations. The influence of the initial constraints on the geometry and aerodynamics of the optimized shape has been explored. Various final shapes generated for an identical initial problem formulation but with different optimization path options (coarse or fine grid, Euler or TLNS), have been aerodynamically evaluated via a common fine-grid TLNS-based analysis. The initial constraint conditions show significant bearing on the optimization results. Also, the results demonstrate that to produce an aerodynamically efficient design, it is imperative to include the viscous physics in the optimization procedure with the proper resolution. Based upon the present results, to better utilize the scarce computational resources, it is recommended that, a number of viscous coarse grid cases using either a preconditioned bi-conjugate gradient (PbCG) or an alternating-direction-implicit (ADI) method, should initially be employed to improve the optimization problem definition, the design space and initial shape. Optimized shapes should subsequently be analyzed using a high fidelity (viscous with fine-grid resolution) flow analysis to evaluate their true performance potential. Finally, a viscous fine-grid-based shape optimization should be conducted, using an ADI method, to accurately obtain the final optimized shape.

Pandya, Mohagna J.

Numerical computation of viscous flows on the lee side of blunt shapes flying at supersonic speeds

A numerical method for solving the parabolic approximation to the steady-state compressible Navier-Stokes equations is examined. The approximation neglects only the streamwise gradients of shear stress. An implicit finite difference method is used which advances the solution downstream from an initial data surface and determines the complete viscous-inviscid flow between the body and bow shock wave. It is necessary that the inviscid portion of the flow field be supersonic. Crossflow separation is determined as part of the solution. The method is applied to a 15 deg sphere-cone at 15 deg angle of attack, and the results are compared with an inviscid method-of-characteristics calculation.

Rakich, J. V.

Direct Coupling Method for Time-Accurate Solution of Incompressible Navier-Stokes Equations

A noniterative finite difference numerical method is presented for the solution of the incompressible Navier-Stokes equations with second order accuracy in time and space. Explicit treatment of convection and diffusion terms and implicit treatment of the pressure gradient give a single pressure Poisson equation when the discretized momentum and continuity equations are combined. A pressure boundary condition is not needed on solid boundaries in the staggered mesh system. The solution of the pressure Poisson equation is obtained directly by Gaussian elimination. This method is tested on flow problems in a driven cavity and a curved duct.

Soh, Woo Y.