OpenMP-based Frameworks for Interoperable Structured Adaptive Methods
Parallel adaptive mesh refinement (AMR) is an important numerical technique that leads to the efficient solution of many physical and engineering problems.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Parallel adaptive mesh refinement (AMR) is an important numerical technique that leads to the efficient solution of many physical and engineering problems.
The use of an adaptive mesh refinement procedure for analyzing hypersonic laminar flows with application to aerothermal load predictions is described. The adaptation procedure, which uses both quadrilateral and triangular elements, is implemented with the multistep Galerkin-Runge-Kutta scheme. Elements that lie in regions of strong gradients are refined based on indicators to obtain better definition of flow features. The effectiveness of the adaptive procedure is demonstrated by modeling Mach 11.7 flow over a 15-deg ramp. Numerical results are compared with predictions of strong interaction theories and experimental data. Surface quantities such as heating rates and pressure loads, critical for the effective design of high-speed vehicles, are found to be in good agreement with experimental values.
In this work, we propose a new method that extends conservative explicit multirate methods to implicit explicit-multirate methods. We develop extensions of order one and two with different stability properties on the implicit side. The method is suitable for time-stepping adaptive mesh refinement PDE discretizations with different degrees of stiffness. A numerical example with an advection-diffusion problem illustrates the new method's properties.
Abstract Modeling the localized intensive deformation in a damaged solid requires highly refined discretization for accurate prediction, which significantly increases the computational cost. Although adaptive model refinement can be employed for enhanced effectiveness, it is cumbersome for the traditional mesh‐based methods to perform while modeling the evolving localizations. In this work, neural network‐enhanced reproducing kernel particle method (NN‐RKPM) is proposed, where the location, orientation, and shape of the solution transition near a localization is automatically captured by the NN approximation via a block‐level neural network (NN) optimization. The weights and biases in the blocked parameterization network control the location and orientation of the localization. The designed basic four‐kernel NN block is capable of capturing a triple junction or a quadruple junction topological pattern, while more complicated localization topological patters are captured by the superposition of multiple four‐kernel NN blocks. The standard RK approximation is then utilized to approximate the smooth part of the solution, which permits a much coarser discretization than the high‐resolution discretization needed to capture sharp solution transitions with the conventional methods. A regularization of the NN approximation is additionally introduced for discretization‐independent material responses. The effectiveness of the proposed NN‐RKPM is verified by a series of numerical verifications.
In this study, we present an \(hr\) -adaptivity framework for optimization of high-order meshes. This work extends the r -adaptivity method by Dobrev et al. (Comput Fluids, 2020), where we utilized the Target-Matrix Optimization Paradigm (TMOP) to minimize a functional that depends on each element’s current and target geometric parameters: element aspect-ratio , size , skew , and rotation . Since fixed mesh topology limits the ability to achieve the target size and aspect-ratio at each position, in this paper, we augment the r -adaptivity framework with nonconforming adaptive mesh refinement to further reduce the error with respect to the target geometric parameters. The proposed formulation, referred to as \(hr\) -adaptivity, introduces TMOP-based quality estimators to satisfy the aspect-ratio target via anisotropic refinements and size target via isotropic refinements in each element of the mesh. The methodology presented is purely algebraic, extends to both simplices and hexahedra/quadrilaterals of any order, and supports nonconforming isotropic and anisotropic refinements in 2D and 3D. Using a problem with a known exact solution, we demonstrate the effectiveness of \(hr\) -adaptivity over both r - and \(h\) -adaptivity in obtaining similar accuracy in the solution with significantly fewer mesh nodes. We also present several examples that show that \(hr\) -adaptivity can help satisfy geometric targets even when \(r\) -adaptivity fails to do so, due to the topology of the initial mesh.
This viewgraph presentation reviews the use Adaptive Mesh Refinement (AMR) in simulating the Crustal Dynamics of Earth's Surface. AMR simultaneously improves solution quality, time to solution, and computer memory requirements when compared to generating/running on a globally fine mesh. The use of AMR in simulating the dynamics of the Earth's Surface is spurred by future proposed NASA missions, such as InSAR for Earth surface deformation and other measurements. These missions will require support for large-scale adaptive numerical methods using AMR to model observations. AMR was chosen because it has been successful in computation fluid dynamics for predictive simulation of complex flows around complex structures.
Computational tractable simulations using an adaptive-mesh-refinement solverfor compressible reacting flows help researchers understand how variations in fuel injection location within the supersonic flow cavity impacts combustion efficiency. By identifying the important physical determinants of the combustion processes, this study shows a promising pathway to improving flame stability and combustion efficiency, as well as reducing emissions.
The increased accessibility of commercial aviation to the general population has in-creased the conventional jet fuel consumption, thereby causing increased CO2 emissions. One of the strategies to reduce the environmental impact is to use sustainable aviation fuels (SAFs). SAFs are jet fuels obtained from renewable resources such as biomass and waste streams such as plastics/municipal solid wastes. Even though the use of SAFs has been gaining importance over the last two decades, only a few numerical studies on their usage have been reported so far. In this study, two SAFs namely, Alcohol to Jet (ATJ) and Hydrotreated Esters and Fatty Acids (HEFA), are chosen and their use in a simple, Lead Direct Injection (LDI) combustor is studied. The focus of this study is limited to the thermo-chemical properties of the fuels and their impact on fuel distribution and evaporation. Hence, only non-reactive simulations are performed. A high accuracy, adaptive mesh refinement based low-Mach solver, PeleLMeX, is used for performing the simulations. The time-averaged flow results indicate faster evaporation of HEFA when compared to ATJ and Jet-A. The difference in fuel evaporation rates is attributed to the differences in fuel viscosity and surface tension properties and the concomitant variations in the fuel droplet size distributions.
The increased accessibility of commercial aviation to the general population has in-creased the conventional jet fuel consumption, thereby causing increased CO2emissions. One of the strategies to reduce the environmental impact is to use sustainable aviation fuels (SAFs). SAFs are jet fuels obtained from renewable resources such as biomass and waste streams such as plastics/municipal solid wastes. Even though the use of SAFs has been gaining importance over the last two decades, only a few numerical studies on their usage have been reported so far. In this study, two SAFs namely, alcohol to jet (ATJ) and hydrotreated esters and fatty acids (HEFA), are chosen and their use in a simple, lead direct injection (LDI) combustor is studied. The focus of this study is limited to the thermo-chemical properties of the fuels and their impact on fuel distribution and evaporation. Hence, only non-reactive simulations are performed. A high accuracy, adaptive mesh refinement based low-Mach solver, PeleLMeX, is used for performing the simulations. The time-averaged flow results indicate faster evaporation of HEFA when compared to ATJ and Jet-A. The difference in fuel evaporation rates is attributed to the differences in fuel viscosity and surface tension properties and the concomitant variations in the fuel droplet size distributions.
The Oak Ridge Leadership Computing Facility (OLCF) has been preparing the nation's first exascale system, Frontier, for production and end users. Frontier is based on HPE Cray's new EX architecture and Slingshot interconnect and features 74 cabinets of optimized 3rd Gen AMD EPYC CPUs for HPC and AI and AMD Instinct 250X accelerators. As a part of this preparation, “real-world” user codes have been selected to help assess the functionality, performance, and usability of the system. This article describes early experiences using the system in collaboration with the Hamburg Observatory for two selected codes, which have since been adopted in the OLCF test harness. Experiences discussed include efforts to resolve performance variability and per-cycle slowdowns. Results are shown for a performance portable astrophysical magnetohydronamics code, AthenaPK, and a mini-application stressing the core functionality of a performance portable block-structured adaptive mesh refinement framework, Parthenon-Hydro. Here, these results show good scaling characteristics to the full system. At the largest scale, the Parthenon-Hydro miniapp reaches a total of $1.7$ $\times$ $10^{13}$ zone-cycles/s on 9216 nodes (73,728 logical GPUs) at ≈92% weak scaling parallel efficiency (starting from a single node using a second-order, finite-volume method).
The PYRAMID parallel unstructured adaptive mesh refinement (AMR) library has been coupled with the GeoFEST geophysical finite element simulation tool to support parallel active tectonics simulations. Specifically, we have demonstrated modeling of coseismic and postseismic surface displacement due to a simulated Earthquake for the Landers system of interacting faults in Southern California. The new software demonstrated a 25-times resolution improvement and a 4-times reduction in time to solution over the sequential baseline milestone case. Simulations on workstations using a few tens of thousands of stress displacement finite elements can now be expanded to multiple millions of elements with greater than 98% scaled efficiency on various parallel platforms over many hundreds of processors. Our most recent work has demonstrated that we can dynamically adapt the computational grid as stress grows on a fault. In this paper, we will describe the major issues and challenges associated with coupling these two programs to create GeoFEST(P). Performance and visualization results will also be described.
Simulating flow through porous media with explicit considerations of complex microstructures is very challenging using conventional sharp-interface methods because of the difficulties in generating meshes conformal to complex geometries. In this work, a diffuse interface embedded boundary method known as the Smoothed Boundary Method (SBM) is utilized to facilitate simulations of fluid dynamics involving complex geometries. In diffuse-interface methods, the geometry is described by a domain parameter. The SBM allows the straightforward reformulation of the time-dependent Navier-Stokes equations in terms of this domain parameter, using only algebraic identities. Thus, enforcing the appropriate boundary conditions at the irregular embedded boundary is greatly simplified. Adaptive mesh refinement is used to increase the accuracy of the diffuse interface method by allowing thinner interfacial thickness to be used in the domain parameter. Here, the SBM-formulated Navier-Stokes equations are solved with the Finite Difference Method on refined mesh systems. Sharp-interface Finite Element Method simulations using the commercial software COMSOL on body-conforming meshes are also provided for comparison. Favorable agreement between the two methods is observed. Since it is no longer necessary for the mesh to conform to the complex geometry, the grid system for the SBM simulations can be generated rapidly and without additional manual interventions, making the entire simulation process more expedient.
In this work, we propose and develop an arbitrary-order adaptive discontinuous Petrov--Galerkin (DPG) method for the nonlinear Grad--Shafranov equation. An ultraweak formulation of the DPG scheme for the equation is given based on a minimal residual method. The DPG scheme has the advantage of providing more accurate gradients compared to conventional finite element methods, which is desired for numerical solutions to the Grad--Shafranov equation. The numerical scheme is augmented with an adaptive mesh refinement approach, and a criterion based on the residual norm in the minimal residual method is developed to achieve dynamic refinement. Nonlinear solvers for the resulting system are explored and a Picard iteration with Anderson acceleration is found to be efficient to solve the system. Finally, the proposed algorithm is implemented in parallel on MFEM using a domain-decomposition approach, and our implementation is general, supporting arbitrary order of accuracy and general meshes. Furthermore, numerical results are presented to demonstrate the efficiency and accuracy of the proposed algorithm.
Here, we present sweep-compatible, novel upwinding recipes for the bilinear discontinuous (BLD) finite element method (FEM) that allows lumped BLD to be used on adaptive mesh refinement (AMR) meshes for thick transport applications without adding additional degrees of freedom at hanging nodes that exist on refinement boundaries. We analyze the properties of the upwinding and lumping that are needed for BLD to get the thick diffusion limit on such meshes, present results demonstrating locking with the wrong recipe, and present results showing error convergence and robustness properties for two diffusive problems on a variety of AMR meshes.
Parallelization of the temporal domain is explored for the solution of turbulent flows. Multigrid reduction-in-time (MGRIT) is used to advance the large-scale fluid dynamics in time sequentially on the coarsest space-time grid but propagate the information in time parallel on all other levels. The goal of this process is to accurately and efficiently resolve the coarse-scale turbulence structure and use that to drive the fine-scales of the turbulent flow. The extra forcing from nonlinear multigrid facilitates the coupling and interaction between fine and coarse scales, through which the multiscale nonlinear physics is properly captured. Adaptive mesh refinement is employed to finely resolve only the regions with strong gradients, which provides further computational efficiency. The underlying computational fluid dynamics solver is a fourth-order finite-volume scheme with the standard 4-stage Runge-Kutta method. An advanced approach is devised and implemented to enable MGRIT to solve highly turbulent flows successfully. Furthermore, the method is applied to solve a Taylor-Green vortex problem and a doubleshear-layer turbulent mixing flow. Results are promising, validating that MGRIT with the filtering approach has the potential to efficiently solve general turbulent flows.
The ExaStar project aims to deliver an efficient, versatile, and portable software ecosystem for multi-physics astrophysics simulations run on exascale machines. The code suite is a component-based multi-physics toolkit, built on the capabilities of current simulation codes (in particular Flash-X and Castro), and based on the massively parallel adaptive mesh refinement framework AMReX. It includes modules for hydrodynamics, advanced radiation transport, thermonuclear kinetics, and nuclear microphysics. The code will reach exascale efficiency by building upon current multi- and many-core packages integrated into an orchestration system that uses a combination of configuration tools, code translators, and a domain-specific asynchronous runtime to manage performance across a range of platform architectures. The target science includes multi-physics simulations of astrophysical explosions (such as supernovae and neutron star mergers) to understand the cosmic origin of the elements and the fundamental physics of matter and neutrinos under extreme conditions.
Concern for emission reduction has motivated the development of new cost-effective alternative sustainable aviation fuels (SAFs). Drop-in SAFs with blends of the certified and the alternative fuels are beneficial because they do not require engine modifications for use in current aviation engines. Combustion characteristics are of particular concern when comparing a new fuel with Jet-A. Lean blow-off and flame stabilization have been identified to be governed by the fuel propensity to autoignition, i.e. derived cetane number. However, fundamental investigation is required to identify the impact of derived cetane number on the combustion mode of flame stabilization in a realistic combustor. The combustion mode has also a direct impact on turbulent combustion modeling closures. DNS simulations are performed in the low-Mach solver of the Pele Suite called PeleLMeX. Lagrangian multi-phase modeling is used to capture the liquid spray injection of Jet-A (reference fuel) and C1 as a representative of a low cetane number SAF. Adaptive Mesh Refinement (AMR) is used to enable a more efficient simulation of a more realistic domain size and embedded boundary treatment is used to model a bluff-body geometry. Local extinction and edge flame propagation were observed for both fuels. The edge flame propagation mode was quantified in terms of a Damkohler number defined as the ratio between progress variable reaction rate and its diffusive flux. Initial analysis suggests that a mixed mode combustion occurs for the edge flame propagation, with flame propagation assisted by ignition and autoignition co-existing for both Jet-A and C1 flames. The analysis of the extinction region shows a larger progress variable for Jet-A which can further increase the local displacement speed and present a faster reignition of the stoichiometric mixture fraction.
Next, a robust and efficient framework for simulating NSPD in multiple dimensions is developed. The reactive Navier-Stokes equations are extended to include a drift-diffusion plasma-fluid model with a local field approximation (LFA) in a finite-volume solver, which uses an adaptive mesh refinement (AMR) strategy to address the wide separation of length scales in the problem. A two-way coupling strategy is used whereby the plasma-fluid model and reactive Navier-Stokes equations are integrated simultaneously. The oxidation of ethylene/air mixtures mediated by NSPD is simulated in a pin-to-pin configuration. All phases of the plasma discharge are simulated explicitly (including streamer ignition, propagation, and connection, as well as the subsequent spark phase), along with the evolution of the plasma during the inter-pulse period. Temporally and spatially-resolved results are presented, with an emphasis on the analysis of heating and energy deposition, as well as of the evolution of the concentration of active particles generated during the NSPD and their influence on ignition.