Search NASASearch

Engineering topics

Gabriel Nastac

Publications and source records attributed to Gabriel Nastac.

At least 19 records

Implicit Thermochemical Nonequilibrium Compressible Flow Simulations on Unstructured Grids Using GPUs

As next-generation exascale-class systems arrive, existing software must be updated accordingly to effectively utilize these systems. For high concurrency and energy efficiency, many of these systems utilize GPU architectures. In this work, we present a CUDA C++ implementation of FUN3D's thermochemical nonequilibrium capability for turbulent flows. Efficiency is demonstrated at scale using the Summit system at the Oak Ridge Leadership Computing Facility which is representative of future exascale systems. This work enables faster, higher fidelity, and scale-resolving simulations of thermochemical nonequilibrium flows including reentry, hypersonics, and combustion.

CFD, GPU, HPC, Hypersonics, Chemistry

Implicit Thermochemical Nonequilibrium Flow Simulations on Unstructured Grids using GPUs

Thermochemical nonequilibrium flow simulation capabilities have been previously implemented, verified, and validated for central processing unit (CPU) systems in NASA’s unstructured-grid computational fluid dynamics solver FUN3D. Many exascale-class high-performance computing systems will rely on graphics processing unit (GPU) architectures for high throughput and energy efficiency; thus, CPU-based scientific computing software unable to effectively utilize these systems must be updated. In this work, we present a CUDA C++ implementation of FUN3D’s thermochemical nonequilibrium flow simulation capabilities targeting NVIDIA Tesla GPUs. An overview of the porting and optimization strategy is described and performance comparisons with other recent architectures are presented. Scaling to thousands of GPUs is demonstrated, yielding computational performance equivalent to that of several million CPU cores. The implementation enables efficient, high-fidelity, scale-resolving simulations of thermochemical nonequilibrium flows for many applications including atmospheric entry, hypersonics, and combustion.

GPU

The Influence of Computer Architecture on Performance and Scaling for Hypersonic Flow Simulations

It is critical to understand how hypersonic simulation tools perform on a range of computational platforms. This information will aid in the acquisition of appropriate hardware and the potential refactoring of hypersonic codes to run on different systems. In this paper, we consider two representative high-speed reacting flow cases: a model Mach 8 hypersonic waverider glide vehicle and a model hydrocarbon-fueled hypersonic ramjet propulsion system. In both scenarios, the flow fields are in chemical non-equilibrium and are modeled by the multi-species reacting Navier-Stokes equations. For these simulations we use several hypersonic simulation tools, including US3D, Kestrel, FUN3D, and the JENRER© flow solver. We explore several high performance computing systems containing IntelR© XeonR© Platinum processors, AMD EPYCTM7702 processors, and NVIDIAR© Tesla V100 devices. We compare performance and strong scaling between the different systems.

CPU

Improved Heat Transfer Prediction for High-Speed Flows over Blunt Bodies using Adaptive Mixed-Element Unstructured Grids

Aerothermodynamic prediction is important for the design and analysis of many aerospace vehicles. Computational Fluid Dynamics (CFD) tools used for these predictions commonly rely on structured shock-aligned grids due to the strong shocks exhibited at high speeds. This work details the incorporation of an improved HLLE++ scheme for both perfect gas and thermochemical nonequilibrium flows which robustly captures shock waves on both non-shock-aligned and shock-aligned grids. The HLLE++ scheme reduces the impact of eigenvalue limiting on flow solutions which is required for Roe's scheme for high Mach number flows. An adapted grid approach is also demonstrated using mixed-element unstructured grids to improve heat prediction. Thin prismatic boundary layers are used with tetrahedra in the farfield and for capturing shock waves. Various results are presented for hypersonic flows over blunt bodies including cylinders, spheres, and capsules.

CFD

Application of a Detached Eddy Simulation Approach with Finite-Rate Chemistry to Mars-Relevant Retropropulsion Operating Environments

Human-scale Mars vehicles will require retropropulsion for descent and landing, replacing heritage supersonic parachute systems with an extended phase of powered flight. Due to the limitations of terrestrial testing in Mars-relevant conditions, design and analysis will increasingly rely on computational modeling and simulation. This paper provides an overview of a computational campaign investigating the aerodynamics of a Mars lander concept along various points on a powered descent trajectory including supersonic, transonic, and subsonic conditions using finite-rate chemistry. Simulations using unstructured grids containing billions of elements are performed at scale using thousands of Graphics Processing Units, enabling run-times of a few days for each simulation presented. At each freestream condition, significant minor species concentrations are observed external to the nozzles in the large mixing region upstream of the vehicle. While the flowfields are highly non-stationary in all cases, the mean integrated forces and moments on the vehicle remain small in comparison to the deceleration provided through retropropulsion.

Ashley Korzun

Improved Heat Transfer Prediction for High-Speed Flows over Blunt Bodies using Adaptive Mixed-Element Unstructured Grids

Aerothermodynamic prediction is important for the design and analysis of many aerospace vehicles. Computational Fluid Dynamics (CFD) tools used for these predictions commonly rely on structured shock-aligned grids due to the strong shocks exhibited at high speeds. This work details the incorporation of an improved HLLE++ scheme for both perfect gas and thermochemical nonequilibrium flows which robustly captures shock waves on both non-shock-aligned and shock-aligned grids. The HLLE++ scheme reduces the impact of eigenvalue limiting on flow solutions which is required for Roe's scheme for high Mach number flows. An adapted grid approach is also demonstrated using mixed-element unstructured grids to improve heat prediction. Thin prismatic boundary layers are used with tetrahedra in the farfield and for capturing shock waves. Various results are presented for hypersonic flows over blunt bodies including cylinders, spheres, and capsules.

CFD

Computational Investigation of the Effect of Chemistry on Mars Supersonic Retropropulsion Environments

Retropropulsion ground tests require significant compromises on physical scale, instrumentation, configuration, and environments. Matching the full Martian environment is simply not possible on Earth. Ground tests of retropropulsion configurations thus far have neglected effects of chemistry due to physical constraints of wind tunnel models and facilities; most experiments use inert simulant gases at relatively low temperatures. As such, a strong reliance on high-fidelity computational analyses is required to expand the knowledge of retropropulsion aerodynamics. In this work, we investigate the effects of chemistry using scale-resolving computational fluid dynamics (CFD) with finite-rate chemistry and a graphics processing unit (GPU)-enabled implementation of the NASA FUN3D flow solver on a human-scale Mars lander concept at supersonic freestream conditions. Results are compared to previous perfect gas simulations.

retropropulsion

Computational Investigation of the Effect of Chemistry on Mars Supersonic Retropropulsion Environments

Retropropulsion ground tests require significant compromises on physical scale, instrumentation, configuration, and environments. Matching the full Martian environment is simply not possible on Earth. Ground tests of retropropulsion configurations thus far have neglected effects of chemistry due to physical constraints of wind tunnel models and facilities; most experiments use inert simulant gases at relatively low temperatures. As such, a strong reliance on high-fidelity computational analyses is required to expand the knowledge of retropropulsion aerodynamics. In this work, we investigate the effects of chemistry using scale-resolving computational fluid dynamics (CFD) with finite-rate chemistry and a graphics processing unit (GPU)-enabled implementation of the NASA FUN3D flow solver on a human-scale Mars lander concept at supersonic freestream conditions. Results are compared to previous perfect gas simulations.

retropropulsion

Performance of Coupled Physics Solvers for Multidisciplinary Hypersonic Flow Simulations on Several Classes of Computer Architectures

The application of hypersonic flow simulation tools to realistic flight scenarios will require the coupling of multiple physical effects to the baseline fluid dynamics. Such multiphysics effects can include the aerooelastic response of the airframe or engine components, dynamic transport of atmospheric particles, the deformation of solid-fluid interfaces that can ablate, pyrolyze, or erode, as well as a host of other processes, all of which are governed by unique sets of physical equations and models. Coupling multiple (and potentially disparate) physics solvers to a robust compressible flow solver poses additional challenges related to the stability, performance and scalability of the combined solver. The choices made during the software design process can therefore lead to a variation in simulation efficiency across different computer architectures. In this paper, we will consider two representative multiphysics hypersonic flow scenarios: the interaction of solid particulates with the flow field created by a hypersonic lifting body and the aerooelastic deformation of a model airframe under high-Mach-number flow conditions. For these simulations we explore the behavior of several hypersonic simulation tools, including Kestrel, FUN3D, US3D, and JENRE multiphysics framework, on several high performance computing systems containing various CPU and GPU architectures.

architecture

Computational Investigation of the Effect of Chemistry on Mars Retropropulsion Environments using a Massively Parallel GPU Approach

In this work, we investigate the effects of chemistry on a human-scale Mars lander concept using scale-resolving computational fluid dynamics (CFD) with finite-rate chemistry and a graphics processing unit (GPU)-enabled implementation of the NASA FUN3D flow solver, enabling run-times of a few days for the simulations presented. Simulations are carried out on Summit at Oak Ridge Leadership Computing Facility using thousands of GPUs. Retropropulsion ground tests require significant compromises on physical scale, instrumentation, configuration, and environments. Ground tests of retropropulsion configurations thus far have neglected effects of chemistry due to physical constraints of wind tunnel models and facilities; most experiments use inert simulant gases at low temperatures. As such, a strong reliance on high-fidelity computational analyses such as those presented in this work is required to expand the knowledge of retropropulsion aerodynamics. An overview of the GPU approach will be presented. Results are compared to a previous scaled perfect gas (air) campaign.

retropropulsion

Performance Optimization Methods for a Memory-Bound, Unstructured-Grid CFD Application on Massively Parallel GPU Platforms

Computational performance of the FUN3D unstructured-grid computational fluid dynamics (CFD) application on massively parallel GPU environments is memory-bound and highly dependent upon efficient reads from and atomic updates to the irregular cell-, edge-, and node-based data structures. In this talk, we present recent efforts into optimizing select performance-critical kernels on NVIDIA Tesla V100 and A100 GPUs and AMD CDNA MI100 GPUs. A novel use of L2 cache residency controls and asynchronous loads into on-chip shared memory are explored on the A100 GPU for the sparse iterative solver, which is dominated by mixed-precision, sparse matrix vector multiplication. Demonstrations show that these methods improve global memory bandwidth utilization by 13.5% on the A100 GPU. Several techniques are also presented that use registers and/or shared memory to facilitate array transposition and aggregation which combine to reduce the frequency and increase the cache efficiency of floating-point atomic updates to the irregular data structures. These methods are demonstrated to improve the kernel throughput by nearly 500% on select kernels on the AMD MI100 over atomic updates directly to global memory. Overall, both V100 and A100 GPUs outperformed the MI100 GPU on kernels dominated by double-precision atomic updates; however, the techniques demonstrated here reduced the performance gap and improved the MI100 performance.

GPU CPU unstructured CFD memory