Search NASA⌕ Search

Engineering topics

Sitaraman, Hariswaran

Publications and source records attributed to Sitaraman, Hariswaran.

At least 19 records

Vidyut3d: A Gpu Accelerated Fluid Solver for Non-Equilibrium Plasmas on Adaptive Grids

We present the numerical methods, programming methodology, verification, and performance assessment of a non-equilibrium plasma fluid solver that can effectively utilize current and upcoming central processing and graphics processing unit (CPU+GPU) architectures, in this work. Our plasma fluid model solves the coupled conservation equations for species transport, electrostatic Poisson and electron temperature on adaptive Cartesian grids. Our solver is written using performance portable adaptive-grid/particle management library, AMReX, and is portable over widely available vendor specific GPU architectures. We present verification of our solver using method of manufactured solutions that indicate formal second order accuracy with central diffusion and fifth-order weighted-essentially-non-oscillatory (WENO) advection scheme. We also verify our solver with published literature on capacitive discharges and atmospheric pressure streamer propagation. We demonstrate the use of our solver on two 3D simulation cases: an atmospheric streamer propagation in Ar-H2 mixtures and a low pressure twin electrode radio frequency reactor. Our performance studies on three different CPU+GPU architectures indicate approximately 150-400X speed-up using AMD and NVIDIA GPUs per time step compared to a single CPU core for a 4 million cell simulation with 15 species.

Sitaraman, Hariswaran↗

2D Modeling of Plasma Streamer and Glow Phases at Ammonia-Air Flame Conditions

Streamer and glow plasma phases have been modeled at two thermochemical states of an ammonia-air flame: fresh reactants and burnt products. A new AMReX-based solver has been verified against benchmarks in the literature and has been used to perform these simulations. A Helmholtz-equation based photoionization model with parameters accounting for the presence of NH3 in air has been coupled with the solver to accurately model the streamer propagation phase. A detailed plasma kinetics mechanism has been compiled and used to predict the evolution of electrons, excited states, ions, and radicals during streamer propagation and glow formation. The propagation velocity of streamers was found increase by almost two-fold when the mixture was changed from the fresh reactants to the burnt products. Moreover, vibrational excitation was found to be limited to the streamer body, whereas ionization predominantly occurred at the streamer head, as is expected. Finally, the differences in the pathways of O and H radical production during the streamer propagation and glow phases have been briefly discussed.

ammonia-air flame↗

A High-Performance Discrete-Element Framework for Simulating Flow and Jamming of Moisture Bearing Biomass Feedstocks

We developed and verified a high-performance open-source discrete element method (DEM) solver with simultaneously-supported feedstock-specific interaction models, including bonded-sphere, liquid bridge, cohesion, and non-linear contact models. Our solver uses parallel data structures on hybrid central and graphics processing unit (CPU/GPU) architectures, with favorable strong scaling performance observed for large problem sizes comprised of (100 M particles), and 4X single-node GPU speedup. The particles for corn stover feedstock were conceptualized and calibrated based on experimental measurements and results. Sensitivity analyses demonstrate that the mass flow rate from a wedge hopper is governed primarily by moisture content, friction coefficient, and cohesion energy density. The model is used to reproduce experimentally observed hopper jamming results, highlighting that the experimental no-flow trends can only be achieved by using non-spherical particles, liquid bridge and cohesion models, highlighting the importance of using concurrent feedstock specialized models for the effective representation of biomass material handling problems.

bioenergy↗

Vidyut3d: A Non-Equilibrium Plasma Modeling Tool [SWR-24-101]

Vidyut3d is a massively-parallel plasma-fluid solver for low-temperature plasmas (LTPs) that supports both local field (LFA) and local mean energy (LMEA) approximations, as well as complex gas and surface-phase chemistry. The solver supports 2D and 3D domains, and uses AMReX's adaptive mesh refinement capabilities to increase the grid resolution around complex structures (e.g. streamer heads and sheaths) while maintaining a tractable problem size. Vidyut specializes in simulating various types of gas-phase discharges, as well as plasma/surface interactions and surface chemistry (e.g. for plasma-mediated catalysis applications). The solver also supports hybrid CPU/GPU parallelization strategies, and has demonstrated excellent scaling on various HPC architectures for problem sizes consisting of O(100 M) control volumes.

Sitaraman, Hariswaran↗

Computational Methods for Multi-Physics Simulation of Melting in Steelmaking

Iron and steel production accounts for approximately 8% of global carbon dioxide (CO) emissions. Pathways to decarbonize include replacing fossil fuels in iron ore reduction and electrifying other steelmaking processes. Iron pellets produced by hydrogen, called Hydrogen Direct Reduced Iron (HDRI), have property differences from those produced using conventional DRI processes. These differences may impact melting in electric arc furnaces (EAF) and other downstream processes. The physical properties of iron pellets vary significantly with temperature during heating, complicating predictions of their behavior. In this project, we seek to develop an integrated simulation, including the fluid flow and convective thermal transport around the pellet particle. We also examine conduction and phase changes within the particle as they impact the melting process. We use adaptive mesh refinement (AMR) to resolve both the changing size of the particle and the complex physics of the interaction between the pellet and the surrounding fluid. We base our simulations on the AMReX-incflo module, which allows large-scale Navier-Stokes simulation while resolving the changing particle size during melting. As we advance our numerical tools, we anticipate an improved understanding of the dynamics of HDRI melting, which will, in turn, accelerate the adoption of low-carbon technologies in the steelmaking industry.

AMReX↗

Spectral Analysis of Regular Material Point Method and its Application to Study High Pressure Reverse Osmosis Membrane Compaction and Embossing

Material Point Method (MPM) is gaining widespread interest in applied continuum mechanics. The fact that all the continuum properties are stored on the particles (or material points) and the governing equations are solved on these material points makes MPM extremely suited to problems involving severe material deformations, such as crack propagation, soil movement, and fluid flows. Despite its popularity, only a few studies have focused on the numerical properties of MPM. This presentation introduces a global spectral analysis of the regular material point method. Contrary to previous studies, the analysis focuses on the numerical properties of the method in the spectral space. The amplification factor is derived as a function of the non- dimensional wave numbers. It provides insights into the stability and dissipative properties of the method for various CFL and Fourier numbers. The effect of the grid shape functions, number of particles per cell and their locations inside the grid cell are also analyzed. The EXAGOOP MPM solver (https://github.com/NREL/Exagoop.git) is developed at the National Renewable Energy Laboratory as a part of the NAWI UHPRO project and is based on the AMReX framework. A single-level, uniform cartesian grid is used as the background mesh, while the particle class in AMReX is used to manage the material point operations. Linear hat and B-splines are used as grid shape functions, while the time integration is performed using explicit Euler time integration. EXAGOOP is both CPU and GPU compatible and has been demonstrated to work well on multiple compute architectures. The performance of EXAGOOP on various computing architectures is presented along with its application to study compaction and embossing of high-pressure reverse osmosis membranes. The MPM solution accurately reproduces the membrane deformation. The deformed pore size and structure simulated using MPM also agree well with experimental SEM images.

material point method↗

EchemAMR (electro-chemical microsctructure scale models with adaptive meshing) [SWR-23-111]

A 3D microstructure resolving electrochemical transport and interfacial chemistry solver. Electrode microstructure plays an important role in determining the performance of an electrochemical system, e.g. lithium ion battery. EchemAMR is a microstructure scale model that solves the governing equations for ion transport, electrical current continuity, interfacial chemistry and structural mechanics. Complex microstructure geometries from imaging can be directly imported into EchemAMR. A volume fraction based description of the geometry on Cartesian grid with an immersed interface formulation enables simplified meshing and large-scale simulations with millions of degrees of freedom. EchemAMR has been tested against systems with analytic solutions for numerical convergence and highly resolved lithium ion battery microstructures. EchemAMR demonstrates excellent mass conversation and efficient scaling on heterogenous High-Performance Computing (HPC) with central and graphics processing units.

Sitaraman, Hariswaran↗

Reverse Osmosis Simulation Data

This dataset consists of computational fluid dynamics (CFD) output for various spacer configurations in a feed-water channel in reverse osmosis (RO) applications. Feed-water channels transport brine solution to the RO membrane surfaces. The spacers embedded in the channels help improve membrane performance by disrupting the concentration boundary layer growth on membrane surfaces. Refer to the "Related Work" resource below for more details. This dataset considers a feed-water channel of length 150mm. The inlet brine velocity and concentration are fixed at 0.1m/s and 100kg/m3 respectively. The diameter of the cylindrical spacers is fixed as 0.3mm and six varying inter-spacer distances of 0.75mm, 1mm, 1.5mm, 2mm, 2.5mm, and 3mm are simulated. The dataset comprising the steady, spatial fields of solute concentration, velocity, and density near each spacer is placed in the folder corresponding to the spacer configuration considered. We run two sets of CFD simulations and include the outputs from both sets for each configuration: (1) with a coarser mesh, producing low-resolution (LR) data of spatial resolution 20x20, and (2) with a finer mesh, producing high-resolution (HR) data of spatial resolution 100x100. These data points can be treated as images with the quantities of interest as their channels and can be used to train machine learning models to learn a mapping from the LR images as inputs to the HR images as outputs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

BiRD (BioReactorDesign) [SWR-24-35]

Numerical simulations can accelerate scale up and optimization of bioreactors. This project provides a toolbox to facilitate such numerical simulations in OpenFOAM. The tool box contains 1) mesh generations tools for several typical bio reactor types in OpenFOAM 2) Inverse modeling tools to calibrate models using available experimental data 3) post processing tools that accelerate and streamline the analysis of the numerical simulations.

Hassanaly, Malik↗

The Pele Simulation Suite for Reacting Flows at Exascale

In this work, we present the Pele suite of software tools for compressible and incompressible reacting flows. The Pele suite leverages several different libraries, notably AMReX and SUNDIALS, to achieve performance portability on heterogeneous computing architectures across the supercomputing landscape. The Pele suite is comprised of PeleC, a compressible reacting flow block-structured adaptive mesh refinement solver, PeleLMeX, a low-Mach number reacting flow block-structured adaptive mesh refinement solver, Pele-Physics, a library for transport, thermodynamics, finite rate chemistry, soot, spray and radiation physics. The objective of this paper is (i) to present the code development efforts necessary to achieve highly effective and scalable applications for exascale machines and (ii) to detail the performance results of the Combustion-Pele project applications on Oak Ridge National Laboratory's Frontier. We show good weak and strong scaling results for both PeleC and PeleLMeX up to more than 50 billion cells on more than 4096 Frontier graphics processing unit nodes. We also present a capability demonstration simulation of a dual-fuel pulse compression ignition engine (six adaptive mesh refinement levels, and 60 billion cells or 2.1 trillion degrees of freedom) on Frontier, to date one of the largest simulations performed on the first exascale-class supercomputer.

adaptive mesh refinement↗

Adaptive Mesh Refinement Simulations for Turbulent Reacting Flow

With the increased availability of exascale computing hardware, detailed simulations of realistic devices can be performed at practically relevant time and length scales. Insights into the multiscale driving mechanisms in compressible reacting flow systems with complex geometry, such as combustors, can be used for design optimization and technology improvements. However, to effectively perform these simulations, advanced numerical algorithms must be used to maintain solution accuracy without incurring undue computational costs. PeleC, part of the Pele suite of codes, leverages block-structured adaptive mesh refinement (AMR) through the AMReX library to capture fine-scale flow features in compressible reacting flows. In this talk, we discuss recent improvements to the numerical algorithms, particularly in regard to describing flows at complex boundary structures, and PeleC's performance on exascale computing hardware. We will demonstrate that PeleC is well-suited for modern, extreme-scale, heterogenous compute platforms.

combustion↗

1D Simulation of Avalanche to Streamer to Spark Transition of Plasma Discharge in Ammonia-Air Combustion

The backward problem of plasma assisted combustion emphasizes evaluating the effect of the evolving thermochemical state on the plasma discharge. This paper investigates the dependence of avalanche to streamer to spark formation dynamics and kinetics on the gas composition and temperature at different points in an ammonia-air premixed laminar flame using a self-consistent multigrid-based 1D plasma solver. Different values of ..alpha.., the coefficient for effective ionization events per unit length, have been reported for electron avalanches in air and stoichiometric NH3-air mixtures. The streamer inception has been shown to obey the Meek's criterion. An exponential reduction in streamer and spark formation time has been observed from plasma simulations at different points in the unburnt, pre-heat zone, reaction zone and the fully burnt regions of the premixed flame. While the enhancement of the reduced electric field with increasing temperature affects effective ionization, there exists a minimum breakdown field for streamer formation, which does not vary proportionally with the changing number density of the gas. The change in the mixture from reactants (NH3, O2, N2) to products of complete combustion of ammonia in air (N2, H2O) has also been shown to affect the streamer and spark formation. Finally, the major pathways during the streamer and spark phases which are responsible for producing important radicals used in combustion of NH3 are also discussed.

ADVANCED PROPULSION SYSTEMS,INORGANIC, ORGANIC, PH↗

Multiphysics Computational Fluid Dynamics for Design and Scale-Up of CO 2 /Syngas Bioreactors [Poster]

What are we trying to do? Develop validated, high fidelity computational models for gas fermentation using CO 2 , CO and H 2 . How is it done today? Microbiological advances are made at the lab scale in well mixed reactors. Process scale-up remains an open question when considering novel microorganisms/reaction systems. Why is this important? Lab-to-production scale transition is required to achieve CO 2 conversion at Mton/Gton scale and computational models can de-risk/accelerate this transition.

09 BIOMASS FUELS↗

Optimization of Hydrogen Production from Pyrolysis of Biomass Waste [Poster]

We developed an CFD aided ML-based tool for rapid assessment and optimization of different compositions of biomass in a fluidized bed reactor. First, we use CFD to simulate fluidized bed reactors with known inlet biomass mixtures and obtain corresponding syngas yields. A lumped kinetic mechanisms represents the conversion of cellulose, hemicellulose, and lignin, as well as subsequent cracking of tars into non-condensable gases (H 2 , CO, CO 2 , CH 4 ). We use Bayesian analysis/optimization to obtain the ideal operational and mass flow conditions for hydrogen production.

08 HYDROGEN↗

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) [SWR-23-37]

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) is an open-source computational fluid dynamics package powered by the lattice Boltzmann equations and built on AMReX. In the lattice Boltzmann method, local collisions between meso-scale fictitious particles drive the governing equations which enables MARBLES to easily simulate flow around complex and/or moving geometry without the generation of a body-conforming mesh. Using AMReX data structures and operations ensures a high level of computational performance and parallel scaling on heterogenous architectures while also naturally supporting locally enhanced grid resolution and fidelity through automatic mesh refinement. New domains and problem definitions are easily specified through an input file with examples and guidance on all options and variables provided in the MARBLES documentation.

Henry de Frahan, Marc↗

Simulating Catalysis with Realistic Pellet Geometries Using Mesoflow: A Case Study of Catalytic Propane Dehydrogenation

We present a case study of catalytic propane dehydrogenation with our open-source multiphysics solver, Mesoflow. The solver was developed to simulate reactive flow coupled to heterogeneous catalytic reactions and deactivation in the context of complex, mesoscale geometry. The method leverages cartesian block-structured adaptive mesh refinement to capture realistic catalyst microstructural features acquired directly from X-ray computed tomography data. A kinetic model for propane dehydrogenation and catalyst deactivation was developed based on temporal analysis of products (TAP) reactor experiments. The TAP reactor experiments allow for precise characterization of intrinsic kinetic reaction steps which are implemented into Mesoflow simulations to model the spatial and temporal evolution of reactants, products, and catalyst active sites. The short-term and long-term deactivation behavior is studied by using XCT data collected from fresh and aged catalyst pellets, which exhibit different microstructural features. This study employs time-splitting algorithms to connect disparate reaction and flow timescales, enabling the simulations to achieve realistic deactivation timescales on the order of minutes while the flow time-scales for small particles (100 microns) are several milliseconds. We also introduce a flexible automated python script that writes the necessary files to construct a Mesoflow simulation from user-created chemical mechanisms. We will also introduce a few new features that are added to Mesoflow such as higher order schemes, implicit chemistry integrators and the ability to run on AMD and NVIDIA graphics-processing-units.

AMReX↗

Simulation of Reverse Osmosis Membrane Compaction Using Material Point Method

Reverse Osmosis (RO) is a promising technology to address the impending water-crisis in the upcoming decades. RO at high salinities and high pressures is challenging due to membrane compaction that changes its porosity and permeability. In this study, we present a simulation methodology for membrane structural mechanics to understand pore size distribution and permeability variations under high pressure. We use the material point method (MPM), that solves the solid mechanics equations in a Lagrangian framework. MPM provides many features that make it well-suited for simulating mesoporous membranes. The Lagrangian framework allows for large deformations, easy integration of constitutive models and direct import of complex geometries as particles. The spatial discretization in our MPM solver is achieved using linear or cubic-spline shape functions while the time integration is carried out using the explicit Euler method. A series of images containing detailed pore structures obtained from X-ray tomography is first converted to a collection of material points. Compressive loads are applied to the top layer of the membrane to simulate the application of pressure. The membrane deformation and pore size distribution before and after load application are reported and compared with the experimental measurements. The presentation discusses the numerical methods used, the performance of the solver on high-performance computing machines, and the results of membrane compact in detail.

compaction↗