Search NASA⌕ Search

Engineering topics

Balakrishnan, Ramesh

Publications and source records attributed to Balakrishnan, Ramesh.

At least 19 records

FY22 Proxy App Suite Release

The FY22 Proxy App Suite Release milestone includes the following activities: Curate a collection of proxy applications that represents the breadth of ECP applications, including application domains, programming models, supporting libraries, numerical methods, etc. Identify gaps in coverage and work with application teams to commission or develop proxies to cover gaps. From within this collection, designate the ”ECP Proxy Application Suite” of 10–15 proxies that balance breadth of coverage with ease of use and quality of implementation. Also designate approximately 6–10 proxies to form the “ECP Machine Learning Proxy Suite”. The ML suite will represent algorithms, use cases, and programming methods typically used by ECP science workloads to incorporate machine learning into their workflows.

97 MATHEMATICS AND COMPUTING↗

GPU-accelerated DNS of compressible turbulent flows

Here, this paper explores strategies to transform an existing CPU-based high-performance computational fluid dynamics solver, HyPar, for compressible flow simulations on emerging exascale heterogeneous (CPU+GPU) computing platforms. The scientific motivation for developing a GPU-enhanced version of HyPar is to simulate canonical turbulent flows at the highest resolution possible on such platforms. We show that optimizing memory operations and thread blocks results in 200x speedup of computationally intensive kernels compared with a CPU core. Using multiple GPUs and CUDA-aware MPI communication, we demonstrate both strong and weak scaling of our GPU-based HyPar implementation on the NVIDIA Volta V100 GPUs. We simulate the decay of homogeneous isotropic turbulence in a triply periodic box on grids with up to 1024 3 points (5.3 billion degrees of freedom) and on up to 1,024 GPUs. We compare the wall times for CPU-only and CPU+GPU simulations. The results presented in the paper are obtained on the Summit and Lassen supercomputers at Oak Ridge and Lawrence Livermore National Laboratories, respectively.

97 MATHEMATICS AND COMPUTING↗

FY21 Proxy App Suite Release: Report for ECP Proxy App Project Milestone ADCD504-12

The FY21 Proxy App Suite Release milestone includes the following activities: Curate a collection of proxy applications that represents the breadth of ECP applications, including application domains, programming models, supporting libraries, numerical methods, etc. Identify gaps in coverage and work with application teams to commission or develop proxies to cover gaps. From within this collection, designate the "ECP Proxy Application Suite" of 12-15 proxies that balance breadth of coverage with ease of use and quality of implementation. Also designate approximately 8-10 proxies to form the \ECP Machine Learning Proxy Suite". The ML suite will represent algorithms, use cases, and programming methods typically used by ECP science workloads to incorporate machine learning into their workflows.

97 MATHEMATICS AND COMPUTING↗

A computational study of turbulent separated flow over a wall-mounted cube at two different Reynolds numbers and incoming velocity profiles

Simulations of the canonical wall-mounted unit cube subjected to two distinct incident velocity profiles is performed at Reynolds numbers (Re) where the bulk flow characteristics are known to become relatively Re-insensitive using both direct numerical simulation (DNS) and wall-resolved large eddy simulation (WRLES). The aim of this work is to highlight the sensitivity of such bluff-body flows to mean shear and to provide a representative set of data for such flow scenarios where common turbulence modeling techniques often fail. Simple boundary conditions are selected to allow for easy comparisons for model development purposes and avoid confounding effects from freestream turbulence. In addition to mean velocity profiles, select turbulence statistics are presented in detail. We find that both mean velocity profiles and mean wake turbulence are Re-insensitive over the range examined here.

42 ENGINEERING↗

A physics-informed data-driven low order model for the wind velocity deficit at the wake of isolated buildings

Detailed simulations of the Atmospheric boundary layer (ABL) provides information on wind velocity, direction and turbulence for optimizing the design of wind turbines and wind farms and their operations. Distributed wind turbines have been considered for use in urban or suburban areas for covering energy needs using a sustainable energy solution. Simulations of high Reynolds number turbulent ABL flows past obstacles can be used for the prediction of the velocity deficit and turbulence characteristics in the leeward side of building-like obstacles, allowing for the estimation of power losses and fatigue loads in wind turbines. However, fully three-dimensional simulations of high Reynolds number ABL flows using Large Eddy Simulation (LES) or Reynolds Average Navier-Stokes Simulations (RANS) continue to require large computational/ execution times. As a result, these 3D simulations may not be ideal tools for the rapid assessment of wind energy potential. In the present study, 3D numerical results from wall resolved RANS simulations were used for the development of a low order model that allows the rapid assessment of wind velocity and turbulence in the leeward side of an isolated building.

17 WIND ENERGY↗

Proxy App Suite Release (FY2020)

Version 4.0 of the ECP Proxy App Suite is practically unchanged from the previous release. The current set of proxies has proven useful for many aspects of benchmarking and co-design and we see little reason to alter the suite. Although there have been few changes to the ECP suite, the team has been hard at work in other areas. In the area of Machine Learning (ML) we have now created a separate proxy suite dedicated to this scientific applications of ML.

97 MATHEMATICS AND COMPUTING↗

FY20 Proxy App Suite Release: Report for ECP Proxy App Project Milestone ADCD-504-10

Version 4.0 of the ECP Proxy App Suite is practically unchanged from the previous release. The current set of proxies has proven useful for many aspects of benchmarking and co-design and we see little reason to alter the suite. Although there have been few changes to the ECP suite, the team has been hard at work in other areas. In the area of Machine Learning (ML) we have now created a separate proxy suite dedicated to this scientific applications of ML. The suite includes: miniGAN (Generative Adversarial Networks), miniRL (Reinforcement Learning), CRADL (inline inference), Cosmoflow-Benchmark (Convolutional Neural Network), and MLPerf-DeepCam (Climate Segmentation Benchmark). Section 3 contains more information about these proxies as well as the principles that are guiding the development of the suite. We have surveyed available proxies for several application domains including Computational Fluid Dynamics, Quantum Chemistry, Quantum Computing Simulation, Molecular Dynamics, Monte Carlo Transport, and Density Functional Theory to identify gaps in proxy coverage. Several new proxy apps are either already available or will be released soon to fill these gaps. Section 4 provides full details. Finally, section 5 reports on our continued collaboration with the ECP Continuous Integration (CI) effort to use proxy apps to help identify problems and roadblocks to cross-lab CI. We have also assisted the El Capitan Center of Excellence (COE) to stand up a CI system that will be used to test releases of HPE and AMD software stacks. We hope that the COE effort can serve as a model for ECP by showing how the Proxy App Team can work with AD and ST teams identify critical features, kernels, patterns, etc. and incorporate them into a CI system that will help ensure that Frontier and Aurora will provide those needed capabilities.

97 MATHEMATICS AND COMPUTING↗

Annular Flow Simulation Supported by Iterative In-Memory Mesh Adaptation

Various flow regimes exist in a boiling water reactor (BWR) as the steam quality increases in the uprising coolant flow, from bubbly flow, slug/churn flow, to annular flow. The annular flow is characterized by the presence of a fast-moving gas core and the surrounding liquid film flowing on the conduit wall. Additionally, entrained droplets can be observed in the gas core with ingested bubbles in the liquid film. The dynamics occurring on the wavy interface between the liquid film and gas core plays a crucial role in affecting the heat transfer rate and pressure drop within the BWR core. However, a fundamental understanding of annular flow is still lacking, partly due to the difficulty in obtaining detailed local data in annular flow experiments. In the current study, a novel simulation framework is developed for the annular flow by coupling a computational fluid dynamics flow solver with state-of-the-art meshing software. The gas-liquid interface is tracked with the level set method. Based on the computed flow solutions, the computational mesh is dynamically adapted in memory to meet the local mesh resolution requirement. This iterative simulation-adaptation framework can ensure the fine mesh resolution across the interface, which not only helps mitigate the mass conservation degradation known to level set methods but also improves the representation of dramatic interface topological changes such as wave breaking and droplet entrainment. The present investigation will shed light onto the complex interfacial processes involved in annular flow and generate much needed simulation data for annular flow modeling.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Toward Simulating Turbulent Wall-Bounded Flows at High Reynolds Numbers on Exascale Platforms

Given that wall resolved LES (WRLES) of high Reynolds number flows will continue to be intractable on even exascale computing platforms, there is considerable effort to make hybrid RANS/LES (HRLES) methods the tool of choice for predictive simulations of high-Re separated flows. The fidelity of HRLES depends on the ability of the subgrid model to account for the effects of the filtered scales on the resolved scales, and on the numerical schemes that are used to evolve the Navier-Stokes equations. While higher-order numerical schemes, with low dissipation/dispersion errors (and higher arithmetic intensity), are commonly used for canonical flow simulations (on simpler geometries), the bulk of the high-Re flow simulations on complex geometry still employ nominally second-order accurate schemes in structured/unstructured flow solvers. Hence, there is a need for better sub-grid models that can improve the predictive capability of both the higher-order flow solvers and existing second-order accurate flow solvers, for simulating turbulent separated flows. This talk is about ongoing efforts to develop HRLES subgrid models from DNS/WRLES simulations of canonical flows over curved and sharply discontinuous surfaces and their ability to predict high-Re flows on current petascale platforms.

Balakrishnan, Ramesh↗

Large-Eddy Simulation Sensitivities to Variations of Configuration and Forcing Parameters in Canonical Boundary-Layer Flows for Wind Energy Applications

Here, the sensitivities of idealized Large-Eddy Simulations (LES) to variations of model configuration and forcing parameters on quantities of interest to wind power applications are examined. Simulated wind speed, turbulent fluxes, spectra and cospectra are assessed in relation to variations of two physical factors, geostrophic wind speed and surface roughness length, and several model configuration choices, including mesh size and grid aspect ratio, turbulence model, and numerical discretization schemes, in three different code bases. Two case studies representing nearly steady neutral and convective atmospheric boundary layer (ABL) flow conditions over nearly flat and homogeneous terrain were used to force and assess idealized LES, using periodic lateral boundary conditions. Comparison with fast-response velocity measurements at five heights within the lowest 50 m indicates that most model configurations performed similarly overall, with differences between observed and predicted wind speed generally smaller than measurement variability. Simulations of convective conditions produced turbulence quantities and spectra that matched the observations well, while those of neutral simulations produced good predictions of stress, but smaller than observed magnitudes of turbulence kinetic energy, likely due to tower wakes influencing the measurements. While sensitivities to model configuration choices and variability in forcing can be considerable, idealized LES are shown to reliably reproduce quantities of interest to wind energy applications within the lower ABL during quasi-ideal, nearly steady neutral and convective conditions over nearly flat and homogeneous terrain.

17 WIND ENERGY↗

Large-eddy simulation sensitivities to variations of configuration and forcing parameters in canonical boundary-layer flows for wind energy applications

Abstract. The sensitivities of idealized large-eddy simulations (LESs) to variations of model configuration and forcing parameters on quantities of interest to wind power applications are examined. Simulated wind speed, turbulent fluxes, spectra and cospectra are assessed in relation to variations in two physical factors, geostrophic wind speed and surface roughness length, and several model configuration choices, including mesh size and grid aspect ratio, turbulence model, and numerical discretization schemes, in three different code bases. Two case studies representing nearly steady neutral and convective atmospheric boundary layer (ABL) flow conditions over nearly flat and homogeneous terrain were used to force and assess idealized LESs, using periodic lateral boundary conditions. Comparison with fast-response velocity measurements at 10 heights within the lowest 100 m indicates that most model configurations performed similarly overall, with differences between observed and predicted wind speed generally smaller than measurement variability. Simulations of convective conditions produced turbulence quantities and spectra that matched the observations well, while those of neutral simulations produced good predictions of stress, but smaller than observed magnitudes of turbulence kinetic energy, likely due to tower wakes influencing the measurements. While sensitivities to model configuration choices and variability in forcing can be considerable, idealized LESs are shown to reliably reproduce quantities of interest to wind energy applications within the lower ABL during quasi-ideal, nearly steady neutral and convective conditions over nearly flat and homogeneous terrain.

17 WIND ENERGY↗

Interface Tracking Investigation of Geometric Effects on the Bubbly Flow in PWR Subchannels

We report that absorbing heat from the fuel rod surface, water as coolant can undergo subcooled boiling within a pressurized water reactor (PWR) fuel rod bundle. Because of the buoyancy effect, the vapor bubbles generated will then rise along and interact with the subchannel geometries. Reliable prediction of bubble behavior is of immense importance to ensure safe and stable reactor operation. However, given a complex engineering system like a nuclear reactor, it is very challenging (if not impossible) to conduct high-resolution measurements to study bubbly flows under reactor operation conditions. The lack of a fundamental two-phase-flow database is hindering the development of accurate two-phase-flow models required in more advanced reactor designs. In response to this challenge, first-principles–based numerical simulations are emerging as an attractive alternative to produce a complementary data source along with experiments. Leveraged by the unprecedented computing power offered by state-of-the-art supercomputers, direct numerical simulation (DNS), coupled with interface tracking methods, is becoming a practical tool to investigate some of the most challenging engineering flow problems. In the presented research, turbulent bubbly flow is simulated via DNS in single PWR subchannel geometries with auxiliary structures (e.g., supporting spacer grid and mixing vanes). The geometric effects these structures exert on the bubbly flow are studied with both a conventional time-averaging approach and a novel dynamic bubble tracking method. Lastly, the new insights obtained will help inform better two-phase models that can contribute to safer and more efficient nuclear reactor systems.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Large-Scale Simulation of Brain Tissue, Blue Brain Project, EPFL

The initial version of this project described in the awarded proposal aimed at largely focusing on the evaluation of Intel KNL hardware and the development of new scientific use cases such as then eurorobotics and whole brain modeling. However, during the course of the project EPFL has been awarded a high impact INCITE project focused on the development of models to support brain plasticity which is considered as the key toward understanding memory. Considering this very prestigious opportunity a large part of our developments has been refocused on the development of methods to support the plasticity use case which is described in Annex 1 along with the awarded INCITE proposal.

60 APPLIED LIFE SCIENCES↗

Extreme Scale Unstructured Adaptive CFD: From Multiphase Flow to Aerodynamic Flow Control

Understanding the flow of fluid, either liquid or gas, through and around solid bodies has challenged man since the dawn of scientific inquiry. Many of the great minds of science and math have progressively built up a hierarchy of fluid models. This report is concerned with the computational modeling of turbulent flow around aerodynamic bodies such as planes and wind turbines. In this case, viscous effects near the solid bodies create very thin boundary layers that yield highly anisotropic (gradients normal to the surface may be 10^6 times larger than gradients along the surface) solutions to the governing non-linear partial differential equations (PDE); the Navier-Stokes equations. Furthermore, turbulent flows develop extremely broad ranges of length and time scales.This disparity motivates the use of discretization methods capable of employing adaptivity and implicit time integration. The combination of these features (non-linear, anisotropy, adaptivity, andimplicit) dramatically raise the complexity of the discretization, posing large challenges to efficient scalable parallel implementation. However, through careful design, the more complex algorithms can provide great reductions in computational cost relative to simpler methods (e.g., Cartesian grids with explicit time integration) that are easier to mate efficiently to hardware. In this report, we not only describe our approach but we also address the fact that while complex algorithms may never be as efficient flop-for-flop as simple methods, in the important measure of science-per-core-hour, they can still win big by making complex features like adaptivity and implicit methods as efficient and scalable as possible.

42 ENGINEERING↗

Free Energy Landscapes of Membrane Transport Proteins

Molecular dynamics (MD) is now a widespread tool for investigating biochemical and biomolecular systems, its prevalence, in no small part, being due to significant advances in computational hardware over the last few decades. Even non-experts can now routinely use MD for protein and nucleic acid structure refinement, studying conformational switching events, and investigating solvation effects due to ligand/drug binding. Nonetheless, the vast majority of simulations being done today utilize only rudimentary algorithmic approaches – so-called “brute force” MD – which only permit access to a small fraction of what the approach has to offer. This is largely because the core algorithm is simple, while advanced techniques can require everything from more sophisticated models and data structures to complicated on-the-fly analysis. A core goal of this early science project is to bring one such advanced MD approach into the broader arena of high-performance computing.In particular, the powerful method of constant-pH MD has long been a relegated to experienced users and specialized model systems. In this work we develop and implement a constant-pH MD algorithm in the NAMD simulation engine making it suitable for deployment on large-scale, next-generation supercomputers as well as ambitious, cutting-edge biological applications. We report,for the first time, constant-pH simulations of a membrane transport protein and use the results to analyze its free energy landscape for ion-selectivity.

59 BASIC BIOLOGICAL SCIENCES↗

Quantum Monte Carlo Calculations in Nuclear Theory

To a remarkable extent, atomic nuclei can be described as collections of point-like particles whose dynamics are dictated by a nonrelativistic Hamiltonian involving two- and three-nucleon potentials.Ab initio approaches are aimed at solving the many-body Schr$ \overline{o} $dinger equation associated with the nuclear Hamiltonian, which is a highly non-trivial problem because of the nonperturbative nature and the strong spin-isospin dependence of the nuclear forces. Within this framework it is possible to disentangle the theoretical uncertainty coming from modeling the nuclear potential and currents from that due to the approximations that are usually inherent in many-body techniques.Our many-body method of choice is quantum Monte Carlo (QMC), in particular Green’s function Monte Carlo (GFMC), which allows solving the nuclear Schrodinger equation with the required 1%accuracy level for both the ground- and the low-lying excited states of A ≤ 12 (A is the number of nucleons) nuclei. Since 2000 we have been achieving excellent agreement with experiment for nuclei with increasing number of nucleons by using the Argonne V18 two-nucleon interaction and the Illinois three-nucleon interactions (AV18+IL7). During this period many other groups have been developing chiral effective field theory (χEFT) potentials; these are generally nonlocal and notsuitable for QMC methods. We and collaborators have recently developed a local χEFT potential including the Δ-isobar degrees of freedom which can be used with QMC.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗