Search NASA⌕ Search

Engineering topics

Pankajakshan, Ramesh

Publications and source records attributed to Pankajakshan, Ramesh.

13 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Transformational Regional-Scale Earthquake Simulations with the DOE EarthQuake SIMulation Exascale Framework

Earthquakes present worldwide risk to economic and human safety. The 2023 earthquakes in Turkiye provided a reminder of the potential for catastrophic consequences with 50,700 deaths and 15.7 million people affected. The ability to predict ground motions and infrastructure damage for earthquakes continues to be a challenging problem for scientists and engineers. Until now, estimates of ground motions have been performed empirically by looking at sparse data from past earthquakes. This approach can provide statistical information on intensity amplitudes but cannot inform site-specific ground motions essential to developing the most effective resilience. Interest has grown in large-scale computational models to simulate earthquakes at regional scale. The U.S. Department of Energy EarthQuake SIMulation (EQSIM) framework was developed for regional-scale earthquake simulations at unprecedented fidelity, taking advantage of emerging GPU-accelerated systems. This article describes the EQSIM workflow and demonstrates regional-scale simulations with the new computational capability available to scientists in their quest to mitigate future disasters.

58 GEOSCIENCES↗
DOE OSTI2024

Regional-scale fault-to-structure earthquake simulations with the EQSIM framework: Workflow maturation and computational performance on GPU-accelerated exascale platforms

Continuous advancements in scientific and engineering understanding of earthquake phenomena, combined with the associated development of representative physics-based models, is providing a foundation for high-performance, fault-to-structure earthquake simulations. However, regional-scale applications of high-performance models have been challenged by the computational requirements at the resolutions required for engineering risk assessments. The EarthQuake SIMulation (EQSIM) framework, a software application development under the US Department of Energy (DOE) Exascale Computing Project, is focused on overcoming the existing computational barriers and enabling routine regional-scale simulations at resolutions relevant to a breadth of engineered systems. This multidisciplinary software development—drawing upon expertise in geophysics, engineering, applied math and computer science—is preparing the advanced computational workflow necessary to fully exploit the DOE’s exaflop computer platforms coming online in the 2023 to 2024 timeframe. Achievement of the computational performance required for high-resolution regional models containing upward of hundreds of billions to trillions of model grid points requires numerical efficiency in every phase of a regional simulation. This includes run time start-up and regional model generation, effective distribution of the computational workload across thousands of computer nodes, efficient coupling of regional geophysics and local engineering models, and application-tailored highly efficient transfer, storage, and interrogation of very large volumes of simulation data. This article summarizes the most recent advancements and refinements incorporated in the workflow design for the EQSIM integrated fault-to-structure framework, which are based on extensive numerical testing across multiple graphics processing unit (GPU)-accelerated platforms, and demonstrates the computational performance achieved on the world’s first exaflop computer platform through representative regional-scale earthquake simulations for the San Francisco Bay Area in California, USA.

58 GEOSCIENCES↗
DOE OSTI2021

SW4 Curvilinear Kernels

Five computationally expensive stencil evaluation routines from SW4(https://github.com/geodynamics/sw4 GPL license) have been extracted and packaged with a driver to create a mini-app for evaluating compiler and GPU performance. The kernels can executed on AMD and Nvidia GPUs with and without RAJA. The kernel driver generates synthetic inputs, checks for correctness and measures kernel run times.

Pankajakshan, Ramesh↗
DOE OSTI2020

Regional-Scale 3D Ground-Motion Simulations of M w 7 Earthquakes on the Hayward Fault, Northern California Resolving Frequencies 0–10 Hz and Including Site-Response Corrections

Large earthquake ground-motion simulations in 3D Earth models provide constraints on site-specific shaking intensities but have suffered from limited frequency resolution and ignored site response in soft soils. In this work we report new regional-scale 3D simulations for moment magnitude 7.0 scenario earthquakes on the Hayward Fault, northern California with SW4. Simulations resolved significantly broader band frequencies (0–10 Hz) than previous studies and represent the highest resolution simulations for any such earthquake to date. Seismic waves were excited by a kinematic rupture following Graves and Pitarka (2016) and obeyed wave propagation in a 3D Earth model with topography from the U.S. Geological Survey (USGS) assuming a minimum shear wavespeed, VSmin, of 500 m/s. We corrected motions for linear and nonlinear site response for the shear wavespeed, VS, from the USGS 3D model, using a recently developed ground-motion model (GMM) for Fourier amplitude spectra . At soft soil locations subjected to strong shaking, the site-corrected intensities reflect the competing effects of linear amplification by low V S material, reduction of stiffness during nonlinear deformation, and damping of high frequencies. Sites with near-surface V S of 500 m/s or greater require no linear site correction but can experience amplitude reduction due to nonlinear response. Averaged over all sites, we obtained reasonable agreement with empirical ergodic median GMMs currently used for seismic hazard and design ground motions (epsilon less than 1), with marked improvement at soft sedimentary sites. At specific locations, the simulated shaking intensities show systematic differences from the GMMs that reveal path and site effects not captured in these ergodic models. Results suggest how next generation regional-scale earthquake simulations can provide higher spatial and frequency resolution while including effects of soft soils that are commonly ignored in scenario earthquake ground-motion simulations.

58 GEOSCIENCES↗
DOE OSTI2019

Sierra Center of Excellence: Lessons Learned

The introduction of heterogeneous computing via GPUs from the Sierra architecture represented a significant shift in direction for computational science at Lawrence Livermore National Laboratory (LLNL), and therefore required significant preparation. Over the last five years, the Sierra Center of Excellence (CoE) has brought employees with specific expertise from IBM and NVIDIA together with LLNL in a concentrated effort to prepare applications, system software, and tools for the Sierra supercomputer. This article shares the process we applied for the CoE and documents lessons learned during the collaboration, with the hope that others will be able to learn from both our success and intermediate setbacks. We describe what we have found to work for the management of such a collaboration and best practices for algorithms and source code, system configuration and software stack, tools, and application performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Umpire: Application-Focused Management and Coordination of Complex Hierarchical Memory

Advanced architectures like Sierra provide a wide range of memory resources that must often be carefully controlled by the user. These resources have varying capacities, access timing rules, and visibility to different compute resources. Applications must intelligently allocate data in these spaces, and depending on the total amount of memory required, applications may also be forced to move data between different parts of the memory hierarchy. Finally, applications using multiple packages must coordinate effectively to ensure that each package can use the memory resources it needs. To address these challenges, we present Umpire, an application-oriented library for managing memory resources. Specifically, Umpire provides support for querying memory resources, provisioning and allocating memory, and memory introspection. It allows computer scientists and computational physicists to efficiently program the memory hierarchies of current and future high-performance computing architectures, without tying their application to specific hardware or software. In this paper, we describe the design and implementation of Umpire and present case studies from the integration of Umpire into applications that are currently running on Sierra.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

An evaluation of the CORAL interconnects

The US Department of Energy deployed the Summit and Sierra supercomputers with the latest state-of-the-art network interconnect technology in 2018 and both systems entered production in 2019. In this paper, we provide an in-depth assessment of the systems' network interconnects that are based on Enhanced Data Rate (EDR) 100 Gb/s Mellanox InfiniBand. Both systems use second-generation EDR Host Channel Adapters (HCAs) and switches with several new features such as Adaptive Routing (AR), switch-based collectives, and HCA-based tag matching. Although based on the same components, Summit's network is "non-blocking" (i.e., a fully provisioned Clos network) and Sierra's network has a 2:1 taper between the racks and aggregation switches. We evaluate the two systems' interconnects using traditional communication benchmarks as well as production applications. We find that the new Adaptive Routing dramatically improves performance but the other new features still need improvement.

Zimmer, Christopher↗
DOE OSTI2018

The Design, Deployment, and Evaluation of the CORAL Pre-Exascale Systems

CORAL, the Collaboration of Oak Ridge, Argonne and Livermore, is fielding two similar IBM systems, Summit and Sierra, with NVIDIA GPUs that will replace the existing Titan and Sequoia systems. Summit and Sierra are currently ranked No. 1 and No. 3, respectively on the Top500 list. We discuss the design and key differences of the systems. Our evaluation of the systems highlights the following. Applications that fit in HBM see the most benefit and may prefer more GPUs; however, for some applications, the CPU-GPU bandwidth is more important than the number of GPUs. The node-local burst buffer scales linearly, and can achieve a 4X improvement over the parallel file system for large jobs; smaller jobs, however, may benefit from writing directly to the PFS. Finally, several CPU, network and memory bound analytics and GPU-bound deep learning codes achieve up to a 11X and 79X speedup/node, respectively over Titan.

Vazhkudai, Sudharshan↗
DOE OSTI2018

Sierra Advances Resolution of Hayward Fault Earthquake Simulations

The character of strong earthquake shaking within a few kilometers of a fault is highly variable and poorly constrained by relatively few empirical recordings. Supercomputers enable simulation of earthquake motions to investigate the hazard and risk to buildings and infrastructure before damaging events occur. However, they require meter scale resolution to capture fine details in high frequency waves (5 - 10 Hz) on regional scales (~ 100 km).

58 GEOSCIENCES↗
NASA NTRS1994

Propulsion/airframe interference for ducted propfan engines with ground effect

The advanced propfan propulsion systems design of the next-generation subsonic transport aircraft has been of interest to many airline companies in the past several years. This is due to the studies which indicate that an efficient ducted propfan engine technology offers a significant reduction in aircraft fuel consumption. However, because of the geometric complexity of the configuration, one challenge is the integration of the ducted propfan engine with the airframe so that aerodynamic interference effects frequently encountered near the nacelle can be minimized, or perhaps, optimized. To understand this interaction phenomenon better, it is desirable to have a reliable and efficient computational tool that can predict propeller effects on the flowfield around complex configurations.

Arabshahi, Abdollah↗
NASA NTRS1993

Turbofan flowfield simulation using Euler equations with body forces

A method for flow computations around ducted propfans is presented. The approach is to use the body force terms in the three-dimensional Euler equations to model the propeller. Numerical solutions are compared with experimental data for three ducted propfan configurations for different flow conditions.

Pankajakshan, Ramesh↗