Search NASA⌕ Search

Engineering topics

Davis, Philip

Publications and source records attributed to Davis, Philip.

Optimizing Data Movement for GPU-Based In-Situ Workflow Using GPUDirect RDMA

The extreme-scale computing landscape is increasingly dominated by GPU-accelerated systems. At the same time, in-situ workflows that employ memory-to-memory inter-application data exchanges have emerged as an effective approach for leveraging these extreme-scale systems. In the case of GPUs, GPUDirect RDMA enables third-party devices, such as network interface cards, to access GPU memory directly and has been adopted for intra-application communications across GPUs. In this paper, we present an interoperable framework for GPU-based in-situ workflows that optimizes data movement using GPUDirect RDMA. Specifically, we analyze the characteristics of the possible data movement pathways between GPUs from an in-situ workflow perspective, and design a strategy that maximizes throughput. Furthermore, we implement this approach as an extension of the DataSpaces data staging service, and experimentally evaluate its performance and scalability on a current leadership GPU cluster. The performance results show that the proposed design reduces data-movement time by up to 53% and 40% for the sender and receiver, respectively, and maintains excellent scalability for up to 256 GPUs.

Zhang, Bo↗

Organizing Large Data Sets for Efficient Analyses on HPC Systems

Upcoming exascale applications could introduce significant data management challenges due to their large sizes, dynamic work distribution, and involvement of accelerators such as graphical processing units, GPUs. In this work, we explore the performance of reading and writing operations involving one such scientific application on two different supercomputers. Our tests showed that the Adaptable Input and Output System, ADIOS, was able to achieve speeds over 1TB/s, a significant fraction of the peak I/O performance on Summit. We also demonstrated the querying functionality in ADIOS could effectively support common selective data analysis operations, such as conditional histograms. In tests, this query mechanism was able to reduce the execution time by a factor of five. More importantly, ADIOS data management framework allows us to achieve these performance improvements with only a minimal amount of coding effort.

Gu, Junmin↗

ornladios/ADIOS2

ADIOS 2: The Adaptable Input Output (I/O) System version 2 is an open-source framework that addresses scientific data management challenges, e.g. scalable parallel I/O, as we approach the exascale era in high-performance computing (HPC). ADIOS 2 bindings are available in C++, C, Fortran, Python and can be used on supercomputers, personal computers, and cloud systems running on Linux, macOS and Windows. ADIOS 2 has out-of-the-box support for MPI and serial environments.

ECP↗

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2

This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.

Poeschel, Franz↗

CoREC: Scalable and Resilient In-memory Data Staging for In-situ Workflows

The dramatic increase in the scale of current and planned high-end HPC systems is leading new challenges, such as the growing costs of data movement and IO, and the reduced mean time between failures (MTBF) of system components. In-situ workflows, i.e., executing the entire application workflows on the HPC system, have emerged as an attractive approach to address data-related challenges by moving computations closer to the data, and staging-based frameworks have been effectively used to support in-situ workflows at scale. However, the resilience of these staging-based solutions has not been addressed, and they remain susceptible to expensive data failures. Furthermore, naive use of data resilience techniques such as n-way replication and erasure codes can impact latency and/or result in significant storage overheads. In this article, we present CoREC, a scalable and resilient in-memory data staging runtime for large-scale in-situ workflows. CoREC uses a novel hybrid approach that combines dynamic replication with erasure coding based on data access patterns. It also leverages multiple levels of replications and erasure coding to support diverse data resiliency requirements. Furthermore, the article presents optimizations for load balancing and conflict-avoiding encoding, and a low overhead, lazy data recovery scheme. We have implemented the CoREC runtime and have deployed with the DataSpaces staging service on leadership class computing machines and present an experimental evaluation in the article. Here, the experiments demonstrate that CoREC can tolerate in-memory data failures while maintaining low latency and sustaining high overall storage efficiency at large scales.

97 MATHEMATICS AND COMPUTING↗

Coupling Exascale Multiphysics Applications: Methods and Lessons Learned

With the growing computational complexity of science and the complexity of new and emerging hardware, it is time to re-evaluate the traditional monolithic design of computational codes. One new paradigm is constructing larger scientific computational experiments from the coupling of multiple individual scientific applications, each targeting their own physics, characteristic lengths, and/or scales. We present a framework constructed by leveraging capabilities such as in-memory communications, workflow scheduling on HPC resources, and continuous performance monitoring. This code coupling capability is demonstrated by a fusion science scenario, where differences between the plasma at the edges and at the core of a device have different physical descriptions. This infrastructure not only enables the coupling of the physics components, but it also connects in situ or online analysis, compression, and visualization that accelerate the time between a run and the analysis of the science content. Results from runs on Titan and Cori are presented as a demonstration.

Choi, Jong Youl↗

Coupled CFD-Thermal Analysis of Erosion Patterns Resulting from Nozzle Wedgeouts on the SRTMV-N2

The objective of this analysis was to study the effects of the erosion patterns from the introduction of nozzle flaws machined into the nozzle of the SRTMV-N2 (Solid Rocket Test Motor V Nozzle 2). The SRTMV-N2 motor was a single segment static subscale solid rocket motor used to further develop the RSRMV (Redesigned Solid Rocket Motor V Segment). Two flaws or "wedgeouts" were placed in the nozzle inlet parallel to the ply angles of that section to study erosion effects. One wedgeout was placed in the nose cap region and the other placed in the inlet ring on the opposite side of the bondline, separated 180 degrees circumferentially. A coupled CFD (Computational Fluid Analysis)-thermal iterative analytical approach was utilized at the wedgeouts to analyze the erosion profile during the burn time. The iterative CFD thermal approach was applied at five second intervals throughout the motor burn. The coupled fluid thermal boundary conditions were derived from a steady state CFD solution at the beginning of the interval. The derived heat fluxes were then applied along the surface and a transient thermal solution was developed to characterize the material response over the specified interval. Eroded profiles of each of the nozzle's wedgeouts and the original contour were created at each of the specified intervals. The final iteration of the erosion profile showed that both wedgeouts were "washedout," indicating that the erosion profile of the wedgeout had rejoined the original eroded contour, leaving no trace of the wedgeouts post fire. This analytical assessment agreed with post-fire observations made of the SRTMV-N2 wedgeouts, which noted a smooth eroded contour.

Ables, Catherine↗

Vortex Shedding Inside a Baffled Air Duct

Common in the operation of both segmented and un-segmented large solid rocket motors is the occurrence of vortex shedding within the motor chamber. A portion of the energy within a shed vortex is converted to acoustic energy, potentially driving the longitudinal acoustic modes of the motor in a quasi-discrete fashion. This vortex shedding-acoustic mode excitation event occurs for every Reusable Solid Rocket Motor (RSRM) operation, giving rise to subsequent axial thrust oscillations. In order to better understand this vortex shedding/acoustic mode excitation phenomena, unsteady CFD simulations were run for both a test geometry and the full scale RSRM geometry. This paper covers the results from the subscale geometry runs, which were based on work focusing on the RSRM hydrodynamics. Unsteady CFD simulation parameters, including boundary conditions and post-processing returns, are reviewed. The results were further post-processed to identify active acoustic modes and vortex shedding characteristics. Probable locations for acoustic energy generation, and subsequent acoustic mode excitation, are discussed.

Davis, Philip↗

Consideration of dynamic loads on the vertical tail by the theory of flat yawing maneuvers

Dynamic yawing effects on vertical tail loads are considered by a theory of flat yawing maneuvers. A comparison is shown between computed loads and the loads measured in flight in a fighter airplane. The dynamic effects were investigated on a large flying boat for both an abrupt rudder deflection and a sinusoidal rudder deflection. Only a moderate amount of control deflection was found to be necessary to attain the ultimate design load on the tail. In order to take into account dynamic effects in design, specifications of yawing maneuverability or control movement are needed.

Boshar, John↗

Consideration of dynamic loads on the vertical tail by the theory of flat yawing maneuvers

Dynamic yawing effects on vertical-tail loads are considered by a theory of flat yawing maneuvers. A comparison is shown between computed loads and the loads measured in flight on a fighter airplane. The dynamic effects were investigated on a large flying boat for both an abrupt rudder deflection and sinusoidal rudder deflection. Only a moderate amount of control deflection was found to be necessary to attain the ultimate design load on the tail. In order to take into account dynamic effects in design, specifications of yawing maneuverability or control movement are needed.

Boshar, John↗