Search NASA⌕ Search

SEARCH · Search NASA

Results for “granular systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Catalytic ignition of hydrogen/oxygen

An experimental program was conducted to evaluate the catalytic ignition of gaseous hydrogen and oxygen. Shell 405 granular catalyst and a unique monolithic sponge catalyst were tested. Mixture ratio, mass flow rate, propellant inlet temperature, and back pressure were varied parametrically in testing to determine the operational limits of a catalytic igniter. The test results showed that the gaseous hydrogen/oxygen propellant combination can be ignited catalytically using Shell 405 catalyst over a wide range of mixture ratios, mass flow rates, and propellant injection temperatures. These operating conditions must be optimized to ensure reliable ignition for an extended period of time. The results of the experimental program and the established operational limits for a catalytic igniter using both the granular and monolithic catalysts are presented. The capabilities of a facility constructed to conduct the igniter testing and the advantages of a catalytic igniter over other ignition systems for gaseous hydrogen and oxygen are also discussed.

Green, James M.↗

Viscosity and thermal fields associated with strongly chaotic non-Newtonian thermal convection

The thermomechanical structure is investigated in strongly chaotic non-Newtonian thermal convection for both base-heated and internally-heated systems. Temperature can build up in stagnant regions and a non-Newtonian mantle can tolerate less internal heating. Viscosity fields of the strongly chaotic regime show a granular structure. The horizontal spectra of viscosity fluctuations obey a power-law and yield a fractal dimension of 1.6 to 1.8 for the isoviscosity lines, providing evidence for 2D turbulence. Long-wavelength viscosity variations are smoothed out by the turbulent non-Newtonian flows.

Malevsky, A. V.↗

An Overview of the Circular Economy Lifecycle Assessment and VIsualization (CELAVI) Framework

A circular economy emphasizes the efficient use of all resources (e.g., materials, land, water). Despite anticipated overall benefits to society, the transition to a circular economy is likely to create regional differences in impacts. Current tools are unable to fully evaluate these potential externalities, which will be important for informing research prioritization and regional decision making. This presentation will review and contrast nine current impact assessment methods and describe their granularity, scope, data requirements, and capabilities within the context of identifying regional and sectoral transfers of impacts that could result from transitioning to a circular economy for energy systems. The review of current approaches highlights the need for a new hybrid circularity assessment framework that leverages multiple methods. We describe one such approach: the Circular Economy Lifecycle Assessment and VIsualization (CELAVI) framework. CELAVI uses system dynamics to model material flows for multiple circular economy pathways, network theory to track the spatial and sectoral flow of functional units across a graph, and discrete event simulation to to step through time and evaluate lifecycle assessment data at each time step. The framework is designed to be flexible and scalable enough to accommodate multiple energy materials and multiple energy technologies. CELAVI's hybridization of multiple existing methods yields additional capabilities, which may help answer questions about how flows between the technosphere and ecosphere may evolve if the circularity of energy systems is modified.

circular economy↗

Initial Demonstration of the Real-Time Safety Monitoring Framework for the National Airspace System Using Flight Data

As new operational paradigms and additional aircraft are being introduced into the National Airspace System (NAS), maintaining safety in such a rapidly growing environment becomes more challenging. It is therefore desirable to have an automated framework to provide an overview of the current safety of the airspace at different levels of granularity, as well an understanding of how the state of the safety will evolve into the future given the anticipated flight plans, weather forecast, predicted health of assets in the airspace, and so on. Towards this end, as part of our earlier work, we formulated the Real-Time Safety Monitoring (RTSM) framework for monitoring and predicting the state of safety and to predict unsafe events. In our previous work, the RTSM framework was demonstrated in simulation on three different constructed scenarios. In this paper, we further develop the framework and demonstrate it on real flight data from multiple data sources. Specifically, the flight data is obtained through the Shadow Mode Assessment using Realistic Technologies for the National Airspace System (SMART-NAS) Testbed that serves as a central point of collection, integration, and access of information from these different data sources. By testing and evaluating using real-world scenarios, we may accelerate the acceptance of the RTSM framework towards deployment. In this paper we demonstrate the framework's capability to not only estimate the state of safety in the NAS, but predict the time and location of unsafe events such as a loss of separation between two aircraft, or an aircraft encountering convective weather. The experimental results highlight the capability of the approach, and the kind of information that can be provided to operators to improve their situational awareness in the context of safety.

Real-time Safety Monitoring↗

Cohesive phase-field chemo-mechanical simulations of inter- and trans- granular fractures in polycrystalline NMC cathodes via image-based 3D reconstruction

The optimal design and durable utilization of lithium-ion batteries necessitates an objective modeling approach to understand fracture and failure mechanisms. This paper presents a comprehensive chemo-mechanical modeling study focused on elucidating fracture-induced damage and degradation phenomena in the polycrystalline Li $\mathcal{x}$ Ni 0.5 Mn 0.3 Co 0.2 O 2 (NMC532) cathode. An innovative approach that utilizes image-based reconstructed 3D geometry as finite element (FE) mesh input is employed to enhance the precision in capturing the convoluted architecture and morphological features. For accurately representing the intricate crack configurations within the polycrystalline system, we adopted the cohesive phase-field fracture (CPF) model. Through the integration of advanced image-based geometry reconstruction technique and the promising CPF modeling approach, lithium (de)intercalation induced crack evolution (e.g., nucleation, propagation, branching and diverse modes including inter-/trans-(intra-) granular patterns) and the resulting chemical degradation can be precisely captured, which is also compared and validated with numerical predictions using a continuum damage model. In particular, this model predicts fracture induced degradation under varying fracture properties of grain boundaries and charging rates; the conclusion that NMC particles comprised of larger grains are predicted to have less degradation than those with smaller grains can also be drawn. This comprehensive analysis provides valuable insights into the fracture and degradation within polycrystalline NMC cathodes.

25 ENERGY STORAGE↗

In Situ Identification of Mineral Resources with an X-Ray-Optical "Hands-Lens" Instrument

The recognition of material resources on a planetary surface requires exploration strategies not dissimilar to those employed by early field geologists who searched for ore deposits primarily from surface clues. In order to determine the location of mineral ores or other materials, it will be necessary to characterize host terranes at regional or subregional scales. This requires geographically broad surveys in which statistically significant numbers of samples are rapidly scanned from a roving platform. To enable broad-scale, yet power-conservative planetary-surface exploration, we are developing an instrument that combines x-ray diffractometry (XRD), x-ray fluorescence spectrometry (XRF), and optical capabilities; the instrument can be deployed at the end of a rover's robotic arm, without the need for sample capture or preparation. The instrument provides XRD data for identification of mineral species and lithological types; diffractometry of minerals is conducted by ascertaining the characteristic lattice parameters or "d-spacings" of mineral compounds. D-spacings of 1.4 to 25 angstroms can be determined to include the large molecular structures of hydrated minerals such as clays. The XRF data will identify elements ranging from carbon (Atomic Number = 6) to elements as heavy as barium (Atomic Number = 56). While a sample is being x-rayed, the instrument simultaneously acquires an optical image of the sample surface at magnifications from lx to at least 50x (200x being feasible, depending on the sample surface). We believe that imaging the sample is extremely important as corroborative sample-identification data (the need for this capability having been illustrated by the experience of the Pathfinder rover). Very few geologists would rely on instrument data for sample identification without having seen the sample. Visual inspection provides critical recognition data such as texture, crystallinity, granularity, porosity, vesicularity, color, lustre, opacity, and so forth. These data can immediately distinguish sedimentary from igneous rocks, for example, and can thus eliminate geochemical or mineral ambiguities arising, say between arkose and granite. It would be important to know if the clay being analyzed was part of a uniform varve deposit laid down in a quiescent lake, or the matrix of a megabreccia diamictite deposited as a catastrophic impact ejecta blanket. The unique design of the instrument, which combines Debye-Scherrer geometry with elements of standard goniometry, negates the need for sample preparation of any kind, and thus negates the need for power-hungry and mechanically-complex sampling systems that would have to chip, crush, sieve, and mount the sample for x-ray analysis. Instead, the instrument is simply rested on the sample surface of interest (like a hand lens); the device can interrogate rough rock surfaces, coarse granular material, or fine rock flour. A breadboard version of the instrument has been deployed from the robotic arm of the Marsokhod rover in field trials at NASA Ames, where large vesicular boulders were x-rayed to demonstrate the functionality of the instrument design, and the ability of such a device to comply with constraints imposed by a roving platform. Currently under development is a flight prototype concept of this instrument that will weigh 0.3 kg, using about 4500 J of energy per sample analysis. It requires about 5 min. for XRD analysis, and about 30 min. for XRF interrogation. Its small mass and rugged design make it ideal for deployment on small rovers of the type currently envisaged for the exploration of Mars (e.g., Sojourner-scale platforms). The design utilizes a monolithic P-N junction photodiode pixel array for XRD, a Si PIN photodiode/avalanche photodiode system for XRF, and an endoscopic imaging camera system unobtrusively embedded between the detectors and the x-ray source (the endoscope with its board-mounted camera can be adapted for IR light in addition to visible wavelenths. A rugged, miniature (7 cu cm) x-ray source for the instrument has already been breadboarded.

Marshall, J.↗

Real-Time Safety Monitoring and Prediction for the National Airspace System

As new operational paradigms and additional aircraft are being introduced into the National Airspace System (NAS), maintaining safety in such a rapidly growing environment becomes more challenging. It is therefore desirable to have both an overview of the current safety of the airspace at different levels of granularity, as well an understanding of how the state of the safety will evolve into the future given the anticipated flight plans, weather forecasts, predicted health of assets in the airspace, and so on. To this end, we have developed a Real-Time Safety Monitoring (RTSM) that first, estimates the state of the NAS using the dynamic models. Then, given the state estimate and a probability distribution of future inputs to the NAS, the framework predicts the evolution of the NAS, i.e., the future state, and analyzes these future states to predict the occurrence of unsafe events. The entire probability distribution of airspace safety metrics is computed, not just point estimates, without significant assumptions regarding the distribution type and or parameters. We demonstrate our overall approach by predicting the occurrence of some unsafe events and show how these predictions evolve in time as flight operations progress.

National Airspace System↗

Prototype hardware design and testing of the global common module for the global trigger subsystem of the ATLAS phase-II upgrade

We report the High-Luminosity Large Hadron Collider (HL-LHC) will deliver more than ten times the integrated luminosity of the previous runs combined. Meeting its stricter throughput requirements poses new challenges to the Trigger and Data Acquisition (TDAQ) systems of the LHC experiments. Introduced in the framework of the ATLAS experiment’s HL upgrade, the Global Trigger (GT) is a new subsystem which will perform offline-like algorithms on full-granularity calorimeter data. The implementation of the GT’s functionality is firmware-focused and is composed of three layers: multiplexing (or data aggregating), global event processing, and demultiplexing interface to the central trigger processor. Each layer will be composed of several, similar nodes, hosted on replicas of identical hardware, the Global Common Module (GCM), an ATCA front board which is designed to be adopted throughout the entire GT subsystem. This article proceeds from the TWEPP 2021 conference and presents the GCM hardware design, performed in 2020, and focuses on some key results of its extensive testing performed in 2021.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Robustness of the smartpixels classifier for different simulated sensor geometries and non-ideal detector conditions

Pixel tracking detectors at upcoming collider experiments will see unprecedented charged-particle densities. Real-time data reduction on the detector will enable higher granularity and faster readout, possibly enabling the use of the pixel detector in high-rate online event selection, such as the ATLAS or CMS first-level trigger systems. This data reduction can be accomplished with a neural network (NN) in the readout chip bonded with the sensor that recognizes and rejects tracks with low transverse momentum (p T ) based on the geometrical shape of the charge deposition (“cluster”). To design viable detectors for deployment, the dependence of the NN as a function of the sensor geometry, external magnetic field, irradiation, and noise must be understood. In this paper, we present first studies of the efficiency and data reduction for planar pixel sensors exploring these parameters. For the CMS HL-LHC sensor geometry, we obtain a signal efficiency of (91.9 ± 0.7)% and a data reduction of (29.7 ± 1.0)%. A smaller sensor pitch in the bending direction improves the p T discrimination, but a larger pitch can be partially compensated with detector thickness. Any accumulated radiation damage also changes the cluster shape, reducing the signal efficiency compared to the baseline by approximately 30–60% in absolute terms, but nearly all of the performance can be recovered through retraining of the network and updating the weights. Finally, the impact of noise was investigated, and retraining the network on noise-injected datasets was found to maintain performance within 6% of the baseline network trained and evaluated on noiseless data. •ASIC-compatible track-momentum classifier is robust in realistic detector conditions.•About 90% signal efficiency and 30% data reduction per layer for CMS HL-LHC geometry.•Single-layer signal efficiency increases for smaller pixel pitch or thicker sensors.•Performance with noise or after radiation damage mostly recovered by retraining.

Shekar, Danush [Illinois U., Chicago] (ORCID:00000↗

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING↗

Monolithic Trace-Contaminant Sorbents Fabricated from 3D-Printed Polymer Precursors

The current trace-contaminant (TC) removal technology for use in Extravehicular Activities (EVAs) involves the use of a packed bed of acid-impregnated granular charcoal, which is difficult to regenerate. In this paper, results are presented on the development of vacuum-regenerable TC sorbents for use in the Portable Life Support System (PLSS). The sorbents are derived from 3D-printed polymer monoliths (e.g., honeycomb structures), which are then carbonized and activated in order to develop porosity, and also to enhance the TC-sorption capacity. Results are presented on the following aspects of carbon-sorbent development: (1) precursor selection; (2) monolith fabrication; (3) shape retention and strength; (4) carbon surface and porosity characterization; (5) TC-sorption capacity and vacuum-regeneration; (6) pressure drop; and (7) sub-scale sorbent prototype. The use of predominantly microporous monolithic carbon is associated with the following benefits: (a) high TC-sorption capacity; (b) low pressure drop; (c) rapid vacuum (pressure-swing) desorption due to thin monolith walls and low pressure drop; (d) good thermal management (high thermal conductivity and low adsorption/desorption thermal effects associated with physisorption); and (e) good resistance to dusty environments.

Portable Life Support System (PLSS)↗

Deformation accommodating periodic computational domain for a uniform velocity gradient

Many multiscale methods for granular materials use periodic computational domains to consider particle scale interactions and then calculate the stress to drive the continuum scale calculations. For problems involving large material deformations, the computation domain often needs to be reinitialized because of the distortion, causing the loss of the history information of the system. This work introduces an algorithm to accommodate a large deformation of the material while maintaining the computational domain cuboid to avoid the domain reinitialization during the computation. The algorithm uses a rotating frame of reference, in which the velocity gradient can be represented by an upper triangular matrix. The deformation caused by the upper triangular matrix is treated by the image system implied in the periodicity to maintain the computational domain cuboid. The effect from the rotation of the reference frame is considered using the inertial forces. Finally, simulations of simple and pure shear motions are carried out to illustrate the algorithm.

42 ENGINEERING↗

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗

Performance Analysis of PIConGPU: Particle-in-Cell on GPUs using NVIDIA’s NSight Systems and NSight Compute

PIConGPU, Particle In Cell on GPUs, is an open source simulations framework for plasma and laser-plasma physics used to develop advanced particle accelerators for radiation therapy of cancer, high energy physics and photon science. While PIConGPU has been optimized for at least 5 years to run well on NVIDIA GPU-based clusters, there has been limited exploration by the development team of potential scalability bottlenecks using recently updated and new tools including NVIDIA’s NVProf tool and the brand-new NVIDIA NSight Suite (Systems and Compute) tools. PIConGPU is a highly optimized application that runs production jobs at scale on a system Oak Ridge Leadership Facility’s (OLCF) Summit supercomputer (using the full machine at 4600 nodes; at 98% of GPU utilization on all ~28000 NVIDIA Volta GPUs). PIConGPU has been selected as one of the the eight applications for OLCF’s coveted Center for Accelerated Application Readiness (CAAR) program aimed at the facility’s Frontier supercomputer (OLCF’s first exascale system to launch in 2021), to partner with our vendors (primary vendors: AMD and Cray/HPE) ensuring that Frontier will be able to perform large-scale science when it opens to users in 2022. To this effect, performance engineers on the PIConGPU team wanted to dive deep into the application to understand at the finest granularity, which portions of the code could be further optimized to exploit the hardware on Summit at it’s maximum potential and also to elucidate which key kernels should be tracked and optimized for the CAAR effort to port this code to Frontier. Any bottlenecks that are observed via performance profiling on Summit are likely to also impact scalability on the Frontier-dev system and the Frontier Early Access (EA) system. Additionally, the engineers wanted to take a closer look at the newest NVIDIA profiling tools which allows us to identify the most useful features on these tools and will provide an opportunity to compare it to new AMD and Cray’s performance analysis tool releases and provide feedback to our vendor partners on what features are most important and mission critical for CAAR efforts. The primary goal of this report is to focus on the evaluation of PIConGPU’s most time-intensive kernels using NVProf and NSight Suite. Three kernels, Current Deposition (also known as Compute Current), Particle Push (Move and Mark), and Shift Particles are known to be some of the most time-consuming kernels in PIConGPU. The Current xi Deposition kernel and Particle Push kernel both set up the particle attributes for running any physics simulation with PIConGPU, so it is crucial to improve the performance of these two kernels. In this report, we measure single GPU metrics for the three kernels, offer high level takeaways from the conducted analysis, and compare the profiling data from NSight Compute to that of NVProf. This analysis was performed using a grid size of 240 x 272 x 224, and 10 time steps with the Mid-November Figure of Merit (FOM) run setup. The Traveling Wave Electron Acceleration (TWEAC) science case used in this run is a representative science case for PIConGPU. This execution can also be used for baseline analysis on AMD MI50/ MI60 systems. As of the time of writing, the PIConGPU application has limited use for features of NSight Systems, so this report will mainly focus on insights garnered from NSight Compute. For this analysis, we run the “full” metric set available in NSight Compute version 2020.1.2 and use NSight Systems version 2020.3.1 to generate the application timeline.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Leveraging 3D CAD and Virtual Reality in Design of the Calcine Disposition Project - 20512

Fluor Idaho's Calcine Disposition Project (CDP) is leveraging the power of three-dimensional (3D) visualization, light detection and ranging (Lidar), and virtual reality to improve designs and worker safety. With the use of computer-aided design (CAD) modeling software, the CDP has created 3D models of the facility and systems to aid in the design, development, and operation of its retrieval and transfer system. This by itself is nothing new and has been done in industry for years. The CDP project however is taking this a few steps farther with the use of Lidar and virtual reality software. The CRP is tasked with removing a radioactive granular material from stainless steel bins located in concrete vaults that were constructed in the late 1950's and early 1960's. While construction drawings are available, it is not certain that the drawings are as-built or how accurate they truly are. Part of the project requires precise placement of equipment on to bins around multiple pipe, electrical lines, and bin stiffeners. Relying solely on the existing drawings and models created from these drawings is highly risky and prone to failure. The first step to determine the precise location and orientation of all obstructions in the vault the project will use a Lidar system to scan the vault structure and precisely locate all vault and bin components. Once this information is obtained, the data will be integrated into the CAD model. The model will then be verified, and a true as-built model developed. Precise component location, size, and orientation will be used for final design and placement of retrieval components. The second step will be to take the verified 3D model and scan data and import it into virtual reality software creating a virtual world. While some work on the project requires all work to be completed remotely due to high radiation fields, some areas have low enough radiation levels that personnel can enter and perform work. With the use of a virtual reality headset, operators and technicians will be able to enter our virtual world and become familiar with the surroundings and perform work prior to ever entering the radiation environment. This training is expected to pay dividends by improving worker efficiency, reducing errors, and improving confidence that the work can be performed as expected. It will play a key aspect in as low as reasonably achievable (ALARA) principles. An additional aspect in using the Lidar scans and virtual environment, is that it will give engineers and managers an opportunity to revisit the facility, especially radiation areas, at any time to obtain design information and measurements that may be costly or impossible to obtain once the facility transitions into radiation operations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Continuum Correlations from CFD-DEM Modeling of Conduction Heat Transfer in Granular Flows

Heat transfer between a surface and flowing particles is analyzed to improve the accuracy of continuum models for wall-to-bed heat transfer in a fluidized bed. Discrete element modeling (DEM) is used to model a fluidized bed heat exchanger where heat enters the system through a heated wall. The DEM heat transfer predictions are validated against published experimental work (Brewster et al., 2024) with less than 15% error. In previous work by Morris et al. (2015), a continuum model was developed using data from high-fidelity DEM simulations of chute flows. In the current study, the continuum model is extended and validated for fluidized beds. The sensitivity of the continuum heat transfer model parameters, which was not quantified in previous studies, is also investigated. It is observed that for a given particle with specific properties, e.g. the particle size, roughness, and conduction lens radius, the continuum correlation developed for heat transfer from a heated boundary to the particle bed depends mainly on the solid fraction or porosity of the particle bed for a given fluid. The new continuum heat transfer model is then validated over a wide range of superficial velocities via comparisons to both discrete element and experimental data. It is shown that this correlation is valid for a large range of particle flow conditions from chute flows to fluidized beds with less than 10% error as compared to DEM predictions.

14 SOLAR ENERGY↗

Soft X-ray structure of the Coma cluster of galaxies

Results are reported for an observation of the Coma cluster with an imaging X-ray telescope system aboard a sounding rocket. A two-dimensional X-ray map of the cluster in the energy range from 0.15 to 2.0 keV is presented. The radial distribution, granularity, and ellipticity of the X-ray surface brightness are investigated, and the spectrum and flux within the field of view are analyzed. These properties are then examined quantitatively by comparing the observations with models through the use of a chi-squared test. It is found that: (1) no single galaxy contributes more than a few percent of the total X-ray flux of the Coma cluster; (2) the X-ray source is diffuse but granular on a scale of several arcmin, particularly in the central region; (3) the centroid of the X-ray source is at a local intensity minimum; and (4) the data are most consistent with an isothermal hydrostatic model.

Gorentstein, P.↗

Three practical workflow schedulers for easy maximum parallelism

Runtime scheduling and workflow systems are an increasingly popular algorithmic component in HPC because they allow full system utilization with relaxed synchronization requirements. There are so many special-purpose tools for task scheduling, one might wonder why more are needed. Use cases seen on the Summit supercomputer needed better integration with MPI and greater flexibility in job launch configurations. Preparation, execution, and analysis of computational chemistry simulations at the scale of tens of thousands of processors revealed three distinct workflow patterns. A separate job scheduler was implemented for each one using extremely simple and robust designs: file-based, task-list based, and bulk-synchronous. Comparing to existing methods shows unique benefits of this work, including simplicity of design, suitability for HPC centers, short startup time, and well-understood per-task overhead. All three new tools have been shown to scale to full utilization of Summit, and have been made publicly available with tests and documentation. This work presents a complete characterization of the minimum effective task granularity for efficient scheduler usage scenarios. Here, these schedulers have the same bottlenecks, and hence similar task granularities as those reported for existing tools following comparable paradigms.

97 MATHEMATICS AND COMPUTING↗