Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Improving Multi-Million Virtual Rank MPI Execution in

(MUPI) is a parallel discrete event simulator designed for enabling software-based experimentation via simulated execution across a range of synthetic to unmodified parallel programs using the Message Passing Interface (MPI) with millions of tasks. Here, we report work in progress in improving the efficiency of . Among the issues uncovered are the scaling problems with implementing barriers and intertask message ordering. Preliminary performance shows the possibility of supporting hundreds of virtual MPI ranks per real processor core. Performance improvements of at least 2 are observed, and enable execution of benchmark MPI runs with over 16 million virtual ranks synchronized in a discrete event fashion on as few as 16,128 real cores of a Cray XT5.

99 GENERAL AND MISCELLANEOUS↗

TEAM Project Review, Year 2

This report summarizes our research activities within the TEAM project between December 2020 and December 2021, funded by the ASCR Advanced Research in Quantum Computing program. During the reporting period the LLNL-MSU team has made progress on several fronts. An overarching goal of the team is to provide a comprehensive suite of software tools that can be used for the Characterize-Optimize-Compute loop needed to implement and execute algorithms on quantum devices. We are concurrently developing lightweight solvers that can be used on desktop computers to find optimal control pulses and to characterize small quantum systems (consisting of a few transmons and cavities). However, desktop computers are insufficient for simulating and characterizing larger quantum systems. We have therefore also developed parallel, distributed memory, simulators and optimization solvers, both for open and closed quantum systems. These parallel solvers have, for example, been used to study quantum optimal control for pure-state preparation, utilizing 1000’s of cores on a modern high-performance computing (HPC) platform.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Parallel implementation of three-dimensional molecular dynamic simulation for laser-cluster interaction

The objective of this article is to report the parallel implementation of the 3D molecular dynamic simulation code for laser-cluster interactions. The benchmarking of the code has been done by comparing the simulation results with some of the experiments reported in the literature. Scaling laws for the computational time is established by varying the number of processor cores and number of macroparticles used. The capabilities of the code are highlighted by implementing various diagnostic tools. To study the dynamics of the laser-cluster interactions, the executable version of the code is available from the author.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving the Performance of the Extreme-scale Simulator

Investigating the performance of parallel applications at scale on future high-performance computing (HPC) architectures and the performance impact of different architecture choices is an important component of HPC hardware/software co-design. The Extreme-scale Simulator (xSim) is a simulation-based toolkit for investigating the performance of parallel applications at scale. xSim scales to millions of simulated Message Passing Interface (MPI) processes. The overhead introduced by a simulation tool is an important performance and productivity aspect. This paper documents two improvements to xSim: (1) a new deadlock resolution protocol to reduce the parallel discrete event simulation management overhead and (2) a new simulated MPI message matching algorithm to reduce the oversubscription management overhead. The results clearly show a significant performance improvement, such as by reducing the simulation overhead for running the NAS Parallel Benchmark suite inside the simulator from 1,020\% to 238% for the conjugate gradient (CG) benchmark and from 102% to 0% for the embarrassingly parallel (EP) and benchmark, as well as, from 37,511% to 13,808% for CG and from 3,332% to 204% for EP with accurate process failure simulation.

Engelmann, Christian↗

A new deadlock resolution protocol and message matching algorithm for the extreme-scale simulator

Investigating the performance of parallel applications at scale on future high-performance computing (HPC) architectures and the performance impact of different HPC architecture choices is an important component of HPC hardware/software co-design. The Extreme-scale Simulator (xSim) is a simulation toolkit for investigating the performance of parallel applications at scale. xSim scales to millions of simulated Message Passing Interface (MPI) processes. The overhead introduced by a simulation tool is an important performance and productivity aspect. This paper documents two improvements to xSim: (1)~a new deadlock resolution protocol to reduce the parallel discrete event simulation overhead and (2)~a new simulated MPI message matching algorithm to reduce the oversubscription management overhead. The results clearly show a significant performance improvement. The simulation overhead for running the NAS Parallel Benchmark suite was reduced from 102% to 0% for the embarrassingly parallel (EP) benchmark and from 1,020% to 238% for the conjugate gradient (CG) benchmark. xSim offers a highly accurate simulation mode for better tracking of injected MPI process failures. Furthermore, with highly accurate simulation, the overhead was reduced from 3,332% to 204% for EP and from 37,511% to 13,808% for CG.

97 MATHEMATICS AND COMPUTING↗

Mechanisms of material removal and mass transport in focused ion beam nanopore formation

Despite the widespread use of focused ion beam (FIB) processing as a material removal method for applications ranging from electron microscope sample preparation to nanopore processing for DNA sequencing, the basic material removal mechanisms of FIB processing are not well understood. We present the first complete atomistic simulation of high-flux FIB using large-scale parallel molecular dynamics (MD) simulations of nanopore fabrication in freestanding thin films. We focus on the root mechanisms of material removal and rearrangement and describe the role of explosive boiling in forming nanopores. FIB nanopore fabrication is typically understood to occur via sputter erosion. This can be shown to be the case in low flux systems, where individual ion impacts are sufficiently separated in time that they may be considered as independent events. But our detailed MD simulations show that in high flux FIB processing, above a threshold level at which thermal effects become significant, the primary mechanism of material removal changes to a significantly accelerated, thermally dominated process. Under these conditions, the target is heated by the ion beam faster than heat is conducted away by the material, leading quickly to melting, and then continued heating to nearly the material critical temperature. This leads to explosive boiling of the target material with spontaneous bubble formation and coalescence. Mass is rapidly rearranged at the atomistic scale, and material removal occurs orders of magnitude faster than would occur by simple sputtering. While the phenomenology is demonstrated computationally in silicon, it can be expected to occur at lower beam fluxes in other cases where thermal conduction is suppressed due to material properties, geometry, or ambient thermal conditions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Performance of GeantV EM Physics Models

The recent progress in parallel hardware architectures with deeper vector pipelines or many-cores technologies brings opportunities for HEP experiments to take advantage of SIMD and SIMT computing models. Launched in 2013, the GeantV project studies performance gains in propagating multiple particles in parallel, improving instruction throughput and data locality in HEP event simulation on modern parallel hardware architecture. Due to the complexity of geometry description and physics algorithms of a typical HEP application, performance analysis is indispensable in identifying factors limiting parallel execution. In this report, we will present design considerations and preliminary computing performance of GeantV physics models on coprocessors (Intel Xeon Phi and NVidia GPUs) as well as on mainstream CPUs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Parallel transport modeling of linear divertor simulators with fundamental ion cyclotron heating *

Abstract The Material Plasma Exposure eXperiment (MPEX) is a steady state linear device with the goal to perform plasma material interaction studies at future fusion reactor relevant conditions. A prototype of MPEX referred as ‘Proto-MPEX’ is designed to carry out research and development related to source, heating and transport concepts on the planned full MPEX device. The auxiliary heating schemes in MPEX are based on cyclotron resonance heating with radio frequency (RF) waves. Ion cyclotron heating (ICH) and electron cyclotron heating in MPEX are used to independently heat the ions and electrons and provide fusion divertor conditions ranging from sheath-limited to fully detached divertor regimes at a material target. A hybrid particle-in-cell code- PICOS++ is developed and applied to understand the plasma parallel transport during ICH in MPEX/Proto-MPEX to the target. With this tool, evolution of the distribution function of MPEX/Proto-MPEX ions is modeled in the presence of (a) Coulomb collisions, (b) volumetric particle sources and (c) quasi-linear RF-based ICH. The code is benchmarked against experimental data from Proto-MPEX and simulation data from B2.5 EIRENE. The experimental observation of ‘density-drop’ near the target in Proto-MPEX and MPEX during ICH is demonstrated and explained via physics-based arguments using PICOS++ modeling. In fact, the density drops at the target during ICH in Proto-MPEX/MPEX to conserve the flux and to compensate for the increased flow during ICH. Furthermore, sensitivity scans of various plasma parameters with respect to ICH power are performed for MPEX to investigate its role on plasma transport and particle and energy fluxes at the target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Parallel anisotropic mesh adaptation with boundary layers for automated viscous flow simulations

This paper presents a set of parallel procedures for anisotropic mesh adaptation accounting for mixed element types used in boundary layer meshes, i.e., the current procedures operate in parallel on distributed boundary layer meshes. The procedures accept anisotropic mesh metric field as an input for the desired mesh size field and apply local mesh modifications to adapt the mesh to match/satisfy the specified mesh size field. The procedures fully account for the parametric geometry of curved domains and maintain the semi-structured nature of the boundary layer elements. The effectiveness of the procedures is demonstrated on three viscous flow examples that include the ONERA M6 wing, a heat transfer manifold, and a scramjet engine.

Sahni, Onkar↗

Development of a Stiffness-Based Chemistry Load Balancing Scheme, and Optimization of Input/Output and Communication, to Enable Massively Parallel High-Fidelity Internal Combustion Engine Simulations

A closed-cycle gasoline compression ignition engine simulation near top dead center (TDC) was used to profile the performance of a parallel commercial engine computational fluid dynamics code, as it was scaled on up to 4096 cores of an IBM Blue Gene/Q supercomputer. The test case has 9 million cells near TDC, with a fixed mesh size of 0.15 mm, and was run on configurations ranging from 128 to 4096 cores. Profiling was done for a small duration of 0.11 crank angle degrees near TDC during ignition. Optimization of input/output performance resulted in a significant speedup in reading restart files, and in an over 100-times speedup in writing restart files and files for post-processing. Improvements to communication resulted in a 1400-times speedup in the mesh load balancing operation during initialization, on 4096 cores. An improved, “stiffness-based” algorithm for load balancing chemical kinetics calculations was developed, which results in an over 3-times faster run-time near ignition on 4096 cores relative to the original load balancing scheme. With this improvement to load balancing, the code achieves over 78% scaling efficiency on 2048 cores, and over 65% scaling efficiency on 4096 cores, relative to 256 cores.

CFD, Mira, Supercomputing, High Performance Comput↗

Application of parallel distributed Lagrange multiplier technique to simulate coupled Fluid-Granular flows in pipes with varying Cross-Sectional area

Fluid-granular flows are common phenomena in nature and industry. Here, an efficient computational technique based on the distributed Lagrange multiplier method is utilized to simulate complex fluid-granular flows. Each particle is explicitly resolved on an Eulerian grid as a separate domain, using solid volume fractions. The fluid equations are solved through the entire computational domain, however, Lagrange multiplier constrains are applied inside the particle domain such that the fluid within any volume associated with a solid particle moves as an incompressible rigid body. The particle–particle interactions are implemented using explicit force-displacement interactions for frictional inelastic particles similar to the DEM method with some modifications using the volume of an overlapping region as an input to the contact forces. Here, a parallel implementation of the method is based on the SAMRAI (Structured Adaptive Mesh Refinement Application Infrastructure) library.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Structural Simluation Toolkit (SST) V 2.0

The SST provides a parallel framework to perform system simulation of computer architectures to determine their performance and power consumption. Additionally, the SST contains basic models of a computer processor, and interconnect and can connect to an external memory simulator (DRAMSim II). The SST framework provides a simple interface by which other computer simulation models can be combined under a common parallel discrete event-based simulation environment. This allows design exploration of future architectures, analysis of how current computer programs will function on future architectures. The SST provides a parallel discrete event simulation framework, including partitioning and object distribution over MPI. It also provides a mechanism by which components can report their power consumption for analysis.

RODRIGUES, ARUN↗

Structural Simluation Toolkit (SST) v.11.0

The SST provides a parallel framework to perform system simulation of computer architectures to determine their performance and power consumption. Additionally, the SST contains basic models of a computer processor, and interconnect and can connect to an external memory simulator (DRAMSim II). The SST framework provides a simple interface by which other computer simulation models can be combined under a common parallel discrete event-based simulation environment. This allows design exploration of future architectures, analysis of how current computer programs will function on future architectures. The SST provides a parallel discrete event simulation framework, including partitioning and object distribution over MPI. It also provides a mechanism by which components can report their power consumption for analysis.

Rodrigues, ArunF.↗

A Scalable O(N) Algorithm for Large-Scale Parallel First-Principles Molecular Dynamics Simulations

Traditional algorithms for first-principles molecular dynamics (FPMD) simulations only gain a modest capability increase from current petascale computers, due to their O(N 3 ) complexity and their heavy use of global communications. To address this issue, we are developing a truly scalable O(N) complexity FPMD algorithm, based on density functional theory (DFT), which avoids global communications. The computational model uses a general nonorthogonal orbital formulation for the DFT energy functional, which requires knowledge of selected elements of the inverse of the associated overlap matrix. We present a scalable algorithm for approximately computing selected entries of the inverse of the overlap matrix, based on an approximate inverse technique, by inverting local blocks corresponding to principal submatrices of the global overlap matrix. The new FPMD algorithm exploits sparsity and uses nearest neighbor communication to provide a computational scheme capable of extreme scalability. Accuracy is controlled by the mesh spacing of the finite difference discretization, the size of the localization regions in which the electronic orbitals are confined, and a cutoff beyond which the entries of the overlap matrix can be omitted when computing selected entries of its inverse. We demonstrate the algorithm's excellent parallel scaling for up to O(100K) atoms on O(100K) processors, with a wall-clock time of O(1) minute per molecular dynamics time step.

36 MATERIALS SCIENCE↗

Highly Reliable Multi-Port Smart Inverter Modules for PV-Based Energy Systems

Generally, large electrolytic capacitors (E-caps) are required to decouple the double-line frequency power fluctuation inherent in all single-phase dc-ac or ac-dc converters. These E-caps pose the weak link in the photovoltaic (PV) inverter because they have poor reliability as a result of short life expectancy and higher equivalent series resistance (ESR) which leads to lower system efficiency. In this paper, multiport smart dual-inverter modules are proposed for residential PV inverter systems with balanced outputs to eliminate the requirement of large decoupling capacitors, thus leading to more reliable and highly efficient inverter modules. The balanced dual outputs are controlled in phase quadrature such that the double frequency current is completely eliminated. One phase supports the standalone residential loads, and the other phase interfaces with the grid, which is synchronized to the utility grid. Also, the proposed modular configuration is scalable to accommodate higher power rating by stacking and paralleling multiple modules. Simulation results for the dual-inverter modules rated for 1 kW each are presented to validate the proposed concept. Experimental results from a controller hardware-in-the-loop (CHIL) platform also verify its feasibility.

14 SOLAR ENERGY↗

Mesoscopic Modeling and Rapid Simulation of Incremental Changes in Epidemic Scenarios on GPUs

In simulation-based studies and analyses of epidemics, a major challenge lies in resolving the conflict between fidelity of models and the speed of their simulation. Another related challenge arises in dealing with the large number of what–if scenarios that need to be explored. Here, we describe new computational methods that together provide an approach to dealing with both challenges. A mesoscopic modeling approach is described that strikes a middle ground between macroscopic models based on coupled differential equations and microscopic models built on fine-grained behaviors at the individual entity level. The mesoscopic approach offers the ability to incorporate complex compositions of multiple layers of dynamics even while retaining the potential for aggregate behaviors at varying levels. It also is an excellent match to the accelerator-based architectures of modern computing platforms in which graphical processing units (GPUs) can be exploited for fast simulation via the parallel execution mode of single instruction multiple thread (SIMT). The challenge of simulating a large number of scenarios is addressed via a method of sharing model state and computation across a tree of what–if scenarios that are localized, incremental changes to a large base simulation. A combination of the mesoscopic modeling approach and the incremental what–if scenario tree evaluation has been implemented in the software on modern GPUs. Synthetic simulation scenarios are presented to demonstrate the computational characteristics of our approach. Results from the experiments with large population data, including USA, UK, and India, illustrate the modeling methodology and computational performance on thousands of synthetically generated what–if scenarios. Execution of our implementation scaled to 8192 GPUs of supercomputing platforms demonstrates the ability to rapidly evaluate what–if scenarios several orders of magnitude faster than the conventional methods.

97 MATHEMATICS AND COMPUTING↗

Characteristics of an envelope model for laser-plasma accelerator simulation

Simulation of laser-plasma accelerator (LPA) experiments is computationally intensive due to the disparate length scales involved. Current experiments extend hundreds of laser wavelengths transversely and many thousands in the propagation direction, making explicit PIC simulations enormously expensive and requiring massively parallel execution in 3D. Simulating the next generation of LPA experiments is expected to increase the computational requirements yet further, by a factor of 1000. We can substantially improve the performance of LPA simulations by modeling the envelope evolution of the laser field rather than the field itself. This allows for much coarser grids, since we need only resolve the plasma wavelength and not the laser wavelength, and therefore larger timesteps can be used. Thus an envelope model can result in savings of several orders of magnitude in computational resources. By propagating the laser envelope in a Galilean frame moving at the speed of light, dispersive errors can be avoided and simulations over long distances become possible. The primary limitation to this envelope model is when the laser pulse develops large frequency shifts, and thus the slowly-varying envelope assumption is no longer valid. Here we describe the model and its implementation, and show rigorous benchmarks for the algorithm, establishing second-order convergence and correct laser group velocity. We also demonstrate simulations of LPA phenomena such as self-focusing and meter-scale acceleration stages using the model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗