Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

A Scalable Parallel Wideband MLFMA for Efficient Electromagnetic Simulations on Large Scale Clusters

The development of the multilevel fast multipole algorithm (MLFMA) and its multiscale variants have enabled the use of integral equation (IE) based solvers to compute scattering from complicated structures. Development of scalable parallel algorithms, to extend the reach of these solvers, has been a topic of intense research for about a decade. In this paper, we present a new algorithm for parallel implementation of IE solver that is augmented with a wideband MLFMA and scalable on large number of processors. The wideband MLFMA employed here, to handle multiscale problems, is a hybrid combination of the accelerated Cartesian expansion (ACE) and the classical MLFMA. The salient feature of the presented parallel algorithm is that it is implicitly load balanced and exhibits higher performance. This is achieved by developing a strategy to partition the MLFMA tree, and hence the associated computations, in a self-similar fashion among the parallel processors. As detailed in the paper, the algorithm employs both spatial and direction partitioning approaches in a flexible manner to ensure scalable performance. Plethora of results are presented here to exhibit the scalability of this algorithm on 512 and more processors.

99 GENERAL AND MISCELLANEOUS↗

Use of Covariances in a Consistent Data Assimilation for Improvement of Basic Nuclear Parameters in Nuclear Reactor Applications: From Meters to Femtometers

Recognition of the key role physics plays in innovative reactor design was already made clear by E. Wigner in his warning: “It has been a bit forgotten that in all really creative thinking in reactor design, a working knowledge of nuclear reaction theory is required.” More recently, extensive sensitivity and uncertainty studies and the availability of new covariance data have allowed preliminary quantification of the impact of current nuclear data uncertainties on the design parameters of the Generation-IV systems (both fast neutron and thermal neutron systems). Similar quantifications can be done for the parameters that characterize the associated innovative fuel cycle to insure sustainability, waste minimization and drastic reduction of the proliferation risks. In parallel, there has been a growing and very significant trend to develop a new generation of reactor simulation tools that rely more and more on first principles. It is safe to say that the next generation of innovative nuclear systems will be assessed with a completely new set of tools, more science based, in sharp contrast with what has been done in the past. However, the studies mentioned above point out that the present uncertainties in nuclear data should be significantly reduced in order to fully benefit from advances in modeling and simulation. Only a parallel effort in advanced simulation and nuclear data improvement will be able to provide designers with more general and well validated calculational tools to meet new design target accuracies. One further consideration related to the development of new advanced simulation tools is that there should be a more explicit link with the more fundamental physics parameters underlying the models used to describe cross sections that would avoid the use of processed, application-oriented, data (like multigroup cross sections). Finally, current methodologies for reducing uncertainties coming from nuclear data, which rely on the use of integral experiment information to perform statistical multigroup (i.e., energy spectrum weighted) cross section data assimilation should evolve to embrace new frontiers in advanced simulation. One of the drawbacks of the classical methodologies is related to the energy group structure and the type of neutron energy spectrum that are adopted in the assimilation (adjustment). In fact, after such an adjustment is performed, neutronic designers are then tied to this energy group structure and neutron energy spectrum when carrying out further calculations. In reality, this can be quite a limiting factor in view of the complex spectral issues that are involved in most reactor physics. This work combines novel, but proven, methodologies for overcoming these limitations. In fact, this is the first attempt to build up a link between the wealth of precise integral experiments and a basic theory of nuclear reactions. Essential ingredients of such a procedure, denominated here as assimilation, are covariances for model parameters and sensitivity matrices. The latter provide direct link between reaction theory and integral experiments. The result is a consistent data assimilation performed directly on the basic nuclear physics parameters that are being used in a variety of nuclear reaction mechanisms. The resulting improvement in their performance will consequently reduce related uncertainties when employed in reactor calculations. By using integral reactor physics experiments (meter scale), information is propagated back to the nuclear physics level (femtometers) covering a range of more than 13 orders of magnitude. The assimilation procedure should result in more accurate and more reliable evaluated data files of universal validity rather than tailored to a particular application. In fact, after data assimilation is carried out, the basic nuclear data file can be processed by a dedicated code into any energy group structure that the reactor physicist deems to be useful. On the other hand, integral experiments used in the assimilation should provide additional, possibly quite strict, constraints on the parameters entering nuclear reaction modeling, as well as the reaction models themselves. This report describes three years of combined research by Brookhaben National Lab (BNL) and Idaho National Lab (INL) on establishing viable assimilation methodology. The emphasis of this paper is on the empire code calculations to prepare the priors, sensitivity matrices and covariances for the model parameters. For completeness, we also include a short summary of the assimilation results produced by INL and reported earlier in annual reports [6], [7], [8].

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An implementation of a tree code on a SIMD, parallel computer

We describe a fast tree algorithm for gravitational N-body simulation on SIMD parallel computers. The tree construction uses fast, parallel sorts. The sorted lists are recursively divided along their x, y and z coordinates. This data structure is a completely balanced tree (i.e., each particle is paired with exactly one other particle) and maintains good spatial locality. An implementation of this tree-building algorithm on a 16k processor Maspar MP-1 performs well and constitutes only a small fraction (approximately 15%) of the entire cycle of finding the accelerations. Each node in the tree is treated as a monopole. The tree search and the summation of accelerations also perform well. During the tree search, node data that is needed from another processor is simply fetched. Roughly 55% of the tree search time is spent in communications between processors. We apply the code to two problems of astrophysical interest. The first is a simulation of the close passage of two gravitationally, interacting, disk galaxies using 65,636 particles. We also simulate the formation of structure in an expanding, model universe using 1,048,576 particles. Our code attains speeds comparable to one head of a Cray Y-MP, so single instruction, multiple data (SIMD) type computers can be used for these simulations. The cost/performance ratio for SIMD machines like the Maspar MP-1 make them an extremely attractive alternative to either vector processors or large multiple instruction, multiple data (MIMD) type parallel computers. With further optimizations (e.g., more careful load balancing), speeds in excess of today's vector processing computers should be possible.

Olson, Kevin M.↗

Direct observations of shape fluctuation in long-time atomistic simulations of metallic nanoclusters

Metallic nanoclusters are functional materials whose unique physical and chemical properties are sensitively controlled by their shapes and structures. An in-depth understanding of their morphological stability is therefore of crucial importance. It has been well documented by transmission electron microscopy (TEM) studies that metallic nanoclusters can interconvert between different isomers. However, the relevant mechanisms remain elusive because the timescales of such shape fluctuations are too short to be resolved experimentally and yet too long for conventional atomistic simulations. By employing massively parallel accelerated molecular dynamics (AMD) simulations reaching timescales of milliseconds, here we provide a clear description of the dynamical processes leading to shape fluctuation in metallic nanoclusters of platinum, silver, copper, and gold at different sizes and temperatures. In all these materials, direct transformations between face-centered-cubic and fivefold symmetric structures (decahedron or icosahedron) are observed away from the melting point. These transitions occur following either a slip-mediated twinning mechanism or a surface-reconstruction driven process. The identified pathways are shown to be reversible, allowing for genuine shape fluctuation processes that do not involve melting or other external factors.

36 MATERIALS SCIENCE↗

Scalable I/O Tracing and Analysis

As supercomputer performance approached and then surpassed the petaflop level, I/O performance has become a major performance bottleneck for many scientific applications. Several tools exist to collect I/O traces to assist in the analysis of I/O performance problems. However, these tools either produce extremely large trace files that complicate performance analysis, or sacrifice accuracy to collect high-level statistical information. We propose a multi-level trace generator tool, ScalaIOTrace, that collects traces at several levels in the HPC I/O stack. ScalaIOTrace features aggressive trace compression that generates trace files of near constant size for regular I/O patterns and orders of magnitudes smaller for less regular ones. This enables the collection of I/O and communication traces of applications running on thousands of processors. Our contributions also include automated trace analysis to collect selected statistical information of I/O calls by parsing the compressed trace on-the-fly and time-accurate replay of communication events with MPI-IO calls. We evaluated our approach with the Parallel Ocean Program (POP) climate simulation and the FLASH parallel I/O benchmark. POP uses NetCDF as an I/O library while FLASH I/O uses the parallel HDF5 I/O library, which internally maps onto MPI-IO. We collected MPI-IO and low-level POSIX I/O traces to study application I/O behavior. Our results show constant size trace files of only 145KB irrespective of the number of nodes for FLASH I/O benchmark, which exhibits regular I/O and communication pattern. For POP, we observe up to two orders of magnitude reduction in trace file sizes compared to flat traces. Statistical information gathered reveals insight on the number of I/O and communication calls issued in the POP and FLASH I/O. Such concise traces are unprecedented for isolated I/O and combined I/O plus communication tracing.

97 MATHEMATICS AND COMPUTING↗

The role of the electron convection term for the parallel electric field and electron acceleration in MHD simulations

There has been a great concern about the origin of the parallel electric field in the frame of fluid equations in the auroral acceleration region. This paper proposes a new method to simulate magnetohydrodynamic (MHD) equations that include the electron convection term and shows its efficiency with simulation results in one dimension. We apply a third-order semi-discrete central scheme to investigate the characteristics of the electron convection term including its nonlinearity. At a steady state discontinuity, the sum of the ion and electron convection terms balances with the ion pressure gradient. We find that the electron convection term works like the gradient of the negative pressure and reduces the ion sound speed or amplifies the sound mode when parallel current flows. The electron convection term enables us to describe a situation in which a parallel electric field and parallel electron acceleration coexist, which is impossible for ideal or resistive MHD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Particle simulation in a multiprocessor environment

A parallel implementation of a particle simulation method that is portable between a wide class of multiprocessor computers is presented. A fine grain spatial decomposition is utilized where several subdomains having a regular structure are computed at each processing node. This leads directly to an efficient and straightforward load balancing scheme if the number of subdomains at each processor is permitted to vary in an appropriate manner. Three dimensional simulations incorporating full thermochemical nonequilibrium are possible using the resulting code. Vectorizable algorithms are retained from earlier work allowing efficient use of deeply pipelined node processors where available. Performance results are presented from three different machine architectures demonstrating the portability of the code. On a 128-node Intel iPSC/860, performance is twice that of a single Cray-Y/MP CPU running a highly vectorized simulation code. Speedup is linear over the full range of number of processors on all target machines, indicating scalability of the method to higher degrees of parallelism.

Mcdonald, Jeffrey D.↗

Improving Multi-Million Virtual Rank MPI Execution in

(MUPI) is a parallel discrete event simulator designed for enabling software-based experimentation via simulated execution across a range of synthetic to unmodified parallel programs using the Message Passing Interface (MPI) with millions of tasks. Here, we report work in progress in improving the efficiency of . Among the issues uncovered are the scaling problems with implementing barriers and intertask message ordering. Preliminary performance shows the possibility of supporting hundreds of virtual MPI ranks per real processor core. Performance improvements of at least 2 are observed, and enable execution of benchmark MPI runs with over 16 million virtual ranks synchronized in a discrete event fashion on as few as 16,128 real cores of a Cray XT5.

99 GENERAL AND MISCELLANEOUS↗

TEAM Project Review, Year 2

This report summarizes our research activities within the TEAM project between December 2020 and December 2021, funded by the ASCR Advanced Research in Quantum Computing program. During the reporting period the LLNL-MSU team has made progress on several fronts. An overarching goal of the team is to provide a comprehensive suite of software tools that can be used for the Characterize-Optimize-Compute loop needed to implement and execute algorithms on quantum devices. We are concurrently developing lightweight solvers that can be used on desktop computers to find optimal control pulses and to characterize small quantum systems (consisting of a few transmons and cavities). However, desktop computers are insufficient for simulating and characterizing larger quantum systems. We have therefore also developed parallel, distributed memory, simulators and optimization solvers, both for open and closed quantum systems. These parallel solvers have, for example, been used to study quantum optimal control for pure-state preparation, utilizing 1000’s of cores on a modern high-performance computing (HPC) platform.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Parallel implementation of three-dimensional molecular dynamic simulation for laser-cluster interaction

The objective of this article is to report the parallel implementation of the 3D molecular dynamic simulation code for laser-cluster interactions. The benchmarking of the code has been done by comparing the simulation results with some of the experiments reported in the literature. Scaling laws for the computational time is established by varying the number of processor cores and number of macroparticles used. The capabilities of the code are highlighted by implementing various diagnostic tools. To study the dynamics of the laser-cluster interactions, the executable version of the code is available from the author.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving the Performance of the Extreme-scale Simulator

Investigating the performance of parallel applications at scale on future high-performance computing (HPC) architectures and the performance impact of different architecture choices is an important component of HPC hardware/software co-design. The Extreme-scale Simulator (xSim) is a simulation-based toolkit for investigating the performance of parallel applications at scale. xSim scales to millions of simulated Message Passing Interface (MPI) processes. The overhead introduced by a simulation tool is an important performance and productivity aspect. This paper documents two improvements to xSim: (1) a new deadlock resolution protocol to reduce the parallel discrete event simulation management overhead and (2) a new simulated MPI message matching algorithm to reduce the oversubscription management overhead. The results clearly show a significant performance improvement, such as by reducing the simulation overhead for running the NAS Parallel Benchmark suite inside the simulator from 1,020\% to 238% for the conjugate gradient (CG) benchmark and from 102% to 0% for the embarrassingly parallel (EP) and benchmark, as well as, from 37,511% to 13,808% for CG and from 3,332% to 204% for EP with accurate process failure simulation.

Engelmann, Christian↗

A new deadlock resolution protocol and message matching algorithm for the extreme-scale simulator

Investigating the performance of parallel applications at scale on future high-performance computing (HPC) architectures and the performance impact of different HPC architecture choices is an important component of HPC hardware/software co-design. The Extreme-scale Simulator (xSim) is a simulation toolkit for investigating the performance of parallel applications at scale. xSim scales to millions of simulated Message Passing Interface (MPI) processes. The overhead introduced by a simulation tool is an important performance and productivity aspect. This paper documents two improvements to xSim: (1)~a new deadlock resolution protocol to reduce the parallel discrete event simulation overhead and (2)~a new simulated MPI message matching algorithm to reduce the oversubscription management overhead. The results clearly show a significant performance improvement. The simulation overhead for running the NAS Parallel Benchmark suite was reduced from 102% to 0% for the embarrassingly parallel (EP) benchmark and from 1,020% to 238% for the conjugate gradient (CG) benchmark. xSim offers a highly accurate simulation mode for better tracking of injected MPI process failures. Furthermore, with highly accurate simulation, the overhead was reduced from 3,332% to 204% for EP and from 37,511% to 13,808% for CG.

97 MATHEMATICS AND COMPUTING↗

Mechanisms of material removal and mass transport in focused ion beam nanopore formation

Despite the widespread use of focused ion beam (FIB) processing as a material removal method for applications ranging from electron microscope sample preparation to nanopore processing for DNA sequencing, the basic material removal mechanisms of FIB processing are not well understood. We present the first complete atomistic simulation of high-flux FIB using large-scale parallel molecular dynamics (MD) simulations of nanopore fabrication in freestanding thin films. We focus on the root mechanisms of material removal and rearrangement and describe the role of explosive boiling in forming nanopores. FIB nanopore fabrication is typically understood to occur via sputter erosion. This can be shown to be the case in low flux systems, where individual ion impacts are sufficiently separated in time that they may be considered as independent events. But our detailed MD simulations show that in high flux FIB processing, above a threshold level at which thermal effects become significant, the primary mechanism of material removal changes to a significantly accelerated, thermally dominated process. Under these conditions, the target is heated by the ion beam faster than heat is conducted away by the material, leading quickly to melting, and then continued heating to nearly the material critical temperature. This leads to explosive boiling of the target material with spontaneous bubble formation and coalescence. Mass is rapidly rearranged at the atomistic scale, and material removal occurs orders of magnitude faster than would occur by simple sputtering. While the phenomenology is demonstrated computationally in silicon, it can be expected to occur at lower beam fluxes in other cases where thermal conduction is suppressed due to material properties, geometry, or ambient thermal conditions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Particle Acceleration, Magnetic Field Generation, and Emission in Relativistic Shocks

Shock acceleration is an ubiquitous phenomenon in astrophysical plasmas. Plasma waves and their associated instabilities (e.g., the Buneman instability, two-streaming instability, and the Weibel instability) created in the shocks are responsible for particle (electron, positron, and ion) acceleration. Using a 3-D relativistic electromagnetic particle (m) code, we have investigated particle acceleration associated with a relativistic jet front propagating through an ambient plasma with and without initial magnetic fields. We find only small differences in the results between no ambient and weak ambient parallel magnetic fields. Simulations show that the Weibel instability created in the collisionless shock front accelerates particles perpendicular and parallel to the jet propagation direction. New simulations with an ambient perpendicular magnetic field show the strong interaction between the relativistic jet and the magnetic fields. The magnetic fields are piled up by the jet and the jet electrons are bent, which creates currents and displacement currents. At the nonlinear stage, the magnetic fields are reversed by the current and the reconnection may take place. Due to these dynamics the jet and ambient electron are strongly accelerated in both parallel and perpendicular directions.

Nishikawa, Ken-IchiI.↗

Particle Acceleration, Magnetic Field Generation in Relativistic Shocks

Shock acceleration is an ubiquitous phenomenon in astrophysical plasmas. Plasma waves and their associated instabilities (e.g., the Buneman instability, two-streaming instability, and the Weibel instability) created in the shocks are responsible for particle (electron, positron, and ion) acceleration. Using a 3-D relativistic electromagnetic particle (REMP) code, we have investigated particle acceleration associated with a relativistic jet front propagating through an ambient plasma with and without initial magnetic fields. We find only small differences in the results between no ambient and weak ambient parallel magnetic fields. Simulations show that the Weibel instability created in the collisionless shock front accelerates particles perpendicular and parallel to the jet propagation direction. New simulations with an ambient perpendicular magnetic field show the strong interaction between the relativistic jet and the magnetic fields. The magnetic fields are piled up by the jet and the jet electrons are bent, which creates currents and displacement currents. At the nonlinear stage, the magnetic fields are reversed by the current and the reconnection may take place. Due to these dynamics the jet and ambient electron are strongly accelerated in both parallel and perpendicular directions.

Nishikawa, Ken-Ichi↗

Performance of GeantV EM Physics Models

The recent progress in parallel hardware architectures with deeper vector pipelines or many-cores technologies brings opportunities for HEP experiments to take advantage of SIMD and SIMT computing models. Launched in 2013, the GeantV project studies performance gains in propagating multiple particles in parallel, improving instruction throughput and data locality in HEP event simulation on modern parallel hardware architecture. Due to the complexity of geometry description and physics algorithms of a typical HEP application, performance analysis is indispensable in identifying factors limiting parallel execution. In this report, we will present design considerations and preliminary computing performance of GeantV physics models on coprocessors (Intel Xeon Phi and NVidia GPUs) as well as on mainstream CPUs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Parallel transport modeling of linear divertor simulators with fundamental ion cyclotron heating *

Abstract The Material Plasma Exposure eXperiment (MPEX) is a steady state linear device with the goal to perform plasma material interaction studies at future fusion reactor relevant conditions. A prototype of MPEX referred as ‘Proto-MPEX’ is designed to carry out research and development related to source, heating and transport concepts on the planned full MPEX device. The auxiliary heating schemes in MPEX are based on cyclotron resonance heating with radio frequency (RF) waves. Ion cyclotron heating (ICH) and electron cyclotron heating in MPEX are used to independently heat the ions and electrons and provide fusion divertor conditions ranging from sheath-limited to fully detached divertor regimes at a material target. A hybrid particle-in-cell code- PICOS++ is developed and applied to understand the plasma parallel transport during ICH in MPEX/Proto-MPEX to the target. With this tool, evolution of the distribution function of MPEX/Proto-MPEX ions is modeled in the presence of (a) Coulomb collisions, (b) volumetric particle sources and (c) quasi-linear RF-based ICH. The code is benchmarked against experimental data from Proto-MPEX and simulation data from B2.5 EIRENE. The experimental observation of ‘density-drop’ near the target in Proto-MPEX and MPEX during ICH is demonstrated and explained via physics-based arguments using PICOS++ modeling. In fact, the density drops at the target during ICH in Proto-MPEX/MPEX to conserve the flux and to compensate for the increased flow during ICH. Furthermore, sensitivity scans of various plasma parameters with respect to ICH power are performed for MPEX to investigate its role on plasma transport and particle and energy fluxes at the target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Parallel Architecture For Robotics Computation

Universal Real-Time Robotic Controller and Simulator (URRCS) is highly parallel computing architecture for control and simulation of robot motion. Result of extensive algorithmic study of different kinematic and dynamic computational problems arising in control and simulation of robot motion. Study led to development of class of efficient parallel algorithms for these problems. Represents algorithmically specialized architecture, in sense capable of exploiting common properties of this class of parallel algorithms. System with both MIMD and SIMD capabilities. Regarded as processor attached to bus of external host processor, as part of bus memory.

Fijany, Amir↗