Achieving Maintainable Cross-Platform Performance in the Particle-in-Cell Accelerator Modeling Code Synergia using Kokkos
Explore the source record for details and available documents.
Engineering topics
Publications and source records attributed to Amundson, James.
Explore the source record for details and available documents.
High Energy Physics (HEP) software environments often involve ~ hundreds of external packages and libraries, and similar numbers of experiment-specific, science-critical packages—many under continuous development. Managing coherent releases of the external software stack is challenging enough, but managing the highly-collaborative—and distributed—development of a large body of code against such a stack adds even more complexity and room for error. Spack is a popular Python-based package management tool with a specific focus on the needs of High Performance Computing (HPC) systems and system administrators whose strength is orchestrating the discrete download, build, testing, and installation of pre-packaged or tagged third-party software against similarly stable dependencies. As such it is becoming increasingly popular within HEP as that community makes increasing use of HPC facilities, and as efforts to develop future HPC systems utilize Spack to provide scientific software on those platforms. SpackDev is a system to facilitate the simultaneous development of interconnected sets of packages. Intended to handle packages without restriction to one internal build system, SpackDev is integrated with Spack as a command extension in order to leverage features such as dependency calculations and build system configuration, and is generally applicable outside HEP. We describe SpackDev’s features and development over the last two years, initial experience using SpackDev in the context of the LArSoft liquid argon detector toolkit, and work remaining before it can be considered a fully-functional multi-package build system for HEP experiments utilizing Spack.
The art event-based analysis framework is used by multiple Intensity Frontier and other experiments and projects in High Energy Physics (HEP). A system of tools and scripts based around a Fermilab-originated package management system called UNIX Product Support (UPS) has evolved to provide development, packaging, release management, and distribution of the art suite, related experimental software and external dependencies in relocatable binary form. The existing system has limitations in environments such as macOS with System Integrity Protection (SIP) enabled and the various High Performance Computing (HPC) systems that the field of HEP is increasingly looking to leverage. This has led to a search for other ways of providing experiments with a packaging and build system that meets their needs. We describe our efforts to develop a packaging and release management system based on the Spack HPC package management tool to replace the existing UPS-based system. We additionally describe a companion system: SpackDev and cetmodules, allowing simultaneous development of multiple HEP software packages in a consistent environment. A successful implementation of the intended system would have applicability across HEP rather than merely to the users of the art framework.
We introduce a method for representing the low-energy subspace of a bosonic field theory on the qubit space of digital quantum computers. This discretization leads to an exponentially precise description of the subspace of the continuous theory thanks to the Nyquist-Shannon sampling theorem. The method makes the implementation of quantum algorithms for purely bosonic systems as well as fermion-boson interacting systems feasible. We present algorithmic circuits for computing the time evolution of these systems. The complexity of the algorithms scales polynomially with the system size. The algorithm is a natural extension of the existing quantum algorithms for simulating fermion systems in quantum chemistry and condensed-matter physics to systems involving bosons and fermion-boson interactions and has a broad variety of potential applications in particle physics, condensed matter, etc. Due to the relatively small amount of additional resources required by the inclusion of bosons in our algorithm, the simulation of electron-phonon and similar systems can be placed in the same near-future reach as the simulation of interacting electron systems. We benchmark our algorithm by implementing it for a two-site Holstein polaron problem on an Atos Quantum Learning Machine quantum simulator. The polaron quantum simulations are in excellent agreement with the results obtained by exact diagonalization.
We present an algorithm that extends existing quantum algorithms for simulating fermion systems in quantum chemistry and condensed matter physics to include bosons in general and phonons in particular. We introduce a qubit representation for the low-energy subspace of phonons which allows an efficient simulation of the evolution operator of the electron-phonon systems. As a consequence of the Nyquist-Shannon sampling theorem, the phonons are represented with exponential accuracy on a discretized Hilbert space with a size that increases linearly with the cutoff of the maximum phonon number. The additional number of qubits required by the presence of phonons scales linearly with the size of the system. The additional circuit depth is constant for systems with finite-range electron-phonon and phonon-phonon interactions and linear for long-range electron-phonon interactions. Our algorithm for a Holstein polaron problem was implemented on an Atos quantum learning machine quantum simulator employing the quantum phase estimation method. The energy and the phonon number distribution of the polaron state agree with exact diagonalization results for weak, intermediate, and strong electron-phonon coupling regimes.
Introduction: At the last CHEP we heard a talk about Quantum Computing from a hardware perspective.; Jim is a software algorithm person and he will concentrate more on that.; 20 months is a long time in Quantum Information Science, QIS; The Josephson Junction technology we heard about then has evolved as predicted and we now have “mid-range” devices available on the cloud.
In recent years Quantum Computing has attracted a great deal of attention in the scientific and technical communities. Interest in the field has expanded to include the popular press and various funding agencies. We discuss the origins of the idea of using quantum systems for computing. We then give an overview in recent developments in quantum hardware and software, as well as some potential applications for high energy physics.
The future high energy physics program at Fermilab requires that the proton complex operate with beam bunch intensities four times larger than is currently handled. At these intensities space charge nonlinear defocussing effects cause unacceptable particle losses especially in the low energy rapid-cycling-synchrotron (RCS) Booster. Focusing electron lens elements may offer a solution by providing partial space charge compensation but there is a need for detailed simulations as this technique has not been demonstrated. We report on high fidelity numerical 6D space charge simulations in a model accelerator lattice with a record high space charge tune shift approaching unity.
Employing Synergia simulations with the DMD method we investigate the Landau damping of space charge modes in bunched beams. The simulations reveal two instances of the parametric damping mechanism in bunched beams. The first example occurs in the proximity of coupling resonance and is due to the oscillation of particles’ amplitudes in the transverse plane. This oscillation modulates the modeparticle coupling with particle dependent trapping frequency. The second example is due to the modulation of the modeparticle coupling in one transverse plane by the oscillatory motion in the other plane.
Not Available
Fermilab has recently completed an upgrade to the com- plex with the goal of delivering 700 kW of beam power as 120 GeV protons to the NuMI target. A major part of boost- ing beam power is to shorten the beam cycle by accumulating up to 12 bunches of 0.5 × 10 11 protons in the Recycler ring through slip-stacking during the Main Injector ramp. This introduces much higher intensities into the Recycler than it has had before. Meeting radiation safety requirements with high intensity operations requires understanding the ef- fects of space charge induced tune spreads and resulting halo formation, and aperture restrictions in the real machine to de- velop a collimation strategy. We report on initial simulations of slip-stacking in the Recycler performed with Synergia.
The Mu2e experiment at Fermilab requires acceleration and transport of intense proton beams in order to deliver stable, uniform particle spills to the production target. To meet the experimental requirement, particles will be extracted slowly from the Delivery Ring to the external beamline. Using Synergia2, we have performed multi-particle tracking simulations of third-integer resonant extraction in the Delivery Ring, including space charge effects, physical beamline elements, and apertures. A piecewise linear ramp profile of tune quadrupoles was used to maintain a constant averaged spill rate throughout extraction. To study and minimize beam losses, we implemented and introduced a number of features, beamline element apertures, and septum plane alignments. Additionally, the RF Knockout (RFKO) technique, which excites particles transversely, is employed for spill regulation. Combined with a feedback system, it assists in fine-tuning spill uniformity. Simulation studies were carried out to optimize the RFKO feedback scheme, which will be helpful in designing the final spill regulation system.
The development and optimization of particle accelerators are essential for advancing our understanding of the properties of matter, energy, space, and time. Particle accelerators are complex devices whose behavior involves many physical effects on multiple scales. Therefore, advanced computational tools utilizing high-performance computing are essential for accurately modeling them. In the past decade, the US Department of Energy's SciDAC program has produced accelerator-modeling tools that have been employed to tackle some of the most difficult accelerator science problems. The authors discuss the Synergia framework and its applications to high-intensity particle accelerator physics. Synergia is an accelerator simulation package capable of handling the entire spectrum of beam dynamics simulations. Our authors present Synergia's design principles and its performance on HPC platforms.
Nonperturbative algorithm for the resistive wall impedance of general cross-section beam pipes; ABSTRACT = We present an algorithm for calculating the impedance of infinitely long beam pipes with arbitrary cross section. The method is not restricted to ultrarelativistic beams or perturbative approximations with respect to the wall surface impedance or skin penetration depth. We exemplify our algorithm with a calculation of the impedance for rectangular metallic beam pipes. Unlike the situation in the perturbative regime, where the beam pipe geometry modifies the metallic resistive-wall impedances by only a multiplicative factor, the beam pipe geometry has a more complex influence on the impedance when nonultrarelativistic effects are significant and in the ultrarelativistic regime at both small and large frequencies. Since our algorithm requires the boundary conditions at the beam pipe wall to be provided as linear relations between the transverse components of the electromagnetic field, we discuss a general algorithm to calculate these boundary conditions for multilayer beam pipes with arbitrary cross section.
Abstract Not Provided
Not Available
We calculate the impedance and the wake functions for laminated structures with parallel-planes and circular geometries. We critically examine the approximations used in the literature for the coupling impedance in laminated chambers and find that most of them are not justified because the wall surface impedance is large. A comparison between the flat and the circular geometry impedance is presented. We use the wake fields calculated for the Fermilab Booster laminated magnets in realistic beam simulations using the Synergia code. We find good agreement between our calculation of the coherent tune shift at injection energy and the experimental measurements. In this paper we calculate the impedance and the wake functions for laminated structures with parallel-planes and circular geometries. First the coupling impedance is derived as a function of the wall surface impedance. Then the surface impedance is calculated by solving Maxwell's equations inside the lamination and the crack regions. We find that the commonly used resistive-wall approximations, good for metallic pipes with small surface impedance, are not valid in the laminated structures where the surface impedance is large. Realistic Synergia simulations of the Booster machine with wake fields predict transverse coherent tune shifts in good agreement with the experiment.