SEARCH · Search NASA

Results for “Parallel particle tracing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2018

Dynamic Load Balancing Based on Constrained K-D Tree Decomposition for Parallel Particle Tracing

Particle tracing is a fundamental technique in flow field data visualization. In this work, we present a novel dynamic load balancing method for parallel particle tracing. Specifically, we employ a constrained k-d tree decomposition approach to dynamically redistribute tasks among processes. Each process is initially assigned a regularly partitioned block along with duplicated ghost layer under the memory limit. During particle tracing, the k-d tree decomposition is dynamically performed by constraining the cutting planes in the overlap range of duplicated data. This ensures that each process is reassigned particles as even as possible, and on the other hand the new assigned particles for a process always locate in its block. Result shows good load balance and high efficiency of our method.

Zhang, Jiang↗

DOE OSTI2023

Reinforcement Learning for Load-balanced Parallel Particle Tracing

We explore an online reinforcement learning (RL) paradigm to dynamically optimize parallel particle tracing performance in distributed-memory systems. Our method combines three novel components: (1) a work donation algorithm, (2) a high-order workload estimation model, and (3) a communication cost model. First, we design an RL-based work donation algorithm. Our algorithm monitors workloads of processes and creates RL agents to donate data blocks and particles from high-workload processes to low-workload processes to minimize program execution time. The agents learn the donation strategy on the fly based on reward and cost functions designed to consider processes' workload changes and data transfer costs of donation actions. Second, we propose a workload estimation model, helping RL agents estimate the workload distribution of processes in future computations. Third, we design a communication cost model that considers both block and particle data exchange costs, helping RL agents make effective decisions with minimized communication costs. We demonstrate that our algorithm adapts to different flow behaviors in large-scale fluid dynamics, ocean, and weather simulation data. Our algorithm improves parallel particle tracing performance in terms of parallel efficiency, load balance, and costs of I/O and communication for evaluations with up to 16,384 processors.

Distributed and parallel particle tracing↗

DOE OSTI2018

Dynamic Data Repartitioning for Load-Balanced Parallel Particle Tracing

We present a novel dynamic load-balancing algorithm based on data repartitioning for parallel particle tracing in flow visualization. Instead of static data assignment, we dynamically repartition the data into blocks and reassign the blocks to processes to balance the workload distribution among the processes. Block repartitioning is performed based on a dynamic workload estimation method that predicts the workload in the flow field on the fly as the input. In our approach, we allow data duplication in the repartitioning, enabling the same data blocks to be assigned to multiple processes. Load balance is achieved by regularly exchanging the blocks (together with the particles in the blocks) among processes according to the output of the data repartitioning. Compared with other load-balancing algorithms, our approach does not need any preprocessing on the raw data and does not require any dedicated process for work scheduling, while it has the capability to balance uneven workload efficiently. Results show improved load balance and high efficiency of our method on tracing particles in both steady and unsteady flow.

data repartitioning↗

DOE OSTI2016

Efficient Unsteady Flow Visualization with High-Order Access Dependencies

We present a novel high-order access dependencies based model for efficient pathline computation in unsteady flow visualization. By taking longer access sequences into account to model more sophisticated data access patterns in particle tracing, our method greatly improves the accuracy and reliability in data access prediction. In our work, high-order access dependencies are calculated by tracing uniformly-seeded pathlines in both forward and backward directions in a preprocessing stage. The effectiveness of our proposed approach is demonstrated through a parallel particle tracing framework with high-order data prefetching. Results show that our method achieves higher data locality and hence improves the efficiency of pathline computation.

Zhang, Jiang↗

DOE OSTI2018

Performance-Portable Particle Advection with VTK-m

Particle advection is the fundamental kernel behind most vector field visualization methods. Yet, the efficient parallel computation of large amounts of particle traces remains challenging. This is exacerbated by the variety of hardware trends in today's HPC arena, including increasing core counts in classical CPUs, many-core designs such as the Intel Xeon Phi, and massively parallel GPUs. The dedicated optimization of a particle advection kernel for each individual target architecture is both time-consuming and error prone. In this paper, we propose a performance-portable algorithm for particle advection. Our algorithm is based on the recently introduced VTK-m system and chiefly relies on its device adapter abstraction. We demonstrate the general portability of our implementation across a wide variety of hardware. Finally, our evaluation shows that our hardware-agnostic algorithm has comparable performance to hardware-specific algorithms.

Pugmire, Dave↗

DOE OSTI2019

Extreme-Scale Stochastic Particle Tracing for Uncertain Unsteady Flow Visualization and Analysis

We present an efficient and scalable solution to estimate uncertain transport behaviors-stochastic flow maps (SFMs)-for visualizing and analyzing uncertain unsteady flows. Computing flow maps from uncertain flow fields is extremely expensive because it requires many Monte Carlo runs to trace densely seeded particles in the flow. We reduce the computational cost by decoupling the time dependencies in SFMs so that we can process shorter sub time intervals independently and then compose them together for longer time periods. Adaptive refinement is also used to reduce the number of runs for each location. We parallelize over tasks-packets of particles in our design-to achieve high efficiency in MPI/thread hybrid programming. Such a task model also enables CPU/GPU coprocessing. We show the scalability on two supercomputers, Mira (up to 256K Blue Gene/Q cores) and Titan (up to 128K Opteron cores and 8K GPUs), that can trace billions of particles in seconds.

CPU-GPU hybrid parallelism↗

DOE OSTI2015

A multi-species collisional operator for full-F gyrokinetics

A linearized multi-species collision operator has been developed for an efficient implementation in gyrokinetic codes. This operator satisfies the main expected properties: particle, momentum, and energy conservation, and existence of an H-theorem. A gyrokinetic version is then calculated, which involves derivatives with respect to the gyrocenter position, parallel velocity, and magnetic momentum. An isotropic version in the velocity space can be constructed for the specific problem of trace impurities colliding with a main species. A simpler version that involves derivatives with parallel velocity only has been developed. This reduced version has been implemented in the GYSELA gyrokinetic code, and is shown to comply with particle, momentum, and energy conservation laws. Moreover, the interspecies relaxation rates for momentum and energy agree very well with the theoretical values.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Attribute-Aware RBFs: Interactive Visualization of Time Series Particle Volumes Using RT Core Range Queries

Smoothed-particle hydrodynamics (SPH) is a mesh-free method used to simulate volumetric media in fluids, astrophysics, and solid mechanics. Visualizing these simulations is problematic because these datasets often contain millions, if not billions of particles carrying physical attributes and moving over time. Radial basis functions (RBFs) are used to model particles, and overlapping particles are interpolated to reconstruct a high-quality volumetric field; however, this interpolation process is expensive and makes interactive visualization difficult. Existing RBF interpolation schemes do not account for color-mapped attributes and are instead constrained to visualizing just the density field. To address these challenges, we exploit ray tracing cores in modern GPU architectures to accelerate scalar field reconstruction. We use a novel RBF interpolation scheme to integrate per-particle colors and densities, and leverage GPU-parallel tree construction and refitting to quickly update the tree as the simulation animates over time or when the user manipulates particle radii. We also propose a Hilbert reordering scheme to cluster particles together at the leaves of the tree to reduce tree memory consumption. Finally, we reduce the noise of volumetric shadows by adopting a spatially temporal blue noise sampling scheme. Our method can provide a more detailed and interactive view of these large, volumetric, time-series particle datasets than traditional methods, leading to new insights into these physics simulations.

Particle Volumes↗

DOE OSTI2015

Perpendicular diffusion of energetic particles: Numerical test of the theorem on reduced dimensionality

A fundamental statement in diffusion theory is provided by the so-called theorem on reduced dimensionality. The latter theorem is saying that if the dimensionality of the turbulence is reduced, charged particles are tied to a single magnetic field line. If there is pitch-angle scattering and therewith parallel diffusion, this usually means that perpendicular transport is subdiffusive. Subdiffusive transport was found in numerous simulations for slab turbulence. However, it was unclear whether the theorem is valid for other models with reduced dimensionality such as the two-dimensional model. In the current paper, we simultaneously trace magnetic field lines and energetic particles and we compute the distance between the particle and the initial field line. We confirm the aforementioned theorem for slab turbulence but we cannot confirm it for two-dimensional turbulence. We also show that particles are not tied to field lines for two-component turbulence.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2014

Electronics for a Picosecond Time-of-flight Measurement

TITLE: Electronics for a Picosecond Time-of-flight Measurement ABSTRACT: Time-of-flight (TOF) detectors have historically been used as part of the particle identification capability of multi-purpose particle physics detectors. An accurate time measurement, combined with a momentum measurement based on the curvature of the track in a magnetic field, is often sufficient to determine the particle's mass, and thus its identity. Such detectors typically have measured the particle flight time extremely precisely, with an uncertainty of one hundred trillionths of a second (also referred to as 100 picoseconds). To put this in perspective it would be like counting all the people on the Earth and getting it right within 1 person! Another use of TOFs is to measure the vertex of the event, which is the location along the beam line where the incoming particles (typically protons) collide. This vertex positon is a well measured quantity for events where the protons collide “head on” as the outgoing particles produced when you blast the proton apart can be used to trace back to a vertex point from which they originated. More frequently the protons just strike a glancing blow and remain intact—in this case they are nearly parallel to the beam and you cannot tell their vertex without this ability to precisely measure the time of flight of the protons. Occasionally both happen in the same event, that is, a central system and two protons are produced. But are they from the same collision, or just a boring background where more than one collision in the same bunch crossing conspire to fake the signal of interest? That’s where the timing of the protons comes into play. The main idea is to measure the time it takes for the two protons to reach TOF detectors positioned equidistant from the center of the main detector. If the vertex is displaced to one side than that detector will measure a shorter time while the other side detector will measure a correspondingly longer time. Taking into account the speed of the particles, which is very close to the speed of light, an accuracy of 100 ps gives a vertex measurement of a few cm or a little more than an inch. At the Large Hadron Collider, where there are up to a hundred billion protons per bunch, and the collision region is compressed to a few inches, that is just not good enough. A higher level of precision is needed to determine whether the vertex of the protons and that of the central system are the same. A factor 10 improvement in the timing measurement to the 10 trillionths of a second level, for example would give the requisite 10 times improvement in the vertex measurement. An accurate measurement of the flight time depends on three key elements: the radiator that produces light when the proton passes through it, the photo-sensor that converts the light to an electrical signal, and the electronics that convert this electrical signal into a time measurement with a compact recordable format. With recent improvements in detector design featuring a series of quartz radiators connected to a micro-channel plate photomultiplier tube, this superior measurement capability is within reach if the readout electronics are sufficiently performant. As a result of the funding of this proposal, we have achieved our primary goals. 1) We have developed from scratch or improved upon existing designs of the full chain of electronics that can maintain the performance of a TOF detector from the output of the photo-sensor to the recording of a compressed data packet containing the timing information. We have accomplished this with a cost effective modular approach such that some or all of the components in the chain could easily be adapted for use in diverse particle physics experiments or in other areas where precise timing is required, such as medical and homeland security devices.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2016

A NUMERICAL SIMULATION OF COSMIC RAY MODULATION NEAR THE HELIOPAUSE. II. SOME PHYSICAL INSIGHTS

Cosmic ray (CR) transport near the heliopause (HP) is studied using a hybrid transport model, with the parameters constrained by observations from the Voyager 1 spacecraft. We simulate the CR radial flux along different directions in the heliosphere. There is no well-defined thin layer between the solar wind region and the interstellar region along the tail and polar directions of the heliosphere. By analyzing the radial flux curve along the direction of Voyager 2 , together with its trajectory information, the crossing time of the HP by Voyager 2 is predicted to be in 2017.14. We simulate the CR radial flux for different energy values along the direction of Voyager 1 . We find that there is only a modest modulation region of about 10 au wide beyond the HP, so that Voyager 1 observing the Local Interstellar Spectra is justified in numerical modeling. We analyze the heliospheric exit information of pseudo-particles in our stochastic numerical (time-backward) method, conjecturing that they represent the behavior of CR particles, and we find that pseudo-particles that have been traced from the nose region exit in the tail region. This implies that many CR particles diffuse directly from the heliospheric tail region to the nose region near the HP. In addition, when pseudo-particles were traced from the Local Interstellar Medium (LISM), it is found that their exit location (entrance for real particles) from the simulation domain is along the prescribed Interstellar Magnetic Field direction. This indicates that parallel diffusion dominates CR particle transport in the LISM.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Neptunium mononitride as a target material for Pu-238 production

Deep space exploration requires specialized sources for both thermal and power applications. Radioactive decay heat of plutonium-238 (238Pu) provides these sources in the form of radioisotope thermoelectric generators (RTGs). The 238 Pu is produced via neutron capture reaction involving neptunium-237 ( 237 Np) target material. Continual optimization of 237 Np target materials and evaluation of potential alternative targets for production of 238 Pu RTGs are advantageous for meeting ongoing space power system resource requirements. Current production of 238 Pu for RTGs for the United States space program utilizes neptunium dioxide ( 237 NpO 2 ) targets; however, the use of neptunium mononitride ( 237 NpN) presents an opportunity to increase the mass of 237 Np per target compared to the dioxide form, as well as increase the thermal conductivity of the target. To assess the viability of a 237 NpN target material, the material chemistry must be thoroughly evaluated, including synthesis methods and dissolution and reprocessing schemes. This review presents a summary of synthesis pathways for 237 NpN based on published literature on actinide mononitrides. Specific literature on 237 NpN is limited, necessitating evaluation of other actinide systems to gather parallels. This suggests a need for additional experimental studies on 237 NpN. A particular limitation in the existing literature is a lack of information on the differences in material characteristics, such as morphology, particle size, and trace chemical impurities, as a function of synthesis method. These parameters may affect subsequent reactor performance or dissolution of irradiated targets. The evaluation of existing literature is presented with a focus on the efficacy of 237 NpN targets for 238 Pu production.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2015

Fully coupled simulation of cosmic reionization. I. numerical methods and tests

Here, we describe an extension of the Enzo code to enable fully coupled radiation hydrodynamical simulation of inhomogeneous reionization in large similar to(100 Mpc)(3) cosmological volumes with thousands to millions of point sources. We solve all dynamical, radiative transfer, thermal, and ionization processes self-consistently on the same mesh, as opposed to a postprocessing approach which coarse-grains the radiative transfer. But, we employ a simple subgrid model for star formation which we calibrate to observations. The numerical method presented is a modification of an earlier method presented in Reynolds et al. differing principally in the operator splitting algorithm we use to advance the system of equations. Radiation transport is done in the gray flux-limited diffusion (FLD) approximation, which is solved by implicit time integration split off from the gas energy and ionization equations, which are solved separately. This results in a faster and more robust scheme for cosmological applications compared to the earlier method. The FLD equation is solved using the hypre optimally scalable geometric multigrid solver from LLNL. By treating the ionizing radiation as a grid field as opposed to rays, our method is scalable with respect to the number of ionizing sources, limited only by the parallel scaling properties of the radiation solver. We test the speed and accuracy of our approach on a number of standard verification and validation tests. We show by direct comparison with Enzo's adaptive ray tracing method Moray that the well-known inability of FLD to cast a shadow behind opaque clouds has a minor effect on the evolution of ionized volume and mass fractions in a reionization simulation validation test. Finally, we illustrate an application of our method to the problem of inhomogeneous reionization in a 80 Mpc comoving box resolved with 3200(3) Eulerian grid cells and dark matter particles.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2015

Electron acceleration by parallel and perpendicular electric fields during magnetic reconnection without guide field

In this work, electron acceleration due to the electric field parallel to the background magnetic field during magnetic reconnection with no guide field is investigated by theory and two-dimensional electromagnetic particle-in-cell simulations and compared with acceleration due to the electric field perpendicular to the magnetic field. The magnitude of the parallel electric potential shows dependence on the ratio of the plasma frequency to the electron cyclotron frequency as (ω pe /Ω e ) -2 and on the background plasma density as N$^{-½}_{b}$ . In the Earth's magnetotail, the parameter ω pe /Ω e ~9 and the background (lobe) density can be of the order of 0.01 cm -3 , and it is expected that the parallel electric potential is not large enough to accelerate electrons up to 100 keV. Therefore, we must consider the effect of the perpendicular electric field to account for electron energization in excess of 100 keV in the Earth's magnetotail. Trajectories for high-energy electrons are traced in a simulation to demonstrate that acceleration due to the perpendicular electric field in the diffusion region is the dominant acceleration mechanism, rather than acceleration due to the parallel electric fields in the exhaust regions. For energetic electrons accelerated near the X line due to the perpendicular electric field, pitch angle scattering converts the perpendicular momentum to the parallel momentum. On the other hand, for passing electrons that are mainly accelerated by the parallel electric field, pitch angle scattering converting the parallel momentum to the perpendicular momentum occurs. In this way, particle acceleration and pitch angle scattering will generate heated electrons in the exhaust regions.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2016

Collaborative Project. 3D Radiative Transfer Parameterization Over Mountains/Snow for High-Resolution Climate Models. Fast physics and Applications

Under the support of the aforementioned DOE Grant, we have made two fundamental contributions to atmospheric and climate sciences: (1) Develop an efficient 3-D radiative transfer parameterization for application to intense and intricate inhomogeneous mountain/snow regions. (2) Innovate a stochastic parameterization for light absorption by internally mixed black carbon and dust particles in snow grains for understanding and physical insight into snow albedo reduction in climate models. With reference to item (1), we divided solar fluxes reaching mountain surfaces into five components: direct and diffuse fluxes, direct- and diffuse-reflected fluxes, and coupled mountain-mountain flux. “Exact” 3D Monte Carlo photon tracing computations can then be performed for these solar flux components to compare with those calculated from the conventional plane-parallel (PP) radiative transfer program readily available in climate models. Subsequently, Parameterizations of the deviations of 3D from PP results for five flux components are carried out by means of the multiple linear regression analysis associated with topographic information, including elevation, solar incident angle, sky view factor, and terrain configuration factor. We derived five regression equations with high statistical correlations for flux deviations and successfully incorporated this efficient parameterization into WRF model, which was used as the testbed in connection with the Fu-Liou-Gu PP radiation scheme that has been included in the WRF physics package. Incorporating this 3D parameterization program, we conducted simulations of WRF and CCSM4 to understand and evaluate the mountain/snow effect on snow albedo reduction during seasonal transition and the interannual variability for snowmelt, cloud cover, and precipitation over the Western United States presented in the final report. With reference to item (2), we developed in our previous research a geometric-optics surface-wave approach (GOS) for the computation of light absorption and scattering by complex and inhomogeneous particles for application to aggregates and snow grains with external and internal mixing structures. We demonstrated that a small black (BC) particle on the order of 1 μm internally mixed with snow grains could effectively reduce visible snow albedo by as much as 5–10%. Following this work and within the context of DOE support, we have made two key accomplishments presented in the attached final report.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Computing material volume fractions on a superimposed mesh as applied to Monte Carlo particle transport simulations

Here, we present a newly implemented ray tracing algorithm in OpenMC for efficiently computing material volume fractions on superimposed meshes in complex geometries. By firing rays along each coordinate direction through the geometry, the approach accumulates track-length data in each mesh element, thereby determining the fractional composition of each material. Scaling studies on three different models—a random tetrahedra configuration, the Frascati Neutron Generator ITER dose rate benchmark, and a stellarator design—show excellent parallel performance, with nearly linear speedup on modern multi-threaded and distributed-memory systems. An analysis of the residual error relative to high-resolution reference solutions demonstrated that under optimal conditions it decreases as 1/R, where R is the number of rays fired, making it straightforward to achieve user-prescribed accuracy. This new functionality enables practical, mesh-based approaches for detailed nuclear analyses in production Monte Carlo workflows without resorting to expensive, fully conformal or unstructured meshing.

Monte Carlo↗

DOE OSTI2017

SCIDAC Center for simulation of wave particle interactions CompX participation

Harnessing the energy that is released in fusion reactions would provide a safe and abundant source of power to meet the growing energy needs of the world population. The next step toward the development of fusion as a practical energy source is the construction of ITER, a device capable of producing and controlling the high performance plasma required for self-sustaining fusion reactions, or “burning” plasma. The input power required to drive the ITER plasma into the burning regime will be supplied primarily with a combination of external power from radio frequency waves in the ion cyclotron range of frequencies and energetic ions from neutral beam injection sources, in addition to internally generated Ohmic heating from the induced plasma current that also serves to create the magnetic equilibrium for the discharge. The ITER project is a large multi-billion dollar international project in which the US participates. The success of the ITER project depends critically on the ability to create and maintain burning plasma conditions, it is absolutely necessary to have physics-based models that can accurately simulate the RF processes that affect the dynamical evolution of the ITER discharge. The Center for Simulation of WavePlasma Interactions (CSWPI), also known as RF-SciDAC, is a multi-institutional collaboration that has conducted ongoing research aimed at developing: (1) Coupled core-to-edge simulations that will lead to an increased understanding of parasitic losses of the applied RF power in the boundary plasma between the RF antenna and the core plasma; (2) Development of models for core interactions of RF waves with energetic electrons and ions (including fusion alpha particles and fast neutral beam ions) that include a more accurate representation of the particle dynamics in the combined equilibrium and wave fields; and (3) Development of improved algorithms that will take advantage of massively parallel computing platforms at the petascale level and beyond to achieve the needed physics, resolution, and/or statistics to address these issues. CompX provides computer codes and analysis for the calculation of the electron and ion distributions in velocity-space and plasma radius which are necessary for reliable calculations of power deposition and toroidal current drive due to combined radiofrequency and neutral beam at high injected powers. It has also contributed to ray tracing modeling of injected radiofrequency powers, and to coupling between full-wave radiofrequency wave models and the distribution function calculations. In the course of this research, the Fokker-Planck distribution function calculation was made substantially more realistic by inclusion of finite-width drift-orbit effects (FOW). FOW effects were also implemented in a calculation of the phase-space diffusion resulting from radiofrequency full-wave models. Average level of funding for CompX was approximately three man-months per year.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Threadsafe Dynamic Neighbor Lists for Monte Carlo Ray Tracing

Monte Carlo (MC) transport codes offer high-fidelity modeling of particle transport physics, but their high computational cost makes them impractical for many applications. For some applications such as multiphysics and depletion that use finely discretized geometries, a large portion of this computational cost is attributable to ray tracing. Neighbor lists are a well-known method for accelerating ray-tracing calculations in a MC code, but despite their prevalence, little work has been published on the details of their implementation. The fine details can have a significant impact on performance, particularly when using shared-memory parallelism. This paper addresses these details of implementation with a discussion of different neighbor list schemes and their impact on software runtime. Performance tests were run by using OpenMC on a pin-cell problem discretized with up to 200 axial regions. The results demonstrate that switching from surface-based to cell-based neighbor lists leads to a 10 faster calculation rate for the most fine discretization. Finally, using a threadsafe shared-memory data structure results in a 20% faster calculation rate versus simple threadprivate neighbor lists. Results here show that a data structure that is contiguous in memory improves performance by only 1% to 2% over noncontiguous linked lists.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗