Search NASA⌕ Search

DOE OSTI · 22991920

Multi-node and Multi-core Performance Studies of a Monte Carlo code RMC

Abstract

Over the past 15 years the architecture of high-performance computing systems has become increasingly heterogeneous with individual computing cores being subdivided into nodes and even auxiliary co-processing units such as graphics processing units or the Intel many integrated core co-processors. In fact, future computer platforms is moving toward a larger number of nodes and cores with lower memory available per node. Today, several production Monte Carlo codes use some types of hybrid parallelism strategy that makes use of shared-memory parallelism within a computing node and message-passing parallelism between nodes, which enables the codes to utilize available computing resources as much as possible, both among and within computing nodes on a cluster. The so-called hybrid parallelization is also possible with Reactor Monte Carlo Code RMC by activating both MPI and OpenMP parallel algorithms together. On HPC' which typically consists of several or several-ten thousand nodes equipping 16-32 computing intra-cores per node, simulation of RMC can be carried out in the hybrid parallelization with the MPI inter-node parallelization and the OpenMP intra-node parallelization. RMC has adopted a hybrid message-passing and shared-memory approach to parallelism, which enables the code to utilize available computing resources, both among and within computing nodes on a cluster. Shared-memory parallelism is especially valuable for large-model simulations because it enables multiple compute cores within a node to share common model information such as the geometry description, material, cross section and tally data, thus reducing the memory usage per processor. The calculation on the Tianhe-2 supercomputer took 6144 cores, resulting in a rate of 173,314,000 neutrons/minute for BEAVRS benchmark. While pin-wise full core H-M benchmark burnup calculations with millions of depletion regions was selected using MPI/OpenMP parallelism, the speed of 6,144 cores reach 1,843,200 burnable regions per minute. Keeping up with the continuing trend for increases in the number of computing resources within modern HPC systems is a significant challenge for teams that develop and maintain high-performance MC radiation transport solvers. order to address this challenge, RMC has adopted a hybrid message-passing and shared-memory approach to parallelism, which enables the code to utilize available computing resources, both among and within computing nodes on a cluster. Shared-memory parallelism is especially valuable for large-model simulations because it enables multiple compute cores within a node to share common model information such as the geometry description, material and composition definitions, and cross section data, thus reducing the memory usage per processor. The parallel performance has been studied by using two complex and representative benchmarks, H-M and BEAVRS benchmark. All simulations were run on Intel Xeon E5-2692 12 core, 2.2 GHz processors at MilkyWay-2 Super Computer with up to 12,288 available computing cores. While employing MPI parallelism, excellent parallel efficiency is achieved even above 12,000 processors and RMC reaches the parallel efficiency of 96% on 12,288 cores for the pin-by-pin computation of the BEAVRS benchmark. While BEAVRS criticality benchmark was selected using MPI/OpenMP parallelism, the speed of 6,144 cores reach 173,314,000 particles per minute. While pin-wise full core H-M benchmark burnup calculations with millions of depletion regions was selected using MPI/OpenMP parallelism, the speed of 6,144 cores reach 1,843,200 burnable regions per minute. Results from these studies demonstrate that RMC, using the hybrid parallel model described in this paper, is able to handle pin-wise full core burnup calculations with millions of depletion regions and scales well through thousands of processors. (authors)

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yang, Feng, Yu, GangLin, Liang, JinGang, Wang, Kan. 2016-06-15. Multi-node and Multi-core Performance Studies of a Monte Carlo code RMC. https://www.osti.gov/biblio/22991920

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Design-informed neutronics assessment of long-lived fission product transmutation in a tokamak fusion reactor blanket

This study presents a neutronics-based assessment of the feasibility and viability of transmuting six major long-lived fission products (LLFPs) from light-water reactors, namely 99 Tc, 129 I, 79 Se, 93 Zr, 126 Sn, and 135 Cs, within the blanket region of a tokamak fusion reactor, using the MIT ARC design as a concrete fusion configuration. Monte Carlo neutronics simulations were performed to evaluate LLFP transmutation and to compare the results with a reference boiling water reactor (BWR). The results indicate that transmutation of all six LLFPs is neutronics-feasible in fusion reactors, with transmutation half-lives significantly shorter than their natural decay half-lives. For elemental targets, transmutation of 135 Cs, 126 Sn, and 93 Zr was found potentially viable, as the net mass transmuted exceeded that achievable in the reference BWR under identical target volume and irradiation time. When isotopically separated targets were considered, transmutation of 126 Sn and 93 Zr appeared potentially viable. A parametric study demonstrated that plasma geometry modifications can enhance local neutron flux, increasing the transmuted 93 Zr mass by approximately 33% and reducing the transmutation half-life from approximately 240 years to 180 years. Repositioning the target and adjusting material layer thickness reduced the transmutation half-life of 93 Zr to 67 years and increased the net mass transmuted by a factor of 50. Furthermore, these results demonstrate that fusion reactors can enable LLFP transmutation beyond the practical limits of thermal fission reactors and highlight the critical role of reactor and blanket design optimization. Engineering and fuel-cycle considerations required for deployment are beyond the scope of this neutronics-focused study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A hybrid Monte Carlo-deterministic second moment method with efficient variance reduction

In this work, we present a hybrid method that combines Monte Carlo with deterministic finite element methods to solve a linear Boltzmann transport equation. Our hybrid method runs orders of magnitude faster than Monte Carlo, without sacrificing accuracy, for a proxy problem from radiative transfer that contains both optically-thick and optically-thin material. We believe that this is the first demonstration of a hybrid Second Moment Method in more than one spatial dimension, the first to consider more than one material, and the first to use variance reduction. Our variance reduction approach arises from an asymptotic analysis in which we show that the magnitude of the scattering source grows without bound. We transform the problem to compute the deviation of the radiation intensity from isotropy. The magnitude of the source in the transformed problem is bounded, and the quality of the hybrid method solution is dramatically improved by a substantial reduction in the variance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗