Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Theoretical Investigations of Nano and Bio Structures

The PI was supported by the DOE grant entitled “Theoretical Investigations of Nano and Bio Structures,” 3/1/13-2/28/17, $440,000, and a one-year no cost extension, 3/1/17-2/28/18. Its main emphasis was on nonequilibrium electron transport and novel nanoscale materials and devices, such as graphene nanoribbons, nanotube-based sensors, nanocircuits able to detect DNA replication, and DNA nanowires. We have also made major enhancements to our RMG suite of electronic structure codes, leading to much increased scalability, excellent parallelization of across both CPU and GPU nodes, and cleaner, refactored code base. For example, RMG performs excellently on Summit, DOE’s flagship supercomputer and the fastest supercomputer in the world. It scales to over 100,000 CPU cores and 20,000 GPUs, and can use multiple GPUs per node. It performs 80x faster per node than on DOE’s previous flagship supercomputer, Titan. This is the final report for grant DE-FG02-98ER45685.

36 MATERIALS SCIENCE↗

Composite Analysis Vadose Zone Transport of Selected Radionuclides Released from DOE O 435.1 Sources.

The main objectives of the composite analysis (CA) compliance case vadose zone (VZ) facet are to simulate transport of radionuclide releases from the surface to the water table, and to provide radionuclide transfer rates to groundwater for inclusion into the Plateau-to-River (P2R) saturated zone (SZ) model (CP-57037, Model Package Report: Plateau to River Groundwater Model, Version 8.3). The parallel exascale version of the Subsurface Transport Over Multiple Phases (eSTOMP1) simulator is used to simulate flow and transport for the CA VZ models. The CA compliance case approach to address the scale and distribution of contaminant sources in the VZ facet is to subdivide the Hanford Site Central Plateau into 26 models that contain contaminant sources and liquid discharges likely to commingle during migration through the VZ to the water table.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Composite Analysis Vadose Zone Transport of Selected Hanford Site Composite Analysis: Vadose Zone Transport of Selected Radionuclides Released from DOE O 435.1 Waste Sites

The main objectives of the composite analysis (CA) compliance case vadose zone (VZ) facet are to simulate transport of radionuclide releases from the surface to the water table, and to provide radionuclide transfer rates to groundwater for inclusion into the Plateau-to-River (P2R) saturated zone (SZ) model (CP-57037, Model Package Report: Plateau to River Groundwater Model, Version 8.3). The parallel exascale version of the Subsurface Transport Over Multiple Phases (eSTOMP) simulator is used to simulate flow and transport for the CA VZ models. The CA compliance case approach to address the scale and distribution of contaminant sources in the VZ facet is to subdivide the Hanford Site Central Plateau into 26 models that contain contaminant sources and liquid discharges likely to commingle during migration through the VZ to the water table.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Magnetic Reconnection in Solar Flares [Slides]

Magnetic reconnection is the underlying mechanism in solar flares. Magnetic reconnection is an astrophysical process in an electrically conducting plasma where neighboring magnetic field lines running anti-parallel break and reconnection therefore exchanging the direction of their paths. The result of this process is the magnetic field energy converting to kinetic and thermal energy which is explosively released. The scale of a solar is extremely large compared to Earth so kinetic simulations are unable to portray an accurate model. In this project, we are using an astrophysical magnetohydrodynamic (MHD) simulation code known as Athena++ with the reconnection problem generator file created by Li et al. 2018. To further study this simulation, we began testing a heating/cooling term. The results of the original file will be compared with the modified file with an implemented heating/cooling term to better understand how solar flares function.

79 ASTRONOMY AND ASTROPHYSICS↗

5G Securely Energized and Resilient: (5G-SER) (Final Report)

NREL's work on 5G integration with physical power systems (versus simulated systems demonstrated in task 3) under 5G-Securely Energized and Resilient (5G-SER) achieved a major milestone in with the completion of Task 4 activities. After many months (6+) of planning and development along with scaling challenges along the way, a full 5G end-to-end network with physical hardware components (physical inverter, physical power panel, physical battery, etc.) was deployed in a containerized environment. In parallel, a distributed controls architecture for a microgrid powering 5G resources was also successfully modified from its previous instantiation for a simulated environment to work with these physical components. These accomplishments set the stage to use newly setup 5G technology with physical microgrid components to test the feasibility of 5G wireless with physical systems to enable resilient communications between controls and distributed solar and storage resources while exploring ways to configure 5G components to survive power disturbances. The results detailed in the report below show that even utilizing physical components, 5G wireless systems were able to provide resilient results that were similar to the results from the simulated environment Task 3).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Cosmic-Ray Diffusion Coefficients throughout the Inner Heliosphere from a Global Solar Wind Simulation

We use a three-dimensional magnetohydrodynamic simulation of the solar wind to calculate cosmic-ray diffusion coefficients throughout the inner heliosphere (2 R{sub ⊙}−3 au). The simulation resolves large-scale solar wind flow, which is coupled to small-scale fluctuations through a turbulence model. Simulation results specify background solar wind fields and turbulence parameters, which are used to compute diffusion coefficients and study their behavior in the inner heliosphere. The parallel mean free path (mfp) is evaluated using quasi-linear theory, while the perpendicular mfp is determined from nonlinear guiding center theory with the random ballistic interpretation. Several runs examine varying turbulent energy and different solar source dipole tilts. We find that for most of the inner heliosphere, the radial mfp is dominated by diffusion parallel to the mean magnetic field; the parallel mfp remains at least an order of magnitude larger than the perpendicular mfp, except in the heliospheric current sheet, where the perpendicular mfp may be a few times larger than the parallel mfp. In the ecliptic region, the perpendicular mfp may influence the radial mfp at heliocentric distances larger than 1.5 au; our estimations of the parallel mfp in the ecliptic region at 1 au agree well with the Palmer “consensus” range of 0.08–0.3 au. Solar activity increases perpendicular diffusion and reduces parallel diffusion. The parallel mfp mostly varies with rigidity (P) as P{sup .33}, and the perpendicular mfp is weakly dependent on P. The mfps are weakly influenced by the choice of long-wavelength power spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

Scaling molecular dynamics beyond 100,000 processor cores for large-scale biophysical simulations

The growing interest in the complexity of biological interactions is continuously driving the need to increase system size in biophysical simulations, requiring not only powerful and advanced hardware but adaptable software that can accommodate a large number of atoms interacting through complex force fields. To address this, we developed and implemented strategies in the GENESIS molecular dynamics package designed for large numbers of processors. Long–range electrostatic interactions were parallelized by minimizing the number of processes involved in communication. Here, a novel algorithm was implemented for nonbonded interactions to increase single instruction multiple data (SIMD) performance, reducing memory usage for ultra large systems. Memory usage for neighbor searches in real–space nonbonded interactions was reduced by approximately 80%, leading to significant speedup. Using experimental data describing physical 3D chromatin interactions, we constructed the first atomistic model of an entire gene locus (GATA4). Taken together, these developments enabled the first billion–atom simulation of an intact biomolecular complex, achieving scaling to 65,000 processes (130,000 processor cores) with 1 ns/day performance.

3D modeling↗

Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

The present work investigates the modeling of preexascale input/output (I/O) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple “kernel” approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear “static” I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.

Godoy, William↗

Massively Parallel Bayesian Model Calibration and Uncertainty Quantification with Applications to Nuclear Fuels and Materials

The U.S. Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program aims to develop predictive capabilities by applying computational methods to the analysis and design of advanced reactor and fuel cycle systems. This program has been providing engineering-scale support for the development of BISON, a high-fidelity and high-resolution fuel performance tool. Fuel behavior in a nuclear reactor is governed by a complex network of mechanisms interacting with various other physics aspects in the reactor system. Any model developed to represent the fuel behavior will likely be idealized resulting in uncertainties in their predictions compared to the observed data. As such, this report was motivated by the need to identify the sources of uncertainties and quantify and propagate them through the fuel model outputs. Such quantification of uncertainties will establish a level of model trustworthiness, identify approaches to improve the model trustworthiness, and even guide optimal experiment design for maximal information gain. To accomplish the uncertainty quantification for computational models, this report has relied on the Bayesian framework which provides probabilistic treatment of models their inputs and outputs. The current state-of-the-art on performing Bayesian Uncertainty Quantification (UQ) for nuclear engineering models using High Performance Computing (HPC) resources have been reviewed. Implementation of capabilities for massively parallel Bayesian UQ in Multiphysics Object-Oriented Simulation Environment (MOOSE) is discussed. Several verification cases are discussed to verify the accuracy of the quantified uncertainties using the developed computational capabilities in MOOSE. Then, the problem of quantifying the uncertainties in TRI-Structural isOtropic (TRISO) fuel silver release is addressed. For the first time, the uncertainties arising from the TRISO Fission Gas Release (FGR) model due to model inadequacy and experimental noise are quantified. Also, the Bayesian capabilities are applied to the calibration of the MATPRO creep model, a widely used model in several fuel assessment cases. The impact of the prediction uncertainties in the MATPRO model on the fuel cladding behavior as part of the TRIBULATION assessment case (which is an integral effects case) is investigated. This report concludes with a discussion on the future work for the UQ for computational models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SAGIPS: a physics-inspired scalable asynchronous generative inverse-problem solver

Abstract Solving large-scale inverse problems using deep-learning algorithms have become an essential part of modern research and industrial applications. The complexity of the underlying inverse problem may require the utilization of high performance computing systems which poses a challenge on the algorithmic design of the inverse problem solver. Most deep learning algorithms require, due to their design, custom parallelization techniques in order to be resource efficient while showing a reasonable convergence. In this paper we introduce a S calable A synchronous G enerative I nverse P roblem S olver (SAGIPS) on high-performance computing systems. We present a workflow that utilizes an asynchronous ring-allreduce algorithm to transfer the gradients of the generator network across multiple GPUs. Experiments with a scientific proxy application demonstrate that SAGIPS shows near linear weak scaling, together with a convergence quality that is comparable to traditional methods. The approach presented here allows leveraging Generative Adverserial Network across multiple GPUs, promising advancements in solving complex inverse problems at scale.

97 MATHEMATICS AND COMPUTING↗

GPU Acceleration of Large-Scale Full-Frequency GW Calculations

Many-body perturbation theory is a powerful method to simulate electronic excitations in molecules and materials starting from the output of density functional theory calculations. By implementing the theory efficiently so as to run at scale on the latest leadership high-performance computing systems it is possible to extend the scope of GW calculations. Here, we present a GPU acceleration study of the full-frequency GW method as implemented in the WEST code. Excellent performance is achieved through the use of (i) optimized GPU libraries, e.g., cuFFT and cuBLAS, (ii) a hierarchical parallelization strategy that minimizes CPU-CPU, CPU-GPU, and GPU-GPU data transfer operations, (iii) nonblocking MPI communications that overlap with GPU computations, and (iv) mixed precision in selected portions of the code. A series of performance benchmarks has been carried out on leadership high-performance computing systems, showing a substantial speedup of the GPU-accelerated version of WEST with respect to its CPU version. Good strong and weak scaling is demonstrated using up to 25 920 GPUs. Finally, we showcase the capability of the GPU version of WEST for large-scale, full-frequency GW calculations of realistic systems, e.g., a nanostructure, an interface, and a defect, comprising up to 10 368 valence electrons.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sub-Alfvénic Turbulence: Magnetic-to-kinetic Energy Ratio, Modification of Weak Cascade, and Implications for Magnetic Field Strength Measurements

Abstract We study the properties of sub-Alfvénic magnetohydrodynamic (MHD) turbulence, i.e., turbulence with Alfvén mach number M A = V L / V A < 1, where V L is the velocity at the injection scale and V A is the Alfvén velocity. We demonstrate that MHD turbulence can have different properties, depending on whether it is driven by velocity or magnetic fluctuations. If the turbulence is driven by isotropic bulk forces acting upon the fluid, i.e., is velocity driven, in an incompressible conducting fluid we predict that the kinetic energy is M A − 2 times larger than the energy of magnetic fluctuations. This effect arises from the long parallel wavelength tail of the forcing, which excites modes with k ∥ / k ⊥ < M A . We also predict that as the MHD turbulent cascade reaches the strong regime, the energy of slow modes exceeds the energy of Alfvén modes by a factor M A − 1 . These effects are absent if the turbulence is driven through magnetic fluctuations at the injection scale. We confirm our predictions with numerical simulations. Since the assumption of magnetic and kinetic energy equipartition is at the core of the Davis–Chandrasekhar–Fermi (DCF) approach to measuring magnetic field strength in sub-Alfvénic turbulence, we conclude that the DCF technique is not universally applicable. In particular, we suggest that the dynamical excitation of long azimuthal wavelength modes in the galactic disk may compromise the use of the DCF technique. We discuss alternative expressions that can be used to obtain magnetic field strength from observations and consider ways of distinguishing the cases of velocity and magnetically driven turbulence using observational data.

79 ASTRONOMY AND ASTROPHYSICS↗

The G2 erosion model: An algorithm for month-time step assessments

Highlights: • G2 is a soil erosion model for developing monthly erosion maps at regional scale. • G2 enhances the spatio-temporal variability of cover management and erosivity factors. • The V-factor models the impact of vegetation cover, land use and imperviousness layer. • G2 uses data from ESDAC, LUCAS, COPERNICUS, CORINE, SENTINEL and EU-DEM databases. • G2 has been applied in Strymonas Catchment, Crete, Cyprus and Albania catchments. A detailed description of the G2 erosion model is presented, in order to support potential users. G2 is a complete, quantitative algorithm for mapping soil loss and sediment yield rates on month-time intervals. G2 has been designed to run in a GIS environment, taking input from geodatabases available by European or other international institutions. G2 adopts fundamental equations from the Revised Universal Soil Loss Equation (RUSLE) and the Erosion Potential Method (EPM), especially for rainfall erosivity, soil erodibility, and sediment delivery ratio. However, it has developed its own equations and matrices for the vegetation cover and management factor and the effect of landscape alterations on erosion. Provision of month-time step assessments is expected to improve understanding of erosion processes, especially in relation to land uses and climate change. In parallel, G2 has full potential to decision-making support with standardised maps on a regular basis. Geospatial layers of rainfall erosivity, soil erodibility, and terrain influence, recently developed by the Joint Research Centre (JRC) on a European or global scale, will further facilitate applications of G2.

54 ENVIRONMENTAL SCIENCES↗

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Kurte, Kuldeep↗

A Massively Parallel Implementation of the CCSD(T) Method Using the Resolution-of-the-Identity Approximation and a Hybrid Distributed/Shared Memory Parallelization Model

In this work, a parallel algorithm is described for the coupled-cluster singles and doubles method augmented with a perturbative correction for triple excitations [CCSD(T)] using the resolution-of-the-identity (RI) approximation for two-electron repulsion integrals (ERIs). The algorithm bypasses the storage of four-center ERIs by adopting an integral-direct strategy. The CCSD amplitude equations are given in a compact quasi-linear form by factorizing them in terms of amplitude-dressed three-center intermediates. A hybrid MPI/OpenMP parallelization scheme is employed, which uses the OpenMP-based shared memory model for intranode parallelization and the MPI-based distributed memory model for internode parallelization. Parallel efficiency has been optimized for all terms in the CCSD amplitude equations. Two different algorithms have been implemented for the rate-limiting terms in the CCSD amplitude equations that entail and -scaling computational costs, where N O and N V denote the number of correlated occupied and virtual orbitals, respectively. One of the algorithms assembles the four-center ERIs requiring N V 4 and N O 2 N V 2 -scaling memory costs in a distributed manner on a number of MPI ranks, while the other algorithm completely bypasses the assembling of quartic memory-scaling ERIs and thus largely reduces the memory demand. It is demonstrated that the former memory-expensive algorithm is faster on a few hundred cores, while the latter memory-economic algorithm shows a better strong scaling in the limit of a few thousand cores. The program is shown to exhibit a near-linear scaling, in particular for the compute-intensive triples correction step, on up to 8000 cores. The performance of the program is demonstrated via calculations involving molecules with 24–51 atoms and up to 1624 atomic basis functions. As the first application, the complete basis set (CBS) limit for the interaction energy of the π-stacked uracil dimer from the S66 data set has been investigated. This work reports the first calculation of the interaction energy at the CCSD(T)/aug-cc-pVQZ level without local orbital approximation. The CBS limit for the CCSD correlation contribution to the interaction energy was found to be -8.01 kcal/mol, which agrees very well with the value -7.99 kcal/mol reported by Schmitz, Hättig, and Tew [ Phys. Chem. Chem. Phys. 2014 , 16 , 22167-22178]. The CBS limit for the total interaction energy was estimated to be -9.64 kcal/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Global gyrokinetic study of shaping effects on electromagnetic modes at NSTX aspect ratio with ad hoc parallel magnetic perturbation effects

Plasma shaping may have a stronger effect on global turbulence in tight-aspect-ratio tokamaks than in conventional-aspect-ratio tokamaks due to the higher toroidicity and more acute poloidal asymmetry in the magnetic field. In addition, previous local gyrokinetic studies have shown that it is necessary to include parallel magnetic field perturbations in order to accurately compute growth rates of electromagnetic modes in tight-aspect-ratio tokamaks. In this work, the effects of elongation and triangularity on global, ion-scale, linear electromagnetic modes are studied at National Spherical Torus Experiment (NSTX) aspect ratio and high plasma β using the global gyrokinetic particle-in-cell code XGC. The effects of compressional magnetic perturbations are approximated via a well-known modification to the particle drifts that was developed for flux-tube simulations [Joiner et al., Phys. Plasmas 17, 072104 (2010)], without proof of its validity in a global simulation, with the gyrokinetic codes GENE and GEM being used for local verification and global cross-verification. Magnetic equilibria are re-constructed for each distinct plasma profile that is used. Coulomb collision effects are not considered. Within the limitations imposed by the present study, it is found that linear growth rates of electromagnetic modes (collisionless microtearing modes and kinetic ballooning modes) are significantly reduced in a high-elongation and high-triangularity NSTX-like geometry compared to a circular NSTX-like geometry. For example, growth rates of kinetic ballooning modes at high- β are reduced to the level of that of collisionless trapped electron modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Identification of stimulated Raman side scattering in near-spherical coronal plasmas on OMEGA EP

Recent spherical-target laser–plasma interaction experiments, performed on the OMEGA EP laser, have been analyzed for stimulated Raman scattering (SRS). This has been motivated by results obtained on the National Ignition Facility (NIF) that have demonstrated the importance of SRS, and in particular SRS side scatter, for directly driven inertial confinement fusion (ICF) conditions [Rosenberg et al. Phys. Rev. Lett. 120, 055001 (2018); Michel et al. Phys. Rev. E 99, 033203 (2019)]. The analysis, based on a generalized ray tracing approach, is described and is shown to explain the observed scattered light spectra: it identifies SRS convective scattering, from portions of each incident beam where the scattered electromagnetic wave is generated in the direction parallel to contours of constant density, as the dominant contribution. This result is novel, as SRS is mostly associated with plasmas of higher electron temperature (T e ≳ 3–4 keV) and longer density scale length (≳600 μ m) than those considered here (T e ~ 1–3 keV, Ln~150 μm) for the relevant overlapped irradiation intensities l ≲ 10 15 W/cm 2 . Furthermore, a combination of the high single-beam intensity on OMEGA EP and the side-scattering geometry, that has been identified, is responsible for this result. It is further suggested that the OMEGA EP platform could provide a good surrogate in which to develop SRS mitigation strategies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

FasTensor (FT) v0.0.1

The FasTensor implements the native array data programming mode namely SLOPE for modern data analysis tasks. It is designed to work in parallel on supercomputer and can handle terabyte data analysis tasks. It is thousand times faster than other data analysis systems such as Apache Spark and 38% faster than TensorFlow in dealing with large scale scientific data analysis. It has wide applications in image data analysis and mesh data analysis tasks in physical simulations and other fields.

Wu, Kesheng↗