Search NASA⌕ Search

SEARCH · Search NASA

Results for “SCALE Code System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Performance tuning of CEED software and first wave apps

The goal of this milestone was the performance tuning of the CEED software and first wave apps. In this milestone, the CEED team developed optimization techniques and tuned for performance the CEED software. Specifically, the focus was on the following: (1) Fast finite element operator storage and evaluation using partial assembly/matrix-free algorithms that take advantage of tensor-product element structure; (2) Architecture optimizations, including the development of performant discretization libraries targeting heterogeneous systems with multi-core CPUs, GPUs, and/or many-core CPUs in single node, cluster, or large-scale ECP supercomputer configurations; and (3) Global kernels for finite element operators, including the development of algorithms and libraries for fast gather-scatter exchanges for action assembly on unstructured graphs and for components needed for global linear solvers. A main part of this milestone was the performance tuning of the CEED first-wave ECP applications. This included the ExaSMR application – Coupled Monte Carlo Neutronics and Fluid Flow Simulation of Small Modular Reactors (ORNL), and the MARBL application – Next-Gen Multi-physics Simulation Code (LLNL). The artifacts delivered include performance improvements in CEED’s 1st wave of applications, and tuned CEED software for various architectures through a number of backends, freely available in the CEED’s repository on GitHub. See the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed for more details. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q4 of FY18 including: CEED’s second annual meeting, a successful minisymposium at the premier international conference on high-order methods (ICOSAHOM), making the CEED milestone reports publicly available, new Laghos release, and other outreach efforts.

97 MATHEMATICS AND COMPUTING↗

VTK-m User's Guide (V.1.8)

Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction. VTK-m simplifies the development of parallel scientific visualization algorithms by providing a framework of supporting functionality that allows developers to focus on visualization operations. Additionally, VTK-m provides data abstractions not provided by other libraries that make code written in VTK-m more versatile.

97 MATHEMATICS AND COMPUTING↗

The VTK-m Users' Guide (V.1.9)

High-performance computing relies on ever finer threading. Advances in processor technology include ever greater numbers of cores, hyperthreading, accelerators with integrated blocks of cores, and special vectorized instructions, all of which require more software parallelism to achieve peak performance. Traditional visualization solutions cannot support this extreme level of concurrency. Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction. VTK-m simplifies the development of parallel scientific visualization algorithms by providing a framework of supporting functionality that allows developers to focus on visualization operations. Consider the listings in Figure 1.1 that compares the size of the implementation for the Marching Cubes algorithm in VTK-m with the equivalent reference implementation in the CUDA software development kit. Because VTK-m internally manages the parallel distribution of work and data, the VTK-m implementation is shorter and easier to maintain. Additionally, VTK-m provides data abstractions not provided by other libraries that make code written in VTK-m more versatile.

97 MATHEMATICS AND COMPUTING↗

The VTK-m Users' Guide (V.2.0)

High-performance computing relies on ever finer threading. Advances in processor technology include ever greater numbers of cores, hyperthreading, accelerators with integrated blocks of cores, and special vectorized instructions, all of which require more software parallelism to achieve peak performance. Traditional visualization solutions cannot support this extreme level of concurrency. Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction. VTK-m simplifies the development of parallel scientific visualization algorithms by providing a framework of supporting functionality that allows developers to focus on visualization operations. Consider the listings in Figure 1.1 that compares the size of the implementation for the Marching Cubes algorithm in VTK-m with the equivalent reference implementation in the CUDA software development kit. Because VTK-m internally manages the parallel distribution of work and data, the VTK-m implementation is shorter and easier to maintain. Additionally, VTK-m provides data abstractions not provided by other libraries that make code written in VTK-m more versatile.

97 MATHEMATICS AND COMPUTING↗

The VTK-m User's Guide (V. 2.2)

High-performance computing relies on ever finer threading. Advances in processor technology include ever greater numbers of cores, hyperthreading, accelerators with integrated blocks of cores, and special vectorized instructions, all of which require more software parallelism to achieve peak performance. Traditional visualization solutions cannot support this extreme level of concurrency. Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction.

97 MATHEMATICS AND COMPUTING↗

The effect of curvature induced broken potential vorticity conservation on drift wave turbulences

Abstract The correlation theory of turbulence suppression (Zhang and Mahajan 1993 Phys. Fluids B5 2000) by velocity shear was constructed by invoking the ansatz of potential vorticity conservation (PVC) that holds for relatively simple (slab) models of drift wave turbulence. It is, therefore, surprising that a detailed modern simulation of the H mode pedestal, using the gyrokinetic code GENE (Hatch et al 2018 Plasma Phys. Control. Fusion 60 084003), found ‘striking agreement’ with the predictions of the analytic model. To understand the reasons for this remarkable agreement, an extended theory that contains finite (magnetic) curvature, and which does not conserve potential vorticity, is developed and ‘solved’ by calculating an inhomogeneous Green function reflecting the fact that the new system has a potential vorticity source. It is, then, demonstrated that the effect of the broken PVC is insignificant for the normal operation parameters in tokamaks; the correction due to curvature is at the order of 2 L 0 / R , where L 0 is the scale length of the local gradient and R is the major radius. The excellent agreement between simulation and slab model 1993 theory is therefore not accidental; the latter can be applied with confidence to the tokamak pedestal.

Physics↗

Parallel accelerated Custom Correlation Coefficient calculations for genomics applications

The massive quantities of genomic data being made available through gene sequencing techniques are enabling breakthroughs in genomic science in many areas such as medical advances in the diagnosis and treatment of diseases. Analyzing this data, however, is a computational challenge insofar as the computational costs of the relevant algorithms can grow with quadratic, cubic or higher complexity—leading to the need for leadership scale computing. In this paper we describe a new approach to calculations of the Custom Correlation Coefficient (CCC) between Single Nucleotide Polymorphisms (SNPs) across a population, suitable for parallel systems equipped with graphics processing units (GPUs) or Intel Xeon Phi processors. We describe the mapping of the algorithms to accelerated processors, techniques used for eliminating redundant calculations due to symmetries, and strategies for efficient mapping of the calculations to many-node parallel systems. Results are presented demonstrating high per-node performance and near-ideal parallel scalability with rates of more than nine quadrillion (9 × 10 15 ) elementwise comparisons achieved per second with the latest optimized code on the ORNL Titan system, this being orders of magnitude faster than rates achieved using other codes and platforms as reported in the literature. Also it is estimated that as many as 90 quadrillion (90 × 10 15 ) comparisons per second may be achievable on the upcoming ORNL Summit system, an additional 10X performance increase. Finally, in a companion paper we describe corresponding techniques applied to calculations of the Proportional Similarity metric for comparative genomics applications.

97 MATHEMATICS AND COMPUTING↗

Parallel simulation via SPPARKS of on-lattice kinetic and Metropolis Monte Carlo models for materials processing

Abstract SPPARKS is an open-source parallel simulation code for developing and running various kinds of on-lattice Monte Carlo models at the atomic or meso scales. It can be used to study the properties of solid-state materials as well as model their dynamic evolution during processing. The modular nature of the code allows new models and diagnostic computations to be added without modification to its core functionality, including its parallel algorithms. A variety of models for microstructural evolution (grain growth), solid-state diffusion, thin film deposition, and additive manufacturing (AM) processes are included in the code. SPPARKS can also be used to implement grid-based algorithms such as phase field or cellular automata models, to run either in tandem with a Monte Carlo method or independently. For very large systems such as AM applications, the Stitch I/O library is included, which enables only a small portion of a huge system to be resident in memory. In this paper we describe SPPARKS and its parallel algorithms and performance, explain how new Monte Carlo models can be added, and highlight a variety of applications which have been developed within the code.

36 MATERIALS SCIENCE↗

Experiments and Simulation of a Borehole in Salt to Understand Heat, Brine, and Vapor Migration - 19192

Disposition of heat-generating nuclear waste (HGNW) remains a continuing technical and sociopolitical challenge. Numerous concepts for HGNW management have been proposed and examined internationally, including an extensive focus on geologic disposal. One proposed geologic material is salt because of its low permeability and viscoplastic deformation that causes self-repair of damage done to the salt by waste emplacement activities. Evaluating the safety and technical challenges of storing HGNW in a salt repository is an ongoing process involving experiments and supporting numerical simulation. Currently an experiment is underway at the Waste Isolation Pilot Plant (WIPP) to explore how the presence of a heat generating source affects phenomena such as brine migration, vapor transport, and mechanical changes to the bedded salt. A sub-horizontal heated borehole test is in progress in the underground at the WIPP that includes a centrally located 10.2 cm diameter borehole with an adjustable heater surrounded with smaller diameter boreholes instrumented with thermocouples. The central borehole contains an inflatable packer, heating block, brine sampler, and constantly flowing nitrogen gas circulation system. Air-injection tests performed in the central borehole provide pressure measurements that are used to constrain permeability of the system. The steady-state temperatures, as well as the rise and fall of temperature when the heater is cycled on and off, have been measured for up to 60 days. In the borehole, dry nitrogen gas circulation evaporates water and outflows to a desiccant container where water mass is measured daily during the experiment to quantify vapor removal. Although this test is a 'shake-down' for a planned second round of fresh borehole testing, we have gathered a rich dataset. These data allow us to build simulations using the Finite Element Heat and Mass transfer code (FEHM) to evaluate the experimental results, determine field-scale parameters, and identify code improvements to reproduce important physical processes that may not be accounted for at present. A 3-D numerical mesh, built using LaGrit software (lagrit.lanl.gov; Miller et al., 2007), includes increasing resolution around the central borehole. Modeling of the experiment allows for determining the local thermal conductivity and permeability of any damaged bedded salt around the borehole, where damage from drilling may change the permeability, porosity and saturation conditions, by parameter testing and inverse methods. Additionally, assumptions about brine and vapor flow and transport are being tested by comparing measured and simulated results. The combination of experimental data and model results provide additional data to help support the safety case for safe and effective HGNW disposition in bedded salt formations. Initial results from this experiment show that water flow into the borehole is within previous experimental results. Further, we have found that the design of the heater block is restricting energy to flow into the rock salt. Thus, this test has proven useful in design of the next generation experiment where infrared heating may be used to bypass issues caused by air gaps located around the current stainless steel block heater. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Parallel Computing for Module-Based Computational Experiment

Large-scale scientific code plays an important role in scientific researches. In order to facilitate module and element evaluation in scientific applications, we introduce a unit testing framework and describe the demand for module-based experiment customization. We then develop a parallel version of the unit testing framework to handle long-term simulations with a large amount of data. Specifically, we apply message passing based parallelization and I/O behavior optimization to improve the performance of the unit testing framework and use profiling result to guide the parallel process implementation. Finally, we present a case study on litter decomposition experiment using a standalone module from a large-scale Earth System Model. This case study is also a good demonstration on the scalability, portability, and high-efficiency of the framework.

Yao, Zhuo↗

Achieving performance portability in Gaussian basis set density functional theory on accelerator based architectures in NWChemEx

The numerical integration of the exchange–correlation (XC) potential is one of the primary computational bottlenecks in Gaussian basis set Kohn–Sham density functional theory (KS-DFT). To achieve optimal performance and accuracy, care must be taken in this numerical integration to preserve local sparsity as to allow for near linear weak scaling with system size. This leads to an integration scheme with several performance critical kernels which must be hand optimized for each architecture of interest. As the set of available accelerator hardware goes more diverse, a key challenge for developers of KS-DFT software is to maintain performance portability across a wide range of computational architectures. In this article, we examine a modular software design pattern which decouples the implementation details of performance critical kernels from the expression of high-level algorithmic workflows in a device-agnostic language such as C++; thus allowing for developers to target existing and emerging accelerator hardware within a single code base. We consider the efficacy of such a design pattern in the numerical integration of the XC potential by demonstrating its ability to achieve performance portability across a set of accelerator architectures which are representative of those on current and future U.S. Department of Energy Leadership Computing Facilities.

97 MATHEMATICS AND COMPUTING↗

Overview of the LANL Multi-Probe Radiography Project [Slides]

Future radiographic facilities for the U.S. defense program will be required to provide more information as simulation codes improve in both physics’ fidelity and resolution. A possible approach is to use more types of probe beams in addition to, or instead of X-rays, generated by 20-MeV electron accelerators from a small number of directions. High power short-pulse laser systems can generate beams of protons, neutrons and electrons, as well as X-rays. The cost of these systems is falling rapidly. So, it can be imagined that deploying multiple short-pulse lasers along with other, more traditional probes, will become feasible. In this project, we are following three paths to determine if such an approach will succeed for cm-scale objects. The first is an experimental one to determine if the presence of multiple short-pulse probes cause interference with each other, especially while radiographing dynamic objects. The second leg of this project is to determine if having multiple types of probes really does give more information on composition. Finally, an overall assessment of the viability of this approach will be made. Examples from recent experiments at the Omega EP laser will be presented. The initial approach to evaluating radiographs with multiple probes using the Bayesian Inference Engine (BIE) also will be given.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Deep Learning Approach for TNC Trip Demand Prediction Considering Spatial-Temporal Features: Preprint

Ride-hailing or transportation network companies (TNCs), such as Uber, Lyft, DiDi Chuxing, or RideAustin, are emerging as a new and disruptive on-demand mobility service in recent years. However, the methods for developing predictive analytics to explore the nature and dynamics of TNCs across cities in the United States are still nascent due to the lack of publicly available data. Recently available public datasets on TNCs by RideAustin offer a unique opportunity to examine spatial, temporal, environmental, and special event factors associated with TNC trip demand. This study explores the use of a deep learning approach - Long Short-Term Memory (LSTM) - to predict TNC trip demand at the ZIP Code level using data from Austin, Texas. The analysis includes key predictive factors such as time of day, day of week, precipitation, and temperature, indicating their corresponding associations with TNC trip demand. Results from initial analysis show that LSTM is able to predict the TNC trip demand for the upcoming hour accurately. LSTM, when compared to other prediction methods, such as historical average and instantaneous trip demand, reduces the mean absolute error (MAE) of the model predictions by 37% and 24%, respectively. This novel method offers significant potential for scaling up and/or replicability across cities where data are available for understanding TNC trip demand to inform emerging mobility system operators. Predicting trip demand can help TNC drivers make informed decisions on how to be more efficient by maximizing passenger pickups and minimizing wait times and deadheading.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Experimental observations of detached bow shock formation in the interaction of a laser-produced plasma with a magnetized obstacle

The magnetic field produced by planets with active dynamos, like the Earth, can exert sufficient pressure to oppose supersonic stellar wind plasmas, leading to the formation of a standing bow shock upstream of the magnetopause, or pressure-balance surface. Scaled laboratory experiments studying the interaction of an inflowing solar wind analog with a strong, external magnetic field are a promising new way to study magnetospheric physics and to complement existing models, although reaching regimes favorable for magnetized shock formation is experimentally challenging. This paper presents experimental evidence of the formation of a magnetized bow shock in the interaction of a supersonic, super-Alfvenic plasma with a strongly magnetized obstacle at the OMEGA laser facility. The solar wind analog is generated by the collision and subsequent expansion of two counterpropagating, laser-driven plasma plumes. The magnetized obstacle is a thin wire, driven with strong electrical currents. Hydrodynamic simulations using the FLASH code predict that the colliding plasma source meets the criteria for bow shock formation. Spatially resolved, optical Thomson scattering measures the electron number density, and optical emission lines provide a measurement of the plasma temperature, from which we infer the presence of a fast magnetosonic shock far upstream of the obstacle. Proton images provide a measure of large-scale features in the magnetic field topology, and reconstructed path-integrated magnetic field maps from these images suggest the formation of a bow shock upstream of the wire and as a transient magnetopause. Finally, we compare features in the reconstructed fields to two-dimensional MHD simulations of the system.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Characterization and Optimization of the Fitting of Quantum Correlation Functions

This case study presents a characterization and optimization of an application code for extracting parton distribution functions from high energy electron-proton scattering data. Profiling this application code reveals that the phase-space density computation accounts for 93% of the overall execution time for a single iteration on a single core. When executing multiple iterations in parallel on a multicore system, the application spends 78% of its overall execution time idling due to load imbalance. We address these issues by first transforming the application code from Python to C++ and then tackling the application load imbalance via a hybrid scheduling strategy that combines dynamic and static scheduling. These techniques result in a 62% reduction in CPU idle time and a 2.46x speedup in overall execution time per node. In addition, the typically enabled power-management mechanisms in supercomputers (e.g., AMD Turbo Core, Intel Turbo Boost, and RAPL) can significantly impact intra-node scalability when more than 50% of the CPU cores are used. This finding underscores the importance of understanding system interactions with power management, as they can adversely impact application performance, and highlights the necessity of intra-node scaling tests to identify performance degradation that inter-node scaling tests might otherwise overlook.

Chuang, Pi-Yueh [Virginia Tech,Dept. of Computer S↗

Development of SAM Code Capabilities for Safety Analysis of GCR Air-ingress Events

Air-ingress following a depressurized loss-of-forced-cooling (DLOFC) event is a challenging, multiphysics safety scenario for High-Temperature Gas-Cooled Reactors (HTGRs), involving coupled gas composition transport, buoyancy-driven flow redistribution, graphite oxidation, and structural heat-up. Despite its importance — air ingress is a key scenario identified in the PIRT process for the HTGRs — existing system-level safety codes have lacked the integrated capability to simulate the complete event sequence with high confidence. This report documents the development, validation, and demonstration of three new capabilities in the SAM code to address this gap: (1) a multi-component gas mixture flow model with binary diffusion to track the helium-air composition and its effect on system density and flow; (2) a 0-D graphite oxidation model based on the Roes correlation, including oxygen consumption and exothermic heat release; and (3) an isentropic critical flow model for accurate representation of primary system depressurization through a break. These capabilities are validated against two benchmark experiments. The NSTF heavy-gas ingress experiment validates the multi-component flow model: SAM correctly reproduces the rapid buoyancydriven flow stagnation and subsequent natural circulation recovery driven by composition-dependent density changes. The NACOK graphite oxidation experiment validates the oxidation model: SAM predicts a bottom-level graphite weight loss of 25%, in close agreement with the measured 24%, and reproduces the strong axial nonuniformity and block-geometry dependence of oxidation, at a level comparable to the SPECTRA and TINTE codes. The validated capabilities are then exercised together in an integrated, reactor-scale simulation of a DLOFC air-ingress transient in a simplified HTR-PM pebble-bed reactor. In a single calculation spanning approximately 8 days, SAM reproduces the complete accident sequence: rapid depressurization, densityand diffusion-driven air ingress over ˜15 hours, onset of buoyancy-driven natural circulation, exothermic graphite oxidation with a peak fuel temperature at ˜62 hours, and eventual passive cooldown. These results demonstrate that SAM now provides the nuclear community with a preliminarily validated, modern systemlevel tool for HTGR air-ingress safety analysis, filling a recognized capability gap. Future extensions to broaden species tracking, improve oxidation chemistry, and refine the reactor model are discussed.

Yang, Gang↗

Experimental observations of detached bow shock formation in the interaction of a laser-produced plasma with a magnetized obstacle

The magnetic field produced by planets with active dynamos, like the Earth, can exert sufficient pressure to oppose supersonic stellar wind plasmas, leading to the formation of a standing bow shock upstream of the magnetopause, or pressure-balance surface. Scaled laboratory experiments studying the interaction of an inflowing solar wind analog with a strong, external magnetic field are a promising new way to study magnetospheric physics and to complement existing models, although reaching regimes favorable for magnetized shock formation is experimentally challenging. This paper presents experimental evidence of the formation of a magnetized bow shock in the interaction of a supersonic, super-Alfvenic plasma with a strongly magnetized obstacle at the OMEGA laser facility. The solar wind analog is generated by the collision and subsequent expansion of two counter- propagating, laser-driven plasma plumes. The magnetized obstacle is a thin wire, driven with strong electrical currents. Hydrodynamic simulations using the FLASH code predict that the colliding plasma source meets the criteria for bow shock formation. Spatially resolved, optical Thomson scat- tering measures the electron number density, and optical emission lines provide a measurement of the plasma temperature, from which we infer the presence of a fast magnetosonic shock far upstream of the obstacle. Proton images provide a measure of large-scale features in the magnetic field topology, and reconstructed path-integrated magnetic field maps from these images suggest the formation of a bow shock upstream of the wire and as a transient magnetopause. We compare features in the reconstructed fields to two-dimensional MHD simulations of the system.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Encoder–decoder neural network for solving the nonlinear Fokker–Planck–Landau collision operator in XGC

An encoder–decoder neural network has been used to examine the possibility for acceleration of a partial integro-differential equation, the Fokker–Planck–Landau collision operator. This is part of the governing equation in the massively parallel particle-in-cell code XGC, which is used to study turbulence in fusion energy devices. The neural network emphasizes physics-inspired learning, where it is taught to respect physical conservation constraints of the collision operator by including them in the training loss, along with the ℓ 2 loss. In particular, network architectures used for the computer vision task of semantic segmentation have been used for training. A penalization method is used to enforce the ‘soft’ constraints of the system and integrate error in the conservation properties into the loss function. During training, quantities representing the particle density, momentum and energy for all species of the system are calculated at each configuration vertex, mirroring the procedure in XGC. This simple training has produced a median relative loss, across configuration space, of the order of 10 –4 , which is low enough if the error is of random nature, but not if it is of drift nature in time steps. The run time for the current Picard iterative solver of the operator is O(n 2 ), where n is the number of plasma species. As the XGC1 code begins to attack problems including a larger number of species, the collision operator will become expensive computationally, making the neural network solver even more important, especially since its training only scales as O(n). Here, a wide enough range of collisionality has been considered in the training data to ensure the full domain of collision physics is captured. An advanced technique to decrease the losses further will be subject of a subsequent report. Eventual work will include expansion of the network to include multiple plasma species.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗