Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

SIERRA Low Mach Module: Fuego Verification Manual (V.5.26)

The SIERRA Low Mach Module: Fuego, henceforth referred to as Fuego, is the key element of the ASC fire environment simulation project. The fire environment simulation project is directed at characterizing both open large-scale pool fires and building enclosure fires. Fuego represents the turbulent, buoyantly-driven incompressible flow, heat transfer, mass transfer, combustion, soot, and absorption coefficient model portion of the simulation software. Sierra/PMR handles the participating-media thermal radiation mechanics. This project is an integral part of the SIERRA multi-mechanics software development project. Fuego depends heavily upon the core architecture developments provided by SIERRA for massively parallel computing, solution adaptivity, and mechanics coupling on unstructured grids.

42 ENGINEERING↗

SIERRA Low Mach Module: Fuego Verification Manual - Version 5.28

The SIERRA Low Mach Module: Fuego, henceforth referred to as Fuego, is the key element of the ASC fire environment simulation project. The fire environment simulation project is directed at characterizing both open large-scale pool fires and building enclosure fires. Fuego represents the turbulent, buoyantly-driven incompressible flow, heat transfer, mass transfer, combustion, soot, and absorption coefficient model portion of the simulation software. Sierra/PMR handles the participating-media thermal radiation mechanics. This project is an integral part of the SIERRA multi-mechanics software development project. Fuego depends heavily upon the core architecture developments provided by SIERRA for massively parallel computing, solution adaptivity, and mechanics coupling on unstructured grids.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

SIERRA Low Mach Module: Fuego Verification Manual - Version 5.30

The SIERRA Low Mach Module: Fuego, henceforth referred to as Fuego, is the key element of the ASC fire environment simulation project. The fire environment simulation project is directed at characterizing both open large-scale pool fires and building enclosure fires. Fuego represents the turbulent, buoyantly-driven incompressible flow, heat transfer, mass transfer, combustion, soot, and absorption coefficient model portion of the simulation software. Sierra/PMR handles the participating-media thermal radiation mechanics. This project is an integral part of the SIERRA multi-mechanics software development project. Fuego depends heavily upon the core architecture developments provided by SIERRA for massively parallel computing, solution adaptivity, and mechanics coupling on unstructured grids.

97 MATHEMATICS AND COMPUTING↗

Toward designing effective exascale scientific computing workflows: experiences and best practices

Many fields within scientific computing have embraced advances in big-data analysis and machine learning, which often requires the deployment of large, distributed and complicated workflows that may combine training neural networks, performing simulations, running inference, and performing database queries and data analysis in asynchronous, parallel and pipelined execution frameworks. Such a shift has brought into focus the need for scalable, efficient workflow management solutions with reproducibility, error and provenance handling, traceability, and checkpoint-restart capabilities, among other needs. Here, we discuss challenges and best-practices for deploying exascale-generation computational science workflows on resources at the Oak Ridge Leadership Computing Facility (OLCF). We present our experiences with large-scale deployment of distributed workflows on the Summit supercomputer, including for bioinformatics and computational biophysics, materials science, and deep learning model optimization. We also present problems and solutions created by working within a Python-centric software base on traditional HPC systems, and discuss steps that will be required before the convergence of HPC, AI, and data science can be fully realized. Our results point to a wealth of exciting new possibilities for harnessing this convergence to tackle new scientific challenges.

Coletti, Mark↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Efficient reconstruction and validation of heterogeneous microstructures for energy applications

The digital reconstruction of microstructures is necessary for simulations in fields ranging from geology to electrochemistry, but the state-of-the-art digital reconstruction techniques often compromise between resolution and field of view. It is challenging to retain detailed microstructure information in large-scale reconstructions. Here, this study investigates different aspects of the Yeong-Torquato algorithm based on correlation functions to make it more efficient. We achieve this goal by reducing the computational complexity of the chord-length distribution function and the two-point correlation function, applying the random sphere-packing method as the initial condition, and restricting potential voxel swaps to interfaces. In addition, a novel superposition parallel scheme is introduced to aid in searching for potential voxel swaps. The algorithm proposed is validated by comparing the pore-size distributions of reconstructed 3D custom battery electrodes from a sample dataset obtained from transmission X-ray microscopy. From a sample image with 200 x 200 pixels, the code can reconstruct a 300 x 300 x 300 structure in under 22 h and reconstruct a 400 x 400 x 400 structure in 43 h with eight cores.

42 ENGINEERING↗

Are scenario projections overly optimistic about future yield progress?

Historical increases in agricultural production were achieved predominantly by large increases in agricultural productivity. Intensification of crop and livestock production also plays a key role in future projections of agricultural land use. Here, we assess and discuss projections of crop yields by global agricultural land-use and integrated assessment models. To evaluate these crop yield projections, we compare them to empirical data on attainable yields by employing a linear and plateauing continuation of observed attainable yield trends. While keeping in mind the uncertainties of attainable yields projections and future climate change impacts, we find that, on average for all cereals on the global level, global projected yields by 2050 remain below the attainable yields. Additionally, this is also true for future pathways with high technological progress and mitigation efforts, indicating that projected yield increases are not overly optimistic, even under systemic transformations. Furthermore, on a regional scale, we find that for developing regions, specifically for sub-Saharan Africa, projected yields stay well below attainable yields, indicating that the large yield gaps which could be closed through improved crop management, may also persist in the future. In OECD countries, in contrast, current yields are already close to attainable yields, and the projections approach or, for some models, even exceed attainable yields by 2050. This observation parallels research suggesting that future progress in attainable yields in developed regions will mainly have to be achieved through new crop varieties or genetic improvements. The models included in this study vary widely in their implementation of yield progress, which are often split into endogenous (crop management) improvements and exogenous (technological) trends. More detail and transparency are needed in these important elements of global yields and land use projections, and this paper discusses possibilities of better aligning agronomic understanding of yield gaps and yield potentials with modelling approaches.

54 ENVIRONMENTAL SCIENCES↗

The impact of aqueous medium on zeolite framework integrity

Understanding the zeolite framework stability in aqueous phase is crucial to develop stable catalysts. Al K–edge, extended X–ray absorption fine structure and 27Al MAS NMR spectroscopies in combination with DFT calculations have been used to monitor both qualitative and quantitative structural changes of two well–characterized samples with BEA structure. The effects of various properties on stability were explored, including Al concentration, Al distribution, particle size and structural defects. As the samples were degraded by treatment in hot liquid water, the local structure about the Al T–site remained mostly intact, including the Al–O–Si angles and bond distances, while the nano–scale crystalline structure as measured by XRD and TEM was disrupted. The combined data suggest a three–step mechanism in which, initially, the HBEA framework crystallinity decreases via hydrolysis of T–O bonds along polymorph stacking faults and inter–grain boundaries in a mode similar to crack propagation in glass. With prolonged exposure, amorphization occurs via hydrolysis of surface Si–OH groups propagating inward through the zeolite lattice. In parallel, cracks propagate within the crystalline micro–domains along paths through specific T–O–T groups. Authors thank B. W. Arey (PNNL) for HIM measurements, T. Huthwelker for support during Al XAFS measurements at the Swiss Light Source (PSI, Switzerland) and M. Y. Hu (PNNL) for support during NMR experiments. This work was supported by the U. S. Department of Energy (DOE), Office of Science, Office of Basic Energy Sciences, Division of Chemical Sciences, Geosciences & Biosciences. NMR experiments were performed at the Environmental Molecular Science Laboratory, a national scientific user facility sponsored by the DOE’s Office of Biological and Environmental Research, and Physical Science Laboratory both located at Pacific Northwest National Laboratory (PNNL). PNNL is a multi–program national laboratory operated for DOE by Battelle under Contract No. DE–AC05–76RL01830.

Environmental Molecular Sciences Laboratory↗

Pathways Following Electron Injection: Medium Effects and Cross-Surface Electron Transfer in a Ruthenium-Based, Chromophore–Catalyst Assembly on TiO 2

Interfacial dynamics following photoexcitation of the water oxidation assembly [((PO 3 H 2 ) 2 bpy) 2 Ru II (bpy-bimpy)Ru II (tpy)(OH 2 )] 4+ , -[Ru a II –Ru b II –OH 2 ] 4+ , on nanocrystalline TiO 2 electrodes, starting from either -[Ru a II –Ru b II –OH 2 ] 4+ or -[Ru a II –Ru b III –OH 2 ] 5+ , have been investigated. Transient absorption measurements for TiO 2 –[Ru a II –Ru b II –OH 2 ] 4+ in 0.1 M HPF 6 or neat trifluoroethanol reveal that electron injection occurs with high efficiency but that hole transfer to the catalyst, which occurs on the electrochemical time scale, is inhibited by local environmental effects. Back electron transfer occurs to the oxidized chromophore on the microsecond time scale. Photoexcitation of the once-oxidized assembly, TiO 2 –[Ru a II –Ru b III –OH 2 ] 5+ , in a variety of media, generates -[Ru a III –Ru b III –OH 2 ] 6+ . The injected electron randomly migrates through the surface oxide structure reducing an unreacted -[Ru a II –Ru b III –OH 2 ] 5+ assembly to -[Ru a II –Ru b II –OH 2 ] 4+ . In a parallel reaction, -[Ru a III –Ru b III –OH 2 ] 6+ formed by electron injection undergoes proton loss giving -[Ru a II –Ru b IV $=$O] 4+ with possible conversion to -[Ru a II –Ru b II –OH 2 ] 4+ by an electrolyte-mediated reaction. In the following slow step, re-equilibration on the surface occurs either by reaction with added Fe III/II or by cross-surface electron transfer between spatially separated -[Ru a II –Ru b IV $=$O] 4+ and -[Ru a II –Ru b II –OH 2 ] 4+ assemblies to give -[Ru a II –Ru b III –OH 2 ] 5+ with a half-time of t 1/2 ~ 68 μs. Finally, these results and analyses show that the transient surface behavior of the assembly and cross-surface reactions play important roles in producing and storing redox equivalents on the surface that are used for water oxidation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Magnetosheath Reconnection Before Magnetopause Reconnection Driven by Interplanetary Tangential Discontinuity: A Three‐Dimensional Global Hybrid Simulation With Oblique Interplanetary Magnetic Field

Abstract Terrestrial dayside dynamics associated with a southward turning, oblique interplanetary magnetic field (IMF) carried by an interplanetary tangential discontinuity (TD) is investigated by performing a three‐dimensional global‐scale hybrid simulation systematically for cases in which the incoming solar wind TD possesses various magnetic field rotation angles ΔΦ = 90° to 180° and half widths w = 2 d i 0 to w = 30 d i 0 , where d i 0 is the ion inertial length in the solar wind. Overall, the TD is compressed while being transmitted into the magnetosheath, with different compression processes downstream of the quasi‐parallel (Q‐||) and quasi‐perpendicular (Q‐ ⊥ ) shocks. It is found that magnetosheath reconnection may take place downstream of both the Q‐|| and Q‐ ⊥ shocks due to interaction of the directional TD with the bow shock and magnetopause, but the existence of magnetosheath reconnection depends on w and ΔΦ . Magnetosheath flux ropes are formed through three‐dimensional patchy reconnection in the thinned current sheet, with a longer rope lengths under a larger ΔΦ . There exists a dawn‐dusk asymmetry in the spatial extent of the flux ropes, which becomes more significant as ΔΦ decreases. When ΔΦ decreases to 90° , no reconnection flux ropes are found. Magnetopause reconnection is initiated when the magnetic fluxes with a southward turning IMF (on the sunward side) reach the magnetopause, and the magnetopause flux ropes can be mixed with the magnetosheath ones. Our simulation demonstrates that the effects of a southward turning of the IMF may not be a simple field direction change that leads to reconnection only at the magnetopause.

Guo, Zhifang↗

Fast correlation function calculator: A high-performance pair-counting toolkit

A novel high-performance exact pair-counting toolkit called fast correlation function calculator (FCFC) is presented. With the rapid growth of modern cosmological datasets, the evaluation of correlation functions with observational and simulation catalogues has become a challenge. High-efficiency pair-counting codes are thus in great demand. We introduce different data structures and algorithms that can be used for pair-counting problems, and perform comprehensive benchmarks to identify the most efficient algorithms for real-world cosmological applications. We then describe the three levels of parallelisms used by FCFC, SIMD, OpenMP, and MPI, and run extensive tests to investigate the scalabilities. Finally, we compare the efficiency of FCFC with alternative pair-counting codes. The data structures and histogram update algorithms implemented in FCFC are shown to outperform alternative methods. FCFC does not benefit greatly from SIMD because the bottleneck of our histogram update algorithm is mainly cache latency. Nevertheless, the efficiency of FCFC scales well with the numbers of OpenMP threads and MPI processes, even though speedups may be degraded with over a few thousand threads in total. FCFC is found to be faster than most (if not all) other public pair-counting codes for modern cosmological pair-counting applications.

79 ASTRONOMY AND ASTROPHYSICS↗

GUNDAM: a toolkit for fast spatial correlation functions in galaxy surveys

ABSTRACT We describe the capabilities of a new software package to calculate two-point correlation functions (2PCFs) of large galaxy samples. The code can efficiently estimate 3D/projected/angular 2PCFs with a variety of statistical estimators and bootstrap errors, and is intended to provide a complete framework (including calculation, storage, manipulation, and plotting) to perform this type of spatial analysis with large redshift surveys. Gundam implements a very fast skip list/linked list algorithm that efficiently counts galaxy pairs and avoids the computation of unnecessary distances. It is several orders of magnitude faster than a naive pair counter, and matches or even surpass other advanced algorithms. The implementation is also embarrassingly parallel, making full use of multicore processors or large computational clusters when available. The software is designed to be flexible, user friendly and easily extensible, integrating optimized, well-tested packages already available in the astronomy community. Out of the box, it already provides advanced features such as custom weighting schemes, fibre collision corrections and 2D correlations. Gundam will ultimately provide an efficient toolkit to analyse the large-scale structure ‘buried’ in upcoming extremely large data sets generated by future surveys.

Donoso, E.↗

Aces4: A Platform for Computational Chemistry Calculations with Extremely Large Block-Sparse Arrays

Aces4 is a parallel programming platform comprising a DSL for Computational Chemistry and its runtime system. It offers a convenient way to express parallelism together with extensive support for extremely large, possibly sparse, distributed arrays. It aids scientists in the creation of performant, scalable, massively parallel programs that can effectively take advantage of leadership class computing systems to address important scientific questions. Aces4 has enabled the development and implementation of new methods in electronic structure theory which are breaking new ground in their ability to perform highly accurate calculations on ever larger molecular systems. In this paper the design of Aces4, which is based on the the Super Instruction Architecture approach, is described. Experimental scaling results for Molecular Cluster Perturbation Theory, a new method enabled by Aces4, and CCSD, a widely used computational chemistry method are given.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The U.S. High-Performance Computing Consortium in the Fight Against COVID-19

U.S. computing leaders, including Department of Energy National Laboratories, have partnered with universities, government agencies, and the private sector to research responses to COVID-19, providing an unprecedented collection of resources that include some of the fastest computers in the world. For HPC users, these leadership machines will drive the AI to accelerate the discovery of promising treatments, enable at-scale simulations to understand the virus’s protein structure and attack mechanisms, and help inform policymakers to deploy resources effectively.

60 APPLIED LIFE SCIENCES↗

FTK: A Simplicial Spacetime Meshing Framework for Robust and Scalable Feature Tracking

In this work, we present the Feature Tracking Kit (FTK), a framework that simplifies, scales, and delivers various feature-tracking algorithms for scientific data. The key of FTK is our simplicial spacetime meshing scheme that generalizes both regular and unstructured spatial meshes to spacetime while tessellating spacetime mesh elements into simplices. The benefits of using simplicial spacetime meshes include (1) reducing ambiguity cases for feature extraction and tracking, (2) simplifying the handling of degeneracies using symbolic perturbations, and (3) enabling scalable and parallel processing. The use of simplicial spacetime meshing simplifies and improves the implementation of several feature-tracking algorithms for critical points, quantum vortices, and isosurfaces. As a software framework, FTK provides end users with VTK/ParaView filters, Python bindings, a command line interface, and programming interfaces for feature-tracking applications. We demonstrate use cases as well as scalability studies through both synthetic data and scientific applications including tokamak, fluid dynamics, and superconductivity simulations. We also conduct end-to-end performance studies on the Summit supercomputer. FTK is open sourced under the MIT license: https://github.com/hguo/ftk.

97 MATHEMATICS AND COMPUTING↗

Quinoa, Version 0.2

Quinoa is a set of computational tools that enables research and numerical analysis in fluid dynamics. At this time it remains a test-bed to experiment with various algorithms using fully asynchronous runtime systems. Currently, Quinoa consists of the following tools: (1) Walker, a numerical integrator for systems of stochastic differential equations in time. It is a mathematical tool to analyze and design the behavior of stochastic differential equations. It allows the estimation of arbitrary coupled statistics and probability density functions and is currently used for the design of statistical moment approximations for multiple mixing materials in variable-density turbulence. (2) Inciter, an overdecomposition-aware finite element field solver for partial differential equations using 3D unstructured grids. Inciter is used to research asynchronous mesh-based algorithms and to experiment with coupling asynchronous to bulk-synchronous parallel code. Two planned new features of Inciter, compared to the previous release (LA-CC-16-015), to be implemented in 2017, are (a) a simple Navier-Stokes solver for ideal single-material compressible gases, and (b) solution-adaptive mesh refinement (AMR), which enables dynamically concentrating compute resources to regions with interesting physics. Using the NS-AMR problem we plan to explore how to scale such high-load-imbalance simulations, representative of large production multiphysics codes, to very large problems on very large computers using an asynchronous runtime system. (3) RNGTest, a test harness to subject random number generators to stringent statistical tests enabling quantitative ranking with respect to their quality and computational cost. (4) UnitTest, a unit test harness, running hundreds of tests per second, capable of testing serial, synchronous, and asynchronous functions. (5) MeshConv, a mesh file converter that can be used to convert 3D tetrahedron meshes from and to either of the following formats: Gmsh, http://www.geuz.org/gmsh, Netgen, http://sourceforge.net/apps/mediawiki/netgen-mesher, ExodusII, http://sourceforge.net/projects/exodusii, HyperMesh, http://www.altairhyperworks.com/product/HyperMesh.

Bakosi, Jozsef↗

Automatic Halo Management for the Uintah GPU-Heterogeneous Asynchronous Many-Task Runtime

The Uintah computational framework is used for the parallel solution of partial differential equations on adaptive mesh refinement grids using modern supercomputers. Uintah is structured with an application layer and a separate runtime system. Uintah is based on a distributed directed acyclic graph of computational tasks, with a task scheduler that efficiently schedules and executes these tasks on both CPU cores and on-node accelerators. The runtime system identifies task dependencies, creates a task graph prior to the execution of these tasks, automatically generates MPI message tags, and automatically performs halo transfers for simulation variables. Automating halo transfers in a heterogeneous environment poses significant challenges when tasks compute within a few milliseconds, as runtime overhead affects wall time execution, or when simulation variables require large halos spanning most or all of the computational domain, as task dependencies become expensive to process. These challenges are magnified at production scale when application developers require each compute node perform thousands of different halo transfers among thousands simulation variables. The principal contribution of this work is to (1) identify and address inefficiencies that arise when mapping tasks onto the GPU in the presence of automated halo transfers, (2) implement new schemes to reduce runtime system overhead, (3) minimize application developer involvement with the runtime, and (4) show overhead reduction results from these improvements.

Concurrency↗

Coupled‐cluster singles, doubles and perturbative triples with density fitting approximation for massively parallel heterogeneous platforms

Abstract A high‐performance implementation of the coupled‐cluster singles, doubles, and perturbative triples [CCSD(T)] is developed in the Massively Parallel Quantum Chemistry program. Novel features include: (1) reduced memory requirements via a density‐fitting (DF) CCSD implementation utilizing distributed lazy evaluation for tensors with more than two unoccupied indices and (2) the ability to utilize efficiently many‐core nodes (Intel Xeon Phi) and heterogeneous nodes with multiple NVIDIA GPUs on each node. All data that are greater than quadratic in the system size are distributed among processes. Excellent strong scaling is observed on distributed‐memory computers equipped with conventional CPUs, Intel Xeon Phi processors, and heterogeneous nodes with multiple NVIDIA GPUs Canonical CCSD(T) energies can be evaluated for systems containing 200 electrons and 1000 basis functions in a few days using a small size commodity cluster, with even larger computations possible on leadership‐class computing resources.

Peng, Chong↗