Hierarchical Semi-Sparse Cubes—Parallel Framework for Storing Multi-Modal Big Data in HDF5
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “parallel computations”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Towards Scalable Parallel Training of Deep Neural Networks
Abstract not provided
97 MATHEMATICS AND COMPUTING↗
Computational Fluid Dynamics Using the Adaptive Wavelet-Collocation Method
Advancements to the adaptive wavelet-collocation method over the last decade have opened up a number of new possible areas for active research. Volume penalization techniques allow complex immersed boundary conditions to be used with high efficiency for both internal and external flows. Anisotropic methods make it possible to use body-fitted meshes while still taking advantage of the dynamic adaptability properties wavelet-based methods provide. The parallelization of the approach has made it possible to perform large high-resolution simulations of detonation initiation and fluid instabilities to uncover new physical insights that would otherwise be difficult to discover. Other developments include space-time adaptive methods and nonreflecting boundary conditions. This article summarizes the work performed using the adaptive wavelet-collocation method developed by Vasilyev and coworkers over the past decade.
42 ENGINEERING↗
Tuning parallel data compression and I/O for large-scale earthquake simulation
Explore the source record for details and available documents.
Mathematics and Computing, Computer science↗
Integration of Titan supercomputer at OLCF with ATLAS Production System
The PanDA (Production and Distributed Analysis) workload management system was developed to meet the scale and complexity of distributed computing for the ATLAS experiment. PanDA managed resources are distributed worldwide, on hundreds of computing sites, with thousands of physicists accessing hundreds of Petabytes of data and the rate of data processing already exceeds Exabyte per year. While PanDA currently uses more than 200,000 cores at well over 100 Grid sites, future LHC data taking runs will require more resources than Grid computing can possibly provide. Additional computing and storage resources are required. Therefore ATLAS is engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. In this paper we will describe a project aimed at integration of ATLAS Production System with Titan supercomputer at Oak Ridge Leadership Computing Facility (OLCF). Current approach utilizes modified PanDA Pilot framework for job submission to Titan's batch queues and local data management, with lightweight MPI wrappers to run single node workloads in parallel on Titan's multi-core worker nodes. It provides for running of standard ATLAS production jobs on unused resources (backfill) on Titan. The system already allowed ATLAS to collect on Titan millions of core-hours per month, execute hundreds of thousands jobs, while simultaneously improving Titans utilization efficiency. We will discuss the details of the implementation, current experience with running the system, as well as future plans aimed at improvements in scalability and efficiency.
97 MATHEMATICS AND COMPUTING↗
Porting HEP Parameterized Calorimeter Simulation Code to GPUs
The High Energy Physics (HEP) experiments, such as those at the Large Hadron Collider (LHC), traditionally consume large amounts of CPU cycles for detector simulations and data analysis, but rarely use compute accelerators such as GPUs. As the LHC is upgraded to allow for higher luminosity, resulting in much higher data rates, purely relying on CPUs may not provide enough computing power to support the simulation and data analysis needs. As a proof of concept, we investigate the feasibility of porting a HEP parameterized calorimeter simulation code to GPUs. We have chosen to use FastCaloSim, the ATLAS fast parametrized calorimeter simulation. While FastCaloSim is sufficiently fast such that it does not impose a bottleneck in detector simulations overall, significant speed-ups in the processing of large samples can be achieved from GPU parallelization at both the particle (intra-event) and event levels; this is especially beneficial in conditions expected at the high-luminosity LHC, where extremely high per-event particle multiplicities will result from the many simultaneous proton-proton collisions. We report our experience with porting FastCaloSim to NVIDIA GPUs using CUDA. A preliminary Kokkos implementation of FastCaloSim for portability to other parallel architectures is also described.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Development of a Library for Conducting Monte Carlo Tallies on Heterogeneous Systems
A library is introduced that enables users to conduct Monte Carlo tallies on heterogeneous computing systems. The library can be built with or linked to a Monte Carlo transport code to provide tally capabilities for the project. The library provides a set of tools and an interface for constructing tallies that can be computed on CPUs or GPUs regardless of where the sample data was generated. The library can be incorporated into existing Monte Carlo transport codes at both the research and production level with minimal intrusion into the transport code. The tally library is capable of computing a variety of tallies including track-length histogram (mesh) tallies, collisionbased kernel density estimators, functional expansion tallies, eigenvalue sensitivity coefficients via iterated fission probability, and sensitivities of reaction rates or adjoint-weighted quantities via differential operator sampling. The parallelization methods are discussed and speedups are shown for 2-D and 3-D problems with comparisons to both the tally library CPU implementations as well as the tally capabilities in the host transport code. Performance results and examples are shown for MCNP, MCATK, and OpenMC.
97 MATHEMATICS AND COMPUTING↗
Angle dependence of strong-field single and double ionization of carbonyl sulfide
We have studied, experimentally and theoretically, the ionization probability of carbonyl sulfide (OCS) molecules in intense linearly polarized 800-nm laser pulses as a function of the angle between the molecular axis and the laser polarization. Experimentally, the molecules are exposed to two laser pulses with a relative time delay. The first, weaker pulse induces a nuclear rotational wave packet within each molecule such that the ensemble exhibits preferential alignment in the laboratory frame at specific times. The second, stronger pulse induces ionization, and the variation in single and double ionization yields is measured as a function of the delay between the two pulses. The angular dependence of the ionization yield is extracted by fitting the delay-dependent yields to a sum of delay-dependent moments of the rotational wave packet's angular distribution. We compute these same angular-dependent strong-field ionization yields for OCS using time-dependent density-functional theory (TDDFT). For the single-ionization case, our measurements agree well with TDDFT calculations and with previous experiments. Furthermore, analysis of the simulated one-body density reveals that, when averaged over a laser cycle, the resulting hole is delocalized across the molecule for light polarized perpendicular to the molecular axis and mostly localized on the sulfur for parallel polarization. Furthermore, this suggests that preferential molecular alignment is a key parameter for controlling charge migration dynamics initiated by strong-field ionization. For double ionization, the agreement between experiment and theory is less compelling, reflecting the substantial challenges of computing double-ionization yields using TDDFT methods.
74 ATOMIC AND MOLECULAR PHYSICS↗
A mesoscale 3D model of irradiated concrete informed via a 2.5 U-Net semantic segmentation
The concrete biological shield in light-water reactors is exposed to neutron and gamma irradiation, which deteriorates the concrete’s mechanical properties in the long term. To assess the irradiation-induced damage, predictive mechanical models are developed and used in parallel with the characterization of irradiated concrete samples. Realistic 3D simulation domains can drastically improve a model’s prediction. In this work, we utilized x-ray computed tomography (XCT) data of a concrete specimen to reconstruct its 3D microstructure. The XCT data shows low contrast between the concrete’s aggregates and cement paste, resulting in poor image segmentation when using traditional unsupervised techniques. To address this issue, we developed and trained a 2.5D U-Net model on only 24 pre-labeled XCT layers to segment 651 layers of the XCT data. The overall F1-score of the model is approximately 96%. Then, we created a 3D finite element (FE) mesh based on the stack of segmented images. The FE model contains radiation-induced expansion, damage, and creep. The constitutive equations are adapted to each phase (aggregates and cement paste). Here, we simulated the effects of neutron irradiation in the concrete specimen as well as the specimen’s mechanical response to uniaxial compression. Finally, model validation was performed using experimental data on similar concrete specimens in the literature.
2.5D U-Net↗
A family of independent Variable Eddington Factor methods with efficient preconditioned iterative solvers
We present a family of discretizations for the Variable Eddington Factor (VEF) equations that have high-order accuracy on curved meshes and efficient preconditioned iterative solvers. The VEF discretizations are combined with the Discontinuous Galerkin transport discretization from to form effective high-order, linear transport methods. The VEF discretizations are derived by extending the unified analysis of Discontinuous Galerkin methods for elliptic problems presented by Arnold et al. to the VEF equations. This framework is used to define analogs of the interior penalty, second method of Bassi and Rebay, minimal dissipation local Discontinuous Galerkin, and continuous finite element methods. The analysis of subspace correction preconditioners, which use a continuous operator to iteratively precondition the discontinuous discretization, is extended to the case of the non-symmetric VEF system. Numerical results demonstrate that the VEF discretizations have arbitrary-order accuracy on curved meshes, preserve the thick diffusion limit, and are effective on a proxy problem from thermal radiative transfer in both outer transport iterations and inner preconditioned linear solver iterations. We demonstrate that the VEF solution converges to the S N transport solution as the mesh is refined on both problems with smooth and non-smooth behavior in angle. Parallel performance studies show that the interior penalty VEF discretization's linear solve weak scales out to 1024 processors and strong scales well on a single node. Particular attention is paid to the parallel performance of the VEF algorithm when used in combination with a parallel block Jacobi transport sweep.
97 MATHEMATICS AND COMPUTING↗
MetaStrider: Architectures for Scalable Memory-centric Reduction of Sparse Data Streams
Reduction is an operation performed on the values of two or more key-value pairs that share the same key. Reduction of sparse data streams finds application in a wide variety of domains such as data and graph analytics, cybersecurity, machine learning, and HPC applications. However, these applications exhibit low locality of reference, rendering traditional architectures and data representations inefficient. This article presents MetaStrider, a significant algorithmic and architectural enhancement to the state-of-the-art, SuperStrider. Furthermore, these enhancements enable a variety of parallel, memory-centric architectures that we propose, resulting in demonstrated performance that scales near-linearly with available memory-level parallelism.
97 MATHEMATICS AND COMPUTING↗
Quantum Dynamics at Scale: Ultrafast Control of Emergent Functional Materials
Confluence of extreme-scale quantum dynamics simulations (i.e. quantum@scale) and cutting-edge x-ray free-electron laser experiments are revolutionizing materials science. An archetypal example is the exciting concept of using picosecond light pulses to control emergent material properties on demand in atomically-thin layered materials. This paper describes efforts to scale our quantum molecular dynamics engine toward the United States' first exaflop/s computer, under an Aurora Early Science Program project named "Metascalable layered material genome". Key algorithmic and computing techniques incorporated are: (1) globally-scalable and locally-fast solvers within a linear-scaling divide-conquer-recombine algorithmic framework; (2) algebraic `BLASification' of computational kernels; and (3) data alignment and loop restructuring, along with register and cache blocking, for enhanced vectorization and efficient memory access. The resulting weak-scaling parallel efficiency was 0.93 on 131,072 Intel Xeon Phi cores for a 56.6 million atom (or 169 million valence-electron) system, whereas the various code transformations achieved 5-fold speedup. The optimized simulation engine allowed us for the first time to establish a significant effect of substrate on the dynamics of layered material upon electronic excitation.
Algebraic BLASification↗
CO 2 Capture by Cold Membrane Operation with Actual Power Plant Flue Gas
The main objective of the project was to develop a post-combustion CO 2 capture process based on the hybrid cold temperature membrane operation. The CO 2 in the flue gas from coal fired power plant is pre-concentrated to >60% CO 2 in the first stage membrane operation followed by further liquefaction of permeate stream to achieve >99% CO 2 purity. The aim of the project was based on DOE program goal of 90% CO 2 capture with >95% CO 2 purity from Pulverized Coal (PC) fired power plants with $40/tonne of carbon capture cost by 2025. The project moves the technology from TRL 4 to TRL 5. The project involved optimization of Air Liquide commercial 12” PI-1 bundle to improve the bundle productivity by >30% compared to the previous baseline (DE-FE0004278) using computational fluid dynamics (CFD) modeling and bundle testing with synthetic flue gas at 0.1 MWe bench scale skid located at Delaware Research and Technology Center (DRTC). In parallel, the next generation polyimide based novel PI-2 membrane was developed with 10 times CO 2 permeance compared to the commercial PI-1 membrane. The novel PI-2 membrane was scaled from mini-permeator to 1” permeator and 1” bundle for testing. Bundle development was conducted with a Development Spin Unit (DSU) installed at MEDAL. Air Liquide’s cold membrane technology was demonstrated with real coal fired flue gas at the National Carbon Capture Center (NCCC) with a 0.3 MWe field-test unit (FTU). The FTU was designed to incorporate testing of two PI-1 commercial membrane bundles (12” or 6” diameter) in parallel or series. A slip stream was sent to the next generation PI-2 membrane for testing with real flue gas. The system exceeded performance targets with stable PI-1 membrane operation for over 500 hours of single bundle, steady state testing. The 12” PI-1 bundle exceeded the productivity target by achieving ~600 Nm3/hr, where the target was set at ~455 Nm3/hr at 90% capture rate. The cost of 90% CO 2 capture from a 550 MWe net coal power plant was estimated between 40 and $45/tonne. A 6” PI-1 bundle exhibited superior bundle performance compared to the 12” PI-1 bundle. However, the carbon capture cost was not lower with the 6” PI-1 bundle due to the higher bundle installed cost. A 1” PI-1 bundle was tested to compare bundles with different length / diameter ratios. This bundle exhibited the lowest performance due to the different fiber winding pattern and increased bundle non-ideality. Several long-term and parametric tests were conducted with 3,200 hours of total run-time at NCCC. Finally, the new PI-2 membrane fiber was tested at a small scale (1” modules) in real flue gas and exhibited up to 10 times the CO 2 permeance and slightly lower CO 2 /N 2 selectivity as the commercial PI-1 fiber. This corresponded to a projected 4 - 5 times increase in the productivity per bundle and a potential cost reduction of $3/tonne for CO2 capture, as compared with PI-1. An analytical campaign was conducted to trace different impurities such as NOx, mercury, Arsenic, Selenium in gas and liquid samples through the carbon capture system. An Environmental, Health and Safety (EH&S) analysis was completed to estimate emissions from a 550 MWe net power plant with carbon capture using cold membrane. A preliminary design and cost analysis was completed for 550 tpd (~25 MWe) plant to assess the capital investment and carbon capture cost for PI-1 and PI-2 membrane solutions from coal fired flue gas. A comparison was made with an amine based solution with significant cost advantage for the membrane at this scale. Additional preliminary design and cost analysis was completed between coal, natural gas and SMR flue gas for carbon capture at 550 tpd (~25 MWe) plant.
01 COAL, LIGNITE, AND PEAT↗
Electrofracturing of Shale at Elevated Pressure
Electrofracturing deeply buried shale formations could be used to increase reservoir permeability and improve reservoir production without requiring large volumes of freshwater. This paper describes a novel experimental system and initial test results to electrofracture shale under high confining pressures. Core-scale laboratory testing was performed on twelve rock samples recovered from a shale gas reservoir. Each sample was subjected to confining pressures of 20.7 MPa (3000 psi) or 58.6 MPa (8000 psi), representative of overburden pressures at depth. Samples were then subjected to application of high voltage until specimen fracture. The experiments produced deformed samples with multiple fracture types, both parallel and oblique to bedding planes. Electrofracturing increased permeabilities by up to nine orders of magnitude for extended time periods. Rock fracture and throughgoing fractures were demonstrated. Computed tomography images revealed the creation of fractures and tube/tunnel flow channels, which resisted closure under hydrostatic pressures up to 58.6 MPa. The breakdown energy and permeability changes in the sample were independent of applied confining pressure. The cumulative energy input required for fracture depended on applied confining pressure and sample length. The energy required to fracture samples up to 9 cm in length is generally more than 0.5 kJ/cm, but no greater than 1 kJ/cm. Our results show that electrofracture of shales under confining pressure is possible and could be a possible water-free mechanism for reservoir stimulation.
04 OIL SHALES AND TAR SANDS↗
Priority-enabled Load Balancing for Dispersed Computing
Opportunistic managed access to local in-network compute resources can improve the performance of distributed applications and reduce the dependence on shared network resources. Instead of backhauling application data to a centralized cloud data center for processing, networked services may be adaptively and continuously dispersed into shared compute resources that are closer to the source of need. While this approach has several benefits, support for mission-aware access to computation is often an afterthought, and is implemented as a brittle extension over traditional load-balancer solutions.In this work, we investigate the design of two priority-aware resource allocation strategies and two load-balancing dispatching strategies as first class citizens in an open-source dispersed computing middleware. We present a control theoretic analysis of these load-balancing primitives to identify weaknesses and strengths in our design, and recommend future directions. In parallel, we prototype two priority-aware allocation algorithms to validate our priority predictions. In initial experiments our prototype shows substantial gains in processing prioritized load. Finally, we make our source-code and experimental configurations open source.
Paulos, Aaron↗
Mahakala: A Python-based Modular Ray-tracing and Radiative Transfer Algorithm for Curved Spacetimes
We introduce Mahakala, a Python-based, modular, radiative ray-tracing code for curved spacetimes. We employ Google's JAX framework for accelerated automatic differentiation, which can efficiently compute Christoffel symbols directly from the metric, allowing the user to easily and quickly simulate photon trajectories through non-Kerr spacetimes. JAX also enables Mahakala to run in parallel on both CPUs and GPUs. Mahakala natively uses the Cartesian Kerr–Schild coordinate system, which avoids numerical issues caused by the pole in spherical coordinate systems. We demonstrate Mahakala's capabilities by simulating 1.3 mm wavelength images (the wavelength of Event Horizon Telescope observations) of general relativistic magnetohydrodynamic simulations of low-accretion rate supermassive black holes. The modular nature of Mahakala allows us to quantitatively explore how different regions of the flow influence different image features. We show that most of the emission seen in 1.3 mm images originates close to the black hole and peaks near the photon orbit. We also quantify the relative contribution of the disk, forward jet, and counterjet to 1.3 mm images.
79 ASTRONOMY AND ASTROPHYSICS↗
Parallel-in-Time Solution of Hyperbolic PDE Systems via Characteristic-Variable Block Preconditioning
We consider the parallel-in-time solution of both linear and nonlinear hyperbolic partial differential equation (PDE) systems in one spatial dimension. In the nonlinear setting, the discretized equations are solved with a preconditioned residual iteration based on a global linearization. The linear(ized) equation systems are approximately solved parallel-in-time using a block preconditioner applied in the characteristic variables of the underlying linear(ized) hyperbolic PDE. This change of variables is motivated by the observation that intervariable coupling between characteristic variables is weak, at least locally where spatio-temporal variations in the eigenvectors of the associated flux Jacobian are sufficiently small, while that between the original variables is not. For an ℓ-dimensional system of PDEs, applying the preconditioner consists of solving a sequence of ℓ scalar linear(ized)-advection-like problems, each associated with a different characteristic wave-speed in the underlying linear(ized) PDE. Furthermore, we approximately solve these linear advection problems using multigrid reduction-in-time (MGRIT); however, any other suitable parallel-in-time method could be used. Numerical examples are shown for the (linear) acoustics equations in heterogeneous media and for the (nonlinear) shallow water equations and Euler equations of gas dynamics with shocks and rarefactions. For many test problems, the solver converges in just a handful of iterations and with mesh-independent convergence rates.
97 MATHEMATICS AND COMPUTING↗
The impact of non-local parallel electron transport on plasma-impurity reaction rates in tokamak scrape-off layer plasmas
Abstract Plasma-impurity reaction rates are a crucial part of modelling tokamak scrape-off layer (SOL) plasmas. To avoid calculating the full set of rates for the large number of important processes involved, a set of effective rates are typically derived which assume Maxwellian electrons. However, non-local parallel electron transport may result in non-Maxwellian electrons, particularly close to divertor targets. Here, the validity of using Maxwellian-averaged rates in this context is investigated by computing the full set of rate equations for a fixed plasma background from kinetic and fluid SOL simulations. We consider the effect of the electron distribution as well as the impact of the electron transport model on plasma profiles. Results are presented for lithium, beryllium, carbon, nitrogen, neon and argon. It is found that electron distributions with enhanced high-energy tails can result in significant modifications to the ionisation balance and radiative power loss rates from excitation, on the order of 50%–75% for the latter. Fluid electron models with Spitzer-Härm or flux-limited Spitzer-Härm thermal conductivity, combined with Maxwellian electrons for rate calculations, can increase or decrease this error, depending on the impurity species and plasma conditions. Based on these results, we also discuss some approaches to experimentally observing non-local electron transport in SOL plasmas.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Refine your search to explore more results.