Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Source-to-Source Automatic Differentiation of OpenMP Parallel Loops

This article presents our work toward correct and efficient automatic differentiation of OpenMP parallel worksharing loops in forward and reverse mode. Automatic differentiation is a method to obtain gradients of numerical programs, which are crucial in optimization, uncertainty quantification, and machine learning. The computational cost to compute gradients is a common bottleneck in practice. For applications that are parallelized for multicore CPUs or GPUs using OpenMP, one also wishes to compute the gradients in parallel. Here, we propose a framework to reason about the correctness of the generated derivative code, from which we justify our OpenMP extension to the differentiation model. We implement this model in the automatic differentiation tool Tapenade and present test cases that are differentiated following our extended differentiation procedure. Performance of the generated derivative programs in forward and reverse mode is better than sequential, although our reverse mode often scales worse than the input programs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Mineral Deposition on the Rough Walls of a Fracture

Modeling carbonate growth in fractures and pores is important for understanding carbon sequestration in the environment or when supersaturated solutions are injected into rocks. Here, we study the simple but nontrivial problem of calcite growth on fractures with rough walls of the same mineral using kinetic Monte Carlo simulations of attachment and detachment of molecules and scaling approaches. First, we consider wedge-shaped fracture walls whose upper terraces are in the same low-energy planes and show that the valleys are slowly filled by the propagation of parallel monolayer steps in the wedge sides. The growth ceases when the walls reach these low-energy configurations so that a gap between the walls may not be filled. Second, we consider fracture walls with equally separated monolayer steps (vicinal surfaces with roughness below 1 nm) and show that growth by step propagation will eventually clog the fracture gap. In both cases, scaling approaches predict the times to attain the final configurations as a function of the initial geometry and the step-propagation velocity, which is set by the saturation index. The same reasoning applied to a random wall geometry shows that step propagation leads to lateral filling of surface valleys until the wall reaches the low-energy crystalline plane that has the smallest initial density of molecules. Thus, the final configurations of the fracture walls are much more sensitive to the crystallography than to the roughness or the local curvature. The framework developed here may be used to determine those configurations, the times to reach them, and the mass of deposited mineral. Effects of transport limitations are discussed when the fracture gap is significantly narrowed.

calcite↗
DOE OSTI2022

A critical comparison of CH∙∙∙π versus π∙∙∙π interactions in the benzene dimer: obtaining benchmarks at the CCSD(T) level and assessing the accuracy of lower scaling methods

In this study, we have established CCSD(T)/CBS (Complete Basis Set) limits for 3 stationary points on the benzene dimer potential energy surface, corresponding to the π∙∙∙π (parallel displaced or PD(C 2h ), minimum) and CH∙∙∙π (T-shaped or T(C 2v ), transition state) and tilted T-shaped (or TT(Cs), minimum) bonding scenarios considering both the structure and binding energy. The CCSD(T)/CBS binding energies are -2.65 ± 0.02 (PD), -2.74 ± 0.03 (T), and -2.83 ± 0.01 kcal mol -1 (TT). To this end, the CH∙∙∙π is ~0.2 kcal mol -1 stronger than the π∙∙∙π interaction, whereas the tilting of the CH donating benzene molecule with respect to the other benzene is worth 0.1 kcal mol -1 . As previously discussed in the literature, the MP2 level of theory does not provide a close match for either the energy or structure, yet the SCS-MP2 yields structures in excellent agreement with respect to the CCSD(T) result. It is found that the SCS-MI-MP2 also gives optimized structures very close to SCS-MP2 (within ~0.01 Å of the benchmark). Despite the closer match in structure, the spin-biased MP2 methods (SCS-, SCS-MI-, and SOS-MP2) incorrectly predict the relative stabilities of the isomers. That said, none of the spin biased MP2 methods offers a good compromise between energy and structure for the systems examined. Finally, the CCSD(T)/CBS benchmarks were used to assess the performance of 13 DFT functionals selected from different rungs of Jacob's ladder. Several functionals such as TPSS-D3, B3LYP-D3, B97-D, B97-D3, and B2PLYP-D3 provided a good description of the binding energies for both CH∙∙∙π and π∙∙∙π interactions, yielding values within 6% of the CCSD(T)/CBS benchmark values. Unlike the MP2 methods, these functionals correctly predict the relative stability of the PD(C 2h ) and T(C 2v ) dimers. Further, we find that there is no systematic improvement as Jacob's ladder is ascended (increased complexity of functional). The best functionals that result in a good compromise between structure and energy accuracy are B97-D3 and B2PLYP-D3 for both the CH∙∙∙π and π∙∙∙π interaction. Despite the impressive performance of these functionals, a challenge that remains is ensuring the transferability of these density functionals in accurately describing the interaction between dimers of larger aromatic molecules, the latter requiring high-level benchmarks for these systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Coarse-grained simulation of colloidal self-assembly, cation exchange, and rheology in Na/Ca smectite clay gels

Knowledge Gap: The aggregation of clay minerals—layered silicate nanoparticles—strongly impacts fluid flow, solute migration, and solid mechanics in soils, sediments, and sedimentary rocks. Experimental and computational characterization of clay aggregation is inhibited by the delicate water-mediated nature of clay colloidal interactions and by the range of spatial scales involved, from 1 nm thick platelets to flocs with dimensions up to micrometers or more. Simulations: Using a new coarse-grained molecular dynamics (CGMD) approach, we predicted the microstructure, dynamics, and rheology of hydrated smectite (more precisely, montmorillonite) clay gels containing up to 2,000 clay platelets on length scales up to 0.1 μm. Further, simulations investigated the impact of simulation time, platelet diameters (6 to 25nm), and the ratio of Na to Ca exchangeable cations on the assembly of tactoids (i.e., stacks of parallel clay platelets) and larger aggregates (i.e., assemblages of tactoids). We analyzed structural features including tactoid size and size distribution, basal spacing, counterion distribution in the electrical double layer, clay association modes, and the rheological properties of smectite gels. Findings: Our results demonstrate new potential to characterize and understand clay aggregation in dilute suspensions and gels on a scale of thousands of particles with explicit representation of counterion clouds and with accuracy approaching that of all-atom molecular dynamics (MD) simulations. For example, our simulations predict the strong impact of Na/Ca ratio on clay tactoid formation and the shear-thinning rheology of clay gels.

42 ENGINEERING↗
DOE OSTI2025

A parallel-kinetic-perpendicular-moment model for magnetised plasmas

We describe a new model for the study of weakly collisional, magnetised plasmas derived from exploiting the separation of the dynamics parallel and perpendicular to the magnetic field. This unique system of equations retains the particle dynamics parallel to the magnetic field while approximating the perpendicular dynamics through a spectral expansion in the perpendicular degrees of freedom, analogous to moment-based fluid approaches. In so doing, a hybrid approach is obtained that is computationally efficient enough to allow for larger-scale modelling of plasma systems while eliminating a source of difficulty in deriving fluid equations applicable to magnetised plasmas. We connect this system of equations to historical asymptotic models and discuss advantages and disadvantages of this approach, including the extension of this parallel-kinetic-perpendicular moment beyond the typical region of validity of these more traditional asymptotic models. This paper forms the first of a multi-part series on this new model, covering the theory and derivation, alongside demonstration benchmarks of this approach that include shocks and magnetic reconnection.

astrophysical plasmas↗
DOE OSTI2024

Hierarchical Phased-Array Antennas Coupled to Al KIDs: A Scalable Architecture for Multi-band Millimeter/Submillimeter Focal Planes

We present the optical characterization of two-scale hierarchical phased-array antenna kinetic inductance detectors (KIDs) for millimeter/submillimeter wavelengths. Our KIDs have a lumped-element architecture with parallel plate capacitors and aluminum inductors. The incoming light is received with a hierarchical phased array of slot dipole antennas, split into 4 frequency bands (between 125 GHz and 365 GHz) with on-chip lumped-element band-pass filters, and routed to different KIDs using microstriplines. Individual pixels detect light for the 3 higher-frequency bands (190–365 GHz), and the signals from four individual pixels are coherently summed to create a larger pixel detecting light for the lowest frequency band (125–175 GHz). The spectral response of the band-pass filters was measured using Fourier transform spectroscopy (FTS), the far-field beam pattern of the phased-array antennas was obtained using an infrared source mounted on a 2-axis translating stage, and the optical efficiency of the KIDs was characterized by observing loads at 294 K and 77 K. We report on the results of these three measurements.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Unidirectional growth of graphene nano-islands from carbon cluster seeds on Ge(1 1 0)

The anisotropic twofold symmetry of Ge(1 1 0) makes it a unique substrate for the growth of single-crystalline graphene. However, the underlying mechanism during the initial stage of growth of graphene on Ge(1 1 0) surface is not well understood. Here, we use in-situ cryogenic scanning tunneling microscopy (STM) and spectroscopy (STS), to study the initial growth properties of graphene synthesized on Ge(1 1 0) surface with ethylene precursor gases. The STM results reveal that the unidirectional growth of the graphene nanoribbons (GNRs) initiates from carbon cluster seeds on terraces during the early stage of the growth. The orientations of the GNRs show the same directions which are nearly parallel to the direction of the Ge(1 1 0) surface. This orientation is the same as that of the wafer-scale graphene grown on Ge(1 1 0). Subsequent growth, transformed the GNRs to graphene nanoislands (GNIs), which eventually coalesced to form single crystalline monolayer graphene. STS measurements demonstrated that the GNRs have small bandgaps induced by the confinement effect of graphene. Furthermore, this study provides an in-depth understanding of the growth mechanism of graphene on Ge(1 1 0) surface in various synthesis conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Simulations of plasmas and fluids using anti-symmetric models

ALMA (Anti-symmetric, Large-Moment, Accelerated) is a fast, flexible, and scalable toolkit designed to solve hyperbolic conservation law systems in hybrid supercomputers. Here this manuscript describes the theoretical background and implementation of ALMA, which uses the anti-symmetric formulation of fluids to obtain simple, robust, and easily paralellizable code. Practical GPU acceleration is realized on entire applications with an overall gain factor of 2 to 4. ALMA also provides a parallel, GPU accelerated sparse solver based on geometric multigrid, capable of diagonalizing linear systems with 239 unknowns. Here we demonstrate ALMA's scaling and performance in petascale supercomputers and use standard fluid models to verify the overall approach with canonical benchmark problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

GronOR: Scalable and Accelerated Nonorthogonal Configuration Interaction for Molecular Fragment Wave Functions

GronOR is a program package for nonorthogonal configuration interaction calculations. Electronic wave functions are constructed in terms of antisymmetrized products of multiconfiguration molecular fragment wave functions. The computational complexity of the nonorthogonal methodologies implemented in GronOR applied to large molecular assemblies requires a design that takes full advantage of massively parallel supercomputer architectures and accelerator technologies. This work describes the implementation strategy and resulting performance characteristics. In addition to parallelization and acceleration, the software development strategy includes aspects of fault resiliency and heterogeneous computing. The program was designed for large-scale supercomputers but also runs effectively on small clusters and workstations for small molecular systems. GronOR is available as open source to the scientific community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Design and Implementation of Papyrus: Parallel Aggregate Persistent Storage

A surprising development in recently announced HPC platforms is the addition of, sometimes massive amounts of, persistent (nonvolatile) memory (NVM) in order to increase memory capacity and compensate for plateauing I/O capabilities. However, there are no portable and scalable programming interfaces using aggregate NVM effectively. This paper introduces Papyrus: a new software system built to exploit emerging capability of NVM in HPC architectures. Papyrus (or Parallel Aggregate Persistent -YRU- Storage) is a novel programming system that provides features for scalable, aggregate, persistent memory in an extreme-scale system for typical HPC usage scenarios. Papyrus mainly consists of Papyrus Virtual File System (VFS) and Papyrus Template Container Library (TCL). Papyrus VFS provides a uniform aggregate NVM storage image across diverse NVM architectures. It enables Papyrus TCL to provide a portable and scalable high-level container programming interface whose data elements are distributed across multiple NVM nodes without requiring the user to handle complex communication, synchronization, replication, and consistency model. We evaluate Papyrus on two HPC systems, including UTK Beacon and NERSC Cori, using real NVM storage devices.

Kim, Jungwon↗
DOE OSTI2017

Galactos: computing the anisotropic 3-point correlation function for 2 billion galaxies

The nature of dark energy and the complete theory of gravity are two central questions currently facing cosmology. A vital tool for addressing them is the 3-point correlation function (3PCF), which probes deviations from a spatially random distribution of galaxies. However, the 3PCF's formidable computational expense has prevented its application to astronomical surveys comprising millions to billions of galaxies. We present Galactos, a high-performance implementation of a novel, O( N 2 ) algorithm that uses a load-balanced k-d tree and spherical harmonic expansions to compute the anisotropic 3PCF. Our implementation is optimized for the Intel Xeon Phi architecture, exploiting SIMD parallelism, instruction and thread concurrency, and significant L1 and L2 cache reuse, reaching 39% of peak performance on a single node. Galactos scales to the full Cori system, achieving 9.8 PF (peak) and 5.06 PF (sustained) across 9636 nodes, making the 3PCF easily computable for all galaxies in the observable universe.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

CORRLA-RS

The CORRLA-RS package provides a suite of statistical methods for sampling multidimensional distributions and to conduct sensitivity and correlation analysis of large scale data in the Rust programming language. The software provides a unique solution to multidimensional constrained sampling problems utilizing a combination of parallelized Markov Chain Monte Carlo methods and traditional rejection sampling. The sensitivity and correlation analysis methods are backed by a high performance randomized singular value decomposition implementation which enables datasets larger than the random access memory (RAM) size to be analyzed. Additionally, CORRLA-RS implements the active subspace identification method using a KD-Tree and the randomized singular value decomposition acting in concert.

Gurecky, William [Oak Ridge National Laboratory (O↗
DOE OSTI2024

Numerical eigen-spectrum slicing, accurate orthogonal eigen-basis, and mixed-precision eigenvalue refinement using OpenMP data-dependent tasks and accelerator offload

Performing a variety of numerical computations efficiently and, at the same time, in a portable fashion requires both an overarching design followed by a number of implementation strategies. All of these are exemplified below as we present transitioning the PLASMA numerical library from relying on dependence-driven large tasks to achieving utilization of fine grain tasking and offload to hardware accelerators while keeping its core dependence sets: OpenMP source code pragmas and runtime for most system-level functionality and basic low-level numerical kernels provided directly by hardware vendors or open source projects with vendor contributions. We also present new algorithmic methods and their efficient parallel implementations including fine grained tasking for eigen-spectrum slicing and offload for mixed-precision eigenvalue refinement. We provide performance, scaling, and numerical results showing sizable gains over the available solutions from either the open source and vendor-provided packages.

Luszczek, Piotr↗
DOE OSTI2023

Scintillating Bubble Chambers for Rare Event Searches

The Scintillating Bubble Chamber (SBC) collaboration is developing liquid-noble bubble chambers for the detection of sub-keV nuclear recoils. These detectors benefit from the electron recoil rejection inherent in moderately-superheated bubble chambers with the addition of energy reconstruction provided from the scintillation signal. The ability to measure low-energy nuclear recoils allows the search for GeV-scale dark matter and the measurement of coherent elastic neutrino-nucleus scattering on argon from MeV-scale reactor antineutrinos. The first physics-scale detector, SBC-LAr10, is in the commissioning phase at Fermilab, where extensive engineering and calibration studies will be performed. In parallel, a functionally identical low-background version, SBC-SNOLAB, is being built for a dark matter search underground at SNOLAB. SBC-SNOLAB, with a 10 kg-yr exposure, will have sensitivity to a dark matter–nucleon cross section of 2×10 –42 cm 2 at 1 GeV/c 2 dark matter mass, and future detectors could reach the boundary of the argon neutrino fog with a tonne-yr exposure. In addition, the deployment of an SBC detector at a nuclear reactor could enable neutrino physics investigations including measurements of the weak mixing angle and searches for sterile neutrinos, the neutrino magnetic moment, and the light Z’ gauge boson.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Large-scale real-time signal processing in physics experiments: the ALICE TPC FPGA pipeline

For LHC Run 3, the ALICE Time Projection Chamber was upgraded to operate in continuous readout mode. Interaction rates of up to 50 kHz in Pb-Pb collisions require real-time processing of more than 3 TB s -1 of raw detector data. This requirement is met by a custom FPGA-based processing pipeline that performs the complete front-end data treatment fully in-stream, including common-mode correction, pedestal subtraction, ion-tail filtering, zero suppression, and dense data packing. A central element of the design is a highly parallel common-mode correction algorithm operating directly on the streaming data. It robustly identifies signal-free readout channels on a time-bin basis and applies pad-dependent scaling to compensate for local variations in capacitive coupling in the GEM readout. In combination with pedestal subtraction and ion-tail filtering, this enables accurate baseline restoration under extreme high-occupancy conditions, preventing signal loss while efficiently suppressing noise prior to zero suppression. The pipeline operates continuously at the full detector bandwidth and reduces the raw input rate of approximately 3 TB s -1 to about 900 GBps for Pb-Pb collisions at the target interaction rate. Overall, it represents a large-scale FPGA-based real-time signal-processing implementation for high-energy physics detector readout.

Digital signal processing (DSP)↗
DOE OSTI2024

Experimental Investigation of Low-Frequency Distributed Acoustic Sensor Responses to Two Parallel Propagating Fractures

Low-frequency distributed acoustic sensing (LF-DAS) is a diagnostic tool for hydraulic fracture propagation with far-field monitoring using fiber optic sensors. LF-DAS senses strain rate variation caused by stress field change due to fracture propagation. Fiber optic sensors are installed in the monitoring wells in the vicinity of a fractured well. From the strain responses, fracture propagation can be evaluated. To understand subsurface conditions with multiple propagating fractures, a laboratory-scale hydraulic fracture experiment was performed simulating the LF-DAS response to fracture propagation with embedded distributed optical fiber strain sensors under these conditions. The experiment was performed using a transparent cube of epoxy with two parallel radial initial flaws centered in the cube. Fluid was injected into the sample to generate fractures along the initial flaws. The experiment used distributed high-definition fiber optic strain sensors with tight spatial resolutions. The sensors were embedded at two different locations on opposite sides of the initial flaws, serving as observation/monitoring locations. We also employed finite element modeling to numerically solve the linear elastic equations of equilibrium continuity and stress–strain relationships. The measured strains from the experiment were compared to simulation results from the finite element model. The experimentally derived strain and strain-rate waterfall plots from this study show the responses to both fractures propagating, while the fracture at the lower position took most of the fluid during the experiment. Interestingly, a fracture first began propagating from the upper flaw of the two flaws, but once the lower fracture was initiated, it grew much faster than the upper fracture. Both fibers were intercepted by the lower fracture, further verifying the strain signature as a fracture is approaching and intersecting an offset fiber.

Chemistry↗
DOE OSTI2017

ArrayBridge: Interweaving declarative array processing with high-performance computing

Scientists are increasingly turning to datacenter-scale computers to produce and analyze massive arrays. Despite decades of database research that extols the virtues of declarative query processing, scientists still write, debug and parallelize imperative HPC kernels even for the most mundane queries. This impedance mismatch has been partly attributed to the cumbersome data loading process; in response, the database community has proposed in situ mechanisms to access data in scientific file formats. Scientists, however, desire more than a passive access method that reads arrays from files. This paper describes ArrayBridge, a bi-directional array view mechanism for scientific file formats, that aims to make declarative array manipulations interoperable with imperative file-centric analyses. Our prototype implementation of ArrayBridge uses HDF5 as the underlying array storage library and seamlessly integrates into the SciDB open-source array database system. In addition to fast querying over external array objects, ArrayBridge produces arrays in the HDF5 file format just as easily as it can read from it. ArrayBridge also supports time travel queries from imperative kernels through the unmodified HDF5 API, and automatically deduplicates between array versions for space efficiency. Our extensive performance evaluation in NERSC, a large-scale scientific computing facility, shows that ArrayBridge exhibits statistically indistinguishable performance and I/O scalability to the native SciDB storage engine.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A network approach for multiscale catchment classification using traits

Abstract. The classification of river catchments into groups with similar biophysical characteristics is useful to understand and predict their hydrological behavior. The increasing availability of remote sensing and other large-scale geospatial datasets has enabled the use of advanced data-driven approaches to classify catchments using traits such as topography, geology, climate, land cover, land use, and human influence. Unsupervised clustering algorithms based on the Euclidean distance are commonly used for trait-based classification but are not suitable for highly dimensional data. In this study we present a new network-based method for multi-scale catchment classification, which can be applied to large datasets and used to determine the traits associated with different catchment groups. In this framework, two networks are analyzed in parallel: the first being where the nodes are traits and the second being where the nodes are catchments. In both cases, edges represent pairwise similarity, and a network cluster detection algorithm is used for the classification. The trait network is used to investigate redundancy in the trait data and to condense this information into a small number of interpretable categories. The catchments network is used to classify the catchments into clusters and to identify representative catchments for the different groups using the degree centrality metric. We apply this method to classify 9067 river catchments across the contiguous United States at both regional and continental scales using 274 non-categorical traits. At the continental scale, we identify 25 interpretable trait categories and 34 catchment clusters of sizes greater than 50. We find that catchments with similar trait categories are typically located in the same region, with different spatial patterns emerging among clusters dominated by natural and anthropogenic traits. We also find that the catchment clusters exhibit distinct hydrological behavior based on an analysis of streamflow indices. This network approach provides several advantages over traditional means of classification, including better separation of clusters, the use of alternate similarity metrics that are more suitable for highly dimensional data, and reducing redundancy in the trait information. The paired catchment–trait networks enable analysis of hydrological behavior using the dominant trait categories for each catchment cluster. The approach can be used at multiple spatial scales since the network topologies adjust automatically to reflect the trait patterns at the scale of investigation. Finally, the representative catchments identified as hub nodes in the network can be used to guide transferable observational and modeling strategies. The method is broadly applicable beyond hydrology for classification of other complex systems that utilize different types of trait datasets.

54 ENVIRONMENTAL SCIENCES↗