Search NASA⌕ Search

SEARCH · Search NASA

Results for “concurrent data structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Concurrent data structures in the ATLAS offline software

In preparation for Run 3 of the LHC, the ATLAS experiment is modifying its offline software to be fully multithreaded. An important part of this is data structures that can be concurrently accessed from many threads both efficiently and safely. A standard way of achieving this is through mutual exclusion; however, the overhead from this can sometimes be excessive. Fully lockless implementations are known for some data structures; however, they are typically complex, and the overhead they require can sometimes be larger than that required for locking implementations. An interesting compromise is to allow lockless access only for reading but not for writing. This often allows the data structures to be much simpler, while still giving good performance for read-mostly access patterns. This proceeding shows some examples of this strategy in data structures used by the ATLAS offline software. It also gives examples of synchronization strategies inspired by read-copy-update, as well as helpers for memorizing values in a multithreaded environment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2018

SLoG: Large-Scale Logging Middleware for HPC and Big Data Convergence

Cloud developers traditionally rely on purpose-specific services to provide the storage model they need for an application. In contrast, HPC developers have a much more limited choice, typically restricted to a centralized parallel file system for persistent storage. Unfortunately, these systems often offer low performance when subject to highly concurrent, conflicting I/O patterns. This makes difficult the implementation of inherently concurrent data structures such as distributed shared logs. Yet, this data structure is key to applications such as computational steering, data collection from physical sensor grids, or discrete event generators. In this paper we tackle this issue. We present SLoG, shared log middleware providing a shared log abstraction over a parallel file system, designed to circumvent the aforementioned limitations. We evaluate SLoG’s design on up to 100,000 cores of the Theta supercomputer: the results show high append velocity at scale while also providing substantial benefits for other persistent backend storage systems.

big data↗
DOE OSTI2019

Extending the Blockchain: Ensuring Transactional Integrity in Relational Data via Blockchain Technology

The idea of combining a relational database with concepts associated with blockchain technology is being examined. The use case outlined herein concurrently utilizes relational and blockchain data structures to facilitate the sharing of complex data among untrusted users without the participation of a trusted third party. By capturing the transactions that result in data being stored in a relational database and placing those transactions in a blockchain structure, users can be assured that the information has not been created, altered, or destroyed without the knowledge of all users of the data. Capturing relational database transactions via a blockchain structure presents several challenges. Among them are increased storage capacity requirements, transaction ordering prior to placement on the blockchain within a multiuser database, use of existing or creation of new consensus mechanisms, and timely data verification. Addressing these challenges, although not unsurmountable, will introduce trade-offs (e.g., increased system sizing, slower transaction execution) that might or might not be acceptable based upon the envisioned use. If these trade-offs are acceptable, then this concept of extending the blockchain is a powerful method to provide both applications and their users immutable, trusted, well-defined, and consistent data.

Ray, Brian↗
DOE OSTI2015

A lock-free priority queue design based on multi-dimensional linked lists

The throughput of concurrent priority queues is pivotal to multiprocessor applications such as discrete event simulation, best-first search and task scheduling. Existing lock-free priority queues are mostly based on skiplists, which probabilistically create shortcuts in an ordered list for fast insertion of elements. The use of skiplists eliminates the need of global rebalancing in balanced search trees and ensures logarithmic sequential search time on average, but the worst-case performance is linear with respect to the input size. In this paper, we propose a quiescently consistent lock-free priority queue based on a multi-dimensional list that guarantees worst-case search time of O(logN) for key universe of size N. The novel multi-dimensional list (MDList) is composed of nodes that contain multiple links to child nodes arranged by their dimensionality. The insertion operation works by first injectively mapping the scalar key to a high-dimensional vector, then uniquely locating the target position by using the vector as coordinates. Nodes in MDList are ordered by their coordinate prefixes and the ordering property of the data structure is readily maintained during insertion without rebalancing nor randomization. Furthermore, in our experimental evaluation using a micro-benchmark, our priority queue achieves an average of 50% speedup over the state of the art approaches under high concurrency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

The SprayList: a scalable relaxed priority queue

High-performance concurrent priority queues are essential for applications such as task scheduling and discrete event simulation. Unfortunately, even the best performing implementations do not scale past a number of threads in the single digits. This is because of the sequential bottleneck in accessing the elements at the head of the queue in order to perform a DeleteMin operation. In this paper, we present the SprayList, a scalable priority queue with relaxed ordering semantics. Starting from a non-blocking SkipList, the main innovation behind our design is that the DeleteMin operations avoid a sequential bottleneck by ``spraying'' themselves onto the head of the SkipList list in a coordinated fashion. The spraying is implemented using a carefully designed random walk, so that DeleteMin returns an element among the first O(p log^3 p) in the list, with high probability, where p is the number of threads. We prove that the running time of a DeleteMin operation is O(log^3 p), with high probability, independent of the size of the list. Our experiments show that the relaxed semantics allow the data structure to scale for high thread counts, comparable to a classic unordered SkipList. As a result, we observe that, for reasonably parallel workloads, the scalability benefits of relaxation considerably outweigh the additional work due to out-of-order execution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Predictive multiscale modeling for Unidirectional Carbon Fiber Reinforced Polymers

This paper presents a predictive multiscale modeling scheme for Unidirectional (UD) Carbon Fiber Reinforced Polymers (CFRP). A bottom-up modeling procedure is discussed for predicting the performance of UD structures. UD material responses are computed from high fidelity Representative Volume Elements (RVEs). A data-driven Reduced Order Modeling approach compresses RVEs into Reduced Order Models so material responses can be computed in a concurrent fashion along with the structural level simulation. The approach presented in this paper is validated against experimental data and is believed to provide design guidance for future fiber reinforced polymers development.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A Full-Stack Exploration of Language-Based Parallelism in Fortran 2023

This poster explores native parallel features in Fortran 2023 through the lens of supporting applications with libraries, compilers, and parallel runtimes. The language revision informally named Fortran 2008 introduced parallelism in the form of Single Program Multiple Data (SPMD) execution with two broad feature sets: (1) loop-level parallelism via do concurrent and (2) a Partitioned Global Address Space (PGAS) comprised of distributed “coarray” data structures. Fortran’s native parallelism has demonstrated high performance [1] and reduced the burden of inserting what sometimes amounts to more directives than code. Several compilers support both feature sets, typically by translating do concurrent into serial do loops annotated by parallel directives and by translating SPMD/PGAS features into direct calls to a communication library. Our research focuses primarily on two questions: (1) can the compiler’s parallel runtime library be developed in the language being compiled (Fortran) and (2) can we define an interface to the runtime that liberates compilers from being hardwired to one runtime and vice versa. We are answering these questions by developing the Parallel Runtime Interface for Fortran (PRIF) [2] and the Co-Array Fortran Framework of Efficient Interfaces to Network Environments (Caffeine) [3]. Caffeine is initially targeting adoption by LLVM Flang, a new open-source Fortran compiler developed by a broad community in industry, academia, and government labs. We are also exploring the use of these features in Inference-Engine, a deep learning library designed to facilitate neural network training and inference for high-performance computing applications written in modern Fortran.

Rasmussen, Katherine↗
DOE OSTI2017

CO-Dark Star Formation and Black Hole Activity in 3C 368 at z = 1.131: Coeval Growth of Stellar and Supermassive Black Hole Masses

We present the detection of four far-infrared fine-structure oxygen lines, as well as strong upper limits for the CO(2–1) and [N ii] 205 μ m lines, in 3C 368, a well-studied radio-loud galaxy at z = 1.131. These new oxygen lines, taken in conjunction with previously observed neon and carbon fine-structure lines, suggest a powerful active galactic nucleus (AGN), accompanied by vigorous and extended star formation. A starburst dominated by O8 stars, with an age of ∼6.5 Myr, provides a good fit to the fine-structure line data. This estimated age of the starburst makes it nearly concurrent with the latest episode of AGN activity, suggesting a link between the growth of the supermassive black hole and stellar population in this source. We do not detect the CO(2–1) line, down to a level twelve times lower than the expected value for star-forming galaxies. This lack of CO line emission is consistent with recent star formation activity if the star-forming molecular gas has low metallicity, is highly fractionated (such that CO is photodissociated throughout much of the clouds), or is chemically very young (such that CO has not yet had time to form). It is also possible, although we argue it is unlikely, that the ensemble of fine-structure lines is emitted from the region heated by the AGN.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Deep learning of accurate force field of ferroelectric HfO 2

The discovery of ferroelectricity in HfO 2 -based thin films opens up new opportunities for using this silicon-compatible ferroelectric to realize low-power logic circuits and high-density nonvolatile memories. The functional performances of ferroelectrics are intimately related to their dynamic responses to external stimuli such as electric fields at finite temperatures. Molecular dynamics is an ideal technique for investigating dynamical processes on large length and time scales, though its applications to new materials are often hindered by the limited availability and accuracy of classical force fields. Here we present a deep neural network–based interatomic force field of HfO 2 learned from ab initio data using a concurrent learning procedure. The model potential is able to predict structural properties such as elastic constants, equation of states, phonon dispersion relationships, and phase transition barriers of various hafnia polymorphs with accuracy comparable with density functional theory calculations. Here, the validity of this model potential is further confirmed by the reproduction of experimental sequences of temperature-driven ferroelectric-paraelectric phase transitions of HfO 2 with isobaric-isothermal ensemble molecular dynamics simulations. We suggest a general approach to extend the model potential of HfO 2 to related material systems including dopants and defects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Rahasak—Scalable blockchain architecture for enterprise applications

Blockchain-based decentralized infrastructure has been adapted in various industries to handle the sensitive data in a privacy-preserving manner without trusting third parties. However, integrating state-of-the-art blockchain platforms with the scalable, enterprise-level applications result in several challenges. Current blockchain platforms do not support high transaction throughput, lack high scalability, and cannot provide real-time transaction processing and back-pressure operation handling in high transaction throughput applications(e.g Big data, IoT). In this paper, we propose a novel permissioned blockchain platform “Rahasak” for highly scalable, enterprise applications. Rahasak blockchain adopts the Apache Kafka-based consensus on top of a “Validate-Execute-Group” blockchain architecture to handle realtime transaction execution on the blockchain. The architecture is equipped with a functional programming and actor-based smart contract platform that enables concurrent execution of transactions in the blockchain. Rahasak supports high transaction throughput, high scalability, concurrent transaction execution, data analytics features. Finally, with Rahasak, we make blockchain more scalable, secure, structured and meaningful for further data analytics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Xylem

"Digital xylem" that transports data through workflows with structure and support — Command line tool to enable reproducible workflows at scale with streamlined concurrency

Wohlgemuth, JasonHoward [Oak Ridge National Labora↗
DOE OSTI2023

Completeness of the NASA/IPAC Extragalactic Database (NED) Local Volume Sample

We introduce the NASA/IPAC Extragalactic Database (NED) Local Volume Sample (NED-LVS), a subset of ~1.9 million objects with distances out to 1000 Mpc. We use UV and IR fluxes available in NED from all-sky surveys to derive physical properties, and estimate the completeness relative to the expected local luminosity density. The completeness relative to near-IR luminosities (which traces a galaxy's stellar mass) is roughly 100% at D < 30 Mpc and remains moderate (70%) out to 300 Mpc. For brighter galaxies (≳L * ), NED-LVS is ~100% complete out to ~400 Mpc. When compared to other local Universe samples (GLADE and HECATE), all three are ~100% complete below 30 Mpc. At distances beyond ~80 Mpc, NED-LVS is more complete than both GLADE and HECATE by ~10%–20%. NED-LVS is the underlying sample for the NED gravitational-wave follow-up service (NED-GWF), which provides prioritized lists of host candidates for GW events within minutes of alerts issued by the LIGO–Virgo–KAGRA collaboration. We test the prioritization of galaxies in the volume of GW170817 by three physical properties, where we find that both stellar mass and inverse specific star formation rate place the correct host galaxy in the top 10. In addition, NED-LVS can be used for a wide variety of other astrophysical studies: galaxy evolution, star formation, large-scale structure, galaxy environments, and more. The data in NED are updated regularly, and NED-LVS will be updated concurrently. Consequently, NED-LVS will continue to provide an increasingly complete sample of galaxies for a multitude of astrophysical research areas for years to come.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Crystal structures of wild‐type Trichoderma reesei Cel7A catalytic domain in open and closed states

Trichoderma reesei Cel7A efficiently hydrolyses cellulose. We report here the crystallographic structures of the wild‐type Tr Cel7A catalytic domain (CD) in an open state and, for the first time, in a closed state. Molecular dynamics (MD) simulations indicate that the loops along the CD tunnel move in concerted motions. Together, the crystallographic and MD data suggest that the CD cycles between the tense and relaxed forms that are characteristic of work producing enzymes. Analysis of the interactions formed by R251 provides a structural rationale for the concurrent decrease in product inhibition and catalytic efficiency measured for product‐binding site mutants.

Bodenheimer, Annette M.↗
DOE OSTI2024

Investigation of Key Electronic States in Layered Mixed Chalcogenides With a d 0 Transition Metal as Li-Ion Cathodes

Lithium-rich transition metal chalcogenides are witnessing a revival as candidates for Li-ion cathode materials, spurred by the boost in their capacities from transcending conventional redox processes based on cationic states and tapping into additional chalcogenide states. A particularly striking case is Li 2 TiS 3-y Se y , which features a d 0 metal. While the end members are expectedly inactive, substantial capacities are measured when both Se and S are present. Using X-ray absorption spectroscopy, it is shown that the electronic structure of Li 2 TiS 3-y Se y is not a simple combination of the end members. The data confirm previous hypotheses that, in Li 2 TiS 2.4 Se 0.6 , this behavior is underpinned by concurrent and reversible redox of only S and Se, and identify key electronic states. Moreover, wavelet transforms of the extended X-ray absorption fine structure provide direct evidence of the formation of short Se–Se units upon charging. The study uncovers the underpinnings of this intriguing reactivity and highlights the richness of redox chemistry in complex solids.

25 ENERGY STORAGE↗
DOE OSTI2025

Three-dimensional lattice modulations in the charge density wave system Lu 2 Ir 3 Si 5

Using total and resonant x-ray scattering coupled to large-scale computer modeling, we study the lattice modulations in the complex charge density wave (CDW) material Lu 2 ⁢Ir 3 ⁢Si 5 . Here, we find that it is a unique quantum system where periodic lattice modulations related to emergent CDW order occur in three orthogonal atomic planes of the crystal lattice, leading to the emergence of an unusual three-dimensional (3D) pattern of short and long Ir-Ir and Lu-Lu bonds. The 3D character of observed lattice modulations explains the largely isotropic character of the changes in the electronic properties occurring when the CDW order sets in, demonstrating the strong electron-lattice coupling in Lu 2 ⁢Ir 3 ⁢Si 5 . The result is supported by DFT calculations based on the experimental structure data. Altogether, our work provides strong evidence for the presence of a relationship between the dimensionality of emergent lattice distortions and that of concurrent changes in the electronic properties of CDW materials. The relationship may need to be accounted for when these materials are explored for practical applications.

36 MATERIALS SCIENCE↗