Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Where Big Data and Prediction Meet

Our ability to assemble and analyze massive data sets, often referred to under the title of “big data”, is an increasingly important tool for shaping national policy. This in turn has introduced issues from privacy concerns to cyber security. But as IBM’s John Kelly emphasized in the last Innovation, making sense of the vast arrays of data will require radically new computing tools. In the past, technologies and tools for analysis of big data were viewed as quite different from the traditional realm of high performance computing (HPC) with its huge models of phenomena such as global climate or supporting the nuclear test moratorium. Looking ahead, this will change with very positive benefits for both worlds. Societal issues such as global security, economic planning and genetic analysis demand increased understanding that goes beyond existing data analysis and reduction. The modeling world often produces simulations that are complex compositions of mathematical models and experimental data. This has resulted in outstanding successes such as the annual assessment of the state of the US nuclear weapons stockpile without underground nuclear testing. Ironically, while there were historically many test conducted, this body of data provides only modest insight into the underlying physics of the system. A great deal of emphasis was thus placed on the level of confidence we can develop for the predictions. As data analytics and simulation come together, there is a growing need to assess the confidence levels in both data being gathered and the complex models used to make predictions. An example of this is assuring the security or optimizing the performance of critical infrastructure systems such as the power grid. If one wants to understand the vulnerabilities of the system or impacts of predicted threats, full scales tests of the grid against threat scenarios are unlikely. Preventive measures would need to be predicated on well-defined margins of confidence in order to take mitigating actions that could have wide ranging impacts. There is a rich opportunity for interaction and exchange between the HPC simulation and data analytics communities.

97 MATHEMATICS AND COMPUTING↗

ERSAP: Toward Better NP Data-Stream Analytics With Flow-Based Programming

This paper presents an reactive, actor-model and FBP paradigm based framework that we develop to design data-stream processing applications for HEP and NP. This framework encourages a functional decomposition of the overall data processing application into small mono-functional artifacts. Artifacts that are easy to understand, develop, deploy and debug. The fact that these artifacts (actors) are programmatically independent they can be scaled and optimized independently, which is impossible to do for components of the monolithic application. One of the important advantages of this approach is fault tolerance where independent actors can come and go on the data-stream without forcing the entire application to crash. Furthermore, it also makes it is easy to locate the faulty actor in the data pipeline. Due the fact that the actors are loosely coupled, and that the data (inevitably) carries the context, they can run on heterogeneous environments, utilizing different accelerators. This paper describes the main design concepts of the framework and presents a ?proof of concept? application design and deployment results obtain processing on-beam calorimeter streaming data.

Gyurjyan, V.↗

Data Science and Computation for Rapid and Dynamic Compression Experiment Workflows at Experimental Facilities (Workshop Overview) [Slides]

Motivation for this workshop stems from these items: Compression experiments are important to LANL's core mission. The scientific community is sometimes frustrated at the pace of discovery. Data analytics for other experimental regimes are advancing. Now is the time as facilities are upgraded and coming online. Advances in data analytics and computational resources could push compression experiment discoveries to a new level.

97 MATHEMATICS AND COMPUTING↗

A Surveillance Infrastructure for Malaria Analytics: Provisioning Data Access and Preservation of Interoperability

Background: According to the World Health Organization, malaria surveillance is weakest in countries and regions with the highest malaria burden. A core obstacle is that the data required to perform malaria surveillance are fragmented in multiple data silos distributed across geographic regions. Furthermore, consistent integrated malaria data sources are few, and a low degree of interoperability exists between them. As a result, it is difficult to identify disease trends and to plan for effective interventions. Objective: We propose the Semantics, Interoperability, and Evolution for Malaria Analytics (SIEMA) platform for use in malaria surveillance based on semantic data federation. Using this approach, it is possible to access distributed data, extend and preserve interoperability between multiple dynamic distributed malaria sources, and facilitate detection of system changes that can interrupt mission-critical global surveillance activities. Methods: We used Semantic Automated Discovery and Integration (SADI) Semantic Web Services to enable data access and improve interoperability, and the graphical user interface-enabled semantic query engine HYDRA to implement the target queries typical of malaria programs. We implemented a custom algorithm to detect changes to community-developed terminologies, data sources, and services that are core to SIEMA. This algorithm reports to a dashboard. Valet SADI is used to mitigate the impact of changes by rebuilding affected services. Results: We developed a prototype surveillance and change management platform from a combination of third-party tools, community-developed terminologies, and custom algorithms. We illustrated a methodology and core infrastructure to facilitate interoperable access to distributed data sources using SADI Semantic Web services. This degree of access makes it possible to implement complex queries needed by our user community with minimal technical skill. We implemented a dashboard that reports on terminology changes that can render the services inactive, jeopardizing system interoperability. Using this information, end users can control and reactively rebuild services to preserve interoperability and minimize service downtime. Conclusions: We introduce a framework suitable for use in malaria surveillance that supports the creation of flexible surveillance queries across distributed data resources. The platform provides interoperable access to target data sources, is domain agnostic, and with updates to core terminological resources is readily transferable to other surveillance activities. A dashboard enables users to review changes to the infrastructure and invoke system updates. The platform significantly extends the range of functionalities offered by malaria information systems, beyond the state-of-the-art.

60 APPLIED LIFE SCIENCES↗

Development of Monitoring Techniques for Laser Powder Bed Additive Manufacturing of Metal Structures (Progress Report)

The Transformational Challenge Reactor (TCR) program is leveraging additive manufacturing (AM) technologies to fabricate nuclear grade components to be assembled into a fully functional microreactor core. Compared to traditional manufacturing technologies, additive manufacturing technologies allow (1) observation of the manufacturing process at a much higher resolution in real time using in situ monitoring technologies to capture the sensor signature that scientifically describes each event occurring over time and space, and (2) validation of the manufacturing process quality using domain-informed data analytics techniques as a potential qualification and certification methodology for the final component. This report provides an update on the program work on laser powder bed fusion in-situ process monitoring and associated data analytics results. Examples are provided to illustrate the progress. Elements of the Digital Thread and data management are discussed in the main document, and an extensive supplemental material section is provided detailing the Digital Platform, as well as its implementation and components. In conclusion the path forward for the next fiscal year is discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of Efficient Process for Manufacturing of Thermoplastic Composites with Tailored Properties (CRADA 511)

This is a collaborative effort between Battelle Memorial Institute as manager and operator of Pacific Northwest National Laboratory (PNNL) and ESI North America Inc. (“ESI” or “Participant”) to apply computation and data analytics to the challenge of light weighting with a focus on the battery enclosures of electric vehicles (EVs). EVs use heavy batteries to increase range and power. A complex-shaped battery enclosure is required to meet a host of challenging performance requirements. The ability to virtually develop composite parts such as battery enclosure with tailored properties to meet required performance will be highly valuable to the automotive industry. However, efficient simulation of composite-manufacturing processes remains a challenging issue since simulation involves multiscale models in space and time, highly non-linear and anisotropic behavior, strongly coupled multi-physics, and complex geometries. This work will advance the state of the art by reducing the computational burden of composite optimization by using simulation data from a limited number of configurations off-line and then developing a reduced order model (ROM) using data analytics and machine learning (ML). Develop a data driven approach to link features of the material and manufacturing processes to the mechanical properties of thermoplastic composite parts.

42 ENGINEERING↗

Improving the Freight Productivity of a Heavy-Duty, Battery Electric Truck by Intelligent Energy Management

This project aimed to enhance the range and reduce the operating costs of battery electric Class 8 trucks traveling over 250 miles daily. This was achieved through the development and implementation of an intelligent-Energy Management System (i-EMS) that leverages vehicle and operations data, physics-aware machine learning algorithms, and vehicle-to-cloud (V2C) connectivity. The project hypothesized that advanced machine learning algorithms and real-time data analytics could significantly improve the energy efficiency and range of these trucks. Key objectives included developing a physics-aware machine learning algorithm, implementing an i-EMS with V2C connectivity and physics-aware spatial data analytics (PSDA), and validating the system’s effectiveness with fleet partners HEB Companies and Murphy Logistics. Extensive data collection from vehicle operations, including vehicle characteristics, road conditions, and payload, was conducted. A machine learning algorithm was developed to predict energy consumption and enable proactive decision-making. The i-EMS was implemented on two Volvo VNR BEVs, with operators receiving charging and routing recommendations. Charging stations were installed at depot locations in Texas and Minnesota, with an additional on-route charger in Minnesota. Significant findings included a 14% range improvement for Murphy Logistics on a highway-driving eco-route and a 22% range improvement for HEB Companies on a city-driving eco-route. The i-EMS utilized rule-based methods and physics-based algorithms to predict and reduce energy consumption, with real-time monitoring and analysis through V2C connectivity enabling proactive decision-making. The project demonstrated the feasibility and economic viability of battery electric Class 8 trucks for long-haul operations, showcasing the potential of physics-aware machine learning in optimizing energy management. The successful implementation of the i-EMS in real-world scenarios validates its practical application and effectiveness, paving the way for the widespread adoption of battery electric vehicles in the freight transportation industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Recursive Use of the Short-Time Fast Fourier Transform for Signature Analysis in Continuous Processes

Although a nuclear reactor is a hostile environment for sensing and electrical communications, the reactor core is amenable to acoustic communication. An acoustic measurement infrastructure (AMI) has been installed in the Advanced Test Reactor (ATR) to record acoustic signals that can capture its different operating regimes. AMI uses coolant pumps as continuous signal sources, coolant and structural components as transmission lines, and accelerometers to capture system motion. A recursive signal processing technique based on the short-time fast Fourier transform (STFFT) for continuous processes provides unique signatures for diagnostic and prognostic analyses from the system motion data. Here this article presents a recursive STFFT methodology that processes acoustic signals from continuous industrial processes. The article first discusses the initial STFFT use with simulated data to elucidate the basic principles necessary to understand and interpret the STFFT results from actual pump vibration data. Each repetitive use of the STFFT on pump vibration data using the results from the prior STFFT processing will generate additional complimentary time-frequency-based signatures. These signatures are generated by the coolant pumps operating under different process conditions. After each use of the STFFT, the resulting signatures provide exemplary examples of the diversity and intuitive nature of recursively using the STFFT. This article focuses on recursively using the STFFT to provide numerous complimentary and diverse signatures that will ultimately be inputs for machine learning algorithms that provide predictive data analytics. The intuitive nature of the information and signatures from recursive STFFT processing will also bring intuitive interpretation capabilities to machine learning and predictive data analytic techniques.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

High throughput crystal structure and composition mapping of crystalline nanoprecipitates in alloys by transmission Kikuchi diffraction and analytical electron microscopy

Statistically significant crystal structure and composition identification of nanocrystalline features such as nanoparticles/nanoprecipitates in materials chemistry and alloy designing using electron microscopy remains a grand challenge. In this paper, we reveal that differing crystallographic phases of nanoprecipitates in alloys can be mapped with unprecedented statistics using transmission Kikuchi diffraction (TKD), on typical carbon-based electron-transparent samples. Using a case of multiphase, multicomponent nanoprecipitates extracted from an improved version of 9% chromium Eurofer-97 reduced-activation ferritic-martensitic steel we show that TKD successfully identified more than thousand M 23 C 6 , MX, M 7 C 3 , and M 2 X ( M =Fe, Cr, W, V, Ta; X = C, N) nanoprecipitates in a single scan, something that is currently unachievable using a transmission electron microscope (TEM) without incorporating a precision electron diffraction (PED) system. Precipitates as small as ~20–25 nm were successfully phase identified by TKD. We verified the TKD phase identification using high-resolution transmission electron microscopy (HRTEM) and convergent beam electron diffraction (CBED) pattern analysis of a few precipitates that were identified by TKD on same sample. TKD study was combined with state-of-art analytical scanning transmission electron microscopy (STEM)-energy dispersive X-ray (EDX) spectroscopy and multivariate statistical analysis (MVSA) which provided the complete crystal structure and distinct chemistries of the precipitates in the steel in a high throughput automated way. This technique should be applicable to characterizing any multiphase crystalline nanoparticles or nanomaterials. Furthermore the results highlight that combining phase identification by TKD with analytical STEM and modern data analytics may open new pathways in big data material characterization at nanoscale that may be highly beneficial for characterizing existing materials and in designing new materials.

36 MATERIALS SCIENCE↗

Report on Progress of correlation of in-situ and ex-situ data and the use of artificial intelligence to predict defects

The Transformational Challenge Reactor (TCR) program is leveraging additive manufacturing (AM) technologies to fabricate nuclear components which will be assembled into a fully functional microreactor core. Compared with traditional manufacturing technologies, AM technologies allow (1) real-time observation of the manufacturing process at a much higher resolution using in-situ monitoring technologies to capture the sensor signatures that scientifically describe each event occurring over time and space and (2) validation of the manufacturing process quality using domain-informed data analytics techniques as a potential qualification and certification methodology for the final component. This report provides an update on the program work on in-situ and ex-situ data correlation and associated data analytics results. Examples are provided to illustrate progress with respect to laser powder bed fusion (L-PBF), binder jetting, computed tomography (CT) reconstruction, and mechanical testing. Elements of the Digital Thread and data management infrastructure are discussed in the main document, and an extensive supplemental appendix is provided detailing the Digital Platform, as well as its implementation and subcomponents. In conclusion, the path forward for the next fiscal year is also discussed.

42 ENGINEERING↗

Development of Monitoring Techniques for Binderjet Additive Manufacturing of Silicon Carbide Structures

The Transformational Challenge Reactor (TCR) program is leveraging additive manufacturing (AM) technologies to fabricate nuclear components to be assembled into a fully functional microreactor core. Compared with traditional manufacturing technologies, AM technologies allow (1) observation of the manufacturing process at a much higher resolution in real-time using in situ monitoring technologies to capture the sensor signature that scientifically describes each event occurring over time and space and (2) validation of the manufacturing process quality using domain-informed data analytics techniques as a potential qualification and certification methodology for the final component. This report provides an update on the program work on binder jetting in situ process monitoring and associated data analytics results, as well as sample placement and tracking for the subsequent chemical vapor infiltration (CVI) process. Examples are provided to illustrate the progress. Elements of the Digital Thread and data management are discussed in the main document, and an extensive supplemental material section is provided detailing the Digital Platform, as well as its implementation and components. In conclusion the path forward for the next fiscal year is discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Physical Property Analysis and Report for Sediments at 100-BC-5 Operable Unit, Boreholes C7505, C7506, C7507, and C7665

Between October 14, 2009 and February 22, 2010 sediment samples were received from 100-BC Decision Unit for geochemical studies. This is an analytical data report for sediments received from CHPRC at the 100 BC 5 OU. The analyses for this project were performed at the 325 building located in the 300 Area of the Hanford Site. The analyses were performed according to Pacific Northwest National Laboratory (PNNL) approved procedures and/or nationally recognized test procedures. The data sets include the sample identification numbers, analytical results, estimated quantification limits (EQL), and quality control data. The preparatory and analytical quality control requirements, calibration requirements, acceptance criteria, and failure actions are defined in the on-line QA plan 'Conducting Analytical Work in Support of Regulatory Programs' (CAW). This QA plan implements the Hanford Analytical Services Quality Assurance Requirements Documents (HASQARD) for PNNL.

100 BC 5, Analytical data, Characterization↗

Advances in imaging, scattering, spectroscopy, and machine learning-aided approaches for multiscale characterization of cementitious systems

Recent progress in methods used in the multiscale characterization of cementitious systems is reviewed, focusing on advances in imaging, scattering, and spectroscopy. The review includes relevant applications and developments in machine learning and other data analytics approaches to enhance characterization. Developments in imaging using light and electron microscopy as well as x-ray (i.e., from synchrotron) methods are summarized. Updates include scanning electron microscopy (SEM), transmission electron microscopy (TEM), tomography, and holography. A critical overview of spectroscopy (e.g., MAS NMR, Raman) and scattering (e.g., neutron, x-ray, synchrotron x-ray) methods is provided, and the intersection of these with imaging is developed (e.g., Raman imaging). Additionally, the paper summarizes recent developments in and implementations of state-of-the-art machine-learning algorithms and data analytics methods for automated, systematic, and/or quantitative analyses of image data sets. The review considers but is not limited to the application of these methods for investigating the hydration and microstructure development of cement phases, low-carbon-footprint cements (e.g., limestone calcined clay cements, LC3), environmental interactions (e.g., ASR) and model systems. Finally, the present work provides a critical presentation of advances in characterization methods that link together the composition and multiscale structure of cementitious materials.

42 ENGINEERING↗

Integrating Data Sources for Improved Safeguards and Accountancy of Electrochemical Fuel Reprocessing Systems. Final Report

Electrochemical reprocessing (also commonly known as “pyroprocessing”) of used nuclear fuel is an alternative to aqueous reprocessing that confers a number of advantages, including the ability to process more recently-discharged fuel, smaller resultant waste volumes, and the lack of isolation of plutonium in the product stream. While electrochemical reprocessing systems have seen a significant research and development effort, nuclear safeguards and security of these systems remains under-developed, particularly given the significant differences in operating environment and process flowsheet compared with established aqueous methods. Objective 4 of DOE’s nuclear energy research and development activities in Nuclear Energy Research and Development Roadmap is: “Understand and minimize the risks of nuclear proliferation and terrorism.” Material Control & Accountancy (MC&A) programs at nuclear processing plants deter and detect theft and diversion of nuclear material by both outside and inside adversaries. Empirical modeling and data analytics of online measurements and state indicators can improve the timeliness of detection and reduce the uncertainty in accountancy measures. To support the development and demonstration of such methods, data are needed that capture expected measurement values collected throughout electrochemical reprocessing facilities. A review of the available literature of current research in measurements for electrochemical reprocessing systems identified twenty-two candidate measurement methodologies, which characterize fuel/salt composition, concentrations of various isotopes and elements, and operational parameters throughout the reprocessing facility. Four primary measurement methodologies have been simulated based on either physical simulations or empirical correlations: gamma emissions, neutron emissions, hybrid k-edge densitometry (HKED), and cyclic voltammetry. Initial investigation into the use of these measures for process monitoring and detection suggests the approach is viable and worthy of further investigation. This report summarizes efforts to generate signatures of key measurements during operation of electrochemical reprocessing facilities and initial investigation of data analytics to support process monitoring, diversion detection, and accountancy.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

FLEXSTAB analysis

The wing differential pressure distributions of two vehicles are predicted using FLEXSTAB. Three space shuttle configurations were investigated. Comparisons were made of wind tunnel and analytical data for a selected range of angle of attack, angle of sideslip, and Mach number. A drone-type vehicle was investigated and comparisons were made between flight and analytical data of wing pressure distributions and static longitudinal stability derivatives.

Lowder, H. E., Jr.↗

Application of New CERCLA Five-Year Review Guidance at Hanford - 16403

Under CERCLA, the implementation of remedial actions established in records of decision (ROD) are required to be reviewed every five years to evaluate their effectiveness in protecting human health and the environment. Past reviews have included evaluation of actions that were not implemented under existing RODs and, therefore, not subject to the requirement. While commendable for its transparency, discussing these out-of-scope actions created confusion and elicited comments that required time and effort to resolve. The fourth CERCLA Five Year Review (FYR) at the Hanford Site embraces the EPA guidance designed to streamline the process and focuses on the specific objectives of the review. This guidance and the training materials developed jointly by multiple federal agencies including EPA, DOE, DOD, and Department of the Interior (DOI), demonstrate a focused approach to the FYR process and offer real-world examples for streamlining this important document. This paper discusses the focused approach and process changes implemented at the Hanford Site that reduced the size and complexity of the document and provided the DOE, Richland Operations Office, with an efficient, effective template for preparing subsequent reviews. One key change was a thorough evaluation of what operable units were discussed and what operable units were not discussed in the five-year review. This process resulted in a reduction of 14 operable unit discussions. Additionally, extensive referencing of previously published CERCLA documents including closure reports and periodic groundwater monitoring reports minimized the amount of analytical data tables necessary to support the discussion. The Hanford five year review made good use of technology and provided internet links to existing documents where detailed information and voluminous analytical data reside. This eliminated the use of extensive data tables and summaries. The resulting five protectiveness determinations include: 1) 'Protective' which is used when there is sufficient data to conclude that the remedy is functioning as intended; 2) 'Protective in the short term' which is used when the data and/or documentation review raises issues that could affect future protectiveness; 3) 'Will be protective' which is used when the remedy under construction is anticipated to be protective on completion; 4) 'Protectiveness deferred' which is typically used when additional information is needed; and 5) 'Not protective' which is used when risks are not under control. Reviewing only on the appropriate operable units, and supporting the analysis of remedy performance with focused data, the resulting protectiveness determinations and overall effectiveness of the document were significantly improved. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrated Modeling and Monitoring Technologies for Environmental Resiliency in Nuclear Energy

Environmental concerns pose the biggest challenge for the development of the nuclear energy industry, often preventing or limiting the construction of new plants and radioactive waste disposal facilities. There are currently numerous sites in the world at which surface and groundwater are contaminated by nuclear weapon production and testing, as well as due to nuclear power plant accidents. Many of those sites remain unused or inhabited primarily due to public concern. Improving scientific and technical capabilities to develop environmental resiliency is critical not only to address existing contamination, but also to build public confidence and support for nuclear energy. One of the obstacles in remediation is to tackle a large volume of contaminated soil and groundwater with relatively low concentrations. Although many contaminant removal technologies have developed (e.g., pump-and-treat systems), they are often expensive and not cost-effective for low-concentration radionuclide contamination. Although soil removal is often the most effective, it produces a large amount of waste that has to be stored securely for a long period of time or treated at the special treatment facilities. Transporting a large amount of waste may also produce greenhouse gases and disrupt local communities. Recently, the concept of 'sustainable remediation' has been proposed to improve a remediation system as a whole, including the consideration of cost effectiveness, reduction of greenhouse emission, waste production and energy usage. Rather than just focusing on removing contaminants, the sustainable remediation highlights the use of passive remediation technologies to immobilize radionuclides along with the application of monitored natural attenuation and longer institutional control. However, such passive technologies and monitored natural attenuation require the increased burden of proof to ensure that those immobilized contaminants would not compromise the long-term public health. Although contaminant transport modeling and risk assessments are always performed, they sometimes fail due to the lack of understanding the contaminant transport proposes at the time of the risk assessment or due to some unexpected processes. Monitoring technologies are critical to ensure the long-term stability of such remediated sites, and also to address the public concerns. Recent advances in in situ sensor technologies and spatially-extensive mapping technologies (such as unmanned aerial vehicles, airborne mapping, geophysics) have improved monitoring of contamination over space and time. In addition to new sensing devices, data management and data analytics technologies have been expanded to manage and process large spatial and temporal datasets. Such technologies can be used to reduce monitoring cost significantly, and to facilitate long-term monitoring. In this study, we demonstrate our data analytics technologies for two nuclear-related contaminated sites: (1) air dose rate monitoring in Fukushima prefecture, and (2) groundwater monitoring at the Savannah River Site F-Area. We are developing the spatial and temporal data integration methodologies to integrate various spatially extensive data and time-series data for improving long-term monitoring. Such monitoring technologies and experiences at the existing contaminated sites can be transferred to build a better monitoring system for nuclear facilities, such as nuclear power plants or nuclear waste storages.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Custom Accessors: Enabling Scalable Data Ingestion, (Re-)Organization, and Analysis on Distributed Systems

The emerging class of high velocity and high volume data analytic workflows comprise interwoven data ingestion, organization, and processing stages, with ingestion and organization steps often contributing comparable or even higher computational costs than actual processing steps. Since complex workflows consist of a variety of phases that view and use data differently, being able to construct efficient, scalable, distributed data structures (arrays, vectors, sets, maps, and multi-maps) is essential and requires custom methods to extend and shrink containers, analyze and position data, and, maintain globallyconsistent meta-data. In this paper, we propose a novel datastructure access paradigm based on the concept of Accessors. At a high level, accessors are customizable callable objects that can modify the behavior of insert, read, update, and delete operations for distributed containers while preserving atomicity guarantees. Accessors provide a very clean and natural way to implement a variety of programming patterns, e.g., conditional insertion/deletion and cascading computations, which would be otherwise hard (or even impossible) to express in parallel and distributed settings without using locks. We demonstrate the practicality and usefulness of our approach with two representative use cases and study the performance of these applications on a distributed High-Performance Computing system. Our analysis highlights that our proposed abstraction allows for an effective overlapping and concurrent execution of different workflow steps (e.g., data ingestion and analysis), which in a conventional analytics pipeline would execute sequentially, contributing cumulatively to the overall latency.

Castellana, Vito G. [BATTELLE (PACIFIC NW LAB)] (O↗