Search NASA⌕ Search

SEARCH · Search NASA

Results for “Structured Programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Embeddings of Causal Sets

A key postulate of the causal set program is that this discrete partial order offers a sufficiently rich structure to make it a viable model of spacetime for quantum gravity. If the deep structure of spacetime is that of a causal set, then the correspondence principle (with the spacetimes of general relativity) must be obeyed. Therefore, one of the requirements of this program is to establish that the causal set structure is in fact, not just in principle, fully consistent with our macroscopic notion of spacetime as a Lorentzian manifold. An important component of any such 'manifold test' is the ability to find embeddings of causal sets into Lorentzian manifolds.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Toward Predictive Theories of Nuclear Reactions Across the Isotopic Chart: Web Report

Recent years have seen exciting new developments and progress in nuclear structure theory, reaction theory, and experimental techniques, that allow us to move towards a description of exotic systems and environments, setting the stage for new discoveries. The purpose of the 5-week program was to bring together physicists from the low-energy nuclear structure and reaction communities to identify avenues for achieving reliable and predictive descriptions of reactions involving nuclei across the isotopic chart. The 4-day embedded workshop focused on connecting theory developments to experimental advances and data needs for astrophysics and other applications. Nuclear theory must address phenomena from laboratory experiments to stellar environments, from stable nuclei to weakly-bound and exotic isotopes. Expanding the reach of theory to these regimes requires a comprehensive understanding of the reaction mechanisms involved as well as detailed knowledge of nuclear structure. A recurring theme throughout the program was the desire to produce reliable predictions rooted in either ab initio or microscopic approaches. At the same time it was recognized that some applications involving heavy nuclei away from stability, e.g. those involving fi ssion fragments, may need to rely on simple parameterizations of incomplete data for the foreseeable future. The goal here, however, is to subsequently improve and refine the descriptions, moving to phenomenological, then microscopic approaches. There was overarching consensus that future work should also focus on reliable estimates of errors in theoretical descriptions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Marshall Islands Dose Assessment and Radioecology Program: Report on the (i) 2018 Visual Study of Exterior Concrete of the Cactus Crater Containment Structure (ii) Periodic Monitoring of Groundwater on Runit Island and (iii) Initial Health Risk Assessment from Contaminants in the Cactus Crater Containment Structure

In 2012, Congress passed P.L. 112-149, Insular Areas Act of 2011, which amended the Compact of Free Association Amendments Act of 2003 by assigning Cactus Crater containment monitoring and reporting requirements to the Secretary of Energy (Secretary). Effective January 1, 2012, the Secretary was required to “periodically (but not less frequently than every 4 years) conduct -- (I) a visual study of the concrete exterior of the Cactus Crater Containment Structure on Runit Island; and (II) a radiochemical analysis of the groundwater surrounding and in the Cactus Crater Containment Structure on Runit Island.” 48 U.S.C. 1921b(f)(1)(B)(i). The Secretary was also directed to submit to Congress a report describing the results of each visual survey and the radiochemical analysis and “a determination on whether the surveys and analyses indicate any significant change in the health risks to the people of Enewetak from the contaminants within the Cactus Crater Containment Structure.” 48 U.S.C. 1921b(f)(1)(B)(ii)(II).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Effective Software Design and Development for the New Graph Architecture HPC Machines

Software applications need to change and adapt as modern architectures evolve. Nowadays advancement in chip design translates to increased parallelism. Exploiting such parallelism is a major challenge in modern software engineering. Multicore processors are about to introduce a significant change in the way we design and use fundamental data structures. In this work we describe the design and programming principles of a software library of highly concurrent scalable and nonblocking data containers. In this project we have created algorithms and data structures for handling fundamental computations in massively multithreaded contexts, and we have incorporated these into a usable library with familiar look and feel. In this work we demonstrate the first design and implementation of a wait-free hash table. Our multiprocessor data structure design allows a large number of threads to concurrently insert, remove, and retrieve information. Non-blocking designs alleviate the problems traditionally associated with the use of mutual exclusion, such as bottlenecks and thread-safety. Lock-freedom provides the ability to share data without some of the drawbacks associated with locks, however, these designs remain susceptible to starvation. Furthermore, wait-freedom provides all of the benefits of lock-free synchronization with the added assurance that every thread makes progress in a finite number of steps. This implies deadlock-freedom, livelock-freedom, starvation-freedom, freedom from priority inversion, and thread-safety. The challenges of providing the desirable progress and correctness guarantees of wait-free objects makes their design and implementation difficult. There are few wait-free data structures described in the literature. Using only standard atomic operations provided by the hardware, our design is portable; therefore, it is applicable to a variety of data-intensive applications including the domains of embedded systems and supercomputers.Our experimental evaluation shows that our hash table design outperforms the most advanced locking solution, provided by Intel's TBB library, by 22%. When compared to more traditional locking designs we show a performance improvement by a factor of 7.92. When compared to alternative non-blocking designs, our hash table demonstrates solid performance gains in a large majority of cases, typically by a factor of 3.44.

99 GENERAL AND MISCELLANEOUS↗

Interim Report on Concrete Degradation Mechanisms and Online Monitoring Techniques

The existing nuclear power plants in the United States have initial operating licenses of 40 years, though most of these plants have applied for and received license extensions. As plant structures, systems, and components age, their useful life—considering both structural integrity and performance—is reduced as a result of deterioration of the materials. The research on online monitoring of concrete structures conducted under the Advanced Instrumentation, Information, and Control Systems Technologies Pathway of the Light Water Reactor Sustainability Program at Idaho National Laboratory will develop and demonstrate concrete structures health monitoring capabilities. Assessment and management of aging concrete structures in nuclear plants require a more systematic approach than simple reliance on existing code margins of safety. Therefore, structural health monitoring is required to produce actionable information regarding structural integrity that supports operational and maintenance decisions. Through this research project, several national laboratories and Vanderbilt University propose to develop a framework of research activities for the health monitoring of nuclear power plant concrete structures that includes the integration of four elements—damage modeling, monitoring, data analytics, and uncertainty quantification. This report briefly discusses available techniques and ongoing challenges in each of the four elements of the proposed framework with emphasis on degradation mechanisms and online monitoring techniques.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Estimating Return on Investment for Energy Technical Assistance Programs

The U.S. Department of Energy's Office of State and Community Energy Programs engaged the National Laboratory of the Rockies to assess the return on investment (ROI) of technical assistance (TA) programs that support state, local, and Tribal energy planning. Although TA delivers value through capacity building, stakeholder engagement, and knowledge transfer, these benefits are often intangible and challenging to monetize. This study reviews existing ROI frameworks and synthesizes the most relevant elements into a hybrid approach tailored to energy TA programs. The proposed framework integrates monetary and non-monetary outcomes through early logic model development, baseline data collection, and the use of proxies for intangible benefits. As a case study, this paper applies this approach to the Communities Local Energy Action Program (Communities LEAP), demonstrating how ROI can inform program design, data strategy, and performance assessment. Findings underscore that ROI should be applied selectively and planned from the outset to ensure data alignment and attribution accuracy. The framework offers TA practitioners a structured approach that can be leveraged for future programs to evaluate and communicate the multifaceted value of TA investments.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

In service inspection and repair of sodium cooled ASTRID prototype

In the frame of the large R and D work which is performed for the future ASTRID sodium cooled prototype, In Service Inspection and Repair (ISI and R) has been identified as a major issue to be taken into account in order to enlarge the plant safety, to consolidate its availability and to protect the associated investment. After the first part of pre-conceptual design phase (2008-2012), the running second part of pre-conceptual phase (2013-2015) allows to increase the ISI and R tool ability for immersed sodium structures of ASTRID, at about 200 deg. C, on the basis of consolidated specifications and thanks to their qualification through more and more realistic laboratory tests and simulation with CIVA code. ISI and R items are being developed and qualified during a pluri-annual program which mainly deals with the reactor block structures, the primary components and circuit, and the Power Conversion System. It ensures a strong connection between the reactor designers and inspection specialists, as the optimization of inspectability and repairability is looked at: this already induced specific rules for design, in order to shorten and ease the ISI and R operations, which have been merged into RCC-MRx rules. In the frame of increasing technology readiness level with corresponding performance demonstration, this paper presents R and D dealing with the ISI and R items: it highlights the sensor development (both ultrasonic and electromagnetic concepts, compatible with sodium at 200 deg. C), then their applications for ASTRID structure control (under sodium telemetry, imaging and NDE). Activity for repair is also presented (a single laser tool for sodium sweeping, machining and welding), and finally the effort for associated robotic (generic program for ASTRID applications, specific technological tools for sodium medium, tight immersed bell). The main results of testing and simulation are given for telemetry, vision, NDE applications, laser process repair and under sodium sealing. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Interpretable Machine Learning Models for Practical Antimonate Electrocatalyst Performance

Computationally predicting the performance of catalysts under reaction conditions is a challenging task due to the complexity of catalytic surfaces and their evolution in situ, different reaction paths, and the presence of solid-liquid interfaces in the case of electrochemistry. We demonstrate here how relatively simple machine learning models can be found that enable prediction of experimentally observed onset potentials. Inputs to our model are comprised of data from the oxygen reduction reaction on non-precious transition-metal antimony oxide nanoparticulate catalysts with a combination of experimental conditions and computationally affordable bulk atomic and electronic structural descriptors from density functional theory simulations. From human-interpretable genetic programming models, we identify key experimental descriptors and key supplemental bulk electronic and atomic structural descriptors that govern trends in onset potentials for these oxides and deduce how these descriptors should be tuned to increase onset potentials. Here, we finally validate these machine learning predictions by experimentally confirming that scandium as a dopant in nickel antimony oxide leads to a desired onset potential increase. Macroscopic experimental factors are found to be crucially important descriptors to be considered for models of catalytic performance, highlighting the important role machine learning can play here even in the presence of small datasets.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quality Assurance Program Description

Effective May 1, 2017, led by a new executive leadership team, Sandia began operating within a new organizational structure. National Technology and Engineering Solutions of Sandia (Sandia’s) Quality Assurance Program (QAP) was established to assign responsibilities and authorities, define workflow policies and requirements, and provide for the performance and assessment of work.

99 GENERAL AND MISCELLANEOUS↗

Environmental Durability Assessment and Development of Subcomponent Test Methods for Advanced Materials in Marine Energy Applications

Marine energy developers are beginning to rely more heavily on advanced composite materials for their load-bearing structures. Understanding how these materials respond and degrade in harsh marine environments is a complex problem. Much research has been performed at smaller laboratory scales to understand the fundamental physical and chemical degradation mechanisms, but little structural testing research has been performed at larger scales to understand how these physical and chemical interactions scale and how they should be accounted for in the design process. The Advanced Materials project is a multilaboratory research collaboration that addresses these issues with the intention of reducing risks and barriers to marine energy developers wanting to adopt advanced composite materials. The National Laboratory of the Rockies has been playing a leading role in developing larger-scale testing infrastructure and test methods to validate complex numerical degradation models and standardize testing procedures to do so. This paper reviews past structural testing activities, how they have grown into current research activities, and how they will continue to evolve to directly address industry needs. This paper covers key research areas - large-scale water absorption and subsequent structural validation testing, qualification of bolted and adhesive connections, and combined submerged fatigue testing at increasing scales. It provides insights into the complex requirements for testing infrastructure and test method development to effectively qualify materials and certify marine energy structures for harsh marine environments. This research program paves the way for better guidance and standardization within the industry when adopting advanced composite materials.

16 TIDAL AND WAVE POWER↗

The Corrective Maintenance Paradigm Shift at Hanford's Tank Farms - 20077

Hanford's Tank Farms facilities have been used to safely store waste for over 70 years, with the first single-shell tanks being constructed in 1943. Tank Farm facilities consist of 149 single-shell tanks, 28 double-shell tanks, an evaporator facility, and wastewater treatment facilities. Tank Farm facilities are aging, with a tremendous corrective maintenance burden on the Tank Farm contractor. The mission of Tank Farm facilities is soon changing from waste storage to waste staging for the Hanford Waste Treatment and Immobilization Plant (WTP). WTP operations will demand a significant increase in Tank Farm facility operations, in which corrective maintenance outage windows will shrink drastically. This realization has forced the Tank Farm contractor to consider a paradigm shift in Tank Farm facilities Maintenance planning, and the use of reliability Engineering tools. The Tank Farm Production Operations Engineering Cognizant System Engineering (CSE) organization has led the way in motivating this paradigm shift. This shift has been realized through the use of: 1) technical exchange with other Department of Energy (DOE) contractors to develop improvements in the CSE program, 2) a shift from the use of lagging to leading system health indicators, and 3) a Plant Health Committee to unite Engineering, Operations, and Maintenance personnel toward a productive maintenance strategy. The CSE organization has held several technical exchanges with other DOE contractors to discuss CSE concepts, and how to better maintain aging infrastructure. The technical exchange with other contractors has greatly reduced the time required to make improvements in the Tank Farm CSE program. Other DOE contractors have already faced issues surrounding aging infrastructure, and have vast experience in improving the reliability and usable life of structures and components in nuclear facilities. The past CSE program used lagging health indicators to determine the health of systems. The key lagging indicator used to determine system health was availability, which is the percentage of time that a facility was ready for operation compared to the time the facility was demanded for operation. Availability was a good indicator of health in the waste storage mission of Tank Farms, where safe storage was the most important function of the facility, and where maintenance outage windows were typically long-duration. In current and future operations, outage windows are reducing, resulting in the need for much more reliable systems. Systems that have had high availability may suddenly become inoperable due to a failed component or sub-system. In several instances, the use of availability as an indicator of system health failed to predict system/equipment failure before its occurrence. In discussions with other DOE contractors, a set of reliability tools, including leading indicators of health, has been implemented in the CSE program. This primarily involves the use of failure modes and effects analysis and the study of equipment failure to develop system monitoring plans that focus on trending data to detect oncoming equipment failure ahead of time. In addition, the use of a Plant Health Committee has added significantly to the paradigm shift from a corrective maintenance philosophy to the use of predictive and preventive maintenance. The Plant Health Committee is a chartered team consisting of Engineering, Operations, and Maintenance personnel. CSEs use this forum to present the results of their performance monitoring, including the presentation of health via leading health indicators. The most positive aspect of this committee is the communication that it creates within these critical organizations. The Operations and Maintenance organization benefit from focusing maintenance on the reliability-centered focus provided by Engineering. Engineering benefits from the operational experience of the Operations organization and from the failure data that can be provided by Maintenance personnel. The continued use of the Plant Health Committee is expected to further decrease maintenance outage times, in better support of oncoming 24/7 operations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Initial Fracture Propagation Modeling of Graphite Components with Grizzly

Graphite has historically been extensively used in power reactor cores and will be used in multiple types of advanced reactors currently under development. These graphite structural components can experience significant stresses due to nonuniform volumetric strains induced by irradiation and thermal expansion, which can lead to fracture. Robust tools for predicting fracture initiation and propagation in graphite structural components in nuclear reactors are important for evaluating component integrity, developing design standards, and interpreting experimental results to characterize graphite performance. The U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation program has been developing degradation models for other structural components in nuclear reactors within the Grizzly and BlackBear codes. This report documents an effort to develop initial capabilities for modeling graphite fracture within these codes, building on prior efforts to model fracture in other materials. Major elements of this effort include developing a new system for modeling fracture nucleation and growth in two dimensions using the extended finite element method and incorporating a damage and plasticity model. These capabilities are applied here to model a representative graphite component and a splitting disc experiment used to obtain tensile strength.

36 MATERIALS SCIENCE↗

Subaru Hyper Suprime-Cam excavates colossal over- and underdense structures over 360 deg 2 out to z = 1

Subaru Strategic Program with the Hyper-Suprime Cam (HSC-SSP) has proven to be successful with its extremely wide area coverage in past years. Taking advantages of this feature, we report initial results from exploration and research of expansive over- and underdense structures at z = 0.3–1 based on the second Public Data Release where optical 5-band photometric data for ~ eight million sources with i < 23 mag are available over ~360 deg 2 . We not only confirm known superclusters but also find candidates of titanic over- and underdense regions out to z = 1. The mock data analysis suggests that the density peaks would involve one or more massive dark matter haloes (>1014 M ⊙ ) of the redshift, and the density troughs tend to be empty of massive haloes over >10 comoving Mpc. Besides, the density peaks and troughs at z ≲ 0.6 are in part identified as positive and negative weak lensing signals respectively, in mean tangential shear profiles, showing a good agreement with those inferred from the full-sky weak lensing simulation. The coming extensive spectroscopic surveys will be able to resolve these colossal structures in 3D space. Finally, the number density information over the entire survey field is available as grid-point data on the website of the HSC-SSP data release (https://hsc.mtk.nao.ac.jp/ssp/data-release/).

79 ASTRONOMY AND ASTROPHYSICS↗

nu-TRLan User Guide Version 1.0: A High-Performance Software Package for Large-Scale Harmitian Eigenvalue Problems

The original software package TRLan, [TRLan User Guide], page 24, implements the thick restart Lanczos method, [Wu and Simon 2001], page 24, for computing eigenvalues {lambda} and their corresponding eigenvectors v of a symmetric matrix A: Av = {lambda}v. Its effectiveness in computing the exterior eigenvalues of a large matrix has been demonstrated, [LBNL-42982], page 24. However, its performance strongly depends on the user-specified dimension of a projection subspace. If the dimension is too small, TRLan suffers from slow convergence. If it is too large, the computational and memory costs become expensive. Therefore, to balance the solution convergence and costs, users must select an appropriate subspace dimension for each eigenvalue problem at hand. To free users from this difficult task, nu-TRLan, [LNBL-1059E], page 23, adjusts the subspace dimension at every restart such that optimal performance in solving the eigenvalue problem is automatically obtained. This document provides a user guide to the nu-TRLan software package. The original TRLan software package was implemented in Fortran 90 to solve symmetric eigenvalue problems using static projection subspace dimensions. nu-TRLan was developed in C and extended to solve Hermitian eigenvalue problems. It can be invoked using either a static or an adaptive subspace dimension. In order to simplify its use for TRLan users, nu-TRLan has interfaces and features similar to those of TRLan: (1) Solver parameters are stored in a single data structure called trl-info, Chapter 4 [trl-info structure], page 7. (2) Most of the numerical computations are performed by BLAS, [BLAS], page 23, and LAPACK, [LAPACK], page 23, subroutines, which allow nu-TRLan to achieve optimized performance across a wide range of platforms. (3) To solve eigenvalue problems on distributed memory systems, the message passing interface (MPI), [MPI forum], page 23, is used. The rest of this document is organized as follows. In Chapter 2 [Installation], page 2, we provide an installation guide of the nu-TRLan software package. In Chapter 3 [Example], page 3, we present a simple nu-TRLan example program. In Chapter 4 [trl-info structure], page 7, and Chapter 5 [trlan subroutine], page 14, we describe the solver parameters and interfaces in detail. In Chapter 6 [Solver parameters], page 21, we discuss the selection of the user-specified parameters. In Chapter 7 [Contact information], page 22, we give the acknowledgements and contact information of the authors. In Chapter 8 [References], page 23, we list reference to related works.

97 MATHEMATICS AND COMPUTING↗

Benders Decomposition Using Graph Modeling and Multi-Parametric Programming

Benders decomposition is a widely used method for solving large and structured optimization problems, but its performance is affected by the repeated solution of subproblems. We propose a flexible and modular algorithmic framework for accelerating Benders decomposition. Specifically, we express the problem structure by using a graph-theoretic modeling abstraction in which nodes represent optimization subproblems and edges represent connectivity between subproblems. A key innovation of our approach is that we embed multiparametric programming (mp) surrogates for node subproblems, which maps the exact analytical map of the subproblem solution space. The use of mp surrogates allows us to replace subproblem solves with fast look-ups and function evaluations for primal and dual variables during the iterative Benders process. We formally show the equivalence between classical Benders cuts and those derived from the mp solution. We implement our framework in the open-source PlasmoBenders.jl software package. To demonstrate the capabilities of the proposed framework, we apply it to a two-stage stochastic programming problem, which aims to make optimal capacity expansion decisions under market uncertainty. We evaluate both single-cut and multicut variants of Benders decomposition and show that the use of mp surrogates achieves substantial speedups in subproblem solve time, while preserving the convergence guarantees of Benders decomposition. We highlight advantages in solution analysis and interpretability that is enabled by mp critical region tracking; specifically, we show that these reveal how decisions evolve geometrically across the Benders search. Our results aim to demonstrate that combining surrogate modeling with graph modeling offers a promising and extensible foundation for structure-exploiting decomposition. In addition, by decomposing the problem into more tractable subproblems, the proposed approach also aims to overcome scalability issues of mp. Finally, the use of mp surrogates provides a unifying and modular optimization framework that enables the representation of heterogeneous node subproblems as modeling objects with a homogeneous structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Unconventional isoquinoline-based SERMs elicit fulvestrant-like transcriptional programs in ER+ breast cancer cells

Estrogen receptor alpha (ERα) is a ligand-dependent master transcriptional regulator and key driver of breast cancer pathology. Small molecule hormones and competitive antagonists favor unique ERα conformational ensembles that elicit ligand-specific transcriptional programs in breast cancer and other hormone-responsive tissues. By affecting disparate ligand binding domain structural features, unconventional ligand scaffolds can redirect ERα genomic binding patterns to engage novel therapeutic transcriptional programs. To improve our understanding of these ERα structure-transcriptional relationships, we develop a series of chemically unconventional antagonists based on the antiestrogens elacestrant and lasofoxifene. High-resolution x-ray co-crystal structures show that these molecules affect both classical and unique structural motifs within the ERα ligand binding pocket. They show moderately reduced antagonistic potencies on ERα genomic activities but are effective anti-proliferative agents in luminal breast cancer cells. Interestingly, they favor a 4-hydroxytamoxifen-like accumulation of ERα in breast cancer cells but lack uterotrophic activities in an endometrial cell line. Importantly, RNA sequencing shows that the lead molecules engage transcriptional pathways similar to the selective estrogen receptor degrader fulvestrant. This advance shows that fulvestrant-like genomic activities can be achieved without affecting ERα accumulation in breast cancer cells.

60 APPLIED LIFE SCIENCES↗

Chilled Water Thermal Storage System and Demand Response at the University of California at Merced

The University of California at Merced is a unique campus that has benefited from intensive efforts to maximize energy efficiency, and has participated in a demand response program for the past two years. Campus demand response evaluations are often difficult because of the complexities introduced by central heating and cooling, non-coincident and diverse building loads, and existence of a single electrical meter for the entire campus. At the University of California at Merced, a two million gallon chilled water storage system is charged daily during off-peak price periods and used to flatten the load profile during peak demand periods. This makes demand response more subtle and challenges typical evaluation protocols. The goal of this research is to study demand response savings in the presence of storage systems in a campus setting. First, University of California at Merced summer electric loads are characterized; second, its participation in two demand response events is detailed. In each event a set of strategies were pre-programmed into the campus control system to enable semi-automated response. Finally, demand savings results are applied to the utility's DR incentives structure to calculate the financial savings under various DR programs and tariffs. A key conclusion to this research is that there is significant demand reduction using a zone temperature set point change event with the full off peak storage cooling in use.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗