Cost-optimal wave-powered persistent oceanographic observation
Not Available
Dillon, Trent (ORCID:0000000201036449)↗
SEARCH · Search NASA
Results for “Persistence”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
3D Simulations Capture the Persistent Low-Mode Asymmetries Evident in Laser-Direct-Drive Implosions on OMEGA
Spherical implosions in Inertial Confinement Fusion (ICF) are inherently sensitive to perturbations that may arise from experimental constraints and errors. Control and mitigation of low-mode (long wavelengths) perturbations is a key milestone to improving implosion performances. Here, we present the first 3-D radiation-hydrodynamic simulations of directly driven ICF implosions with an inline package for polarized Crossed-Beam Energy Transfer (CBET). Simulations match bang times, yields (separately accounting for laser-induced high modes and fuel age), hot spot flow velocities and direction, for which polarized CBET contributes to the systematic flow orientation evident in the OMEGA implosion database. Current levels of beam mispointing, imbalance, target offset and asymmetry from polarized CBET degrade yields by more than 40%. The effectiveness of two mitigation strategies for low-modes is explored.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Controls and relationships of soil organic carbon abundance and persistence vary across pedo–climatic regions
One of the largest uncertainties in the terrestrial carbon cycle is the timing and magnitude of soil organic carbon (SOC) response to climate and vegetation change. This uncertainty prevents models from adequately capturing SOC dynamics and challenges the assessment of management and climate change effects on soils. Reducing these uncertainties requires simultaneous investigation of factors controlling the amount (SOC abundance) and duration (SOC persistence) of stored C. We present a global synthesis of SOC and radiocarbon profiles (n Profile = 597) to assess the timescales of SOC storage. We use a combination of statistical and depth–resolved compartment models to explore key factors controlling the relationships between SOC abundance and persistence across pedo–climatic regions and with soil depth. This allows us to better understand (i) how SOC abundance and persistence covary across pedo–climatic regions and (ii) how the depth dependence of SOC dynamics relates to climatic and mineralogical controls on SOC abundance and persistence. We show that SOC abundance and persistence are differently related; the controls on these relationships differ substantially between major pedo–climatic regions and soil depth. For example, large amounts of persistent SOC can reflect climatic constraints on soils (e.g., in tundra/polar regions) or mineral absorption, reflected in slower decomposition and vertical transport rates. In contrast, lower SOC abundance can be found with lower SOC persistence (e.g., in highly weathered tropical soils) or higher SOC persistence (e.g., in drier and less productive regions). We relate variable patterns of SOC abundance and persistence to differences in the processes constraining plant C input, microbial decomposition, vertical C transport and mineral SOC stabilization potential. This process–oriented grouping of SOC abundance and persistence provides a valuable benchmark for global C models, highlighting that pedo–climatic boundary conditions are crucial for predicting the effects of climate change and soil management on future C abundance and persistence.
54 ENVIRONMENTAL SCIENCES↗
Complex genetics cause and constrain fungal persistence in different parts of the mammalian body
Determining how genetic polymorphisms enable certain fungi to persist in mammalian hosts can improve understanding of opportunistic fungal pathogenesis, a source of substantial human morbidity and mortality. We examined the genetic basis of fungal persistence in mice using a cross between a clinical isolate and the lab reference strain of the budding yeast Saccharomyces cerevisiae. Employing chromosomally encoded DNA barcodes, we tracked the relative abundances of 822 genotyped, haploid segregants in multiple organs over time and performed linkage mapping of their persistence in hosts. Detected loci showed a mix of general and antagonistically pleiotropic effects across organs. General loci showed similar effects across all organs, while antagonistically pleiotropic loci showed contrasting effects in the brain vs the kidneys, liver, and spleen. Persistence in an organ required both generally beneficial alleles and organ-appropriate pleiotropic alleles. This genetic architecture resulted in many segregants persisting in the brain or in nonbrain organs, but few segregants persisting in all organs. These results show complex combinations of genetic polymorphisms collectively cause and constrain fungal persistence in different parts of the mammalian body.
59 BASIC BIOLOGICAL SCIENCES↗
Photophysics and Spin-Physics Studies on Persistent Upconversion Luminescence from Nonlinearly Polarizable Ferroelectric-Like Lattice Prepared by Orderly Packing Donor–Acceptor Structures under Multiphoton Excitation
The ultralong-lived upconversion luminescence with the lifetime of 0.48 s in a broad spectral range (530–650 nm) is observed in CD49 (9-(3-(5-bromopyridin-3-yl)prop-2-yn-1-yl)-9H-carbazole) crystal designed with donor–acceptor (carbazole–pyridine) structures under infrared excitation, simultaneously accompanied with second harmonic generation (SHG). This phenomenon indicates orderly packing donor–acceptor structures form a nonlinearly polarizable ferroelectric-like lattice with ultralong-lived light-emitting states, leading to much prolonged nonlinear optical behaviors. The persistent upconversion luminescence together with SHG is largely reduced when lowering crystallinity. This implies that nonlinearly polarizable ferroelectric-like lattice provides the necessary condition to generate persistent upconversion luminescence. Evidently, persistent upconversion luminescence becomes completely lacking when only using ultralong-lived light-emitting states without nonlinearly polarizable ferroelectric-like lattice, exampled by 4-(dimethylamino)benzonitrile dispersed in polyvinyl alcohol matrix. Magneto-photoluminescence shows that persistent upconversion luminescence is essentially a super-delayed fluorescence from crystalline intermolecular charge-transfer excitons formed in the nonlinearly polarizable ferroelectric-like lattice. Magnetodielectrics indicate crystalline intermolecular charge-transfer excitons are coupled with nonlinearly polarizable ferroelectric-like lattice, leading to prolonged nonlinear optical behaviors shown as persistent upconversion luminescence through super delayed fluorescence. In conclusion, therefore, crystalline intermolecular charge-transfer excitons formed in nonlinearly polarizable ferroelectric-like lattice provide an interesting platform to generate prolonged nonlinear optical behaviors toward developing persistent upconversion luminescence under multiphoton excitation.
36 MATERIALS SCIENCE↗
Climatic controls on soil and saprock nitrogen distribution and persistence in the Sierra Nevada
Nitrogen (N) is an essential nutrient in soil that regulates plant growth, terrestrial sequestration of atmospheric carbon dioxide, and persistence of organic compounds. However, major knowledge gaps remain about how climate change may impact N accumulation and persistence, especially in deep soil and saprock (friable weakly weathered bedrock). Our objective was to understand how climate impacts the accumulation of N in soil and saprock and how climate impacts soil N distribution, persistence, and mechanisms of N persistence. We investigated N concentration in bulk soil and density fractions. We estimated N persistence along a bio-climatic sequence—sites range from a low-elevation oak savannah, mid-elevation pine-oak/mixed-conifer forest, to a high-elevation subalpine forest—in the southern Sierra Nevada in California. A combination of radiocarbon and elemental composition measurements along with a first-order kinetic model was used. The N concentration in the bulk soil and density fractions declined with depth, and there was a relatively greater mineral-associated heavy fraction (HF) N in deeper samples. The cooler/wetter mixed conifer site held 37% of profile N in saprock, which was greater than that of the entire soil profile at the drier/hotter oak savannah. The majority of N in soil, which was in the HF, was not influenced by climate proxies tested. However, both unprotected and occluded fractions of N were strongly influenced by climate. Soil N mean residence time (MRT) showed that drier/hotter climates have a shorter MRT, compared to mid-elevation sites with cooler/wetter climates. The effect of climate on deep saprock N storage might be indirect, primarily through climatic influence on the thickness of saprock. Overall, our findings suggest the mineral-associated HF N pool will not be vulnerable to changes in climate and will continue to contribute to the persistent soil N pool. The amount of topsoil and subsoil unprotected and occluded N can be explained by gross primary productivity and mean annual precipitation indicating that changes in climate can influence N partitioning. N stored in deep soil and saprock may be less vulnerable to climate than N stored in drier/hotter climates with less deeply stored N. It is critical to dig deeper to understand terrestrial ecosystems’ response to climate.
58 GEOSCIENCES↗
Persistence and potential of soil organic carbon in nature‐based climate solutions: A review of managed disturbances
Societal Impact Statement Implementing nature-based climate solutions is important for mitigating climate change, which is a global issue, but requires local adjustments in management practices. Using the association between soil carbon and minerals as a proxy for carbon persistence, we evaluated the effect of different management regimes on soil carbon sequestration and loss. We identified areas where management practices that increase carbon inputs should be prioritized and areas where management should focus on avoiding severe disturbances. Using this storage-potential-and-persistence framework to identify how to increase or maintain soil organic carbon storage locally will increase the effectiveness of nature-based climate solutions globally. Summary Increasing soil organic carbon storage could reduce the pace of climate change, but the longevity of this nature-based climate solution depends on the persistence of carbon in soils, not just the input rates into soils. We apply a framework for considering how soil carbon persistence—namely, via the association with minerals—sheds light on soil carbon sequestration. We review how management of disturbances, such as prescribed burning, forestry, and grazing, can change soil carbon storage, persistence, and potential. Past work demonstrated that management of disturbances can sequester soil carbon, but it remains unclear how the potential stabilization of that accrual and vulnerability to loss varies across disturbance types and geographies. We found that there is substantial geographical heterogeneity in the overlap among estimates of carbon accrual, disturbance occurrence, and potential stabilization: Fire-prone grasslands and intensively grazed rangelands occur in areas estimated to have high potential to store mineral-associated organic carbon, and studies also find that adjusted fire and grazing can promote mineral-associated organic carbon. Plantation forestry and burned area span large regions where particulate organic matter is the dominant form, and studies find that particulate organic carbon is disproportionately lost following intense wildfires and forest harvests. Thus, areas with high mineral-associated organic carbon deficits should be prioritized for practices that increase carbon inputs; whereas areas with high proportions of particulate organic carbon should be prioritized for practices that help to avoid severe disturbances. Taken together, the distribution of and changes in persistence mechanisms shed light on the durability of nature-based climate solutions.
fire↗
Microscale spatial distribution and soil organic matter persistence in top and subsoil
The spatial distribution of organic substrates and microscale soil heterogeneity significantly influence organic matter (OM) persistence as constraints on OM accessibility to microorganisms. However, it is unclear how changes in OM spatial heterogeneity driven by factors such as soil depth affect the relative importance of substrate spatial distribution on OM persistence. This work evaluated the decomposition and persistence of 13 C and 15 N labeled water-extractable OM inputs over 50 days as either hotspot (i.e., pelleted in 1–2 mm-size pieces) or distributed (i.e., added as OM < 0.07 μm suspended in water) forms in topsoil (0–0.2 m) and subsoil (0.8–0.9 m) samples of an Andisol. We observed greater persistence of added C in the subsoil with distributed OM inputs relative to hotspot OM, indicated by a 17% reduction in cumulative mineralization of the added C and a 10% higher conversion to mineral-associated OM. A lower substrate availability potentially reduced mineralization due to OM dispersion throughout the soil. NanoSIMS (nanoscale secondary ion mass spectrometry) analysis identified organo-mineral associations on cross-sectioned aggregate interiors in the subsoil. On the other hand, in the topsoil, we did not observe significant differences in the persistence of OM, suggesting that the large amounts of particulate OM already present in the soil outweighed the influence of added OM spatial distribution. Here, we demonstrated under laboratory conditions that the spatial distribution of fresh OM input alone significantly affected the decomposition and persistence of OM inputs in the subsoil. On the other hand, spatial distribution seems to play a lower role in topsoils rich in particulate OM. The divergence in the influence of OM spatial distribution between the top and subsoil is likely driven by differences in soil mineralogy and OM composition.
59 BASIC BIOLOGICAL SCIENCES↗
Microbial colonization and persistence in deep fractured shales is guided by metabolic exchanges and viral predation
Background: Microbial colonization of subsurface shales following hydraulic fracturing offers the opportunity to study coupled biotic and abiotic factors that impact microbial persistence in engineered deep subsurface ecosystems. Shale formations underly much of the continental USA and display geographically distinct gradients in temperature and salinity. Complementing studies performed in eastern USA shales that contain brine-like fluids, here we coupled metagenomic and metabolomic approaches to develop the first genome-level insights into ecosystem colonization and microbial community interactions in a lower-salinity, but high-temperature western USA shale formation. Results: We collected materials used during the hydraulic fracturing process (i.e., chemicals, drill muds) paired with temporal sampling of water produced from three different hydraulically fractured wells in the STACK (Sooner Trend Anadarko Basin, Canadian and Kingfisher) shale play in OK, USA. Relative to other shale formations, our metagenomic and metabolomic analyses revealed an expanded taxonomic and metabolic diversity of microorganisms that colonize and persist in fractured shales. Importantly, temporal sampling across all three hydraulic fracturing wells traced the degradation of complex polymers from the hydraulic fracturing process to the production and consumption of organic acids that support sulfate- and thiosulfate-reducing bacteria. Furthermore, we identified 5587 viral genomes and linked many of these to the dominant, colonizing microorganisms, demonstrating the key role that viral predation plays in community dynamics within this closed, engineered system. Lastly, top-side audit sampling of different source materials enabled genome-resolved source tracking, revealing the likely sources of many key colonizing and persisting taxa in these ecosystems. Conclusions: These findings highlight the importance of resource utilization and resistance to viral predation as key traits that enable specific microbial taxa to persist across fractured shale ecosystems. We also demonstrate the importance of materials used in the hydraulic fracturing process as both a source of persisting shale microorganisms and organic substrates that likely aid in sustaining the microbial community. Moreover, we showed that different physicochemical conditions (i.e., salinity, temperature) can influence the composition and functional potential of persisting microbial communities in shale ecosystems. Together, these results expand our knowledge of microbial life in deep subsurface shales and have important ramifications for management and treatment of microbial biomass in hydraulically fractured wells.
59 BASIC BIOLOGICAL SCIENCES↗
Malicious Cyber Activity Detection using Zigzag Persistence
In this study we synthesize zigzag persistence from topological data analysis with autoencoder-based approaches to detect malicious cyber activity, and derive analytic insights. Cybersecurity aims to safeguard computers, networks, and servers from various forms of malicious attacks, including network damage, data theft, and activity monitoring. We focus on the cybersecurity domain and investigate the detection of malicious activity using log data. We consider the dynamics of the log data and explore the changing topology of a hypergraph representation of this data to gain insights into the underlying activity. These hypergraphs capture complex interactions between processes, together with their temporal information. To study the changing topology we use zigzag persistence, which captures how topological features persist at multiple dimensions over time. We observe that this detects malicious activity in a cyber data set. To automate this detection we implement an autoencoder trained on a vectorization of the resulting zigzag persistence barcodes. Our experimental results demonstrate the effectiveness of the autoencoder in detecting malicious activity. Overall, this study highlights the potential of zigzag persistence and its combination with temporal hypergraphs for analyzing cybersecurity log data and detecting malicious behavior.
hypergraphs, temporal hypergraph, topological data↗
Biomolecular budget of persistent, microbial-derived soil organic carbon: The importance of underexplored pools
The details of how soil microorganisms contribute to stable soil organic carbon pools are a pressing knowledge gap with direct implications for soil health and climate mitigation. It is now recognized that microbial necromass contributes substantially to the formation of stable soil carbon. However, the quantification of necromass in soils has largely been limited to model molecules such as aminosugar biomarkers. The abundance and chemical composition of other persistent microbial residues remain unresolved, particularly concerning how these pools may vary with microbial community structure, soil texture, and management practices. We use yearlong soil incubation experiments with an isotopic tracer to quantify the composition of persistent residues derived from microbial communities inhabiting sand or silt dominated soil with annual (corn) or perennial (switchgrass) monocultures. Persistent microbial residues were recovered in diverse soil biomolecular pools including metabolites, proteins, lipids, and mineral-associated organic matter (MAOM). The relative abundances of microbial contributions to necromass pools were consistent across cropping systems and soil textures. The greatest residue accumulation was not recovered in MAOM but in the light density fraction of soil debris that persisted after extraction by chemical fractionation using organic solvents. Necromass abundance was positively correlated with microbial biomass abundance and revealed a possible role of cell wall morphology in enhancing microbial carbon persistence; while gram-negative bacteria accounted for the greatest contribution to microbial-derived carbon by mass at one year, residues from gram-positive Actinobacteria and Firmicutes showed greater durability. Together these results offer a quantitative assessment of the relative importance of diverse molecular classes for generating durable soil carbon.
54 ENVIRONMENTAL SCIENCES↗
Infant gut strain persistence is associated with maternal origin, phylogeny, and traits including surface adhesion and iron acquisition
Gut microbiome succession affects infant development. However, it remains unclear what factors promote persistence of initial bacterial colonizers in the developing gut. Here, we perform strain-resolved analyses to compare gut colonization of preterm and full-term infants throughout the first year of life and evaluate associations between strain persistence and strain origin as well as genetic potential. Analysis of fecal metagenomes collected from 13 full-term and 9 preterm infants reveals that infants' initially distinct microbiomes converge by age 1 year. Approximately 11% of early colonizers, primarily Bacteroides and Bifidobacterium, persist during the first year of life, and those are more prevalent in full-term, compared with preterm infants. Examination of 17 mother-infant pairs reveals maternal gut strains are significantly more likely to persist in the infant gut than other strains. Enrichment in genes for surface adhesion, iron acquisition, and carbohydrate degradation may explain persistence of some strains through the first year of life.
59 BASIC BIOLOGICAL SCIENCES↗
Targeting Mycobacterium tuberculosis Persistence through Inhibition of the Trehalose Catalytic Shift
Tuberculosis (TB), caused by Mycobacterium tuberculosis (Mtb), is the leading cause of death worldwide by infectious disease. Treatment of Mtb infection requires a six-month course of multiple antibiotics, an extremely challenging regimen necessitated by Mtb’s ability to form drug-tolerant persister cells. Mtb persister formation is dependent on the trehalose catalytic shift, a stress-responsive metabolic remodeling mechanism in which the disaccharide trehalose is liberated from cell surface glycolipids and repurposed as an internal carbon source to meet energy and redox demands. Here, using a biofilm-persister model, metabolomics, and cryo-electron microscopy (EM), we found that azidodeoxy- and aminodeoxy-d-trehalose analogues block the Mtb trehalose catalytic shift through inhibition of trehalose synthase TreS (Rv0126), which catalyzes the isomerization of trehalose to maltose. Out of a focused eight-member compound panel constructed by chemoenzymatic synthesis, the natural product 2-trehalosamine exhibited the highest potency and significantly potentiated first- and second-line TB drugs in broth culture and macrophage infection assays. We also report the first structure of TreS bound to a substrate analogue inhibitor, obtained via cryo-EM, which revealed conformational changes likely essential for catalysis and inhibitor binding that can potentially be exploited for future therapeutic development. Our results demonstrate that inhibition of the trehalose catalytic shift is a viable strategy to target Mtb persisters and advance trehalose analogues as tools and potential adjunctive therapeutics for investigating and targeting mycobacterial persistence.
60 APPLIED LIFE SCIENCES↗
Drought Reduces Formation, but Enhances Persistence, of Mineral‐Associated Organic Matter in a Grassland Soil
Drought effects are pervasive in terrestrial ecosystems, yet there is limited understanding of how drought impacts the transformation of plant carbon (C) inputs to mineral-associated organic matter (MAOM)—the largest and slowest-cycling pool of soil organic carbon (SOC). In a 12-week 13 C-CO 2 greenhouse labeling experiment, we tracked the formation of MAOM derived from the two dominant sources of plant C input to the mineral soil—living root inputs ( 13 C-rhizodeposits) and decaying root inputs ( 13 C-root detritus)—under normal moisture and droughted conditions in a semiarid grassland soil. At the end of the 12-week period, we also measured the persistence of 13 C-MAOM formed from rhizodeposits versus root detritus via a subsequent persistence assay. Drought reduced the formation of MAOM derived from living roots by decreasing rhizodeposits, reducing microbial growth rates, and altering the composition of organic matter, lipids, and metabolites. Drought initially delayed the formation of MAOM derived from root detritus by slowing the early stages of root litter decomposition (week 4–8), but did not decrease total MAOM formation by the end of the 12-week period. Notably, drought enhanced the persistence of MAOM derived from root detritus, but did not influence the persistence of MAOM derived from rhizodeposits. Our results provide some of the first direct evidence that drought can reduce the formation of MAOM in a grassland soil, but may enhance its persistence, based on the source of plant input from which MAOM is derived.
13C- labeling↗
Stabilization and control of persistent current magnets using variable inductance
Ultra-stable, tunable magnetic fields are desirable for a wide range of applications in medical imaging, electron microscopy, quantum science, and atomic physics. Superconducting magnets operated in persistent current mode, with device current flowing in a closed superconducting loop disconnected from a power source, are a common approach for applications with the most stringent requirements on temporal field stability. In this work, we present a method for active control of this persistent current by means of dynamic inductance change within the superconducting circuit. For a first realization of this general technique, we consider a variable superconducting inductor placed in series with the main magnet. The inductor acts as a dynamic flux storage device capable of transferring flux to or from the main magnet through inductance change. This allows for fine and fast adjustments of the persistent current without the use of thermal switches that limit the speed and accuracy of many present-day methods. With first experiments employing this technique, we demonstrate stabilization of a 1.95 T Nb–Ti round lens for electron microscopy against decay resulting from residual losses in the superconducting circuit, and more generally show flexibility for precise control over the magnitude and waveform of the persistent current.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Targeting the Bet-Hedging Strategy with an Inhibitor of Bacterial Efflux Capacity Enhances Antibiotic Efficiency and Ameliorates Bacterial Persistence In Vitro
Persistence is a bet-hedging strategy in bacterial populations that increases antibiotic tolerance and leads to the establishment of latent infections. In this study, we demonstrated that a synthetic non-toxic taxane-based reversal agent (tRA), developed as an inhibitor of ABC transporter systems in mammalian cancer cells, enhanced antibiotic killing of persister populations from different pathogens, including Burkholderia, Pseudomonas, Francisella, and Yersinia. Acting as an inhibitor of bacterial efflux at 100 nM, tRA99020 enhanced antibiotic efficiency and suppressed the production of natural products of Burkholderia species polyketide synthase (PKS) function. We demonstrate that the metabolites produced by PKS in response to stress by different antibiotics act as inhibitors of mammalian histone deacetylase activity and stimulate cell death. Applying a single-molecule fluorescence in situ hybridization (smFISH) assay, we analyzed on a single-cell level the activation profiles of the persistence regulating pks gene in Burkholderia thailandensis treated with tRA99020 and antibiotics. We posit that a multi-pronged approach encompassing antibiotic therapies and inhibition of efflux systems and fatty acid catabolism will be required for efficient eradication of persistent bacterial populations.
59 BASIC BIOLOGICAL SCIENCES↗
Shape-persistent ladder molecules exhibit nanogap-independent conductance in single-molecule junctions
Molecular electronic devices require precise control over the flow of current in single molecules. However, the electron transport properties of single molecules critically depend on dynamic molecular conformations in nanoscale junctions. Here, in this work, we report a unique strategy for controlling molecular conductance using shape-persistent molecules. Chemically diverse, charged ladder molecules, synthesized via a one-pot multicomponent ladderization strategy, show a molecular conductance (d[log( G/G 0 )]/d x ≈ -0.1 nm -1 ) that is nearly independent of junction displacement, in stark contrast to the nanogap-dependent conductance (d[log( G/G 0 )]/d x ≈ -7 nm -1 ) observed for non-ladder analogues. Ladder molecules show an unusually narrow distribution of molecular conductance during dynamic junction displacement, which is attributed to the shape-persistent backbone and restricted rotation of terminal anchor groups. These principles are further extended to a butterfly-like molecule, thereby demonstrating the strategy's generality for achieving gap-independent conductance. Overall, our work provides important avenues for controlling molecular conductance using shape-persistent molecules. Achieving robust and controllable conductance in single-molecule junctions is challenging due to the dynamic nature of molecular conformations that fluctuate over operational timescales. A strategy using shape-persistent molecules has now been developed that demonstrates nearly junction-displacement-independent conductance, providing a stable solution for single-molecule electronic properties.
molecular electronics↗
Optimizing Management of Persistent Data Structures in High-Performance Analytics
Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.
Computer science↗