Search NASA⌕ Search

SEARCH · Search NASA

Results for “data tiering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Case for Deploying Complex Systems Utilizing Commodity Components

When the International Space Station (ISS) finally reached an operational state, many of the Payload Operations and Integration Facility (POIF) hardware components were reaching end of life, COTS product costs were soaring, and the ISS budget was becoming severely constrained. However, most requirement development was complete. In addition, the ISS program is a fully functioning program with at least fifteen years of operational life remaining. Therefore it is critical that any upgrades, refurbishments, or enhancements be accomplished in realtime with minimal disruptions to service. For these and other reasons, it was necessary to ensure the viability of the POIF. Due to the to the breadth of capability of the POIF (a NASA ground station), it is believed that the lessons to be learned by other complex systems are applicable and any solutions garnered by the POIF are applicable to other complex systems as well. With that in mind, a number of new approaches have been investigated to increase the portability of the POIF and reduce the cost of refurbishment, operations, and maintenance. These new approaches were directed at the Total Cost of Ownership (TCO); not only the refurbishment but also current operational difficulties, licensing, and anticipation of the next refurbishment. Our basic premise is that technology had evolved dramatically since the concept of the POIF ground system and we should leverage our experience on this new technological landscape. Fortunately, Moore's law and market forces have changed the landscape considerably. These changes are manifest in five (5) ways that are particularly relevant to POIF: 1. Complex Instruction Set Computing (CISC) processors have advanced to unprecedented levels of compute capacity with a dramatic cost break, 2. Linux has become a major operating system supported by most vendors on a broad range of platforms, 3. Windows(TradeMark) based desktops are pervasive in the office environment, 4. Stable and affordable WindowsTM development environments and tools are available and offer a rich set of capabilities, 5. The WindowsTM 2000 provides a stable client platform, Therefore, five studies were proposed, developed, and are in the current process of deployment which dramatically reduces the cost of operations, maintenance, refurbishment, and deployment of a ground system. Restating and refining the basic premise stated earlier, it is possible to enhance operations through the replacement of hardware and software components with commodity based items wherever applicable. This will dramatically reduce the overall lifecycle cost of the project. The first study leveraged the POIF S secure, three-tier, web architecture to replace the client workstations with lower cost PC platforms. A second study initiated a review of COTS products to examine the level of added value of each product. This study included replacement of some COTS products with custom code, deletions, substitutions, and consolidation of COTS products. Studies three and four reviewed the server architectures of the data distribution systems and Enhanced HOSC System (EHS) command and telemetry system to propose migration to new platforms, both software and hardware. The final study reviewed current IP communication technologies, developed an operational model for flight operations, and demonstrated that voice over IP was practical and could be integrated into operations.

Bryant, Barry S.↗
NASA NTRS2001

Middleware as a mission enabler for Mars exploration

Effective midleware can improve the capability of business and science applications in several ways, e.g., by hiding platform heterogeneity or by providing standard shared services which reduce the complexity or increase the capability of every application. Recent successes in midleware, such as multi-tier client/server and web-based architectures, have fueled phenomenal growth in enterprise level applications, which provide better integration and more rapid adaptability of business in many fields.

middleware software architecture services data com↗
DOE OSTI2021

Deep-freeze graph training for latent learning

Scientific and engineering advances are primarily driven by multi-tier conceptual constructs and conditional theoretical frameworks. The theories allow predictions of hypothetical system responses, given a set of approximate conditions (ranges of applicability) imposed on latent parameters that cannot be measured directly. Learning to estimate the latent variables (Latent Learning) helps to pinpoint the anticipated range-edge anomalies and improves the confidence in interpretation, interpolation and extrapolation of limited experimental data. Due to high dimensionality and extreme non-linearity of the materials science problems, very large datasets are typically required for conventional data-driven model development. The vital experimental data collection, particularly on microstructural phases, is very challenging, which makes it difficult to compile a high-quality database. Incorporation of the domain knowledge into the computational graph structure, initialization and optimization processes presents a viable mechanism for developing accurate models, with limited datasets. Furthermore, this study successfully utilized the approach to build the Deep Freeze Graph (DeepFreG) by mapping known causality relationships and by digitizing empirical domain knowledge for Latent Learning (LL), with specific applications in materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Process-based modeling of soil nitrous oxide emissions from United States corn fields under different management and climate scenarios coupled with evaluation using regional estimates

Direct emissions of soil nitrous oxide during a growing season (N 2 O gs ) can be quantified with process-based models considering interactions between management, climate, and soil moisture when key data are available. We used an adapted “parameterized CENTURY/DAYCENT-model” ( p CENTURY) calibrated with crop growth and soil organic matter decay coefficients at the county-level for the estimation of N 2 O gs in the United States Corn Belt. Model estimated N 2 O-emissions from corn-based biofuels scenarios considering crop rotation, fertilizer inputs, tillage, and weather were compared against meta-summary of field observations from 55 studies. Both model and meta-summary ranked N 2 O gs -emissions to be corn > wheat > soybean phase while model likely underestimated cover crop N 2 O gs -emissions. The N 2 O gs -emissions and the associated emission factors (EFs) were modeled and summarized to be greater after anhydrous ammonia than urea application and from conventional tilled than non-tilled fields. Modeled and observed N 2 O gs -emissions after organic and inorganic fertilizer amendment did not differ due to high variability associated with the treatments. However, the organic fertilizer associated EFs were greater according to meta-summary data because of N input rates. Regionalized weather scenarios indicate hotspots for N 2 O gs -emissions can occur where crop N uptake is limited during dry years and in eastern states also during normal or wet seasons. The p CENTURY-derived N 2 O gs EFs (0.91 ± 0.19%) for counties investigated were only slightly lower than literature (1.07 ± 0.57%) or Tier-1 (1%) values. Our preliminary evaluation of regional soil moisture estimates showed reasonable agreement between monthly soil moisture estimates and the North American Soil Moisture Dataset during the growing season, but overestimation of soil moisture in winter-spring can influence the estimates of annual N 2 O emissions so future work is needed to calibrate soil moisture-associated model parameters. Our work provided scenario-based estimates of climate and management impacts on soil N 2 O gs -emissions together with valuable spatial insights into EFs that will be improved by more accurate information of fertilizer inputs and more temporally refined model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Ocean surface radiation measurement best practices

Ocean surface radiation measurement best practices have been developed as a first step to support the interoperability of radiation measurements across multiple ocean platforms and between land and ocean networks. This document describes the consensus by a working group of radiation measurement experts from land, ocean, and aircraft communities. The scope was limited to broadband shortwave (solar) and longwave (terrestrial infrared) surface irradiance measurements for quantification of the surface radiation budget. Best practices for spectral measurements for biological purposes like photosynthetically active radiation and ocean color are only mentioned briefly to motivate future interactions between the physical surface flux and biological radiation measurement communities. Topics discussed in these best practices include instrument selection, handling of sensors and installation, data quality monitoring, data processing, and calibration. It is recognized that platform and resource limitations may prohibit incorporating all best practices into all measurements and that spatial coverage is also an important motivator for expanding current networks. Thus, one of the key recommendations is to perform interoperability experiments that can help quantify the uncertainty of different practices and lay the groundwork for a multi-tiered global network with a mix of high-accuracy reference stations and lower-cost platforms and practices that can fill in spatial gaps.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2009

The 50 Constellation Priority Sites

The Constellation program (CxP) has developed a list of 50 sites of interest on the Moon which will be targeted by the LRO narrow angle camera. The list has also been provided to the M~ team to supplement their targeting list. This list does not represent a "site selection" process; rather the goal was to find "representative" sites and terrains to understand the range of possible surface conditions for human lunar exploration to aid engineering design and operational planning. The list compilers leveraged heavily on past site selection work (e.g. Geoscience and a Lunar Base Workshop - 1988, Site Selection Strategy for a Lunar Outpost - 1990, Exploration Systems Architecture Study (ESAS) - 2005). Considerations included scientific, resource utilization, and operational merits, and a desire to span lunar terrain types. The targets have been organized into two "tiers" of 25 sites each to provide a relative priority ranking in the event of mutual interference. A LEAG SAT (special action team) was established to validate and recommend modifications to the list. This SAT was chaired by Dr. Paul Lucey. They provided their final results to CxP in May. Dr. Wendell Mendell will organize an on-going analysis of the data as they come down to ensure data quality and determine if and when a site has sufficient data to be retired from the list. The list was compiled using the best available data, however, it is understood that with the flood of new lunar data, minor modifications or adjustments may be required.

Noble, S.↗
DOE OSTI2022

Towards Software Bill of Materials in the Nuclear Industry

Large, modern industrial facilities often incorporate thousands of digital assets in their operational technology. Regulated facilities, such as nuclear power plants (NPPs), maintain robust cybersecurity and configuration management programs that often use bills of materials (BOMs) for these assets, including make, model, and version of hardware, firmware, and software. However, these BOMs typically capture only first- or second-tier information provided by the original equipment manufacturer (OEM). Unfortunately, as indicated by the increasing number and sophistication of software supply chain attacks, this level of detail is insufficient for identifying all the potential vulnerabilities and risks in software applications. Software BOMs (SBOMs) provide detailed enumeration of components and dependencies within the product or devices, including firmware. SBOMs can be combined with vulnerability data sources and vendor vulnerability attestations to improve vulnerability management and enable rapid identification of affected components when new software vulnerabilities are discovered. Ideally, SBOMs are created by the OEM prior to installation. However, since this practice is not yet commonplace and since NPPs are typically slow to adopt new technology, most NPPs do not incorporate SBOMs into their asset or configuration management programs. Fortunately, SBOMs can be generated by NPPs on existing digital assets to provide further insight into risk management decisions. This report provides an overview of the current SBOM ecosystem and recommends guidance on how to get started in a “crawl, walk, run” manner to develop and implement a sustainable SBOM program for digital assets in an NPP.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2018

Auto Tracking Antenna Platform

The present invention is an auto tracking antenna platform upon which multiple antenna elements can be mounted to track a common moving object. The antenna tracking platform generally comprises a bottom pedestal enclosing a rotary azimuth actuator for controlled-rotary motion about the single vertical (z) axis, and an upper multi-tier framework housing a horizontal antenna-mounting beam pivotally supported for rotation about a horizontal (x) axis, and a drive assembly for direct-drive rotation of the antenna-mounting bar. Antenna elements are mounted along the horizontal mounting bar and the feeds routed through the azimuth actuator. This enables the use of fiber optic rotary joints or slip rings to pass data and video, instead of RF (waveguide) rotary joints which are required to pass high power RF signals.

Sanner, Kurt G↗
NASA NTRS2012

The Herschel Multi-tiered Extragalactic Survey: HerMES

The Herschel Multi-tiered Extragalactic Survey, HerMES, is a legacy program designed to map a set of nested fields totalling approx. 380 deg(exp 2). Fields range in size from 0.01 to approx. 20 deg (exp 2), using Herschel-SPIRE (at 250, 350 and 500 micron), and Herschel-PACS (at 100 and 160 micron), with an additional wider component of 270 deg. (exp. 2) with SPIRE alone. These bands cover the peak of the redshifted thermal spectral energy distribution from interstellar dust and thus capture the re-processed optical and ultra-violet radiation from star formation that has been absorbed by dust, and are critical for forming a complete multi-wavelength understanding of galaxy formation and evolution. The survey will detect of order 100,000 galaxies at 5-sigma in some of the best studied fields in the sky. Additionally, HerMES is closely coordinated with the PACS Evolutionary Probe survey. Making maximum use of the full spectrum of ancillary data, from radio to X-ray wavelengths, it is designed to: facilitate redshift determination; rapidly identify unusual objects; and understand the relationships between thermal emission from dust and other processes. Scientific questions HerMES will be used to answer include: the total infrared emission of galaxies; the evolution of the luminosity function; the clustering properties of dusty galaxies; and the properties of populations of galaxies which lie below the confusion limit through lensing and statistical techniques. This paper defines the survey observations and data products, outlines the primary scientific goals of the HerMES team, and reviews some of the early results.

multi-tiered↗
NASA NTRS2011

Reusable Solid Rocket Motor - Accomplishments, Lessons, and a Culture of Success

The Reusable Solid Rocket Motor represents the largest solid rocket motor ever flown and the only human rated solid motor. Each Reusable Solid Rocket Motor (RSRM) provides approximately 3-million lb of thrust to lift the integrated Space Shuttle vehicle from the launch pad. The motors burn out approximately 2 minutes later, separate from the vehicle and are recovered and refurbished. The size of the motor and the need for high reliability were challenges. Thrust shaping, via shaping of the propellant grain, was needed to limit structural loads during ascent. The motor design evolved through several block upgrades to increase performance and to increase safety and reliability. A major redesign occurred after STS-51L with the Redesigned Solid Rocket Motor. Significant improvements in the joint sealing systems were added. Design improvements continued throughout the Program via block changes with a number of innovations including development of low temperature o-ring materials and incorporation of a unique carbon fiber rope thermal barrier material. Recovery of the motors and post flight inspection improved understanding of hardware performance, and led to key design improvements. Because of the multidecade program duration material obsolescence was addressed, and requalification of materials and vendors was sometimes needed. Thermal protection systems and ablatives were used to protect the motor cases and nozzle structures. Significant understanding of design and manufacturing features of the ablatives was developed during the program resulting in optimization of design features and processing parameters. The project advanced technology in eliminating ozone-depleting materials in manufacturing processes and the development of an asbestos-free case insulation. Manufacturing processes for the large motor components were unique and safety in the manufacturing environment was a special concern. Transportation and handling approaches were also needed for the large hardware segments. The reusable solid rocket motor achieved significant reliability via process control, ground test programs, and postflight assessment. Process control is mandatory for a solid rocket motor as an acceptance test of the delivered product is not feasible. Process control included process failure modes and effects analysis, statistical process control, witness panels, and process product integrity audits. Material controls and inspections were maintained throughout the sub tier vendors. Material fingerprinting was employed to assess any drift in delivered material properties. The RSRM maintained both full scale and sub-scale test articles. These enabled continuous improvement of design and evaluation of process control and material behavior. Additionally RSRM reliability was achieved through attention to detail in post flight assessment to observe any shift in performance. The postflight analysis and inspections provided invaluable reliability data as it enables observation of actual flight performance, most of which would not be available if the motors were not recovered. These unique challenges, features of the reusable solid rocket motor, materials and manufacturing issues, and design improvements will be discussed in the paper.

Moore, Dennis R.↗
NASA NTRS1994

A streamlined software environment for situated skills

This paper documents a powerful set of software tools used for developing situated skills. These situated skills form the reactive level of a three-tiered intelligent agent architecture. The architecture is designed to allow these skills to be manipulated by a task level engine which is monitoring the current situation and selecting skills necessary for the current task. The idea is to coordinate the dynamic activations and deactivations of these situated skills in order to configure the reactive layer for the task at hand. The heart of the skills environment is a data flow mechanism which pipelines the currently active skills for execution. A front end graphical interface serves as a debugging facility during skill development and testing. We are able to integrate skills developed in different languages into the skills environment. The power of the skills environment lies in the amount of time it saves for the programmer to develop code for the reactive layer of a robot.

Yu, Sophia T.↗
DOE OSTI2026

Data-Driven Modeling and Control of Systems with Plasma-Surface Interactions (Final Technical Report)

This final technical report summarizes the activities and accomplishments in the period from February 2023 thru January 2026. The objective of the proposed research is to investigate the physical mechanisms and processes underlying the formation of structures and patterns in systems with plasma-surface interactions. In the past decades, there have been extensive studies on the interaction of glow discharges, dielectric barrier discharges, and arc discharges with confining or intervening surfaces. The advancement of the understanding of these phenomena is not only of fundamental scientific interest and relevance to the knowledge of the plasma state, but also with profound implications in various technological applications. The research will integrate theoretical, computational, and experimental work within an innovative framework of data assimilation, i.e., optimally combining model predictions with measurements. The scientific merit of this research has three aspects. Firstly, it extends the studies of plasma-surface interactions to systems with insulator surfaces and multi-layer systems, while existing studies are predominantly on electrode surfaces. Secondly, it expects to develop a novel data-driven modeling approach based on data assimilation to enhance the predictive and control capabilities, which could make transformative contributions to basic plasma research. Thirdly, it will shed new light on outstanding problems related to formation of patterns interfacing plasmas. This project also aims to launch an education and outreach initiative at Texas A&M University-Kingsville, a non-R1, minority-serving institution in South Texas. The initiative is structured as a four-tier pyramid. Tier one will be a webinar series for culture and capacity building to inform broader audience in the region about the research fields of plasma science and engineering. Tier two will be the creation and offering of an upper-level undergraduate course on introductory plasma physics, which will help with the recruitment for the upper tiers. On tier three, we will engage and mentor senior design students to conduct work toward the research goal of this project. There will also be a certificate program on general plasma science for undergrad and graduate students, part of which will be lab training at Princeton University. Tier four will be the supervision and mentoring of Ph.D. students. Therefore, this project will systematically expand the talent pipeline, broaden participation from communities historically and geographically underrepresented in DOE SC research portfolio, significantly improve the research and education capacity at the PI’s institution, and contribute to developing a diverse workforce in plasma science and engineering.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

PAVC Gridded 20m Alaska NGEE Tier3 PFTs v1.0

These 20-meter spatial resolution gridded products provide per-pixel fractional cover (%) of Next Generation Ecosystem Experiments (NGEE) Arctic Plant Functional Types (PFTs) Tier 3 across Alaska, north of the boreal treeline. The products were developed for the NGEE Arctic project, which is improving Arctic vegetation representation and parameterization of the E3SM Land Model. This dataset includes 8 files containing fractional cover for NGEE Tier 3 PFTs (https://data.ess-dive.lbl.gov/view/doi:10.15485/2529470): (1) bryophytes; (2) lichens; (3) non-vascular plants, i.e., the sum of lichens and bryophytes; (4) deciduous shrubs, (5) evergreen shrubs, (6) forbs, (7) graminoids, and a non-PFT class, (8) litter. Each pixel contains the percent cover (expressed as a fraction of total ground cover) that was predicted by random-forest regression models. The random-forest models were trained on cover data collected at 978 plots from 2010 to 2021, of which are archived in the Pan-Arctic Vegetation Cover (PAVC) database (https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2483557). The plot cover was linked to 20-meter spatial resolution, satellite-derived predictor variables: Sentinel-2 spectra and Sentinel-1 polarizations averaged over the 2019 growing season, as well as topographical features derived from ArcticDEM. Then, spatio-temporally anomalous plot data that introduced large variability to the regression outcomes were dropped using the Cook’s distance outlier detection method, and the models were re-created using high-quality plots and their associated satellite derived explanatory variables per each PFT. The correlations between plot-observed and satellite-derived fractional cover for all PFTs were well correlated (R2 = 0.69–0.95 and 0.5 for litter) and had low RMSE bias (0.02–0.11). This research was performed as a part of the NGEE Arctic project. The NGEE Arctic project was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Identification of beneficial and detrimental bacteria impacting sorghum responses to drought using multi-scale and multi-system microbiome comparisons

Abstract Drought is a major abiotic stress limiting agricultural productivity. Previous field-level experiments have demonstrated that drought decreases microbiome diversity in the root and rhizosphere. How these changes ultimately affect plant health remains elusive. Toward this end, we combined reductionist, transitional and ecological approaches, applied to the staple cereal crop sorghum to identify key root-associated microbes that robustly affect drought-stressed plant phenotypes. Fifty-three Arabidopsis-associated bacteria were applied to sorghum seeds and their effect on root growth was monitored. Two Arthrobacter strains caused root growth inhibition (RGI) in Arabidopsis and sorghum. In the context of synthetic communities, Variovorax strains were able to protect plants from Arthrobacter-caused RGI. As a transitional system, high-throughput phenotyping was used to test the synthetic communities. During drought stress, plants colonized by Arthrobacter had reduced growth and leaf water content. Plants colonized by both Arthrobacter and Variovorax performed as well or better than control plants. In parallel, we performed a field trial wherein sorghum was evaluated across drought conditions. By incorporating data on soil properties into the microbiome analysis, we accounted for experimental noise with a novel method and were able to observe the negative correlation between the abundance of Arthrobacter and plant growth. Having validated this approach, we cross-referenced datasets from the high-throughput phenotyping and field experiments and report a list of bacteria with high confidence that positively associated with plant growth under drought stress. In conclusion, a three-tiered experimental system successfully spanned the lab-to-field gap and identified beneficial and deleterious bacterial strains for sorghum under drought.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2007

Collaborative Resource Allocation

Collaborative Resource Allocation Networking Environment (CRANE) Version 0.5 is a prototype created to prove the newest concept of using a distributed environment to schedule Deep Space Network (DSN) antenna times in a collaborative fashion. This program is for all space-flight and terrestrial science project users and DSN schedulers to perform scheduling activities and conflict resolution, both synchronously and asynchronously. Project schedulers can, for the first time, participate directly in scheduling their tracking times into the official DSN schedule, and negotiate directly with other projects in an integrated scheduling system. A master schedule covers long-range, mid-range, near-real-time, and real-time scheduling time frames all in one, rather than the current method of separate functions that are supported by different processes and tools. CRANE also provides private workspaces (both dynamic and static), data sharing, scenario management, user control, rapid messaging (based on Java Message Service), data/time synchronization, workflow management, notification (including emails), conflict checking, and a linkage to a schedule generation engine. The data structure with corresponding database design combines object trees with multiple associated mortal instances and relational database to provide unprecedented traceability and simplify the existing DSN XML schedule representation. These technologies are used to provide traceability, schedule negotiation, conflict resolution, and load forecasting from real-time operations to long-range loading analysis up to 20 years in the future. CRANE includes a database, a stored procedure layer, an agent-based middle tier, a Web service wrapper, a Windows Integrated Analysis Environment (IAE), a Java application, and a Web page interface.

Wang, Yeou-Fang↗
NASA NTRS1995

Microgravity Experiments Safety and Integration Requirements Document Tree

This report is a document tree of the safety and integration documents required to develop a space experiment. Pertinent document information for each of the top level (tier one) safety and integration documents, and their applicable and reference (tier two) documents has been identified. This information includes: document title, revision level, configuration management, electronic availability, listed applicable and reference documents, source for obtaining the document, and document owner. One of the main conclusions of this report is that no single document tree exists for all safety and integration documents, regardless of the Shuttle carrier. This document also identifies the need for a single point of contact for customers wishing to access documents. The data in this report serves as a valuable information source for the NASA Lewis Research Center Project Documentation Center, as well as for all developers of space experiments.

Hogan, Jean M.↗
NASA NTRS2008

Constellation Program Design Specification for Natural Environments

The Design Specification for Natural Environments (DSNE) completes environment-related requirements from architecture, system level, and lower tier documents by specifying the ranges of environmental conditions that must be accounted for by the design of all Constellation Program (CxP) elements. As such, it forms a part of those specifications. It has been pulled out into a separate document to assure clarity and consistency and to prevent the requirements documents from becoming cluttered with extensive amounts of technical material. It is based on the Constellation Design Reference Missions and Operational Concepts Document and the models, data, and environment descriptions in the Natural Environments Definition for Design (NEDD). The NEDD provides additional detailed environment data and model descriptions to support analytical studies for Constellation (Cx) systems.

Constellation Program↗
DOE OSTI2022

DenKv: Addressing Design Trade-offs of Key-value Stores for Scientific Applications

High-performance computing (HPC) facilities have employed flash-based storage tier near to compute nodes to absorb high I/O demand by HPC applications during periodic system-level checkpoints. To accelerate these checkpoints, proxy-based distributed key-value stores (PD-KVS) gained particular attention for their flexibility to support multiple backends and different network configurations. PD-KVS rely internally on monolithic KVS, such as LevelDB or RocksDB, to exploit the KV interface and query support. However, PD-KVS are unaware of the high redundancy factor in checkpoint data, which can be up to GBs to TBs, and therefore, tend to generate high write and space amplification on these storage layers. In this paper, we propose DenKv which is deduplication-extended node-local LSM-tree-based KVS. DenKv employs asynchronous partially inline dedup (APID) and aims to maintain the performance characteristics of LSM-tree-based KVS while reducing the write and space amplification problems. We implemented DenKv atop BlobDB and showed that our proposed solution maintains performance while reducing write amplification up to 2× and space amplification by 4× on average.

Khan, Awais↗