Search NASA⌕ Search

SEARCH · Search NASA

Results for “storage throughput”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Mission possible: Unify HPC and Big Data stacks towards application-defined blobs at the storage layer

HPC and Big Data stacks are completely separated today. The storage layer offers opportunities for convergence, as the challenges associated with HPC and Big Data storage are similar: trading versatility for performance. This motivates a global move towards dropping file-based, POSIX-IO compliance systems. However, on HPC platforms this is made difficult by the centralized storage architecture using file-based storage. In this paper we advocate that the growing trend of equipping HPC compute nodes with local storage redistributes the cards by enabling object storage to be deployed alongside the application on the compute nodes. Furthermore, such integration of application and storage not only allows fine-grained configuration of the storage system, but also improves application portability across platforms. In addition, the single-user nature of such application-specific storage obviates the need for resource-consuming storage features like permissions or file hierarchies offered by traditional file systems. In this article we propose and evaluate Blobs (Binary Large Objects) as an alternative to distributed file systems. Finally, we factually demonstrate that it offers drop-in compatibility with a variety of existing applications while improving storage throughput by up to 28%.

97 MATHEMATICS AND COMPUTING↗

Broom: application for non-redundant storage of high throughput sequencing data

Abstract Motivation The data generation capabilities of high throughput sequencing (HTS) instruments have exponentially increased over the last few years, while the cost of sequencing has dramatically decreased allowing this technology to become widely used in biomedical studies. For small labs and individual researchers, however, storage and transfer of large amounts of HTS data present a significant challenge. The recent trends in increased sequencing quality and genome coverage can be used to reconsider HTS data storage strategies. Results We present Broom, a stand-alone application designed to select and store only high-quality sequencing reads at extremely high compression rates. Written in C++, the application accepts single and paired-end reads in FASTQ and FASTA formats and decompresses data in FASTA format. Availability and implementation C++ code available at https://scsb.utmb.edu/labgroups/fofanov/broom.asp. Supplementary information Supplementary data are available at Bioinformatics online.

Albayrak, Levent↗

Accelerating Electrolyte Discovery for Energy Storage with High-Throughput Screening

Computational screening techniques have been found to be an effective alternative to the trial and error of experimentation for discovery of new materials. With increased interest in development of advanced electrical energy storage systems, it is essential to find new electrolytes that function effectively. This Perspective reviews various methods for screening electrolytes and then describes a hierarchical computational scheme to screen multiple properties of advanced electrical energy storage electrolytes using high-throughput quantum chemical calculations. The approach effectively down-selects a large pool of candidates based on successive property evaluation. As an example, results of screening are presented for redox potentials, solvation energies, and structural changes of similar to 1400 organic molecules for nonaqueous redox flow batteries. Importantly, on the basis of high-throughput screening, in silico design of suitable candidate molecules for synthesis and electrochemical testing can be achieved. We anticipate that the computational approach described in this Perspective coupled with experimentation will have a significant role to play in the discovery of materials for future energy needs.

25 ENERGY STORAGE↗

Machine learning-assisted design of metal–organic frameworks for hydrogen storage: A high-throughput screening and experimental approach

Various theoretical approaches, including big data and high-throughput screening techniques, have been explored in developing new materials due to their significant potential time-saving advantages. However, it remains a significant challenge to experimentally realize new materials that are predicted. In this study, we propose a novel materials design strategy that utilizes machine-learning (ML) techniques to predict new porous materials that show promise for hydrogen storage and are likely to be feasible to synthesize. By leveraging ML techniques and metal–organic framework (MOF) databases, we are able to predict the synthesizability of MOF structures. This is evidenced by the successful synthesis of a new vanadium-based MOF that exhibits excellent performance for cryogenic H 2 storage. Notably, the total gravimetric and volumetric H 2 uptakes are as high as 9.0 wt% and 50.0 g/L at 77 K and 150 bar. This ML-assisted materials design offers an efficient and promising approach for developing hydrogen storage materials.

08 HYDROGEN↗

Learning concave-convex profiles of data transport over dedicated connections

Dedicated data transport infrastructures are increasingly being deployed to support distributed big-data and high-performance computing scenarios. These infrastructures employ data transfer nodes that use sophisticated software stacks to support network transport among sites, which often house distributed file and storage systems. Throughput measurements collected over such infrastructures for a range of round trip times (RTTs) reflect the underlying complex end-to-end connections, and have revealed dichotomous throughput profiles as functions of RTT. In particular, concave regions of throughput profiles at lower RTTs indicate near-optimal performance, and convex regions at higher RTTs indicate bottlenecks due to factors such as buffer or credit limits. We present a machine learning method that explicitly infers these concave and convex regions and transitions between them using sigmoid functions. We also provide distribution-free confidence estimates for the generalization error of these concave-convex profile estimates. Throughput profiles for data transfers over 10 Gbps connections with 0–366 ms RTT provide important performance insights, including the near optimality of transfers performed with the XDD tool between XFS filesystems, and the performance limits of wide-area Lustre extensions using LNet routers. A direct application of generic machine learning packages does not adequately highlight these critical performance regions or provide as precise confidence estimates.

Rao, Nageswara↗

Striped tape arrays

A growing number of applications require high capacity, high throughput tertiary storage systems. How data striping ideas apply to arrays of magnetic tape drives is investigated. Data striping increases throughput and reduces response time for large accesses to a storage system. Striped magnetic tape systems are particularly appealing because many inexpensive magnetic tape drives have low bandwidth; striping may offer dramatic performance improvements for these systems. There are several important issues in designing striped tape systems: the choice of tape drives and robots, whether to stripe within or between robots, and the choice of the best scheme for distributing data on cartridges. One of the most troublesome problems in striped tape arrays is the synchronization of transfers across tape drives. Another issue is how improved devices will affect the desirability of striping in the future. The results of simulations comparing the performance of striped tape systems to non-striped systems are presented.

Drapeau, Ann L.↗

High Throughput Screening of Nanostructured Hydrogen Storage Materials

Hydrogen storage is the most challenging task for the hydrogen economy. We established a multidisciplinary research program for high throughput combinatorial synthesis and characterization of novel nanoporous and metastable complex hydrides, coupled to fundamental material studies including electronic, structural and kinetic transport modeling, and pump-probe experiments. Our research is based the concept of hybrid nanostructures that store hydrogen by a combination of chemi- and physorption: atomic hydrogen is stored in metastable hydrides while molecule hydrogen is stored in the nanometer pores of the hydrides. Metastable nanostructured hydride has been achieved by introducing structural and compositional disorders through high throughput elemental substitution/doping, catalyst addition, and nonequilibrium processing. Fast screening compatible with the combinatorial synthesis was achieved by combining X-ray structural characterization with the development of a laser-based microbalance. Manufacturing of nanoporous metahydrides that are identified as promising by the combinatorial synthesis has been explored along with the materials search.

36 MATERIALS SCIENCE↗

Improving I/O Throughput with PRIMACY: Preconditioning ID-Mapper for Compressing Incompressibility

The ability to efficiently handle massive amounts of data is necessary for the continuing development towards exascale scientific data-mining applications and database systems. Unfortunately, recent years have shown a growing gap between the size and complexity of data produced from scientific applications and the limited I/O bandwidth available on modern high-performance computing systems. Utilizing data compression in order to lower the degree of I/O activity offers a promising means to addressing this problem. However, the standard compression algorithms previously explored for such use offer limited gains on both the end-to-end throughput and storage fronts. In this paper, we introduce an in-situ compression scheme aimed at improving end-to-end I/O throughput as well as reduction of dataset size. Our technique, PRIMACY (Preconditioning Id-MApper for Compressing incompressibility), acts as a preconditioner for standard compression libraries by modifying representation of original floating-point scientific data to increase byte-level repeatability, allowing standard loss less compressors to take advantage of their entropy-based byte-level encoding schemes. We additionally present a theoretical model for compression efficiency in high-performance computing environments and evaluate the efficiency of our approach via comparative analysis. Based on our evaluations on 20 real-world scientific datasets, PRIMACY achieved up to 38% and 22% improvements upon standard end-to-end write and read throughputs respectively in addition to a 25% increase in compression ratios paired with 3-to-4-fold improvement in both compression and decompression throughput over general purpose compressors.

Computer Science↗

Towards Transparent Throughput Elasticity for IaaS Cloud Storage: Exploring the Benefits of Adaptive Block-Level Caching

Storage elasticity on IaaS clouds is a crucial feature in the age of data-intensive computing, especially when considering fluctuations of I/O throughput. This paper provides a transparent solution that automatically boosts I/O bandwidth during peaks for underlying virtual disks, effectively avoiding over-provisioning without performance loss. The authors' proposal relies on the idea of leveraging short-lived virtual disks of better performance characteristics (and thus more expensive) to act during peaks as a caching layer for the persistent virtual disks where the application data is stored. Furthermore, they introduce a performance and cost prediction methodology that can be used both independently to estimate in advance what trade-off between performance and cost is possible, as well as an optimization technique that enables better cache size selection to meet the desired performance level with minimal cost. The authors demonstrate the benefits of their proposal both for microbenchmarks and for two real-life applications using large-scale experiments.

Nicolae, Bogdan↗

Comparison of Classical and Charge Storage Methods for Determining Conductivity of Thin Film Insulators

Conductivity of insulating materials is a key parameter to determine how accumulated charge will distribute across the spacecraft and how rapidly charge imbalance will dissipate. Classical ASTM and IEC methods to measure thin film insulator conductivity apply a constant voltage to two electrodes around the sample and measure the resulting current for tens of minutes. However, conductivity is more appropriately measured for spacecraft charging applications as the "decay" of charge deposited on the surface of an insulator. Charge decay methods expose one side of the insulator in vacuum to sequences of charged particles, light, and plasma, with a metal electrode attached to the other side of the insulator. Data are obtained by capacitive coupling to measure both the resulting voltage on the open surface and emission of electrons from the exposed surface, as well monitoring currents to the electrode. Instrumentation for both classical and charge storage decay methods has been developed and tested at Jet Propulsion Laboratory (JPL) and at Utah State University (USU). Details of the apparatus, test methods and data analysis are given here. The JPL charge storage decay chamber is a first-generation instrument, designed to make detailed measurements on only three to five samples at a time. Because samples must typically be tested for over a month, a second-generation high sample throughput charge storage decay chamber was developed at USU with the capability of testing up to 32 samples simultaneously. Details are provided about the instrumentation to measure surface charge and current; for charge deposition apparatus and control; the sample holders to properly isolate the mounted samples; the sample carousel to rotate samples into place; the control of the sample environment including sample vacuum, ambient gas, and sample temperature; and the computer control and data acquisition systems. Measurements are compared here for a number of thin film insulators using both methods at both facilities. We have found that conductivity determined from charge storage decay methods is 102 to 104 larger than values obtained from classical methods. Another Spacecraft Charging Conference presentation describes more extensive measurements made with these apparatus. This work is supported through funding from the NASA Space Environments and Effects Program and the USU Space Dynamics Laboratory Enabling Technologies Program.

Swaminathan, Prasanna↗

Rheological Modifiers and Wetting Agents

DOE tank waste treatment plants, the Waste Treatment Plant (WTP) at Hanford and Defense Waste Processing Facility (DWPF) at Savannah River, are designed to vitrify radioactive waste slurries for long-term storage. Plant throughput is currently limited by the waste solids loading. To increase waste throughput rates in the plant, an increase in the slurry solids concentration (or conversely, a reduction in the mass fraction of water in the waste) is being considered. However, the present mechanical designs used to mix and transport theses slurries are limited by the rheological properties. This reduction of water results in an increase in rheological properties that challenge plant design and performance. To support this increase in throughput, there is a need to reduce the rheological properties of these waste slurries. The objective of this project is to determine a small set of well-performing and commercially available rheological modifiers that allow control rheological properties of various simulated and actual waste slurries and to understand the physical mechanisms that govern modification of waste rheology. It is estimated that processing at a higher solids concentration will reduce the operating life of these plants by one year for both facilities, representing roughly $1B in lifecycle cost savings. In addition, this research is potentially important to sustainable operations of both WTP and DWPF

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

When to use rsync

We have endeavored to show, using a series of data transfer results obtained from two testbeds, when to use the popular data copying tool rsync and related tools. Tests have been conducted in local area network (LAN) and wide area network (WAN) environments. We conclude that for files in a certain size range and network latency ≦ 10 ms round trip time (RTT), rsync is still useful for data moving tasks in the category 4 of the U.S. DOE Technical Report “Data Movement Categories”. For more demanding data movement requirements, tools of different classes are suggested. Sample histograms from two DOE user facilities are provided to further support our conclusions.

97 MATHEMATICS AND COMPUTING↗

The crush of new earth science data knocking at our door

The reasons for collecting massive amounts of earth science data in the Earth Observing System (EOS) Project are discussed. A processing hierarchy for handling the data is described, and the prospects for adequate throughput and storage for operational data analysis in the EOS era are addressed. Needs for successful exploratory data analysis are examined, and the policy issues implicated by the large stream of EOS data are considered.

Kahn, Ralph↗

Logistics Modeling of Emplacement Rate and Duration of Operations for Generic Geologic Repository Concepts - 16529

This study (1) identifies 16 potential geologic repository concepts for disposal of commercial spent nuclear fuel (SNF) and (2) evaluates the achievable repository waste emplacement rate and time needed to complete disposal for these concepts. Total repository capacity is assumed to be 140,000 MTU of spent fuel. The results provide important input to rough-order-of-magnitude (ROM) cost estimates for SNF disposal alternatives. The disposal concepts cover three categories of host geologic media: crystalline, salt, and argillaceous rock. Four waste package sizes are considered: 4PWR/9BWR; 12PWR/21BWR; 21PWR/44BWR, and dual purpose canisters (DPCs) packaged for disposal. Each concept is associated with package thermal power limits for emplacement and repository closure (the same for some concepts). To estimate the repository emplacement rate and duration of operations, logistical simulations were performed using assumptions on interim SNF storage, disposition of SNF stored in DPCs, repository opening date, and throughput rates for storage and disposal facilities. The simulations demonstrate that all concepts and scenarios, with few exceptions, are similar with regard to achievable emplacement rate and duration of operations. Throughput of 3,000 MTU per year can be maintained during the first 44 years of repository operations. Most of the inventory (99%) can be emplaced within 54 years of repository operations (the remaining 1% could require additional aging or smaller packages). Estimating ROM disposal cost was not an objective of this analysis, however, an example of disposal cost is provided to demonstrate key differences between concepts. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗