Search NASA⌕ Search

SEARCH · Search NASA

Results for “High Performance Storage Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A Simple XML Producer-Consumer Protocol

There are many different projects from government, academia, and industry that provide services for delivering events in distributed environments. The problem with these event services is that they are not general enough to support all uses and they speak different protocols so that they cannot interoperate. We require such interoperability when we, for example, wish to analyze the performance of an application in a distributed environment. Such an analysis might require performance information from the application, computer systems, networks, and scientific instruments. In this work we propose and evaluate a standard XML-based protocol for the transmission of events in distributed systems. One recent trend in government and academic research is the development and deployment of computational grids. Computational grids are large-scale distributed systems that typically consist of high-performance compute, storage, and networking resources. Examples of such computational grids are the DOE Science Grid, the NASA Information Power Grid (IPG), and the NSF Partnerships for Advanced Computing Infrastructure (PACIs). The major effort to deploy these grids is in the area of developing the software services to allow users to execute applications on these large and diverse sets of resources. These services include security, execution of remote applications, managing remote data, access to information about resources and services, and so on. There are several toolkits for providing these services such as Globus, Legion, and Condor. As part of these efforts to develop computational grids, the Global Grid Forum is working to standardize the protocols and APIs used by various grid services. This standardization will allow interoperability between the client and server software of the toolkits that are providing the grid services. The goal of the Performance Working Group of the Grid Forum is to standardize protocols and representations related to the storage and distribution of performance data. These standard protocols and representations must support tasks such as profiling parallel applications, monitoring the status of computers and networks, and monitoring the performance of services provided by a computational grid. This paper describes a proposed protocol and data representation for the exchange of events in a distributed system. The protocol exchanges messages formatted in XML and it can be layered atop any low-level communication protocol such as TCP or UDP Further, we describe Java and C++ implementations of this protocol and discuss their performance. The next section will provide some further background information. Section 3 describes the main communication patterns of our protocol. Section 4 describes how we represent events and related information using XML. Section 5 describes our protocol and Section 6 discusses the performance of two implementations of the protocol. Finally, an appendix provides the XML Schema definition of our protocol and event information.

Smith, Warren↗

High Performance COPVs for In-Space Storage of High Pressure Cryogenic Fuels

Polymeric composite overwrapped pressure vessels (COPVs) provide an attractive material system to support developing commercial launch business and alternate fuel ventures. However to be able to design with these materials, the mechanical behavior of the materials must be understood with regards to processing, performance, damage tolerance, and environment. For the storage of cryogenic propellants, it is important to evaluate the materials performance and impact damage resistance at cryogenic temperatures in order to minimize weight and to ensure safety and reliability. As part of this study, material tests of candidate fiber and resin systems were used as the basis for the selection of the material combinations for evaluation in a COPV at cryogenic conditions. This comprehensive approach has also been expanded to address issues with impact damage tolerance and material degradation due to environmental factors. KEY WORDS: Cryogenic testing, evaluation and applications for pressure vessels, COPVs, tanks, or storage vessels.

Schneider, Judy↗

From Data to Models and Analytics: An Integrated Scientific Computing Platform to Accelerate Environmental Research SBIR Phase I (Final Technical Report)

Phase I research was conducted to investigate the technical feasibility of an integrated open source platform GeoLib to provide turnkey solutions for model-data integration for environmental systems science (ESS), using modern web technologies, advances in HPC and cloud computing and high-performance visualization. A key feature of our platform is that it minimizes and automates data movement between data storage and computing systems. Another critical feature of the design is that it enables users to perform high-fidelity post-processing by performing high-performance visualization server-side and in-situ on the compute cluster close to the data. The investigation, which was performed over a 12-month period ending April 2019, centered on developing prototype software to demonstrate the key enabling technologies required for this system. This included: (i) rapid access to data from multiple remote sources, via a unified data interface; (ii) software for scalable geospatial visualization of raster, vector, and point cloud data on the web; (iii) development of an easy-to-use API for creating simulation and modeling workflows; (iv) remote data visualization and processing on middle-tier servers; and (v) remote data processing on high-performance computing systems. A critical part of this work is that all of these capabilities be accessible to end users through standard desktop tools such as Project Jupyter, which is widely adopted for ESS simulation and modeling.

97 MATHEMATICS AND COMPUTING↗

In situ Infrared Spectroelectrochemistry for Understanding Structural Transformations of Precisely Defined Ions at Electrochemical Interfaces

Understanding the intrinsic properties of electroactive species at electrode-electrolyte interfaces (EEIs) is essential to the rational design of high-performance solid-state energy conversion and storage systems. In situ spectroscopy combined with cyclic voltammetry (CV) provides insights into structural changes of electroactive species at functioning EEIs. Ion soft-landing enables precisely-controlled deposition of massand charge-selected ions onto electrode surfaces thereby avoiding the contamination inherent with conventional electrode preparation techniques. In this contribution, we describe a new approach for the simultaneous electrochemical and spectroscopic characterization of soft-landed ions at operating solid-state EEIs. The technique exploits a specially-fabricated three-electrode cell that is compatible with in situ infrared reflection absorption spectroscopy (IRRAS) characterization of the softlanded ions. Keggin polyoxometalate (POM) anions, PW12O40 3-, were selected as a model system for these experiments due to their multielectron redox activity, structural stability, and well-characterized IRRAS spectrum. In situ CV measurements indicated continuous multielectron transfer processes of the soft-landed PW12O40 3- anions over a large potential range of -2.1 to -0.3 V. A distinct shift in the wavenumber of the terminal W=Ot stretching vibration in the IRRAS spectra was observed during the multielectron reduction process. The results demonstrate the capabilities of the in situ spectroelectrochemical approach for examining structural changes of well-defined electroactive species during electron transfer processes at operating solid-state EEIs.

Su, Pei↗

Pre-conditioned BFGS-based uncertainty quantification in elastic full-waveform inversion

SUMMARY Full-waveform inversion has become an essential technique for mapping geophysical subsurface structures. However, proper uncertainty quantification is often lacking in current applications. In theory, uncertainty quantification is related to the inverse Hessian (or the posterior covariance matrix). Even for common geophysical inverse problems its calculation is beyond the computational and storage capacities of the largest high-performance computing systems. In this study, we amend the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm to perform uncertainty quantification for large-scale applications. For seismic inverse problems, the limited-memory BFGS (L-BFGS) method prevails as the most efficient quasi-Newton method. We aim to augment it further to obtain an approximate inverse Hessian for uncertainty quantification in FWI. To facilitate retrieval of the inverse Hessian, we combine BFGS (essentially a full-history L-BFGS) with randomized singular value decomposition to determine a low-rank approximation of the inverse Hessian. Setting the rank number equal to the number of iterations makes this solution efficient and memory-affordable even for large-scale problems. Furthermore, based on the Gauss–Newton method, we formulate different initial, diagonal Hessian matrices as pre-conditioners for the inverse scheme and compare their performances in elastic FWI applications. We highlight our approach with the elastic Marmousi benchmark model, demonstrating the applicability of pre-conditioned BFGS for large-scale FWI and uncertainty quantification.

58 GEOSCIENCES↗

An All-Soluble Fe/Mn-Based Alkaline Redox Flow Battery System

Redox flow batteries (RFBs) are membrane-separated rechargeable flow cells with redox electrolytes, offering the potential for large-scale energy storage and supporting renewable energy grids. Yet, creating a cost-effective, high-performance RFB system is challenging. In this work, we investigate an Fe/Mn RFB alkaline system based on the [(TEA)Fe–O–Fe(TEA)] 3– / 4– and MnO 4 – / 2– redox couples with a theoretical cell voltage of ~1.43 V. This combination has not been systematically studied previously, but it can lead to a very low-cost and sustainable materials for high energy storage. Constant current cycling tests were performed at ±41 mA cm –2 between 20% and 80% SOC over 800 h (400 cycles) with an apparent Coulombic efficiency (CE) approaching 100%, while the voltage efficiency (VE) gradually decreased from ~75.3% to ~61.4% due to increasing internal resistances. Finally, the voltage efficiency loss can be mitigated through a periodic acid treatment to remove MnO 2 deposits from the separator.

25 ENERGY STORAGE↗

Metallic phase change material thermal storage for Dish Stirling

Dish-Stirling systems provide high-efficiency solar-only electrical generation and currently hold the world record at 31.25%. This high efficiency results in a system with a high possibility of meeting the DOE SunShot goal of $0.06/kWh. However, current dish-Stirling systems do not incorporate thermal storage. For the next generation of non-intermittent and cost-competitive solar power plants, we propose adding a thermal energy storage system that combines latent (phase-change) energy transport and latent energy storage in order to match the isothermal input requirements of Stirling engines while also maximizing the exergetic efficiency of the entire system. This paper reports current findings in the area of selection, synthesis and evaluation of a suitable high performance metallic phase change material (PCM) as well as potential interactions with containment alloy materials. The metallic PCM's, while more expensive than salts, have been identified as having substantial performance advantages primarily due to high thermal conductivity, leading to high exergetic efficiency. Systems modeling has indicated, based on high dish Stirling system performance, an allowable cost of the PCM storage system that is substantially higher than SunShot goals for storage cost on tower systems. Several PCM's are identified with suitable melting temperature, cost, and performance.

14 SOLAR ENERGY↗

Development of Low-Cost, High-Performance, Easy-To-Apply, Non-Flammable, Inorganic Phase Change Material (PCM) Technology (Project Final Report)

This report describes a 45-months long research program focused on the development of novel, easy-to-apply, non-flammable, and high-performance inorganic phase change materials (PCMs) for building and industrial applications. The University of Massachusetts Lowell (UML) formed a world-class team consisting of researchers form InsolCorp (only N. American manufacturer of inorganic PCM systems for building applications), and a group of industrial advisors, to develop a universal/multipurpose, simple-to-manufacture and cost-effective PCM technology. The project team expects that the results of this work will spur in the future the adoption of thermal storage materials – a key building energy saving technology as identified by DOE BTO – for a variety of building envelope applications. The main goal of this project was to demonstrate a suite of low-cost, multipurpose, and durable inorganic PCM formulations with phase transition temperatures encompassing typical building applications (between +5 o C and +55 o C). The first objective was to design, fabricate, and experimentally validate a performance of inexpensive, durable, highly efficient, non-flammable, and easy to manufacture PCMs. To allow a variety of building applications, the project team focused on formulations that exhibit repeatable phase transitions between +5 o C and +55 o C. To follow the DOE BTO cost efficiency target without compromising thermal performance, our work was based on inorganic compounds (mostly salt hydrates) and their blends, which represent a fraction of the cost of most of organic PCMs with about twice as high density as well as significantly higher thermal conductivity and phase change enthalpy. The second objective was to develop easy-to-manufacture and -install packaging/encapsulation designs that are 1) a superior barrier to current state-of-the-art macro-packaging, which significantly reduces the risk of loss of hydration water and PCM leak, and 2) optimal in enhancing the heat exchange rates with the surroundings and within the PCM core to ensure complete charging/discharging of the entire PCM within the product. Finally, the project’s intend was to scale-up the fabrication process to demonstrate installation on system-scale applications, and to validate the performance under field conditions. This work aimed at developing low-cost, high-energy storage, and reliable latent heat storage technology for building applications. This development was realized by formulating and integrating the following two technology components: 1) inorganic salt hydrate based PCMs that have high latent enthalpies and are low-cost and durable, and 2) PCM encapsulation (packaging) technology that maximizes PCM concentration and enhances heat transport characteristics in the product and with the external environment/materials. High thermal storage capacity, low cost and fire resistance are key to the building market entry for PCM technology. Therefore, the project’s focus was on salt-hydrate-based formulations which satisfy all these criteria. Packaging and/or encapsulation of PCM is a key processing step. The project team recognized that a low-cost and simple-to-manufacture salt hydrate-based PCM technology holds the best chance to be successful in the building construction market, a market which is traditionally extremely sensitive to cost and where commodity thermal insulations are the benchmark for envelope-related energy saving measures. That is why, in this project, the main intention was to minimize the production cost and maximize the product energy storage density without sacrificing the PCM performance. It was achieved through: 1. Minimizing the non-PCM components (plastics, additives, packaging/encapsulation materials, etc.) because they are significantly more expensive than salt hydrates, 2. Using highly thermally conductive and lightweight PCM carrier (packaging material) to facilitate more complete phase cycling, and 3. Optimizing the thickness and minimizing air spaces in product design (such as in pouched PCM). For this purpose, our approach was to enable an easy system design, including selection of the PCM operating temperatures, optimizing the necessary heat storage capacity (by stacking together several layers of PCM products), and if needed, a synchronized usage of PCM products of different temperatures. A specially designed, robust, highly thermally conducting and highly impermeable packaging (to retain salt hydrate water during phase transition cycles) was designed and tested to increase the overall system thermal performance and durability. All PCM products developed during this project were tested in both lab scale and in full scale field conditions. It is expected that, after further developments and commercialization, the developed PCM technologies may be also applied in space conditioning, energy storage technologies, and heat transfer applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

SWARM: Reimagining scientific workflow management systems in a distributed world

Modern scientific workflows process massive amounts of data from diverse instruments and sensors, leveraging geographically distributed, heterogeneous compute and storage resources—from leadership-class systems to edge devices—connected by high-performance networks. The diversity of resources introduces challenges in harnessing their full potential, with resilience issues arising across applications, system software, networks, storage, and hardware. Today, workflow management systems (WMS) coordinate the execution of computation and data management tasks across target resources. However, WMS’s centralized nature makes them vulnerable to faults and scalability issues that may result in failures of entire computational campaigns. In conclusion, this paper introduces a novel agentic framework for workflow management, fully distributing and decentralizing the WMS functions and modeling them as swarm intelligence agents infused with advanced artificial intelligence solutions and traditional distributed computing algorithms that can make coordinated decisions in the presence of failures of the underlying cyberinfrastructure.

Swarm intelligence↗

Economic Analysis of an Electric Thermal Energy Storage System Using Solid Particles for Grid Electricity Storage

As renewable power generation becomes the mainstream new-built energy source, energy storage will become an indispensable need to complement the uncertainty of renewable resources to firm the power supply. When phasing out fossil-fuel power plants to meet the carbon neutral utility target in the midcentury around the world, large capacity of energy storage will be needed to provide reliable grid power. The renewable power integration with storage can support future carbon-free utility and has several significant impacts including increasing the value of renewable generation to the grid, improving the peak-load response, and balancing the electricity supply and demand. Long-duration energy storage (10–100 hours duration) can potentially complement the reduction of fossil-fuel baseload generation that otherwise would risk grid security when a large portion of grid power comes from variable renewable sources. Current energy storage methods based on pumped storage hydropower or batteries have many limitations. Thermal energy storage (TES) has unique advantages in scale and siting flexibility to provide grid-scale storage capacity. A particle-based TES system has promising cost and performance for the future growing energy storage needs. This paper introduces the system and components required for the particle TES to be technically and economically competitive. A technoeconomic analysis based on preliminary component designs and performance shows that the particle TES integrated with an efficient air-Brayton combined cycle power system can provide power for several days by low-cost, high-performance storage cycles. It addresses grid storage needs by enabling large-scale grid integration of intermittent renewables like wind and solar, thereby increasing their grid value. The design specifications and cost estimations of major components in a commercial scale system are presented in this paper. The cost model provides insights for further development and cost comparison with competing technologies.

27 ARPA - Advanced Research Projects Agency-Energy↗

Economic Analysis of a Novel Thermal Energy Storage System Using Solid Particles for Grid Electricity Storage: Preprint

As renewable power generation becomes the mainstream new-built energy source, energy storage will become an indispensable need to complement the uncertainty of renewable resources to firm the power supply. When phasing out fossil-fuel power plants to meet the carbon neutral utility target in the midcentury around the world, large capacity of energy storage will be needed to provide reliable grid power. The integration of renewable power and storage to support future carbon-free utility has several significant and positive impacts including expanding the renewable generation into the grid, improving the peak-load response, and balancing the electricity supply and demand. Long-duration energy storage (10–100 hours duration) can potentially complement the reduction of fossil-fuel baseload generation that otherwise would risk grid security when a large portion of grid power comes from variable renewable sources. Current energy storage methods based on pumped storage hydropower or batteries have many limitations. Thermal energy storage (TES) has unique advantages in scale and siting flexibility to provide grid-scale storage capacity. A particle-based TES system has promising cost and performance for the future growing energy storage needs. This paper introduces the system and components required for the particle TES to be technically and economically competitive. A technoeconomic analysis based on preliminary component designs and performance shows that the particle TES integrated with an efficient air-Brayton combined cycle power system can provide power for several days by low-cost, high-performance storage cycles. It addresses grid storage needs by enabling large-scale grid integration of intermittent renewables like wind and solar, thereby increasing their grid value. The design specifications and cost estimations of major components in a commercial scale system are presented in this paper. The cost model provides insights for further development and cost comparison with competing technologies.

27 ARPA - Advanced Research Projects Agency-Energy↗

An Integrated Risk Assessment Process for Digital Instrumentation and Control Upgrades of Nuclear Power Plants

Most of the existing nuclear power plants (NPPs) in the world rely on traditional analog instrumentation and control (I&C) systems for monitoring, control, and protection functions. With the industrial base largely moving to digital systems, the operation and maintenance of plants involves managing issues including lack of needed analog spare parts, increasing maintenance costs, and the loss of vendor support. Compared with existing analog I&C systems, digital I&C systems have significant functional advantages, such as reliable system performance in terms of accuracy and computational capability, high data handling and storage capabilities to fully measure and display operating conditions, and improved capabilities (e.g., fault tolerance, self-testing, signal validation, process system diagnostics). Therefore, the U.S. nuclear power industry has initiated the replacement of existing, aging analog systems with digital I&C technology, and is developing new designs for advanced plants using digital systems in integrated control rooms to provide modern control and protection systems. However, the qualification of digital I&C systems remains a challenge, especially the issue of software common cause failure (CCF), which has been difficult to address. A CCF is the malfunction of two or more plant components or functions due to a single failure source. CCFs have the potential to generate unanalyzed events or sequences that may not be bounded by previous plant accident analyses, therefore, to challenge the plant safety. Existing analyses on CCF in I&C systems are mainly focusing on hardware failures. With the application and upgrades of new digital I&C systems, software CCFs due to design flaws have become a potential threat to plant safety considering most redundancy designs are using the similar digital platforms or software in the operating and application systems. With complex multi-layer redundancy designs to meet the single failure criterion, these I&C safety systems are of a particular concern in the U.S. Nuclear Regulatory Commission (NRC) licensing procedures. Therefore, there is a need to develop an integrated risk assessment strategy with digital CCF and plant transient responses considered to assure the long-term safety and reliability of vital digital systems and reduce uncertainties in costs, time, and support integration of digital systems in the plant. The overall goal of this project is to deliver a strong technical basis to support effective, licensable, and secure digital I&C technologies for the digital upgrades to existing NPPs. To deal with the expensive licensing justifications from regulatory insights, this technical basis is instructive for nuclear vendors and utilities to effectively lower the costs associated with digital compliance and speed-up industry advances by: (1) defining an integrated risk-informed analysis process for digital I&C upgrades including hazard analysis, reliability analysis, and consequence analysis; (2) applying systematic and risk-informed tools to address CCFs and quantify responding failure probabilities for digital I&C technologies; (3) evaluating the impact of digital failures at the individual level, system level, and plant level; and (4) providing insights and suggestions on designs to manage the risks, thus to support the development, licensing, and deployment of advanced digital I&C technologies on NPPs. Upgrading digital I&C (safety and non-safety related) systems in existing NPPs within a cost-effective and regulatory acceptable way offers the foremost means of performance improvements and cost-reductions for existing NPPs. One key outcome of this project is to perform plant-specific risk assessment to provide a sustainable scientific support for enabling industry to balance the digital-related risks, costs, reliability, and safety.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Effect of moderate temperatures on compressive strength of ultra-high-performance concrete: A microstructural analysis

Highlights: • All coarse aggregates and steel fibres were surrounded by the binder. • X-ray diffraction is useful for explaining the increase in compressive strength with increasing temperature. • Rosenhahnite and/or quartz Dauphiné-twinned phases improved the compressive strength. • Polypropylene fibres prevented spalling and preserved the compressive strength. • Concrete with steel and polypropylene fibres did not exhibit spalling at 300 °C. Concrete with two types of steel fibres and a polypropylene fibre prevented spalling and preserved the compressive strength at 300 °C, which makes these concretes suitable for long-term applications up to 300 °C, such as for steam collectors or thermal energy storage systems. The compressive strength behaviour of three types of ultra-high-performance fibre-reinforced concrete manufactured with the same matrix was investigated. For this purpose, a complete characterisation of all the raw materials and the three types of fibres used was performed. The morphology of all concrete mixtures at room temperature was analysed using scanning electron microscopy–energy-dispersive X-ray spectroscopy. From the results, it was ascertained that the steel fibres and coarse siliceous aggregates were not in contact (being separated by ≥3.41 μm) and were surrounded by the binder (of ≥1 μm in thickness) for all the mixtures studied. Rosenhahnite and/or quartz Dauphiné-twinned phases improved the compressive strength (as determined by X-ray diffraction).

36 MATERIALS SCIENCE↗

LIVVkit 2.1: automated and extensible ice sheet model validation

A collection of scientific analyses, metrics, and visualizations for robustvalidation of ice sheet models is presented using the Land Ice Verificationand Validation toolkit (LIVVkit), version 2.1, and the LIVVkit Extensionsrepository (LEX), version 0.1. This software collection targets stand-aloneice sheet or coupled Earth system models, and handles datasets and analysesthat require high-performance computing and storage. LIVVkit aims to enableefficient and fully reproducible workflows for postprocessing, analysis, andvisualization of observational and model-derived datasets in a shareableformat, whereby all data, methodologies, and output are distributed to usersfor evaluation. Extending from the initial LIVVkit software framework, wedemonstrate Greenland ice sheet simulation validation metrics using thecoupled Community Earth System Model (CESM) as well as an idealizedstand-alone high-resolution Community Ice Sheet Model, version 2 (CISM2),coupled to the Albany/FELIX velocity solver (CISM-Albany or CISM-A). As oneexample of the capability, LIVVkit analyzes the degree to which modelscapture the surface mass balance (SMB) and identifies potential sources ofbias, using recently available in situ and remotely sensed data ascomparison. Related fields within atmosphere and land surface models, e.g.,surface temperature, radiation, and cloud cover, are also diagnosed. Appliedto the CESM1.0, LIVVkit identifies a positive SMB bias that is focusedlargely around Greenland's southwest region that is due to insufficientablation.

58 GEOSCIENCES↗

Highly efficient interface stabilization for ambient-temperature quasi-solid-state sodium metal batteries

Solid-state sodium (Na) batteries (SSSBs) using sulfide-based solid electrolytes (SSEs) hold tremendous promise due to their high theoretical specific capacity, enhanced safety and abundant resources. However, detrimental interfacial issues between SSEs and Na metal present a major challenge to the advancement of sulfide-based SSSBs. To address interfacial issues, we demonstrate an efficient approach by incorporating an ionic liquid electrolyte ((PYR/Na)TFSI) as interlayer to stabilize the Na metal/SSE interface. The presence of the (PYR/Na)TFSI interlayer enables the formation of a stable solid electrolyte interphase (SEI) to prevent the harmful reactions and inhibit Na dendrites. Combination of ab initio molecular dynamics simulations and X-ray photoelectron spectroscopy revealed that this stable SEI is largely composed of reduced products of TFSI -, such as NaF and CF 3 . As a result, the symmetric cells exhibited stable Na plating/striping cycling for 300 h at 0.1 mA cm -2 . In addition, FeS2||Na quasi-solid-state batteries delivered an impressive specific capacity of over 300 mAh g -1 under the current density of 20 mA g -1 at room temperature. Under a higher current density (100 mA g -1 ), such batteries performed with long-term cycling stability and maintained a specific capacity of around 103 mAh g -1 after 330 cycles. This work demonstrates the novel perspective of using an ionic liquid interlayer to address interfacial issues, contributing to the advancement of high-performance SSSBs for the next-generation energy storage systems.

25 ENERGY STORAGE↗

Regen: An object layout regenerator on large-scale production HPC systems

This article proposes an object layout regenerator called Regen which regenerates and removes the object layout dynamically to improve the read performance of applications. Regen first detects frequent access patterns from the I/O requests of the applications. Second, Regen reorganizes the objects and regenerates or preallocates new object layouts according to the identified access patterns. Finally, Regen removes or reuses the obsolete or regenerated object layouts as necessary. As a result, Regen accelerates access to objects by providing a flexible object layout. We implement Regen as a framework on top of Proactive Data Container (PDC) and evaluate it on Cori supercomputer, a production-scale HPC system, by using realistic HPC I/O benchmarks. The experimental results show that Regen improves the I/O performance by up to 16.92 × compared with an existing system.

Distributed file system↗

Server-side Log Data Analytics for I/O Workload Characterization and Coordination on Large Shared Storage Systems

Inter-application I/O contention and performance interference have been recognized as severe problems. In this work, we demonstrate, through measurement from Titan (world s No. 3 supercomputer), that high I/O variance co-exists with the fact that individual storage units remain under-utilized for the majority of the time. This motivates us to propose AID, a system that performs automatic application I/O characterization and I/O-aware job scheduling. AID analyzes existing I/O traffic and batch job history logs, without any prior knowledge on applications or user/developer involvement. It identifies the small set of I/O-intensive candidates among all applications running on a supercomputer and subsequently mines their I/O patterns, using more detailed per-I/O-node traffic logs. Based on such auto- extracted information, AID provides online I/O-aware scheduling recommendations to steer I/O-intensive applications away from heavy ongoing I/O activities. We evaluate AID on Titan, using both real applications (with extracted I/O patterns validated by contacting users) and our own pseudo-applications. Our results confirm that AID is able to (1) identify I/O-intensive applications and their detailed I/O characteristics, and (2) significantly reduce these applications I/O performance degradation/variance by jointly evaluating out- standing applications I/O pattern and real-time system l/O load.

Liu, Y.↗