Search NASA⌕ Search

SEARCH · Search NASA

Results for “High Performance Building Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains. Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling. The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Hybrid Solar System (Final Scientific/Technical Report)

GTI Energy (GTI) teamed with the University of California at Merced (UCM) to scaleup the hybrid solar system (HSS) technology for demonstrating its performance at the US Gypsum (USG) plant in Plaster City, California. The technology integrates two-stage concentrating solar collector with matching particle thermal transport and storage (TSS) system to deliver cost-effective, and on-demand distributed high temperature industrial process heat up to 600°C with solar thermal, in this case to a gypsum kettle, to reduce its fuel use and carbon footprint. Current solar technologies, which reach these temperatures, are not distributable (towers) or cost-effective (dish). The research team developed a conceptual system design for host site retrofit, including preliminary heat balance, process flow diagram, particle to process heat exchanger and equipment placements at the site. Subsequently, parallel efforts were carried out at UCM to design, build and test a 12 m long commercial scale prototype concentrating thermal-only collector system and at GTI to design, build and test a matching 650°C capable particle TTS system. The nominal 50 kWth collector consists of a parabolic trough and three 4 m long two-stage receivers in series. Prior to on-sun testing, a 4 m long receiver was fabricated and successfully tested at 650 °C in a laboratory setting for 100 hrs of continuous operation showing less than 15% radiation loss. A 7 m wide x 17 m long parabolic trough was then installed at UCM for on-sun testing of the 12 m long receiver, and concurrently several 4 m long receivers were built. The optics of the parabolic trough were calibrated, and on-sun test were carried out on 12 m long receivers. During tests, the intense solar radiation (53x) caused the absorber tubes in the receivers to bend, reducing the overall optical efficiency. To address the bending issue, a self-consistent algorithm that includes ray tracing, thermal and deformation models was developed to perform thermal stress analysis on absorbers for parabolic solar collectors. Results obtained with this algorithm showed a dramatic rise in deformation as absorber tube length increases. A combined efficiency parameter that includes the occluded area for the mounts was developed to obtain an optimized tube length obtained. Based on the results, a length of 2.7 m for the absorber + 0.2 m for the coupler was chosen to minimize any bending and optimize optical efficiency while maintaining ease of mounting. The associated particle TTS system was designed, built and successfully tested at GTI. It includes storage, receiving and lock hoppers and piping that simulates the transfer of captured solar energy to an actual industrial furnace. Tests over 77 charge-discharge cycles demonstrated <2% particle degradation, with no problematic particle accumulations and no flow interruptions. The piping pressure drop was about 5 psi. The team also worked with Stanley Consultants (Stanley) to prepare conceptual and preliminary engineering packages to facilitate follow-on development and commercialization efforts. These include process and instrumentation diagram’s (P&ID’s), general arrangements, electrical one-line, project definitions document, equipment data sheets, schedule, and construction cost estimate for 2 MWth system. Updated HSS technology commercialization and customer engagement plans and detailed costs and evaluated market trade-offs and manufacturing.

03 NATURAL GAS↗
DOE OSTI2023

Real-Time Krylov Theory for Quantum Computing Algorithms

Quantum computers provide new avenues to access ground and excited state properties of systems otherwise difficult to simulate on classical hardware. New approaches using subspaces generated by real-time evolution have shown efficiency in extracting eigenstate information, but the full capabilities of such approaches are still not understood. In recent work, we developed the variational quantum phase estimation (VQPE) method, a compact and efficient real-time algorithm to extract eigenvalues on quantum hardware. Here we build on that work by theoretically and numerically exploring a generalized Krylov scheme where the Krylov subspace is constructed through a parametrized real-time evolution, which applies to the VQPE algorithm as well as others. We establish an error bound that justifies the fast convergence of our spectral approximation. We also derive how the overlap with high energy eigenstates becomes suppressed from real-time subspace diagonalization and we visualize the process that shows the signature phase cancellations at specific eigenenergies. We investigate various algorithm implementations and consider performance when stochasticity is added to the target Hamiltonian in the form of spectral statistics. To demonstrate the practicality of such real-time evolution, we discuss its application to fundamental problems in quantum computation such as electronic structure predictions for strongly correlated systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Artificial Intelligence and Machine Learning for Bioenergy Research: Opportunities and Challenges

The integration of artificial intelligence and machine learning (AI/ML) with automated experimentation, genomics, biosystems design, and bioprocessing technologies is poised to revolutionize scientific investigation and, particularly, bioenergy research. To identify the opportunities and challenges in this emerging research area, the U.S. Department of Energy’s (DOE) Biological and Environmental Research program (BER) and Bioenergy Technologies Office (BETO) held a joint virtual workshop on AI/ML for Bioenergy Research (AMBER) on August 23–25, 2022. These interests have since been amplified in a September 2022 Executive Order, “Advancing Biotechnology and Biomanufacturing Innovation for a Sustainable, Safe, and Secure U.S. Bioeconomy,” to promote a whole-of government approach to biotechnology development (White House 2022). Approximately 50 scientists with various backgrounds and expertise from academia, industry, and DOE national laboratories met to discuss the opportunities and challenges of AI/ML for bioenergy research. Workshop participants were tasked with assessing the potential for AI/ML and laboratory automation to advance biological understanding and engineering in general. They particularly examined how integrating AI/ML tools with laboratory automation could accelerate biosystems design and optimize biomanufacturing. Discussions included the data and computational infrastructure needed to augment biosystems design applications and the expertise and workforce development efforts urgently required to shift integrated systems toward bioenergy research more broadly. Participants discussed many existing and future applications of AI/ML for biosystems design ranging from enzymes to plants and microbes, microbiomes, and bioprocess development. They also identified three key categories of scientific and technical opportunities and challenges: high-quality data, AI/ML algorithms, and laboratory automation. Several main takeaways emerged from the workshop: 1. Numerous AI/ML and automated experimentation applications exist for a variety of DOE mission needs in energy and the environment; 2. Exemplary research grand challenges for which AI/ML could provide solutions include: building microbes and microbial communities to specifications, developing closed-loop autonomous design and control for biosystems design, and advancing scale-up and automation; 3. Lack of sufficient high-quality, annotated data hinders the development of AI/ML applications; 4. New and improved AI/ML tools are needed, particularly those meeting the specific needs of the BER and BETO research communities; 5. Trade-offs in performance, cost, and reliability exist between deploying commercially available versus building custom-developed instrumentation and software for automated or autonomous experimentation; translation of manual to automated or autonomous methods is often a nontrivial endeavor; 6. Training a new generation of young scientists who can develop and apply AI/ML tools is needed to solve long-standing scientific challenges in bioenergy research. The integration of AI/ML tools and automated experimentation represents a new data-driven research paradigm complementary to the traditional hypothesis-driven research paradigm. This paradigm accelerates design and optimization of biological systems and processes for a variety of DOE mission needs in energy and the environment. The AMBER workshop broadly explored the potential of this new paradigm for bioenergy research, of particular interest to BER and BETO, and identified key challenges and opportunities that DOE can address in the coming years by leveraging its unique capabilities and resources.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

High-Efficiency Modular SiC-based Power-Converter for Flexible-CHP Systems with Stability-Enhanced Grid-Support Functions

This project seeks to develop a modular, scalable MV power converter featuring stability-enhanced grid-support functions for future grid-interface applications in flexible combined heat and power (F-CHP) cogeneration plants, being fully compliant with the IEEE Standard 1547, category B—for operation in local areas with high aggregated distributed energy resource (DER) penetration, and also with the IEEE standard for the specification of microgrid controllers, namely IEEE Std 2030.7, with the goal to enable F-CHP systems for both microgrid and standalone applications. Further, the proposed converter will use a modular circuit topology, the MMC, which is scalable both in voltage and current by interconnecting power-cell building blocks, thus flexibly suiting the needs of F-CHP systems in the 1–20 MWe range. Furthermore, the use of 10 kV SiC MOSFET devices will minimize the number of power-cells needed to operate in 2–13.8 kV MV distribution systems, but more importantly, they will render feasible a power conversion efficiency > 98 %, and a power density > 10 kW/l. This is highly relevant given that these are two key performance metrics that will further increase the value of F-CHP systems by shortening the time required to recover their investment costs.

14 SOLAR ENERGY↗
DOE OSTI2025

Framework and Tool for Artificial Intelligence & Machine Learning (AI/ML) Enabled Automated Non-Destructive Inspection of Composites Aerostructures Manufacturing

Vehicles and systems in the field of aerospace have two major requirements: a high demand for a large quantity and an expectation to perform for their lifetime with little to no failures. Thus, there is a need for a fast production rate of aerospace products with high quality. Improvements to production rate have many benefits, including a reduction in energy consumption per unit manufactured. This would be from factory energy usage, which is required to build and verify a product. Manufacturing process specifications require inspection of parts to determine if any flaws are present. Depending on factory planning and product quality, especially at higher rates, the evaluation process can pose a production rate bottleneck. This project was comprised of using artificial intelligence and machine learning (AI/ML) methods on inspection evaluations with the objective of reducing the required time to produce an aerospace structure or product and without reducing the final quality.

42 ENGINEERING↗
DOE OSTI2026

Experimental study of a thermal energy storage-integrated heat pump system for load shifting in space cooling and heating

This study experimentally investigates an all-season thermal energy storage-integrated heat pump (TES-HP) system developed to enhance building energy efficiency and support grid-interactive operation through load shifting in both cooling and heating. A 4-ton commercial rooftop air-source heat pump was modified by integrating a hydronic thermal energy storage (TES) unit containing a phase change material (PCM) with a melting temperature of 22.0 °C. The system employs two reversing valves and three electronic expansion valves to enable six operating modes, including normal, TES charging, and TES discharging in both cooling and heating seasons. A subcooling-controlled electronic expansion valve was implemented to mitigate refrigerant maldistribution caused by unequal internal volumes among the heat exchangers. Compared with a baseline heat pump, the TES-HP reduced power consumption by 30–50% during cooling at an ambient temperature of 40.6 °C, and by up to 60% during heating at −15.0 °C, while maintaining high performance under cold-climate conditions. Additionaly to experimental evaluation, a simplified annualized on-peak analysis was conducted to compare the TES-HP with the baseline system, indicating an on-peak electricity reduction of approximately 876 kWhₑ per unit per year and associated on-peak cost savings under time-of-use pricing. These results demonstrate that the TES-HP effectively decouples HP operation from adverse ambient conditions, improving flexibility, resilience, and energy efficiency. This work advances prior research by experimentally proving the integration of PCM-based TES for a year-round, load-flexible HVAC operation.

42 ENGINEERING↗
DOE OSTI2020

Ad Hoc File Systems for High-Performance Computing

Storage backends of parallel compute clusters are still based mostly on magnetic disks, while newer and faster storage technologies such as flash-based SSDs or non-volatile random access memory (NVRAM) are deployed within compute nodes. Including these new storage technologies into scientific workflows is unfortunately today a mostly manual task, and most scientists therefore do not take advantage of the faster storage media. One approach to systematically include nodelocal SSDs or NVRAMs into scientific workflows is to deploy ad hoc file systems over a set of compute nodes, which serve as temporary storage systems for single applications or longer-running campaigns. This paper presents results from the Dagstuhl Seminar 17202 “Challenges and Opportunities of User-Level File Systems for HPC” and discusses application scenarios as well as design strategies for ad hoc file systems using node-local storage media. The discussion includes open research questions, such as how to couple ad hoc file systems with the batch scheduling environment and how to schedule stage-in and stage-out processes of data between the storage backend and the ad hoc file systems. Also presented are strategies to build ad hoc file systems by using reusable components for networking and how to improve storage device compatibility. Various interfaces and semantics are presented, for example those used by the three ad hoc file systems BeeOND, GekkoFS, and BurstFS. Their presentation covers a range from file systems running in production to cutting-edge research focusing on reaching the performance limits of the underlying devices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Scalable Hardware-and-Human-in-the-Loop Grid-interactive Efficient Building Equipment Performance Dataset

This project developed a publicly available, high-fidelity dataset about the interactions among humans, homes, and heat pumps supporting grid interactive efficient buildings to balance demand on the grid with comfort for occupants. Laboratory measurements and simulations of the hardware capture the second-scale electric power dynamics of heat pumps providing grid services like load shifting and load shedding. Field measurements, behavior tracking, and qualitative surveys of people in their homes over multiple years—including experimentally adjusting the heating and cooling system to provide grid services—to capture the reciprocal effect of human behavior on grid services, and grid services on human comfort. Taken together, these data capture the complete Hardware and Human in the loop system for residential heat pumps, reducing large uncertainties in simulation for design, and models for control of heat pumps, and grid-interactive buildings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

RAPIDS: Reconciling Availability, Accuracy, and Performance in Managing Geo-Distributed Scientific Data

In modern science, big data plays an increasingly important role. Many scientific applications, such as running simulations on supercomputers or conducting experiments on advanced instruments, produce huge amount of data at unprecedented speed. Analyzing and understanding such big data is the key for scientists to make scientific breakthroughs. However, data might become unavailable for scientists to access when outages or maintenance of the storage system occur, which severely hinders scientific discovery. To improve the data availability, data duplication and erasure coding (EC) are often used. But as the scientific data gets larger, using these two methods can cause considerable storage and network overhead.In this paper, we propose RAPIDS, a hybrid approach that combines the multigrid-based error-bounded lossy compression with erasure coding, to significantly reduce the storage and network overhead required for maintaining high data availability. Our experiments show that RAPIDS reduces the storage overhead by up to 7.5x and network overhead by up to 3x to achieve the same level of availability compared to the regular EC method. We improve RAPIDS by building two models to optimize the fault tolerance configurations and data gathering strategy. We demonstrate that RAPIDS significantly improves performance when running on many CPU cores in parallel or on GPUs.

Wan, Lipeng↗
DOE OSTI2020

Using a Genetic Algorithm to Optimize Configurations in a Data-Driven Application

Users of highly-configurable software systems often want to optimize a particular objective such as improving a functional outcome or increasing system performance. One approach is to use an evolutionary algorithm. However, many applications today are data-driven, meaning they depend on inputs or data which can be complex and varied. Hence, a search needs to be run (and re-run) for all inputs, making optimization a heavy-weight and potentially impractical process. In this paper, we explore this issue on a data-driven highly-configurable scientific application. We build an exhaustive database containing 3,000 configurations and 10,000 inputs, leading to almost 100 million records as our oracle, and then run a genetic algorithm individually on each of the 10,000 inputs. We ask if (1) a genetic algorithm can find configurations to improve functional objectives; (2) whether patterns of best configurations over all input data emerge; and (3) if we can we use sampling to approximate the results. We find that the original (default) configuration is best only 34% of the time, while clear patterns emerge of other best configurations. Out of 3,000 possible configurations, only 112 distinct configurations achieve the optimal result at least once across all 10,000 inputs, suggesting the potential for lighter weight optimization approaches. We show that sampling of the input data finds similar patterns at a lower cost.

Sinha, Urjoshi↗
DOE OSTI2020

Neural-based time series forecasting of loss of coolant accidents in nuclear power plants

During the last few years, deep learning in neural networks has demonstrated impressive successes in the areas of computer vision, speech and image recognition, text generation, and many others. However, sensitive engineering areas such as nuclear engineering benefited less from these efficient techniques. In this work, deep learning expert systems are utilized to model and predict time series progression of a design-basis nuclear accident, featuring a loss of coolant accident. Two major findings are accomplished in this work. First, the ability to train expert systems with high accuracy, which could help nuclear power plant operators to figure out plant responses during the accident. Second, building fast, efficient, and accurate deep models to simulate nuclear phenomena, which could be valuable to nuclear computational science. In this work, large amount of time series data is obtained from simulation tools by simulating different conditions of the base-case/nominal accident scenario. Four critical outputs/responses are monitored during the accident (e.g. temperature, pressure, break flow rate, water level). Two approaches are adopted in this work. The first approach is to use feedforward deep neural networks (DNN) to fit all time steps and outputs in a single model. The second approach is to use long short-term memory (LSTM) to fit all time steps together for each reactor response separately. Both DNN and LSTM demonstrate very good performance in predicting the test and base-case scenarios, with accuracy as low as 92% and as high as 99%, where these test scenarios are unknown to the expert systems and are not included in the model training. In addition, both approaches demonstrate a significant reduction in computational costs, as the deep expert system is able to accurately predict the accident 100,000 times faster than the original simulation tool. Given sufficient data, the methodology adopted in this study demonstrates that DNN/LSTM expert systems can be used as a decision support system to model advanced time series phenomena within nuclear power plants with high accuracy and negligible computational costs.

42 ENGINEERING↗
DOE OSTI2023

Load balancing for multi-beam additive manufacturing systems

As powder bed fusion (PBF) additive manufacturing (AM) becomes a more mature field, system configurations are gradually moving away from the classic single heat source, layer-by-layer system configurations towards unconventional system configurations that offer higher throughput. Higher throughput systems allow PBF systems to be considered for a larger variety of industrial applications. However, the inclusion of multiple heat sources, or beams, also increases the complexity of the control schemes needed. For multi-beam systems with overlapping fields of view, the distribution of workload, or load balancing, across these beams directly affects the total print time for a build. Additionally, the probability of any beam failing in a multi-beam system increases with the number of beams. While manual methods of load balancing and dealing with beam failures are reasonable for current generation multi-beam systems, as system configurations become more complex, manual methods will become prohibitively inefficient. Here, this paper introduces two different ways to load balance multi-beam systems of various configuration types, regardless of their complexity, which are highly performant. A consequence of this performance is the enablement of on-the-fly load balancing in the event a beam fails, thus improving system robustness.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Scalable and Cost-Effective Roll-To-Roll Additive Manufacturing of Highly Durable and Thermal Insulating Silica-Carbon Aerogel (Final Report)

The research objective of this project is to demonstrate low cost silica aerogel insulation materials with high R-value and low installed price of R7.5/inch, and $0.94/ft2-inch, respectively, which can meet the cost and performance targets of the Department of Energy’s 2030 Building Technology Office Emerging Technologies program. The main tasks of this project include the following three topics: a) Low-cost silica gel precursor: Repeat silica sol gel chemical approach which is reproducible and scalable. Also explore suitability of water-glass on silica aerogel system to further control cost efficiency. In addition, our aim is to synthesize hollow silica using low-cost precursors. Sodium silicate (water glass) was chosen as our silica source because of its availability and low price compared to the other precursors; b) In situ ambient pressure-drying (APD) and surface modification: confirm and improve silica aerogel under cost-effective continuous ambient pressure-drying and investigate silica aerogel performance under time and temperature dependence; c) Roll-to-Roll (R2R) manufacturing with the targeted structure, thermal and mechanical characteristics: evaluate 3D printing with silica aerogel precursor to modify aerogel formation.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Evaluation of LLVM Flang for Production HPC Applications and Modern Fortran Features

In 2025, LLVM released its first Flang Fortran compiler version considered ready for widespread evaluation. We know of no published assessment of Flang compiling a workload- derived portfolio of high-performance computing (HPC) applications. We address this gap using workload data from the National Energy Research Scientific Computing Center (NERSC), which supports more than 10,000 scientists on approximately 1,000 projects. The NERSC workload analyses identify many Fortran components in heavily used applications. We selected 10 such packages with available source code. We compiled them with Flang 22.1.3 on NERSC’s Perlmutter system. Six compiled without code modifications, though some required build-system changes. Three compiled after minor source edits, mostly to address Fortran standard violations. One built only without OpenMP enabled. We evaluated seven additional packages selected for their use of, or enablement of, standard Fortran parallel features: multi-image execution and do concurrent. Six such codes compiled with most or all unit tests passing.

Rasmussen, Katherine↗
DOE OSTI2023

Performance Evaluation and Costs of a Combined Ground Source Heat Pump and Solar Photovoltaic Storage System in an Extreme Cold Climate

This report outlines the effectiveness and economics of a ground source heat pump system installed together with solar photovoltaic panels and a battery storage system in a local community building situated in a cold climate. The community building is a tribal building located in Ruby, Alaska. Power from solar photovoltaic panels is supplemented by electricity purchased from the local community microgrid. A ground source heat pump was commissioned three years after the building was occupied, and supplements the heat generated by a boiler for both heat and domestic hot water. Data collected over the 2021-2022 heating season shows that the heat pump is providing heat to the building about 19% of the time with an average coefficient of performance of 2.68, ranging from below 2.5 in winter to above 3.0 in summer. The solar photovoltaic panels provided 4,700 kWh of power used within the building and an additional 2,900 kWh exported to the microgrid. The solar-produced power used within the building nearly offsets the estimated annual electrical draw of the heat pump of 5,700 kWh. Due to the very high costs for shipping and installation to remote locations, projects such as this, while not economically feasible if self-funded, can save the community an estimated $76,051 over a period of 20-years. Fuel prices increasing by more than 25%, or subsidized electricity prices decreasing by more than 25%, make the ground source heat pump a more viable option economically. Unsubsidized electricity prices increasing by 25% or more make a solar photovoltaic system with battery storage nearly economically viable after a 20-year period for commercial or school buildings that are not eligible for Alaska's Power Cost Equalization program.

14 SOLAR ENERGY↗
DOE OSTI2023

Rapid Cryogenic Electrical Characterization of Materials and Devices Using Gifford-McMahon Cryocoolers

Thin-film heterostructures are necessary building blocks for superconducting and phononic quantum computing devices. Many new generations of quantum hardware demand extensive materials research to optimize performances at cryogenic temperatures (below 10 K). Here, we demonstrate compact cryogenic measurement systems capable of reaching sub-10K temperatures in less than three hours with the ability to measure AC/DC resistance and dielectric properties of thin-film materials. Our platform utilizes Gifford-McMahon (GM) cryocoolers as effective tools for providing high throughput cooling-warming cycles. We successfully used the GM-based measurement systems to measure 1) the superconducting transition temperature for Nb thin films (T c ~7.8 K), and 2) the temperature dependence of the dielectric constant in SiO 2 thin films down to 10 K. The fast electrical characterization feedback will be critical in developing robust materials and components for cryogenic computing devices.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗