Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis ready data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A Business Case Evaluation of Gas Switching Reforming (GSR) Technology: A Promising Technology for Natural Gas Reforming with Integrated CO2 Capture

Hydrogen is essential in the transition to sustainable energy, and developing low-carbon production methods is a key research focus. Traditional steam methane reforming (SMR) dominates the hydrogen industry but contributes substantially to CO2 emissions. In response, Gas Switching Reforming (GSR) has emerged as a novel process that integrates carbon capture and utilizes process heat more efficiently. Unlike other reforming methods, GSR consolidates oxidation and reduction reactions within a single reactor, which minimizes external energy inputs and simplifies scaling. Like conventional steam methane reforming (SMR), GSR can be integrated with water-gas shift and pressure swing adsorption units for pure hydrogen production. This work presents a comprehensive business case analysis of GSR technology based on experimental results in Technology Readiness Level 3, Life Cycle Assessment (LCA) and Techno-Economic (TEA) evaluation incorporating ASPEN Plus process modeling considering different configurations and energy scenarios. The TEA incorporates data from kinetic experiments from various catalysts to evaluate the GSR process under various conditions. The goal of this work is to evaluate GSR’s potential to serve as a low-carbon alternative to SMR, focusing on global warming potential and additional impact categories to evaluate a wide spectrum of environmental impacts. Comparative assessments were conducted with SMR, chemical loop reforming (CLR), and proton exchange membrane (PEM) electrolysis to explore trade-offs across environmental metrics. The environmental impact assessment of this work encompasses the entire hydrogen production lifecycle from raw material extraction to plant decommissioning, using a cradle-to-gate boundary. Preliminary findings highlight that GSR, when integrated with low-carbon energy sources, could significantly reduce environmental impacts, making it a promising candidate for low-carbon hydrogen infrastructure. The insights from this business case evaluation aim to guide industry in scale-up and commercialization of this promising clean energy technology.

03 NATURAL GAS↗

REPORT OF ON-SITE INSPECTION WORKSHOP-16

The central issue addressed by this workshop was the task of making the on-site inspection (OSI) part of the Comprehensive Nuclear-Test-Ban Treaty verification system operationally ready at entry into force of the Treaty. It is recognized, and this was emphasized by the 2008 OSI Integrated Field Exercise (IFE), that it is not possible to develop every part of the OSI regime simultaneously. Therefore, it is necessary to prioritize the approach to OSI readiness. The reviews of the IFE have pointed to many elements of OSI readiness that still need development. The objective of this workshop was to provide priorities for the path forward for Working Group B to consider. Several critical areas have been identified that are related to the development of OSI readiness: (1) Technology development: Priorities are radionuclide and noble gas sampling and analysis, visual observation, multispectral/infrared imaging methods, active seismic methods and the recognition of the importance of signatures. (2) Organizational development: Priorities are health and safety, the Operations Support Centre, the Equipment Storage and Maintenance Facility, information technology data flow and communications. (3) Resources: The expertise to develop key parts of the OSI regime is not available within the current OSI Division staff. To develop these aspects of the regime will require more staff or supplements to the staff with cost-free experts or other means. Aspects of the system that could benefit from more staff include radionuclide and noble gas detection methods, data flow and communications, visual observation, multispectral/infrared methods and health and safety. As the path forward, participants of this workshop recognized a need to optimize the development of OSI priorities. The outcome of this workshop is to suggest for consideration an operational approach to OSI readiness that utilizes results of an evaluation of the relative effectiveness of OSI elements versus their relative maturity. By integrating such an assessment with considerations of integrated operational capabilities and the anticipated level of inspection team self-sufficiency and measurable milestone criteria, a set of priorities for OSI development can be developed. Once these priorities have been established, the Policy Making Organs can decide upon the milestones, strategic plan and action plan to serve as guidance for implementation by the Provisional Technical Secretariat. The suggested operational approach is as follows: (1) Assess the relative effectiveness (importance) of OSI elements versus their relative maturity; (2) Determine the anticipated level of self-sufficiency; (3) Define measurable milestone criteria; and (4) Result: Milestones for OSI readiness.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Considerations for Distributed Edge Data Centers and Use of Building Loads to Support Large Interconnections

The rapid expansion of artificial intelligence (AI) and machine learning is driving unprecedented electricity demand from data centers. It is predicted that by 2030, 90% of AI workloads will be inference-based, requiring interconnection of multiple low-latency edge data centers (<20 MW) sited closer to end users - often on already constrained distribution feeders. Although individually small, these loads can aggregate to large loads per feeder, straining infrastructure, creating multi-year interconnection delays, and driving up customer costs. This paper proposes a data center-focused grid-integration framework that combines feeder hosting capacity analysis with building energy efficiency, building load flexibility, and waste heat reuse to expand effective feeder and substation headroom. Such approaches can reduce interconnection delays, lower costs for ratepayers, and accelerate AI-ready infrastructure deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Quantitative Evaluation of MD/HD Vehicle Electrification using Statistical Data

This paper presents a wide-ranging analysis of Class 3-8 commercial vehicle electrification by means of developing a framework tool which uses a quantitative method of estimating electric vehicle energy consumption and appropriate charging considerations. The Fleet DNA composite statistics on real-world driving behavior is used to evaluate feasible or market-ready battery electric vehicle (BEV) technologies in medium- and heavy-duty (MD/HD) applications. In the paper, ten representative Class 3-8 commercial vehicle electrifications have been evaluated as a function of various service coverages, including applications in port drayage tractors, refuse trucks, delivery trucks, buses, and bucket trucks. The results indicate significant energy savings and fuel cost savings across all MD/HD vehicle electrifications. The majority of MD BEVs, with the exception of Class 3 bucket trucks, achieve better than a 5-year payback with 50–75% service coverage. For HD BEVs, with the exception of the Class 8 port drayage tractors, the 90% service coverage results in a 10-year or longer payback time, while the 50% service coverage yields a 7–8 year payback. Class 8 port drayage tractors should achieve payback in no more than a 3.5 years with 50–75% service coverage. Thus, the analysis indicates a highly feasible potential for Class 3-6 MD vehicles to be electrified, and feasible opportunities for electrification in Class 7-8 HD short-distance applications.

33 ADVANCED PROPULSION SYSTEMS↗

A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Verification and Validation of CFD Simulations involving Twin Rectangular Jets using Steady RANS in Star-CCM+

Analyses such as component design and safety analysis can be conducted through careful application of computational fluid dynamics (CFD) codes. Before these codes can be considered ready for specific analysis, benchmarking (validation) against applicable datasets is needed. The twin jet water facility (TJWF) developed originally at the University of Tennessee, Knoxville has been purposed for aiding in this type of work. The TJWF allows for large data sets to be created using state of the art non-invasive measurement techniques within a mostly transparent testing volume. Utilizing velocity data collected in the TJWF by Wang et. al., the Star-CCM+ code was benchmarked a using steady Reynolds averaged Navier Stokes (RANS) framework for a combining two jet case. Careful efforts to properly conduct verification of the numerical work was undertaken with a sample reported in this summary. The computational results were validated against the experimental work and found to be within acceptable limits. The parameters of interest were the merging and combining points (MP and CP) of the twin jets, and the velocity profiles at increasing heights after injection. Fig.1 provides a graphical depiction of the twin jets combining within a free shear volume with key geometric factors included. The MP and velocity profiles were predicted with reasonable agreement. Whereas, the combining point of the twin jets was found to be over-predicted by {approx}24% difference. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

End-Use Savings Shapes Measure Documentation: LED Lighting

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock and ComStock models over the past three years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility measure applied. It results in a timeseries profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each timestep. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on a single end-use savings shape measure - LED lighting. The LED lighting measure replaces interior lights with LEDs where applicable. The measure resulted in 1.25 TBtu energy savings across the building stock, with the majority of savings occurring in retail and warehouse buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dataset for report: Non-Technical Barriers to Geothermal Development in California and Nevada

In California and Nevada, geothermal projects are subject to non-technical barriers, which may create development delays leading to higher project costs and risks and decreased competitiveness with other electricity generation technologies. These non-technical barriers may include federal and state permits, authorizations, environmental reviews, and other regulatory requirements that are applicable throughout different phases of geothermal project development. The 2022 National Renewable Energy Laboratory (NREL) report, "Non-Technical Barriers to Geothermal Development in California and Nevada" presents findings of a study on non-technical barriers that may influence geothermal project development. The set of data resources relied upon for the report includes: 1) interviews conducted with relevant geothermal stakeholders including regulators and project developers, 2) federal and state environmental review documents developed for specific projects, 3) a techno-economic analysis conducted using the NREL Annual Technology Baseline (ATB) framework, and 4) an analysis of the impacts of site-specific land access and permitting considerations on project development readiness conducted using the Geothermal Resource Portfolio Optimization and Reporting Technique (GeoRePORT) Socioeconomic Assessment Tool (SEAT).

15 GEOTHERMAL ENERGY↗

End-Use Savings Shapes Measure Documentation: Boiler Replacement with Air-Source Heat Pump Boiler and Electric Boiler Backup

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock TM and ComStock TM models over the past three years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each timestep. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual sub hourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on a single end-use savings shape measure—boiler replacement by air-source heat pump boiler. This measure replaces space heating natural gas boilers by air-source heat pump boilers when applicable and helps quantify the decarbonization as well as the energy savings potential from the replacement. The measure resulted higher savings in natural gas consumption compared to the increase in electricity consumption, with a ratio of 2.9. The total natural gas energy consumption was reduced by 20%, whereas the total electricity consumption was increased by 2.5%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

End-Use Savings Shapes Measure Documentation: Boiler Replacement with Air-Source Heat Pump Boiler and Natural Gas Boiler Backup

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock (™) and ComStock (™) models over the past three years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each timestep. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on a single end-use savings shape measure - boiler replacement with air-source heat pump boiler with natural gas boiler backup. This measure replaces natural gas boilers for HVAC application by air-source heat pump boilers when applicable and use natural gas boiler backup when the heat pump boiler could not operate due to outdoor air conditions which are below its cutoff temperature. This measure helps to quantify the decarbonization as well as the energy savings potential from the replacement. The measure resulted higher savings in natural gas consumption compared to the increase in electricity consumption, with a ratio of 3. The total natural gas energy consumption was reduced by 41%, whereas the total electricity consumption was increased by 5.3%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

End-Use Savings Shapes Measure Documentation: Variable Refrigerant Flow with Heat Recovery and Dedicated Outdoor Air System

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock™ and ComStock™ models over the past 3 years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on a single heating, ventilation, and air-conditioning (HVAC) end-use savings shape measure - a variable refrigerant flow with heat recovery (VRF HR) heating and cooling system coupled with a dedicated outdoor air system (DOAS) for ventilation. This measure replaces existing multi-zone variable air volume (VAV) systems or single-zone rooftop units (RTU) with a VRF HR system coupled with a DOAS that includes an energy/heat recovery ventilator (E/HRV). The measure covers 53% of exisiting building stock's floor area and is not applicable to HVAC system types using district heating or cooling or buildings/spaces that include high-ventilation spaces such as kitchens where the amount of exhaust air is large. A DOAS with E/HRV is used to provide required outdoor ventilation air to spaces since ventilation air is generally not supplied by a VRF HR system. An exhaust air energy recovery ventilator (ERV ) with sensible and latent heat exchange is added to humid climate zones while a heat recovery ventilator (HRV ) with sensible only exchange is added to drier climate zones. The ERV is modeled as a fixed membrane plate counterflow heat exchanger, while the HRV is modeled as a sensible-only fixed aluminum plate counterflow heat exchanger. Both systems include a bypass (for temperature control and economizer lockout) and minimum exhaust temperature control for frost prevention.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

End-Use Savings Shapes Measure Documentation: Economizers

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock™ and ComStock™ models over the past 3 years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

End-Use Savings Shapes Upgrade Package Documentation: Wall and Roof Insulation and New Windows

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock and ComStock models over the past 3 years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) upgrade measures, or upgrades. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility upgrade applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on an upgrade package of three end-use savings shapes upgrades - Window Replacement, Exterior Wall Insulation, and Roof Insulation, which we will refer to collectively as the "High Efficiency Envelope" package. More details on the individual upgrades can be found on the ComStock Measures Documentation page. An upgrade package applies two or more EUSS upgrades to a single building model simulation. Since ComStock is a bottom-up physics-based model, an upgrade package will go beyond aggregating or summing the individual upgrade results and produce novel results by simulating interactions between the upgrades. For example, pairing an envelope upgrade with an electrification upgrade would likely result in higher savings results than the sum of these upgrades individually, and the size of the heating, ventilating, and air conditioning (HVAC) equipment may be reduced if the envelope upgrade reduces the loads significantly.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

End-Use Savings Shapes Upgrade Package Documentation: LED Lighting, HP-RTU and ASHP-Boiler

Building on the successfully completed effort to calibrate and validate the U.S. Department of Energy's ResStock and ComStock models over the past 3 years, the objective of this work is to produce national data sets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of analysis questions. The goal of this work is to develop energy efficiency, electrification, and demand flexibility end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) upgrade measures, or upgrades. "Measures" refers to energy efficiency variables that can be applied to buildings during modeling. An end-use savings shape is the difference in energy consumption between a baseline building and a building with an energy efficiency, electrification, or demand flexibility upgrade applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. This documentation focuses on an upgrade package of three end-use savings shapes upgrades - Light Emitting Diode (LED) Lighting, Heat Pump Rooftop Unit (RTU) (HP-RTU), and Air-Source Heat Pump (ASHP) Boiler, which we will refer to collectively as the "Interior Lighting and Heat Pump" package. More details on the individual upgrades can be found on the ComStock Measures Documentation page. An upgrade package applies two or more EUSS upgrades to a single building model simulation. Since ComStock is a bottom-up physics-based model, an upgrade package will go beyond aggregating or summing the individual upgrade results and produce novel results by simulating interactions between the upgrades. For example, pairing an envelope upgrade with an electrification upgrade would likely result in higher savings results than the sum of these upgrades individually, and the size of the heating, ventilating, and air conditioning (HVAC) equipment may be reduced if the envelope upgrade reduces the loads significantly.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Leading-order electroweak corrections to the Drell-Yan process in the CMS experiment at LHC

The leading part of electroweak radiative corrections to the Drell-Yan process in the CMS (compact muon solenoid detector) experiment at LHC were calculated. Analytic and numerical tests indicate that the results are independent of all nonphysical parameters. A numerical analysis of radiative effects was performed by using the FORTRAN code READY with allowance for experimental constraints at the CMS detector. The results presented for the relative correction to the fully differential cross section for the Drell-Yan process over the entire kinematical region of the CMS detector would hopefully be helpful in handling experimental data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fission gas bubble identification using MATLAB's image processing toolbox

Automated image processing routines have the potential to aid in the fuel performance evaluation process by eliminating bias in human judgment that may vary from person-to-person or sample-to-sample. This study presents several MATLAB based image analysis routines designed for fission gas void identification in post-irradiation examination of uranium molybdenum (U–Mo) monolithic-type plate fuels. Frequency domain filtration, enlisted as a pre-processing technique, can eliminate artifacts from the image without compromising the critical features of interest. This process is coupled with a bilateral filter, an edge-preserving noise removal technique aimed at preparing the image for optimal segmentation. Adaptive thresholding proved to be the most consistent gray-level feature segmentation technique for U–Mo fuel microstructures. The Sauvola adaptive threshold technique segments the image based on histogram weighting factors in stable contrast regions and local statistics in variable contrast regions. Once all processing is complete, the algorithm outputs the total fission gas void count, the mean void size, and the average porosity. The final results demonstrate an ability to extract fission gas void morphological data faster, more consistently, and at least as accurately as manual segmentation methods. - Highlights: •Automated image processing can aid in the fuel qualification process. •Routines are developed to characterize fission gas bubbles in irradiated U–Mo fuel. •Frequency domain filtration effectively eliminates FIB curtaining artifacts. •Adaptive thresholding proved to be the most accurate segmentation method. •The techniques established are ready to be applied to large scale data extraction testing.

36 MATERIALS SCIENCE↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗