SEARCH · Search NASA

Results for “Applicability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Vulnerabilities in Artificial Intelligence and Machine Learning Applications and Data

Artificial intelligence (AI) applications driven by machine learning (ML) are transformational technologies within the international nuclear security regime. Advancements realized by AI—faster and improved data insights, more efficient and automated processes, reductions in human error—enable nuclear security applications such as behavior analysis for insider threat mitigation, source tracking of stolen nuclear material, and facial recognition software for physical protection. In addition to the advantages, however, there are also inherent vulnerabilities and threats associated with its use and risk mitigations must be built into any AI/ML-enabled systems. This work provides a background on AI and ML and different data types used in the field, including open-source intelligence information (OSINT) that is discoverable by AI tools and application data that are used by AI tools for decision-making and automation. Current and potential AI applications and vulnerabilities related to their use within the nuclear security regime are also discussed.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

DOE OSTI2022

Milestone Report: Co-Scheduling Applications on Current and Future Architectures

This report evaluates the viability and performance of co-scheduling scientific applications and workloads between CPUs and GPUs on current and future hardware architectures. This study was performed by collecting hardware independent and memory performance characteristics of 6 ECP mini-applications through Byfl and NSight Systems, by measuring the applications’ co-scheduled performance on current node architectures, and by gathering memory bandwidth utilization data with Intel Advisor and nvprof to begin reasoning about the feasibility of co-scheduling applications on future APU architectures.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Artificial Intelligence for Accelerating Nuclear Applications, Science, and Technology

Artificial intelligence (AI) and machine learning (ML) methods have had significant impacts in science and technology in recent years. These methods for generating models from datasets or logic-based algorithms that emulate aspects of human performance can similarly accelerate the fields of nuclear applications, science, and technology toward the IAEA goals of contributing to peace, health, and prosperity. In order to accomplish advances with AI in general and ML in particular across these fields, IAEA can play a significant role by establishing, hosting and curating centralised resources, including databases, adhering to FAIR (findable, accessible, interoperable and reusable) principles and Open Science best practices, providing stewardship of data sharing, supporting training efforts and development of relevant workforces, as well as enabling connections among the scientific, technology, mathematics, AI and ethics communities. Many areas can benefit from the use of AI in the realm of nuclear applications. In human health, these areas include clinical research, epidemiology, nutrition, medical imaging, radiotherapy and education of health professionals. AI-based tools are also being used to facilitate different clinical tasks in imaging, computer-assisted diagnosis in mammography and lung cancer screening programmes, and dose prediction in nuclear medicine procedures. ML methods in particular may also increase the efficiency and accuracy of the analysis of computerised tomography and dual-energy absorptiometry scans for body composition and bone analysis. The application of AI methods to nuclear and related technologies in food and agriculture can lead to significant advances and improved efficiency in the optimisation of agricultural production, food product development, management of supply chains, food safety and food authenticity control. In the water and environmental sector, AI can help inform policies to mitigate the world’s water problems. The application of AI techniques to hydrology and environmental sciences is expected to improve patterns identification and enable model predictions under a changing climate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Application of electron beam technology to decompose persistent emerging drinking water contaminants: poly- and perfluoroalkyl substances (PFAS) and 1,4 dioxane.

Fermi Research Alliance, LLC (FRA) operates Fermilab under contract with the U.S. Department of Energy and has patents on technologies and applications of a novel mobile electron beam accelerator. A high-power version of this mobile accelerator based on FRA-developed SRF technology is under development at Illinois Accelerator Research Center (IARC) and can enable several new applications that have significant commercial potential. One such application is the e-beam treatment of persistent emerging contaminants in drinking water. The contaminants of concern are poly- and perfluoroalklyl substances (PFAS) and 1,4-dioxine. Both PFAS and 1,4-D are highly resistant to degradation and are not effectively removed by conventional drinking water treatment systems. Existing technologies, such as granular activated carbon (GAC) filters and reverse osmosis (RO) systems do not decompose. The Center for Clean Water Technology (CCWT) at Stony Brook University (SBU) is in the process of identifying and testing effective technologies to remove PFAS and/or 1,4-D from drinking waters. se PFAS, but rather concentrate them either by adsorption (GAC) or membrane rejection (RO). The Center for Clean Water Technology (CCWT) at Stony Brook University (SBU) is in the process of identifying and testing effective technologies to remove PFAS and/or 1,4-D from drinking waters to demonstrate the full-scale application of novel water treatment technologies and is experienced in conducting research to understand treatment performance with a particular focus on 1,4-D and PFAS contamination.

43 PARTICLE ACCELERATORS↗

DOE OSTI2022

Regulatory Considerations for Nuclear Energy Applications of Digital Twin Technologies

Digital twins (DTs) in complex industrial and engineering applications have potential benefits that include increased operational efficiencies, enhanced safety and reliability, improved security engineering, reduced errors, faster information sharing, and better predictions. The interest in DT technologies continues to grow, and many of these advanced technologies are expected to experience rapid and wide industry adoption in the near future. Some of the potential application areas for DTs in the nuclear industry are design, licensing, plant construction, training simulators, predictive operations and maintenance, autonomous operation and control, failure and degradation prediction, physical protection modeling and simulation, and safety and reliability analyses. The Office of Nuclear Regulatory Research at the U.S. Nuclear Regulatory Commission (NRC) has initiated a future-focused research project to assess the regulatory viability of DTs for nuclear power plants and other NRC-regulated activities, such as fuel cycle facilities and operations. This report explores the potential impact of DT technologies in nuclear applications on NRC-regulated activities of interest. This report describes a nuclear DT system and its capabilities for nuclear power plant applications, followed by identification and discussion of some regulated activities that merit special consideration and present opportunities in implementing DT-enabling technologies and capabilities.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Optimizing Performance on Trinity Utilizing Machine Learning, Proxy Applications and Scheduling Priorities

The sheer number of nodes continues to increase in today’s supercomputers, the first half of Trinity alone contains more than 9400 compute nodes. Since the speed of today’s clusters are limited by the slowest nodes, it more important than ever to identify slow nodes, improve their performance if it can be done, and assure minimal usage of slower nodes during performance critical runs. This is an ongoing maintenance task that occurs on a regular basis and, therefore, it is important to minimize the impact upon its users by assessing and addressing slow performing nodes and mitigating their consequences while minimizing down time. These issues can be solved, in large part, through a systematic application of fast running hardware assessment tests, the application of Machine Learning, and making use of performance data to increase efficiency of large clusters. Proxy applications utilizing both MPI and OpenMP were developed to produce data as a substitute for long runtime applications to evaluate node performance. Machine learning is applied to identify underperforming nodes, and policies are being discussed to both minimize the impact of underperforming nodes and increase the efficiency of the system. In this paper, I will describe the process used to produce quickly performing proxy tests, consider various methods to isolate the outliers, and produce ordered lists for use in scheduling to accomplish this task.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

In-Situ Monitoring Assisted Large-Scale Additive Manufacturing of Mild Steel and 316L Alloys for Nuclear Application

The Advanced Materials and Manufacturing Technologies (AMMT) Program is aimed at developing cross-cutting technologies in support of a broad range of nuclear reactor parts, and to maintain U.S. leadership in materials and manufacturing technologies for nuclear energy applications. The overarching vision of the AMMT program is to accelerate the development, qualification, demonstration and deployment of advanced materials and manufacturing technologies to enable reliable and economical nuclear energy. One of its three goals is to target big challenges and game-changing technologies, to realize the mission and vision of AMMT program. Based on this context, this multi-year work package focuses on understanding the current state of large-scale additive manufacturing (AM) technology for the deposition of 316L stainless steel materials for final components and mild steel for use in nuclear manufacturing processes. The targeted AM modality is directed energy deposition (DED), capable of fabricating components on the size scale of meters including valves, pumps, impellers. etc. that are challenging or difficult to source, especially when developing new systems or replacing obsolete components. Accordingly, the current writeup aims at providing a baseline literature survey on structure-property relationships in mild steel and 316L alloys. Also, information on preliminary trials to date involving these two alloys show tremendous potential of printing parts having complex geometry and thin- walled structures, such as nuclear valve and Hot isostatic Press (HIP) can, using wire based (Wire Arc Additive Manufacturing and Hybrid Additive Manufacturing) as well as blown powder DED machines. All of this is aimed towards (i) demonstrating the ability to fabricate large components for pressure boundary applications relevant to the nuclear community and nuclear manufacturing technology, and (ii) understanding the effect of different manufacturing technology on AM can production and post HIPed material for nuclear applications. Another target of this writeup is to compile various in-situ monitoring tools that have been incorporated for different DED AM modalities, in order to understand process variability during the entire fabrication process. This can be correlated with processing-structure-property response surfaces and would add confidence around process quality verification and ultimately component certification for nuclear applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Historic Architectural Resource Survey of the Dosimetry Applications Research (DOSAR) Facility in the 7700 Area of the Oak Ridge National Laboratory

In May 2022, Cultural Resource Analysts, Inc., completed a historic architectural resource survey of buildings associated with the Dosimetry Applications Research Facility at the Oak Ridge National Laboratory. The laboratory is one of three Department of Energy facilities located on the Oak Ridge Reservation in Roane and Anderson Counties, Tennessee. The Dosimetry Applications Research Facility is located approximately 2 mi southeast of the main Oak Ridge National Laboratory campus. The survey included Buildings 7709, 7710, and 7712, which date to the 1960s. An additional DOSAR building (Building 7735) dates to the late 1980s and was not surveyed since it is outside the period of significance. The survey was conducted at the request of UT-Battelle, LLC, on behalf of the Department of Energy. As stipulated by the National Historic Preservation Act of 1966, as amended, the Department of Energy is required to identify any properties under its jurisdiction that are included in or eligible for inclusion in the National Register of Historic Places. In order to identify historic properties at the Oak Ridge National Laboratory, in 2017–2018 Cultural Resource Analysts, Inc., conducted a survey of the main campus as well as outlying facilities, publishing the findings in a 2018 report entitled Oak Ridge National Laboratory Historic Architectural Resource Survey. At the time of the 2017–2018 survey, buildings associated with the Dosimetry Applications Research Facility were not accessible for security reasons and the current report serves as an addendum to the 2018 report. In addition, the current survey incorporates information included in a documentation report on Building 7709 completed in 2019. The properties included in the current survey were also evaluated for their collective potential as a historic district. The identification of archaeological properties that are eligible for inclusion in the National Register of Historic Places is beyond the scope of this report. Cultural Resource Analysts, Inc., recommends that none of the buildings surveyed for the current report are individually eligible for listing in the National Register of Historic Places. However, the collective of buildings represents a facility that made notable contributions to the Oak Ridge National Laboratory’s scientific research endeavors from the 1960s to the 1980s, specifically in the field of Health Physics. The buildings and their associated features have also maintained their integrity of setting, materials, design, location, and association. Therefore, Cultural Resource Analysts, Inc., proposes the Dosimetry Applications Research Facility Historic District, which is recommended eligible for listing under Criterion A. The three buildings addressed in the current survey (Buildings 7709, 7710, and 7712) are recommended eligible as contributing resources of the historic district. The district boundary is scribed to incorporate the environs of these three facilities, as well as additional relevant features.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2023

Online Monitoring Applications Enabled by Phasor Measurement Units: Technical Assistance to the Power Sectors of Southeast Asia

In this report, an overview of several online applications enabled by PMU measurements is provided. Besides a brief technical background for each application, the report also discusses control room displays and alarming methodologies used by North American organizations, and applicable standards set by the North American Electric Reliability Corporation (NERC). The five applications discussed herein are inertia monitoring, linear state estimation, voltage stability monitoring, small-signal stability monitoring, and forced oscillation monitoring.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Quantum Computing for Energy-Related Applications

Growing interest in quantum computing and simulations have created opportunities for its deployment to improve processes pertaining to energy production, distribution, and consumption. While quantum computing is considered as a paradigm shift in our basic understanding of physical computation, effective implementation of quantum computing in energy applications also depends on progress and development in the dimensions of both quantum computing hardware and quantum computing algorithms. To fully address the status and future challenges of quantum information science (QIS) applied within the energy sector, in this presentation, we firstly summarize recent advancements on the applications of quantum computing to energy infrastructure and materials, complex energy system processes, advanced manufacturing, and energy system security. Then, we will demonstrate the results of quantum computing both on a simulator and a quantum device accessing from OLCF. Our first example is to use the variational quantum eigensolver (VQE) with a unitary coupled cluster with singles and doubles (UCCSD) ansatz to simulate a series of LixHyq molecules (q=-1, 0, +1). The obtained results showed that the quantum computing VQE-UCCSD is comparable to classical CCSD for small systems like LiH with respect to full configuration interaction (FCI). Targeting on CO2 capture application, our second example is to use VQE to quantify molecular vibrational energies and reaction pathways between CO2 and a simplified amine-based solvent model—NH3 to form H2NCOOH. This research showcases quantum computing applications in the study of CO2 capture reactions.

Duan, Yuhua↗

DOE OSTI2025

Smart Contracts for Power Grid Applications Using the Advanced DLT Cyber Grid Guard Testbed

In this study is presented two power system applications with distributed ledger technology (DLT) and smart contracts (SC) that were assessed in a Cyber-Grid-Guard System (CGGS) advanced testbed, with protective relays, power meters, communication devices, DLT devices, synchronized time source, clock displays and real time simulator. This CGGS testbed was set in the Advanced Protection Lab, 252 lab space of the Grid Research Integration and Deployment Center (GRID- C), at Oak Ridge National Laboratory. In power grids, customer-owned distributed energy resources (DERs) are more frequent than in the past, and the numbers of points of interconnection (POI) with customer-owned DERs have increased. Disruptive operation from DERs presents a risk to grid operations, and protective relays located at the POI are used to isolate out-of-tolerance or poorly behaving of DERs. Ensuring the integrity of data from the relays at the POI, and DLT could enhance the security of the power grids. The first application is a SC to define and control the allowable total power factor (TPF) of the DER (wind farm) output, and the terms of the SC are implemented using DLT with a CGGS for a customer-owned DER. The TPF SC was implemented by the CGGS using DLT. The experimental model was performed with a real-time simulator using a CGGS and relay in-the-loop. The data collected from the CGGS were used to execute the TPF SC. The TPF limits were between +0.9 and +1.0, and the breakers’ operation in the POI was controlled by the relay using the SC. The events were collected from the real-time simulator, CGGS, and SEL 700GT relay to validate a successful application of the TPF SC using DLT. The second application is a SC to measure and control the allowable voltage service limits (VSL) by the CGGS using DLT. The tests were performed by using a real-time simulator, CGGS and relay in-the-loop. The data was collected from the CGGS that executed the SC. The main constraints were defined based on ANSI C84.1 service voltage limits, and the operation of the breakers in the POI. The events were collected from the CGGS, and SEL 700GT relay to assess a successful operation of the VSL SC using DLT.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Workflows for Science: A comprehensive guide for ensemble workflow tools usage with applications on OLCF systems

The growing demand for robust computational and workflow environments for scientific applications and user communities at the Oak Ridge Leadership Computing Facility (OLCF) has prompted collaboration with ensemble tools development teams and facility users to produce this technical paper. We connect science applications to the RADICAL-Pilot (RP) workflow tool to execute ensemble instantiations using the Frontier supercomputer. The documented installation, usage, and execution demonstrates how RP streamlines scientific workflows at OLCF. We outline the specific steps OLCF users can follow to integrate this tool with their applications and advance their research. This document stands as a comprehensive guide to OLCF users of ensemble workflow tools with examples on real applications using the Frontier supercomputer.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Safety of Mobile Hydrogen and Fuel Cell Technology Applications: An Investigation by the Hydrogen Safety Panel

Safe practices in the production, storage, distribution, and use of hydrogen are essential for the widespread acceptance of hydrogen and fuel cell technologies. A significant safety incident could damage public perception of hydrogen and fuel cells. Recent incidents involving multi-cylinder hydrogen transport vehicles in the United States have brought attention to the potential impacts of mobile hydrogen storage and transportation. Road transportation of bulk gaseous hydrogen presents unique hazards that can be very different from those for stationary equipment, and new equipment developers may have less experience and expertise than seasoned gas providers. In response to the aforementioned incidents, and in support of hydrogen and fuel cell activities in California specifically, the Hydrogen Safety Panel (HSP) has investigated the safety of mobile hydrogen and fuel cell applications (mobile auxiliary/emergency fuel cell power units, mobile fuelers, multi-cylinder transport vehicles, unmanned aircraft power supplies, and mobile hydrogen generators). The HSP examined the applications, requirements, and performance of mobile applications that are being used extensively outside of California to understand how safety considerations are applied. This report discusses the results of the HSP’s evaluation of hydrogen and fuel cell mobile applications along with recommendations to address relevant safety issues.

08 HYDROGEN↗

DOE OSTI2025

A Data Science and Machine Learning Platform Supporting Large Particle Accelerator Control and Diagnostics Applications Final Report: SBIR Initial Phase II DE-SC0022583

The Machine Learning Data Platform (MLDP) is a product providing full-stack support for data science, Machine Learning, and Artificial Intelligence (ML/AI) applications at particle accelerator and large experimental physics facilities. It supports ML/AI applications from front-end, high-speed acquisition of heterogeneous, time-series data, through data archiving and management, to back-end analysis. The MLDP embodies a “data-science ready” platform for data analysis and ML/AI applications in diagnosis, modelling, control, and optimization of these facilities. It provides data scientists and applications a consistent, datacentric interface to archive data standardizing implementation and deployment of ML/AI algorithms to different operations configurations within the same facility, or between facilities. Being an open-source, public-domain project, the MLDP is intended for broadest possible impact by increasing accessibility and minimizing the required expertise for installation and operation. The MLDP can also be deployed at user facilities for experimental data collection, archiving, and analysis. It is capable of acquisition and archiving of heterogeneous data from experimental equipment (e.g., images, arrays, structures, etc.) along with system hardware configurations (e.g., scalars, tables), control system process variables, and any metadata required for provenance. Thus, the MLDP can manage experimental data through its entire lifecycle, from acquisition and archiving, through analysis and investigation, to release and final publication.

43 PARTICLE ACCELERATORS↗

DOE OSTI2026

Sand-Based Thermal Storage for Building Heating Applications: A District Energy Case Study

Buildings account for 40% of global energy consumption and contribute to 30% of global carbon emissions. As energy from renewable sources increases in availability and building designers push for increased electrification, thermal energy storage (TES) systems will play a crucial role in extending the usable time horizon of renewable energy. While water, molten salt, and phase change materials are typically used for building TES heating applications, silica-sand has emerged as an alternative medium for concentrated solar power applications due to its low cost, wide availability, and comparable system efficiency. This paper proposes a new silica-sand particle-based TES system for building heating applications. In this work, a novel steam plant for district heating applications is first designed to utilize silica-sand TES, which can be used for different district energy systems. To demonstrate the silica-sand TES plant performance, the design is modelled in Modelica based on a case study on the University of Colorado Boulder’s campus. The simulation results show that the sand TES plant is more costly to operate than a gas-boiler based plant due to the low cost of natural gas, while the site EUI and carbon intensity can be improved. This novel system shows initial promise as a low-carbon alternative to conventional natural gas steam boilers but will require further modelling and follow-up research to improve its energy efficiency. An eventual rise in natural gas prices, and reduction of electricity prices, could improve the economic viability of this system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Development of a web-based screening tool for ground source heat pump applications

Ground source heat pump (GSHP) technology has great potential to help the nation meet its energy and decarbonization goals, but several barriers hinder the wide application of GSHP. Important barriers include the lack of a coherent toolset for analyzing the technical feasibility and economic viability of the GSHP application. The current design and analysis methods are ineffective and require significant expertise to apply. Although building energy modeling is increasingly important in designing buildings, the tools for GSHP modeling and simulation are lacking. A web-based free-to-use tool is being developed for quick techno-economic analysis of GSHP applications in nearly any building in the United States. This tool is enabled by improvements in the calculation methodology to allow rapid sizing of borehole configurations that provide significant cost savings. The screening tool currently uses US Department of Energy (DOE) prototype building models and an extended g-function library to size ground heat exchangers and simulate the performance of GSHP systems. The team is integrating with DOE's Oak Ridge National Laboratory's AutoBEM program to automatically create a building model based on user inputs. This paper introduces the structure, components, features, and results of the web-based screening tool for GSHP applications. Future directions for further developing the tool are also discussed.

Liu, Xiaobing↗

DOE OSTI2025

Toward a persistent event-streaming system for high-performance computing applications

High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.

HPC↗