Search NASA⌕ Search

SEARCH · Search NASA

Results for “Persistant”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Life cycles of persistent anomalies. II - The development of persistent negative height anomalies over the North Pacific Ocean

Consideration is given to the potential sources for the development of cases defined by strong and persistent negative height anomalies over the central North Pacific. The analyses of Dole (1986) are extended by providing a more complete synoptic description of the developments and additional diagnostic analysis to identify dynamical mechanisms responsible for the developments. The synoptic characteristics of the developments are reviewed and the barotropic and baroclinic processes of the developments are analyzed. The reproducibility and representativeness of the results are examined. The observed characteristics suggest that the large-scale flow anomalies develop as a result of an instability of three-dimensional wintertime mean flow.

Dole, Randall M.↗
NASA NTRS1991

Organizing and Typing Persistent Objects Within an Object-Oriented Framework

Conventional operating systems provide little or no direct support for the services required for an efficient persistent object system implementation. We have built a persistent object scheme using a customization and extension of an object-oriented operating system called Choices. Choices includes a framework for the storage of persistent data that is suited to the construction of both conventional file system and persistent object system. In this paper we describe three areas in which persistent object support differs from file system support: storage organization, storage management, and typing. Persistent object systems must support various sizes of objects efficiently. Customizable containers, which are themselves persistent objects and can be nested, support a wide range of object sizes in Choices. Collections of persistent objects that are accessed as an aggregate and collections of light-weight persistent objects can be clustered in containers that are nested within containers for larger objects. Automated garbage collection schemes are added to storage management and have a major impact on persistent object applications. The Choices persistent object store provides extensible sets of persistent object types. The store contains not only the data for persistent objects but also the names of the classes to which they belong and the code for the operation of the classes. Besides presenting persistent object storage organization, storage management, and typing, this paper discusses how persistent objects are named and used within the Choices persistent data/file system framework.

Madany, Peter W.↗
NASA NTRSDate not supplied

Near-term Persistent Platform Orbital Testbed: Three Candidate Architecture Options

On-orbit Servicing, Assembly, and Manufacturing (OSAM) will revolutionize the space industry by transforming the concept of operations of space systems and enabling new, radically different system implementations. These new implementations will benefit from a novel persistent asset design paradigm which focuses on evolvable designs that are tailored to the operational environment, not the launch environment. In addition, the ability to launch sub-systems independently enable future persistent assets to economically expand in capability and size, achieving cost effective and productive operations lasting for decades like terrestrial observatories. With few exceptions (International Space Station, Hubble Space Telescope, Mission Extension Vehicle customers), current space systems are not visited once they are operational. Leveraging emerging low cost commercial launch provides the ability to repeatedly and routinely revisit space systems. Thus, revolutionary new approaches for space system design are possible, creating completely new opportunities for small businesses and accelerating the growth of already established space industries. To usher in the revolutionary new operational paradigm, two things are needed. First, to build confidence in the technology and new paradigm, there must be a leading example, a bellwether persistent asset, that demonstrates the reliability and maturity of the new persistent asset paradigm (where repeated visits are common). Second, in order to rapidly advance and validate OSAM capabilities, an efficient means is required to conduct tests in the space environment. A persistent platform testbed satisfies both these needs. The space environment exhibits a plethora of characteristics that are difficult and costly to accurately simulate for a full system in a terrestrial laboratory, such as near zero gravity, a wide range of ionizing radiation types, atomic oxygen, and micro-meteoroids and space debris traveling at high velocity. In addition, since persistent assets range in mass from a few grams to several metric tons, it is difficult to accurately simulate interactions between these systems and visiting vehicles (that also exhibit a wide range of varying masses and capabilities). These interactions include the transmission of forces and/or exchanging mass (in the form of instruments, fuel, robotic assets, etc.). Thus, a rapid, versatile and cost efficient in-space testing capability that includes a persistent test platform and a surrounding in-space test zone is needed to mature technologies through experimentation. The testbed can provide common services, such as: power, thermal control, vibration isolation, data transmission between experiments and terrestrial experimenters, station-keeping, pointing, and robotic agents that can be leveraged by customer experiments. The onboard robotic agents can be used to provide payload handling services, such as: assembly, change out or upgrade, relocation, connecting/disconnecting utilities, inspection, repair or servicing, etc. Since the persistent platform cost will be amortized over many hosted payloads, its services can eventually be offered at a price much lower than if one were to design a unique and dedicated spacecraft and mission for those few experiments. The key to achieving an effective testbed is providing efficient cost effective access and infrastructure to a variety of commercial, academic and government customers coupled with extensibility, in the capability of an individual persistent platform test bed or replication of the test bed in a different operational regime. Three potential options for implementing a test bed were developed and evaluated in this study.

Persistent Platform↗
NASA NTRSDate not supplied

Near-term Persistent Platform Orbital Testbed: Three Candidate Architecture Options

On-orbit Servicing, Assembly, and Manufacturing (OSAM) will revolutionize the space industry by transforming the concept of operations of space systems and enabling new, radically different system implementations. These new implementations will benefit from a novel persistent asset design paradigm which focuses on evolvable designs that are tailored to the operational environment, not the launch environment. In addition, the ability to launch sub-systems independently enable future persistent assets to economically expand in capability and size, achieving cost effective and productive operations lasting for decades like terrestrial observatories. With few exceptions (International Space Station, Hubble Space Telescope, Mission Extension Vehicle customers), current space systems are not visited once they are operational. Leveraging emerging low cost commercial launch provides the ability to repeatedly and routinely revisit space systems. Thus, revolutionary new approaches for space system design are possible, creating completely new opportunities for small businesses and accelerating the growth of already established space industries. To usher in the revolutionary new operational paradigm, two things are needed. First, to build confidence in the technology and new paradigm, there must be a leading example, a bellwether persistent asset, that demonstrates the reliability and maturity of the new persistent asset paradigm (where repeated visits are common). Second, in order to rapidly advance and validate OSAM capabilities, an efficient means is required to conduct tests in the space environment. A persistent platform testbed satisfies both these needs. The space environment exhibits a plethora of characteristics that are difficult and costly to accurately simulate for a full system in a terrestrial laboratory, such as near zero gravity, a wide range of ionizing radiation types, atomic oxygen, and micro-meteoroids and space debris traveling at high velocity. In addition, since persistent assets range in mass from a few grams to several metric tons, it is difficult to accurately simulate interactions between these systems and visiting vehicles (that also exhibit a wide range of varying masses and capabilities). These interactions include the transmission of forces and/or exchanging mass (in the form of instruments, fuel, robotic assets, etc.). Thus, a rapid, versatile and cost efficient in-space testing capability that includes a persistent test platform and a surrounding in-space test zone is needed to mature technologies through experimentation. The testbed can provide common services, such as: power, thermal control, vibration isolation, data transmission between experiments and terrestrial experimenters, station-keeping, pointing, and robotic agents that can be leveraged by customer experiments. The onboard robotic agents can be used to provide payload handling services, such as: assembly, change out or upgrade, relocation, connecting/disconnecting utilities, inspection, repair or servicing, etc. Since the persistent platform cost will be amortized over many hosted payloads, its services can eventually be offered at a price much lower than if one were to design a unique and dedicated spacecraft and mission for those few experiments. The key to achieving an effective testbed is providing efficient cost effective access and infrastructure to a variety of commercial, academic and government customers coupled with extensibility, in the capability of an individual persistent platform test bed or replication of the test bed in a different operational regime. Three potential options for implementing a test bed were developed and evaluated in this study.

Persistent Platform↗
NASA NTRS1999

Persistence of the Lower Stratospheric Polar Vortices

The persistence of the Arctic and Antarctic lower stratospheric vortices is examined over the period 1958 to 1998. Three different vortex-following diagnostics (two using potential vorticity and one based solely on the zonal winds) are compared, and shown to give very similar results for the break up date. The variability in the timing of the breakup of each vortex is qualitatively the same: there are large interannual variations together with smaller decadal-scale variations and there is a significant increase in the persistence since the mid-1980s (all variations are larger for the Arctic vortex). Also, in both hemispheres there is a high correlation between the persistence and the strength and coldness of the spring vortex, with all quantities having the same interannual and decadal variability. However, there is no such correlation between the persistence and the characteristics of the mid-winter vortex. In the northern hemisphere there is also a high correlation between the vortex persistence and the upper tropospheric/lower stratospheric eddy heat flux averaged over the two months prior to the breakup. This indicates that the variability in the wave activity entering the stratosphere over late-winter to early-spring plays a key role in the variability of the vortex persistence (and spring polar temperatures) on both interannual and decadal time scales. However, the decadal variation in the Arctic vortex coldness and persistence for the 1990's falls outside the range of natural variability, while this is not the case for the eddy heat flux. This suggests that the recent increase in vortex persistence is not due solely to changes in the wave activity entering the stratosphere.

Waugh, Darryn W.↗
NASA NTRS2019

Persistent Assets in Zero-G and on Planetary Surfaces: Enabled by Modular Technology and Robotic Operations

Space operations are on the cusp of a revolutionary new operational paradigm that leverages modular systems and recurring robotic visits to “Persistent Assets” enabling asset maintenance, repair, and enhancement. A “Persistent Asset” is defined here as any zero-g or planetary surface system that benefits from in-space assembly (ISA) or multiple visits for servicing, repairs, and upgrades. This term is an extension of the term “Persistent Platform” used by Ms. Pam Melroy at the Defense Advanced Research Projects Agency to describe the vision of the Agency for a geosynchronous Earth orbiting platform. In this paper, the term “Persistent Asset” is introduced to encompass not only zero-g systems; such as telecommunication platforms, Earth observing science platform, Department of Defense platforms, and scientific telescope systems, but also planetary surface systems that support missions such as human outposts, science stations, and in-situ resource utilization systems. In contrast to the current state of the art, where space systems are typically launched as a single unit and operated without any further physical intervention after launch; future systems will be maintained, enhanced and reconfigured in-situ as new technology becomes available or mission needs change. Visits to the persistent asset can be regularly scheduled or dictated by funding constraints enabling a pay-as-you-go approach, which is largely independent of time-constraints and able to exploit launches of opportunity. In this paper, historical in-space assembly activities which relied heavily on astronaut extra-vehicular activity will be reviewed as well as early robotic assembly activities. These approaches will be contrasted with emerging modular approaches supporting realization of a new Persistent Asset operational paradigm. The paper will define attributes of the Persistent Asset paradigm and illustrate advantages by applying the paradigm to two relevant applications: 1) a large space telescope backing structure and 2) the backbone structure for a solar electric transport vehicle. Finally, recently developed unique Persistent Asset elements (modules, and interface approaches) will be described.

Doggett, William R.↗
NASA NTRS2018

Persistent Assets in Zero-G and on Planetary Surfaces: Enabled by Modular Technology and Robotic Operations

Space operations are on the cusp of a revolutionary new operational paradigm that leverages modular systems and recurring robotic visits to “Persistent Assets” enabling asset maintenance, repair, and enhancement. A “Persistent Asset” is defined here as any zero-g or planetary surface system that benefits from in-space assembly (ISA) or multiple visits for servicing, repairs, and upgrades. This term is an extension of the term “Persistent Platform” used by Ms. Pam Melroy at the Defense Advanced Research Projects Agency to describe the vision of the Agency for a geosynchronous Earth orbiting platform. In this paper, the term “Persistent Asset” is introduced to encompass not only zero-g systems; such as telecommunication platforms, Earth observing science platform, Department of Defense platforms, and scientific telescope systems, but also planetary surface systems that support missions such as human outposts, science stations, and in-situ resource utilization systems. In contrast to the current state of the art, where space systems are typically launched as a single unit and operated without any further physical intervention after launch; future systems will be maintained, enhanced and reconfigured in-situ as new technology becomes available or mission needs change. Visits to the persistent asset can be regularly scheduled or dictated by funding constraints enabling a pay-as-you-go approach, which is largely independent of time-constraints and able to exploit launches of opportunity. In this paper, historical in-space assembly activities which relied heavily on astronaut extra-vehicular activity will be reviewed as well as early robotic assembly activities. These approaches will be contrasted with emerging modular approaches supporting realization of a new Persistent Asset operational paradigm. The paper will define attributes of the Persistent Asset paradigm and illustrate advantages by applying the paradigm to two relevant applications: 1) a large space telescope backing structure and 2) the backbone structure for a solar electric transport vehicle. Finally, recently developed unique Persistent Asset elements (modules, and interface approaches) will be described.

William R Doggett↗
DOE OSTI2026

Persistence and potential of soil organic carbon in nature‐based climate solutions: A review of managed disturbances

Societal Impact Statement Implementing nature-based climate solutions is important for mitigating climate change, which is a global issue, but requires local adjustments in management practices. Using the association between soil carbon and minerals as a proxy for carbon persistence, we evaluated the effect of different management regimes on soil carbon sequestration and loss. We identified areas where management practices that increase carbon inputs should be prioritized and areas where management should focus on avoiding severe disturbances. Using this storage-potential-and-persistence framework to identify how to increase or maintain soil organic carbon storage locally will increase the effectiveness of nature-based climate solutions globally. Summary Increasing soil organic carbon storage could reduce the pace of climate change, but the longevity of this nature-based climate solution depends on the persistence of carbon in soils, not just the input rates into soils. We apply a framework for considering how soil carbon persistence—namely, via the association with minerals—sheds light on soil carbon sequestration. We review how management of disturbances, such as prescribed burning, forestry, and grazing, can change soil carbon storage, persistence, and potential. Past work demonstrated that management of disturbances can sequester soil carbon, but it remains unclear how the potential stabilization of that accrual and vulnerability to loss varies across disturbance types and geographies. We found that there is substantial geographical heterogeneity in the overlap among estimates of carbon accrual, disturbance occurrence, and potential stabilization: Fire-prone grasslands and intensively grazed rangelands occur in areas estimated to have high potential to store mineral-associated organic carbon, and studies also find that adjusted fire and grazing can promote mineral-associated organic carbon. Plantation forestry and burned area span large regions where particulate organic matter is the dominant form, and studies find that particulate organic carbon is disproportionately lost following intense wildfires and forest harvests. Thus, areas with high mineral-associated organic carbon deficits should be prioritized for practices that increase carbon inputs; whereas areas with high proportions of particulate organic carbon should be prioritized for practices that help to avoid severe disturbances. Taken together, the distribution of and changes in persistence mechanisms shed light on the durability of nature-based climate solutions.

fire↗
NASA NTRS1997

Providing the Persistent Data Storage in a Software Engineering Environment Using Java/COBRA and a DBMS

An investigation was undertaken to build the software foundation for the WHERE (Web-based Hyper-text Environment for Requirements Engineering) project. The TCM (Toolkit for Conceptual Modeling) was chosen as the foundation software for the WHERE project which aims to provide an environment for facilitating collaboration among geographically distributed people involved in the Requirements Engineering process. The TCM is a collection of diagram and table editors and has been implemented in the C++ programming language. The C++ implementation of the TCM was translated into Java in order to allow the editors to be used for building various functionality of the WHERE project; the WHERE project intends to use the Web as its communication back- bone. One of the limitations of the translated software (TcmJava), which militated against its use in the WHERE project, was persistent data management mechanisms which it inherited from the original TCM; it was designed to be used in standalone applications. Before TcmJava editors could be used as a part of the multi-user, geographically distributed applications of the WHERE project, a persistent storage mechanism must be built which would allow data communication over the Internet, using the capabilities of the Web. An approach involving features of Java, CORBA (Common Object Request Broker), the Web, a middle-ware (Java Relational Binding (JRB)), and a database server was used to build the persistent data management infrastructure for the WHERE project. The developed infrastructure allows a TcmJava editor to be downloaded and run from a network host by using a JDK 1.1 (Java Developer's Kit) compatible Web-browser. The aforementioned editor establishes connection with a server by using the ORB (Object Request Broker) software and stores/retrieves data in/from the server. The server consists of a CORBA object or objects depending upon whether the data is to be made persistent on a single server or multiple servers. The CORBA object providing the persistent data server is implemented using the Java progranu-ning language. It uses the JRB to store/retrieve data in/from a relational database server. The persistent data management system provides transaction and user management facilities which allow multi-user, distributed access to the stored data in a secure manner.

Dhaliwal, Swarn S.↗
NASA NTRS2012

A New Approach to Monitoring Coastal Marshes for Persistent Flooding

Many areas in coastal Louisiana are below sea level and protected from flooding by a system of natural and man-made levees. Flooding is common when the levees are overtopped by storm surge or rising rivers. Many levees in this region are further stressed by erosion and subsidence. The floodwaters can become constricted by levees and trapped, causing prolonged inundation. Vegetative communities in coastal regions, from fresh swamp forest to saline marsh, can be negatively affected by inundation and changes in salinity. As saltwater persists, it can have a toxic effect upon marsh vegetation causing die off and conversion to open water types, destroying valuable species habitats. The length of time the water persists and the average annual salinity are important variables in modeling habitat switching (cover type change). Marsh type habitat switching affects fish, shellfish, and wildlife inhabitants, and can affect the regional ecosystem and economy. There are numerous restoration and revitalization projects underway in the coastal region, and their effects on the entire ecosystem need to be understood. For these reasons, monitoring persistent saltwater intrusion and inundation is important. For this study, persistent flooding in Louisiana coastal marshes was mapped using MODIS (Moderate Resolution Imaging Spectroradiometer) time series of a Normalized Difference Water Index (NDWI). The time series data were derived for 2000 through 2009, including flooding due to Hurricane Rita in 2005 and Hurricane Ike in 2008. Using the NDWI, duration and extent of flooding can be inferred. The Time Series Product Tool (TSPT), developed at NASA SSC, is a suite of software developed in MATLAB(R) that enables improved-quality time series images to be computed using advanced temporal processing techniques. This software has been used to compute time series for monitoring temporal changes in environmental phenomena, (e.g. NDVI times series from MODIS), and was modified and used to compute the NDWI indices and also the Normalized Difference Soil Index (NDSI). Coastwide Reference Monitoring System (CRMS) water levels from various hydrologic monitoring stations and aerial photography were used to optimize thresholds for MODIS-derived time series of NDWI and to validate resulting flood maps. In most of the profiles produced for post-hurricane assessment, the increase in the NDWI index (from storm surge) is accompanied by a decrease in the vegetation index (NDVI) and then a period of declining water. The NDSI index represents non-green or dead vegetation and increases after the hurricane s destruction of the marsh vegetation. Behavior of these indices over time is indicative of which areas remain flooded, which areas recover to their former levels of vegetative vigor, and which areas are stressed or in transition. Tracking these indices over time shows the recovery rate of vegetation and the relative behavior to inundation persistence. The results from this study demonstrated that identification of persistent marsh flooding, utilizing the tools developed in this study, provided an approximate 70-80 percent accuracy rate when compared to the actual days flooded at the CRMS stations.

Kalcic, M. T.↗
DOE OSTI2026

Drought Reduces Formation, but Enhances Persistence, of Mineral‐Associated Organic Matter in a Grassland Soil

Drought effects are pervasive in terrestrial ecosystems, yet there is limited understanding of how drought impacts the transformation of plant carbon (C) inputs to mineral-associated organic matter (MAOM)—the largest and slowest-cycling pool of soil organic carbon (SOC). In a 12-week 13 C-CO 2 greenhouse labeling experiment, we tracked the formation of MAOM derived from the two dominant sources of plant C input to the mineral soil—living root inputs ( 13 C-rhizodeposits) and decaying root inputs ( 13 C-root detritus)—under normal moisture and droughted conditions in a semiarid grassland soil. At the end of the 12-week period, we also measured the persistence of 13 C-MAOM formed from rhizodeposits versus root detritus via a subsequent persistence assay. Drought reduced the formation of MAOM derived from living roots by decreasing rhizodeposits, reducing microbial growth rates, and altering the composition of organic matter, lipids, and metabolites. Drought initially delayed the formation of MAOM derived from root detritus by slowing the early stages of root litter decomposition (week 4–8), but did not decrease total MAOM formation by the end of the 12-week period. Notably, drought enhanced the persistence of MAOM derived from root detritus, but did not influence the persistence of MAOM derived from rhizodeposits. Our results provide some of the first direct evidence that drought can reduce the formation of MAOM in a grassland soil, but may enhance its persistence, based on the source of plant input from which MAOM is derived.

13C- labeling↗
NASA NTRS1990

Considerations of persistence and security in CHOICES, an object-oriented operating system

The current design of the CHOICES persistent object implementation is summarized, and research in progress is outlined. CHOICES is implemented as an object-oriented system, and persistent objects appear to simplify and unify many functions of the system. It is demonstrated that persistent data can be accessed through an object-oriented file system model as efficiently as by an existing optimized commercial file system. The object-oriented file system can be specialized to provide an object store for persistent objects. The problems that arise in building an efficient persistent object scheme in a 32-bit virtual address space that only uses paging are described. Despite its limitations, the solution presented allows quite large numbers of objects to be active simultaneously, and permits sharing and efficient method calls.

Campbell, Roy H.↗
NASA NTRS1992

A proof-of-concept implementation of persistence in a hierarchical storage system

The concept of providing transparent access to a collection of files in a mass storage system is a familiar one. The goal of this project was to investigate the feasibility of providing similar access to a collection of persistent, complex objects. We describe an architecture for interfacing a persistent store of complex objects to a hierarchical storage system. Persistent object stores support the uniform creation, storage, and access of complex objects, regardless of their lifetimes. In other words, a mechanism is provided so that persistent objects outlive the processes which create them and can be accessed in a uniform manner by other processes. We validated this architecture by implementing a proof-of-concept system and testing the system on two stores of data. These tests indicate that this architecture supports the creation, storage, and access of very large persistent object stores.

Grossman, Robert↗
DOE OSTI2024

Shape-persistent ladder molecules exhibit nanogap-independent conductance in single-molecule junctions

Molecular electronic devices require precise control over the flow of current in single molecules. However, the electron transport properties of single molecules critically depend on dynamic molecular conformations in nanoscale junctions. Here, in this work, we report a unique strategy for controlling molecular conductance using shape-persistent molecules. Chemically diverse, charged ladder molecules, synthesized via a one-pot multicomponent ladderization strategy, show a molecular conductance (d[log( G/G 0 )]/d x ≈ -0.1 nm -1 ) that is nearly independent of junction displacement, in stark contrast to the nanogap-dependent conductance (d[log( G/G 0 )]/d x ≈ -7 nm -1 ) observed for non-ladder analogues. Ladder molecules show an unusually narrow distribution of molecular conductance during dynamic junction displacement, which is attributed to the shape-persistent backbone and restricted rotation of terminal anchor groups. These principles are further extended to a butterfly-like molecule, thereby demonstrating the strategy's generality for achieving gap-independent conductance. Overall, our work provides important avenues for controlling molecular conductance using shape-persistent molecules. Achieving robust and controllable conductance in single-molecule junctions is challenging due to the dynamic nature of molecular conformations that fluctuate over operational timescales. A strategy using shape-persistent molecules has now been developed that demonstrates nearly junction-displacement-independent conductance, providing a stable solution for single-molecule electronic properties.

molecular electronics↗
DOE OSTI2025

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗
DOE OSTI2025

Toward a persistent event-streaming system for high-performance computing applications

High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.

HPC↗