MPI Sessions, Persistent Collectives, and Partitioned Communication.
Abstract not provided.
Dosanjh, Matthew↗
SEARCH · Search NASA
Results for “persistent communication”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Securing the Modern Grid: Federal Investments, Digitization, and Supply Chain Strategy
Across the United States (U.S.) grid expansion and modernization is underway, paving the way for accelerated load growth and intelligent resource management. Digitization of the grid is supported by several state and federal programs, providing support for utilities installing advanced metering infrastructure (AMI), AI-powered analytics systems, battery energy storage systems (BESS), and distributed energy resource management systems (DERMS) to transform the grid from a one-way power delivery system into an intelligent, responsive network that will enable faster load growth and power expansion of data centers for advanced artificial intelligence (AI) applications. The digital transformation of America's grid presents opportunity for increased efficiency and resiliency but also introduces new digital risks that require careful management. Digital equipment often contains several vulnerabilities such as unencrypted communication protocols, and persistent remote access capabilities that could be exploited to manipulate device settings, coordinate service disruptions, or inject false data into grid operations. These digital risks become particularly important as the grid must rapidly scale to support AI-driven data centers, which the administration has identified as essential for maintaining U.S. technological leadership and economic competitiveness. These vulnerabilities are compounded by supply chain realities: Chinese manufacturers currently produce 70-90% of essential grid components including inverters, batteries, and control systems, with the U.S. lacking domestic manufacturing capacity for critical assets like extra-high voltage transformers. Recent federal legislation has established Foreign Entity of Concern (FEOC) restrictions to address these risks, requiring projects to achieve escalating thresholds of non-FEOC content to receive tax credits while utilities work to expand sourcing channels for their supply chains and strengthen security measures. These restrictions arrive precisely when utilities face unprecedented electricity demand growth driven by the rapid growth in data centers, creating a considerable challenge: rapidly expanding infrastructure while navigating complex compliance requirements while lacking viable alternatives for many critical components. Idaho National Laboratory (INL) and its partners have developed practical approaches to help utilities navigate these intersecting challenges as they leverage federal investment to strengthen and grow the grid. These solutions include Cyber-Informed Engineering (CIE) principles that build resilience directly into systems, the Cirrus tool for secure cloud migration, and enhanced procurement guidance that embeds security requirements throughout equipment lifecycles. Federal initiatives, such as the Technical Assistance for Digital Assurance (TADA) project, provide direct support to utilities implementing these approaches while facilitating knowledge sharing across the industry. While these tools and frameworks cannot eliminate all risks inherent in foreign supply chain dependencies, they offer pragmatic pathways for strengthening security posture without sacrificing the deployment momentum essential to meeting surging electricity demand. Ultimately, securing America's digital energy infrastructure demands dedicated coordination across multiple fronts: building domestic supply chains, implementing robust digital assurance practices, and maintaining the aggressive modernization timeline necessary for reliability, resilience, and energy independence.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Optimizing Irregular Communication with Neighborhood Collectives and Locality-Aware Parallelism
Irregular communication often limits both the performance and scalability of parallel applications. Typically, applications individually implement irregular communication as point-to-point, and any optimizations are integrated directly into the application. As a result, these optimizations lack portability. It is difficult to optimize point-to-point messages within MPI, as the interface for single messages provides no information on the collection of all communication to be performed. However, the persistent neighbor collective API, released in the MPI 4 standard, provides an interface for portable optimizations of irregular communication within MPI libraries. This paper presents methods for implementing existing optimizations for irregular communication within neighborhood collectives, analyzes the impact of replacing point-to-point communication in existing codebases such as Hypre BoomerAMG with neighborhood collectives, and finally shows up to a 1.38x speedup on sparse matrix-vector multiplication communication within a BoomerAMG solve through the use of our optimized neighbor collectives. Here, the authors analyze three implementations of persistent neighborhood collectives for Alltoallv: an unoptimized wrapper of standard point-to-point communication, and two locality-aware aggregating methods. The second locality-aware implementation exposes an non-standard interface to perform additional optimization, and the authors present the additional 0.07x speedup from the extended interface. All optimizations are available in an open-source codebase, MPI Advance, which sits on top of MPI, allowing for optimizations to be added into existing codebases regardless of the system MPI install.
AMG↗
Toward a persistent event-streaming system for high-performance computing applications
High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.
HPC↗
RFID-Enabled Tamper-Indicating Seal
Tamper-indicating seals protect sensitive materials, valuable equipment, and critical shipments. Most conventional seals must be checked through manual visual inspection and do not provide a digital record of their condition. Some attempts to remove, alter, or bypass a seal may also leave little visible damage, making tampering difficult to identify during routine inspections. Los Alamos National Laboratory has developed a smart tamper-indicating seal that converts even subtle tampering into a persistent digital record. The seal communicates its identity and status wirelessly through standard radio-frequency identification (RFID) readers, giving organizations a faster, more reliable way to verify that an asset has remained secure.
99 GENERAL AND MISCELLANEOUS↗
Summer 2021 Internship Report
The Library Research and Prototyping team (Proto Team) under the research library explores aspects of scholarly communication, covering aspects of infrastructure, interoperability, and persistence. One of the key contributions of the team is the contribution in standardizing and forming the infrastructure for Mementos in web archiving. The Memento framework in web archiving enables access to digital resources in prior versions serving both persistence and the interoperability of the information. During the internship program, I worked on improving the Memento infrastructure by updating the memento validator. The Memento validator provides the functionality of testing the compliance of the web resources to the Memento specification. The application is intended to be used by the community at large such as web archives, researchers, librarians, and general users, with different levels of technical expertise.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
HIDES: Hybrid Intrusion Detector for Energy Systems
The establishment of a resilient electric grid accompanied by a secure communications network is an ongoing battle as advanced persistent threats continue to exploit existing vulnerabilities in legacy supervisory control and data acquisition system (SCADA) infrastructure. Traditional intrusion detection systems (IDSs) lack consistent performance because of the continuously evolving attack surface of SCADA systems. These shortcomings can be overcome by integrating logical system behavior, protocol-specific knowledge, and data-based learning to develop a comprehensive IDS solution. In this paper, we present a Hybrid Intrusion Detector for Energy Systems by integrating a network-based IDS, state-of-the-art machine learning-based IDS, and model-based IDS to detect unknown and stealthy cyberattacks targeting the SCADA networks. The proposed IDS uses synchrophasor measurements and cyber logs to learn patterns of different scenarios based on spatiotemporal behaviors of power systems. As a proof of concept, we implement and validate the proposed IDS by leveraging resources available at the National Renewable Energy Laboratory's Energy Systems Integration Facility test bed. Experimental results show promising performance in detecting cyberattacks while providing realtime visualization of power system measurements and cyber logs.
machine-learning intrusion detection system↗
Biphasic response of human iPSC-derived neural network activity following exposure to a sarin-surrogate nerve agent
Organophosphorus nerve agents (OPNA) are hazardous environmental exposures to the civilian population and have been historically weaponized as chemical warfare agents (CWA). OPNA exposure can lead to several neurological, sensory, and motor symptoms that can manifest into chronic neurological illnesses later in life. There is still a large need for technological advancement to better understand changes in brain function following OPNA exposure. The human-relevant in vitro multi-electrode array (MEA) system, which combines the MEA technology with human stem cell technology, has the potential to monitor the acute, sub-chronic, and chronic consequences of OPNA exposure on brain activity. However, the application of this system to assess OPNA hazards and risks to human brain function remains to be investigated. In a concentration-response study, we have employed a human-relevant MEA system to monitor and detect changes in the electrical activity of engineered neural networks to increasing concentrations of the sarin surrogate 4-nitrophenyl isopropyl methylphosphonate (NIMP). We report a biphasic response in the spiking (but not bursting) activity of neurons exposed to low (i.e., 0.4 and 4 μM) versus high concentrations (i.e., 40 and 100 μM) of NIMP, which was monitored during the exposure period and up to 6 days post-exposure. Regardless of the NIMP concentration, at a network level, communication or coordination of neuronal activity decreased as early as 60 min and persisted at 24 h of NIMP exposure. Once NIMP was removed, coordinated activity was no different than control (0 μM of NIMP). Interestingly, only in the high concentration of NIMP did coordination of activity at a network level begin to decrease again at 2 days post-exposure and persisted on day 6 post-exposure. Notably, cell viability was not affected during or after NIMP exposure. Also, while the catalytic activity of AChE decreased during NIMP exposure, its activity recovered once NIMP was removed. Gene expression analysis suggests that human iPSC-derived neurons and primary human astrocytes resulted in altered genes related to the cell’s interaction with the extracellular environment, its intracellular calcium signaling pathways, and inflammation, which could have contributed to how neurons communicated at a network level.
59 BASIC BIOLOGICAL SCIENCES↗
Implementing One Sided Partitioned Communication in Open MPI
This report introduces partitioned communication, a new MPI 4.0 interface that enables early bird communication by overlapping communication and computation. By partitioning messages into smaller sub-messages, MPI can start partial data transfers early. Performance studies show that the RMA implementation outperforms the Persistent implementation, despite some constraints. This report details a new opt-in RMA implementation, offering a high-performance option for partitioned communication that imposes some additional limitations.
97 MATHEMATICS AND COMPUTING↗
SHARP-Net: Platform for Self-Healing and Attack Resilient PMU Networks
Synchrophasor technology plays a pivotal role in developing the next generation of wide-area monitoring, protection, and control in the smart grid environment. As technology and communications infrastructures evolve, however, so do the attack surfaces in the synchrophasor network that can be exploited by advanced persistent threat (APT) actors to affect power system stability and reliability. In this paper, we propose a novel platform for developing a self-healing and attack-resilient PMU network (SHARP-Net) by instituting a state-of-the-art intrusion detection system (IDS) with an intrusion mitigation system (IMS) and an alert management system (AMS). In particular, the proposed platform detects anomalies during cyberattacks on phasor data concentrators (PDCs) based on the rules defined in the IDS, then the generated alerts are published to the IMS through the AMS. The proposed IMS proceeds to take automated corrective responses to mitigate cyberattacks by reconfiguring the synchrophasor network to isolate the compromised PDCs, and it orchestrates new PDCs to prevent the future propagation of attacks. Further, the IMS restores the system's observability by reconnecting the new PDCs to make the grid attack-resilient. In this work, the SHARP-Net platform is developed by using Python-based libraries, minimega's software-defined network, and virtual machine orchestration. We implement and validate the proposed SHARP-Net architecture by testing a PMU network in the smart grid environment. SHARP-Net showed promising performance in detecting cyberattacks and mitigating them through the network reconfiguration.
computer architecture↗
Implementing Software Resiliency in HPX for Extreme Scale Computing
The DOE Office of Science Exascale Computing Project (ECP) outlines the next milestones in the supercomputing domain. The target computing systems under the project will deliver 10x performance while keeping the power budget under 30 megawatts. With such large machines, the need to make applications resilient has become paramount. The benefits of adding resiliency to mission critical and scientific applications, includes the reduced cost of restarting the failed simulation both in terms of time and power. Most of the current implementation of resiliency at the software level makes use of a Coordinated Checkpoint and Restart (C/R). This technique of resiliency generates a consistent global snapshot, also called a checkpoint. Generating snapshots involves global communication and coordination and is achieved by synchronizing all running processes. The generated checkpoint is then stored in some form of persistent storage. On failure detection, the runtime initiates a global rollback to the most recent previously saved checkpoint. This involves aborting all running processes, rolling them back to the previous state and restarting them.
97 MATHEMATICS AND COMPUTING↗
Orchestrating Spontaneous Emission With Metasurfaces: Recent Advances in Engineering Thermal, Luminescent, and Quantum Emissions
Metasurfaces have emerged as powerful tools for controlling spontaneous emission, offering unprecedented control over light-matter interactions at sub-wavelength scales. While metasurfaces are traditionally utilized for shaping coherent electromagnetic waves, they have recently extended their capabilities to control incoherent or spontaneous emission. This examines review how metasurfaces can enhance and precisely control properties of thermal, luminescent, and quantum emission. In thermal emission, metasurfaces enable control over spatial, temporal, and spin coherence, offering new possibilities for applications such as energy harvesting, radiative cooling and heat assisted ranging and detection. For luminescent emission, metasurfaces significantly improve emission rates, quantum efficiency, and directionality, driving innovations in lighting and display technologies. For controlling quantized spontaneous emission, metasurfaces are instrumental in enhancing single-photon sources and enabling novel functionalities in quantum states through photon-pair generation, which is vital for quantum communication, meteorology, and computing. Here, despite these advancements several challenges to increase the operational bandwidths, accelerate and develop simulation strategies, and fabrication complexities persist. Emerging trends are also discussed, such as dynamic metasurfaces and their integration with nanophotonic platforms, which could further expand the capabilities of light-emitting metasurfaces.
Luminescence↗
DUNE DAQ R&D integration in ProtoDUNE Single-Phase at CERN
The DAQ system of ProtoDUNE-SP successfully proved its design principles and met the requirements of the beam run of 2018. The technical design of the DAQ system for the DUNE experiment has major differences compared to the prototype due to different requirements placed on the detector, as well as a radically different location of operation. The single-phase prototype at CERN is a major integration facility for R&D aspects of the DUNE DAQ system. The facility allows for the exploration of additional data processing capabilities and optimization of the FELIX system, which is the chosen TPC readout solution for the DUNE single-phase detectors. One of the fundamental differences from the prototype is that the DUNE DAQ relies on self-triggering. Therefore, real-time processing of the data stream for hit and trigger primitive finding is essential for the requirement of continuous readout. The supernova burst trigger requires a large and fast buffering technique, where 3D XPoint persistent memory solutions are evaluated and integrated. In order to maximize resource utilization of the FELIX hosting servers, the elimination of the 100 Gb network communication stack is desired. This implies the design and development of a single-host application layer, which is a fundamental element of the self-triggering chain. This paper discusses the evaluation and integration of these developments for the DUNE DAQ, in the ProtoDUNE environment.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Unraveling the Noise: An Investigation Plan for Signal Interference in Hearing Aids
Bluetooth Low Energy (BLE) has revolutionized the performance of hearing aids with functionalities like seamless audio streaming and enhanced auditory functions. However, BLE operates within the highly congested 2.4 GHz frequency band, making it susceptible to signal interference that can degrade performance, reduce audio quality, and impact user experience. This paper documents interference patterns in BLE communication and introduces practical mitigation techniques aimed at improving the reliability of hearing aids. Attack vectors associated with Bluetooth enabled hearing aids include communication jamming, the interception of data between target devices, and GATT handle exploitation. Attackers could also use the vulnerabilities to block communications or intercept sensitive audio streams, posing significant security and privacy risks. These threats compromise two critical components of the CIA triad: (1) availability, by causing persistent connectivity issues, and (2) integrity, by enabling unauthorized data modifications. It is necessary to deal with these problems to ensure hearing aids work well and safely. This study investigates the impact of BLE signal interference on hearing aids, using tools such as HackRF [1], a Python tool to simulate interference scenarios, and Ubertooth [2] to sniff Bluetooth traffic between hearing aids and the device with the application. This paper investigates testing of BLE traffic in search of specific interference patterns that would impact the functionality of hearing aids, including jamming and flooding. This research focuses on developing robust mitigation techniques with the aim of securing BLE-enabled hearing aids against those vulnerabilities.
Baldwin, David [Savannah River National Laboratory↗
Is solid copper oxalate a spin chain or a mixture of entangled spin pairs?
Macroscopic assemblies of interacting spins give rise to a broad spectrum of behaviors determined by the spatial arrangement of the magnetic sites and the electronic interactions between them. Compounds of copper (II), in which each copper carries spin 1/2, exhibit a vast variety of physical properties. For antiferromagnetically coupled spin sites, there are two limiting scenarios: spin chains in which the spins can exhibit a long-range order or a mixture of dimers in which the spins within each pair are entangled but do not communicate with the spins from other dimers. In principle, the two types can be distinguished on the basis of experimental observations and modeling using empirically parameterized effective Hamiltonians, but in practice, ambiguity may persist for decades, as is the case for copper oxalate. Here we use high-level ab initio calculations to establish the validity of the nearest-site Heisenberg model and to predict the interaction strength between the magnetic sites. Finally, the computed magnetic susceptibility provides an unambiguous interpretation of magnetic experiments performed throughout half a century, clearly supporting the infinite spin-chain behavior of solid copper oxalate.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Probabilistic Cloud Optimized Day-Ahead Forecasting System Based on WRF-Solar (Final Report)
The most persistent challenge in both intraday and day-ahead solar forecasting is to get numerical weather prediction models to produce the right type of clouds with the right frequency at the right time and place. Another challenge is to understand and communicate the forecast uncertainty. The objective of this project was to develop an optimized ensemble-based solar irradiance forecasting system that will (1) demonstrably improve the current state-of-the-art solar forecasts from the deterministic Weather Research and Forecasting-Solar (WRF-Solar) model and (2) provide probabilistic forecasts for grid operations. This probabilistic solar forecasting system, referred to as the WRF-Solar Ensemble Prediction System (WRF-Solar EPS), aims to significantly enhance both the intraday and the day-ahead solar forecasting capability for grid operations. This technical report summarizes the work performed in the past 3 years through a collaboration between the National Renewable Energy Laboratory and the National Center for Atmospheric Research as part of the U.S. Department of Energy's Solar Forecasting 2 program that aims to improve the accuracy of solar energy forecasts and enable increased deployment of solar energy on the electric grid.
14 SOLAR ENERGY↗
A Comparative Study of the Perceptual Sensitivity of Topological Visualizations to Feature Variations
Color maps are a commonly used visualization technique in which data are mapped to optical properties, e.g., color or opacity. Color maps, however, do not explicitly convey structures (e.g., positions and scale of features) within data. Topology-based visualizations reveal and explicitly communicate structures underlying data. Although our understanding of what types of features are captured by topological visualizations is good, our understanding of people's perception of those features is not. Further, this paper evaluates the sensitivity of topology-based isocontour, Reeb graph, and persistence diagram visualizations compared to a reference color map visualization for synthetically generated scalar fields on 2-manifold triangular meshes embedded in 3D. In particular, we built and ran a human-subject study that evaluated the perception of data features characterized by Gaussian signals and measured how effectively each visualization technique portrays variations of data features arising from the position and amplitude variation of a mixture of Gaussians. For positional feature variations, the results showed that only the Reeb graph visualization had high sensitivity. For amplitude feature variations, persistence diagrams and color maps demonstrated the highest sensitivity, whereas isocontours showed only weak sensitivity. These results take an important step toward understanding which topology-based tools are best for various data and task scenarios and their effectiveness in conveying topological variations as compared to conventional color mapping.
97 MATHEMATICS AND COMPUTING↗
Development and Experimental Validation of a High-Power DC Distribution Testbed for Advanced Charging Infrastructure and Energy Management
This paper presents the development of a hardware testbed for DC-distributed high-power charging (HPC) stations. As DC distributed solutions emerge as a viable solution to optimize HPC site operations, challenges such as interoperability, protection, and seamless integration of distributed energy resources (DER) persist. These issues underscore the need for a robust testing facility to investigate compliance of available commercial off-the-shelf (COTS) market devices. The developed testbed features a DC-distributed charging hub including a charger, emulated energy storage system (ESS), and site level communication and controller implementation. It facilitates the testing of COTS hardware, charger prototypes, standards validation and site energy management system (SEMS) controllers at rated power. This paper details the development of the charging infrastructure platform, implementation of communication system, validation of different SEMS algorithms, and understanding improvements required for future expansion. Using the developed testbed, interoperability gaps for SEMS implementation with multi-vehicle concurrent charging via a multi-port charger are experimentally observed. Aimed at supporting the transition to large-scale EV charging infrastructure deployment and DER integration, this testbed plays a crucial role in conformity testing of COTS device interoperability.
24 POWER TRANSMISSION AND DISTRIBUTION↗