Search NASA⌕ Search

SEARCH · Search NASA

Results for “Complex Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Compositionally Complex Spinel Oxides as Conversion Anodes for Lithium-Ion Batteries

Four different compositionally complex multicomponent M 3 O 4 spinels containing 5–8 distinct metals were prepared by a rapid combustion synthesis method or solvothermal synthesis. High resolution synchrotron X-ray diffraction patterns show that the materials consist primarily of spinel phases with small amounts of rock salt impurities, and, in several samples, a minor amount of contracted spinel phase. Materials were investigated as conversion anodes in lithium half-cells and delivered significantly higher capacities than two-component MgFe 2 O 4 made by combustion synthesis. X-ray absorption near-edge structure (XANES) was used to estimate the oxidation states of the metals in the pristine, lithiated (discharged) and delithiated (charged) materials to better understand the redox processes in half cells that led to the improvement. Co, Ni, and Zn are reduced to low oxidation states during lithiation (cell discharge) but are only partially oxidized. The presence of a conductive metallic network that forms after lithiation is thought to account for the improved electrochemical characteristics. Interestingly, in most of the samples, iron is not fully reduced during initial lithiation unlike what happens with a set of related high entropy spinel ferrites studied previously. Finally, the improved electrochemical properties of these materials illustrates both the advantages of complexity and the difficulties in predicting their behavior.

25 ENERGY STORAGE↗
DOE OSTI2024

Correlation functions from tensor network influence functionals: The case of the spin-boson model

We investigate the application of matrix product state (MPS) representations of the influence functionals (IFs) for the calculation of real-time equilibrium correlation functions in open quantum systems. Focusing specifically on the unbiased spin-boson model, we explore the use of IF-MPSs for complex time propagation, as well as IF-MPSs for constructing correlation functions in the steady state. We examine three different IF approaches: one based on the Kadanoff–Baym contour targeting correlation functions at all times, one based on a complex contour targeting the correlation function at a single time, and a steady state formulation, which avoids imaginary or complex times, while providing access to correlation functions at all times. We show that within the IF language, the steady state formulation provides a powerful approach to evaluate equilibrium correlation functions.

Chemistry↗
DOE OSTI2024

Kansas City, Missouri, Streetlight Electric Vehicle Charging: Strategies and challenges for site selection of streetlight electric vehicle infrastructure in Kansas City, Missouri (Final Report)

Public streetlight charging, whether on streets in central business districts or residential areas, provides easy charging access for apartment residents and homeowners alike. While most electric vehicle (EV) drivers charge at home, they do so in garages or on driveways they own. For renters and residents of multifamily housing (MFH), however, this may not be an option. EVs have a lower cost of ownership compared to conventional vehicles, and a used EV may be an affordable option for a lower-income household. But without easy access to charging, even a low-cost used EV may not be an option for a prospective buyer. An affordable curbside charging network has the potential to expand EV adoption into neighborhoods that have to date seen minimal interest and uptake of the technology and associated charging infrastructure. Streetlight charging networks can provide an economical, scalable, and effective approach to providing equitable and convenient charging. Metropolitan Energy Center (MEC) is dedicated to the mission of creating resource efficiency, environmental health, and economic vitality in the Kansas City region and beyond. Since 1983, MEC has provided resources, outreach, and training to make alternative fuels and energy efficiency commonplace. MEC led a streetlight charging pilot project that installed limited EV charging infrastructure on the streetlight system in Kansas City, Missouri, to demonstrate and test the benefits of curbside charging for EVs at existing on-street parking locations. The project aimed to cost-effectively expand the charging network in Kansas City to support residential charging and provide infrastructure in one or more charging deserts throughout the city. This pilot evaluates the impact and overall success of streetlight charging based on community feedback, utilization of charging infrastructure, technical feasibility, and cost. The project has pursued a data- and community-driven site selection process designed to identify sites with high demand and high opportunity for EV charging. This project was funded by the U.S. Department of Energy (DOE) and awarded to MEC through a competitive proposal process. The novelty and complexity of this project required an organization that could facilitate collaboration across levels of government, community members, and industry partners. For the past 25 years, through Kansas City Regional Clean Cities, MEC has worked with numerous public and private fleets on a variety of projects to improve the environmental performance and efficiency of the regional vehicle fleet. To advance affordable, efficient, and clean transportation efforts, DOE Clean Cities and Communities coalitions create local networks of public and private sector stakeholders and engage communities. Rooted within their local communities, the coalitions serve as experts and ambassadors, bringing to bear the collective knowledge, experience, and practical know-how of the entire network from within DOE, its national laboratories, and diverse stakeholders in the field. MEC and its project partners made in-kind contributions to leverage federal dollars for the benefit of the Kansas City community. Findings from this project will help determine the best applications for streetlight charging technologies to maximize funding impact and serve community needs. The team evaluated locations based on expected charging demand, technical feasibility, safety considerations, and enhanced charging network siting needs. Throughout the project, the team gathered feedback and evaluated ways to make public charging for EVs available to all community members. The insights will help Kansas City and other communities streamline future efforts to support EV drivers through public charging in the city right-of-way. Furthermore, this project will inform citywide guidance for future installations. MEC is committed to a transparent and publicly accessible approach that encourages the collaborative evaluation of streetlight charging. The project has engaged the community to proactively identify and evaluate the benefits and impacts of streetlight charging. It was a priority for the project to ensure the benefits of this pilot are distributed equitably to all members of the Kansas City community and that new charging opportunities and associated resources are available in diverse neighborhoods across the city. The charging infrastructure supports an affordable curbside charging network that will enable more drivers to choose EVs and provide easy charging access for all community members interested in driving an EV. The community feedback received through this project informed future resources and opportunities to make EVs more accessible to all members of the Kansas City community. MEC worked with several community partners on this project, including Missouri University of Science and Technology (MST), Pennsylvania State University (Penn State), the National Renewable Energy Laboratory (NREL); the city of Kansas City, Missouri; Evergy; Black and McDonald (B&M); LilyPad EV; EVNoire; and Westside Housing Organization (WHO). Project partners contributed to the cost match required for DOE grants through capital expenditures, personnel, and other in-kind contributions. Detailed descriptions of project team organizations can be found in Appendix A. Project Partners. Analysts at NREL and MST/PennState developed site maps based on demand and equity considerations. MEC conducted outreach to community members to garner input on project design and site selection, and received approval from the Missouri Public Service Commission (PSC) for Evergy’s EV charging station ownership. MEC worked with all partners to gather additional siting criteria and developed a site selection evaluation checklist, and partners conducted site visits to proposed installation sites. Next, B&M, Evergy, and the city executed all site agreements, conducted site-specific engineering design, acquired associated permits, and issued notices to proceed site by site or in small batches. Finally, from January to April 2023, the project team installed 23 EV charging stations built on Kansas City’s streetlight system in six council districts. Evergy will own, operate, and monitor the stations for 10 years, sharing charging data with MEC for at least 1 year.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Discovering CO Adsorption and Desorption Pathways from Chemical Reaction Neural Network Modeling of Transient Kinetics Spectroscopy

Here, we demonstrate a data-driven approach to interpreting surface reactions by combining time-resolved gas pulsing infrared spectroscopy with chemical reaction neural networks (CRNNs). Using CO adsorption and desorption on Pd(111) at 460–490 K as a model system, we show how transient kinetic data can reveal detailed reaction mechanisms. Starting with a simple one-species model, we systematically evaluate increasingly complex mechanisms involving hollow and bridge site adsorption. Despite the similar goodness of fit to the same experimental absorbance data, our models predict distinct coverage dynamics for different adsorption sites. Through analysis of spectral peak stability and predicted dynamics, we identify a mechanism in which CO primarily adsorbs on bridge sites followed by rapid conversion to hollow sites as being the most physically consistent with experimental observations. This work provides a framework for extracting mechanistic insights from limited experimental data, demonstrating how machine learning can bridge the gap between transient kinetic measurements and a molecular-level understanding of surface reactions.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Dynamic Charging Rendezvous and Motion Planning for a Multi-AGV Team Including a Mobile Charging Host

Teams of automated battery-powered electric vehicles have the potential to execute complex mission tasks in off-road environments for agriculture, military, and other applications. Limited onboard energy reserves hinder their adoption in large-scale resource-constrained environments, where recharging is a necessity. It may be infeasible to install a network of static charging stations in off-road environments. For this reason, dedicated mobile host vehicles with charging capabilities are proposed as a means to increase range and capabilities of the multivehicle team. Here, in this study, we consider an ad hoc planning framework, where results from a high-confidence trajectory planner are leveraged to plan charging rendezvous between a host and other worker vehicles in a receding horizon fashion to provide high confidence that energy reserves will not be prematurely exhausted. The core problem is posed so as to minimize the impact of recharging on the mission in terms of task delays, overall energy utilization, and costs of fast charging. Through extensive Monte Carlo simulations of an off-road mission, we show a decrease in task delays without substantial increases in energy needs by updating the charging rendezvous plan during the mission. However, if updates are made too often, model mismatch may cause unnecessary cycling and mission failure.

Energy constraints↗
DOE OSTI2025

Temperature Field Reconstruction of Surfaces Heated Through Radiative Heat Transfer Using Convolutional Neural Networks

Microreactors could play a crucial role in decarbonizing our energy portfolio. However, their development and implementation come with specific challenges, particularly regarding cost. Due to their compact size and the harsh operational environment, collecting real-time data on reactor operation can be challenging. Many probe designs are unable to withstand extreme conditions (e.g., temperature, radiation) in the reactor. In this context, using convolutional neural networks (CNNs) can pave the way for developing a nonintrusive approach that relies solely on ex-core sensors. A well-trained physics-informed CNN can reconstruct the distribution of a given physical quantity over a domain using only a few sensors, allowing us to reconstruct the desired field distribution even in a limited space or complex geometries where a large array of sensors is impractical. In this work, we present the initial steps toward developing a real-time tool for monitoring the thermal behavior of nuclear reactor pressure vessels. Based on an experimental setup, a computational model using the Multiphysics Object-Oriented Simulation Environment (moose) framework was built, where the Ray Tracing and Heat Conduction modules were used to evaluate the temperature distribution over a convex metal surface heated through radiative heat transfer. This metal surface represents a section of a heated nuclear reactor vessel wall. The model also accounts for solid mechanics physics through the moose Solid Mechanics module. In situ experimental data, acquired from a Texas A&M facility, were used to validate the computational model. Part of the data generated by the moose model was used to train the convolutional neural network to reconstruct the vessel wall's outer surface temperature. The CNN generalization was then compared against the experimental and computational data.

Aldeia Machado, Luiz Carlos↗
DOE OSTI2025

The Persistent Challenge of Data Locality in the Post-Exascale Era

The era of exascale computing, exemplified by systems like Frontier achieving exaflop-level performance, marks a milestone. However, the quest for sheer compute power leads to strong imbalance in system design. Hence, scaling advancements in memory, network bandwidth, and storage are also necessary and pose challenges, with a crucial need to address data locality issues. This article underscores the fundamental importance of data locality as a key abstraction for optimizing application performance. Despite notable software solutions, the growing complexity of parallelism and memory hierarchy demands performance-portable data locality solutions across diverse computing platforms. Additionally, the article revisits data locality aspects, covering hardware considerations, application perspectives, software stack abstractions, and tool support. It concludes with insights into data locality challenges and opportunities, emphasizing the ongoing significance of collaborative research for progress in this critical issue.

Unat, Didem [Koc University, Istanbul (Turkey)] (O↗
DOE OSTI2024

Model-Based Detection of Coordinated Attacks (DCA) in Distribution Systems

The fast-paced growth in digitization of smart grid components enhances system observability and remote-control capabilities through efficient communication. However, enhanced connectivity results in heightened system vulnerability towards cybersecurity risks in the cyber-physical power system. Coordinated cyber-attacks (CCA), when undetected, lead to system-wide impact in terms of large disturbances or widespread outages. Detecting CCA in the cyber layer is critical to thwart cyber-attacks in real-time before the attack impacts the physical system. The challenge of locating CCA stems from the complex grid dynamics, making it difficult to distinguish between normal operational variations and cyber-attack impact. CCA often employs multiple attack vectors targeting geographically distributed components, further complicating CCA identification. Existing research in intrusion detection is primarily focused on the transmission network and limited to detecting individual attacks. In this paper, a novel proactive DCA strategy is proposed for early detection of CCA by establishing correlations among distinct attack events through model-based reinforcement learning that utilizes abductive reasoning to conclude the attacker goal. The solution includes understanding the system model, learning the system dynamics, and correlating individual cyber-attacks to extract the attacker’s objective. The developed learning algorithm identifies the most probable attack path to reach the attacker’s objective by predicting the next attack steps. A DNP3-based cyber-physical co-simulation testbed is developed to test the proposed algorithm using the IEEE 13-node test feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Securing Grid Communications Infrastructure: Addressing Gaps Beyond NERC CIP Facility Perimeters

The North American electric grid relies on a complex communications infrastructure that extends beyond facility perimeters traditionally covered by NERC Critical Infrastructure Protection (CIP) standards. While CIP requirements have significantly strengthened cybersecurity within Electronic Security Perimeters, many operational communications—such as those between control centers, substations, and third-party networks—fall outside current regulatory scope. As grid modernization introduces new technologies and connectivity models, these external pathways present evolving security challenges. This brief explores the nature of these challenges, including emerging attack vectors and supply chain considerations, and highlights how ongoing grid transformation increases exposure to sophisticated threats. It outlines practical strategies and policy options to complement existing standards, such as expanding secure communications practices, enhancing supply chain transparency, and fostering collaboration among federal, state, and industry stakeholders. Near-term actions like encryption, authentication, and contractual safeguards can help reduce risk while longer-term frameworks are developed to ensure resilient and secure grid operations.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Many-body expansion based machine learning models for octahedral transition metal complexes

Abstract Graph-based machine learning (ML) models for material properties show great potential to accelerate virtual high-throughput screening of large chemical spaces. However, in their simplest forms, graph-based models do not include any 3D information and are unable to distinguish stereoisomers such as those arising from different orderings of ligands around a metal center in coordination complexes. In this work we present a modification to revised autocorrelation descriptors, a molecular graph featurization method, for predicting spin state dependent properties of octahedral transition metal complexes (TMCs). Inspired by analytical semi-empirical models for TMCs, the new modeling strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. We present the necessary modifications to include this approach in two commonly used ML methods, kernel ridge regression and feed-forward neural networks. On a test set composed of all possible isomers of binary TMCs, the best MBE models achieve mean absolute errors (MAEs) of 2.75 kcal mol −1 on spin-splitting energies and 0.26 eV on frontier orbital energy gaps, a 30%–40% reduction in error compared to models based on our previous approach. We also observe improved generalization to previously unseen ligands where the best-performing models exhibit MAEs of 4.00 kcal mol −1 (i.e. a 0.73 kcal mol −1 reduction) on the spin-splitting energies and 0.53 eV (i.e. a 0.10 eV reduction) on the frontier orbital energy gaps. Because the new approach incorporates insights from electronic structure theory, such as ligand additivity relationships, these models exhibit systematic generalization from homoleptic to heteroleptic complexes, allowing for efficient screening of TMC search spaces.

Meyer, Ralf (ORCID:0000000322360261)↗
DOE OSTI2025

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗
DOE OSTI2025

A hereditary integral, transient network approach to modeling permanent set and viscoelastic response in polymers

An efficient numerical framework is presented for modeling viscoelasticity and permanent set of polymers. It is based on the hereditary integral form of transient network theory, in which polymer chains belong to distinct networks each with different natural equilibrium states. Chains continually detach from previously formed networks and reattach to new networks in a state of zero stress. The free energy of these networks is given in terms of the deformation gradient relative to the configuration at which the network was born . A decomposition of the kernel for various free energies allows for a recurrence relationship to be established, bypassing the need to integrate over all time history. The technique is established for both highly compressible and nearly incompressible materials through the use of neo-Hookean, Blatz–Ko, Yeoh, and Ogden-Hill material models. Multiple examples are presented showing the ability to handle rate-dependent response and residual strains under complex loading histories.

Finite element method↗
DOE OSTI2024

Machine learning-guided design, synthesis, and characterization of atomically dispersed electrocatalysts

The recent integration of machine learning into materials design has revolutionized the understanding of structure–property relationships and optimization of material properties beyond the trial-and-error paradigm. On one hand, machine learning has significantly accelerated the development of atomically dispersed metal-nitrogen-carbon (M-N-C) electrocatalysts, which traditionally heavily relied on heuristic approaches. On the other hand, the primary challenge of leveraging machine learning to expedite M-N-C materials discovery lies in the cost associated with data collection. Here, we review recent machine learning integration strategies for M-N-C catalyst development, including discussions on the typical algorithms such as symbolic regression and convolutional neural networks employed for the theoretical design, synthesis optimization via active learning, and advanced microscopy characterization. Subsequently, we provide our perspective on potential near-future directions for furthering machine learning-assisted development of new M-N-C catalysts and elucidating the complex physicochemical mechanisms governing the selectivity, activity, and durability in this class of materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Effective optimization of atomic decoration in giant and superstructurally ordered crystals with machine learning

Crystals with complicated geometry are often observed with mixed chemical occupancy among Wyckoff sites, presenting a unique challenge for accurate atomic modeling. Similar systems possessing exact occupancy on all the sites can exhibit superstructural ordering, dramatically inflating the unit cell size. In this work, a crystal graph convolutional neural network (CGCNN) is used to predict optimal atomic decorations on fixed crystalline geometries. This is achieved with a site permutation search (SPS) optimization algorithm based on Monte Carlo moves combined with simulated annealing and basin-hopping techniques. Our approach relies on the evidence that, for a given chemical composition, a CGCNN estimates the correct energetic ordering of different atomic decorations, as predicted by electronic structure calculations. This provides a suitable energy landscape that can be optimized according to site occupation, allowing the prediction of chemical decoration in crystals exhibiting mixed or disordered occupancy, or superstructural ordering. Verification of the procedure is carried out on several known compounds, including the superstructurally ordered clathrate compound Rb8Ga27Sb16 and vacancy-ordered perovskite Cs2SnI6, neither of which was previously seen during the neural network training. In addition, the critical temperature of an order–disorder phase transition in solid solution CuZn is probed with our SPS routines by sampling site configuration trajectories in the canonical ensemble. This strategy provides an accurate method for determining favorable decoration in complex crystals and analyzing site occupation at unprecedented speed and scale.

Chemistry↗
DOE OSTI2025

A dynamic protein interactome drives energy conservation and electron flux in Thermococcus kodakarensis

ABSTRACT Life is supported by energy gains fueled by catabolism of a wide range of substrates, each reliant on the selective partitioning of electrons through redox ( red uction and ox idation) reactions. Electron flux through tunable and regulated protein interactions provides dynamic routes for energy conservation, but how electron flux is regulated in vivo , particularly for archaeal metabolisms that support rapid growth at the thermodynamic limits of life, is poorly understood. Identification of bona fide in vivo protein assemblies and how such assemblies dictate the totality of electron flux is critical to our understanding of the regulation imposed on metabolism, energy production, and energy conservation. Here, 25 key proteins in central metabolic redox pathways in the model, genetically accessible, hyperthermophilic archaeon Thermococcus kodakarensis , were purified to reveal an extensive, dynamic, and tightly interconnected network of protein interactions that responds to environmental cues (such as the availability of various reductive sinks) to direct electron flux to maximize energetic gains. Interactions connecting disparate functions suggest many catabolic and anabolic activities occur in spatial proximity in vivo , and while protein complexes have been historically defined under optimal conditions, many of these complexes appear to maintain alternative partnerships in changing conditions. The totality of the results obtained redefines our understanding of in vivo assemblies driving ancient metabolic strategies supporting the growth of modern Archaea. IMPORTANCE Given the potential for rational genetic manipulations of biofuel- and biotech-promising archaea to yield transformative results for major markets, it is a priority to define how the metabolisms of such species are controlled, at least in part, by in vivo protein assemblies, and from such, define routes of energy flux that can be most efficiently altered toward biofuel or biotechnological gains. Proteinaceous electron carriers (PECs, such as ferredoxins) offer the potential for specific protein–protein interactions to coordinate selective reductive flow. Employing the model, genetically accessible, hyperthermophilic archaeon, Thermococcus kodakarensis , we establish the metabolic protein interactome of 25 key redox proteins, revealing that each redox active protein has a dynamic partnership profile, suggesting catabolic and anabolic activities may occur in concert and in temporal and spatial proximity in vivo . These results reveal critical importance in evaluating the newly identified partnerships and their role and utility in providing regulated redox flux in T. kodakarensis .

Williams, Sere A. (ORCID:0000000235509590)↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2024

7-8 GHz Point-to-Point Testing

Wireless spectrum is a limiting resource for continued economic growth in the United States. As discussed in the recent National Spectrum Strategy (NSS), wireless spectrum underpins several aspects of the U.S. economy and the demand for additional spectrum is driving the need for realizing spectrum sharing to enable continued development. At the same time, wireless spectrum is an essential foundation of critical energy infrastructure, including electric, oil, and natural gas resources. In particular, wireless point-to-point (P2P) links are the backbone of vast infrastructure networks that enable the flow of sensor and control information needed to manage critical energy sector infrastructure in the United States. These links will only become more important as the energy sector incorporates more diverse sensing and more efficient control mechanisms, which increases system complexity and data volume requiring more resilient communications. Therefore, the continued economic development of the U.S. depends on determining novel approaches to spectrum management that balance both broad access for advanced wireless technologies and resilience for critical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗