Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Storage System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Optimal Coordination of Distributed Energy Resources Using Deep Deterministic Policy Gradient

Recent studies showed that reinforcement learning (RL) is a promising approach for coordination and control of distributed energy resources (DER) under uncertainties. Many existing RL approaches, including Q-learning and approximate dynamic programming, are based on lookup table methods, which become inefficient when the problem size is large and infeasible when continuous states and actions are involved. In addition, when modeling battery energy storage system (BESS), the loss of life is not reasonably considered into the decision-making process. This paper proposes an innovative deep RL method for DER coordination considering BESS degradation. The proposed deep RL is designed based on an adaptive actor-critic architecture and employs an off-policy deterministic policy gradient method for determining the dispatch operation that minimizes the operation cost and BESS life loss. Case studies were performed to validate the proposed method and demonstrate the effects of incorporating degradation models into control design.

Das, Avijit↗
DOE OSTI2023

Measurement and applications: Exploring the challenges and opportunities of hierarchical federated learning in sensor applications

Sensor applications have become ubiquitous in modern society as the digital age continues to advance. AI-based techniques (e.g., machine learning) are effective at extracting actionable information from large amounts of data. An example would be an automated water irrigation system that uses AI-based techniques on soil quality data to decide how to best distribute water. However, these AI-based techniques are costly in terms of hardware resources, and Internet-of-Things (IoT) sensors are resource-constrained with respect to processing power, energy, and storage capacity. These limitations can compromise the security, performance, and reliability of sensor-driven applications. To address these concerns, cloud computing services can be used by sensor applications for data storage and processing. Unfortunately, cloud-based sensor applications that require real-time processing, such as medical applications (e.g., fall detection and stroke prediction), are vulnerable to issues such as network latency due to the sparse and unreliable networks between the sensor nodes and the cloud server [1]. As users approach the edge of the communications network, latency issues become more severe and frequent. A promising alternative is edge computing, which provides cloud-like capabilities at the edge of the network by pushing storage and processing capabilities from centralized nodes to edge devices that are closer to where the data are gathered, resulting in reduced network delays [2], [3].

Po-Leen Ooi, Melanie↗
DOE OSTI2025

A Convolution Neural Network for Voltage Event Classification at a Photovoltaic Inverter

This paper presents a convolutional neural network (CNN) developed to identify voltage events in photovoltaic (PV) inverters. The CNN is trained on synthetic data generated using the IEEE 13-bus distribution feeder model and evaluated on field measured data collected from Energy Northwest’s Horn Rapids Solar, Storage, and Training (HRSST) facility. The study focuses on two common voltage events: faults and voltage sags. The CNN is configured to analyze voltage and current waveforms from three-phase PV systems, demonstrating excellent accuracy during training. Field data from the HRSST facility is employed to assess its real-world performance, where the CNN achieves perfect identification of faults and voltage sags in a sample of nine events. This work highlights the potential of the proposed method to enhance PV protection schemes, providing a robust foundation for improved voltage event detection and grid reliability.

Cornachione, Matthew A.↗
DOE OSTI2026

Oversizing and Part-Load Problems

Oversizing, the common engineering practice of specifying devices with capacity exceeding the actual load requirement, is a widespread practice across virtually all building technologies end-use categories, including HVAC, electrical systems, lighting, appliances, and plug loads. This practice, driven by factors like design uncertainty, institutional pressures, and risk aversion, results in wasted capital investment, control difficulties, and excessive energy consumption due to inefficient part-load operation. Part-load operation, where devices run below maximum capacity, is the dominant operating mode in most energy systems and presents a complex design challenge. Solutions to match output to load fall into three broad categories: constraining the output, adjusting the device’s internal behavior, and linking output to energy storage or other waste-heat reuse applications. The energy implications of part-load are critical, as efficiency often drops sharply as load decreases across a wide diversity of devices. To quantify the extent of this problem, we derive a dimensionless Part-Load Metric (PLM) based on device efficiency and its frequency distribution of operating hours at various output levels. The PLM quantifies the deviation of a device's actual efficiency from its maximum design efficiency. This metric also serves as a measure of "capital inefficiency," enabling engineers to compare the impact of different part-load solutions and providing a unified framework for evaluating performance across various devices and systems.

Meier, Alan↗
DOE OSTI2024

Leveraging Existing Assets for Long Duration Energy Storage

Increased renewables penetration to electrical grid is necessary to reduce overall emissions from the electrical power generation sector. Nonetheless, its integration creates challenges to grid operators who must match the power being generated by intermittent renewables and other traditional energy sources with the demand from consumers, while ensuring the reliability and power quality for the entire system. Energy storage has been proposed as an alternative to natural gas peaking plants and a form to deliver excess renewable energy generation at times of peak demand. For energy storage to provide benefits to end customers (energy consumers), it must be reliable, efficient, and cost effective. The Illinois Sustainable Technology Center (ISTC), one of the surveys that integrate the Prairie Research Institute (PRI), aims to develop a Center for Energy Storage at Existing Assets (CESEA) at UIUC with the participation of Waste Pressure Corp and Ecotek Engineering USA LLC. CESEA will focus on LDES systems that can integrate to existing infrastructure in a manner that reduces the initial capital expenditure and demonstrates the ability to repurpose fossil assets that would otherwise become stranded, to serve the energy transition. CESEA aims to leverage UIUC’s unique facilities to validate LDES systems performance at a relevant operating environment. UIUC’s facilities include a 85-MW combined heat and power (CHP) power plant, two (2) solar PV plants totaling over 18 MWdc of installed capacity, an electrical grid along with a substation at transmission and distribution voltages, a 22-mile gas pipeline network operating at two pressure levels, along with steam and chilled water distribution networks. The new LDES systems will connect to the existing UIUC grid through a new test electrical station, which will have the capacity to accommodate additional connections to test new devices and technologies as part of future CESEA R&D activities. The test electrical station will contain meters, instrumentation, and controls to accurately capture data and allow optimization of control algorithms. CESEA will initially focus on technologies that: i) utilize existing equipment or facilities to perform at least one of the process steps in LDES (charging, storage, or discharging), ii) leverage mature or commercially available components or controls, iii) show potential for cost-leadership in 10+ hour storage at a commercial scale. Initial technologies that were identified to meet these criteria include Compressed Gas Energy Storage (CGES), and TES. CGES stores electricity by raising the pressure of a compressible gas inside a control volume and converting the stored energy to electricity via expansion-generation. CGES is a generalization of CAES that covers any working gas (not just air). A successful CGES demo will help to circumvent many challenges faced by CAES (long development times due to site prospecting, high cost of compression and storage, heat recovery management, etc.) by: 1) utilizing existing infrastructure (compressors, pipelines, underground storage or pressure vessels) used in the transportation and storage of industrial gases for LDES charging and storage; 2) deploying over sites already-developed for industrial applications with minor additional work; 3) leveraging the price structure of commercial industrial gas to cover the costs of electricity used during charging. A previous DOE-sponsored conceptual study (DE-FE-0032018) estimated the levelized cost of energy of a 1.1 MW / 17 MWh CGES system at $0.08/kWh, with a commercial 10x scale system cost estimated at <$0.04/kWh (Giardinella, 2022). The pilot-sized system was estimated to avoid up to 2693 tons of CO2/year.

25 ENERGY STORAGE↗
DOE OSTI2023

Distributed clean energy opportunities for US oil refinery operations

The oil and gas industry is increasingly seeking operational improvements to reduce costs and emissions while improving resilience. This study describes techno-economic analysis of opportunities for distributed energy resources that could be integrated to support oil and gas companies’ economic, environmental, and energy resiliency goals. Specifically, the analysis evaluates solar photovoltaics, wind turbines, battery energy storage, landfill gas, biomass, municipal solid waste-to-energy, solar steam for process heat, combined heat and power, and electrolyzers for hydrogen production at two hypothetical refineries, one located in Louisiana and the other in southern California. These technologies could reduce the sites’ consumption of grid electricity and/or natural gas and thus can help reduce emissions. This study employs the ReOPT tool and System Advisor Model to evaluate the techno-economic potential for clean energy technologies to support refineries in achieving energy goals, including energy cost savings, resiliency, and emissions reductions. Results indicate that the associated costs of emissions reductions via several distributed clean energy technologies are competitive with other emissions reduction strategies such as energy efficiency, reducing flaring, direct carbon capture and sequestration, and markets under certain conditions. There are also cost beneficial opportunities for the use of renewable energy for refining, especially for resilience, depending on local conditions such as resources and utility costs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Groundwater and Surface Water Flow (GSFLOW) model files to explore bedrock circulation depth and porosity in Copper Creek, Colorado

This data package contains integrated hydrological model input and output files for Copper Creek, Colorado (24 km2), a tributary of the East River located in the headwaters of the Upper Colorado River Basin. The model code is the U.S. Geological Survey (USGS) Groundwater and Surface Water Flow (GSFLOW) model. The model contains a 100-m grid resolution and a daily timestep. The land surface model is dynamically linked to a three-dimensional groundwater flow model that allows for streamflow gaining and losing conditions. The groundwater model contains 12 model layers and extends 400 m below land surface. The original Copper Creek model was modified to contain geologic layers representing saprolite, shallow bedrock, and deep bedrock. Endmember depth versus hydraulic conductivity relationships and porosity values for fractured crystalline rock are simulated. For the shallow case, median flow depths occur in the shallow saprolite at depths <8 m, while the deep case promotes a median groundwater flow depth of 100 m. With this modeling framework we compare streamflow response to a plausible worst-case drought lasting up to five years. Streamflow metrics of analysis include average streamflow, fraction of stream network that is dry, no-flow duration, average groundwater flow to streams and time to recovery following the drought. Results and implications are presented in a paper submitted to Geophysical Research Letters titled, "The role of bedrock circulation depth and porosity in mountain streamflow response to prolonged drought" by Rosemary WH. Carroll, Andrew H. Manning and Kenneth H Williams. A Readme.txt file provides instructions on how to download all model files and execute each model scenario. In addition to the GSFLOW output/prms/copper_drought.csv file containing daily basin water stores and fluxes (refer to GSFLOW manual) and the output/prms/copper_drought_statvar.dat file with output defined in the gsflow3.control file (refer to GSFLOW Manual), output files also include spatially distributed daily values of total evapotranspiration, canopy evaporation, precipitation, snowfall, infiltration, snow water equivalent, potential evapotranspiration, recharge, sublimation, soil moisture, contributing interflow, water table elevations, changes in groundwater storage, groundwater evapotranspiration, interbasin groundwater flow (limited to the alluvium below the stream outlet), and surface-groundwater exchanges within the river system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Will Solar Panels Help When the Power Goes Out? Planning for PV Resilience

PV systems, like all energy systems, must chart a difficult course in order to improve resilience. They need to simultaneously withstand extreme conditions that cause grid power disruptions, be configured in a way that allows electricity to be delivered to meet the PV user's needs, and overcome disruptions arising from solar resource intermittency. Certain considerations reveal themselves as key to a PV system's resilience benefits. Choice of hardware is critical, as is site selection for the PV array. Voluminous evidence in a hurricane context demonstrates that durable hardware, properly maintained and sited, leads to PV systems surviving extreme weather with their functionality intact. Structurally weak or poorly maintained PV equipment, on the other hand, has demonstrated failures during extreme weather events. PV system stakeholders should ensure that best practices are followed for hardware procurement and siting. It is also important to understand that PV systems are not one-size-fits-all. While incorporating islanding capabilities and energy storage into the system's electrical topology will typically enhance resilience, the user's needs will determine the optimally resilient conformation of any given system. These factors - appropriate hardware, siting, maintenance, and system design - are the primary drivers of PV resilience. PV systems possess high potential for resilient energy generation due to their distributed, abundant, and free fuel supply, but the technology itself does not inherently lead to resilient outcomes. Realizing PV's potential for resilience requires consideration of these determinative factors.

14 SOLAR ENERGY↗
DOE OSTI2021

Analyzing the Economic and Technical Potential of H2@Scale

H2@Scale is one of EERE's flagship initiatives to enable clean and affordable hydrogen production, storage, distribution, and utilization across multiple sectors in the economy. The January H2IQ hour will discuss results from a recent multi-laboratory analysis report quantifying the technical and economic potential of H2@Scale, given the use of hydrogen as an energy intermediate to integrate sectors in the U.S. energy system. Mark Ruth of the National Renewable Energy Laboratory, the lead author of the report, will discuss specific examples of the role hydrogen can play in industry and transportation sectors, such as steelmaking, synthetic fuels, and blending into natural gas pipelines. He will also explain how hydrogen production can be integrated with the electric grid to monetize low-cost energy and incentivize growth in renewable energy supply. The H2IQ Hour will dive into estimates for future hydrogen consumption in current and emerging sectors, given R&D advances and varying prices of natural gas and electricity.

39 EE - Hydrogen and Fuel Cell Technologies (EE-3F↗
DOE OSTI2022

A continuum model for heat and mass transfer in moving-bed reactors for thermochemical energy storage

In this work, a continuum heat and mass transfer model coupling transport phenomena and high-temperature thermochemical reactions is developed for stationary packed-bed and counter-flow moving-bed reactors. After presenting the general modeling framework, we focus on the 2D axisymmetric version of the model for which validation is conducted with experimental results for a packed-bed reactor in the literature for manganese-iron oxide reduction/oxidation and an in-house counter-flow moving-bed reactor for magnesium-manganese oxide reduction up to 1450 °C. Transient simulation results including the local distributions of gas/solid temperatures, oxygen concentration and the extent of reaction, as well as the various energy flow components and energy conversion efficiencies are reported. The results based on the 2D axisymmetric model are also compared with those obtained from a previous 1D model. The comparison shows that capturing the radial variation is critical in reactor modeling and the 2D results demonstrate improved agreement with experiments. Specifically, large temperature variations along the radial direction are observed especially in the reaction zone; this non-uniform radial temperature distribution has a significant effect on the chemical reaction extent due to its strong dependence on temperature; and the overall oxygen concentration at the reactor exit and the predicted system efficiency are slightly lower in the 2D model compared to the 1D model. Finally, the present heat and mass transfer model can provide valuable insights into reactor design, scale-up, and operating conditions selection to maximize system energy storage efficiency.

25 ENERGY STORAGE↗
DOE OSTI2021

Resilience and economics of microgrids with PV, battery storage, and networked diesel generators

Current designs and assessments of microgrids have ignored component reliability, leading to significant errors in predicting a microgrid’s performance while islanded. Existing life cycle cost studies on hybrid microgrids—which combine photovoltaics (PV), battery storage and networked emergency diesel generators—also have not identified all the potential economic opportunities. Reducing the number of emergency diesel generators through reliance on PV and battery, retail bill savings, and demand response and wholesale market revenue streams are all important. This paper provides a new statistical methodology that calculates the impact of distributed energy reliability and variability on a microgrid’s performance and a novel use of the optimization platform REopt to explore multiple cost savings and revenue streams. We examine the impacts for microgrids in California, Maryland, and New Mexico and show that a hybrid microgrid is a more resilient and cost-effective solution than a diesel-only system. Under realistic conditions, a hybrid microgrid can provide higher system reliability when islanded and have a lower life cycle cost under multiple market conditions than a traditional diesel generator-based system. The improved performance of the hybrid system is resilient to conditions experienced over the last 20 years in solar irradiance and sees little degradation in performance immediately after a hurricane. The cost savings to provide this more resilient backup power system as compared to a diesel-only microgrid are significant. The net present cost for a hybrid microgrid is 19% lower in New Mexico and 35% lower in Maryland than a diesel-only microgrid. In California, the net present cost of the hybrid microgrid is negative because, unlike a diesel-only microgrid, a hybrid microgrid has lower life cycle costs than the power costs without a microgrid.

25 ENERGY STORAGE↗
DOE OSTI2020

Demonstration of μCHP in Light Commercial Hot Water Applications

Internal combustion engine driven combined heat and power (CHP) systems produce power while the waste heat is recovered and used for another purpose. For µCHP systems (less than 50kWe output) overall efficiencies can reach over 90% for products currently on the market throughout the world. On a fuel basis this offers an advantage over using grid-based power and another fuel for heat. Additionally, the cost of natural gas on an energy unit basis is significantly less expensive than electric power. This difference can lead to substantial savings for the end user of a CHP system. In some parts of the world, particularly Germany and Japan, µCHP has become a common part of the heat and distributed generation equipment mix. Market analysis conducted in 2012 showed that in North America there is potential of a 5,300 units per year market for µCHP, resulting in an annual energy savings of approximately 13.5 TBtu and more than $84 million in annual customer savings. However, µCHP still has not seen much market penetration in North America. This study helps to identify some of the reasons why, address roadblocks that still need to be overcome and provide experience to established best practices. Nine commercial sites were initially identified (fitness club, surgical center, senior community, resort and spa, commercial laundry, two multi-family housing, restaurant and manufacturing facility). Systems from two different manufacturers were installed at five sites total, but due to unforeseen circumstances, only three of those sites were finally commissioned: test data were collected by Oak Ridge National Laboratory. While not all systems were installed as intended, the project resulted in the following key findings: Micro combined heat and power is an unfamiliar technology for building owners and plumbing and electrical contractors that serve the buildings most suited for µCHP. Manufacturers will need to be aggressive in providing training and providing broad support to successfully bring the technology to market.; The proper integration of µCHP into other building systems is the most critical part of a successful installation. Manufacturers will need to be able to provide the expertise to train, advise and support the mechanical contractors during the design and installation of the heat integration system.; Regulations governing µCHP varies across the country. There are a few UL standards (UL 2200 and UL 1741) that apply nationally. Emissions are governed by EPA except in California where the California Air Resources Board (CARB) has established their own standard. Requirements that dictate installation and interconnection are dependent on local building codes and local utility processes and requirements. Some out of date building codes do not offer clear guidance for these requirements, leading to confusion. This makes developing training and determining broadly applicable best practices difficult.; Installation costs of µCHP are a key factor in making an installation successful. It is critical that these costs and all national, state and local regulations be understood and accounted for by all parties involved in the installation before a project is undertaken.; A robust customer service organization is important to meet the needs of the customers. These systems require annual maintenance and service and local capability is needed to keep costs inline.

03 NATURAL GAS↗
DOE OSTI2020

Enabling a Flexible Grid with Increased Penetration of DER: Techno-economic Analysis of Metal Hydride Thermochemical Energy Storage Integrated with Stirling Engine for Grid Energy Storage Applications

This report summarizes the results of a techno-economic assessment of the capital and operational expenses for 3 scenarios utilizing a TES/Stirling engine system which is charged by an electric heater to provide grid power and energy storage. While there are several integration possibilities and material choices that could be utilized in such systems, three difference scenarios were chosen for this assessment to reflect an anticipated deployment of the technology where each might require different TES system configurations. Additionally, an enhanced version of the HTMH is considered to demonstrate the expected impact on costs with further technology development. The predicted capital and operational LCOS for the system configurations range from $0.0198/kWhr e - $0.0734/kWhr e which compare positively to the LCOS for lithium ion battery storage ranging from $0.087/kWhr e – $0.329/kWhr e . The key drivers for cost improvements to the system are material property enhancements in the HTMH primarily related to reducing the costs associated with the HTMH vessel and heat exchangers. This analysis demonstrates the potential benefits and flexibility of integrating a Stirling engine with a metal hydride-based TES system and suggests that the MH TES technology, at its current level of development, provides a highly competitive alternative to lithium ion batteries for large scale grid energy storage applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Multi-Source Data Aggregation and Real-Time Anomaly Classification and Localization in Power Distribution Systems

This paper proposes a real-time anomaly location and classification framework for power distribution systems to simultaneously determine the type of anomaly (i.e., short-circuit fault, cyber attack, DER switching) and its location. The proposed framework employs the data aggregation module to collect the measurement data from multiple field devices operating at different sampling rates, such as protection relays and D-PMUs. The output of the data aggregation is then fed into a multi-task learning-based long-based short-term memory (MTL-LSTM) to classify the type of anomaly and the location in two separate tasks. The proposed MTL-LSTM approach can be utilized in real-time operation in order to distinguish between normal and several anomalous operations and locate the anomaly. The proposed framework is tested on a modified IEEE 33-bus test feeder benchmark that integrates solar generation and energy storage. Furthermore, the results show that the proposed framework can locate and classify anomalies for several operation conditions with more than 96% accuracy. Further experiments highlight the impact of aggregating multiple sources of data on the performance of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Cybersecurity Standards for Distributed Energy Resources: Gaps and Harmonization Strategy

This report examines cybersecurity standards for Distributed Energy Resources (DERs) in light of their rapid growth and increasing integration into energy systems. It identifies critical gaps in existing frameworks, including inadequate coverage of DER-specific challenges, complexities in implementing comprehensive standards, integration issues with legacy systems, adoption hurdles for newer standards, and a lack of harmonization across regulatory landscapes. The analysis highlights vulnerabilities such as data integrity risks, unauthorized device control, and denial-of-service attacks across various DER technologies like solar PV, wind turbines, energy storage systems, and hydrogen fuel cells. The report proposes a harmonization strategy to address these deficiencies by developing unified cybersecurity requirements, certification programs, and training resources while fostering collaboration among stakeholders such as government agencies, industry groups, DER operators, manufacturers, and research institutions. A phased roadmap is outlined to refine and implement these measures through pilot testing and widespread adoption. Ultimately, the report underscores the urgent need for coordinated efforts to enhance DER cybersecurity and ensure the reliable operation of future energy systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Empowering Rural Electrification in Honduras: An Integrated Assessment of PV/BESS and Productive Uses of Electricity in Gracias a Dios

Honduras faces significant challenges in its energy sector, particularly in rural areas where access to reliable and affordable electricity remains limited. The flagship rural electrification initiative for Honduras Secretary of Energy (SEN) is the Politica de Acceso Universal a la Electricidad (PAUEH - Universal Electricity Access Policy), a key solution for addressing this energy poverty is the deployment of more than 1700 distributed solar and hybrid mini-grid solutions. In late 2023 as a first step towards supporting SEN's electrification efforts, the National Renewable Energy Laboratory (NREL) developed a literature review of SEN electrification policy documents and conducted a series of technical capacity-building workshops with SEN and other energy sector stakeholders in Honduras focused on using NREL's open-source REopt tool to conduct techno-economic assessments and develop least-cost optimizations for potential solar + storage mini-grid systems. Building on some initial capacity building on mini-grid modeling, the National Renewable Energy Laboratory (NREL) worked with SEN to develop a detailed techno-economic assessment for electrifying two schools, a healthcare clinic, and a hospital in a hypothetical community within the department of Gracias a Dios. The analysis also evaluates the business case for cold storage productive use of energy (PUE) applications for the fisheries value chain and how the incorporation of these PUE loads potentially impacts both the viability of the PV+BESS solutions as well as local economic development. By assessing the potential for deployment of integrated PV/BESS systems to both support critical community services like education and healthcare, as well as potential for downstream enterprise and economic development, this analysis represents a first step that can help to inform specific strategies for development of pilot PV+BESS projects aligned with national priorities and sector level planning under PAUEH.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

A Data-Driven Algorithm for Enabling Delay Tolerance in Resilient Microgrid Controls Using Dynamic Mode Decomposition

The increased implementation of smart grid technologies in the power distribution grid presents unique opportunities that enable resiliency, but also brings challenges motivating needs for novel solutions and mitigation techniques. The bi-directional power and data flow allow for the grid to operate with increased resiliency, which is the ability to avoid discontinuity of service to end-use loads during extreme events. However, in applications where control of the distribution grid or microgrid relies on communication networks, the degradation of communication systems in the form of loss or high latency can cause maloperation and result in loss of end-use loads. Here this paper presents a novel framework to enable delay tolerance of centralized microgrid control schemes to mitigate communication system latency impacts and guarantee successful control action. We demonstrate the delay tolerance on a control scheme that operates a battery energy storage system (BESS) to offset the sudden loss of generation and maintain system frequency. During periods of severely degraded communication system performance, the proposed delay-tolerant algorithm compensates for the latency by utilizing a data-driven model generated at the device level using dynamic mode decomposition (DMD) to determine the performance of the communications. The DMD technique predicts the system’s frequency using device-level terminal measurements and provides updated control signals. The HELICS cosimulation platform evaluates the cyber-physical interaction of the power system model in GridLAB-D, the centralized control agent in Python, and the discrete network model in NS-3. The framework is tested and validated on the IEEE-123 node system modified to represent a networked remote microgrid model, and the results show an improvement in the dynamic performance

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗