Search NASA⌕ Search

SEARCH · Search NASA

Results for “load following”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Cs absorption capacity and selectivity of crystalline and amorphous Hf and Zr phosphates

Removal of radioactive Cs from sodium-rich solutions is a technical challenge that goes back to post World War II nuclear waste storage and treatment; and interest in this topic was reinvigorated by the Fukushima-Daiichi nuclear power plant disaster, 10 years ago. Since the 1960's there has been considerable focus on layered Zr phosphates as robust inorganic sorbents for separation of radionuclides such as Cs. Here we present synthesis and characterization, and direct comparison of Cs sorption capacity and selectivity of four related materials: 1) crystalline α-Zr phosphate and α-Hf phosphate, and 2) amorphous analogues of these. Powder X-ray diffraction, thermogravimetry, solid-state 31P magic angle spinning nuclear magnetic resonance (MAS-NMR) spectroscopy, and compositional analysis (inductively coupled plasma optical emission spectroscopy and mass spectroscopy, ICP OES and ICP MS) provided formulae; respectively M(HPO4)2∙1H2O and M(HPO4)2∙4H2O (M = Hf, Zr) for crystalline and amorphous analogues. Maximum Cs loading, competitive Cs-Na selectivity and maximum Cs-Na loading followed by the above characterizations plus 133Cs MAS-NMR spectroscopy revealed that amorphous analogues are considerably better Cs-sorbents (based on maximum Cs-loading and selectivity over Na) than the well-studied crystalline Zr-analogue. Additionally, crystalline α-Hf phosphate is better Cs-sorbent than crystalline α-Zr phosphate. All these studies consistently show that Hf phosphate is less crystallize than Zr phosphate, when obtained under similar or identical synthesis conditions. We attribute this to lower solubility of Hf phosphate compared to Zr phosphate, preventing ‘defect healing’ during the synthesis process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Environmental Validation of Materials and Design Concepts to Enable Operational Flexibility of Existing Coal Power Plants

Increasingly, coal-fired power plants are required to balance power grids by compensating for the variable electricity supply from renewable energy sources. Fossil-fueled power plants, originally designed to be base loaded, will increasingly need to operate on a load following or cyclic basis. This demanding requirement for operational flexibility will need to be evaluated for resilience to frequent start-ups, meeting major and rapid load changes, and providing frequency control duties. Our research objective was to evaluate and improve flexibility of existing power plants by improving and redesigning components and defining new operational strategies, with acceptable impacts on component life, efficiency and emissions.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2021

Nontargeted vs. Targeted vs. Smart Load Shifting Using Heat Pump Water Heaters

Deployment of CTA-2045–enabled devices is increasing in the U.S. market. These devices allow utilities or third-party aggregators to control appliance energy use in homes, and could also be applied to end uses in small commercial buildings. This study focuses on a field study using CTA-2045–enabled water heaters to shift electric load off the peak and toward periods when renewable resources are more prevalent (e.g., near noon for solar resources and near midnight for wind resources). The following load shifting strategies were compared to understand effects on the aggregate load-shifting capabilities of Heat Pump Water Heaters (HPWHs) and on consumer hot water supply: non-targeted (traditional), targeted (grouped, with different shifting schedules) and “smart” (adaptive control commands). The results of this study show that targeted and smart control strategies yield significantly more load-shifting potential from a population of water heaters than the non-targeted approach without sacrificing hot water supply to occupants. However, as control commands become more aggressive, aggregators may face challenges in meeting consumer hot water demand. Furthermore, the findings and lessons learned can benefit electric utilities and inform updates to manufacturer controls and communications standards. The data collected may also be useful for developing and validating HPWH models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Predictive modeling of a subcritical pulverized-coal power plant for optimization: Parameter estimation, validation, and application

As renewable power generation deployment increases, fossil fuel plants are increasingly required to operate more flexibly. Many coal-fired power plants were originally designed to operate at base load and do not operate optimally at partial load. Predictive first-principles plant-wide models can be employed to identify opportunities for flexibility improvements and diagnose low-load operating issues. This paper describes the application of the Institute for the Design of Advanced Energy Systems Integrated Platform (IDAES) to model and optimize flexible power plant operations. The key benefits of using IDAES are that it provides an open-source, fully equation-oriented modeling framework for efficient modular model construction, reuse, and customization, together with a mathematical optimization framework leveraging powerful, state-of-the-art solvers. The process systems engineering workflow from predictive process simulation to parameter estimation, model validation, and plant optimization is applicable to a variety of existing and next-generation energy systems as well as other chemical and environmental processes. Here, to demonstrate this capability, a physics-based, steady-state model was developed to improve full- and part-load performance of the Escalante Generating Station, a 245 MWe (net) subcritical pulverized coal-fired power plant owned and operated by Tri-State Generation and Transmission Association. Specifically, sixty-nine model parameters were simultaneously estimated from several months of operating data enabling prediction of flow rates, temperatures, pressures, and steam quality throughout the plant. The validated model was leveraged by Escalante to reduce the minimum operating load from 90 MW to 50 MW by diagnosing a low-load water-hammer issue, enabling coal usage and emissions reductions during periods of low power demand. Additionally, opportunities for heat rate reduction (i.e., efficiency improvement) through a steeper sliding-pressure approach to load-following and optimization of other boiler operating variables were also identified and quantified. For example, a potential efficiency improvement of 0.7 percentage points was observed at half-load operation.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2020

Sandia Nuclear Cartridge Concept

Nuclear power offers the promise of long-term electrical power for remote areas. Recent advances in passive safety and long-life cores make a reactor that can be operated autonomously for 20 years or more a real possibility. This white paper discusses a reactor concept that offers the potential for further development, resulting in a permanently hermetically-sealed "nuclear cartridge." The term "nuclear cartridge" is meant to imply a nuclear energy source that can be inserted into a site and operated autonomously until its energy has been depleted, then withdrawn and replaced by another cartridge. The concept can be scaled for various sizes, ranging from about 1 megawatt-electric (MWe) to about 100 MWe. The paper also discusses the concept of Integrated Safety, Operations, Security, and Safeguards (ISOSS) by design as it applies to this reactor design. Finally, a discussion of smart grids and how they can benefit the transfer of power to the end user is included. The Nuclear Cartridge concept has been developed with the following characteristics in mind: highly reliable autonomous operation coupled with international monitoring, requiring minimal on-site operations personnel; walkaway passively safe design; cartridge replacement cycle on the order of 20 years; load following capability; physical security by design requiring minimal security personnel during operations; and proliferation resistance by design. As illustrated in figure 1, integrating the reactor with advanced power conversion, smart grids, and other sources of energy results in a resilient and sustainable energy source.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗
DOE OSTI2021

Assessing the Impacts of Recent Crop Expansion on Water Quality in the Missouri River Basin Using the Soil and Water Assessment Tool

The Missouri River Basin (MORB) has experienced a resurgence of grassland conversion to crop production, which raised concerns on water quality. We applied the Soil and Water Assessment Tool (SWAT) to address how this conversion would impact water quality. We designed three crop production scenarios representing conversion of grassland to: (a) continuous corn; (b) corn/soybean rotation; and (c) corn/wheat rotation to assess the impact. The SWAT model results showed: (a) the lower MORB produced high total nitrogen (TN) and total phosphorus (TP) load before conversion (baseline) due mainly to high precipitation and high agricultural activity; (b) the greatest percentage increases of TN and TP occurred in the North and South Dakotas, coinciding with the highest amount of grassland conversion to cropland; and (c) grassland conversion to continuous corn resulted in the greatest increase in TN and TP loads, followed by conversion to corn/soybean and then conversion to corn/wheat. Although the greatest percentage increases of TN and TP occurred in the North and South Dakotas, these areas still contributed relatively low TN and TP to total basin loads after conversion. However, watersheds, predominantly in the lower MORB continued to be “hotspots” that contributed the greatest amounts of TN and TP to the total basin loads—driven by a combination of grassland conversion, high precipitation, and loading from pre-existing cropland. At the watershed outlet, the TN and TP loads were increased by 6.4% (13,800 t/yr) and 8.7% (3,400 t/yr), respectively, during the 2008–2016 period for the conversion to continuous corn scenario.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Exploring the parameter space of MagLIF implosions using similarity scaling. III. Rise-time scaling

Magnetized liner inertial fusion (MagLIF) is a z-pinch magneto-inertial-fusion concept studied at the Z Pulsed Power Facility of Sandia National Laboratories. Two important metrics characterizing current delivery to a z-pinch load are the peak current and the current-rise time, which is roughly the time interval to reach the peak current. It is known that, when driving a z-pinch load with a longer current-rise time, the performance of the z-pinch decreases. However, a theory to understand and quantify this effect is still lacking. Here, in this paper, we utilize a framework based on similarity scaling to analytically investigate the variations in the performance of MagLIF loads when varying the current-rise time, or equivalently, the implosion timescale. To maintain similarity between the implosions, we provide scaling prescriptions of experimental input parameters defining a MagLIF load and derive the expected scaling laws for stagnation conditions and for various performance metrics. We compare predictions of the theory to 2D numerical simulations using the radiation, magneto-hydrodynamic code hydra. For several metrics, we find acceptable agreement between the theory and simulations. Our results show that the voltage φload near the MagLIF load follows a weak scaling law φload ∝$t_{φ}^{-0.12}$ with respect to the characteristic timescale t φ of the voltage source, instead of the ideal φload ∝$t_{φ}^{-1}$ scaling. This occurs because the imploding height of the MagLIF load must increase to preserve end losses. As a consequence of the longer imploding liners, the required total laser preheat energy and delivered electric energy increase. Overall, this study helps understand the trade-offs of the MagLIF design space when considering future pulsed-power generators with shorter and longer current-rise times.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗
DOE OSTI2022

Advanced CO 2 Capture Solvent Systems for Dynamic Power Generation

RTI International, in collaboration with Pacific Northwest National Laboratory (PNNL), Carbon Capture Simulation for Industry Impact (CCSI 2 ), Electricity Power Research Institute (EPRI), and West Virginia University (WVU), successfully completed a joint research effort in developing a cost-effective, resilient, load-following advanced CO 2 capture technology for natural gas power plants. The project’s objective was to develop a CO 2 capture process that maximizes the net present value (NPV) of the electricity sale by minimizing the levelized cost of electricity (LCOE) under dynamic plant loads and high renewable penetration environments. The two key innovations developed in this project were the use of (i) advanced water-lean solvents (WLSs) and (ii) process intensification equipment, such as a rotating packed bed (RPB) absorber and dual-stage flash regeneration. The process’s low CO 2 capture cost is realized through WLSs’ low energy required for solvent regeneration, which lowers the operating cost while RPBs intensify the absorption process and reduces the power plant capital cost. A suite of advanced computational and simulation packages was implemented to guide the process design, validate the dynamic response of the capture plant, evaluate system-wide performance, and maximize the power plant’s profit. The project also engaged with power producers and other stakeholders to ensure its technical relevance and techno-economic viability. The development of this highly disruptive CO 2 capture technology could accelerate the industry adoption and thereby lower the greenhouse gas emissions of the U.S. power sector. Deployment of this technology can increase the reliability and decrease the cost of electricity generation in the U.S. by enabling the use of low-carbon fossil fuels to balance fluctuations of renewable energy availability.

03 NATURAL GAS↗
DOE OSTI2022

Characterization of Temperature Heterogeneity in Utility-Scale Power Plant Boilers by Spatially Distributed Ultrasonic Measurements

In extreme environments, even hardened insertion sensors fail quickly. For such environments, we have developed an ultrasonic (US) method for measuring the spatial distribution of temperatures in solid materials and, specifically, across containments of extreme processes. By deploying US sensors in multiple locations, spatial heterogeneity in temperatures inside harsh environments may be characterized. In this note, we update our progress on testing the developed approach in an industrial setting and its performance in describing the temperature distribution inside a 500 MW (electrical) coalfired utility boiler of an electrical power generation plant. We use waveguides (WG) structured to contain echogenic features that produce a train of echoes in response to an excitation pulse. The time of flight between echoes encodes the information on the temperature distribution in the corresponding segment of the WG, which we reconstruct using its parametrization. Five waveguides were welded to the boiler’s heat exchange surface (waterwall) and different locations at the same boiler elevation and produced reliable US waveforms 18 months after the installation. For several weeks during the latest trial, we performed US measurements in five locations spanning half of the boiler’s 14-meter width. The measurements were acquired during regular operation, including load cycling to adjust for demand and intermittent contributions of renewable power sources, and during boiler shutdown for emergency maintenance and the subsequent restart. The interpretation of US waveforms by signal processing resulted in an accurate estimation of temperature distribution along the waveguides. We captured daily cyclical variations in demand-following load. Measurements performed in multiple locations revealed unexpected temperature variations across the boiler. We conclude that an array of developed sensors can provide responsive and spatial temperature measurements while maintaining functionality despite prolonged exposure to an extreme environment.

Walton, Kenneth↗
DOE OSTI2023

Modeling and control of nuclear–renewable integrated energy systems: Dynamic system model for green electricity and hydrogen production

The need for decarbonization and diversification of energy resources has led to the development of integrated energy systems (IESs), where multiple resources supply more than one energy sector. Here, one such IES with small modular nuclear reactors and renewables (wind and solar) as generating resources, catering to the demand of the electric grid while producing hydrogen for industries, is modeled in this paper. The physics-based component models are represented using the Modelica language and interconnected to form the IES. The control and coordination of the overall system are ensured by designing a suitable control architecture composed of individual subsystem-level controls and supervisory control. The dynamic performance and the load-following capability of the IES are evaluated, while satisfying the safe operational limits of the components. Different configurations and modes of IES operation are considered, where the adaptability of the control system in the presence of varying demands and renewable generations is validated. The simulation results indicate that hydrogen as a flexible load facilitates the supply of varying grid demand. Additionally, the renewables are also accommodated into the IES owing to the flexibility of the balance of plant associated with the nuclear reactors.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Evaluation of Hybrid FPOG Applications in Regulated and Deregulated Markets Using HERON

Recent changes in the U.S. energy market, such as low natural gas prices and increased electricity production for variable renewable energy (VRE) sources, have led to an economic crisis for existing light-water reactor (LWR) nuclear power plants (NPP). Many owners and operators of LWRs have elected to decommission these plants rather than continue using them as consistent sources of clean baseload power. This has led to exploration of various possibilities to increase the economic viability of these units, including market restructuring to monetize benefits LWRs already provide to the grid through ancillary markets, load following and economic dispatch, and possible integration of secondary systems directly to the NPP for production of additional products through technologies such as hydrogen electrolysis or water desalination. Previous studies have considered the technologies associated with these Integrated Energy Systems (IES) activities, and the analysis of markets for these secondary products. To analyze the economic viability of various system configurations including IES, especially given the uncertainty surrounding load demand, electricity prices, and the availability of VRE resources, the stochastic technoeconomic analysis package HERON (Heuristic Energy Resource Optimization Network) was released earlier this year as an extension of the risk analysis framework RAVEN (Risk Analysis Virtual Environment). HERON focuses foremost on making the complex uncertainty quantification analysis tools approachable for energy systems analysts, also providing general dispatch optimization algorithms for those workflows. HERON continues to be improved and tested as a significant part of the IES viability analyses performed in this work. HERON is not a capacity expansion model. To consider market and grid energy system development in a variety of scenarios, HERON is best used in coupling with modelling tools such as US-REGEN, which sacrifice some of the uncertainty analysis and resolution of HERON's modelling for the ability to efficiently predict the change in the grid energy system's profile due to economic drivers over decades. HERON can then use this information to explore the economic viability of introducing changes to the predicted outcomes, such as the introduction of an IES. In this work, experts at EPRI using US-REGEN provide six projection scenarios for use in HERON stochastic technoeconomic analysis (STEA) in considering the options available for increasing LWR economic viability through introduction of a hydrogen-centric IES using a high-temperature steam electrolysis plant (HTSE), hydrogen storage, and a constant-rate contracted hydrogen consumer. The results obtained are differential in nature; they do not report expected profits for any configuration, but rather report on the possible increase in the NPV of a configuration with respect to a baseline no-IES configuration. Due to the uncertainty captured in the variable net load of the systems, there is likewise uncertainty in the mean values reported. We consider this viability both in terms of a regulated market, where the energy producers and IES are owned and operated by single entity, as well as a deregulated market, where the IES chooses its bid for electricity generation and is then dispatched by the grid system operator. Results indicate that for deregulated markets, the inclusion of the IES is often statistically beneficial. This is especially true in policies that are not favorable towards nuclear, as nuclear is less often dispatched and is forced to deal with frequent idle capacity. In the nominal case as well as the case of carbon tax policies, inclusion of the IES clearly benefited the economic performance of the NPP. In the regulated case, however, there was a trend towards minimizing the IES, likely due to the optimal sizing performed by US-REGEN of the NPP within the system as well as the lack of penalty for idle capacity at the NPP in the regulated market analyses.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

A New Proposal Generalized Predictive Control Algorithm With Polynomial Reference Tracking Applied for Sodium Fast Reactors

This paper proposes a generalized predictive control (GPC) with constraints and orthonormal Laguerre functions using the simplified model of the primary system (reactor core and intermediate heat exchanger (IHX)) of a prototypical sodium fast reactor (SFR). This paper develops a multiple-input multiple-output (MIMO) GPC with input constraints able to track polynomial references of any degree applied in coolant temperature difference across the core and fractional power. The manipulated variables of the GPC-SFR are the reactivity and the sodium flow rate of the primary and secondary pipes. Moreover, orthonormal Laguerre functions and step down condition number techniques were also applied to avoid the numerical ill-conditioning issue in quadratic programming of large systems. Thus, a GPC type-2 was designed to control fractional power, coolant temperature difference across the core and sodium tank temperature of the SFR primary system when temperature references change according to a linear ramp after reaching their steady-state operation, sustaining 100% power operation on the reactor. In order to analyze the load tracking capability of the GPC-SFR type-2, the load following from 100% fractional power (FP) to 60% FP at 0.8% FP/min rate is simulated. Constraints on the rate of coolant temperature difference across the core and reactivity were applied for the design safety. For comparison criteria, this paper compares the GPC-SFR type-2 with the GPC-SFR type-1, i.e., standard model predictive control (MPC), to verify the viability and superior performance of the proposal regarding: (a) ramp-tracking capability of temperature and load; (b) the rejections of a reactivity disturbance of -1 cent and a secondary sodium inlet temperature disturbance of +10°F; and (c) a simulation with uncertainty in reactor design. The simulations show that the GPC-SFR type-2 overcome the GPC-SFR type-1 robustness and performance.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗