Search NASA⌕ Search

SEARCH · Search NASA

Results for “optimal scheduling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach: Preprint

The continual expansion of high-performance computing (HPC) brings with it an increasing need for efficiency. Heavy investment in energy, hardware, and software infrastructure to support peta- and exascale computing requires the optimization of existing systems and, wherever possible, the discernment and adoption of best-practices towards these goals. Such is the case for runtime prediction. When a job is submitted to an HPC system, an estimate of its runtime is provided by the user in the form of "requested wallclock''. Error in this user-provided estimate can lead to jobs being prematurely killed by the scheduler, increased wait time on the queue, and decreased system utilization. More than fifteen years of research has been directed at mitigating these effects by using data-driven runtime predictions. Codified here is a set of commonalities and insights emerging from this body of work, which we present as recommendations and best practices. These practices are combined into a methodological approach described and evaluated on an 11-million-job dataset from the National Renewable Energy Laboratory's petascale HPC system, Eagle. This dataset and the accompanying codebase have been released to the public domain for the benefit of the wider HPC research community.

high performance computing↗
DOE OSTI2024

A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning

In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.

causal reinforcement learning↗
DOE OSTI2024

Delivery-Risk-Aware Flexibility Scheduling and Dispatch for Aggregated Flexible Loads

Flexible loads like smart thermostats and water heaters can shift energy consumption and provide flexibility to the grid. However, this flexibility is dependent on occupant behavior and can lead to delivery risk, which causes utilities and grid operations to consider them as unreliable for purposes of grid operation. To date, they have not been well integrated into wholesale electricity markets or ancillary service offerings. With proper consideration of uncertainty and risk, these resources can be one of the most cost-effective sources of flexibility. This work uses stochastic optimization to quantify and bid flexibility from a fleet of flexible resources while considering their delivery risk.

DER↗
DOE OSTI2024

Building Automation

In this chapter, we focus on both need-based and vision-based control innovation for building automation for HVAC systems. After providing a brief background that describes different HVAC architectures and products, we describe the control challenges and opportunities from a needs-based point of view, at the equipment level, the systems level, and the building level. At the equipment level, increased use of continuously variable actuation such as variable speed compressors and fans, requires application of robust multivariable control that must consider various types of nonlinear behavior across increasingly larger operating envelopes. The objective at this level is to achieve robust and energy efficient operation. At the system level, coupled and interactive dynamics among subsystems are increasingly important to consider, and functional integration of these subsystems, along with set points and operating schedules are designed to minimize energy consumption and improve occupant comfort. At the building level, issues such as integration among other building systems, such as the building envelope and the electric grid, offer opportunities to develop new types of demand response and grid-interactive behaviors and technologies. At the higher levels, system dynamics and robust stability are less of an issue, similar to process control applications, while optimization and integration are more important, although dynamic stability is increasing an issue at the higher levels too. From a vision-driven innovation point of view, we describe three areas that will require sustained research efforts and will eventually impact building automation: Digital Twins, Model Predictive Control, and Grid Interactive Buildings.

Bortoff, Scott↗
DOE OSTI2023

Light Water Sustainability Program: Optimizing Information Automation Using a New Method Based on System-Theoretic Process Analysis

This report describes the interim progress for research supporting the design and optimization of information automation systems for nuclear power plants. Much of the domestic nuclear fleet is currently focused on modernizing technologies and processes, including transitioning toward digitalization in the control room and elsewhere throughout the plant, along with a greater use of automation, artificial intelligence, robotics, and other emerging technologies. While there are significant opportunities to apply these technologies toward greater plant safety, efficiency, and overall cost-effectiveness, optimizing their design and avoiding potential safety and performance risks depends on ensuring that human-performance-related organizational and technical design issues are identified and addressed. This report describes modeling tools and techniques, based on sociotechnical system theory, to support these design goals and their application in the current research effort. The report is intended for senior nuclear energy stakeholders, including regulators, corporate management, and senior plant management. We have developed and employed a method to design an optimized information automation ecosystem (IAE) based on the systems-theoretic constructs underlying sociotechnical systems theory in general and the Systems-Theoretic Accident Modeling and Processes (STAMP) approach in particular. We argue that an IAE can be modeled as an interactive information control system whose behavior can be understood in terms of dynamic control and feedback relationships amongst the system’s technical and organizational components. Up to this point, we have employed a Causal Analysis based on STAMP (CAST) technique to examine a performance- and safety-related incident at an industry partner’s plant that involved the unintentional activation of an emergency diesel generator. This analysis provided insight into the behavior of the plant’s current information control structure within the context of a specific, significant event. Our ongoing analysis is focused on identifying near-term process improvements and longer-term design requirements for an optimized IAE system. The latter analyses will employ a second STAMP-derived technique, System-Theoretic Process Analysis (STPA). STPA is a useful modeling tool for generating and analyzing actual or potential information control structures. Finally, we have begun modeling plantwide organizational relationships and processes. Organizational system modeling will supplement our CAST and STPA findings and provide a basis for mapping out a plantwide information control architecture. CAST analysis findings indicate an important underlying contributor to the incident under investigation, and a significant risk to information automation system performance, was perceived schedule pressure, which exposed weaknesses in interdepartmental coordination between and within responsible plant organizations and challenged the resilience of established plant processes, until a human caused the initiating event. These findings are discussed in terms of their risk to overall system performance and their implications for information automation system resilience and brittleness. We present two preliminary information automation models. The proactive issue resolution model is a test case of an information automation concept with significant near-term potential for application and subsequent reduction in significant plant events. The IAE model is a more general representation of a broader, plantwide information automation system. From our results, we have generated a set of preliminary system-level requirements and safety constraints. These requirements will be further developed over the remainder of our project in collaboration with nuclear industry subject matter experts and specialists in the technical systems under consideration. Additionally, we will continue to pursue the system analyses initiated in the first part of our effort, with a particular emphasis on STPA as the main tool to identify weak or weakening control structures that affect the resilience of organizations and programs. Our intent is to broaden the scope of the analysis from an individual use case to a related set of use cases (e.g., maintenance tasks, compliance tasks) with similar human-system performance challenges. This will enable more generalized findings to refine the Proactive Issue Resolution and IAE models, as well as their system-level requirements and safety constraints. We will use organizational system modeling analyses to supplement STPA findings and model development. We conclude the report with a set of summary recommendations and an initial draft list of system-level requirements and safety constraints for optimized information automation systems.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Punzi-loss: a non-differentiable metric approximation for sensitivity optimisation in the search for new particles

We present the novel implementation of a non-differentiable metric approximation and a corresponding loss-scheduling aimed at the search for new particles of unknown mass in high energy physics experiments. We call the loss-scheduling, based on the minimisation of a figure-of-merit related function typical of particle physics, a Punzi-loss function, and the neural network that utilises this loss function a Punzi-net. We show that the Punzi-net outperforms standard multivariate analysis techniques and generalises well to mass hypotheses for which it was not trained. This is achieved by training a single classifier that provides a coherent and optimal classification of all signal hypotheses over the whole search space. Our result constitutes a complementary approach to fully differentiable analyses in particle physics. We implemented this work using PyTorch and provide users full access to a public repository containing all the codes and a training example.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Validation of HVAC Hardware-in-the-Loop Simulation for Advanced Control Strategies in Smart Homes: Preprint

Residences with smart thermostats can use advanced control strategies to manage their cooling/heating demand, but it is difficult to evaluate optimal control strategies for flexible heating, ventilation, and air conditioning (HVAC) systems in a traditional laboratory setting. The HVAC hardware-in-the-loop (HIL) system combines physical HVAC equipment and a physical thermostat with a simulated house to enable realistic operation of the hardware in any climate. This HIL platform allows researchers to evaluate advanced control strategies for homes with different construction or vintage types, as well as different climates and occupancy schedules. To demonstrate the capabilities of the HVAC HIL system, experimental results with a SEER 16, HSPF 9.5, 3 ton single-speed air source heat pump are validated against past field data collected from a heavily instrumented, unoccupied, retrofit house located in Sacramento, California. Three different cooling strategies are recreated in the HVAC HIL platform, including two different pre-cooling schedules that were designed to shift energy use away from the evening peak. The room temperatures, heat pump energy use, and run time show good agreement between the field data and HIL experimental results for three strategies.

cooling strategies↗
DOE OSTI2025

Vector-level feedforward control of LPBF melt pool area using a physics-based thermal model

Laser powder bed fusion (LPBF) is an additive manufacturing technique that has gained popularity thanks to its ability to produce geometrically complex, fully dense metal parts. However, these parts are prone to internal defects and geometric inaccuracies, stemming in part from variations in the melt pool. Here, this paper proposes a novel vector-level feedforward control framework for regulating melt pool area in LPBF. By decoupling part-scale thermal behavior from small-scale melt pool physics, the controller provides a scale-agnostic prediction of melt pool area and efficient optimization over it. This is done by operating on two coupled lightweight models: a finite-difference thermal model that efficiently captures vector-level temperature fields and a reduced-order, analytical melt pool model. Each model is calibrated separately with minimal single-track and 2D experiments, and the framework is validated on a complex 3D geometry in both Inconel 718 and 316L stainless steel. Results showed that feedforward vector-level laser power scheduling reduced geometric inaccuracy in key dimensions by 62%, overall porosity by 16.5%, and photodiode root-mean-squared deviation by 38.5% on average. Overall, this modular, data-efficient approach demonstrates that proactively compensating for known thermal effects can significantly improve part quality while remaining computationally efficient and readily extensible to other materials and machines.

Additive manufacturing↗
DOE OSTI2024

Electric vehicle supply equipment location and capacity allocation for fixed-route networks

Electric vehicle (EV) supply equipment location and allocation (EVSELCA) problems for freight vehicles are becoming more important because of the trending electrification shift. Some previous works address EV charger location and vehicle routing problems simultaneously by generating vehicle routes from scratch. Although such routes can be efficient, introducing new routes may violate practical constraints, such as drive schedules, and satisfying electrification requirements can require dramatically altering existing routes. To address the challenges in the prevailing adoption scheme, we approach the problem from a fixed -route perspective. We develop a mixed -integer linear program, a clustering approach, and a metaheuristic solution method using a genetic algorithm (GA) to solve the EVSELCA problem. The clustering approach simplifies the problem by grouping customers into clusters, while the GA generates solutions that are shown to be nearly optimal for small problem cases. A case study examines how charger costs, energy costs, the value of time (VOT), and battery capacity impact the cost of the EVSELCA. Charger equipment costs were found to be the most significant component in the objective function, leading to a substantial reduction in cost when decreased. VOT costs exhibited a significant decrease with rising energy costs. Further, an increase in VOT resulted in a notable rise in the number of fast chargers. Longer EV ranges decrease total costs up to a certain point, beyond which the decrease in total costs is negligible.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Integration of cryogenic energy storage with renewables and power plants: Optimal strategies and cost analysis

Energy storage is critical for overcoming challenges associated with the intermittency and the variable availability of renewable sources for decarbonizing the energy sector. Cryogenic energy storage (CES) is of interest due to its high technology readiness level, no geographical limitations, and moderate round-trip efficiency. The time-varying nature of demands and renewable availability needs to be considered at the design and integration stages of energy storage. We develop a mixed-integer nonlinear program (MINLP) model to obtain the energy storage costs on a daily basis for different scenarios that typically arise over an entire year. Using this optimization-based framework, we address key decision-making questions towards energy transition: What is the energy cost when CES is integrated with renewables and power plants? How does each scenario affect the overall energy cost? How much storage is needed for complete transition to renewables? What is the optimal integration towards 100% renewable energy? What are the optimal storage designs for both renewables and fossil-based power generation with current and future energy demands? Here, we discuss different scenarios and solutions to these questions.

25 ENERGY STORAGE↗
DOE OSTI2025

Laser Powder Bed Fusion Additive Manufacture Nb1Zr Development

Next generation fission and fusion nuclear reactors require materials that can withstand operating temperatures greater than 500 °C, neutron irradiation doses of up to 200 displacements per atom (dpa), and potentially corrosive coolants such as the alkali liquid metals sodium, lithium, and NaK (Na33K eutectic alloy). Refractory alloys, such as Nb1Zr (Nb-1wt%Zr) and Molybdenum alloy TZM (Mo-0.5wt%Ti-0.08wt%Zr) have been traditionally considered viable candidates for advanced fission and fusion reactor concepts. However, it is relatively difficult to generate complex geometries of interest from these alloys using traditional manufacturing methods. In addition, there needs to be a concentrated effort to address refractory metal challenges at elevated temperature operation. In order to generate complex geometries of interest, modern manufacturing techniques are considered to increase the technological readiness level (TRL), cost-effectiveness, and schedule savings. This work focused on the continued development of laser powder bed fusion (L-PBF) additive manufacturing (AM) to improve both design flexibility, evaluate microstructure and properties, and ultimately accelerate the TRL and qualification of these processes and alloys for components to potentially be put into service. Niobium alloy Nb1Zr was identified through a down-selection process outlined in previous reports as a candidate to develop in L-PBF AM. Historically, Nb1Zr had been explored for high temperature fast spectrum fission reactors for both terrestrial and space applications. Molybdenum alloy TZM has also been considered for these reactor concepts due to exceptional high-temperature strength, creep resistance, and stability under irradiation. L-PBF AM of TZM has previously been investigated at LANL under the Microreactor program, NASA, ORNL, and in academia. However, due to the crack prone nature of TZM, L-PBF AM of TZM resulted in significant microcracking and additional development is required to pursue viable maturation. Other AM methods have been found to be more successful in printing TZM, and those alternatives approaches are discussed in this effort. The efforts detailed in this report focused on continued development of Nb1Zr through L-PBF and development of TZM via L-PBF and electron powder bed fusion (E-PBF). The objective of this work was to further the development of these AM techniques for the chosen refractory alloys, elucidating and addressing associated challenges through characterization of several demonstration builds. At LANL, Nb1Zr builds were completed using an EOS M290 and M400 machines, and a refractory alloy-dedicated L-PBF system, the Xact Metal XM200G, was installed. The XM200G primary purpose was to do the Nb1Zr parameter development process; however, due to difficulties associated with the machine installation and qualification process, it was decided to pivot development to the larger M400 and M290 machines. Although the supply of Nb1Zr powder was limited, it was sufficient to generate sub-scale metallographic specimens for the purpose of parameter development. This was first accomplished on the EOS M400 then the M290 due to machine schedule availability. Further development of TZM has been initiated at the University of Texas El Paso (UTEP) under contract with LANL to use both a heated build envelope L-PBF machine and E-PBF machine that have been found in the literature to mitigate microcracking. UTEP was provided with TZM powder and build plates to support parallel TZM parameter development across both machines. As part of the contract, UTEP will also be conducting microstructural characterization once optimized process parameters have been identified. The optimized process parameters for each machine will be used to generate a series of metallographic, mechanical, and surface finish specimens for subsequent characterization and testing. In the next section, we provide a detailed discussion of the methodology used for investigating the feasibility of leveraging these alloys for use in advanced reactor applications.

36 MATERIALS SCIENCE↗
DOE OSTI2026

EASY-SHIFT v Alpha

The software is a generic, price- and load-responsive control algorithm integrating heat pumps with thermal energy storage. The algorithm leverages simple models of the system and easily accessible data to schedule operation of heat pumps and thermal energy storage in ways that minimize the cost of operating the heating/cooling system. This tool is specifically designed to be easy to interact with, and something that industry partners are able to adopt. There are two current state of the art approaches. Industry tends to develop very simple algorithms, with predetermined schedules that are not capable of changing operation in response to changes in operating environment. For example, a control designed to avoid high-price electricity from 5-8 PM will not be able to adapt if the high-price period changes to 4-9 PM. Academia commonly develops algorithms called Model predictive control (MPC). MPC requires extensive data and highly trained staff to develop a specific type of simulation model of the building, connect the building to optimization algorithms, and leverage powerful computers. Industry, with limited time/finance budgets for any project, is resistant to adopting MPC due to the associated high complexity and cost.

Grant, Peter [Lawrence Berkeley National Laborator↗
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
DOE OSTI2021

Digital Twin Model for Advanced Manufacture of a Rotating Detonation Engine Injector

A digital twin material model (DTMM) of an additive manufacturing (AM) process was created to advance the state of the art in rotating detonation engine (RDE) injector design. Current RDE injectors are designed with large pressure drops, enabling a stable and repeatable combustion process. However, this comes at the cost of system efficiency. For the technology to transition to commercial fossil-based power generation, it is important to develop injectors with reduced flow losses. Low-loss injectors are difficult to design and manufacture with conventional manufacturing techniques. AM enables new design options, but the AM manufacturing process must be thoroughly understood to result in a robust design. A DTMM provides the necessary insight by defining the cause-effect relationships between process parameters, microstructure features, and properties. Therefore, a DTMM to support the design and manufacturing process was developed and applied to the design of a new additively manufactured low-loss injector. The injector combustion behavior was characterized through hot-fire tests, and mechanical performance was compared to the DTMM predictions. The two project goals were the successful development of the DTMM and the demonstration of an improved RDE injector design. The RDE injector design and DTMM developments occurred on parallel but dependent paths. The injector was designed to reduce pressure drop by increasing the cross-sectional flow area ratio between the injector air passages and the combustor annulus. This resulted in less structural material, raising the concern that thin members would be susceptible to high-cycle fatigue (HCF) under the periodic loading inherent to an RDE. It was most important for the DTMM to predict behavior in these features; therefore, the injector design concept guided the material thicknesses used in fatigue tests. The DTMM development started by manufacturing a series of coupons over the range of possible AM process variations. A design-of-experiment approach was used to select which process variable combinations gave the most efficient coverage relevant to the injector design space. The microstructure in each of these coupons was characterized, and then computational methods were used to create a numerical model of the correlation between process variables and microstructure. Next, a set of HCF samples were tested to calibrate existing models that map microstructure to HCF performance. Together, these two links formed the DTMM that calculates HCF behavior from AM process variables. Two injector prototypes were additively manufactured. The first injector design strategy aggressively pursued low-loss performance by substantially increasing the oxidizer flow area. The combination of manufacturing lead times and the fatigue testing schedule meant that the DTMM was not available when building this first prototype. Therefore, its process parameters were chosen based on a manual review of the available coupon data. This prototype was built successfully and evaluated in 58 combustion tests. Sustained detonation was achieved with remarkably reduced pressure loss, and some tests even displayed pressure loss characteristics similar to conventional gas turbine combustors. This achieved the project goal of improving RDE injector design. The second injector was manufactured according to the optimized parameters predicted by the DTMM. The flow area modifications of this injector were less aggressive than the first injector since demonstrating low pressure loss was not an objective of the second hot-fire test series. Rather, the test objective was to cause high cycle fatigue failure in the part due to periodic loading from the rotating detonation wave. The observed number of cycles to failure was to be compared to the number predicted by the DTMM and thereby assess the utility of the DTMM in component design. However, the required level of vibration was not obtained during combustion. Therefore, high cycle fatigue was not experienced in the hot-fire tests of the second injector. Fatigue data was obtained by further testing the second injector in a conventional HCF test apparatus. The injector demonstrated HCF strength above the DTMM prediction. In fact, it did not fail and testing was only discontinued due to reaching the end of the period of performance. This points to some success in the project’s primary goal of successfully developing and applying the DTMM to a component design. Implementing the DTMM recommendations for optimal processing parameters led to a part with acceptable properties. The DTMM was also shown to be an efficient correlator of data and to provide insight into the relationship between process settings, microstructure, and property performance. However, the failure of the DTMM prediction to match the experimental result of the injector fatigue test also points to the need to include significantly more data in the model development. In this project, coupons made with identical processing parameters exhibited drastically different properties from each other and from the injector part, which clearly influences the accuracy of a model that predicts performance based on parameters. Uncertainties in the build process must be quantified to develop more robust models. A denser and broader matrix of coupon process and geometry variations, several repeated builds of every point, more in-situ build process measurements, and direct observation of tensile and HCF sample microstructure (as opposed to separate microstructure specimens) are recommendations to improve future AM modeling efforts.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2023

Experiments to Measure the Effect of Tantalum on Critical Systems

Sandia National Laboratories (SNL) and Oak Ridge National Laboratory (ORNL) collaborated to develop a capability to test the epithermal/intermediate cross sections of materials at the SNL critical experiment facility using the Seven Percent Critical Experiment (7uPCX) fuel. As a result, a new set of critical experiments has been designed to target the epithermal cross sections of tantalum (Ta) and is scheduled to be performed at SNL in 2023. These critical experiments will be evaluated for inclusion in the 2024 edition of the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The focus of these critical experiments is to measure the effects of Ta on the critical array size. The critical array size will be determined by an approach-to-critical experiment with the number of fuel rods in the array as a free parameter. The core configurations are designed to optimize the reactivity worth of Ta and the overall percentage of Ta absorption rates in the epithermal/intermediate energy range (0.625 eV – 100 keV). The baseline core configuration includes 7uPCX fuel rods set at a triangular pitch of 1.016 cm and a central dry test region that utilizes a cadmium liner for filtering out thermal neutrons. The central test region has locations for 85 Ta rods set at a triangular pitch of 0.813 cm. The Ta reactivity worth for the case with 85 Ta rods is approximately 2.55%, with the percentage of Ta absorption rates within the intermediate energy range at nearly 90%.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Deep Reinforcement Learning From Demonstrations to Assist Service Restoration in Islanded Microgrids

Microgrids can be operated in island mode during utility grid outages to support service restoration and improve system resilience. To schedule and dispatch distributed energy resources (DERs) in an islanded microgrid, conventional model-based methods rely on accurate distribution network models and lack generalization and adaptability. Data-driven methods are promising for DER coordination but face practical challenges such as potential hazards to microgrids during online training and insufficient online training opportunities due to low outage rates. This paper presents a novel two-stage learning framework that builds on the deep deterministic policy gradient from demonstrations to identify an optimal restoration strategy. At the pre-training stage, imitation learning is applied to equip the control agent with expert experiences to guarantee acceptable initial performance. At the online training stage, action clipping, reward shaping, and expert demonstrations are leveraged to ensure safe exploration while accelerating the training process. In conclusion, the proposed method is illustrated using the IEEE 123-node system and compared with a representative model-based method and the standard deep deterministic policy gradient method to prove solution accuracy and demonstrate increased computational efficiency.

Du, Yan↗