Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

MOOSE Reactor Module Meshing Enhancements to Support Reactor Physics Analysis

The U.S. Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) program develops an integrated suite of advanced reactor physics tools built upon the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Each code generally requires an input finite element mesh on which the physics solution is calculated, reported, and transferred to other physics codes. The meshing process is often burdensome for the complex geometries present in reactors due to lack of easy-to-use, open-source meshing tools. To address the bottleneck associated with meshing complex geometries found in nuclear reactors, NEAMS initiated the development of the MOOSE Reactor Module starting in FY21. The Reactor Module builds off the existing MOOSE Mesh System to include targeted meshing capabilities such as the ability to generate hexagonal pin cells, assemblies with ducts, rotating control drums, cores, peripheral zones around a core, as well as the automatic labeling (“reporting IDs”) of pin, assembly, and planar zones to simplify post-processing of results. As a Physics Module in MOOSE, the Reactor Module is open-source, available with any MOOSE installation, directly compatible with MOOSE-based tools, and can be invoked from MOOSEbased applications to generate meshes. Functionality from the Reactor Module has been applied to several advanced reactor concepts to demonstrate user workflow improvements and accuracy. The primary objective of the Reactor Module is to improve useability of MOOSEbased tools by streamlining mesh generation and output inspection processes. During FY22, the functionality of the Reactor Module (and accompanying Mesh System) has been expanded based on user needs. First, the Reactor Geometry Mesh Builder capability developed primarily in FY21 has been refactored and merged to the public MOOSE repository. This capability wraps underlying Reactor Module mesh generators into a “Pin – Assembly – Core” workflow appropriate for conventional Cartesian and hexagonal geometries, and notably assigns material IDs during mesh generation stage and generates only the minimal number of blocks needed in order to reduce computational burden. Biasing and boundary layer options have been added to the base mesh generators as required by thermal hydraulics solvers. The reporting ID functionality has been expanded to differentiate ring-wise and azimuthal sectors within a pin for use with depletion algorithms, and VectorPostProcessor and Reporter objects are now available to integrate solution variables across zones based on ID combinations. Functionality to trim hexagonal meshes along the center or periphery has been developed so users may leverage symmetry and reflective boundary conditions to reduce the mesh size. A flexible and powerful tool to fill the space between two sidesets has been introduced to the framework and can be used for transition layers such as stitching two assemblies together with different numbers of pins, or for complex geometries which do not follow conventional Cartesian/hexagonal patterns. Finally, additional verification problems were performed with NEAMS physics tools in complement with existing NEAMS work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Influence of Environment on Post-Detonation Chemistry and Debris Formation (Abbreviated Final Report: 20-SI-006)

Predicting, responding to, or interpreting the chemical record preserved in debris derived from nuclear events can be challenging due to chemical fractionation. Chemical fractionation is where different species of the evolving radionuclide inventory segregate and/or are lost from the system over the timescales of debris formation. Both historic data and recent research suggest that the interaction and character of the local environment may exert controls on chemical fractionation by influencing the cooling and evolution of the associated fireball as well as the composition of the vapor term and resultant speciation. Prior to this work, an integrated platform permitting dynamic and concurrent consideration of physical and chemical evolution of early time post-detonation event environments did not exist. Our work merged historic data and experimental approaches to support development of a computational framework able to simulate fundamental processes (e.g., entrainment of local environment, oxidation chemistry, and cooling time scales) that may perturb the radionuclide inventory captured in post-detonation debris. Work with historic debris confirmed that entrained environmental material affect debris composition, structure, and radionuclide incorporation. Complementary work utilizing a readily controllable and tunable benchtop setup (a plasma flow reactor) simulated the late cooling of a nuclear fireball (e.g., T < 6000 K) and bounded the sensitivity of actinide speciation and particle size distribution to variations in oxygen concentration and cooling rates. Concurrent laser ablation and laser heating experiments were used to investigate the chemistry and physics of processes occurring in vaporized and/or rapidly heated actinides and other elements in the presence of oxygen. A more computationally efficient microphysical model was developed for predicting and evolving size distributions of particles forming from mixed vapor terms and simulating particle formation processes under a variety of extreme conditions. Continued study of historic nuclear event film confirmed that shockwave data and physics codes agree to within the uncertainty of the data. Good agreement was achieved for thermal emission from an airburst, however the paucity of low-temperature molecular opacity data for mixtures of air, bomb debris, entrained dirt, and water vapor complicate agreement for more elaborate scenarios. A multiphysics code (ALE3D) was modified to bring the necessary physics and chemistry, including these new data and insights, onto a single platform. Code development included improved initialization of large physical systems, modernization of chemistry capabilities, and modifications to enable inclusion of particle transport.

07 ISOTOPE AND RADIATION SOURCES↗

Status of Modifications to the AGR-3/4 Fission Product Transport Model

A one-dimensional (1D) finite-element model of the AGR 3/4 experiment fission product distributions based on the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework has been revised and implemented within BISON, with improvements which allow for detailed temperature histories to be used for analyses. Empirically determined concentration profiles and ring inventories from the AGR-3/4 experiment have been compiled for comparison purposes. Ongoing efforts to build fission product diffusion models which can describe the applicable physics for isotopic concentration profiles in each AGR-3/4 capsule are discussed, as well as the suitability of each isotopic concentration profile in each capsule for obtaining transport parameters.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

BISON Fuel Fragmentation Relocation and Dispersal (FFRD) Assessment Database for Eventual Use in Bayesian Calibration

Existing light-water reactor (LWR) fuel vendors have been interested in seeking increased discharge burnups of nuclear fuel rods for improved economics for quite a few years. With increased burnups come additional challenges that must be addressed. It has been experimentally observed that average burnups higher than the current regulatory limit of 62 MWd/kgU may undergo fuel fragmentation, relocation, and dispersal (FFRD) during a loss-of-coolant accident (LOCA). Industry must demonstrate approaches to mitigate FFRD. In an effort to support industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) has for several years invested in developing multiscale models and creating a validation/assessment database for these models to study the mechanisms driving FFRD. This report provides an update on changes made to the assessment database and new models added to BISON to support the study of fuel rod behavior during FFRD. An effort has been initiated this year to begin adding dedicated inputs to the publicly available Virtual Test Bed (VTB) repository for industry use. A section of this report details the efforts made in this area. NEAMS has recently developed new capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework’s stochastic tools module for calibration using Bayesian inference. The goal in the future is to use these capabilities to calibrate and identify weaknesses in the existing BISON models for FFRD. The report concludes with a discussion on the models most likely to benefit the most from such calibration.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Collaborative Research: Vlasov-Maxwell Simulations to Resolve Electron Heating and Dissipation, in Quasi-Perpendicular Shocks

The major goals of the project are to study three fundamental questions related to collisionless, non-relativistic, quasi-perpendicular shocks by combining continuum Vlasov-Maxwell simulations (the Gkeyll framework) and high resolution, in situ heliospheric observations from the MMS spacecraft. The specific questions are: 1. How and where are electrons energized and heated in a quasi-perpendicular shock, including the ultimate source of entropy production? 2. What role do waves, turbulence, and secondary instabilities play in the conversion of directed flow energy to electron energy? 3. How do the parameters of the shock determine the energization of electrons?

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Energetic Particles - microturbulence interaction thrust (EP SIWG white paper)

This white paper outlines a strategic approach to Energetic Particle (EP) research, aimed at applying the results to the future burning devices such as ITER. Our goal is to deepen the understanding of the interplay between plasma background microturbulence and diverse species of energetic ions in burning plasma devices. This strategy is poised to advance our knowledge in this crucial area of fusion science, paving the way for significant breakthroughs in plasma physics and fusion energy research. We consider the confinement of energetic ions such as auxiliary heating beams, minority ions from ICRH, and fusion product alpha particles. Recent studies have underscored the potential of EP/microturbulence interaction to enhance fusion plasma performance by stabilizing microturbulence. However, it also poses risks, such as exacerbating Alfvénic eigenmode (AE) instabilities, which could compromise the sustainability of plasma discharge by causing EP losses. The interplay between EPs and background microturbulence is evident in the phenomenon of effective pitch angle scattering, a crucial aspect of the quasilinear (QL) theory. This theory is integral to developing numerically-efficient yet comprehensive and self-consistent approaches, recently employed to investigate the relaxation of energetic particle populations in the holistic modeling of fusion-grade plasmas. The primary objectives of this white paper thrust encompass a dual focus. First is that we need to delve into the mechanisms through which microturbulence engenders effective pitch angle scattering. This investigation will entail the examination of the presence of known or self-consistently predicted spectra of modes accountable for microturbulence. In these explorations, electrostatic microturbulence serves as a logical initial stride towards achieving the trust's objectives. This endeavor is anticipated to yield formulations expressing the parametric dependencies of the effective pitch angle scattering frequency on variables such as thermal plasma electron and/or ion temperatures, as well as their respective thermal conductivities. In our second objective, we aim to delve into the intricate formation of zonal flow (ZF) structures amidst the complex interplay of microturbulence and Alfvenic eigenmodes (AEs). This endeavor poses greater challenges as we seek to unravel the macroscopic manifestations influenced by microturbulence, termed as zonal structures (ZS), stemming from microturbulence-induced ZF. Drawing from this understanding, we anticipate employing a QL approach to yield comprehensive insights into the distribution function of energetic particles (EP) within phase space. This method entails resolving the dominant multidimensional phase space diffusion processes while effectively averaging over the rapid ballistic responses. Nevertheless, substantial strides remain imperative to realize a comprehensive whole-device modeling framework. This entails meticulous verification and validation exercises against experimental observations, as well as rigorous benchmarking against theoretical frameworks and numerical simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

US-UK fusion energy collaborations in the digital space

The US and UK share the vision for fusion as a vital part of the clean energy future. This vision is reflected in the respective national plans in the form of the Bold Decadal Vision for Commercial Fusion (BDV) in the US and the Spherical Tokamak for Energy Production (STEP) program in the UK. Digital tools such as simulation and control frameworks, design tools, AI/ML, high performance computing (HPC), and virtual reality (VR) will play an important role in developing, diagnosing, operating, and further improving burning-plasma-class fusion power plants. Therefore, a collaborative approach, involving both the public and private sectors, to developing these digital tools can accelerate the path to fusion energy commercialization. In this report we discuss previous and ongoing collaborations and opportunities to expand these collaborations into new areas. We conclude this report with near term actions and a vision of the collaboration to the Joint Coordinating Committee.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

LLNL FESP Theory Highlights: August 2024

The 2024 ABOUND SciDAC and BOUT++ combined workshop was held August 5-9 th 2024 at the University of California Livermore Collaboration Center (UCLC) in Livermore. Bringing together leading scientists and researchers from across the globe, this pivotal event focused on advancing plasma physics and boundary plasma dynamics within the context of fusion energy research. Key discussions throughout the meeting highlighted significant advancements in the BOUT++ framework, including enhanced simulations of small Edge Localized Modes (ELMs) and the initiation of integrating the integration of the 5D GEM gyrokinetic turbulence core code with the 2D SOLPS-ITER boundary transport code. These developments are crucial for managing heat loads in fusion reactors and supporting the longevity of plasma-facing components. The event also featured a session on Inter-SciDAC Collaborations, where principal investigators from multiple U.S. FES SciDAC tokamak projects explored opportunities for cross-collaboration. Additionally, the meeting showcased cutting-edge advancements in GPU acceleration and AI/ML technologies, poised to drive the next generation of fusion research. In his closing remarks, Dr. Xueqiao Xu emphasized the importance of the collaborative efforts and discussions that took place, noting their potential to shape future breakthroughs in fusion energy. The event underscored the global nature of the BOUT++ collaboration, with contributions from over 57 institutions worldwide. The 2024 BOUT++ and ABOUND Joint Hybrid Meeting continues to drive forward the research and innovations needed to achieve fusion energy, setting the stage for future collaboration and discovery.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Comprehensive Neural Posterior Estimation for Galaxy-Galaxy Strong Lensing

We present a deep learning model based on neural posterior estimation (NPE) for comprehensive extraction of astrophysical parameters from galaxy-scale strong gravitational lenses. The unprecedentedly large amount of galaxy-scale strong lenses expected in future cosmological surveys (${\cal O}(10^5)$) promises to enable valuable statistical constraints in various studies ranging from galaxy formation to the nature of dark matter, but it also poses a significant challenge for traditional modelling pipelines. To this end, our automated model includes several new, state-of-the-art features and approaches leveraging the framework of simulation-based inference (SBI). We infer a total of 20 parameters describing the mass and light profiles of both lens and source galaxies, using simulated raw multi-band data modelled under noise and observing conditions expected by the Legacy Survey of Space and Time (LSST), with its summary statistics generated by a residual network. We examine the efficacy of multi-band data in extracting nearly 20 model parameters simultaneous from strong lensing images including lens light. Finally, We perform a comprehensive set of diagnostics for SBI models, evaluating the model's prediction accuracy, stability, and uncertainty quantification.

Zhao, Roy J. [Chicago U., KICP]↗

Surface impacts and associated mechanisms of a moisture intrusion into the Arctic observed in mid-April 2020 during MOSAiC

Distinct events of warm and moist air intrusions (WAIs) from mid-latitudes have pronounced impacts on the Arctic climate system. We present a detailed analysis of a record-breaking WAI observed during the MOSAiC expedition in mid-April 2020. By combining Eulerian with Lagrangian frameworks and using simulations across different scales, we investigate aspects of air mass transformations via cloud processes and quantify related surface impacts. The WAI is characterized by two distinct pathways, Siberian and Atlantic. A moist static energy transport across the Arctic Circle above the climatological 90th percentile is found. Observations at research vessel Polarstern show a transition from radiatively clear to cloudy state with significant precipitation and a positive surface energy balance (SEB), i.e., surface warming. WAI air parcels reach Polarstern first near the tropopause, and only 1–2 days later at lower altitudes. In the 5 days prior to the event, latent heat release during cloud formation triggers maximum diabatic heating rates in excess of 20 K d -1 . For some poleward drifting air parcels, this facilitates strong ascent by up to 9 km. Based on model experiments, we explore the role of two key cloud-determining factors. First, we test the role moisture availability by reducing lateral moisture inflow during the WAI by 30%. This does not significantly affect the liquid water path, and therefore the SEB, in the central Arctic. The cause are counteracting mechanisms of cloud formation and precipitation along the trajectory. Second, we test the impact of increasing Cloud Condensation Nuclei concentrations from 10 to 1,000 cm -3 (pristine Arctic to highly polluted), which enhances cloud water content. Resulting stronger longwave cooling at cloud top makes entrainment more efficient and deepens the atmospheric boundary layer. Finally, we show the strongly positive effect of the WAI on the SEB. This is mainly driven by turbulent heat fluxes over the ocean, but radiation over sea ice. The WAI also contributes a large fraction to precipitation in the Arctic, reaching 30% of total precipitation in a 9-day period at the MOSAiC site. However, measured precipitation varies substantially between different platforms. Therefore, estimates of total precipitation are subject to considerable observational uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Optimal Operations Management of Mobility-on-Demand Systems

The emergence of the sharing economy in urban transportation networks has enabled new fast, convenient and accessible mobility services referred to as Mobilty-on-Demand systems (e.g., Uber, Lyft, DiDi). These platforms have flourished in the last decade around the globe and face many operational challenges in order to be competitive and provide good quality of service. A crucial step in the effective operation of these systems is to reduce customers' waiting time while properly selecting the optimal fleet size and pricing policy. In this paper, we jointly tackle three operational decisions: (i) fleet size, (ii) pricing, and (iii) rebalancing, in order to maximize the platform's profit or its customers' welfare. To accomplish this, we first devise an optimization framework which gives rise to a static policy. Then, we elaborate and propose dynamic policies that are more responsive to perturbations such as unexpected increases in demand. We test this framework in a simulation environment using three case studies and leveraging traffic flow and taxi data from Eastern Massachusetts, New York City, and Chicago. Our results show that solving the problem jointly could increase profits between 1% and up to 50%, depending on the benchmark. Moreover, we observe that the proposed fleet size yield utilization of the vehicles in the fleet is around 75% compared to private vehicle utilization of 5%.

Wollenstein-Betech, Salomón↗

Hybrid Solid Oxide Fuel Cell/Gas Turbine Model Development for Electric Aviation

A thermodynamic model was developed and validated to analyze a high-performance solid oxide fuel cell and gas turbine (SOFC-GT) hybrid power system for electric aviation. This study used a process simulation software package (ProMax) to study the role of SOFC design and operation on the feasibility and performance of the hybrid system. Standard modules, including compressor, turbine, heat exchanger, reforming reactor, and combustor were used from the ProMax tool suite while a custom module was created to simulate the SOFC stack. The model used an SOFC test data set as an input. Additional SOFC stack performance effects, such as pressure, temperature, and utilization of air and fuel, were added from open source data. System performance predictors were SOFC specific power, fuel-to-electricity conversion efficiency, and hybrid system efficiency. Using these input data and predictors, a static thermodynamic performance model was created that can be modified for different system configurations and operating conditions. Prior to creating the final aircraft performance model, initial demonstration models were developed to validate output results. We used the NASA SOFC model as a benchmark, which was created with their Numerical Propulsion System Simulator (NPSS) software framework. Our output results matched within 1% of both the NASA model and open source SOFC performance data. With confidence gained in the accuracy of this model, a 1-MW SOFC-GT hybrid power system was constructed for an aircraft propulsion concept. Overall hybrid system efficiencies of > 75% FTE were observed during standard 36,000 feet cruise flight conditions.

30 DIRECT ENERGY CONVERSION↗

Three Regimes and Four Modes for the Resonant Saturation of Parallel Ion-beam Instabilities

Motivated by recent advances in laboratory experiments on parallel ion-beam instabilities, we present a theoretical framework for—and simulations of—their evolution toward shock formation and Fermi acceleration. Here, after reviewing the linear theory of beam instabilities, with an emphasis on how magnetic helicity and polarization depend on properties of the beam, we compare the evolution and saturation of three distinct parameter regimes: (I) the left-handed "non-resonant" regime; (II) the right-handed beam-gyroresonant regime; (III) the balanced, mixed-turbulence regime.

79 ASTRONOMY AND ASTROPHYSICS↗

Focused Ion Beam Tomography of Alloy 617 Corroded in Molten Chloride Salt

Materials qualification of reactor structural materials is a critical step in rapid implementation of advanced nuclear reactor technologies, particularly to assess the corrosion performance in these designs. Accelerated qualification of reactor structural materials requires incorporating powerful computational toolsets, such as phase field modelling in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, to predict the evolution of structural materials due to corrosion. Accordingly, computational toolsets will require experimental data generated at appropriate length scales to validate accuracy. Focused ion beam (FIB) provides a high degree of control over manipulation of materials for analytical purposes, including capturing data on the evolution in the microstructure and elemental composition of materials at the mesoscale, an appropriate length scale for phase field modelling of intergranular diffusion phenomena using the MOOSE framework. For instance, the FEI Helios G4 UX dual beam plasma FIB microscope at the Irradiated Materials Characterization Laboratory (IMCL) is capable of backscatter diffraction (EBSD) and energy-dispersive x-ray spectroscopy (EDS) documenting the evolution in the microstructure and elemental composition, respectively. The Helios can perform EDS and EBSD three-dimensionally (3D) using tomography, which is then combined using different software packages to visualize 3D volumes correlating elemental composition to microstructural data. The purpose of this investigation was to develop a streamlined characterization and data processing workflow for 3D tomography studies on the FEI Helios G4 plasma FIB. The investigation is segmented into three parts: 1) Optimizing the data collection workflow, 2) identifying appropriate data processing and visualization software (i.e. DREAM.3D, MIPAR, and VGStudioMax), and 3) establishing an infrastructure for public release. The optimization of the data collection workflow is in collaboration with members of the U220 department to setup formal training on the tomography operation of the G4, through ThermoFisher Scientific, and exploring DREAM.3D, MIPAR, and VGStudioMax data processing/visualization software packages. VGStudioMax currently demonstrates the most promise for future use. Optimization of the data collection and processing workflow is still ongoing. A collaboration with INL High Performance Computing (HPC) established an open-source license for expediting the public release of FIB tomography datasets through HPC. FIB tomography data generated by the G4 will provide comprehensive data for validating 3D phase field mesoscale modelling tools within the MOOSE framework for accelerated qualification of reactor structural materials.

Copeland-Johnson, Trishelle↗

Least-Squares PN Formulation of the Transport Equation Using Self-Adjoint-Angular-Flux Consistent Boundary Conditions.

In this paper, we study the Least-Squares (LS) PN form of the transport equation compatible with voids in the context of Continuous Finite Element Methods (CFEM).We first deriveweakly imposed boundary conditions which make the LS weak formulation equivalent to the Self-Adjoint Angular Flux (SAAF) variational formulation with a void treatment, in the particular case of constant cross-sections and a uniform mesh. We then implement this method in Rattlesnake with the Multiphysics Object Oriented Simulation Environment (MOOSE) framework using a spherical harmonics (PN) expansion to discretize in angle. We test our implementation using the Method of Manufactured Solutions (MMS) and find the expected convergence behavior both in angle and space. Lastly, we investigate the impact of the global non-conservation of LS by comparing the method with SAAF on a heterogeneous test problem.

Least-Squares↗

Least-Squares PN Formulation of the Transport Equation Using Self-Adjoint-Angular-Flux Consistent Boundary Conditions

In this paper, we study the Least-Squares (LS) PN form of the transport equation compatible with voids [1] in the context of Continuous Finite Element Methods (CFEM).We first deriveweakly imposed boundary conditions which make the LS weak formulation equivalent to the Self-Adjoint Angular Flux (SAAF) variational formulation with a void treatment [2], in the particular case of constant cross-sections and a uniform mesh. We then implement this method in Rattlesnake with the Multiphysics Object Oriented Simulation Environment (MOOSE) framework [3] using a spherical harmonics (PN) expansion to discretize in angle. We test our implementation using the Method of Manufactured Solutions (MMS) and find the expected convergence behavior both in angle and space. Lastly, we investigate the impact of the global non-conservation of LS by comparing the method with SAAF on a heterogeneous test problem.

97 MATHEMATICS AND COMPUTING↗

Development of a Real-Time Mobility Control and Visualization System with Predictive Vehicle Speed Control for Connected and Automated Vehicles (CAVs)

The Oak Ridge National Laboratory is developing a cloud-based platform for the deployment and evaluation of mobility- and efficiency-oriented connected and automated vehicles (CAVs) applications that will include fundamental data management, communications and visualization elements. This system will serve as a data portal, providing indirect communications that are relevant to efficiency applications, and can be used for both real world CAVs deployments and virtual systems that allow evaluation of new CAVs applications and algorithms. Predictive vehicle speed control algorithms have been developed and will be integrated with the real-time queryable transportation database and geospatial platform to achieve optimized energy efficiency and improved traffic flow in off-freeway driving. This paper describes the technology and summarizes evaluations being conducted for a corridor in Chattanooga, Tennessee, where the technology is expected to be initially deployed. To evaluate the fuel savings resulting from the vehicle speed control and the RTMCS data framework, vehicle powertrain simulations will be completed using results from a calibrated microscopic traffic model.

Laclair, Tim↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗