Search NASA⌕ Search

SEARCH · Search NASA

Results for “ADAPTIVE CONTROL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Pangenomes suggest ecological-evolutionary responses to experimental soil warming

ABSTRACT Below-ground carbon transformations that contribute to healthy soils represent a natural climate change mitigation, but newly acquired traits adaptive to climate stress may alter microbial feedback mechanisms. To better define microbial evolutionary responses to long-term climate warming, we study microorganisms from an ongoing in situ soil warming experiment where, for over three decades, temperate forest soils are continuously heated at 5°C above ambient. We hypothesize that across generations of chronic warming, genomic signatures within diverse bacterial lineages reflect adaptations related to growth and carbon utilization. From our bacterial culture collection isolated from experimental heated and control plots, we sequenced genomes representing dominant taxa sensitive to warming, including lineages of Actinobacteria, Alphaproteobacteria, and Betaproteobacteria. We investigated genomic attributes and functional gene content to identify signatures of adaptation. Comparative pangenomics revealed accessory gene clusters related to central metabolism, competition, and carbon substrate degradation, with few functional annotations explicitly associated with long-term warming. Trends in functional gene patterns suggest genomes from heated plots were relatively enriched in central carbohydrate and nitrogen metabolism pathways, while genomes from control plots were relatively enriched in amino acid and fatty acid metabolism pathways. We observed that genomes from heated plots had less codon bias, suggesting potential adaptive traits related to growth or growth efficiency. Codon usage bias varied for organisms with similar 16S rrn operon copy number, suggesting that these organisms experience different selective pressures on growth efficiency. Our work suggests the emergence of lineage-specific trends as well as common ecological-evolutionary microbial responses to climate change. IMPORTANCE Anthropogenic climate change threatens soil ecosystem health in part by altering below-ground carbon cycling carried out by microbes. Microbial evolutionary responses are often overshadowed by community-level ecological responses, but adaptive responses represent potential changes in traits and functional potential that may alter ecosystem function. We predict that microbes are adapting to climate change stressors like soil warming. To test this, we analyzed the genomes of bacteria from a soil warming experiment where soil plots have been experimentally heated 5°C above ambient for over 30 years. While genomic attributes were unchanged by long-term warming, we observed trends in functional gene content related to carbon and nitrogen usage and genomic indicators of growth efficiency. These responses may represent new parameters in how soil ecosystems feedback to the climate system.

Choudoir, Mallory J. (ORCID:0000000291175150)↗

Synchronous Machine Governor Upgrade

Conventional generation sources play a critical role in the stability and reliability of the electrical grid, particularly as we transition towards more renewable energy sources. To understand and accurately emulate their behavior for optimizing grid operations and ensuring seamless integration with renewable technologies, it is essential to better emulate the grid- and plant-level impacts of conventional generation sources, such as natural gas (NG) driven heat recovery steam generators (HRSGs) and combustion turbines (CTs). Therefore, a governor model is developed in a programmable logic controller (PLC) to investigate the performance of the conventional generator under various dynamic operating conditions and to identify the impact on grid stability in a controlled environment. The governor model aims to enable the hardware-in-the-loop (HIL) based emulation of these conventional generation sources using the existing 2 MVA synchronous machine/generator that is driven by a flexible 2.5 MW variable speed drive. This setup will allow us to replicate the dynamic characteristics and response behaviors of NG-driven HRSGs and CTs. The controls for the emulated conventional plants follow the industry standard and are adjustable, ensuring they accurately reflect the operational capabilities and limitations of real-world systems. These controls include load-following capabilities, ramp rates, startup and shutdown sequences, and emissions characteristics. By incorporating these adjustable controls, we aim to capture the nuanced impacts of conventional generation, such as their ability to provide ancillary services like frequency regulation, voltage support, and spinning reserve. In this report, we simulate two types of dynamic operations: grid-connected and islanding. For each dynamic operation, representative starting sequences are tested, including turbine purge, ignition, speed ramping up, generator excitation and synchronizing, and breaker close. The HIL based tests provides insights for field deployment, specifically the high-fidelity governor model provides results to predict the potential stability and reliability risk and suggest possible integration measures (e.g., generation and load balancing, tuning of governor control parameters). Ultimately, this enhanced emulation capability will be integrated into our Advanced Research on Integrated Energy Systems (ARIES), enabling us to conduct comprehensive studies on the interactions between conventional and renewable energy sources. By better understanding these interactions, we can develop strategies to optimize the overall performance and reliability of the grid. This will support the deployment of advanced grid management techniques, such as demand response, grid-forming inverters, and energy storage systems. The main contributions are summarized as follows: (1) This report introduces a PLC-based governor model for gas turbines. This model accurately simulates the dynamic behavior of conventional generation sources under various operational scenarios; (2) The model is integrated with an HIL testbed that includes a 2.5 MW variable speed drive and a 2 MVA synchronous machine. This setup enables realistic, real-time emulation of conventional power plants, particularly NG driven HRSGs and CTs; (3) The developed model is adaptable to various gas turbine configurations and allows for precise control over parameters such as MW ramp rates. This flexibility makes it a valuable tool for future research and industry collaboration; and (4) By incorporating the model into the National Renewable Energy Laboratory's Advanced Research on Integrated Energy Systems, the report lays the groundwork for future studies on interactions between conventional and renewable energy sources, enhancing the ability to develop advanced grid management strategies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ARM-IRL: Adaptive Resilience Metric Quantification Using Inverse Reinforcement Learning

The resilience of safety-critical systems is gaining importance due to the rise in cyber and physical threats, especially within critical infrastructure. Traditional static resilience metrics may not capture dynamic system states, leading to inaccurate assessments and ineffective responses to cyber threats. This work aims to develop a data-driven, adaptive method for resilience metric learning. We propose a data-driven approach using inverse reinforcement learning (IRL) to learn a single, adaptive resilience metric. The method infers a reward function from expert control actions. Unlike previous approaches using static weights or fuzzy logic, this work applies adversarial inverse reinforcement learning (AIRL), training a generator and discriminator in parallel to learn the reward structure and derive an optimal policy. The proposed approach is evaluated on multiple scenarios: optimal communication network rerouting, power distribution network reconfiguration, and cyber–physical restoration of critical loads using the IEEE 123-bus system. The adaptive, learned resilience metric enables faster critical load restoration in comparison to conventional RL approaches.

97 MATHEMATICS AND COMPUTING↗

CTRL-STEER: Closed-Loop Neuron Activation Control in Vision-Language-Action Models

Vision-Language-Action (VLA) models enable test-time behavioral steering via neuron-level interventions, but existing methods use fixed strengths and operate in open loop. This static modulation fails under evolving task dynamics, leading to overcorrection, oscillations, and reduced task success—especially for temporal attributes like speed. We propose CTRL-STEER, a control-theoretic framework that casts activation steering as closed-loop feedback with adaptive, time-varying interventions. Instead of assuming neurons encode temporal concepts, we steer along motion-aligned residual directions and regulate intervention magnitude via feedback. We instantiate this with both PID and reinforcement learning controllers that jointly optimize concept adherence and task success. Experiments on fine-tuned OpenVLA policies across four LIBERO suites show improved stability and a better steering–success trade-off over fixed-coefficient baselines, without retraining the base model.

Babu, Abhijith [Florida International University, ↗

Fusion Pilot Plant and ITER Scenarios and Control

The principal goals of this project were to develop key physics understandings and control solutions necessary for the realization of a steady-state fusion reactor by adapting high performance plasma scenarios from DIII-D to long pulse operation on the Experimental Advanced Superconducting Tokamak (EAST) in Hefei, China. Specific research objectives include the development of physics and control solutions necessary for demonstrating disruption-free long-pulse plasmas at high physics performance sustained simultaneously with the capability of handling the plasma exhaust and plasma-wall interactions using reactor-relevant materials surrounding the plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The crystal structure of Grindelia robusta 7,13-copalyl diphosphate synthase reveals active site features controlling catalytic specificity

Diterpenoid natural products serve critical functions in plant development and ecological adaptation and many diterpenoids have economic value as bioproducts. The family of class II diterpene synthases catalyzes the committed reactions in diterpenoid biosynthesis, converting a common geranylgeranyl diphosphate precursor into different bicyclic prenyl diphosphate scaffolds. Enzymatic rearrangement and modification of these precursors generate the diversity of bioactive diterpenoids. We report the crystal structure of Grindelia robusta 7,13-copalyl diphosphate synthase, GrTPS2, at 2.1 Å of resolution. GrTPS2 catalyzes the committed reaction in the biosynthesis of grindelic acid, which represents the signature metabolite in species of gumweed (Grindelia spp., Asteraceae). Grindelic acid has been explored as a potential source for drug leads and biofuel production. The GrTPS2 crystal structure adopts the conserved three-domain fold of class II diterpene synthases featuring a functional active site in the γβ-domain and a vestigial α-domain. Substrate docking into the active site of the GrTPS2 apo protein structure predicted catalytic amino acids. Biochemical characterization of protein variants identified residues with impact on enzyme activity and catalytic specificity. Specifically, mutagenesis of Y457 provided mechanistic insight into the position-specific deprotonation of the intermediary carbocation to form the characteristic 7,13 double bond of 7,13-copalyl diphosphate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HDX–MS finds that partial unfolding with sequential domain activation controls condensation of a cellular stress marker

Eukaryotic cells form condensates to sense and adapt to their environment [S. F. Banani, H. O. Lee, A. A. Hyman, M. K. Rosen,Nat. Rev. Mol. Cell Biol.18, 285–298 (2017), H. Yoo, C. Triandafillou, D. A. Drummond,J. Biol. Chem.294, 7151–7159 (2019)]. Poly(A)-binding protein (Pab1), a canonical stress granule marker, condenses upon heat shock or starvation, promoting adaptation [J. A. Ribacket al.,Cell168, 1028–1040.e19 (2017)]. The molecular basis of condensation has remained elusive due to a dearth of techniques to probe structure directly in condensates. We apply hydrogen–deuterium exchange/mass spectrometry to investigate the mechanism of Pab1’s condensation. Pab1’s four RNA recognition motifs (RRMs) undergo different levels of partial unfolding upon condensation, and the changes are similar for thermal and pH stresses. Although structural heterogeneity is observed, the ability of MS to describe populations allows us to identify which regions contribute to the condensate’s interaction network. Our data yield a picture of Pab1’s stress-triggered condensation, which we term sequential activation (Fig. 1A), wherein each RRM becomes activated at a temperature where it partially unfolds and associates with other likewise activated RRMs to form the condensate. Subsequent association is dictated more by the underlying free energy surface than specific interactions, an effect we refer to as thermodynamic specificity. Our study represents an advance for elucidating the interactions that drive condensation. Furthermore, our findings demonstrate how condensation can use thermodynamic specificity to perform an acute response to multiple stresses, a potentially general mechanism for stress-responsive proteins.

Science & Technology - Other Topics↗

An experimental process parameter study on the identification of defects in additively fabricated Al6061 with laser powder bed fusion

Additively fabricated metal parts using laser powder bed fusion (L-PBF) possess sophisticated morphology due to the recurrent use of laser-induced metal powder melting and solidification. The surface and 3D morphology of these parts often include defects in the form of protrusions, depressions, pores, voids, keyholes, or cracks that are known to be influenced by laser scanning paths and layer-to-layer processing. Such inconsistent part quality hampers the extensive adoption of L-PBF. Pores and cracks are detrimental to the fatigue life of the parts and components. Quantifying and controlling part defects and optimizing processing and scanning strategy parameters adaptively in real-time through in situ monitoring systems are highly desired. This study investigates the optimization of experimental process parameters (power, scan velocity, and hatch spacing) and their effects on the cracking and porosity of Al6061 alloy using machine learning techniques. Multi-objective optimization is formulated and conducted to determine the L-PBF parameters that minimize both porosity and crack densities.

36 MATERIALS SCIENCE↗

Numerical Modeling & Optimization of the iProTech Pitching Inertial Pump (PIP) Wave Energy Converter (WEC) (CRADA Final Report)

This project represents a continuation of the collaboration between iProTech and NLR to simulate, optimize and design the iProTech Pitching Inertial Pump (PIP) device. The objectives of this TEAMER project are twofold: 1. Refining the physical characteristics of the existing iProTech PIP WEC-Sim model to enhance the model’s fidelity and include controllable components. Key model enhancements target the inclusion of Coulomb friction, the introduction of a controllable bypass valve, and the replacement of traditional check valves with advanced motorized ones. 2. Exploring traditional and advanced control algorithms. From traditional methods like latching control to cutting-edge reinforcement learning (RL) algorithms, the goal is to ensure the PIP device's adaptability and optimal performance across a range of ocean conditions. NLR is tasked with augmenting the WEC-Sim model and implementing the control algorithms, culminating in performance comparison analyses. iProTech will update their existing 3D models, advise on model improvements, and determine crucial system metrics. WEC-Sim, developed in MATLAB/SIMULINK with Simscape Multibody, is the main piece of software that will be used in this project. Coupled with the MATLAB RL Toolbox, it offers a robust platform for in-depth simulation and optimization of the iProTech PIP device. Building on previous work to explore the PIP design space and optimize its geometry, mass distribution, center of gravity and other key parameters, this project aims to refine iProTech’s existing numerical models and develop effective control algorithms that can seamlessly integrate into their future hardware testing campaigns.

16 TIDAL AND WAVE POWER↗

Adaptive Power Flow Approximations With Second-Order Sensitivity Insights

The power flow equations are fundamental to power system planning, analysis, and control. However, the inherent non-linearity and non-convexity of these equations present formidable obstacles in problem-solving processes. To mitigate these challenges, recent research has proposed adaptive power flow linearizations that aim to achieve accuracy over wide operating ranges. The accuracy of these approximations inherently depends on the curvature of the power flow equations within these ranges, which necessitates considering second-order sensitivities. In this paper, we leverage second-order sensitivities to both analyze and improve power flow approximations. We evaluate the curvature across broad operational ranges and subsequently utilize this information to inform the computation of various sample-based power flow approximation techniques. Additionally, we leverage second-order sensitivities to guide the development of rational approximations that yield linear constraints in optimization problems. In conclusion, this approach is extended to enhance accuracy beyond the limitations of linear functions across varied operational scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Mesoporous Thin Film Architectures: Addressing Material Demands through Molecular Self-Assembly

Mesoporous thin films spark interest across a wide range of disciplines due to their tunable nanostructures, large internal surface areas, and strong compatibility with planar optical, electronic, and microfluidic devices. While attention in the porous materials community has shifted toward macroporous or disordered nanoporous systems, a resurgence in mesoporous thin film research is underway, driven by new molecular self-assembly methods, advanced materials chemistry, and improved characterization techniques. The integration of high-χN block copolymer design, kinetically persistent micelle templating, and postdeposition processing protocols now allows control over structural parameters such as pore size, wall thickness, porosity, and connectivity. These advances have overcome many of the thermodynamic and processing constraints that previously limited widespread adoption. Rather than serving only as high-surface-area supports, mesoporous thin films are engineered as active interfaces where responsive chemistries and nanoscale confinement act in tandem. Embedding switchable ligands, thermoresponsive polymers, redox mediators, or ion-selective groups directly within the pore walls enables real-time control over transport, optical, and electrochemical properties. These capabilities open up new directions in adaptive coatings, gated membranes, and fast-response biosensors. To further expand their functional scope, mesoporous films are integrated into hierarchical and multicomponent architectures. Techniques such as triblock terpolymer templating, crack-directed assembly, and nanoimprint lithography allow for control over spatial organization on the micron and submicron scale and pore system orientation. This enables programmable anisotropy, enhanced molecular diffusion, and wavelength-selective photonic behavior, essential for next-generation sensing, catalysis, and energy applications. Such structural and functional complexity requires equally sophisticated characterization. Multimodal and in situ techniques can track material dynamics under operational conditions. Recent progress includes extended-range ellipsometric porosimetry (EP) for hierarchical architectures, vacuum EP for interface energetics, time-resolved EP for diffusion kinetics, and correlative AFM-SAXS mapping. The introduction of advanced neutron-based spectroscopies, particularly quasielastic neutron scattering (QENS), promises to provide real-time access to ion transport dynamics and segmental motion under nanoscale confinement, offering a path toward deeper mechanistic understanding of structure-performance correlations in mesoporous systems. This Account reflects the technical advances made and the interdisciplinary collaborations that have shaped our collective vision. The particular dimensions of mesopores enable us to subtly tune interactions at the molecular, interfacial, and mesoscopic levels that permit us to harness nanoconfinement. What emerges is a versatile, modular platform capable of chemical gating, energy transduction, and sensing with a level of tunability unmatched by other porous materials. We highlight critical challenges including the need for more robust large-area processing, a deeper understanding of dynamic behavior under cycling, and better integration with device-level architectures. Our strategies support the transition of mesoporous thin films into active high-performance components in next-generation energy, environmental, and biomedical systems.

oxides↗

Data-Driven Mean-Corrected Recursive Estimation-Based Optimal DER Dispatch for Distribution System Voltage Control

Recent advances in smart inverters offer opportunities to mitigate adverse grid impacts caused by high penetrations of distributed photovoltaics (PV) in distribution grids, such as voltage violations. Here, this paper proposes a novel measurement-driven optimal power flow (OPF)-based distributed energy resource management system (DERMS) voltage regulation via recursive sensitivity estimation informed coordinated control of distributed PV inverters. The proposed approach leverages available grid and controllable DER measurements, eliminating reliance on system model information while being adaptive and robust to volatile operating conditions. A mean-corrected recursive ridge regression (MCRRR) algorithm is proposed for sensitivity estimation, continuously refining the sensitivity model through a closed-form solution. It effectively manages varying grid operating conditions, such as changes in power injections and topology reconfiguration, to facilitate a time-varying update of the Load Sensitivity Factors (LSF). The proposed approach is formulated as a linear programming (LP) problem and is thus scalable to larger-scale distribution systems. Its effectiveness and efficiency are demonstrated on a realistic distribution feeder with high PV penetrations in Southern California, USA.

14 SOLAR ENERGY↗

Self-Aware Local Autonomous and Semi-Cooperative Control for Cross-Layered Resilience (SLAC3R)

The objective of this work is to develop and demonstrate novel, adaptive, lightweight algorithms that enable the decision-making agents in a large cyber-physical network to act both autonomously and in collaborative harmony to enforce assured resilience across spatiotemporal layers, even under unforeseen adversarial scenarios (e.g., high- impact-low-probability events). Towards this end, the proposed solution will serve as minimally invasive add-on layers that bridge the existing (faster, reactive) local myopic controls and (slower, predictive) centralized optimization. Importantly, the proposed algorithms will enable the multi-agent network to autonomously and collaboratively enforce resilient operation under no or limited communication environment typical of severe cyber- physical adversarial events. The expected outcome of this effort is a suite of prototype, open-source, software algorithms for safety-aware local autonomous and semi-cooperative control (SLAC3R), demonstrated on networked microgrids (via RD2C/Thrust-1 OPAL-RT testbed).

97 MATHEMATICS AND COMPUTING↗

High-Order Mesh r-Adaptivity with Tangential Relaxation and Guaranteed Mesh Validity

High-order meshes are crucial for achieving optimal convergence rates in curvilinear domains, preserving symmetry, and aligning with key flow features in moving mesh simulations [1], but their quality is challenging to control. In prior work, we have developed techniques based on Target-Matrix Optimization Paradigm (TMOP) to adapt a given high-order mesh to the geometry and solution of the partial differential equation (PDE) [2, 3]. Here, we extend this framework to address two key gaps in the literature for highorder mesh 𝑟-adaptivity. First, we introduce tangential relaxation on curved surfaces using solely the discrete mesh representation, eliminating the need for access to underlying geometry (e.g., CAD model). Second, we ensure a continuously positive Jacobian determinant throughout the domain. This determinant positivity is essential for using the high-order mesh resulting from 𝑟-adaptivity with arbitrary quadrature schemes in simulations. The proposed approach is demonstrated to be robust using a variety of numerical experiments.

Mathematics and Computing↗

Field-Driven Out-of-Equilibrium Collective Patterns for Swarm Micro-Robotics

Soft robotics has been rapidly advancing, offering significant improvements over traditional rigid robotic systems through the use of compliant materials that enhance adaptability and interaction with the environment. However, current approaches face critical challenges, including the reliance on complex “top-down” fabrication techniques and the difficulty of wireless powering and control at the microscale. Swarm robotics introduces a paradigm shift, leveraging collective dynamics to achieve cooperative and adaptable behaviors among multiple robotic units. Inspired by nature, this “bottom-up” approach enables swarm robots to execute task-specific reconfigurations, enhancing flexibility and robustness. Field-driven active colloids emerge as a promising platform for swarm microrobotics, capable of self-propulsion and self-organization into dynamic collective patterns under external field excitation and manipulation. These systems mimic biologically inspired swarm behaviors, such as flocking and vortex formation, providing a versatile foundation for designing innovative swarm microrobots. Here, this review discusses the principles of electric and magnetic field-driven collective self-organization, focusing on the particle dynamics, the emergence of collective swarm patterns, and illustrative examples of functional swarm microrobots. It concludes with future perspectives on harnessing these systems for adaptive, scalable, and multifunctional microrobotic applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

TETRIS-ADAPT-VQE: An adaptive algorithm that yields shallower, denser circuit Ansätze

Adaptive quantum variational algorithms are particularly promising for simulating strongly correlated systems on near-term quantum hardware, but they are not yet viable due, in large part, to the severe coherence time limitations on current devices. In this paper, we introduce an algorithm called TETRIS-ADAPT-VQE (tiling efficient trial circuits with rotations implemented simultaneously adaptive derivative-assembled problem-tailored variational quantum eigensolver), which iteratively builds up variational a few operators at a time in a way dictated by the problem being simulated. This algorithm is a modified version of the ADAPT-VQE algorithm, in which the one-operator-at-a-time rule is lifted to allow for the addition of multiple operators with disjoint supports in each iteration. TETRIS-ADAPT-VQE results in denser but significantly shallower circuits, without increasing the number of controlled- gates or variational parameters. Its advantage over the original algorithm in terms of circuit depths increases with the system size. Moreover, the expensive step of measuring the energy gradient with respect to each candidate unitary at each iteration is performed only a fraction of the time compared with ADAPT-VQE. These improvements bring us closer to the goal of demonstrating a practical quantum advantage on quantum hardware. Published by the American Physical Society 2024

Anastasiou, Panagiotis G. (ORCID:0000000256601791)↗

Thiol post-translational modifications modulate allosteric regulation of the OpcA–G6PDH complex through conformational gate control

In cyanobacteria, the redox-sensitive protein OpcA acts as a metabolic switch for G6PDH, enabling rapid adjustment of reducing power generation from glycogen catabolism and thereby precisely regulating carbon flux between anabolic and catabolic pathways. Although redox-sensitive cysteines in OpcA are known to regulate G6PDH, the mechanisms by which redox post-translational modifications (PTMs) on OpcA control G6PDH structure and activity remain unclear. Here, we combine computational modeling with experimental redox proteomics in Synechococcus elongatus PCC 7942 to dissect this mechanism. Experimentally, redox proteome analysis revealed differential redox PTM patterns, particularly on cysteines within the G6PDH-binding site of OpcA. These environmentally sensitive PTM changes at the interface suggest that thiol modifications in this region form a key regulatory node. More broadly, redox proteomics identified site-specific cysteine modifications under light/dark transitions and circadian cycling, linking distinct redox regimes to discrete PTM states. We employed PTM-Psi simulations to show that thiol PTMs near the OpcA–G6PDH interface are critical for allosteric regulation of G6PDH. The thiol PTMs on OpcA affect a putative gate region in G6PDH for substrate ingress and product egress as well as key hydrogen-bond networks within the active site. We infer that PTMs on OpcA tune the conformational landscapes of individual G6PDH subunits toward functionally relevant configurations according to environmental gradients, biasing the enzyme toward catalytically favorable states. Together, our results reveal a molecular mechanism in which thiol PTMs on OpcA modulate G6PDH structure and function through PTM-induced reorganization of conformational dynamics and allosteric communication. These findings demonstrate that PTM-level regulation provides a critical control layer from genotypes to phenotypes that enables cyanobacteria to rapidly adapt to environmental fluctuations through precise metabolic fine-tuning.

Allosteric regulation↗

A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning

In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.

causal reinforcement learning↗