Adaptive Model Predictive Control for Real-Time Dispatch of Energy Storage Systems.
Abstract not provided.
Copp, David↗
SEARCH · Search NASA
Results for “adaptive model predictive control”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Learning and Adapting Model Predictive Controllers with Reinforcement Learning for Time-Varying Systems
Presented by NETL at 2019 AIChE Annual Meeting, 11/19
Zitney, Steve↗
Integrating Reinforcement Learning with Model Predictive Control for Adaptive Control of Energy Systems
Hedrick, E., K. Hedrick, D. Bhattacharyya, S.E. Zitney, and B.P. Omell, "Integrating Reinforcement Learning with Model Predictive Control for Adaptive Control of Energy Systems," Clearwater Clean Energy Conference, Clearwater, FL, August 1-4, 2022.
Hedrick, Elijah↗
Proof-of-Concept for Sensor Modeling in MOOSE for the Design of Autonomous Nuclear Reactor Control
Autonomous operation is essential for the deployment of microreactors and fission batteries, both in terrestrial and space applications. For this reason, recent studies have investigated autonomous control by using adaptive model predictive control and multi-objective optimization for heat pipe–cooled microreactors under normal and heat pipe failure conditions. However, prototypes of microreactors and fission batteries do not exist yet, and even the design space has not been narrowed down conclusively, making the instrumentation and control system design difficult. For this reason, there is a need for flexible computational capabilities to create a numerical stand-in of potential microreactor and fission battery designs. The latter can be used to design and test control strategies to support autonomous operations. In this poster, we describe the initial implementation of a pluggable sensor system for the easy implementation of realistic sensor models in the multiphysics object-oriented simulation environment (MOOSE) framework. This new capability will enable MOOSE users to create a numerical stand-in of microreactors and fission batteries, ultimately allowing them to easily test new control algorithms, and instrumentation strategies for advanced systems in the design phase.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
Reinforcement learning for online adaptation of model predictive controllers: Application to a selective catalytic reduction unit
Here we present a novel application of reinforcement learning (RL) for online dynamic tuning of model predictive controllers (MPC). Applying a state-action-reward-state-action (SARSA) algorithm for temporal difference learning with a control-specific reward function improves the error tracking performance of a standard MPC formulation. The proposed RL approach is also readily adaptable to other MPCs, or entirely different control approaches. Practical details for the implementation of the RL-MPC algorithm are also presented. The proposed algorithm is applied to a case study of controlling nitrogen oxide (NO x ) emissions in an industrial selective catalytic reduction (SCR) unit, a control problem characterized by significant nonlinearity and time delay. Along with an RL-MPC formulation for NOx control, another MPC is proposed to mitigate ammonia slip and decrease ammonia consumption in the SCR. Results showing the efficacy of the RL-MPC for NO x control through learning and implementation on the nonlinear SCR dynamic model are presented.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Securing Grid-interactive Efficient Buildings (GEB) through Cyber Defense and Resilient System (CYDRES)
The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.
42 ENGINEERING↗
Experimental Performance of a Nonlinear Control Strategy to Regulate Temperature of a High-Temperature Solar Reactor
Abstract Despite the significant potential of solar thermochemical process technology for storing solar energy as solid-state solar fuel, several challenges have made its industrial application difficult. It is important to note that solar energy has a transient nature that causes instability and reduces process efficiency. Therefore, it is crucial to implement a robust control system to regulate the process temperature and tackle the shortage of incoming solar energy during cloudy weather. In our previous works, different model-based control strategies were developed namely a proportional integral derivative controller (PID) with gain scheduling and adaptive model predictive control (MPC). These methods were tested numerically to regulate the temperature inside a high-temperature tubular solar reactor. In this work, the proposed control strategies were experimentally tested under various operation conditions. The controllers were challenged to track different setpoints (500 °C, 1000 °C, and 1450 °C) with different amounts of gas/particle flowrates. Additionally, the flow controller was tested to regulate the reactor temperature under a cloudy weather scenario. The ultimate goal was to produce 5 kg of reduced solar fuel magnesium manganese oxide (MgMn2O4) successfully, and the controllers were able to track the required process temperature and reject disturbances despite the system's strong nonlinearity. The experimental results showed a maximum error in the temperature setpoint of less than 0.5% (6 °C), and the MPC controller demonstrated superior performance in reducing the control effort and rejecting disturbances.
Energy & Fuels↗
Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control
As occupancy sensing technologies become mature, various occupancy sensors are increasingly deployed in commercial buildings for pervasive occupancy monitoring. These sensors provide occupant-count data, which contains rich spatiotemporal information about occupancy patterns. With long-term occupant-count data collected from a commercial building, we design three different predictive models that capture the occupancy dynamics and examine how a model predictive control of the HVAC system benefits from actual occupancy count prediction. Our analysis reveals that mispredictions of occupancy states, especially false positives and false negatives, may introduce inefficient control that leads to energy waste or user discomfort. To address this issue, we take a step further to design an adaptive model predictive controller that minimizes inefficient control actions according to misprediction types and distributions. A comprehensive evaluation is performed in OpenBuild and EnergyPlus simulators to study the effectiveness of the proposed end-to-end control strategy. The evaluation shows that the proposed solution reduces energy consumption by 29.5% while improving the average weighted occupants comfort by 86.7% in Predicted Mean Vote (PMV) over the fixed schedule strategy.
97 MATHEMATICS AND COMPUTING↗
Implementation of a Model Predictive Control Strategy to Regulate Temperature Inside Plug-Flow Solar Reactor With Countercurrent Flow
Abstract Solar-driven thermochemical energy storage systems are proven to be promising energy carriers (solar fuels) to utilize solar energy by using reactive solid-state pellets. However, the production of solar fuel requires a quasi-steady-state process temperature, which represents the main challenge due to the transient nature of solar power. In this work, an adaptive model predictive controller (MPC) is presented to regulate the temperature inside a tubular solar reactor to produce solid-state solar fuel for long-term thermal storage systems. The solar reactor system consists of a vertical tube heated circumferentially over a segment of its length by concentrated solar power, and the reactive pellets (MgMn2O4) are fed from the top end and flow downwards through the heated tube. A countercurrent flowing gas supplied from the lower end interacts with flowing pellets to reduce it thermochemically at a temperature range of 1000—1500 °C. A low-order physical model was developed to simulate the dynamics of the solar reactor including the reaction kinetics, and the proposed model was validated numerically by using a 7-kW electric furnace. The numerical model then was utilized to design the MPC controller, where the control system consists of an MPC code linked to an adaptive system identification code that updates system parameters online to ensure system robustness against external disturbances (sudden change in the flow inside the reactor), model mismatches, and uncertainty. The MPC controller parameters are tuned to enhance the system performance with minimum steady-state error and overshoot. The controller is tested to track different temperature ranges between 500 °C and 1400 °C with different particles/gas mass flowrates and ramping temperature profiles. Results show that the MPC controller successfully regulated the reactor temperature within ± 1 °C of its setpoint and maintained robust performance with minimum input effort when subjected to sudden changes in the amount of flowing media and the presence of chemical reaction.
Engineering↗
Adaptable Data Driven Model Predictive Control for Heat Pipe Microreactors
To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Adaptive Online Model Update Algorithm for Predictive Control in Networked Systems
In this article, we introduce an adaptive on-line model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on historical data for offline model identification, our approach utilizes real-time data for continuous model updates. This method integrates seamlessly with existing online control and optimization algorithms and provides timely updates in response to real-time changes. This methodology offers significant advantages, including a reduction in the communication network bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt after disturbances. Furthermore, our algorithm is tailored for non-linear convex models, enhancing its applicability to practical scenarios. The efficacy of the proposed method is validated through a numerical study, demonstrating improved control performance using a synthetic IEEE test case.
data-driven model predictive control↗
Adaptive Control Using Reinforcement Learning Augmented Model Predictive Control
Hedrick, E., K. Reynolds, D. Bhattacharyya, S.E. Zitney, and B.P. Omell, "Adaptive Control Using Reinforcement Learning Augmented Model Predictive Control," Advanced Manufacturing and Processing Conference 2022, Bethesda, MD, June 1-3 (2022).
Hedrick, Elijah↗
Adaptive Data-Driven Model Predictive Control for Heat Pipe Microreactors
To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Bang-bang control strategy using a tabular adaptive model.
Bang-bang control using adaptive-predictive model applied to least-square error trajectory control of settling-time nonlinear systems
TRAJECTORY CONTROL↗
A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings
Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Control of a nonlinear plant with two level input using a tabular adaptive-predictive model.
Tabular adaptive predictive model for trajectory following control of nonlinear plant with switched two-level input
NONLINEAR SYSTEM↗
Control of modeling error in calibration and validation processes for predictive stochastic models
The idea of adaptive control of modeling error is expanded to include ideas of statistical calibration, validation, and uncertainty quantification.
97 MATHEMATICS AND COMPUTING↗
Indirect M-MRAC for Systems with Time Varying Parameters and Bounded Disturbances
The paper presents a prediction-identification model based adaptive control method for uncertain systems with time varying parameters in the presence of bounded external disturbances. The method guarantees desired tracking performance for the system s state and input signals. This is achieved by feeding back the state prediction error to the identification model. It is shown that the desired closed-loop properties are obtained with fast adaptation when the error feedback gain is selected proportional to the square root of the adaptation rate. The theoretical findings are confirmed via a simulation example.
Stepanyan, Vahram↗