SEARCH · Search NASA

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

DOE OSTI2022

Learning-based Anticipatory Control of Microreactors

Learning-based anticipatory control advances the level of autonomy of microreactor control systems, a key consideration for the unattended operation of fission batteries. In this work, an anticipatory control system is shown to provide accurate load-following for a microreactor by utilizing a model predictive control framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2022

Adaptive Force Control for Small Celestial Body Sampling

An adaptive force control algorithm for small celestial body sampling for a variety of surface properties is developed. The control algorithm consists of an adaptive controller combined with feedback linearization. When a spacecraft makes contact with the surface, it must maintain a desired contact force in order to capture a sample. The properties of the surface are unknown or uncertain before contact with the surface is made. The adaptive controller performs system identification online to create an input-output model of the feedback linearized system. From the input-output model a block observable canonical form is realized and the control input is determined by model predictive control (MPC) to maintain a desired contact force in spite of the unknown surface properties. The approach is applied to a variety of surface properties with linear and nonlinear contact models.

Quadrelli, Marco M↗

DOE OSTI2020

Current Observer Based Predictive Decoupled Power Control Grid-Interactive Inverter

This paper presents a sensor-less current model predictive control (MPC) scheme via a full state observer based current estimator. The grid interactive inverters’ control schemes require current and voltage sensors. Elimination of current sensor enhances the inverter reliability. This paper leverages the inherent characteristics of MPC towards robust current sensor-less grid interactive inverter with LC filter. The observer for inductor current is developed based on the existing capacitor voltage measurement. The estimator dynamic state-space matrices are then obtained through reconstruction of the inverter model with the capacitor voltage and inductor current being the state variables. The controller objectives are to regulate active and reactive power in a decoupled manner. The theoretical expectation, controller performance, and accuracy of the current estimation are verified by conducting a real-time simulation via Typhoon HIL.

Zhang, Zhen↗

DOE OSTI2018

Closed‐loop hierarchical control strategies for connected and autonomous hybrid electric vehicles with random errors

This study presents a closed‐loop hierarchical control strategy for a group of connected and autonomous hybrid electric vehicles (HEVs) with the purpose of optimising fuel economy while guaranteeing traffic mobility and vehicle safety. In the hierarchical control architecture, a decentralised stochastic model predictive control (SMPC)‐based higher level controller incorporating signal phase and timing information is formulated to optimise the velocity profile of each vehicle, and an adaptive equivalent consumption minimisation strategy based lower level controller is employed for the energy management control of the HEVs. Creatively, random errors of the control variable are considered in the SMPC framework. The errors are discretised and modelled as a Markov process and the state transition matrix of the errors is generated randomly to capture the error transition dynamics. To solve the SMPC problem more efficiently, a scenario‐based SMPC is employed. Moreover, the propulsion and recuperation efficiencies of the lower level controller are calculated at each time step with measurable variables, and fed back to the higher level controller for velocity optimisation in next time step. Simulation results validate the control effectiveness and advantages of the proposed control architecture.

Qiu, Shaolin↗

DOE OSTI2022

Site demonstration and performance evaluation of MPC for a large chiller plant with TES for renewable energy integration and grid decarbonization

Thermal energy storage (TES) for a cooling plant is a crucial resource for load flexibility. Traditionally, simple, heuristic control approaches, such as the storage priority control which charges TES during the nighttime and discharges during the daytime, have been widely used in practice, and shown reasonable performance in the past benefiting both the grid and the end-users such as buildings and district energy systems. However, the increasing penetration of renewables changes the situation, exposing the grid to a growing duck curve, which encourages the consumption of more energy in the daytime, and volatile renewable generation which requires dynamic planning. The growing pressure of diminishing greenhouse gas emissions also increases the complexity of cooling TES plant operations as different control strategies may apply to optimize operations for energy cost or carbon emissions. This paper presents a model predictive control (MPC), site demonstration and evaluation results of optimal operation of a chiller plant, TES and behind-meter photovoltaics for a campus-level district cooling system. The MPC was formulated as a mixed-integer linear program for better numerical and control properties. Compared with baseline rule-based controls, the MPC results show reductions of the excess PV power by around 25%, of the greenhouse gas emission by 10%, and of peak electricity demand by 10%.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2016

Optimal Battery Utilization Over Lifetime for Parallel Hybrid Electric Vehicle to Maximize Fuel Economy

This paper presents a control strategy to maximize fuel economy of a parallel hybrid electric vehicle over a target life of the battery. Many approaches to maximizing fuel economy of parallel hybrid electric vehicle do not consider the effect of control strategy on the life of the battery. This leads to an oversized and underutilized battery. There is a trade-off between how aggressively to use and 'consume' the battery versus to use the engine and consume fuel. The proposed approach addresses this trade-off by exploiting the differences in the fast dynamics of vehicle power management and slow dynamics of battery aging. The control strategy is separated into two parts, (1) Predictive Battery Management (PBM), and (2) Predictive Power Management (PPM). PBM is the higher level control with slow update rate, e.g. once per month, responsible for generating optimal set points for PPM. The considered set points in this paper are the battery power limits and State Of Charge (SOC). The problem of finding the optimal set points over the target battery life that minimize engine fuel consumption is solved using dynamic programming. PPM is the lower level control with high update rate, e.g. a second, responsible for generating the optimal HEV energy management controls and is implemented using model predictive control approach. The PPM objective is to find the engine and battery power commands to achieve the best fuel economy given the battery power and SOC constraints imposed by PBM. Simulation results with a medium duty commercial hybrid electric vehicle and the proposed two-level hierarchical control strategy show that the HEV fuel economy is maximized while meeting a specified target battery life. On the other hand, the optimal unconstrained control strategy achieves marginally higher fuel economy, but fails to meet the target battery life.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2020

Hierarchical Distribution System Adaptive Restoration with Diverse Distributed Energy Resources

Distributed energy resources (DERs) can be utilized as alternative power sources for fast service recovery in cases of distribution system outages. However, the diverse characteristics and stochastic nature of DERs impose challenges on the optimal operation of di-verse resources during the restoration phase. Here, we introduce a hierarchical structure to coordinate distribution system entities and propose an adaptive restoration strategy to sustain a reliable power supply to outage loads in an unbalanced distribution system utilizing DERs. An efficient system reconfiguration model is developed to guarantee the radiality of restoration islands. The flexibility of DERs is evaluated by a novel method that focuses on the cumulative energy consumption, the superiority of which is also proven. Model predictive control (MPC) is adopted to enable the adjustment of system topology and DER operation strategies based on up-to-date data. The performance of the proposed restoration model is validated on a modified IEEE 123-bus test system. Moreover, the effectiveness of the proposed novel flexibility assessment and the MPC-based adaptive restoration strategy are verified through comparative studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Application of Koopman operator for model-based control of fracture propagation and proppant transport in hydraulic fracturing operation

This work explores the application of the recently developed Koopman operator approach for model identification and feedback control of a hydraulic fracturing process. Controlling fracture propagation and proppant transport with precision is a challenge due in large part to the difficulty of constructing approximate models that accurately capture the characteristic moving boundary and highly-coupled dynamics exhibited by the process. Koopman operator theory is particularly attractive here as it offers a way to explicitly construct linear representations for even highly nonlinear dynamics. The method is data-driven and relies on lifting the states to an infinite-dimensional space of functions called observables where the dynamics are governed by a linear Koopman operator. Here this work considers two problems: (a) fracture geometry control, and (b) proppant concentration control. In both cases, an approximate linear model of the corresponding dynamics is constructed and used to design a model predictive controller (MPC). The manuscript shows that in the case of highly nonlinear dynamics, as observed in the proppant concentration, use of canonical functions in the observable basis fails. In such cases, a priori system knowledge can be leveraged to choose the required basis. The numerical experiments demonstrate that the Koopman linear model shows excellent agreement with the real system and successfully achieves the desired target values maximizing the oil and gas productivity. Additionally, due to its linear structure, the Koopman models allow convex MPC formulations that avoid any issues associated with nonlinear optimization.

42 ENGINEERING↗

DOE OSTI2020

Optimization-Based Fast-Frequency Estimation and Control of Low-Inertia Microgrids

The lack of inertial response from non-synchronous, inverter-based generation in microgrids makes the power system vulnerable to a large rate of change of frequency (ROCOF) and frequency excursions. Energy storage systems (ESSs) can be utilized to provide fast-frequency support to prevent such large excursions in the system. However, fast-frequency support is a power-intensive application that has a significant impact on the ESS lifetime. In this paper, a framework that allows the ESS operator to provide fast-frequency support as a service is proposed. The framework maintains the desired quality-of-service (limiting the ROCOF and frequency) while taking into account the ESS lifetime and physical limits. The framework utilizes moving horizon estimation (MHE) to estimate the frequency deviation and ROCOF from noisy phase-locked loop (PLL) measurements. These estimates are employed by a model predictive control (MPC) algorithm that computes control actions by solving a finite-horizon, online optimization problem. Additionally, this approach avoids oscillatory behavior induced by delays that are common when using low-pass filters as with traditional derivative-based (virtual inertia) controllers. MATLAB/Simulink simulations on a test system from Cordova, Alaska, show the effectiveness of the MHE-MPC approach to reduce frequency deviations and ROCOF of a low-inertia microgrid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Integrated Dynamic Facade Control with an Agent-based Architecture for Commercial Buildings

Dynamic façades have significant technical potential to minimize heating, cooling, and lighting energy use and peak electric demand in the perimeter zone of commercial buildings, but the performance of these systems is reliant on being able to balance complex trade-offs between solar control, daylight admission, comfort, and view over the life of the installation. As the context for controllable energy-efficiency technologies grows more complex with the increased use of intermittent renewable energy resources on the grid, it has become increasingly important to look ahead towards more advanced approaches to integrated systems control in order to achieve optimum life-cycle performance at a lower cost. This study examines the feasibility of a model predictive control system for low-cost autonomous dynamic façades. A system architecture designed around lightweight, simple agents is proposed. The architecture accommodates whole building and grid level demands through its modular, hierarchical approach. Automatically-generated models for computing window heat gains, daylight illuminance, and discomfort glare are described. The open source Modelica and JModelica software tools were used to determine the optimum state of control given inputs of window heat gains and lighting loads for a 24-hour optimization horizon. Penalty functions for glare and view/ daylight quality were implemented as constraints. The control system was tested on a low-power controller (1.4 GHz single core with 2 GB of RAM) to evaluate feasibility. The target platform is a low-cost ($35/unit) embedded controller with 1.2 GHz dual-core cpu and 1 GB of RAM. Configuration and commissioning of the curtainwall unit was designed to be largely plug and play with minimal inputs required by the manufacturer through a web-based user interface. An example application was used to demonstrate optimal control of a three-zone electrochromic window for a south-facing zone. The overall approach was deemed to be promising. Further engineering is required to enable scalable, turnkey solutions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A Model-Predictive Hierarchical-Control Framework for Aggregating Residential DERs to Provide Grid Regulation Services

This paper develops a hierarchical control frame-work to aggregate and to manage behind-the-meter distributed energy resources (DERs), which will be ubiquitous in future distribution systems. In the proposed framework, firstly, each controller in the hierarchy determines the flexibility of the DERs such that the obtained flexibility is feasible with respect to its operational purview. For example, the operational purview of a home energy management system may only consider consumer comfort preferences, while that for an aggregator or a grid controller may consider network voltage management as well. Based on the feasible flexibility, optimal setpoints for the DERs is then determined by the hierarchical controllers to help the distribution power network in voltage regulation, coordination issues with existing transmission-level conventional generators, etc. Therefore, the proposed strategy, which is based on model-predictive control, can be effectively utilized by the distribution network to coordinate several DERs to provide grid regulation services. Numerical simulations performed on the IEEE 37-bus test system demonstrate the efficacy of the proposed approach.

behind-the-meter↗

DOE OSTI2024

HP-FLEX MPC v0.1.0

HP-FLEX MPC is control software developed by Lawrence Berkeley National Laboratory with support from the California Energy Commission (CEC) through EPIC-19-301. HP-FLEX aims to provide load flexibility for heat pumps (HPs) in response to dynamic grid signals (including Time-of-Use, Dynamic Pricing, and Critical Peak Pricing) while maintaining thermostat temperatures within user-specified bounds. The software includes a system-identification module, which models the dynamics of the building envelope with thermostat data, and a control module based on a model predictive controller (MPC) to make optimal decisions. HP-FLEX receives forecasts of outdoor air temperature, solar irradiation, and internal gain (if available), as well as trajectories of energy price, temperature lower and upper bounds over a prediction horizon. It then optimizes heating and cooling capacities to minimize energy cost and peak power (with a user-defined weight on peak power) over the prediction horizon, while maintaining room air temperature within the temperature constraints, and outputs the optimal thermostat setpoints.

Kim, Donghun↗

DOE OSTI2024

Securing Grid-interactive Efficient Buildings (GEB) through Cyber Defense and Resilient System (CYDRES)

The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.

42 ENGINEERING↗

DOE OSTI2012

Control system design for maintaining CO{sub 2} capture in IGCC power plants while loading-following

Load-following requirements for future integrated gasification combined cycle (IGCC) power plants with precombustion CO{sub 2} capture are expected to be far more challenging as electricity produced by renewable energy is connected to the grid and strict environmental limits become mandatory requirements. In this work, loadfollowing studies are performed using a comprehensive dynamic model of an IGCC plant with pre-combustion CO{sub 2} capture developed in Aspen Engineering Suite (AES). Considering multiple single-loop controllers for power demand load following, the preferred IGCC control strategy from the perspective of a power producer is gas turbine (GT) lead with gasifier follow. In this strategy, the GT controls the load by manipulating its firing rate while the slurry feed flow to the gasifier is manipulated to control the syngas pressure at the GT inlet. The syngas pressure control is an integrating process with significant time delay mainly because of the large piping and equipment volumes between the gasifier and the GT inlet. A modified proportional–integral–derivative (PID) control is considered for IGCC syngas pressure control. The desired CO{sub 2} capture rate must be maintained while the IGCC plant follows the load. For maintaining the desired CO{sub 2} capture rate, the control performance of PID control is compared with linear model predictive control (LMPC). The results show that the LMPC outperforms PID control for maintaining CO{sub 2} capture rates in an IGCC power plant while load following.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2012

Dynamic modeling and control of a solid-sorbent CO{sub 2} capture process with two-stage bubbling fluidized bed adsorber reactor

Solid-sorbent-based CO{sub 2} capture processes have strong potential for reducing the overall energy penalty for post-combustion capture from the flue gas of a conventional pulverized coal power plant. However, the commercial success of this technology is contingent upon it operating over a wide range of capture rates, transient events, malfunctions, and disturbances, as well as under uncertainties. To study these operational aspects, a dynamic model of a solid-sorbent-based CO{sub 2} capture process has been developed. In this work, a one-dimensional (1D), non-isothermal, dynamic model of a two-stage bubbling fluidized bed (BFB) adsorber-reactor system with overflow-type weir configuration has been developed in Aspen Custom Modeler (ACM). The physical and chemical properties of the sorbent used in this study are based on a sorbent (32D) developed at National Energy Technology Laboratory (NETL). Each BFB is divided into bubble, emulsion, and cloud-wake regions with the assumptions that the bubble region is free of solids while both gas and solid phases coexist in the emulsion and cloud-wake regions. The BFB dynamic model includes 1D partial differential equations (PDEs) for mass and energy balances, along with comprehensive reaction kinetics. In addition to the two BFB models, the adsorber-reactor system includes 1D PDE-based dynamic models of the downcomer and outlet hopper, as well as models of distributors, control valves, and other pressure-drop devices. Consistent boundary and initial conditions are considered for simulating the dynamic model. Equipment items are sized and appropriate heat transfer options, wherever needed, are provided. Finally, a valid pressure-flow network is developed and a lower-level control system is designed. Using ACM, the transient responses of various process variables such as flue gas and sorbent temperatures, overall CO{sub 2} capture, level of solids in the downcomer and hopper have been studied by simulating typical disturbances such as change in the temperature, flowrate, and composition of the flue gas. To maintain the overall CO{sub 2} capture at a desired level in face of the typical disturbances, two control strategies were considered–a proportional-integral-derivative (PID)-based feedback control strategy and a feedforward-augmented feedback control strategy. Dynamic simulation results show that both the strategies result in unacceptable overshoot/undershoot and a long settling time. To improve the control system performance, a linear model predictive controller (LMPC) is designed. In summary, the overall results illustrate how optimizing the operation and control of carbon capture systems can have a significant impact on the extent and the rate at which commercial-scale capture processes will be scaled-up, deployed, and used in the years to come.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2023

Global-Local Policy Search and its Application in Grid-Interactive Building Control

As the buildings sector represents over 70% of the total U.S. electricity consumption, it offers a great amount of untapped demand-side resources to tackle many critical grid-side problems and improve the overall energy system's efficiency. To help make buildings grid-interactive, this paper proposes a global-local policy search method to train a reinforcement learning (RL) based controller which optimizes building operation during both normal hours and demand response (DR) events. Experiments on a simulated five-zone commercial building demonstrate that by adding a local fine-tuning stage to the evolution strategy policy training process, the control costs can be further reduced by 7.55% in unseen testing scenarios. Baseline comparison also indicates that the learned RL controller outperforms a pragmatic linear model predictive controller (MPC), while not requiring intensive online computation.

demand response↗