Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗
DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Solar+ Optimizer: A Model Predictive Control Optimization Platform for Grid Responsive Building Microgrids

With the falling costs of solar arrays and battery storage and reduced reliability of the grid due to natural disasters, small-scale local generation and storage resources are beginning to proliferate. However, very few software options exist for integrated control of building loads, batteries and other distributed energy resources. The available software solutions on the market can force customers to adopt one particular ecosystem of products, thus limiting consumer choice, and are often incapable of operating independently of the grid during blackouts. In this paper, we present the “Solar+ Optimizer” (SPO), a control platform that provides demand flexibility, resiliency and reduced utility bills, built using open-source software. SPO employs Model Predictive Control (MPC) to produce real time optimal control strategies for the building loads and the distributed energy resources on site. SPO is designed to be vendor-agnostic, protocol-independent and resilient to loss of wide-area network connectivity. The software was evaluated in a real convenience store in northern California with on-site solar generation, battery storage and control of HVAC and commercial refrigeration loads. Preliminary tests showed price responsiveness of the building and cost savings of more than 10% in energy costs alone.

14 SOLAR ENERGY↗
DOE OSTI2016

Model Predictive Control of A Matrix-Converter Based Solid State Transformer for Utility Grid Interaction

The matrix converter solid state transformer (MC-SST), formed from the back-to-back connection of two three-to-single-phase matrix converters, is studied for use in the interconnection of two ac grids. The matrix converter topology provides a light weight and low volume single-stage bidirectional ac-ac power conversion without the need for a dc link. Thus, the lifetime limitations of dc-bus storage capacitors are avoided. However, space vector modulation of this type of MC-SST requires to compute vectors for each of the two MCs, which must be carefully coordinated to avoid commutation failure. An additional controller is also required to control power exchange between the two ac grids. In this paper, model predictive control (MPC) is proposed for an MC-SST connecting two different ac power grids. The proposed MPC predicts the circuit variables based on the discrete model of MC-SST system and the cost function is formulated so that the optimal switch vector for the next sample period is selected, thereby generating the required grid currents for the SST. Simulation and experimental studies are carried out to demonstrate the effectiveness and simplicity of the proposed MPC for such MC-SST-based grid interfacing systems.

Xue, Yaosuo↗
DOE OSTI2019

MPCPy: An Open-Source Software Platform for Model Predictive Control in Buildings

Within the last decade, needs for building control systems that reduce cost, energy, or peak demand, and that facilitate building-grid integration, district-energy system optimization, and occupant interaction, while maintaining thermal comfort and indoor air quality, have come about. Current PID and schedule-based control systems are not capable of fulfilling these needs, while Model Predictive Control (MPC) could. Despite the critical role MPC-enabled buildings can play in future energy infrastructures, widespread adoption of MPC within the building industry has yet to occur. To address barriers associated with system setup and configuration, this paper introduces an open-source software platform that emphasizes use of self-tuning adaptive models, usability by non-experts of MPC, and a flexible architecture that enables application across projects.

Blum, David↗
DOE OSTI2018

A Comparative Assessment of Economic Model Predictive Control Strategies for Fuel Economy Optimization of Heavy-Duty Trucks

This paper provides a comparative assessment of three control strategies that fuse a global, offline dynamic programming (DP) optimization with online model predictive control (MPC) in an effort to minimize fuel consumption for a heavy-duty truck. The online MPC optimization, which is local in nature, makes refinements to a coarsely (but globally, subject to grid resolution) optimized target velocity profile from the DP optimization. Three candidate economic MPC formulations are evaluated: a time-based formulation that directly penalizes predicted fuel consumption, a simplified time-based formulation that penalizes braking effort in place of fuel consumption, and a distance-based convex formulation that maintains a tradeoff between energy expenditure and tracking of the coarsely optimized velocity based on DP. The performance of each approach is presented for three representative route profiles, using a medium-fidelity proprietary Volvo model of the heavy-duty truck’s longitudinal dynamics. Results demonstrate 4-7% fuel economy improvement across all three formulations, when compared to a baseline strategy. Furthermore, we present a detailed analysis of energy usage by “type” (aerodynamic losses, braking losses, and comparison of brake-specific fuel consumption), under each candidate control approach.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Model predictive control for matrix converter operating in current control mode with load current estimation

A matrix converter system operating in current control mode is provided. The matrix converter includes a switching matrix coupled between a low voltage side and a high voltage side, wherein the matrix converter is coupled at its low voltage side to a generator for receiving an input power including an input current and transforming the input power into an output power at its high voltage side, wherein a load is coupled to the high voltage side. The control system includes a load observer and a model predictive controller (MPC). The load observer is configured to estimate a load current that flows to the load from the high voltage side of the matrix converter as a function of a switching state of the switching matrix, an output voltage output at the high voltage side of the matrix converter, and the input current. The MPC is configured to select the switching state of the switching matrix to meet one or more control objectives defined by minimization of a multi-objective function that tracks the output voltage and the input current using the estimated load current.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Prime Time for Model-Predictive Control? Assessing the Technical and Market Readiness of Advanced Controls in Buildings

Despite three decades of extensive research and field testing that have consistently validated the benefits of Model Predictive Control (MPC) in building applications, the technology has seen limited market adoption. This paper evaluates the readiness of MPC for widespread deployment, showcases recent demonstrations and field tests across diverse building types, including residential, small commercial, large commercial, and campus settings. Our results demonstrate that MPC can optimize system operations to achieve load shifting, minimize curtailment of on-site generation, and reduce energy costs by up to 80 %, while maintaining or improving occupant comfort. We also show that MPC can effectively control large assets, such as MW-sized thermal storage systems, and respond to dynamic pricing signals. However, achieving scale remains difficult due to labor-intensive workflows, reliance on a “PhD-in-the-loop” for MPC design and maintenance, susceptibility to fragile data infrastructure, and persistent workforce education and acceptance barriers. To bridge this gap, we outline a transition from bespoke, labor intensive prototypes toward streamlined, segment-targeted deployment strategies that leverage model templates, semantic tools, and generative AI. By automating control configuration and reducing engineering effort, these recommendations provide a pathway for transforming successful research demonstrations into scalable, market ready solutions for MPC-based controls.

Pritoni, Marco↗
DOE OSTI2022

Reinforcement learning for online adaptation of model predictive controllers: Application to a selective catalytic reduction unit

Here we present a novel application of reinforcement learning (RL) for online dynamic tuning of model predictive controllers (MPC). Applying a state-action-reward-state-action (SARSA) algorithm for temporal difference learning with a control-specific reward function improves the error tracking performance of a standard MPC formulation. The proposed RL approach is also readily adaptable to other MPCs, or entirely different control approaches. Practical details for the implementation of the RL-MPC algorithm are also presented. The proposed algorithm is applied to a case study of controlling nitrogen oxide (NO x ) emissions in an industrial selective catalytic reduction (SCR) unit, a control problem characterized by significant nonlinearity and time delay. Along with an RL-MPC formulation for NOx control, another MPC is proposed to mitigate ammonia slip and decrease ammonia consumption in the SCR. Results showing the efficacy of the RL-MPC for NO x control through learning and implementation on the nonlinear SCR dynamic model are presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Ice storage model-predictive control in an office building with PV: scenario, error and sensitivity analysis

Thermal energy storage (TES) can enable more building-sited renewable electricity generation and lower utility bill costs for buildings owners and occupants, especially when there are high demand and variable time-of-use (TOU) charges. A model predictive control (MPC) strategy can offer additional savings over a schedule-based control with added complexity and reliance on forecasts. Here, this study examines savings for medium office buildings with chiller plants in three locations with building-installed solar photovoltaics (PV) to understand the impact of MPC. Control setpoints are fixed by a schedule-based control or optimized by nonlinear MPC. These control setpoints are actuated within EnergyPlus building models to simulate the utility cost of the chiller plant. NLP solutions can be unstable or unrealistic, but our results show that by regularizing the NLP, the solutions can be reasonably followed by the building model. MPC models make simplifications that lead to errors once the controller is participating in and changing the operation of the building. These errors average 9 % across the cases, showing that the most important parts of the system are represented. The no-thermal load costs are computed to show that the optimization can in some cases achieve both the minimum TOU and minimum monthly demand costs by demand management while reducing TOU energy costs by energy arbitrage. The MPC saves 35–66 % in the annual chiller plant operating costs, which is an additional savings above the schedule by 1–33 %. PV and TES are complementary and mostly independent, but a load with PV often results in better performance for the schedule. Our case study and sensitivity analysis show the importance of modeling and optimization for complex rates, but also the circumstances wherein a simpler strategy achieves the same performance with less potential for error.

14 SOLAR ENERGY↗
DOE OSTI2022

Robust Model Predictive Control for Attack Mitigation of Virtual Synchronous Generators (VSGs) in an Islanded Microgrid

With the increasing application of power converters in distributed energy systems, power electronics converters face an increasing number of cyber-attacks. To mitigate the cyber-attack impact on voltage source converters (VSCs) and microgrids, a robust model predictive control (RMPC) is proposed for virtual synchronous generators (VSG) in an islanded microgrid. This RMPC is designed to compensate for the frequency deviations, thus maintaining frequency stability of the whole islanded microgrid against cyber threats. Finally, to verify the feasibility of the proposed method, comparisons between the proposed method and the conventional VSC controller are provided in different attack scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Model predictive control of heating, ventilation, and air conditioning (HVAC) systems: A state-of-the-art review

Due to the fast advancement of communication and information technology, intelligent buildings have garnered great interest. These buildings can forecast weather, ambient temperature, and sun irradiation and can modify heating, ventilation, and air conditioning (HVAC) operations appropriately, based on current and previous data. This change is intended to reduce HVAC system energy usage while maintaining an appropriate degree of thermal comfort and indoor air quality. Since its inception, model predictive control (MPC) has been one of the prospective solutions for HVAC management systems to reduce both costs and energy usage. Additionally, MPC is becoming increasingly practical as the processing capacity of building automation systems increases and a large quantity of monitored building data becomes available. MPC also provides the potential to improve the energy efficiency of HVAC systems via its capacity to consider limitations, to predict disruptions, and to factor in multiple competing goals such as interior thermal comfort and building energy consumption. Although substantial research has been conducted on MPC in building HVAC systems, there is a shortage of critical reviews and a lack of a comprehensive framework that formulates and defines the applications. Here, this article provides a comprehensive state-of-the-art overview of MPC in HVAC systems. Detailed discussions of modeling approaches and optimization algorithms are included. Numerous design aspects such as prediction horizon, occupancy behavior, building type, and cost function, that impact MPC performance are discussed in detail. The technical characteristics, advantages, and disadvantages of various types of modeling software are discussed. The primary objective of this work is to highlight critical design characteristics for the MPC control scheme and to give improved suggestions for future research. Moreover, numerous prospective scenarios have been suggested that might provide future research direction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗