SEARCH · Search NASA

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

All sources NASA NTRS DOE OSTI

DOE OSTI2019

Chance-Constrained Energy Management System for Power Grids With High Proliferation of Renewables and Electric Vehicles

This paper proposes a two-stage energy management system (EMS) for power grids with massive integration of electric vehicles (EVs) and renewable energy resources. The first stage economic dispatch determines the optimal operating points of charging stations and battery swapping stations (BSS) for EVs under plug-in and battery swapping modes, respectively. The proposed stochastic model predictive control (SMPC) problem in this stage is characterized through a chance-constrained optimization formulation that can effectively capture the system and the forecast uncertainties. A distributed algorithm, the alternating direction method of multipliers (ADMM), is applied to accelerate the optimization computation through parallel computing. The second stage is aimed in coordinating the EV charging mechanisms to continuously follow the first-stage solutions, i.e., the target operating points, and meeting the EV customers' charging demands captured via the Advanced Metering Infrastructure (AMI). In this work, the proposed solution offers a holistic control strategy for large-scale centralized power grids in which the aggregated individual parameters are predictable and the system dynamics do not vary sharply within a short time-interval.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2016

A modeling framework for optimal energy management of a residential building

Residential buildings are currently equipped with energy production facilities, e.g., solar rooftops and batteries, which in conjunction with smart meters, can function as smart energy hubs coordinating the loads and the resources in an optimal manner. This paper presents a mathematical model for the optimal energy management of a residential building and proposes a centralized energy management system (CEMS) framework for off-grid operation. The model of each component of the hub is integrated within the CEMS. The optimal decisions are determined in real-time by considering these models with realistic parameter settings and customer preferences. Model predictive control (MPC) is used to adapt the optimal decisions on a receding horizon to account for the deviations in the system inputs. Simulation results are presented to demonstrate the feasibility and effectiveness of the proposed CEMS framework. Results show that the proposed CEMS can reduce the energy cost and energy consumption of the customers by approximately 17% and 8%, respectively, over a day. In conclusion, using the proposed CEMS, the total charging cycles of the ESS were reduced by more than 50% in a day.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2019

Economy analysis of second-life battery in wind power systems considering battery degradation in dynamic processes: Real case scenarios

Energy storage system plays an important role in modern power systems for mitigating the variation and intermittency of renewable energy sources. The Lithium-ion battery is currently the most widely used solution for energy storage system. However, its high cost is considered as one of the major barriers hampering the integration of renewable energy and the adoption of electric vehicles. Reusing electric vehicle batteries seems a promising solution to the aforementioned problem. Based on a dynamic degradation model of Lithium-ion batteries, this paper first compares the profits that second-life and fresh batteries can bring to the wind farm. Model predictive control is adopted to solve an hourly optimal wind scheduling problem and maximize the profit of wind farm owner. Here, the optimal size of battery is determined and then the comparison of second-life and fresh batteries is conducted taking the battery degradation, the profit of the wind farm owner, and various remaining capacities of battery into account. Two case studies in USA and Denmark are conducted and the analysis shows that given the current prices of wind energy and Lithium-ion batteries, reusing batteries is not worthwhile for the studied wind farms, but it may outperform fresh batteries in the future if the wind energy price decreases much faster than the battery price.

17 WIND ENERGY↗

DOE OSTI2024

Power System Frequency Dynamics Modeling, State Estimation, and Control using Neural Ordinary Differential Equations (NODEs) and Soft Actor-Critic (SAC) Machine Learning Approaches

With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)↗

NASA NTRS2005

Small Body GN&C Research Report: A Guidance and Control Technique for Small-Body Proximity Operations with Guaranteed Guidance Resolvability and Required Thruster Silent Time

The guidance and control (G&C) algorithms for enabling small-body proximity operations are developed by using a model predictive control approach along with a convexification of the governing dynamics, control constraints, and trajectory/state constraints. The open-loop guidance is solved ahead of time or in a resolvable, real-time manner through the use of PWG (Pseudo Way-point Generation), a technique developed in this research. The PWG scheme ensures required thruster silent times during trajectory maneuvers. The feedback control is implemented to track the PWG trajectories in a manner that guarantees the resolvability for the open-loop problem, enabling the ability to update the G&C in a model-predictive manner. The schemes incorporate gravity models and thruster ring times into discrete dynamics that are solved as a optimal control problem to minimize fuel consumption or thruster energy expenditure. The optimal control problem is cast as an LMI (Linear Matrix Inequality) and then solved through Semi-Definite Programming techniques in a computationally efficient manner that provides convergence and constraint guarantees.

guidance and control (G&C)↗

DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2018

Final Technical and Scientific Report: Advanced Control of the Azura Wave Energy Device

The objective of the project was to develop a model predictive controller and associated hydraulic PTO for the Azura wave energy device to improve the annual energy production (AEP) and reduce the levelized cost of electricity (LCOE) of the device. Performance of the controller and hydraulic PTO were validated in a 1/15th scale wave tank test performed at the University of Maine. Three controllers, with three corresponding PTOs, were developed and tested as part of the project. The three controllers are an ideal MPC controller paired with an ideal PTO, an MPC controller with a heuristic paired with a directional force control hydraulic PTO, and a preliminary study of an MPC controller applied to a variable force hydraulic PTO. Experimental data was used to estimate the controller paired with the directional force control would increase the annual energy production of the Azura at WETS by 12%, with a corresponding reduction in LCOE of 10.8%. Preliminary testing of the variable force hydraulic PTO paired with a MPC shows this configuration has the potential to increase the AEP of the Azura at WETS by at least 33%. Further design and development work is necessary to develop the PTO technology to achieve these gains. Additionally, all control schemes require additional work to address the short-term wave prediction method needed to implement the control. In addition to validation of these control methods, NWEI demonstrated careful design of a wave tank test model, PTO, and instrumentation yields high quality test data, and the ability to test advanced control algorithms and include complex PTO dynamics via hardware-in-the-loop testing techniques.

16 TIDAL AND WAVE POWER↗

DOE OSTI2024

Development and Validation of Home Comfort System for Total Performance Deficiency/Fault Detection and Optimal Comfort Control

In this project, we developed and tested a learning-based home thermal model that facilitates the operation of a model predictive control (MPC)-based optimization agent and an automated fault detection and diagnosis (AFDD) agent. The home thermal model was constructed using a two-node resistor-capacitor model. Moreover, two accompanying parameter identification methods were introduced, least-squares and optimization. Based on the home thermal model, the MPC-based optimization agent was developed to optimize residential HVAC operation. Using two FDD methods, the AFDD agent was constructed to detect and diagnose two prevalent residential AC faults, airflow reduction and refrigerant undercharge. The home thermal model, along with the MPC-based optimization agent and AFDD agent, were tested at the Norman Test House, Miami Test House, Pacific Northwest National Laboratory (PNNL) Test House A, and PNNL Test House B. Finally, they were also field tested in nine demonstration homes with real occupants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗

NASA NTRSDate not supplied

Assessment of Control Algorithms for Mars Entry Vehicles With Flap-Based Trajectory Control Under Uncertainty

Flap-based steering systems on blunt-body entry vehicles may improve flight performance relative to heritage bank-angle steering systems. Successful implementation of articulating aerodynamic flaps on a hypersonic entry vehicle requires an active control system to map angle of attack and sidelip angle commands to flap deflection commands. Here, a successive-linearization model prective control algorithm, as a linear quadratic regulator, are formulated, designed, and assessed to address this multiple input multiple output control problem. These two control algorithms are assessed under uncertainty in Monte Carlo simulations for various control profiles and vehicle configurations. Results indicate that while both control algorithms provide successful command tracking under uncertainty, the model predictive controller provides a lower mean and integral error, as well as greater robustness, relative to the linear-quadratic regulator.

Daniel L Engel↗

DOE OSTI2018

Predictive drug dosage control through a Fokker–Planck observer

During the years, various techniques have been presented for optimal control of tumor growth for which its stochastic behavior has rarely been considered. This article uses the well-known Gompertz stochastic model, for describing tumor growth, and by receding horizon model predictive control (RH-MPC) scheme computes the drug dosage for minimizing the tumor-cell population. To do this, a predictive control problem is defined based on the difference between the probability density function of tumor-cell population and the desired probability density function. In the model, both the drug dosage limitation and the Fokker–Planck equation have been considered as constraints. By solving this problem, the drug dosage which is considered as an external input to tumor model, is computed. In this article, the Fokker–Planck equation is used (1) as a nonlinear observer of probability density function of tumor-cell population and (2) a mapping vehicle from stochastic to deterministic domain. The Fokker–Planck equation is written for the Gompertz stochastic model of tumor growth. The equation is then solved through the path integral method. In this way, the probability density function of tumor-cell population, which contains the entire stochastic characteristics of the tumor growth, is obtained for any instance of time. The simulation results have also been presented for the evaluation of the suggested approach. The results show that the tumor-cell population can be controlled within a number of time windows (15 time windows in our case study) if an appropriate desired PDF is selected.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Deep Learning Explicit Differentiable Predictive Control Laws for Buildings

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear model predictive control (MPC). Contrary to approximate MPC, DPC does not require supervision by an expert controller. Instead, a system dynamics model is learned from a small dataset of recorded observations of the perturbed system's dynamics and the control law is optimized offline by interaction with the learned system model. The DPC method is based on two sequential steps, i) system identification using a constrained neural state-space model, and ii) optimization of an explicit control law parametrized by another neural network in closed-loop simulation with the identified neural state-space model. The combination of a differentiable closed-loop system and penalty methods for constraint handling of system outputs and inputs allows us to optimize the control law's parameters directly by backpropagating economic MPC loss through the learned system model. By incorporating domain knowledge and leveraging established techniques from optimal control, our method leverages deep neural networks as nonlinear function approximators for system identification and control while avoiding concomitant costs of intractably large datasets, and computationally expensive over-parametrized models. The scalability, data efficiency, and constrained optimal control capability of the proposed DPC method are demonstrated in simulation using a multi-zone building emulator.

Drgona, Jan↗

DOE OSTI2019

Machine‐learning‐based predictive control of nonlinear processes. Part II: Computational implementation

Abstract Machine learning is receiving more attention in classical engineering fields, and in particular, recurrent neural networks (RNNs) coupled with ensemble regression tools have demonstrated the capability of modeling nonlinear dynamic processes. In Part I of this two‐article series, the Lyapunov‐based model predictive control (LMPC) method using a single RNN model and an ensemble of RNN models, respectively, was rigorously developed for a general class of nonlinear systems. In the present article, computational implementation issues of this new control method ranging from training of the RNN models, ensemble regression of the RNN models, and parallel computation for accelerating the real‐time model calculations are addressed. Furthermore, a chemical reactor example is used to demonstrate the implementation and effectiveness of these machine‐learning tools in LMPC as well as compare them with standard state‐space model identification tools.

Wu, Zhe↗

DOE OSTI2025

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS)

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

grid architecture↗

DOE OSTI2022

Data Driven Controls at WRRFs – A Plan for Ammonia-Based Aeration Control (ABAC)

An ammonia-based aeration controller (ABAC) is being developed in the form of a model predictive controller (MPC) at the HRSD Nansemond Treatment Plant. The project integrates the following concepts: machine learning, digital twin, ABAC and MPC.

Sparks, Jeff↗