Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Time-Varying Output Delay Compensation-A Model-Free Approach and its Application on Cooperative On-Ramp Merging

This paper presents a model-free approach to compensate for time-varying output delay in networked control systems. The proposed architecture combines a model-free observer and the Smith predictor. The model-free observer estimates the current state while handling modeling errors and uncertainties of the system. The Smith predictor moves the effect of time delay outside the control closed-loop using the estimated delayed output and the actual output of the plant. The proposed method is applied to a cooperative on-ramp merging problem. First, an ultra-local model predictive control is implemented to provide a computationally efficient online speed planner agnostic to the vehicle dynamics. After that, a model-free observer is designed to estimate the current state. Finally, the proposed architecture is tested against a time-varying output delay with an upper bound of 200 milliseconds. The results demonstrate the effectiveness of the proposed method with improved tracking of intervehicle distance.

Waleed khan, Muhammad [The University of Texas at ↗

Distributed MPC for Efficient Coordination of Storage and Renewable Energy Sources Across Control Areas

In electric power systems, multiple entities are responsible for ensuring an economic and reliable way of delivering power from producers to consumers. With the increase of variable renewable generation it is becoming increasingly important to take advantage of the individual entities' (and their areas') capabilities for balancing variability. Hence, in this paper, we employ and extend the approximate Newton directions method to optimally coordinate control areas leveraging storage available in one area to balance variable resources in another area with only minimal information exchange among the areas. The problem to be decomposed is a model predictive control problem including generation constraints, energy storage constraints, and AC power flow constraints. Singularity issues encountered when formulating the respective Newton-Raphson steps due to intertemporal constraints are addressed and extensions to the original decomposition method are proposed to improve the convergence rate and required communication of the method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adaptive Deep Reinforcement Learning Algorithm for Distribution System Cyber Attack Defense With High Penetration of DERs

With grid modernization, smart inverters are increasingly used to execute advanced controls for distribution network reliability. However, this also increases the cyber-attack space. Here this paper focuses on the defense approaches to restore the system to normal operation circumstances in the presence of cyber-attacks. A unique deep reinforcement learning (DRL) method is developed to minimize voltage violations and reduce power losses for impacted feeders. The defense problem is reformulated as a Markov decision-making process to dynamically control DERs while minimizing load shedding. This is achieved via an improved soft actor-critic (SAC)-based DRL algorithm, which can govern DER set points and load-shedding scenarios in discrete and continuous modes via the auto-tune entropy and Gaussian policy features. Numerical comparison results on the modified IEEE 123-node system with other control approaches, such as Volt-VAR (VV), Volt-Watt (VW), and model predictive control (MPC) show that the proposed method can eliminate voltage violations and provide feasible control actions that perform complete mitigation of cyber-threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains.Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling.The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

99 GENERAL AND MISCELLANEOUS↗

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains. Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling. The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Data-Driven Nonlinear Subspace Modeling for Prediction and Control of Molten Iron Quality Indices in Blast Furnace Ironmaking

Blast furnace (BF) in ironmaking is a nonlinear dynamic process with complicated physical-chemical reactions, where multi-phase and multi-field coupling and large time delay occur during its operation. In BF operation, the molten iron temperature (MIT) as well as Si, P and S contents of molten iron are the most essential molten iron quality (MIQ) indices, whose measurement, modeling and control have always been important issues in metallurgic engineering and automation field. This paper develops a novel data-driven nonlinear state space modeling for the prediction and control of multivariate MIQ indices by integrating hybrid modeling and control techniques. First, to improve modeling efficiency, a data-driven hybrid method combining canonical correlation analysis and correlation analysis is proposed to identify the most influential controllable variables as the modeling inputs from multitudinous factors would affect the MIQ indices. Then, a Hammerstein model for the prediction of MIQ indices is established using the LS-SVM based nonlinear subspace identification method. Such a model is further simplified by using piecewise cubic Hermite interpolating polynomial method to fit the complex nonlinear kernel function. Compared to the original Hammerstein model, this simplified model can not only significantly reduce the computational complexity, but also has almost the same reliability and accuracy for a stable prediction of MIQ indices. Last, in order to verify the practicability of the developed model, it is applied in designing a genetic algorithm based nonlinear predictive controller for multivariate MIQ indices by directly taking the established model as a predictor. Industrial experiments show the advantages and effectiveness of the proposed approach.

Blast furnace (BF)↗

Online data-enabled predictive control

We develop an online data-enabled predictive (ODeePC) control method for optimal control of unknown systems, building on the recently proposed DeePC (Coulson et al., 2019). Our proposed ODeePC method leverages a primal-dual algorithm with real-time measurement feedback to iteratively compute the corresponding real-time optimal control policy as system conditions change. The proposed ODeePC conceptual-wise resembles standard adaptive system identification and model predictive control (MPC), but it provides a new alternative for the standard methods. ODeePC is enabled by computationally efficient methods that exploit the special structure of the Hankel matrices in the context of DeePC with Fast Fourier Transform (FFT) and primal-dual algorithm We provide theoretical guarantees regarding the asymptotic behavior of ODeePC, and we demonstrate its performance through numerical examples.

97 MATHEMATICS AND COMPUTING↗

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗

Comparison of MPC Formulations for Building Control under Commercial Time-of-Use Tariffs

© 2019 IEEE. Most medium and large commercial buildings in the U.S. are subject to complex electricity tariffs that combine both Time-of-Use (TOU) energy and demand charges. This study analyses the performances of different economic Model Predictive Control (MPC) formulations, from the standpoints of monthly bill reduction, load shifting, and peak demand reduction. Simulations are performed on many simplified commercial building models, with multiple TOU demand charges, and under various summer conditions. Results show that compared to energy-only MPC, the traditional method for dealing with demand charges significantly reduces peak demand and owner bill, however, highlight a lack of load shifting capability. A proposed incremental approach is presented, which better balances the bill components in the objective function. In the case study presented, this method can improve monthly bill savings and increase load shifting during demand response events, while keeping a similarly low peak demand, compared to traditional MPC methods taking into account demand charges.

Cutsem, Olivier Van↗

Biomimetic model-based advanced control strategy integrated with multi-agent optimization for nonlinear chemical processes

Here, a novel framework is proposed for integrating biomimetic-based advanced control and multi-agent optimization approaches for nonlinear chemical process applications. In particular, a Biologically-Inspired Optimal Control Strategy, denoted as BIO-CS, is combined with multi-agent optimization (MAO) techniques to provide optimal solutions for dynamic systems. In this combined framework, the BIO-CS algorithm employs gradient-based optimal control solvers for the intermediate problems associated with the leader-follower agents’ local interactions. Also, the MAO uses the capabilities of heuristic-based optimization techniques by sharing process information to obtain optimal operating setpoints for the controller considering an overall process objective. The applicability of the proposed method is demonstrated using a nonlinear, multivariable, process model of a fermentation system. Specifically, the optimal operating points are computed by the MAO implementation for setpoint tracking, trajectory tracking and plant-model mismatch scenarios for BIO-CS application. Results of the developed framework are compared to a gradient-based Sequential Quadratic Programming (SQP) technique and a classical proportional-integral (PI) controller in terms of optimization and control studies, respectively. As an additional contribution, BIO-CS is also cast as a model predictive controller (MPC) for the first time and compared to the agent-based BIO-CS approach in terms of computational time and tracking error. Closed-loop control results show up to 46% improvement in tracking performance during transient for the multi-agent BIO-CS when compared to BIO-CS as MPC for additional computational expense. The obtained results illustrate the capabilities of this novel integrated framework including BIO-CS as MPC to achieve desired nonlinear system performance for various scenarios.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NMPC for Mode-Switching Operation of Reversible Solid Oxide Cell Systems

Solid oxide cells (SOCs) are a promising dual-mode technology that generates hydrogen through high-temperature water electrolysis and generates power through a fuel cell reaction that consumes hydrogen. Reversible operation of SOCs requires a transition between these two modes for hydrogen production setpoints as the demand and price of electricity fluctuate. Moreover, a well-functioning control system is important to avoid cell degradation during mode-switching operation. In this work, we apply nonlinear model predictive control (NMPC) to an SOC module and supporting equipment and compare NMPC performance to classical proportional integral (PI) control strategies, while ramping between the modes of hydrogen and power production. While both control methods provide similar performance in many metrics, NMPC significantly reduces cell thermal gradients and curvatures (mixed spatial-temporal partial derivatives) during mode switching. A dynamic process flowsheet of the reversible SOC system was developed in the open-source, equation-based IDAES modeling framework. Our IDAES dynamic simulation results show that NMPC can ramp the SOC system between hydrogen and power production targets within short mode-switching times. Moreover, NMPC can comply with operating limits in the SOC system more effectively than PI, and only NMPC can directly enforce user-specified limits for mixed spatial-temporal partial derivatives of temperature. This allows for management of the trade-off be-tween operating efficiency and cell degradation, which is dependent on these temperature curvatures.

Li, Mingrui↗

DC-Link Current Minimization Control for Current Source Converter-Based Solid-State Transformer

This article proposes a fast predictive control method and a small DC-link inductor to minimize the DC-link current in current-source converter (CSC)-based solid-state transformer. The DC-link current minimization can significantly reduce power loss and improve efficiency. The challenge of this problem is on improving both steady-state and dynamic performance. PI control methods and large DC-link inductors are conventionally used in the CSC but have limited dynamic performance. A model predictive control (MPC) method is proposed to achieve switching-cycle-level settling time, and the DC-link inductor is sized for 40% ripple to enable fast current change. Importantly, this article also proposes to minimize the DC-link current by varying the current even within a line cycle under single-phase load to improve the steady-state performance, in contrast with the reduction to a constant value in the literature. The proposed MPC features a constant switching frequency without weighting factors. The MPC does not have a high computational burden and is implemented in a regular digital controller for a prototype of soft-switching solid-state transformer (S4T) with reduced conduction loss. The effectiveness of the proposed method has been experimentally verified on the SiC S4T prototype during steady-state and dynamics under different multiport power flow conditions up to 2 kV peak. Here, the DC-link current in the experiments is close to the minimum current with a short zero-vector duration, which further verifies the performance of the proposed method.

14 SOLAR ENERGY↗

Traffic Signal Control for Large-Scale Urban Traffic Networks: Real-World Experiments using Vision-Based Sensors

Effective control of traffic signals plays a critical role in ensuring smooth vehicle flow in urban areas. Expertly engineered traffic signal controllers can considerably minimize travel delays and enhance sustainability. In this paper, the team proposes the Model Predictive Control (MPC) traffic signal control strategy using real-time traffic flow data from a vision-based camera as feedback information. Also, a realistic signal timing plan that considers National Electrical Manufacturers Association (NEMA) constraints has been developed to be applied to real-world scenarios. The primary aim is to reduce the number of vehicles across all links in the controlled area, thereby optimizing traffic flow and reducing energy consumption. To validate the proposed method, several real-life experiments were conducted at 24 intersections in Chattanooga, Tennessee, by collaborating with traffic field engineers. These experiments demonstrated significant performance improvements in comparison to the existing method.

data processing↗

Small Body GN&C Research Report: A G-Guidance Enhancement to Increase Mission Functionality

G-Guidance is a robust G&C (guidance and control) algorithm developed under the small-body GN&C task. The G-Guidance scheme utilizes a model predictive control approach, along with a convexification of the governing dynamics, control constraints, and trajectory/state constraints. This report details an enhancement to the FY2005 G-Guidance algorithm; the addition of a fire-second approach helps to nullify velocity errors and hit desired final velocities much more precisely than the original Fire-first scheme developed in FY2005. The enhancement preserves the primary benefit of the algorithm, which is to ensure required thruster silent times during trajectory maneuvers. The fire-second scheme increases the versatility of the algorithm for missions employing G-Guidance. For instance, a landing sequence could employ the fire-second scheme to ensure a null final velocity at landing, whereas an ascent sequence could utilize a fire-first scheme to ensure there is no drift of the spacecraft toward the ground at the beginning of the maneuver. Examples are provided within to demonstrate a fire-first versus fire-second guidance scheme. As in the existing G-Guidance algorithm, the examples and schemes incorporate gravity models and thruster firing times into discrete dynamics that are solved as a optimal control problem to minimize fuel consumption or thruster energy expenditure.

velocity errors↗

Resonance Control System for the CEBAF Separator Upgrade

Abstract The Continuous Electron Beam Accelerator Facility (CEBAF) energy upgrade from 6 GeV to 12 GeV includes the installation of four new 748.5 MHz normal conducting deflecting cavities in the 5th pass extraction region. The RF system employs two digital LLRF systems controlling four normal conducting cavities in a vector sum setting. Cavity tune information of the individual cavities is obtained using a multiplexing scheme of the forward and reflected RF signals. Water skids equipped with heaters and valves are used to control resonance. A new FPGA-based hardware and EPICS-based predictive control algorithm has been developed to support reliable operation of the beam extraction process. This paper presents the architecture design of the existing hardware and software as well as a plan to develop a model predictive control system.

Plawski, Tomasz↗

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗

Real-Time Charging Strategies for an Electric Vehicle Aggregator to Provide Ancillary Services

Real-time charging strategies, in the context of vehicle to grid (V2G) technology, are needed to enable the use of electric vehicle (EV) fleets batteries to provide ancillary services (AS). Here, we develop tools to manage charging and discharging in a fleet to track an Automatic Generation Control (AGC) signal when aggregated. We also propose a real-time controller that considers bidirectional charging efficiency and extend it to study the effect of looking ahead when implementing Model Predictive Control (MPC). Simulations show that the controller improves tracking error as compared with benchmark scheduling algorithms, as well as regulation capacity and battery cycling.

33 ADVANCED PROPULSION SYSTEMS↗