Search NASA⌕ Search

SEARCH · Search NASA

Results for “model predictive controller”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

System and method for operator control of heterogeneous unmanned system teams

A control architecture and associated control methods are under development to allow a single user to control a team of multiple heterogeneous UMS as they conduct multi-faceted (i.e. multi-objective) missions in real time is disclosed. The control architecture is hierarchical, modular and layered and enables operator interaction at each layer, ensuring the human operator is in close control of the unmanned team at all times. The architecture and key data structures are introduced. Two approaches to distributed collaborative control of heterogeneous unmanned systems are described, including an extension of homogeneous swarm control and a novel application of distributed model predictive control. Initial results are presented, demonstrating heterogeneous UMS teams conducting collaborative missions.

47 OTHER INSTRUMENTATION↗

Laboratory Evaluation of Federated, Hierarchical Controls for Distribution Power System Management: Preprint

The connection of more loads and distributed energy resources (DERs) to the distribution power system brings both challenges and opportunities to system operators. There are opportunities to aggregate flexible loads and DERs to provide transmission grid services, but the coordinated actions of DERs being managed by independent, third-party DER aggregators to support transmission system operations can present challenges. We developed a federated DER management architecture and control framework that aims to manage heterogeneous DERs to deliver reliable transmission grid services while respecting distribution system constraints. The controls include stochastic day-ahead optimization, model predictive control, and a simple real-time management scheme. We present simulation results obtained from a realistic laboratory test bed of federated controls managing DERs within a substation service area to make the substation net power follow the optimal net power determined by the day-ahead optimization based on cost and limiting reverse power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗

AlphaBuilding ResCommunity: A multi-agent virtual testbed for community-level load coordination

Training and validating algorithms in a simulation testbed can accelerate research and applications of optimal control of residential loads to improve energy flexibility and grid resilience. We developed an open-source simulation environment, AlphaBuilding ResCommunity, that can be used to train and validate algorithms to control a single thermostatically controlled load (TCL) or coordinate a group of TCLs. We used reduced-order models to simulate the thermodynamics of TCLs, and the parameter values were determined from the connected smart thermostat data of real households. The environment was built upon the standardized OpenAI Gym interface. Ancillary functions, such as retrieving the parameters and weather forecasts, are provided to facilitate control strategies that require predictive information. Compared with existing efforts, AlphaBuilding ResCommunity has three advantages: (1) more realistic model settings because the parameter values are identified from actual household operating data, and modelling and measurement uncertainty are considered; (2) passive thermal storage control; and (3) ease of use due to a simple software dependency and standardized interface. We demonstrated the applications of the environment by implementing a Kalman Filter and Model Predictive Control on a single TCL and a Priority-Stack-Based Control and Alternating Direction Method of Multipliers to coordinate multiple TCLs for load tracking.

Wang, Z↗

Optimal pumping schedule with high-viscosity gel for uniform distribution of proppant in unconventional reservoirs

Hydrocarbon recovery from a hydraulic-fractured unconventional reservoir can be enhanced by replacing slickwater with non-Newtonian high-viscosity gel as a fracturing fluid. However, in the literature, the role of gel rheology on hydrocarbon production from a fractured reservoir is not very well understood. This lack of understanding makes it difficult for the industry to choose appropriate viscosity parameters of fracturing gels. Motivated by these limitations, first, we have developed a high-fidelity model of non-Newtonian fluid flow to simulate fracture propagation, fluid leak-off, and gel flowback processes to predict the oil production from a hydraulic fractured reservoir. Simulation results of the high-fidelity model show how fracture geometry, formation damage, and gel cleanup process varies with the fracturing fluid rheology. Therefore, the developed model is used to understand the effect of gel rheology on hydrocarbon production via a sensitivity analysis, which provides a set of rheological parameters that maximize the cumulative amount of oil production. Finally, utilizing this optimal high-viscosity gel, a model predictive controller is designed to obtain an optimal pumping schedule necessary for producing a target fracture geometry and proppant concentration. The closed-loop simulation results demonstrate that the obtained pumping schedule successfully achieved the desired fracture geometry and proppant concentration at the end of pumping, leading to the maximum oil production from an unconventional reservoir.

13 HYDRO ENERGY↗

Frequency Analysis of Solar PV Power to Enable Optimal Building Load Control

In this paper, we present a flexibility estimation mechanism for buildings’ thermostatically controlled loads (TCLs) to enable the distribution level consumption of the majority of solar photovoltaic (PV) generation by local building TCLs. The local consumption of PV generation provides several advantages to the grid operation as well as the consumers, such as reducing the stress on the distribution network, minimizing voltage fluctuations and two-way power flows in the distribution network, and reducing the required battery storage capacity for PV integration. This would result in increasing the solar PV generation penetration levels. The aims of this study are twofold. First, spectral (frequency) analyses of solar PV power generation together with the power consumption of multiple building TCLs (such as heating, ventilation, and air conditioning (HVAC) systems, water heaters, and refrigerators) are performed. These analyses define the bandwidth over which these TCLs can operate and also describe the PV generation frequency bandwidth. Such spectral analyses, in frequency domain, can help identify the flexible components of PV generation that can be consumed by the various TCLs through optimal building load utilization. Second, a quadratic optimization problem based on model predictive control is formulated to allow consuming most of the low and medium frequency content of the PV power locally by building TCLs, while maintaining occupants’ comfort and TCLs’ physical constraints. The solution to the proposed optimization problem is achieved using optimal control strategies. Numerical results show that most of the low and medium frequency content of the PV generation can be consumed locally by building TCLs. The remaining high-frequency content of the PV generation can then be stored/offset using energy storage systems.

14 SOLAR ENERGY↗

Stochastic Home Energy Management Systems with Varying Controllable Resources

This paper studies the performance of a model predictive control (MPC) algorithm in a home energy management system (HEMS) as the set of controllable resources varies and under both a constant and a time-of-use (TOU) electricity price structure. The set of controllable resources includes residentially-owned photovoltaic (PV) panels, a home battery system (HBS), an electric vehicle (EV), and a home heating, ventilation, and air conditioning (HVAC) system. The HEMS optimally schedules the set of controllable resources given user preferences such as indoor thermal comfort and electricity cost sensitivity. The home energy management system is built on a chance constrained, MPC-based algorithm, where the chance constraint ensures the indoor thermal comfort is satisfied with a high probability given uncertainty in the outdoor temperature and solar irradiance forecasts. Simulation results for varying sets of controllable resources under two different electricity price structures demonstrate the variation in the HEMS control with respect to HBS operation, electricity cost, and grid power usage.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Stabilizer based Predictive Control Scheme for Smart Inverters in Weak Grid

This paper presents a self-stabilization mechanism based on finite-set model predictive control (FCS-MPC) framework for smart inverters operating in weak grid conditions. As weak grid’s large parasitic impedance and low short-circuitratio (SCR) challenge the stable operation of grid-connected inverters. Specifically, the inverter may experience frequencies that might excite the LCL filter resonance phenomenon. The inverter stability collapses if this LCL resonance is triggered. To address this issue, a robust predictive controller is proposed that features a self-stabilization mechanism for smart inverters interacting with a weak grid. The proposed methodology utilizes the idea that in stiff grid conditions the grid current feedback (GCF) is stable and in weak grid conditions the inverter current feedback (ICF) is stable. Therefore, the proposed FCS-MPC toggles between GCF and ICF to achieve inherent LCL filter resonance damping. The toggling action between GCF and ICF is leveraged by comparing the moving RMS grid current with threshold current as a constrained in the proposed FCS-MPC cost function. The theoretical analyses are verified by several case studies for a single-phase grid-connected inverter. The analysis and results demonstrated that the proposed FCS-MPC operates well under weak, ultra-weak and stiff grid conditions.

Umar, Muhammad Farooq↗

Intelligent Engine Systems: Adaptive Control

We have studied the application of the baseline Model Predictive Control (MPC) algorithm to the control of main fuel flow rate (WF36), variable bleed valve (AE24) and variable stator vane (STP25) control of a simulated high-bypass turbofan engine. Using reference trajectories for thrust and turbine inlet temperature (T41) generated by a simulated new engine, we have examined MPC for tracking these two reference outputs while controlling a deteriorated engine. We have examined the results of MPC control for six different transients: two idle-to-takeoff transients at sea level static (SLS) conditions, one takeoff-to-idle transient at SLS, a Bode power command and reverse Bode power command at 20,000 ft/Mach 0.5, and a reverse Bode transient at 35,000 ft/Mach 0.84. For all cases, our primary focus was on the computational effort required by MPC for varying MPC update rates, control horizons, and prediction horizons. We have also considered the effects of these MPC parameters on the performance of the control, with special emphasis on the thrust tracking error, the peak T41, and the sizes of violations of the constraints on the problem, primarily the booster stall margin limit, which for most cases is the lone constraint that is violated with any frequency.

Gibson, Nathan↗

Chance-Constrained Energy Management System for Power Grids With High Proliferation of Renewables and Electric Vehicles

This paper proposes a two-stage energy management system (EMS) for power grids with massive integration of electric vehicles (EVs) and renewable energy resources. The first stage economic dispatch determines the optimal operating points of charging stations and battery swapping stations (BSS) for EVs under plug-in and battery swapping modes, respectively. The proposed stochastic model predictive control (SMPC) problem in this stage is characterized through a chance-constrained optimization formulation that can effectively capture the system and the forecast uncertainties. A distributed algorithm, the alternating direction method of multipliers (ADMM), is applied to accelerate the optimization computation through parallel computing. The second stage is aimed in coordinating the EV charging mechanisms to continuously follow the first-stage solutions, i.e., the target operating points, and meeting the EV customers' charging demands captured via the Advanced Metering Infrastructure (AMI). In this work, the proposed solution offers a holistic control strategy for large-scale centralized power grids in which the aggregated individual parameters are predictable and the system dynamics do not vary sharply within a short time-interval.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A modeling framework for optimal energy management of a residential building

Residential buildings are currently equipped with energy production facilities, e.g., solar rooftops and batteries, which in conjunction with smart meters, can function as smart energy hubs coordinating the loads and the resources in an optimal manner. This paper presents a mathematical model for the optimal energy management of a residential building and proposes a centralized energy management system (CEMS) framework for off-grid operation. The model of each component of the hub is integrated within the CEMS. The optimal decisions are determined in real-time by considering these models with realistic parameter settings and customer preferences. Model predictive control (MPC) is used to adapt the optimal decisions on a receding horizon to account for the deviations in the system inputs. Simulation results are presented to demonstrate the feasibility and effectiveness of the proposed CEMS framework. Results show that the proposed CEMS can reduce the energy cost and energy consumption of the customers by approximately 17% and 8%, respectively, over a day. In conclusion, using the proposed CEMS, the total charging cycles of the ESS were reduced by more than 50% in a day.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Economy analysis of second-life battery in wind power systems considering battery degradation in dynamic processes: Real case scenarios

Energy storage system plays an important role in modern power systems for mitigating the variation and intermittency of renewable energy sources. The Lithium-ion battery is currently the most widely used solution for energy storage system. However, its high cost is considered as one of the major barriers hampering the integration of renewable energy and the adoption of electric vehicles. Reusing electric vehicle batteries seems a promising solution to the aforementioned problem. Based on a dynamic degradation model of Lithium-ion batteries, this paper first compares the profits that second-life and fresh batteries can bring to the wind farm. Model predictive control is adopted to solve an hourly optimal wind scheduling problem and maximize the profit of wind farm owner. Here, the optimal size of battery is determined and then the comparison of second-life and fresh batteries is conducted taking the battery degradation, the profit of the wind farm owner, and various remaining capacities of battery into account. Two case studies in USA and Denmark are conducted and the analysis shows that given the current prices of wind energy and Lithium-ion batteries, reusing batteries is not worthwhile for the studied wind farms, but it may outperform fresh batteries in the future if the wind energy price decreases much faster than the battery price.

17 WIND ENERGY↗

Power System Frequency Dynamics Modeling, State Estimation, and Control using Neural Ordinary Differential Equations (NODEs) and Soft Actor-Critic (SAC) Machine Learning Approaches

With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.

97 MATHEMATICS AND COMPUTING↗

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)↗

Small Body GN&C Research Report: A Guidance and Control Technique for Small-Body Proximity Operations with Guaranteed Guidance Resolvability and Required Thruster Silent Time

The guidance and control (G&C) algorithms for enabling small-body proximity operations are developed by using a model predictive control approach along with a convexification of the governing dynamics, control constraints, and trajectory/state constraints. The open-loop guidance is solved ahead of time or in a resolvable, real-time manner through the use of PWG (Pseudo Way-point Generation), a technique developed in this research. The PWG scheme ensures required thruster silent times during trajectory maneuvers. The feedback control is implemented to track the PWG trajectories in a manner that guarantees the resolvability for the open-loop problem, enabling the ability to update the G&C in a model-predictive manner. The schemes incorporate gravity models and thruster ring times into discrete dynamics that are solved as a optimal control problem to minimize fuel consumption or thruster energy expenditure. The optimal control problem is cast as an LMI (Linear Matrix Inequality) and then solved through Semi-Definite Programming techniques in a computationally efficient manner that provides convergence and constraint guarantees.

guidance and control (G&C)↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Final Technical and Scientific Report: Advanced Control of the Azura Wave Energy Device

The objective of the project was to develop a model predictive controller and associated hydraulic PTO for the Azura wave energy device to improve the annual energy production (AEP) and reduce the levelized cost of electricity (LCOE) of the device. Performance of the controller and hydraulic PTO were validated in a 1/15th scale wave tank test performed at the University of Maine. Three controllers, with three corresponding PTOs, were developed and tested as part of the project. The three controllers are an ideal MPC controller paired with an ideal PTO, an MPC controller with a heuristic paired with a directional force control hydraulic PTO, and a preliminary study of an MPC controller applied to a variable force hydraulic PTO. Experimental data was used to estimate the controller paired with the directional force control would increase the annual energy production of the Azura at WETS by 12%, with a corresponding reduction in LCOE of 10.8%. Preliminary testing of the variable force hydraulic PTO paired with a MPC shows this configuration has the potential to increase the AEP of the Azura at WETS by at least 33%. Further design and development work is necessary to develop the PTO technology to achieve these gains. Additionally, all control schemes require additional work to address the short-term wave prediction method needed to implement the control. In addition to validation of these control methods, NWEI demonstrated careful design of a wave tank test model, PTO, and instrumentation yields high quality test data, and the ability to test advanced control algorithms and include complex PTO dynamics via hardware-in-the-loop testing techniques.

16 TIDAL AND WAVE POWER↗