Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗

Real-Time Ecodriving Control in Electrified Connected and Autonomous Vehicles Using Approximate Dynamic Programing

Connected and automated vehicles (CAVs), particularly those with a hybrid electric powertrain, have the potential to significantly improve vehicle energy savings in real-world driving conditions. In particular, the ecodriving problem seeks to design optimal speed and power usage profiles based on available information from connectivity and advanced mapping features to minimize the fuel consumption over an itinerary. This paper presents a hierarchical multilayer model predictive control (MPC) approach for improving the fuel economy of a 48 V mild-hybrid powertrain in a connected vehicle environment. Approximate dynamic programing (DP) is used to solve the receding horizon optimal control problem, whose terminal cost is approximated with the base policy obtained from the long-term optimization. The controller was tested virtually (with deterministic and Monte Carlo simulation) across multiple real-world routes, demonstrating energy savings of more than 20%. The controller was then deployed on a test vehicle equipped with a rapid prototyping embedded controller. In-vehicle testing confirm the energy savings obtained in simulation and demonstrate the real-time ability of the controller.

Automation & Control Systems↗

Adaptive Optimization for System Performance and Combined Bernstein Polynomial, Optimal Reciprocal Collision Avoidance, Differential Dynamic Programming for Trajectory Replanning and Collision Avoidance for UAM Vehicles

The emerging urban air mobility (UAM) sector in aerospace is driving development of unconventional multi-modal vehicle configurations and autonomous flight. The combination of multi-modal vehicle dynamics, complex environment, requirements to deal with flight contingencies in an efficient and safe manner, as well as necessity for precise trajectory following and performance, are the driving influence behind adaptive optimization for system performance. We are interested in trajectory optimization algorithm that would system parameter estimation and identifying the optimal switching time between modes of hybrid dynamical systems. This presentation discusses a parameterized optimal control trajectory optimization algorithm that is an extended and generalized version of Differential Dynamic Programming (DDP), titled Parameterized Differential Dynamic Programming (PDDP). DDP is an efficient trajectory optimization algorithm relying on second order approximations of a system’s dynamics and cost function and has recently been applied to optimize systems with time invariant parameters. Experiments are presented applying PDDP to solve model predictive control (MPC) and moving horizon estimation (MHE) tasks simultaneously. In particular, PDDP is used to determine the optimal transition point between flight regimes of a complex urban air mobility (UAM) class vehicle exhibiting multiple phases of flight and to identify and compensate for actuation faults.

optimization↗

Controls-structures-electromagnetics interaction program

A technology development program is described involving Controls Structures Electromagnetics Interaction (CSEI) for large space structures. The CSEI program was developed as part of the continuing effort following the successful kinematic deployment and RF tests of the 15 meter Hoop/Column antenna. One lesson learned was the importance of making reflector surface adjustment after fabrication and deployment. Given are program objectives, ground based test configuration, Intelsat adaptive feed, reflector shape prediction model, control experiment concepts, master schedule, and Control Of Flexible Structures-II (COFS-II) baseline configuration.

Grantham, William L.↗

Systems and methods for energy cost optimization in a building system

Methods and systems to minimize energy cost in response to time-varying energy prices are presented for a variety of different pricing scenarios. A cascaded model predictive control system is disclosed comprising an inner controller and an outer controller. The inner controller controls power use using a derivative of a temperature setpoint and the outer controller controls temperature via a power setpoint or power deferral. An optimization procedure is used to minimize a cost function within a time horizon subject to temperature constraints, equality constraints, and demand charge constraints. Equality constraints are formulated using system model information and system state information whereas demand charge constraints are formulated using system state information and pricing information. A masking procedure is used to invalidate demand charge constraints for inactive pricing periods including peak, partial-peak, off-peak, critical-peak, and real-time.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Cooperative and Integrated Vehicle and Intersection Control for Energy Efficiency (CIVIC-E²)

Recent advances in connected vehicle technologies enable vehicles and signal controllers to cooperate and improve the traffic management at intersections. This paper explores the opportunity for cooperative and integrated vehicle and intersection control for energy efficiency (CIVIC-E 2 ) to contribute to a more sustainable transportation system. We propose a two-level approach that jointly optimizes the traffic signal timing and vehicles' approach speed, with the objective being to minimize total energy consumption for all vehicles passing through an isolated intersection. More specifically, at the intersection level, a dynamic programming algorithm is designed to find the optimal signal timing by explicitly considering the arrival time and energy profile of each vehicle. At the vehicle level, a model predictive control strategy is adopted to ensure that vehicles pass through the intersection in a timely fashion. Our simulation study has shown that the proposed CIVIC-E 2 system can significantly improve intersection performance under various traffic conditions. Furthermore, compared with conventional fixed-time and actuated signal control strategies, the proposed algorithm can reduce energy consumption and queue length by up to 31% and 95%, respectively.

33 ADVANCED PROPULSION SYSTEMS↗

Melter Modeling over a Range of Scales to Support Vitrification at the WTP

Computational modeling is a powerful complement to laboratory experiments and testing of systems at various scales. When properly applied and validated, computational fluid dynamics (CFD) can provide information not readily obtainable by physical testing, especially in cases where the operating environment does not permit visual observation or the insertion of typical data acquisition instrumentation as in the case of waste glass vitrification. A series of CFD and heat transfer models over a range of scales are being developed to support melter operations at the Hanford Waste Treatment and Immobilization Plant. This paper provides a description of the models and the resulting information they provide that can be used to improve melter throughput, as well as aid in evaluating and resolving operating plant issues or upsets. This work is important for the WTP operation by providing a potential for model-predictive control of the melter operation. Increases in the rate of glass production and avoiding idling can significantly decrease the duration and cost of the vitrification campaign, potentially saving billions of dollars.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Cold Climate Integrated Heat Pump with Energy Storage for Grid-Responsive Control

An air-source integrated heat pump (ASIHP) is a multifunctional unit, capable of space cooling, space heating, and water heating. We developed a packaged cold climate ASIHP, using a multi-stage compressor, capable of working down to -25°C, and providing 100% rated capacity down to -15°C with a heating COP > 2.2. An innovative system configuration and related controls were developed to solve charge balance in the integrated heat pump, smooth charge migration, and mode transition among multiple working modes. Extensive laboratory investigations for individual modes were performed to verify the performance. Its integrated heating capability provides speedy water heating to meet domestic hot water use and store heating energy in a phase change material ceiling/panel. The heating energy storage can be used to shift the load when the electricity price is high. Based on the performance data and a calibrated model from the laboratory testing, we conducted building energy simulations driven by a model predictive control, using EnergyPlus in one U.S. cold climate zone to investigate the grid-responsive control strategy and estimate the utility cost reduction potential.

Shen, Bo↗

Reactive Collision Avoidance Algorithm

The reactive collision avoidance (RCA) algorithm allows a spacecraft to find a fuel-optimal trajectory for avoiding an arbitrary number of colliding spacecraft in real time while accounting for acceleration limits. In addition to spacecraft, the technology can be used for vehicles that can accelerate in any direction, such as helicopters and submersibles. In contrast to existing, passive algorithms that simultaneously design trajectories for a cluster of vehicles working to achieve a common goal, RCA is implemented onboard spacecraft only when an imminent collision is detected, and then plans a collision avoidance maneuver for only that host vehicle, thus preventing a collision in an off-nominal situation for which passive algorithms cannot. An example scenario for such a situation might be when a spacecraft in the cluster is approaching another one, but enters safe mode and begins to drift. Functionally, the RCA detects colliding spacecraft, plans an evasion trajectory by solving the Evasion Trajectory Problem (ETP), and then recovers after the collision is avoided. A direct optimization approach was used to develop the algorithm so it can run in real time. In this innovation, a parameterized class of avoidance trajectories is specified, and then the optimal trajectory is found by searching over the parameters. The class of trajectories is selected as bang-off-bang as motivated by optimal control theory. That is, an avoiding spacecraft first applies full acceleration in a constant direction, then coasts, and finally applies full acceleration to stop. The parameter optimization problem can be solved offline and stored as a look-up table of values. Using a look-up table allows the algorithm to run in real time. Given a colliding spacecraft, the properties of the collision geometry serve as indices of the look-up table that gives the optimal trajectory. For multiple colliding spacecraft, the set of trajectories that avoid all spacecraft is rapidly searched on-line. The optimal avoidance trajectory is implemented as a receding-horizon model predictive control law. Therefore, at each time step, the optimal avoidance trajectory is found and the first time step of its acceleration is applied. At the next time step of the control computer, the problem is re-solved and the new first time step is again applied. This continual updating allows the RCA algorithm to adapt to a colliding spacecraft that is making erratic course changes.

Scharf, Daniel↗

Adaptive Cyber-Physical Resilience for Building Control Systems

The main goal of the project is to develop an AI-based process layer cybersecurity suite for detection, isolation and mitigation of cyber-attack effects on operation of building energy management systems (BEMS). The following constituent key technologies were developed under the program towards fulfilling the program objectives: (1) developed a high fidelity BEMS testbed for generation of training data and validation of developed technologies; (2) developed a physics informed ML based attack detection and localization module (ADL) capable of detecting high impact stealthy attacks (HISA - attacks causing 30% energy utilization but no immediate visible impact otherwise) with 98% accuracy; (3) developed a methodology to determine ’representative days’ to limit the data required for training; (4) developed a virtual sensing system that can reconstruct affected sensors with 10% error for the same HISA set; (5) developed a resilient model predictive control system that can continue operation of the BEMS without jeopardizing stability for the HISA set; and (6) integrated and deployed all the constituent modules and demonstrated the efficacy of the technology in real-time in a hardware in loop simulation.

42 ENGINEERING↗

Seamlessly Fuel Flexible Heat Pump with Optimal Model-based Control Strategies to Reduce Peak Demand, Utility Cost and CO2 Emission

This research develops a novel hybrid fuel heat pump system for space heating of residential and small commercial buildings with built-in optimization and control. Whereas conventional dual fuel systems either run on gas or electricity at any given moment, the proposed seamlessly fuel flexible heat pump (SFFHP) simultaneously consumes gas and electricity and continuously optimizes the proportion of each. The building air flows across the heat pump condenser first and then flows across the furnace coil, and this reduces the heat pump temperature lift. The SFFHP delivers energy savings by allowing each subsystem (gas furnace and electric heat pump) to operate where it performs best to improve energy efficiency, minimize energy cost, and minimize carbon footprint. The capacities of the electric heat pump and gas furnace are continuously adjusted based on ambient conditions, utility price signals, and marginal grid emission signals. An optimal model predictive control strategy was developed with the goal of minimizing utility cost and minimizing CO2 emission. Two case studies were conducted to simulate the performance of SFFHP during the heating season in Chicago and Los Angeles, respectively. Compared with a conventional electric heat pump, SFFHP yields 33% utility cost reduction and 49% CO2 emission reduction in Chicago. Similarly, it achieves 23% utility cost reduction and 17% CO2 emission reduction in Los Angeles. Case studies demonstrate that SFFHP can deliver significant reductions in peak demand, utility cost, and CO2 emission. Due to the hybrid fuel nature of this novel equipment, user comfort will always be maintained. The fuel flexibility makes it an attractive option for demand response programs.

Li, Zhenning↗

Piloted Simulator Evaluation Results of Flight Physics Based Stall Recovery Guidance

In recent studies, it has been observed that loss of control in flight is the most frequent primary cause of accidents. A significant share of accidents in this category can be remedied by upset prevention if possible, and by upset recovery if necessary, in this order of priorities. One of the most important upsets to be recovered from is stall. Recent accidents have shown that a correct stall recovery maneuver remains a big challenge in civil aviation, partly due to a lack of pilot training. A possible strategy to support the flight crew in this demanding context is calculating a recovery guidance signal, and showing this signal in an intuitive way on one of the cockpit displays, for example by means of the flight director. Different methods for calculating the recovery signal, one based on fast model predictive control and another using an energy based approach, have been evaluated in four relevant operational scenarios by experienced commercial as well as test pilots in the Vertical Motion Simulator at NASA Ames Research Center. Evaluation results show that this approach could be able to assist the pilots in executing a correct stall recovery maneuver.

Lombaerts, Thomas↗

Quantification of Load Flexibility in Residential Buildings Using Home Energy Management Systems

With increasing penetration of renewable energy resources, the flexibility of operating behind-the-meter (BTM) resources plays a key role in enhancing grid reliability and resilience. Residential buildings with home energy management systems (HEMS) can provide desired flexibility for the distribution system operator (DSO) while considering customer comfort and preferences. This paper discusses a methodology to quantify the flexibility of BTM resources of residential buildings using HEMS. First, we propose a model predictive control framework to formulate the flexibility band comprising nominal, upper, and lower demand profiles. Second, the paper proposes a dispatch method for HEMS to compute the control signals for each BTM resource (e.g., air conditioner, water heater, home battery system) upon receiving a flexibility service request from the DSO. The case study provides insight into the flexibility provided at the whole-home level with different user preferences and seasons. The results demonstrate that HEMS is capable of providing flexibility service at the request of the DSO while delivering primary services to the building occupants.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimal Control of an Oscillating Surge Wave Energy Converter

During this project, we experimentally investigated the hydrodynamics and performance of a laboratory-scale oscillating surge wave energy converter (OSWEC).We looked at how flap buoyancy and driveline losses (primarily in the form of stiction) affected the dynamics and performance of the device. In addition, we assessed the influence of flap profile (rounded vs. square edges) on OSWEC hydrodynamics. Through this, we were able to develop a deeper understanding of OSWEC performance and provide guidance on strategies to counteract artifacts that may be present in laboratory models, but are absent in field-scale devices. To do this, we tested a laboratory-scale OSWEC in the Sea Wave Environmental Lab (SWEL) wave tank at the National Renewable Energy Laboratory (NREL). We ran several types of experiments to investigate the hydrodynamics and performance of the device. Overall, we achieved the overall goal of experimentally investigating the hydrodynamics and performance of this device. We discovered important and unexpected trends in performance, and collected time-resolved data to help us further investigate the underlying hydrodynamics responsible for these trends. In addition, we are currently using the time-resolved data from these experiments to build data-driven models of the dynamics, which can in turn be used to inform data-driven model predictive control of this device and address this objective in the future.

16 TIDAL AND WAVE POWER↗

Optimal Coordination of Building Loads and Energy Storage for Power Grid and End User Services

Demand response and energy storage play a profound role in the smart grid. The focus of this paper is to evaluate benefits of coordination of flexible loads and energy storage for power grid and end user services. We present a Generalized Battery Model (GBM) to describe the flexibility of building loads and energy storage. A Model Predictive Control (MPC) approach is proposed to characterize the GBM parameters (power and energy limits) for flexible building loads. Moreover, we develop optimal coordination algorithms for them to provide ancillary and end user services such as energy arbitrage, frequency regulation, spinning reserve, as well as energy and demand charge reduction. Several case studies have been performed to demonstrate the efficacy of the GBM and coordination algorithms, and evaluate the benefits of using their flexibility to provide grid and end user services. We show that optimal coordination yields significant cost saving and revenue. Moreover, the best option for grid services is to provide energy arbitrage and frequency regulation, because spinning reserve cannot compete with regulation service. Furthermore, when coordinating flexible loads with energy storage to provide end user services, it is recommended to consider both the time-of-use (TOU) price and demand charge rather than the TOU price only in order to flat the aggregate power profile.

Hao, He↗