SEARCH · Search NASA

Results for “MPC formulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

43 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Model Predictive Control for a Grid-interactive Efficient Thermal Storage-integrated Heat Pump System

Building heating and cooling systems can be used to overcome the mismatch between the intermittent supply of renewable power and the fluctuating demand for electricity. A novel underground thermal energy storage integrated with a dual-source heat pump has been proposed to mitigate the mismatch while meeting the thermal demand of buildings efficiently. Conventional thermostat control with heuristic rules cannot provide intelligent decisions to maximize the thermal efficiency and flexibility of the proposed system. Advanced control strategies like model predictive control (MPC) have provided a new paradigm for grid-interactive efficient building operation with the advancement of computation and sensing. This study developed an MPC for the proposed system to provide grid service for Demand Side Management and minimize the operating cost of building owners. A control-oriented dynamic model of the proposed system has been developed. Given an objective function and proper constraints, an optimization problem is formulated to determine the optimal control strategy of the system. Dynamic Programming is adopted to solve the optimization problem. A rule-based control (RBC) is also developed to achieve similar goals. Short-term simulations are conducted to compare the system performance resulting from the two controls. The simulation results indicate that the MPC performs more intelligently than the RBC in charging thermal energy storage and selecting heat pump sources by taking advantage of the predicted cooling demands of the building and the performance of the integrated system. As a result, the MPC could save energy and reduce operating costs compared with the RBC. A case study shows that, for a 3-day operation, the MPC saves 36.9% energy and reduces 38.5% operating cost compared with the RBC.

Shi, Liang↗

DOE OSTI2022

MPC4CLR (Model-Predictive-Control-for-Critical-Load-Restoration-in-Power-Distribution-Systems) [SWR-22-24]

Model predictive control (MPC) is a system or process control technique for making decisions under uncertainty via rolling look-ahead optimizations at each control step where only the current step decisions are applied, and the rest are discarded. In this work, we developed an MPC for a critical load restoration (CLR) in power distribution systems to recover system service (electricity delivery) following an extreme event-triggered substation outage. The method considers the problem of controlling distributed energy resources (DERs) of the distribution system with the objective of achieving maximum load pick up while satisfying distribution network flow and voltage constraints. A linearized optimal power flow (OPF) model is employed to represent the physics of the network. The problem formulation is augmented with a ramping (up) reserve product for the DERs to ensure improved and upward monotonic load restoration as time evolves. Simulation analysis and performance tests are performed using a modified IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage battery. The software is developed using various software packages in Julia and Python. The MPC model is implemented using the JuMP optimization language in Julia while the data analytics including renewable generation and load demand forecasts, running the MPC simulation and visualizations is performed in Python.

Eseye, Abinet Tesfaye↗

DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗

DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗

NASA NTRS1994

The cosmic X-ray background-IRAS galaxy correlation and the local X-ray volume emissivity

We have cross-correlated the galaxies from the IRAS 2 Jy redshift survey sample and the 0.7 Jy projected sample with the all-sky cosmic X-ray background (CXB) map obtained from the High Energy Astronomy Observatory (HEAO) 1 A-2 experiment. We have detected a significant correlation signal between surface density of IRAS galaxies and the X-ray background intensity, with W(sub xg) = (mean value of ((delta I)(delta N)))/(mean value of I)(mean value of N)) of several times 10(exp -3). While this correlation signal has a significant implication for the contribution of the local universe to the hard (E greater than 2 keV) X-ray background, its interpretation is model-dependent. We have developed a formulation to model the cross-correlation between CXB surface brightness and galaxy counts. This includes the effects of source clustering and the X-ray-far-infrared luminosity correlation. Using an X-ray flux-limited sample of active galactic nuclei (AGNs), which has IRAS 60 micrometer measurements, we have estimated the contribution of the AGN component to the observed CXB-IRAS galaxy count correlations in order to see whether there is an excess component, i.e., contribution from low X-ray luminosity sources. We have applied both the analytical approach and Monte Carlo simulations for the estimations. Our estimate of the local X-ray volume emissivity in the 2-10 keV band is rho(sub x) approximately = (4.3 +/- 1.2) x 10(exp 38) h(sub 50) ergs/s/cu Mpc, consistent with the value expected from the luminosity function of AGNs alone. This sets a limit to the local volume emissivity from lower luminosity sources (e.g., star-forming galaxies, low-ionization nuclear emission-line regions (LINERs)) to rho(sub x) less than or approximately = 2 x 10(exp 38) h(sub 50) ergs/s/cu Mpc.

Miyaji, Takamitsu↗

DOE OSTI2024

An Empirical Model For Intrinsic Alignments: Insights From Cosmological Simulations

We extend current models of the halo occupation distribution (HOD) to include a flexible, empirical framework for the forward modeling of the intrinsic alignment (IA) of galaxies. A primary goal of this work is to produce mock galaxy catalogs for the purpose of validating existing models and methods for the mitigation of IA in weak lensing measurements. This technique can also be used to produce new, simulation-based predictions for IA and galaxy clustering. Our model is probabilistically formulated, and rests upon the assumption that the orientations of galaxies exhibit a correlation with their host dark matter (sub)halo orientation or with their position within the halo. We examine the necessary components and phenomenology of such a model by considering the alignments between (sub)halos in a cosmological dark matter only simulation. We then validate this model for a realistic galaxy population in a set of simulations in the Illustris-TNG suite. We create an HOD mock with Illustris-like correlations using our method, constraining the associated IA model parameters, with the $\mathcal{X}$$^{2}_{dof}$ between our model’s correlations and those of Illustris matching as closely as 1.4 and 1.1 for orientation–position and orientation–orientation correlation functions, respectively. By modeling the misalignment between galaxies and their host halo, we show that the 3-dimensional two-point position and orientation correlation functions of simulated (sub)halos and galaxies can be accurately reproduced from quasi-linear scales down to 0.1 $\mathcal{h}$ –1 Mpc. We also find evidence for environmental influence on IA within a halo. Our publicly-available software provides a key component enabling efficient determination of Bayesian posteriors on IA model parameters using observational measurements of galaxy-orientation correlation functions in the highly nonlinear regime.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗