Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal Control Problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Analysis of Control Behavior in Eco-Driving Speed Optimization Using Pontryagin’s Minimum Principle

The energy efficiency of autonomous vehicles can be improved by selecting an optimized speed profile. Energy savings can be maximized by performing control optimization with knowledge of the powertrain characteristics and future driving conditions. Previous studies have shown that Pontryagin’s minimum principle (PMP) performs well in vehicle speed optimization problems. Building on the methods proposed in previous studies, the contribution of this study is to derive meaningful observations from the concepts and results of PMP to enhance the understanding of the control problem. In particular, the switching behavior of the control mode is analyzed with supportive variables, such as ξ and mv, which dictates the changes in the control modes. Additionally, the existence of the singular control is analyzed, which helps in understanding the cruise driving in the control problem. Finally, we obtain several solutions that satisfy various boundary conditions along with a map of the reachable states, and discuss the impact of cruise driving. This is helpful for designing practical control concepts for real-world applications based on this map. Previous studies have contributed significantly to this control problem; however, this study provides a better understanding of the issue and offers guidance and inspiration for future real-world applications based on these meaningful observations.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Adapting Optimal Velocity Tracking Control to Account for WEC Constraints and Power-Take-Off Efficiencies: Preprint

Wave energy converters (WECs) come in many different forms, from point absorbers, oscillating water columns, to bulge wave devices. This paper focuses on the control of point absorber WECs, which typically have a narrow-banded frequency response and, therefore, control is well placed to improve the energy capture of such WECs. The acausal nature of the control problem means that theoretically optimal control is almost impossible to achieve inpractice; however optimal velocity tracking (OVT) offers a simple and robust approximation to optimal control that can achieve better power capture than passive linear damping methods, albeit with necessarily higher force demands. OVT is a form of impedance matching and the magnitude of the power-take off (PTO) force demand is often not linearly proportional to the WEC velocity, which can lead to PTO force and speed combinations far from the optimalPTO efficiency. The highly non-linear PTO force and speed to efficiency mapping can, without remedial measures, severely diminish the effectiveness of OVT techniques. In this paper, limits to the movement and force of the PTO are demonstrated, allowing OVT to be more easily applied in practice. The effect of PTO efficiency is explored, and a potential solution to the problem of adapting control to account for efficiency is presented. Both aspects of the work presented highlight the requirement for co-design of the WEC, PTO, and controller.

conversion efficiency↗
DOE OSTI2020

Frequency Analysis of Solar PV Power to Enable Optimal Building Load Control

In this paper, we present a flexibility estimation mechanism for buildings’ thermostatically controlled loads (TCLs) to enable the distribution level consumption of the majority of solar photovoltaic (PV) generation by local building TCLs. The local consumption of PV generation provides several advantages to the grid operation as well as the consumers, such as reducing the stress on the distribution network, minimizing voltage fluctuations and two-way power flows in the distribution network, and reducing the required battery storage capacity for PV integration. This would result in increasing the solar PV generation penetration levels. The aims of this study are twofold. First, spectral (frequency) analyses of solar PV power generation together with the power consumption of multiple building TCLs (such as heating, ventilation, and air conditioning (HVAC) systems, water heaters, and refrigerators) are performed. These analyses define the bandwidth over which these TCLs can operate and also describe the PV generation frequency bandwidth. Such spectral analyses, in frequency domain, can help identify the flexible components of PV generation that can be consumed by the various TCLs through optimal building load utilization. Second, a quadratic optimization problem based on model predictive control is formulated to allow consuming most of the low and medium frequency content of the PV power locally by building TCLs, while maintaining occupants’ comfort and TCLs’ physical constraints. The solution to the proposed optimization problem is achieved using optimal control strategies. Numerical results show that most of the low and medium frequency content of the PV generation can be consumed locally by building TCLs. The remaining high-frequency content of the PV generation can then be stored/offset using energy storage systems.

14 SOLAR ENERGY↗
DOE OSTI2025

Deep Reinforcement Learning for Distribution System Operations: A Tutorial and Survey

Here, the rapid evolution of modern electric power distribution systems into complex networks of interconnected active devices, distributed generation (DG), and storage poses increasing difficulties for system operators. The large-scale integration of distributed energy resources (DERs) and the rapid exchange of measurement data via communication networks present major opportunities for advancing grid operations but also introduce greater uncertainty, higher data dimensionality, more complex network and device models, and challenging control and optimization problems. Deep reinforcement learning (DRL) algorithms are promising in addressing these challenges. However, they have not been effectively adapted for power systems applications, requiring extensive customization for implementation and evaluation. This has resulted in reproducibility challenges and a steep learning curve for researchers new to applying DRL algorithms to the power systems domain. To bridge these gaps, this tutorial aims to serve as a valuable resource for researchers interested in exploring learning-based algorithms to operate active power distribution networks. Specifically, this work presents a generalized process for translating sequential decision-making problems in power distribution systems into Markov decision process (MDP) formulations, illustrated through concrete grid service examples. Additionally, we introduce a simple environment design strategy to develop and evaluate example DRL algorithms for distribution system applications, complete with an included code repository to guide users through environment construction.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Ensuring Transient Stability With Guaranteed Region of Attraction in DC Microgrids

DC microgrids have promising applications in renewable integration due to their better energy efficiency when connecting DC components. However, they might be unstable since many loads in a DC microgrid are regulated as constant power loads (CPLs) that have a destabilizing negative impedance effect. As a result, the state trajectory displacement caused by abrupt load changes or contingencies can easily lead to instability. Many existing works have been devoted to studying the region of attraction (ROA) of a DC microgrid, in which the system is guaranteed to be asymptotically stable. Nevertheless, existing work either focuses on using numerical methods for ROA approximations that generally have no performance guarantees or cannot ensure a desired ROA for a general DC microgrid. To close this gap, this paper develops an innovative control synthesis algorithm to make a general DC microgrid have a theoretically guaranteed ROA, for example, to cover the entirety of its operating range regarding state trajectories. Here, we first study the nonlinear dynamics of a DC microgrid to derive a novel transient stability condition to rigorously certify whether a given operating range is a subset of the ROA; then, we formulate a control synthesis optimization problem to guarantee the condition’s satisfaction. This condition is a linear constraint, and the optimization problem resembles an optimal power flow problem and has a good computational behavior. Simulation case studies verify the validity of the proposed work.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Analytical Models of Frequency and Voltage in Large-Scale All-Inverter Power Systems

Low-order frequency response models for power systems have a decades-long history in optimization and control problems such as unit commitment, economic dispatch, and wide-area control. With a few exceptions, these models are built upon the Newtonian mechanics of synchronous generators, assuming that the frequency dynamics across a system are approximately homogeneous, and assume the dynamics of nodal voltages for most operating conditions are negligible, and thus are not directly computed at all buses. As a result, the use of system frequency models results in the systematic underestimation of frequency minimum nadir and maximum RoCoF, and provides no insight into the reactive power-voltage dynamics. This paper proposes a low-order model of both frequency and voltage response in grid-forming inverter-dominated power systems. The proposed model accounts for spatial-temporal variations in frequency and voltage behavior across a system and as a result, demonstrates the heterogeneity of frequency response in future renewable power systems. Electromagnetic transient (EMT) simulations are used to validate the utility, accuracy, and computational efficiency of these models, setting the basis for them to serve as fast, scalable alternatives to EMT simulation, especially when dealing with very large-scale systems, for both planning and operational studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗
DOE OSTI2024

Local convergence analysis of an inexact trust-region method for nonsmooth optimization

In Baraldi, we introduced an inexact trust-region algorithm for minimizing the sum of a smooth nonconvex function and a nonsmooth convex function in Hilbert space—a class of problems that is ubiquitous in data science, learning, optimal control, and inverse problems. Furthermore, this algorithm has demonstrated excellent performance and scalability with problem size. In this paper, we enrich the convergence analysis for this algorithm, proving strong convergence of the iterates with guaranteed rates. In particular, we demonstrate that the trust-region algorithm recovers superlinear, even quadratic, convergence rates when using a second-order Taylor approximation of the smooth objective function term.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Quantum optimal control for pure-state preparation using one initial state

This paper presents a framework for solving the pure-state preparation problem using numerical optimal control. As an example, we consider the case where a number of qubits are dispersively coupled to a readout cavity. Herein, we model open system quantum dynamics using the Markovian Lindblad master equation driven by external control pulses. The main result of this paper develops a basis of density matrices (a parameterization) where each basis element is a density matrix by itself. Utilizing a specific objective function, we show how an ensemble of the basis elements can be used as a single initial state throughout the optimization process—independent of the system dimension. We apply the general framework to the specific application of ground-state reset of one and two qubits coupled to a readout cavity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Transient Stability Preventive Control via Tuning the Parameters of Virtual Synchronous Generators

This paper presents an optimal preventive control (OPC) method to improve the power system transient stability via tuning the transient parameter of virtual synchronous generators. The novelty of this work is that we formulate the preventive control as an optimization problem so that inverter parameters can be adjusted at the pre-contingency stage. A reinforcement learning (RL)-driven method is proposed to solve the OPC problem with the fault energy-based reward function. An ANDES-based RL environment is also developed. Versatile functions included in the proposed environment have been presented in this paper. The proposed OPC formulation, the RLdriven method, and the fault energy-based reward function are verified on several standard test systems.

Inverter-based resources, virtual synchronous gene↗
DOE OSTI2024

A Review: Indirect Optimal Control of Wave Energy Converters

Wave energy conversion has been the subject of interest in the past several years. While there are several concepts for converting wave power into electric power, the cost of the electric power harvested from ocean waves remains high. One of the main challenges, though it receives less attention, is the control of the wave energy converter (WEC). This paper presents a treatment for the WEC control problem within the context of optimal control theory. The result is systematic development for an explicit expression for a control that maximizes the harvested energy while meeting operational constraints such as the maximum device stroke and the maximum control force. The control presented here can also be adjusted to meet device design constraints such as a limitation on the amount of reactive power available from the power take-off (PTO) unit; this feature enables a control co-design for the PTO unit. Numerical simulations are presented in this paper for demonstration.

control design↗
DOE OSTI2021

Randomized Sketching Algorithms for Low-Memory Dynamic Optimization

This paper develops a novel limited-memory method to solve dynamic optimization problems. The memory requirements for such problems often present a major obstacle, particularly for problems with PDE constraints such as optimal flow control, full waveform inversion, and optical tomography. In these problems, PDE constraints uniquely determine the state of a physical system for a given control; the goal is to find the value of the control that minimizes an objective. While the control is often low dimensional, the state is typically more expensive to store. This paper suggests using randomized matrix approximation to compress the state as it is generated and shows how to use the compressed state to reliably solve the original dynamic optimization problem. Concretely, the compressed state is used to compute approximate gradients and to apply the Hessian to vectors. The approximation error in these quantities is controlled by the target rank of the sketch. This approximate first- and second-order information can readily be used in any optimization algorithm. As an example, we develop a sketched trust-region method that adaptively chooses the target rank using a posteriori error information and provably converges to a stationary point of the original problem. Numerical experiments with the sketched trust-region method show promising performance on challenging problems such as the optimal control of an advection-reaction-diffusion equation and the optimal control of fluid flow past a cylinder.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Qubit control noise spectroscopy with optimal suppression of dephasing

Here, we extend quantum noise spectroscopy (QNS) of amplitude control noise to settings where dephasing noise or detuning errors make significant contributions to qubit dynamics. Previous approaches to characterize amplitude noise are limited by their vulnerability to low-frequency dephasing noise and static detuning errors, which can overwhelm the target control noise signal and introduce bias into estimates of the amplitude noise spectrum. To overcome this problem, we leverage optimal control to identify a family of amplitude control waveforms that optimally suppress low-frequency dephasing noise and detuning errors, while maintaining the spectral concentration in the amplitude filter essential for spectral estimation. The waveforms found via numerical optimization have surprisingly simple analytic forms, consisting of oscillating sine waves obeying particular amplitude and frequency constraints. In numerically simulated QNS experiments, these waveforms demonstrate superior robustness, enabling accurate estimation of the amplitude noise spectrum in regimes where existing approaches are biased by low-frequency dephasing noise and detuning errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Deep reinforcement learning to discover multi-fuel injection strategies for compression ignition engines

Over the past several decades, regulation of compression ignition engine emissions has become increasingly stringent as concern about the environmental and health implications of these emissions has grown. These changing constraints have led to a series of new, alternative fuel injection strategies that aim to maintain power output while reducing in-cylinder generated emissions by operating in the low-temperature combustion (LTC) regime. These advanced injection strategies are created and retuned for individual combinations of engine geometry, fuel, and emissions constraints. Deep reinforcement learning has been shown to be an effective alternative to traditional optimization approaches for highly combinatorial control problems, such as discovering the optimal injection schedules for compression ignition engines. In this study, we deploy a previously presented deep reinforcement learning framework to iteratively optimize a series of engine geometries over a range of increasingly strict NO x emissions regulations. We then examine the resulting injection schedules. We discuss the potential for using this deep reinforcement learning framework for fuel selection screening and for discovering unique injection strategies for different engine geometries and future emissions standards.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

On optimal control of hybrid dynamical systems using complementarity constraints

Optimal control for switch-based dynamical systems is a challenging problem in the process control literature. In this study, we model these systems as hybrid dynamical systems with finite number of unknown switching points and reformulate them using non-smooth and non-convex complementarity constraints as a mathematical program with complementarity constraints (MPCC). We utilize a moving finite element based strategy to discretize the differential equation system to accurately locate the unknown switching points at the finite element boundary and achieve high-order accuracy at intermediate non-collocation points. We propose a globalization approach to solve the discretized MPCC problem using a mixed NLP/MILP-based strategy to converge to a non-spurious first-order optimal solution. The method is tested on three dynamic optimization examples, including a gas–liquid tank model and an optimal control problem with a sliding mode solution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Towards constrained grid-forming control

Grid-forming converters are commonly envisioned to replace conventional synchronous generators as the cornerstone of future power systems. However, compared to synchronous generators, power converters and their power sources (e.g., renewable generation, energy storage) are subject to significant physical constraints (e.g., current limits, modulation limits). Grid-forming controls are commonly designed neglecting these constraints and subsequently augmented with limiters for a subset of constraints. In this work, we propose a systematic approach to constrained grid-forming control of two-level voltage source converters interfacing photovoltaics. We first formulate grid-forming control objectives and constraints of voltage source converters and photovoltaics in a one-step optimal grid-forming control problem. Next, we leverage primal-dual dynamics to obtain a dynamic feedback controller that approximates the solution of the one-step optimal grid-forming control problem. Finally, electromagnetic transient simulations are used to illustrate the results.

Gross, Dominic↗