Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal Control Problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
NASA NTRS1988

A forward method for optimal stochastic nonlinear and adaptive control

A computational approach is taken to solve the optimal nonlinear stochastic control problem. The approach is to systematically solve the stochastic dynamic programming equations forward in time, using a nested stochastic approximation technique. Although computationally intensive, this provides a straightforward numerical solution for this class of problems and provides an alternative to the usual dimensionality problem associated with solving the dynamic programming equations backward in time. It is shown that the cost degrades monotonically as the complexity of the algorithm is reduced. This provides a strategy for suboptimal control with clear performance/computation tradeoffs. A numerical study focusing on a generic optimal stochastic adaptive control example is included to demonstrate the feasibility of the method.

Bayard, David S.↗
NASA NTRS1990

Stabilization and control of distributed systems with time-dependent spatial domains

This paper considers the problem of the stabilization and control of distributed systems with time-dependent spatial domains. The evolution of the spatial domains with time is described by a finite-dimensional system of ordinary differential equations, while the distributed systems are described by first-order or second-order linear evolution equations defined on appropriate Hilbert spaces. First, results pertaining to the existence and uniqueness of solutions of the system equations are presented. Then, various optimal control and stabilization problems are considered. The paper concludes with some examples which illustrate the application of the main results.

Wang, P. K. C.↗
DOE OSTI2022

Unifying Energy-Management Problems for Inverter-Based Power Networks

This paper outlines a suite of energy-management problems for inverter-based power networks from the vantage point of optimal control and (non)linear optimization. The problems are categorized based on timescales dictated by the network dynamics, and organized methodologically based on the problem complexity. A growing body of literature has addressed problems in this domain, albeit, with poorly motivated assumptions and behavioral models that obscure precise device behavior. With a combination of circuit- and control-theoretic lenses, we establish appropriate dynamic models for the networked resources, illustrate how common engineering assumptions arise, uncover how problems are linked, and postulate open challenges.

(non)linear optimization↗
DOE OSTI2020

Coastal Community Resiliency Enhancement Using Marine Hydrokinetic (MHK) Resources and Networked Microgrids

Enormous challenges are inherent in the operation of modern distribution grids. In particular, distribution feeders can be severely compromised under extreme conditions such as large-scale weather events (e.g., hurricanes, floods, and other types of natural disasters). To combat this problem, they turn to local energy support from distributed energy resources, such as solar and wind, marine hydrolinetic (MHK), and other types of energy. In this report, we investigate the actual characteristics of MHK resources to enhance coastal community resiliency. Two typical types of MHK resources (i.e., wave and tidal resources) illustrate the coastal resilience enhancement framework. By identifying their operational characteristics, such as target time-scales and potential power generation variations, we detail a holistic coastal community resiliency enhancement framework that integrates both optimization and control efforts. The optimization problem is formulated to significantly minimize the power outage time at the critical infrastructures in coastal communities by implementing multiple autonomous and dynamic microgrids around MHK resources. Therefore, during severe power outages caused by natural disasters (e.g., floods, hurricanes), the coastal community load profiles can be satisfied using local MHK resources in each microgrid with limited or no power support from upstream power grids.

16 TIDAL AND WAVE POWER↗
NASA NTRS2013

Robust Maneuvering Envelope Estimation Based on Reachability Analysis in an Optimal Control Formulation

This paper discusses an algorithm for estimating the safe maneuvering envelope of damaged aircraft. The algorithm performs a robust reachability analysis through an optimal control formulation while making use of time scale separation and taking into account uncertainties in the aerodynamic derivatives. Starting with an optimal control formulation, the optimization problem can be rewritten as a Hamilton- Jacobi-Bellman equation. This equation can be solved by level set methods. This approach has been applied on an aircraft example involving structural airframe damage. Monte Carlo validation tests have confirmed that this approach is successful in estimating the safe maneuvering envelope for damaged aircraft.

optimal control↗
NASA NTRS1967

Automatic control

Numerical solution of optimal control and programming problems

FEEDBACK CONTROL SYSTEM↗
NASA NTRS1991

A mathematical basis for the design optimization of adaptive trusses in precision control

Optimal actuator placement schemes are presently studied for cases of adaptive truss precision control and prestressing control, with a view to the maximization of actuator efficiencies. In statically indeterminate truss structures, the optimal placement criteria and techniques differ, depending on whether the primary determinate structure is known. A suboptimal actuator-placement solution to the global optimization problem which combines displacement control and prestressing control is suggested, by combining the separate displacement control and prestressing control optimization results. Attention is given to the results obtained for the illustrative case of a two-bay, three-dimensional precision truss structure.

Das, S. K.↗
DOE OSTI2021

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

This paper aims at developing a data-driven optimal control strategy for virtual synchronous generator (VSG) in the scenario where no expert knowledge or requirement for system model is available. Firstly, the optimal and adaptive control problem for VSG is transformed into a reinforcement learning task. Specifically, the control variables, i.e., virtual inertia and damping factor, are defined as the actions. Meanwhile, the active power output, angular frequency and its derivative are considered as the observations. Moreover, the reward mechanism is designed based on three preset characteristic functions to quantify the control targets: (1) maintaining the deviation of angular frequency within special limits; (2) preserving well-damped oscillations for both the angular frequency and active power output; (3) obtaining slow frequency drop in the transient process. Next, to maximize the cumulative rewards, a decentralized deep policy gradient algorithm, which features model-free and faster convergence, is developed and employed to find the optimal control policy. With this effort, a data-driven adaptive VSG controller can be obtained. By using the proposed controller, the inverter-based distributed generator can adaptively adjust its control variables based on current observations to fulfill the expected targets in model-free fashion. Finally, simulation results validate the feasibility and effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1993

Synthesis of Optimal Nonlinear Feedback Laws for Dynamic Systems Using Neural Networks

Open-loop solutions of dynamical optimization problems can be numerically computed usingexisting software packages. The computed time histories of the state and control variables, formultiple sets of end conditions can then be used to train a neural network to 'recognize' the optimal,nonlinear feedback relation between the states and controls of the system. The 'learned' network canthen be used to output an approximate optimal control given a full set (or a partial set) of measuredsystem states. With simple neural networks, we have successfully demonstrated the efficacy of theproposed approach using a minimum-time orbit injection problem. The usefulness and limitations ofthis novel approach on real-life optimal guidance and control problems, with many state and control variables as well as path inequality constraints, remain to be seen.

Orbit injection problem↗
DOE OSTI2023

Cyber-Resilient Automatic Generation Control for Systems of AC Microgrids

In this paper we propose a co-design of the secondary frequency regulation in systems of AC microgrids and its cyber security solutions. We term the secondary frequency regulator a Micro-Automatic Generation Control (μ AGC) for highlighting its same functionality as the AGC in bulk power systems. We identify sensory challenges and cyber threats facing the μ AGC. To address the sensory challenges, we introduce a new microgrid model by exploiting the rank-one deficiency property of microgrid dynamics. This model is used to pose an optimal μ AGC control problem that is easily implemented, because it does not require fast frequency measurements. An end-to-end cyber security solution to the False Data Injection (FDI) attack detection and mitigation is developed for the proposed μ AGC. The front-end barrier of applying off-the-shelf algorithms for cyber attack detection is removed by introducing a data-driven modeling approach. Finally, we propose an observer-based corrective control for an islanded microgrid and a collaborative mitigation scheme in systems of AC microgrids. We demonstrate a collaborative role of systems of microgrids during cyber attacks. Furthermore, the performance of the proposed cyber-resilient μ AGC is tested in a system of two networked microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

An Efficient, Globally Convergent Method for Optimization Under Uncertainty Using Adaptive Model Reduction and Sparse Grids

We present a new approach to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed: (1) stochastic collocation based on dimension-adaptive sparse grids (SGs), which approximates the stochastic objective function with a limited number of quadrature nodes, and (2) projection-based reduced-order models (ROMs), which generate efficient approximations to PDE solutions. These two sources of inexactness lead to inexact objective function and gradient evaluations, which are managed by a trust-region method that guarantees global convergence by adaptively refining the SG and ROM until a proposed error indicator drops below a tolerance specified by trust-region convergence theory. A key feature of the proposed method is that the error indicator---which accounts for errors incurred by both the SG and ROM---must be only an asymptotic error bound, i.e., a bound that holds up to an arbitrary constant that need not be computed. This allows the approach to be applicable to a wide range of problems, including those where sharp, computable error bounds are not available; this distinguishes the proposed method from previous works. Numerical experiments performed on a model problem from optimal flow control under uncertainty verify global convergence of the method and demonstrate the method's ability to outperform previously proposed alternatives.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1974

A minimum principle for smooth first-order distributed systems

Consideration of the problem of characterizing optimal controls for a class of distributed parameter systems. The system dynamics are characterized mathematically by a finite number of coupled partial differential equations involving first-order time and space derivatives of the state variables. Boundary conditions on the state are in the form of a finite number of algebraic relations between the state and boundary control variables. A few directions are outlined in which the results obtained may be extended further.

Johnson, T. L.↗
NASA NTRS1990

Optimal control of singularly perturbed nonlinear systems with state-variable inequality constraints

The established necessary conditions for optimality in nonlinear control problems that involve state-variable inequality constraints are applied to a class of singularly perturbed systems. The distinguishing feature of this class of two-time-scale systems is a transformation of the state-variable inequality constraint, present in the full order problem, to a constraint involving states and controls in the reduced problem. It is shown that, when a state constraint is active in the reduced problem, the boundary layer problem can be of finite time in the stretched time variable. Thus, the usual requirement for asymptotic stability of the boundary layer system is not applicable, and cannot be used to construct approximate boundary layer solutions. Several alternative solution methods are explored and illustrated with simple examples.

Calise, A. J.↗
NASA NTRS1994

A note on the regularity of solutions of infinite dimensional Riccati equations

This note is concerned with the regularity of solutions of algebraic Riccati equations arising from infinite dimensional LQR and LQG control problems. We show that distributed parameter systems described by certain parabolic partial differential equations often have a special structure that smoothes solutions of the corresponding Riccati equation. This analysis is motivated by the need to find specific representations for Riccati operators that can be used in the development of computational schemes for problems where the input and output operators are not Hilbert-Schmidt. This situation occurs in many boundary control problems and in certain distributed control problems associated with optimal sensor/actuator placement.

Burns, John A.↗
NASA NTRS1996

Performance Robustness of Manipulator Collision Controller

In this paper, we propose that the manipulator impact control problem be approached from a stochastic optimal control perspective. The reason is that not only is such approach be able to model uncertainties in contact environment, force sensing, as well as manipulator dynamics, the controllers obtained is optimally robust in terms of performance. This result is verified by analyses and simulations.

model uncertainties contact environment force sens↗