On A Class of Adaptive Suboptimal Riccati-based Controllers
In this paper a nonlinear modification is given to the standard control law resulting from a linear optimal control problem formulated in state-space.
Riccati-based↗
SEARCH · Search NASA
Results for “Optimal Control Problem”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
(abstract) Optimal Low Thrust Trajectories Using Differential Inclusion Concepts
Low thrust propulsion systems typically have their greatest benefit for high energy missions or missions with large post-launch maneuver requirements. Missions which have been examined include main belt asteroid rendezvous, comet rendezvous, outer planet and Mercury orbiters, Pluto flyby, and solar probe missions. Low thrust mission design software used to determine these trajectories is based on two distinct formulations of the optimal control problem: the indirect and direct methods. The traditional approach (indirect) is to use the calculus of variations to obtain first order necessary conditions on the states and costates. In contrast, direct methods are conceptually different in that no explicit integration takes place. A direct method based on differential inclusion concepts has been developed and successfully used to compute low thrust trajectories. This new approach removes explicit control dependence from the problem thereby reducing the dimension of the parameter space for the nonlinear programming problem. Also when compared to other direct methods, fewer nonlinear constraints are required to represent the dynamics of the problem.
low↗
Learning Based Edge Computing in Air-to-Air Communication Network
This paper studies learning-based edge computing and communication in a dynamic Air-to-Air Ad-hoc Network (AAAN). Due to spectrum scarcity, we assume the number of Air-to-Air (A2A) communication links is greater than that of the available frequency channels, such that some communication links have to share the same channel, causing co-channel interference. We formulate the joint channel selection and power control optimization problem to maximize the aggregate spectrum utilization efficiency under resource and fairness constraints. A distributed deep Q learning-based edge computing and communication algorithm is proposed to find the optimal solution. In particular, we design two different neural network structures and each communication link can converge to the optimal operation by exploiting only the local information from its neighbors, making it scalable to large networks. Finally, experimental results demonstrate the effectiveness of the proposed solution in various AAAN scenarios.
Zhe Wang↗
Convex Optimization Guidance for Precision Landing on Titan
Precision landing is an anticipated technology for future interplanetary missions. Autonomous spacecraft Entry, Descent and Landing (EDL) on the surface of a planetary body with a degree of precision in the order of meters is highly challenging. In this paper, a successive convexification guidance algorithm is utilized to simulate autonomous precision landing sequences on Saturn’s moon Titan. Due to its unique geophysical features, studying the science of matter within Titan’s atmosphere and beneath its surface is one of NASA’s most important planetary science objectives. As part of the Space Exploration Technology Directorate, a parafoil is proposed for landing on Titan due to its cost effectiveness, ease of deployment, low mass compared to the prospective payload and capabilities of precise autonomous delivery. This paper focuses on path optimization and guidance law development for high-fidelity dynamics parafoil tuning in the dense and adverse wind atmosphere of Titan, defined as a nonlinear and nonconvex optimal control problem. The powerful successive convexification method is used to solve the problem accordingly. The algorithm is designed such that the converged solution adheres to the nonlinear dynamics and kinematics in accordance with the original formulation, while respecting the state and control constraints. The six-degree-of-freedom (6DoF) simulations results show that this robust method is suitable for autonomous interplanetary applications.
Mooij, Edwin↗
Designing Trajectories Resilient to Missed Thrust Events Using Expected Thrust Fraction
With the adoption of efficient low-thrust propulsion methods, the probability of a missed thrust event occurring has become a significant concern for short and long- duration missions. If the missed thrust events take place during a critical portion of the trajectory, the mission can be compromised. Therefore, it is essential to de- velop trajectories that are resilient to missed thrust events. This paper investigates the use of expected thrust fraction, which embeds the stochastic nature of missed thrust events into a deterministic optimal control problem. The performance of trajectories designed using expected thrust fraction is compared with traditionally designed trajectories to measure changes in resiliency to missed thrust events. In this investigation, trajectories designed using expected thrust fraction arrive with a median lateness half that of traditionally designed trajectories. Using expected thrust fraction can help astrodynamicists mitigate risks posed by the use of low- thrust propulsion.
Laipert, Frank E.↗
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint
Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.
61 RADIATION PROTECTION AND DOSIMETRY↗
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning
Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.
61 RADIATION PROTECTION AND DOSIMETRY↗
On the necessity of a certain convexity condition for lower closure of control problems.
Existence problem of optimal controls analyzed for necessity of convexity condition for lower closure
Brunovsky, P.↗
A Mathematical Formulation of the SCOLE Control Problem. Part 2: Optimal Compensator Design
The study initiated in Part 1 of this report is concluded and optimal feedback control (compensator) design for stability augmentation is considered, following the mathematical formulation developed in Part 1. Co-located (rate) sensors and (force and moment) actuators are assumed, and allowing for both sensor and actuator noise, stabilization is formulated as a stochastic regulator problem. Specializing the general theory developed by the author, a complete, closed form solution (believed to be new with this report) is obtained, taking advantage of the fact that the inherent structural damping is light. In particular, it is possible to solve in closed form the associated infinite-dimensional steady-state Riccati equations. The SCOLE model involves associated partial differential equations in a single space variable, but the compensator design theory developed is far more general since it is given in the abstract wave equation formulation. The results thus hold for any multibody system so long as the basic model is linear.
Balakrishnan, A. V.↗
Near-optimal, asymptotic tracking in control problems involving state-variable inequality constraints
The class of all piecewise time-continuous controllers tracking a given hypersurface in the state space of a dynamical system can be split by the present transformation technique into two disjoint classes; while the first of these contains all controllers which track the hypersurface in finite time, the second contains all controllers that track the hypersurface asymptotically. On this basis, a reformulation is presented for optimal control problems involving state-variable inequality constraints. If the state constraint is regarded as 'soft', there may exist controllers which are asymptotic, two-sided, and able to yield the optimal value of the performance index.
Markopoulos, N.↗
The dynamics and optimal control of spinning spacecraft and movable telescoping appendages, part A
The problem of optimal control with a minimum time criterion as applied to a single boom system for achieving two axis control is discussed. The special case where the initial conditions are such that the system can be driven to the equilibrium state with only a single switching maneuver in the bang-bang optimal sequence is analyzed. The system responses are presented. Application of the linear regulator problem for the optimal control of the telescoping system is extended to consider the effects of measurement and plant noises. The noise uncertainties are included with an application of the estimator - Kalman filter problem. Different schemes for measuring the components of the angular velocity are considered. Analytical results are obtained for special cases, and numerical results are presented for the general case.
Bainum, P. M.↗
Linear stochastic optimal control and estimation problem
Problem involves design of controls for linear time-invariant system disturbed by white noise. Solution is Kalman filter coupled through set of optimal regulator gains to produce desired control signal. Key to solution is solving matrix Riccati differential equation. LSOCE effectively solves problem for wide range of practical applications. Program is written in FORTRAN IV for batch execution and has been implemented on IBM 360.
Geyser, L. C.↗
On the optimal angular velocity control of asymmetrical space vehicles
Inverse problem of optimal control for reducing angular velocities of space vehicle to zero
Athans, M.↗
Control optimization, stabilization and computer algorithms for aircraft applications
Research related to reliable aircraft design is summarized. Topics discussed include systems reliability optimization, failure detection algorithms, analysis of nonlinear filters, design of compensators incorporating time delays, digital compensator design, estimation for systems with echoes, low-order compensator design, descent-phase controller for 4-D navigation, infinite dimensional mathematical programming problems and optimal control problems with constraints, robust compensator design, numerical methods for the Lyapunov equations, and perturbation methods in linear filtering and control.
Source record↗
Dual Representations and H ∞ -Optimal Control of Partial Differential Equations
We consider H ∞ -optimal state-feedback control of the class of linear Partial Differential Equations (PDEs) which admit a Partial Integral Equation (PIE) representation. While linear matrix inequalities are commonly used for optimal control of Ordinary Differential Equations (ODEs), the absence of a universal state-space representation and suitable dual form prevents such methods from being applied to optimal control of PDEs. Specifically, for ODEs, the controller synthesis problem is defined in state-space, and duality is used to resolve the bilinearity of that synthesis problem. Recently, the PIE representation was proposed as a universal state-space representation for linear PDE systems. In this paper, we show that any PDE system represented by a PIE admits a dual PIE with identical stability and I/O properties. This result allows us to reformulate the stabilizing and optimal state-feedback control problems as convex optimization over the cone of positive Partial Integral (PI) operators. Operator inversion formulae then allow us to construct feedback gains for the original PDE system. The results are verified through application to several canonical problems in optimal control of PDEs and indicate the resulting bounds on H ∞ norm are not conservative.
42 ENGINEERING↗
Some Asymptotic Problems in the Optimal Control of Distributed Systems
The optimal control of structures which consist of composite materials or of perforated materials is discussed. Asymptotic formula, derived from the so-called homogenization theory, are presented which allow the replacement of very complicated problems by much simpler ones.
Lions, J. L.↗
Analysis, approximation, and computation of a coupled solid/fluid temperature control problem
An optimization problem is formulated motivated by the desire to remove temperature peaks, i.e., 'hot spots', along the bounding surfaces of containers of fluid flows. The heat equation of the solid container is coupled to the energy equations for the fluid. Heat sources can be located in the solid body, the fluid, or both. Control is effected by adjustments to the temperature of the fluid at the inflow boundary. Both mathematical analyses and computational experiments are given.
Gunzburger, Max D.↗
Floating Wind Turbine Control Optimization
We present a framework for optimizing the control parameters of floating offshore wind turbines (FOWTs). The framework combines aeroelastic simulations with a systems engineering model and control software. In an example of the optimization framework, we minimize tower damage equivalent loading with generator speed constraints. We also study the effect of thrust-limiting control and quantify the trade off between fatigue loading and energy capture using a set of optimal controller designs. Finally, we optimize the controller of four different FOWT models and compare their dynamic responses. Additional details and other use cases for the framework are presented, which can optimize different control problems and evaluate FOWT designs.
controls↗