Three examples of differential game problems in optimal control theory
Optimal control problems solved by application of differential game theory
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimal control problems solved by application of differential game theory
Optimal control problems for Markov chains solved by iterative method, using nonlinear finite difference equations to approximate degenerate elliptic functions
Optimal control theory and systems analysis of man machine systems and operator performance prediction model for compensatory tracking tasks are discussed.
The results of optimal control theory are used to synthesize a feedback filter. The feedback filter is used to force the output of the filtered frequency response to match that of a desired optimal frequency response over a finite frequency range. This matching is accomplished by employing a nonlinear programing algorithm to search for the coefficients of the feedback filter that minimize the error between the optimal frequency response and the filtered frequency response. The method is applied to the synthesis of an active flutter-suppression control law for an aeroelastic wind-tunnel model. It is shown that the resulting control law suppresses flutter over a wide range of subsonic Mach numbers. This is a promising method for synthesizing practical control laws using the results of optimal control theory.
Crossover models and optimal control theory for obtaining pilot performance data
The theory of optimal control for nonscalar-valued performance criteria is discussed. In the space, where the performance criterion attains its value, the relations better than, worse than, not better than, and not worse than are defined by a partial order relation. The notion of optimality splits up into superiority and non-inferiority, because worse than is not the complement of better than, in general. A superior solution is better than every other solution. A noninferior solution is not worse than any other solution. Noninferior solutions have been investigated particularly for vector-valued performance criteria. Superior solutions for non-scalar-valued performance criteria attaining their values in abstract partially ordered spaces are emphasized. The main result is the infimum principle which constitutes necessary conditions for a control to be a superior solution to an optimal control problem.
Optimal control theory is used to design linear state variable feedback to improve the dynamic characteristics of a rotor and cantilever wing representing the tilting proprotor aircraft in cruise flight. The response to a vertical gust and system damping are used as criteria for the open and closed loop performance. The improvement in the dynamic characteristics achievable is examined for a gimballed rotor and for a hingeless rotor design. Several features of the design process are examined, including: (1) using only the wing or only the rotor dynamics in the control system design; (2) the use of a wing flap as well as the rotor controls for inputs; (3) and the performance of the system designed for one velocity at other forward speeds.
We present a self-consistent algorithm for optimal control simulations of many-body quantum systems. The algorithm features a two-step synergism that combines discrete real-time machine learning (DRTL) with Quantum Optimal Control Theory (QOCT) using the time-dependent Schrödinger equation. Specifically, in step (1), DRTL is employed to identify a compact working space (i.e., the important portion of the Hilbert space) for the time evolution of the many-body quantum system in the presence of a control field (i.e., the initial or previously updated field), and in step (2), QOCT utilizes the DRTL-determined working space to find a newly updated control field for a chosen objective. Steps 1 and 2 are iterated until a self-consistent control objective value is reached such that the resulting optimal control field yields the same targeted objective value when the corresponding working space is systematically enlarged. Furthermore, to demonstrate this two-step self-consistent DRTL-QOCT synergistic algorithm, we perform optimal control simulations of strongly interacting 1D as well as 2D Heisenberg spin systems. In both scenarios, only a single spin (at the left end site for 1D and the upper left corner site for 2D) is driven by the time-dependent control fields to create an excitation at the opposite site as the target. It is found that, starting from all spin-down zero excitation states, the synergistic method is able to identify working spaces and convergence of the desired controlled dynamics with just a few iterations of the overall algorithm. In the cases studied, the dimensionality of the working space scales only quasi-linearly with the number of spins.
Application of optimal control theory to design of launch vehicle attitude control systems
Processes and applications of calculus of variations in optimal control theory
Optimal final value control theory, applying variational calculus and functional analysis to control function selection for dynamic systems
Being intrinsically nonequilibrium, active materials can potentially perform functions that would be thermodynamically forbidden in passive materials. However, active systems have diverse local attractors that correspond to distinct dynamical states, many of which exhibit chaotic turbulent-like dynamics and thus cannot perform work or useful functions. Designing such a system to choose a specific dynamical state is a formidable challenge. Motivated by recent advances enabling optogenetic control of experimental active materials, we describe an optimal control theory framework that identifies a spatiotemporal sequence of light-generated activity that drives an active nematic system toward a prescribed dynamical steady state. Active nematics are unstable to spontaneous defect proliferation and chaotic streaming dynamics in the absence of control. We demonstrate that optimal control theory can compute activity fields that redirect the dynamics into a variety of alternative dynamical programs and functions. This includes dynamically reconfiguring between states, selecting and stabilizing emergent behaviors that do not correspond to attractors, and are hence unstable in the uncontrolled system. Furthermore, our results provide a roadmap to leverage optical control methods to rationally design structure, dynamics, and function in a wide variety of active materials.
Flight and wind tunnel tests were conducted and multidiscipline computer programs were developed as part of investigations of active control technology conducted at the NASA Langley Research Center. Unsteady aerodynamics approximation, optimal control theory, optimal controller design, and the Delta wing and DC-10 models are described. The drones for aerodynamics and structural testing (DAST program) for evaluating procedures for aerodynamic loads prediction and the design of active control systems on wings with significant aeroelastic effects is described as well as the DAST model used in the wind tunnel tests.
A methodology for optimal trajectory planning, useful in the nap-of-the-earth guidance of helicopters, is presented. This approach uses an adjoint-control transformation along with a one-dimensional search scheme for generating the optimal trajectories. In addition to being useful for helicopter nap-of-the-earth guidance, the trajectory planning solution is of interest in several other contexts, such as robotic vehicle guidance and terrain-following guidance for cruise missiles and aircraft. A distinguishing feature of the present research is that the terrain constraint and the threat envelopes are incorporated in the equations of motion. Second-order necessary conditions are examined.
Book on applications of optimal control theory to computer controller design
Deterministic optimal control, discussing Bellman dynamic programming method, Pontryagin maximum principle, orbital transfer, interplanetary guidance, etc
Deterministic optimal control, discussing Bellman dynamic programming method, Pontryagin maximum principle, orbital transfer, interplanetary guidance, etc
Spacecraft and large launch vehicle nonoptimal /suboptimal/ controllers evaluated with Chebyshev minimax optimal control theory