Search NASA⌕ Search

SEARCH · Search NASA

Results for “STOCHASTIC CONTROL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Linear System Control Using Stochastic Learning Automata

This paper explains the use of a Stochastic Learning Automata (SLA) to control switching between three systems to produce the desired output response. The SLA learns the optimal choice of the damping ratio for each system to achieve a desired result. We show that the SLA can learn these states for the control of an unknown system with the proper choice of the error criteria. The results of using a single automaton are compared to using multiple automata.

Ziyad, Nigel↗
NASA NTRS1972

Adaptive control of stochastic linear systems with unknown parameters

The problem of optimal control of linear discrete-time stochastic dynamical system with unknown and, possibly, stochastically varying parameters is considered on the basis of noisy measurements. It is desired to minimize the expected value of a quadratic cost functional. Since the simultaneous estimation of the state and plant parameters is a nonlinear filtering problem, the extended Kalman filter algorithm is used. Several qualitative and asymptotic properties of the open loop feedback optimal control and the enforced separation scheme are discussed. Simulation results via Monte Carlo method show that, in terms of the performance measure, for stable systems the open loop feedback optimal control system is slightly better than the enforced separation scheme, while for unstable systems the latter scheme is far better.

Ku, R. T.↗
NASA NTRS1971

Closed-loop control of stochastic nonlinear systems

Technique resolves problems in complex control systems, such as those used for space vehicle guidance and control. Main disadvantage of procedure is that it is only appropriate in situations where trajectory concept is valid.

Schmidt, G. T.↗
NASA NTRS1991

Supercomputer optimizations for stochastic optimal control applications

Supercomputer optimizations for a computational method of solving stochastic, multibody, dynamic programming problems are presented. The computational method is valid for a general class of optimal control problems that are nonlinear, multibody dynamical systems, perturbed by general Markov noise in continuous time, i.e., nonsmooth Gaussian as well as jump Poisson random white noise. Optimization techniques for vector multiprocessors or vectorizing supercomputers include advanced data structures, loop restructuring, loop collapsing, blocking, and compiler directives. These advanced computing techniques and superconducting hardware help alleviate Bellman's curse of dimensionality in dynamic programming computations, by permitting the solution of large multibody problems. Possible applications include lumped flight dynamics models for uncertain environments, such as large scale and background random aerospace fluctuations.

Chung, Siu-Leung↗
NASA NTRS1989

Parallel and vector computation for stochastic optimal control applications

A general method for parallel and vector numerical solutions of stochastic dynamic programming problems is described for optimal control of general nonlinear, continuous time, multibody dynamical systems, perturbed by Poisson as well as Gaussian random white noise. Possible applications include lumped flight dynamics models for uncertain environments, such as large scale and background random atmospheric fluctuations. The numerical formulation is highly suitable for a vector multiprocessor or vectorizing supercomputer, and results exhibit high processor efficiency and numerical stability. Advanced computing techniques, data structures, and hardware help alleviate Bellman's curse of dimensionality in dynamic programming computations.

Hanson, F. B.↗
NASA NTRS1989

Application of stochastic robustness to aircraft control systems

Stochastic robustness, a simple numerical procedure for estimating the stability robustness of linear, time-invariant systems, is applied to a forward-swept-wing aircraft control system. Based on Monte Carlo evaluation of the system's closed-loop eignevalues, this analysis approach introduces the probability of instability as a scalar stability robustness measure. The related stochastic root locus provides insight into robustness characteristics of the closed-loop system. Three Linear Quadratic controllers of decreasing robustness are chosen to demonstrate the use of stochastic robustness to analyze and compare control designs. Examples are presented illustrating the use of stochastic robustness analysis to address the effects of actuator dynamics and unmodeled dynamics on the stability robustness of the forward-swept-wing aircraft.

Stengel, Robert F.↗
NASA NTRS1972

Control system estimation and design for aerospace vehicles with time delay

The problems of estimation and control of discrete, linear, time-varying systems are considered. Previous solutions to these problems involved either approximate techniques, open-loop control solutions, or results which required excessive computation. The estimation problem is solved by two different methods, both of which yield the identical algorithm for determining the optimal filter. The partitioned results achieve a substantial reduction in computation time and storage requirements over the expanded solution, however. The results reduce to the Kalman filter when no delays are present in the system. The control problem is also solved by two different methods, both of which yield identical algorithms for determining the optimal control gains. The stochastic control is shown to be identical to the deterministic control, thus extending the separation principle to time delay systems. The results obtained reduce to the familiar optimal control solution when no time delays are present in the system.

Allgaier, G. R.↗
NASA NTRS1985

Implicit dual control for general stochastic systems

A new implicit dual technique is presented for stochastic adaptive control synthesis. In this technique, denoted as the method of utility costs (MOUC), a new control policy is derived from a known starting control policy by using a single iteration in time-varying policy space. An important result is that the new control policy yields a corresponding improvement in adaptive performance relative to the known starting policy. Since the starting policy can be chosen arbitrarily, the new policy has potentially superior performance relative to any existing design. Unlike other implicit dual designs, the MOUC can be applied to systems having constrained inputs, discontinuities, discrete valued disturbances, as well as in situations where the variances of the associated process statistics are large. A numerical example is given in which a controller is synthesized to provide improved performance relative to the Open-Loop Feedback policy of Dreyfus.

Bayard, D. S.↗
NASA NTRS1975

Theory and applications survey of decentralized control methods

A nonmathematical overview is presented of trends in the general area of decentralized control strategies which are suitable for hierarchical systems. Advances in decentralized system theory are closely related to advances in the so-called stochastic control problem with nonclassical information pattern. The basic assumptions and mathematical tools pertaining to the classical stochastic control problem are outlined. Particular attention is devoted to pitfalls in the mathematical problem formulation for decentralized control. Major conclusions are that any purely deterministic approach to multilevel hierarchical dynamic systems is unlikely to lead to realistic theories or designs, that the flow of measurements and decisions in a decentralized system should not be instantaneous and error-free, and that delays in information exchange in a decentralized system lead to reasonable approaches to decentralized control. A mathematically precise notion of aggregating information is not yet available.

Athans, M.↗
NASA NTRS1990

Stochastic performance robustness of aircraft control systems

Stochastic robustness, a simple technique used to estimate the robustness of linear, time-invariant systems, is applied to a twin-jet transport aircraft control system. Concepts behind stochastic stability robustness are extended to stochastic performance robustness. Stochastic performance robustness measures based on classical design specifications and measures specific to aircraft handling qualities are introduced. Confidence intervals for both individual stochastic robustness measures and for comparing two measures are presented. The application of stochastic performance robustness, the use of confidence intervals, and tradeoffs between performance objectives are demonstrated by means of the twin-jet aircraft example.

Stengel, Robert F.↗
NASA NTRS1976

Optimum design considerations of a gust alleviator for aircraft

A gust alleviation system for aircraft flying in turbulent air was analyzed. A vane sensor (with noise) was used to measure vertical gusts, and elevators and flaps were used to reduce the root-mean-square value of the normal accelerations associated with the aircraft response to gusts. Since turbulence has stochastic properties, stochastic control theory was used in the analysis. A quadratic performance-index function involving normal acceleration and control deflections was minimized. Application of the analysis was illustrated by a short take-off and landing (STOL) airplane in flight through turbulent air. Effects of varying the noise characteristics of the vane sensor and of a weighting matrix in the performance-index function were determined. Calculations were performed as required by stochastic control theory to obtain the root-mean-square response of the airplane to turbulence. Results show that good alleviation was calculated when the intensity of the measurement noise was about 3.6 percent of the vane deflection angles.

Oehman, W. I.↗
DOE OSTI2025

Control-Affine Schrödinger Bridge and Generalized Bohm Potential

From a stochastic control perspective, the Schrödinger bridge is a density-valued continuous curve parameterized by time that connects a given pair of initial and terminal probability densities via minimum effort controlled Brownian motion. The control-affine Schrödinger bridge extends this idea to a generic control-affine Itô diffusion, possibly with an additive state cost. Here, in this letter, we recast the necessary conditions of optimality for the control-affine Schrödinger bridge problem as a two point boundary value problem for a quantum mechanical Schrödinger PDE with complex potential. This complex-valued potential is a generalization of the real-valued Bohm potential in quantum mechanics. Our derived potential is akin to the optical potential in nuclear physics where the real part of the potential encodes elastic scattering (transmission of wave function), and the imaginary part encodes inelastic scattering (absorption of wave function). The key takeaway is that the process noise that drives the evolution of probability densities induces an absorbing medium in the evolution of wave function. These results make new connections between control theory and non-equilibrium statistical mechanics through the lens of quantum mechanics.

Markov processes↗
NASA NTRS1976

Linear stochastic optimal control and estimation

Digital program has been written to solve the LSOCE problem by using a time-domain formulation. LSOCE problem is defined as that of designing controls for linear time-invariant system which is disturbed by white noise in such a way as to minimize quadratic performance index.

Geyser, L. C.↗
NASA NTRS1980

Linear stochastic optimal control and estimation problem

Problem involves design of controls for linear time-invariant system disturbed by white noise. Solution is Kalman filter coupled through set of optimal regulator gains to produce desired control signal. Key to solution is solving matrix Riccati differential equation. LSOCE effectively solves problem for wide range of practical applications. Program is written in FORTRAN IV for batch execution and has been implemented on IBM 360.

Geyser, L. C.↗