Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1989

Application of stochastic robustness to aircraft control systems

Stochastic robustness, a simple numerical procedure for estimating the stability robustness of linear, time-invariant systems, is applied to a forward-swept-wing aircraft control system. Based on Monte Carlo evaluation of the system's closed-loop eignevalues, this analysis approach introduces the probability of instability as a scalar stability robustness measure. The related stochastic root locus provides insight into robustness characteristics of the closed-loop system. Three Linear Quadratic controllers of decreasing robustness are chosen to demonstrate the use of stochastic robustness to analyze and compare control designs. Examples are presented illustrating the use of stochastic robustness analysis to address the effects of actuator dynamics and unmodeled dynamics on the stability robustness of the forward-swept-wing aircraft.

Stengel, Robert F.↗
DOE OSTI2020

Probability Density Function Control for Stochastic Nonlinear Systems using Monte Carlo Simulation

This paper presents a fast implementation framework of output probability density function (PDF) control for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. The statistical properties of the system outputs can be adjusted by shaping the dynamic output probability density function to track the reference stochastic distribution. However, the dynamic probability density function evolution is very difficult to obtain analytically even if the system model and the stochastic distributions of the noises are known. Motivated by Monte Carlo simulation, the dynamic probability density function can be estimated by sampling data which forms the contribution of this paper. In particular, the sampling points are generated following the stochastic distribution of the noise for each instant. These points go through the system would generate the histogram for system outputs, then the dynamic model can be established based on the dynamic histogram which reflects the randomness and the nonlinear dynamics of the investigated system. Based on the established model, the output probability density function tracking can be achieved and the simulation results and discussions show the effectiveness and benefits of the presented framework.

Zhang, Qichun↗
NASA NTRS1972

Control system estimation and design for aerospace vehicles with time delay

The problems of estimation and control of discrete, linear, time-varying systems are considered. Previous solutions to these problems involved either approximate techniques, open-loop control solutions, or results which required excessive computation. The estimation problem is solved by two different methods, both of which yield the identical algorithm for determining the optimal filter. The partitioned results achieve a substantial reduction in computation time and storage requirements over the expanded solution, however. The results reduce to the Kalman filter when no delays are present in the system. The control problem is also solved by two different methods, both of which yield identical algorithms for determining the optimal control gains. The stochastic control is shown to be identical to the deterministic control, thus extending the separation principle to time delay systems. The results obtained reduce to the familiar optimal control solution when no time delays are present in the system.

Allgaier, G. R.↗
NASA NTRS1985

Implicit dual control for general stochastic systems

A new implicit dual technique is presented for stochastic adaptive control synthesis. In this technique, denoted as the method of utility costs (MOUC), a new control policy is derived from a known starting control policy by using a single iteration in time-varying policy space. An important result is that the new control policy yields a corresponding improvement in adaptive performance relative to the known starting policy. Since the starting policy can be chosen arbitrarily, the new policy has potentially superior performance relative to any existing design. Unlike other implicit dual designs, the MOUC can be applied to systems having constrained inputs, discontinuities, discrete valued disturbances, as well as in situations where the variances of the associated process statistics are large. A numerical example is given in which a controller is synthesized to provide improved performance relative to the Open-Loop Feedback policy of Dreyfus.

Bayard, D. S.↗
DOE OSTI2020

Online Control of Process Variance Using Feedback

For many stochastic control problem formulations, design objectives typically include constraining the covariance of the outputs of the system. Recent engineering challenges have demonstrated an interest in controlling system output covariances to a setpoint. However, open-loop control of system output covariance can be exceptionally challenging when the system has significant plant uncertainties. This paper explores closed-loop control of the system’s output covariance using a windowed variance function. The stochastic nature of the windowed variance feedback means that root locus and other classical control design techniques cannot be immediately used. Expected value analysis is used to generate transfer functions for the average response of such systems, and the results are used to design controllers. Stochastic simulations are presented to verify the analytical results and make other observations concerning closed-loop variance control.

Bieniek, Mitchell↗
NASA NTRS1975

Theory and applications survey of decentralized control methods

A nonmathematical overview is presented of trends in the general area of decentralized control strategies which are suitable for hierarchical systems. Advances in decentralized system theory are closely related to advances in the so-called stochastic control problem with nonclassical information pattern. The basic assumptions and mathematical tools pertaining to the classical stochastic control problem are outlined. Particular attention is devoted to pitfalls in the mathematical problem formulation for decentralized control. Major conclusions are that any purely deterministic approach to multilevel hierarchical dynamic systems is unlikely to lead to realistic theories or designs, that the flow of measurements and decisions in a decentralized system should not be instantaneous and error-free, and that delays in information exchange in a decentralized system lead to reasonable approaches to decentralized control. A mathematically precise notion of aggregating information is not yet available.

Athans, M.↗
NASA NTRS1990

Stochastic performance robustness of aircraft control systems

Stochastic robustness, a simple technique used to estimate the robustness of linear, time-invariant systems, is applied to a twin-jet transport aircraft control system. Concepts behind stochastic stability robustness are extended to stochastic performance robustness. Stochastic performance robustness measures based on classical design specifications and measures specific to aircraft handling qualities are introduced. Confidence intervals for both individual stochastic robustness measures and for comparing two measures are presented. The application of stochastic performance robustness, the use of confidence intervals, and tradeoffs between performance objectives are demonstrated by means of the twin-jet aircraft example.

Stengel, Robert F.↗
NASA NTRS1976

Optimum design considerations of a gust alleviator for aircraft

A gust alleviation system for aircraft flying in turbulent air was analyzed. A vane sensor (with noise) was used to measure vertical gusts, and elevators and flaps were used to reduce the root-mean-square value of the normal accelerations associated with the aircraft response to gusts. Since turbulence has stochastic properties, stochastic control theory was used in the analysis. A quadratic performance-index function involving normal acceleration and control deflections was minimized. Application of the analysis was illustrated by a short take-off and landing (STOL) airplane in flight through turbulent air. Effects of varying the noise characteristics of the vane sensor and of a weighting matrix in the performance-index function were determined. Calculations were performed as required by stochastic control theory to obtain the root-mean-square response of the airplane to turbulence. Results show that good alleviation was calculated when the intensity of the measurement noise was about 3.6 percent of the vane deflection angles.

Oehman, W. I.↗
DOE OSTI2025

Control-Affine Schrödinger Bridge and Generalized Bohm Potential

From a stochastic control perspective, the Schrödinger bridge is a density-valued continuous curve parameterized by time that connects a given pair of initial and terminal probability densities via minimum effort controlled Brownian motion. The control-affine Schrödinger bridge extends this idea to a generic control-affine Itô diffusion, possibly with an additive state cost. Here, in this letter, we recast the necessary conditions of optimality for the control-affine Schrödinger bridge problem as a two point boundary value problem for a quantum mechanical Schrödinger PDE with complex potential. This complex-valued potential is a generalization of the real-valued Bohm potential in quantum mechanics. Our derived potential is akin to the optical potential in nuclear physics where the real part of the potential encodes elastic scattering (transmission of wave function), and the imaginary part encodes inelastic scattering (absorption of wave function). The key takeaway is that the process noise that drives the evolution of probability densities induces an absorbing medium in the evolution of wave function. These results make new connections between control theory and non-equilibrium statistical mechanics through the lens of quantum mechanics.

Markov processes↗
NASA NTRS1976

Linear stochastic optimal control and estimation

Digital program has been written to solve the LSOCE problem by using a time-domain formulation. LSOCE problem is defined as that of designing controls for linear time-invariant system which is disturbed by white noise in such a way as to minimize quadratic performance index.

Geyser, L. C.↗
NASA NTRS1980

Linear stochastic optimal control and estimation problem

Problem involves design of controls for linear time-invariant system disturbed by white noise. Solution is Kalman filter coupled through set of optimal regulator gains to produce desired control signal. Key to solution is solving matrix Riccati differential equation. LSOCE effectively solves problem for wide range of practical applications. Program is written in FORTRAN IV for batch execution and has been implemented on IBM 360.

Geyser, L. C.↗
NASA NTRS1982

Some critical questions about deterministic and stochastic adaptive control algorithms

The purpose of this informal paper is to discuss certain robustness issues associated with existing adaptive control algorithms. A modeling framework for incorporating high-frequency unknown dynamics in the adaptive control framework is suggested. Possible fundamental limitations of existing adaptive control framework is suggested. Possible fundamental limitations of existing adaptive control algorithms are also discussed, with emphasis upon their closed-loop stability properties in the presence of unmodeled high-frequency dynamics.

Athans, M.↗
NASA NTRS2003

Stochastic Optimal Control via Bellman's Principle

This paper presents a method for finding optimal controls of nonlinear systems subject to random excitations. The method is capable to generate global control solutions when state and control constraints are present. The solution is global in the sense that controls for all initial conditions in a region of the state space are obtained. The approach is based on Bellman's Principle of optimality, the Gaussian closure and the Short-time Gaussian approximation. Examples include a system with a state-dependent diffusion term, a system in which the infinite hierarchy of moment equations cannot be analytically closed, and an impact system with a elastic boundary. The uncontrolled and controlled dynamics are studied by creating a Markov chain with a control dependent transition probability matrix via the Generalized Cell Mapping method. In this fashion, both the transient and stationary controlled responses are evaluated. The results show excellent control performances.

Crespo, Luis G.↗