Noise-intensity sensitivity in optimal stochastic systems.
Optimal stochastic control systems design, deriving sensitivity equation for analyzing optimal performance index sensitivity to variations in random signal variance parameter
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimal stochastic control systems design, deriving sensitivity equation for analyzing optimal performance index sensitivity to variations in random signal variance parameter
Analysis of stochastic dynamical systems that involve multiplicative (bilinear) noise processes is considered. After defining the systems of interest, the evolution of the moments of such systems, the question of stochastic stability, and estimation for bilinear stochastic systems are discussed. Both exact and approximate methods of analysis are introduced, and, in particular, the uses of Lie-theoretic concepts and harmonic analysis are discussed.
Analysis of stochastic dynamical systems that involve multiplicative (bilinear) noise processes. After defining the systems of interest, consideration is given to the evolution of the moments of such systems, the question of stochastic stability, and estimation for bilinear stochastic systems. Both exact and approximate methods of analysis are introduced, and, in particular, the uses of Lie-theoretic concepts and harmonic analysis are discussed.
We demonstrate that nonlinear stochastic systems near criticality (including forced and self-organized criticality) will generally exhibit low-dimensional behavior. We give a connection between the fractal dimensions of finite-dimensional chaotic systems and the anomalous dimensions in stochastic systems near criticality. The effect of additional random noise on stochastic systems will be delineated in terms of the crossover phenomenon between competing criticalities. The possibility of observing such effects in space (such as the onset of substorms) and in the laboratory (such as stochastic particle heating in 'noisy' magnetic fields) will be discussed.
It is demonstrated, using the techniques of path integrals and renormalization-group, that nonlinear stochastic systems near criticality (including self-organized criticality) generally exhibit low-dimensional behavior. The symmetry which characterizes a particular criticality can be broken by the appearance of relevant scaling fields. A connection is made between the fractal dimensions of finite-dimensional chaotic systems and the anomalous dimensions in stochastic systems near criticality. The effect of additional random noise on stochastic systems is also delineated.
The algebraic and geometric structures of certain classes of nonlinear stochastic systems were exploited in order to obtain useful stability and estimation results. The class of bilinear stochastic systems (or linear systems with multiplicative noise) was discussed. The stochastic stability of bilinear systems driven by colored noise was considered. Approximate methods for obtaining sufficient conditions for the stochastic stability of bilinear systems evolving on general Lie groups were discussed. Two classes of estimation problems involving bilinear systems were considered. It was proved that, for systems described by certain types of Volterra series expansions or by certain bilinear equations evolving on nilpotent or solvable Lie groups, the optimal conditional mean estimator consists of a finite dimensional nonlinear set of equations. The theory of harmonic analysis was used to derive suboptimal estimators for bilinear systems driven by white noise which evolve on compact Lie groups or homogeneous spaces.
The decentralized stochastic control of a linear dynamic system consisting of several subsystems is considered. A two-level approach is used by the introduction of a coordinator who collects measurements from the local controllers periodically and in return transmits coordinating parameters. Two types of coordination are considered: open-loop feedback and closed loop. The resulting control laws are found to be intuitively attractive.
Optimal control and stability for stochastic systems, viewing linear diffusion models based upon Gaussian-Markov process as finite dimensional linear system driven by white noise
Linear discrete stochastic control systems containing unknown multiple time delays, plant parameters and noise variances are considered. An algorithm is established which uses the maximum-likelihood technique to identify the unknown parameters. An estimated likelihood function is evaluated based on the previous parameter estimates, which in turn generates a new descent direction vector to update the unknown parameters. The delays and plant parameters are identified in their respective parameter spaces. An example of a second-order stochastic system has been implemented by digital simulation to demonstrate the applicability of the algorithm.
Consideration of stochastic optimal control problems in which the measurement equation contains a control variable. Conditions under which it is possible to separately optimize the dynamic and measurement controls are studied, with particular emphasis on showing (by counterexample) that certain results already available for the linear-Gaussian-quadratic case do not extend to more general problems. Conditions under which the extension is possible are discussed.
New methods are presented for evaluating the expected performance cost of partially observed closed-loop stochastic systems. When the variances of the process statistics are small, a linearized model of the closed-loop stochastic system is defined for which the expected cost can be evaluated by recursion on a set of purely deterministic difference equations. When the variances of the process statistics are large, the linearized model can be used in the control variate method of variance reduction for reducing the number of sample paths required for effective Monte Carlo estimation.
Minimum principle characterizing steady state of linear stochastic system found by using urn model
A novel method is presented for identifying a state-space model and a state estimator for linear stochastic systems from input and output data. The method is primarily based on the relationship between the state-space model and the finite-difference model of linear stochastic systems derived through projection filters. It is proved that least-squares identification of a finite difference model converges to the model derived from the projection filters. System pulse response samples are computed from the coefficients of the finite difference model.
Statistical feedback optimization of linear stochastic systems with measurement errors
With the increasing connectedness and interdependence of systems that are stochastic in nature, the issue of how to manage and coordinate them for safe operation has evidently become more important. In many networked system architectures, the system-wide output has to be delicately managed; often within a prescribed set of bounds. In this paper, a novel control framework is proposed where the bounds on the outputs are translated into independent bounds on the controllable inputs of each subsystem. The main benefit of this framework is that respecting the individual control bounds suffices to guarantee that the system-wide outputs will remain within safe boundaries. Since the systems are assumed to be stochastic, the bounds on the output are introduced as probabilistic chance constraints. The benefits of this framework are demonstrated by applying it to the control of distributed energy resources in a distribution networks where main goal is to keep the voltage magnitudes with their prescribed bounds. The control bounds are evaluated using real data on an IEEE test system.
With the increasing connectedness and interdependence of systems that are stochastic in nature, the issue of how to manage and coordinate them for safe operation has evidently become more important. In many networked system architectures, the system-wide output must be delicately managed, often within a prescribed set of bounds. In this paper, a novel control framework is proposed where the bounds on the outputs are translated into independent bounds on the controllable inputs of each subsystem. The main benefit of this framework is that respecting the individual control bounds suffices to guarantee that the system-wide outputs will remain within safe boundaries. Because the systems are assumed to be stochastic, the bounds on the output are introduced as probabilistic chance constraints. The benefits of this framework are demonstrated by applying it to the control of distributed energy resources in a distribution network where the main goal is to keep the voltage magnitudes within their prescribed bounds. The control bounds are evaluated using real data on an IEEE test system.
The design of self-tuning controllers for multivariable stochastic systems is considered analytically. A long-division technique for finding the similarity transformation matrix and transforming the estimated left MFD to the right MFD is developed; the derivation is given in detail, and the procedures involved are briefly characterized.
Iterative digital computer algorithm for solving optimization problems for linear stochastic systems