Some problems and some recent results in stochastic control.
Stochastic optimal control applications in dynamic programming for linear and nonlinear systems
DYNAMIC PROGRAMMING↗
SEARCH · Search NASA
Results for “(nonlinear) stochastic dynamical systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Probability Density Function Control for Stochastic Nonlinear Systems using Monte Carlo Simulation
This paper presents a fast implementation framework of output probability density function (PDF) control for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. The statistical properties of the system outputs can be adjusted by shaping the dynamic output probability density function to track the reference stochastic distribution. However, the dynamic probability density function evolution is very difficult to obtain analytically even if the system model and the stochastic distributions of the noises are known. Motivated by Monte Carlo simulation, the dynamic probability density function can be estimated by sampling data which forms the contribution of this paper. In particular, the sampling points are generated following the stochastic distribution of the noise for each instant. These points go through the system would generate the histogram for system outputs, then the dynamic model can be established based on the dynamic histogram which reflects the randomness and the nonlinear dynamics of the investigated system. Based on the established model, the output probability density function tracking can be achieved and the simulation results and discussions show the effectiveness and benefits of the presented framework.
Zhang, Qichun↗
Determining structural performance
An overview of the methods and concepts developed to enhance and predict structural dynamic characteristics of advanced aeropropulsion systems is presented. Aeroelasticity, vibration control, dynamic systems, and computational structural methods are four disciplines that make up the structural dynamic effort at LeRC. The aeroelasticity program develops analytical and experimental methods for minimizing flutter and forced vibration of aerospace propulsion systems. Both frequency domain and time domain methods were developed for applications on the turbofan, turbopump, and advanced turboprop. In order to improve life and performance, the vibration control program conceives, analyzes, develops, and demonstrates new methods for controlling vibrations in aerospace systems. Active and passive vibration control is accomplished with electromagnetic dampers, magnetic bearings, and piezoelectric crystals to control rotor vibrations. The dynamic systems program analyzes and verifies the dynamics of interacting systems, as well as develops concepts and methods for high-temperature dynamic seals. Work in this field involves the analysis and parametric identification of large, nonlinear, damped, stochastic systems. The computational structural methods program exploits modern computer science as an aid to the solutions of structural problems.
Ernst, Michael A.↗
Control of Complex Dynamic Systems by Neural Networks
This paper considers the use of neural networks (NN's) in controlling a nonlinear, stochastic system with unknown process equations. The NN is used to model the resulting unknown control law. The approach here is based on using the output error of the system to train the NN controller without the need to construct a separate model (NN or other type) for the unknown process dynamics. To implement such a direct adaptive control approach, it is required that connection weights in the NN be estimated while the system is being controlled. As a result of the feedback of the unknown process dynamics, however, it is not possible to determine the gradient of the loss function for use in standard (back-propagation-type) weight estimation algorithms. Therefore, this paper considers the use of a new stochastic approximation algorithm for this weight estimation, which is based on a 'simultaneous perturbation' gradient approximation that only requires the system output error. It is shown that this algorithm can greatly enhance the efficiency over more standard stochastic approximation algorithms based on finite-difference gradient approximations.
Spall, James C.↗
Stochastic control system parameter identifiability
The parameter identification problem of general discrete time, nonlinear, multiple input/multiple output dynamic systems with Gaussian white distributed measurement errors is considered. The knowledge of the system parameterization was assumed to be known. Concepts of local parameter identifiability and local constrained maximum likelihood parameter identifiability were established. A set of sufficient conditions for the existence of a region of parameter identifiability was derived. A computation procedure employing interval arithmetic was provided for finding the regions of parameter identifiability. If the vector of the true parameters is locally constrained maximum likelihood (CML) identifiable, then with probability one, the vector of true parameters is a unique maximal point of the maximum likelihood function in the region of parameter identifiability and the constrained maximum likelihood estimation sequence will converge to the vector of true parameters.
Lee, C. H.↗
Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty
Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.
42 ENGINEERING↗
Optimal control of nonlinear discrete time systems by mathematical programming
Nonlinear discrete time sampled systems optimal control by dynamic programming, with application to stochastic systems
Tabak, D.↗
Correspondence between open bosonic systems and stochastic differential equations
Bosonic mean-field theories can approximate the dynamics of systems of $n$ bosons provided that $n \gg 1$. Here, we show that there can also be an exact correspondence at finite $n$ when the bosonic system is generalized to include interactions with the environment and the mean-field theory is replaced by a stochastic differential equation. When the $n \to \infty$ limit is taken, the stochastic terms in this differential equation vanish, and a mean-field theory is recovered. Besides providing insight into the differences between the behavior of finite quantum systems and their classical limits given by $n \to \infty$, the developed mathematics can provide a basis for quantum algorithms that solve some stochastic nonlinear differential equations. We discuss conditions on the efficiency of these quantum algorithms, with a focus on the possibility for the complexity to be polynomial in the log of the stochastic system size. A particular system with the form of a stochastic discrete nonlinear Schrödinger equation is analyzed in more detail.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Nonlinear dynamics; Proceedings of the International Conference, New York, NY, December 17-21, 1979
Papers were presented on turbulence, ergodic and integrable behavior, chaotic maps and flows, chemical and fully developed turbulence, and strange attractors. Specific attention was given to measures describing a turbulent flow, stochastization and collapse of vortex systems, a subharmonic route to turbulent convection, and weakly nonlinear turbulence in a rotating convection layer. The Korteweg-de Vries and Hill equations, plasma transport in three dimensions, a horseshoe in the dynamics of a forced beam, and the explosion of strange attractors exhibited by Duffing's equation were also considered.
Helleman, R. H. G.↗
A separation theorem for nonlinear measurements
Separation theorem for nonlinear measurements, discrete-time linear systems and quadratic cost to achieve stochastic control without dynamic programming
Curry, R. E.↗
Parallel and vector computation for stochastic optimal control applications
A general method for parallel and vector numerical solutions of stochastic dynamic programming problems is described for optimal control of general nonlinear, continuous time, multibody dynamical systems, perturbed by Poisson as well as Gaussian random white noise. Possible applications include lumped flight dynamics models for uncertain environments, such as large scale and background random atmospheric fluctuations. The numerical formulation is highly suitable for a vector multiprocessor or vectorizing supercomputer, and results exhibit high processor efficiency and numerical stability. Advanced computing techniques, data structures, and hardware help alleviate Bellman's curse of dimensionality in dynamic programming computations.
Hanson, F. B.↗
Nonequilibrium steady state and heat transport in nonlinear open quantum systems: Stochastic influence action and functional perturbative analysis
In this paper, we show that a nonequilibrium steady state (NESS) exists at late times in open quantum systems with weak nonlinearity by following its nonequilibrium dynamics with a perturbative analysis. We consider an oscillator chain containing three-types of anharmonicity: cubic α- and quartic β-type Fermi–Pasta–Ulam–Tsingou (FPUT) nearest-oscillator interactions and the on-site (pinned) Klein–Gordon (KG) quartic self-interaction. Assuming weak nonlinearity, we introduce a stochastic influence action approach to the problem and obtain the energy flows in different junctures across the chain. The formal results obtained here can be used for quantum transport problems in weakly nonlinear quantum systems. For α-type anharmonicity, we observe that the first-order corrections do not play any role in the thermal transport in the NESS of the configuration we considered. For KG and β-types anharmonicity, we work out explicitly the case of two weakly nonlinearly coupled oscillators, with results scalable to any number of oscillators. We examine the late-time energy flows from one thermal bath to the other via the coupled oscillators, and show that both the zeroth- and the first-order contributions of the energy flows become constant in time at late times, signaling the existence of a late-time NESS to first order in nonlinearity. Our perturbative calculations provide a measure of the strength of nonlinearity for nonlinear open quantum systems, which may help control the mesoscopic heat transport distinct from or close to linear transport. Furthermore, our results also give a benchmark for the numerical challenge of simulating heat transport. Our setup and predictions can be implemented and verified by investigating heat flow in an array of Josephson junctions in the limit of large Josephson energy with the platform of circuit QED.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Observability Analysis of a Power System Stochastic Dynamic Model Using a Derivative-Free Approach
Serving as a prerequisite to power system dynamic state estimation, the observability analysis of a power system dynamic model has recently attracted the attention of many power engineers. However, because this model is typically nonlinear and large-scale, the analysis of its observability is a challenge to the traditional derivative-based methods. Indeed, the linear-approximation-based approach may provide unreliable results while the nonlinear-technique-based approach inevitably faces extremely complicated derivations. Furthermore, because power systems are intrinsically stochastic, the traditional deterministic approaches may lead to inaccurate observability analyses. In this work, facing these challenges, we propose a novel polynomial-chaos-based derivative-free observability analysis approach that not only is free of any linear approximations, but also accounts for the stochasticity of the dynamic model while bringing a low implementation complexity. Furthermore, this approach enables us to quantify the degree of observability of a stochastic model, what conventional deterministic methods cannot do. The excellent performance of the proposed method has been demonstrated by performing extensive simulations using a synchronous generator model with IEEE-DC1A exciter and the TGOV1 turbine governor.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Adaptive PID Gain Scheduling Control for Hydropower Turbine Using Neural CDE and Stochastic Distribution Shaping
This paper introduces a gain-scheduling PID controller design strategy for hydroturbine frequency control mode. This scheme first uses real data to learn the nonlinear dynamics of the hydroturbine using neural controlled differential equations and then perturbs the obtained nonlinear system at different equilibrium points, based on which a static output feedback adaptive dynamic programming algorithm is then used to optimize the PID gains for each equilibrium point. Moreover, a continuous-time version of stochastic distribution control is proposed to further fine-tune the optimized PID gains. Finally, the controller is obtained by implementing linear interpolation between the optimized PID control gains. The simulation results show that the proposed gain-scheduling PID controller can control a larger range of operation points compared with the given fixed PID controller and the baseline method. Compared with the given fixed PID controller, the proposed gain-scheduling PID controller can regulate hydroturbine frequency against disturbances induced by power-load variation with over 50% less overshoot for some operation points.
13 HYDRO ENERGY↗
Fault isolation and fault-tolerant control for Takagi-Sugeno fuzzy time-varying delay stochastic distribution systems
A fault isolation, estimation, and fault-tolerant control (FTC) scheme for nonlinear time-varying delay stochastic distribution control systems was presented in this paper. The Takagi-Sugeno fuzzy model was adopted to approach the nonlinear dynamics of time-varying delay systems. According to the output equivalence principle and Laplace transformation, an augmented state vector was given to solve the time-varying delay problem. When multiple actuator faults and interference occur simultaneously, fault detection, isolation and fault estimation was designed to obtained the fault information. To decouple faults and obtain the value and location information of the fault, the system was separated into two parts through the designed multiple conversion matrices, in which one subsystem was only affected by one actuator fault. This has simplified the design of fault isolation and estimation. A adaptive observer for fault estimation was given. Then, fault information such as the time, location, and size was determined. The observer gain matrices were calculated using linear matrix inequality (LMI). When a fault was detected and diagnosed, a FTC algorithm was devised using the proportional-integral control scheme to compensate the fault as much as possible. It has been shown that even if multiple faults actuator occurred simultaneously, the FTC controller still ensured the output probability density function of the system traced the desired probability density function when a fault occurred. Finally, the expected results were obtained through the simulation example, which confirmed the effectiveness of the method.
42 ENGINEERING↗
Stochastic Representation of Chaos using Terminal Attractors
A nonlinear version of the Liouville equation based upon terminal attractors is proposed for describing post-instability motions of dynamical systems with exponential divergence of trajectories such as those leading to chaos and turbulence. As a result, the post-instability motions are represented by expectations, variances, and higher moments of the state variables as functions of time. The proposed approach can be applied to conservative chaos, and in particular, to n-bodies problem, as well as to dissipative systems, and in particular, to chaotic attractors and turbulence.
stochastic processes↗
Multi-element flow-driven spectral chaos (ME-FSC) method for uncertainty quantification of dynamical systems
The flow-driven spectral chaos (FSC) is a recently developed method for tracking and quantifying uncertainties in the long-time response of stochastic dynamical systems using the spectral approach. The method uses a novel concept called enriched stochastic flow maps as a means to construct an evolving finite-dimensional random function space that is both accurate and computationally efficient in time. In this paper, we present a multi-element version of the FSC method (the ME-FSC method for short) to tackle (mainly) those dynamical systems that are inherently discontinuous over the probability space. In ME-FSC, the random domain is partitioned into several elements, and then the problem is solved separately on each random element using the FSC method. Subsequently, results are aggregated to compute the probability moments of interest using the law of total probability. To demonstrate the effectiveness of the ME-FSC method in dealing with discontinuities and long-time integration of stochastic dynamical systems, four representative numerical examples are presented in this paper, including the Van-der-Pol oscillator problem and the Kraichnan-Orszag three-mode problem. Results show that the ME-FSC method is capable of solving problems that have strong nonlinear dependencies over the probability space, both reliably and at low computational cost.
97 MATHEMATICS AND COMPUTING↗
Non-Gaussian approach for parametric random vibration of non-linear structures
The dynamic response of a nonlinear, single degree of freedom structural system subjected to a physically white noise parametric excitation is investigated. The Ito stochastic calculus is employed to derive a general differential equation for the moments of the response coordinates. The differential equations of moments of any order are found to be coupled with higher order moments. A non-Gaussian closure scheme is developed to truncate the moment equations up to fourth order. The statistical of the stationary response are computed numerically and compared with analytical solutions predicted by a Gaussian closure scheme and the stochastic averaging method. It is found that the computed results exhibit the jump phenomenon which is typical of the characteristics of deterministic nonlinear systems. In addition, the numerical algorithm leads to multiple solutions all of which give positive mean squares. However, two of these solutions are found to violate the properties of high order moments. One solution preserves the moments properties and demonstrates that the system achieves a stationary response.
Ibrahim, R. A.↗