Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic nonlinear systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Composite Robust $H_\infty$ Control for Uncertain Stochastic Nonlinear Systems with State Delay via Disturbance Observer

Here in this note, the robust stochastic stabilization and robust H_infinity control problems are investigated for uncertain stochastic time-delay systems with nonlinearity and multiple disturbances. By estimating the disturbance, which can be described by an exogenous model, a composite hierarchical control scheme is proposed that integrates the output of the disturbance observer with state feedback control law. Sufficient conditions for the existence of the disturbance observer and composite hierarchical controller are established in terms of linear matrix inequalities, which ensure the mean-square asymptotic stability of the resulting closed-loop system and the disturbance attenuation. It has been shown that the disturbance rejection performance can also be achieved. A numerical example is provided to show the potential of the proposed techniques and encouraging results have been obtained.

42 ENGINEERING↗
DOE OSTI2022

Data-driven Minimum Entropy Control for Stochastic Nonlinear Systems using the Cumulant-Generating Function

Here, we present a novel minimum entropy control algorithm for a class of stochastic nonlinear systems subjected to non-Gaussian noises. The entropy control can be considered as an optimization problem for the system randomness attenuation, but the mean value has to be considered separately. To overcome this disadvantage, a new representation of the system stochastic properties was given using the cumulant-generating function based on the moment-generating function, in which the mean value and the entropy was reflected by the shape of the cumulant-generating function. Based on the samples of the system output and control input, a time-variant linear model was identified, and the minimum entropy optimization was transformed to system stabilization. Then, an optimal control strategy was developed to achieve the randomness attenuation, and the boundedness of the controlled system output was analyzed. The effectiveness of the presented control algorithm was demonstrated by a numerical example. In this paper, a data-driven minimum entropy design is presented without pre-knowledge of the system model; entropy optimization is achieved by the system stabilization approach in which the stochastic distribution control and minimum entropy are unified using the same identified structure; and a potential framework is obtained since all the existing system stabilization methods can be adopted to achieve the minimum entropy objective.

42 ENGINEERING↗
DOE OSTI2020

Dynamic Performance Enhancement for Nonlinear Stochastic Systems Using RBF Driven Nonlinear Compensation with Extended Kalman Filter

In this paper, a novel hybrid control method is proposed to enhance the control performance of the PI based control system for a class of nonlinear and non-Gaussian stochastic dynamic processes with unmeasurable states. Firstly, to enhance the tracking performance of the PI controller where the PI parameters are fixed in many actual control systems, the compensative signal is formed using the extended Kalman filter(EKF) based state estimator and driven by the radial basis function (RBF) neural network based compensator. In addition, the weights of RBF is trained to minimize the entropy criterion of tracking error as the process is subjected to non-Gaussian disturbances. Meanwhile, since the precise statistical property of noises is hard to obtain for many industrial processes, the kernel density estimation (KDE) technique is employed in this paper to estimate the entropy. The convergence of RBF network is discussed and the stability of the resulted closed-loop hybrid control system is analyzed in mean square sense. Finally, a numerical example and a practical system testing are given to illustrate the effectiveness of the proposed control method.

stochastic systems, PI Controller, Entropy, Extend↗
NASA NTRS1975

Estimation and Analysis of Nonlinear Stochastic Systems

The algebraic and geometric structures of certain classes of nonlinear stochastic systems were exploited in order to obtain useful stability and estimation results. The class of bilinear stochastic systems (or linear systems with multiplicative noise) was discussed. The stochastic stability of bilinear systems driven by colored noise was considered. Approximate methods for obtaining sufficient conditions for the stochastic stability of bilinear systems evolving on general Lie groups were discussed. Two classes of estimation problems involving bilinear systems were considered. It was proved that, for systems described by certain types of Volterra series expansions or by certain bilinear equations evolving on nilpotent or solvable Lie groups, the optimal conditional mean estimator consists of a finite dimensional nonlinear set of equations. The theory of harmonic analysis was used to derive suboptimal estimators for bilinear systems driven by white noise which evolve on compact Lie groups or homogeneous spaces.

Marcus, S. I.↗
DOE OSTI2019

RBFNN-based Minimum Entropy Filtering for a Class of Stochastic Nonlinear Systems

This paper presents a novel minimum entropy filter design for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. Motivated by stochastic distribution control, an output entropy model is developed using RBF neural network while the parameters of the model can be identified by the collected data. Based upon the presented model, the filtering problem has been investigated while the system dynamics have been represented. As the model output is the entropy of the estimation error, the optimal nonlinear filter is obtained based on the Lyapunov design which makes the model output minimum. Moreover, the entropy assignment problem has been discussed as an extension of the presented approach. To verify the presented design procedure, a numerical example is given which illustrates the effectiveness of the presented algorithm. The contributions of this paper can be included as 1) an output entropy model is presented using neural network; 2) a nonlinear filter design algorithm is developed as the main result and 3) a solution of entropy assignment problem is obtained which is an extension of the presented framework.

42 ENGINEERING↗
DOE OSTI2018

EKF-Based Enhanced Performance Controller Design for Nonlinear Stochastic Systems

In this paper, a novel control algorithm is presented to enhance the performance of tracking property for a class of non-linear dynamic stochastic systems with unmeasurable variables. To minimize the entropy of tracking errors without changing the existing closed loop with PI controller, the enhanced performance loop is constructed based on the state estimation by extended Kalman Filter and the new controller is designed by full state feedback following this presented control algorithm. Besides, the conditions are obtained for the stability analysis in the mean square sense. In the end, the comparative simulation results are given to illustrate the effectiveness of proposed control algorithm.

Complex industrial process↗
NASA NTRS1977

Control of nonlinear stochastic systems using adaptive estimation

A general procedure for the design of a digital controller for nonlinear stochastic systems is presented; the emphasis is on development of partitioned-adaptive control techniques which provide rapid tracking of the system state vector to follow rapid trajectory variations. Tests involving the control of a low-order nonlinear oscillator suggest that the procedure yields an effective method for achieving closed-loop performance, despite the difficulty of the control problem

Vanlandingham, H. F.↗
NASA NTRS1978

Digital set point control of nonlinear stochastic systems

A technique for digital control of nonlinear stochastic plants is presented. The development achieves a practical digital algorithm with which the closed-loop system behaves in a classical Type I manner even with gross nonlinearities in the plant structure and low signal-to-noise power ratios. The design procedure is explained in detail and illustrated by an example whose simulated responses testify to the practicality of the approach.

Moose, R. L.↗
DOE OSTI2020

Probability Density Function Control for Stochastic Nonlinear Systems using Monte Carlo Simulation

This paper presents a fast implementation framework of output probability density function (PDF) control for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. The statistical properties of the system outputs can be adjusted by shaping the dynamic output probability density function to track the reference stochastic distribution. However, the dynamic probability density function evolution is very difficult to obtain analytically even if the system model and the stochastic distributions of the noises are known. Motivated by Monte Carlo simulation, the dynamic probability density function can be estimated by sampling data which forms the contribution of this paper. In particular, the sampling points are generated following the stochastic distribution of the noise for each instant. These points go through the system would generate the histogram for system outputs, then the dynamic model can be established based on the dynamic histogram which reflects the randomness and the nonlinear dynamics of the investigated system. Based on the established model, the output probability density function tracking can be achieved and the simulation results and discussions show the effectiveness and benefits of the presented framework.

Zhang, Qichun↗
DOE OSTI2017

An Error-Entropy Minimization Algorithm for Tracking Control of Nonlinear Stochastic Systems with Non-Gaussian Variables

This paper presents an error-entropy minimization tracking control algorithm for a class of dynamic stochastic system. The system is represented by a set of time-varying discrete nonlinear equations with non-Gaussian stochastic input, where the statistical properties of stochastic input are unknown. By using Parzen windowing with Gaussian kernel to estimate the probability densities of errors, recursive algorithms are then proposed to design the controller such that the tracking error can be minimized. The performance of the error-entropy minimization criterion is compared with the mean-square-error minimization in the simulation results.

Entropy↗
NASA NTRS1971

Closed-loop control of stochastic nonlinear systems

Technique resolves problems in complex control systems, such as those used for space vehicle guidance and control. Main disadvantage of procedure is that it is only appropriate in situations where trajectory concept is valid.

Schmidt, G. T.↗
NASA NTRS1983

A separated bias identification and state estimation algorithm for nonlinear systems

A computational algorithm for the identification of biases in discrete-time, nonlinear, stochastic systems is derived by extending the separate bias estimation results for linear systems to the extended Kalman filter formulation. The merits of the approach are illustrated by identifying instrument biases using a terminal configured vehicle simulation.

Caglayan, A. K.↗
NASA NTRS1983

A bias identification and state estimation methodology for nonlinear systems

A computational algorithm for the identification of input and output biases in discrete-time nonlinear stochastic systems is derived by extending the separate bias estimation results for linear systems to the extended Kalman filter formulation. The merits of the approach are illustrated by identifying instrument biases using a terminal configured vehicle simulation.

Caglayan, A. K.↗
NASA NTRS1993

Control of Complex Dynamic Systems by Neural Networks

This paper considers the use of neural networks (NN's) in controlling a nonlinear, stochastic system with unknown process equations. The NN is used to model the resulting unknown control law. The approach here is based on using the output error of the system to train the NN controller without the need to construct a separate model (NN or other type) for the unknown process dynamics. To implement such a direct adaptive control approach, it is required that connection weights in the NN be estimated while the system is being controlled. As a result of the feedback of the unknown process dynamics, however, it is not possible to determine the gradient of the loss function for use in standard (back-propagation-type) weight estimation algorithms. Therefore, this paper considers the use of a new stochastic approximation algorithm for this weight estimation, which is based on a 'simultaneous perturbation' gradient approximation that only requires the system output error. It is shown that this algorithm can greatly enhance the efficiency over more standard stochastic approximation algorithms based on finite-difference gradient approximations.

Spall, James C.↗