Optimization of stochastic processes - Midcourse guidance.
Filtering and optimal control problems for discrete stochastic dynamical systems, describing various feedback controls and midcourse guidance optimization
Jazwinski, A. H.↗
SEARCH · Search NASA
Results for “stochastic control”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Stochastic Stability of Sampled Data Systems with a Jump Linear Controller
In this paper an equivalence between the stochastic stability of a sampled-data system and its associated discrete-time representation is established. The sampled-data system consists of a deterministic, linear, time-invariant, continuous-time plant and a stochastic, linear, time-invariant, discrete-time, jump linear controller. The jump linear controller models computer systems and communication networks that are subject to stochastic upsets or disruptions. This sampled-data model has been used in the analysis and design of fault-tolerant systems and computer-control systems with random communication delays without taking into account the inter-sample response. This paper shows that the known equivalence between the stability of a deterministic sampled-data system and the associated discrete-time representation holds even in a stochastic framework.
Gonzalez, Oscar R.↗
Algorithms for output feedback, multiple-model, and decentralized control problems
The optimal stochastic output feedback, multiple-model, and decentralized control problems with dynamic compensation are formulated and discussed. Algorithms for each problem are presented, and their relationship to a basic output feedback algorithm is discussed. An aircraft control design problem is posed as a combined decentralized, multiple-model, output feedback problem. A control design is obtained using the combined algorithm. An analysis of the design is presented.
Halyo, N.↗
Stochastic ordering properties and optimal routing control for a class of finite capacity queueing systems
The problem of routing jobs to parallel queues with identical exponential servers and unequal finite buffer capacities is considered. Stochastic ordering and weak majorization properties on critical performance measures are established by means of event-driven inductions. In particular, it is shown that the intuitive 'join the shortest non-full queue' (SNQ) policy is optimal with respect to an overall function that accounts for holding and blocking costs. Moreover, the buffer allocation problem is solved by proving the intuitive result that, for a fixed total buffer capacity, the optimal allocation scheme is the one in which the difference between the maximum and minimum queue capacities is minimized, i.e., becomes either 0 or 1.
Towsley, Don↗
Sparse Control Synthesis for Uncertain Responsive Loads With Stochastic Stability Guarantees
In this report, recent studies have demonstrated the potential of flexible loads in providing frequency response services, predominantly due to their availability and cost-effectiveness. However, uncertainty and variability in various weather-related and end-use behavioral factors often impact the reliability of demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive in the power system dynamics. Recently developed mean square exponential stability (MSES) results for continuous-time linear stochastic systems are applied to pose the control synthesis problem which results in an LMI-based optimization problem. Additional costs and constraints are added to the LMI-based controller synthesis to ensure MSES, improve closed-loop transient performance, maximize tolerable uncertainties, and promote sparsity in the controller. Additionally, the fundamental limitations between the tolerable uncertainties and control efforts while ensuring MSES are discussed. Further, the control synthesis problem for the case of the full-state measurement is generalized to the case of partial-state measurements. The proposed control synthesis is illustrated on an IEEE 39 bus system with rigorous studies to demonstrate the role of sparsity, closed-loop transient performance, tolerable uncertainties, and control efforts while ensuring MSES and achieving frequency response.
42 ENGINEERING↗
Feedback control for unsteady flow and its application to the stochastic Burgers equation
The study applies mathematical methods of control theory to the problem of control of fluid flow with the long-range objective of developing effective methods for the control of turbulent flows. Model problems are employed through the formalism and language of control theory to present the procedure of how to cast the problem of controlling turbulence into a problem in optimal control theory. Methods of calculus of variations through the adjoint state and gradient algorithms are used to present a suboptimal control and feedback procedure for stationary and time-dependent problems. Two types of controls are investigated: distributed and boundary controls. Several cases of both controls are numerically simulated to investigate the performances of the control algorithm. Most cases considered show significant reductions of the costs to be minimized. The dependence of the control algorithm on the time-descretization method is discussed.
Choi, Haecheon↗
Optimal control in the presence of measurement uncertainties
Linear stochastic systems optimal feedback control with application to spacecraft minimum fuel midcourse guidance problems
Deyst, J. J., Jr.↗
Convergence Analysis for an Online Data-Driven Feedback Control Algorithm
This paper presents convergence analysis of a novel data-driven feedback control algorithm designed for generating online controls based on partial noisy observational data. The algorithm comprises a particle filter-enabled state estimation component, estimating the controlled system’s state via indirect observations, alongside an efficient stochastic maximum principle-type optimal control solver. By integrating weak convergence techniques for the particle filter with convergence analysis for the stochastic maximum principle control solver, we derive a weak convergence result for the optimization procedure in search of optimal data-driven feedback control. Numerical experiments are performed to validate the theoretical findings.
97 MATHEMATICS AND COMPUTING↗
A stochastic scan strategy for grain structure control in complex geometries using electron beam powder bed fusion
Spatial control of microstructure within a three-dimensional component has been a dream of materials scientists for centuries. However, limitations in traditional manufacturing processes prevent detailed control over the distribution of microstructures in a single part. Here, we demonstrate the ability to control grain structure and crystallographic texture during metal additive manufacturing for arbitrary cross-sections of a practical size, with profound implications for the design and optimization of next-generation products. The key to this advance is a new geometry agnostic scan path algorithm that manipulates the spatial distribution of solidification conditions. Utilizing a fundamental understanding of solidification dynamics and a model of the heat transfer during processing, we have designed this algorithm to manipulate the natural competition between epitaxial dendrite growth and grain nucleation. With this algorithm, we successfully controlled the grain structure of Ni-based superalloy IN718 in the shape of the Mona Lisa.
36 MATERIALS SCIENCE↗
Integrated Control Using the SOFFT Control Structure
The need for integrated/constrained control systems has become clearer as advanced aircraft introduced new coupled subsystems such as new propulsion subsystems with thrust vectoring and new aerodynamic designs. In this study, we develop an integrated control design methodology which accomodates constraints among subsystem variables while using the Stochastic Optimal Feedforward/Feedback Control Technique (SOFFT) thus maintaining all the advantages of the SOFFT approach. The Integrated SOFFT Control methodology uses a centralized feedforward control and a constrained feedback control law. The control thus takes advantage of the known coupling among the subsystems while maintaining the identity of subsystems for validation purposes and the simplicity of the feedback law to understand the system response in complicated nonlinear scenarios. The Variable-Gain Output Feedback Control methodology (including constant gain output feedback) is extended to accommodate equality constraints. A gain computation algorithm is developed. The designer can set the cross-gains between two variables or subsystems to zero or another value and optimize the remaining gains subject to the constraint. An integrated control law is designed for a modified F-15 SMTD aircraft model with coupled airframe and propulsion subsystems using the Integrated SOFFT Control methodology to produce a set of desired flying qualities.
Halyo, Nesim↗
Aircraft adaptive learning control
The optimal control theory of stochastic linear systems is discussed in terms of the advantages of distributed-control systems, and the control of randomly-sampled systems. An optimal solution to longitudinal control is derived and applied to the F-8 DFBW aircraft. A randomly-sampled linear process model with additive process and noise is developed.
Lee, P. S. T.↗
Design and evaluation of a Stochastic Optimal Feed-forward and Feedback Technology (SOFFT) flight control architecture
This paper describes the design and evaluation of a stochastic optimal feed-forward and feedback technology (SOFFT) control architecture with emphasis on the feed-forward controller design. The SOFFT approach allows the designer to independently design the feed-forward and feedback controllers to meet separate objectives and then integrate the two controllers. The feed-forward controller has been integrated with an existing high-angle-of-attack (high-alpha) feedback controller. The feed-forward controller includes a variable command model with parameters selected to satisfy level 1 flying qualities with a high-alpha adjustment to achieve desired agility guidelines, a nonlinear interpolation approach that scales entire matrices for approximation of the plant model, and equations for calculating feed-forward gains developed for perfect plant-model tracking. The SOFFT design was applied to a nonlinear batch simulation model of an F/A-18 aircraft modified for thrust vectoring. Simulation results show that agility guidelines are met and that the SOFFT controller filters undesired pilot-induced frequencies more effectively during a tracking task than a flight controller that has the same feedback control law but does not have the SOFFT feed-forward control.
Ostroff, Aaron J.↗
Control of Complex Dynamic Systems by Neural Networks
This paper considers the use of neural networks (NN's) in controlling a nonlinear, stochastic system with unknown process equations. The NN is used to model the resulting unknown control law. The approach here is based on using the output error of the system to train the NN controller without the need to construct a separate model (NN or other type) for the unknown process dynamics. To implement such a direct adaptive control approach, it is required that connection weights in the NN be estimated while the system is being controlled. As a result of the feedback of the unknown process dynamics, however, it is not possible to determine the gradient of the loss function for use in standard (back-propagation-type) weight estimation algorithms. Therefore, this paper considers the use of a new stochastic approximation algorithm for this weight estimation, which is based on a 'simultaneous perturbation' gradient approximation that only requires the system output error. It is shown that this algorithm can greatly enhance the efficiency over more standard stochastic approximation algorithms based on finite-difference gradient approximations.
Spall, James C.↗
On the stochastic maximum principle with ''average'' constraints.
Stochastic maximum principle with averaged constraint developed for control problems affected by stochastic process
RANDOM PROCESS↗
Investigation of Air Transportation Technology at Princeton University, 1989-1990
The Air Transportation Technology Program at Princeton University proceeded along six avenues during the past year: microburst hazards to aircraft; machine-intelligent, fault tolerant flight control; computer aided heuristics for piloted flight; stochastic robustness for flight control systems; neural networks for flight control; and computer aided control system design. These topics are briefly discussed, and an annotated bibliography of publications that appeared between January 1989 and June 1990 is given.
Stengel, Robert F.↗
Stochastic Satbility and Performance Robustness of Linear Multivariable Systems
Stochastic robustness, a simple technique used to estimate the robustness of linear, time invariant systems, is applied to a single-link robot arm control system. Concepts behind stochastic stability robustness are extended to systems with estimators and to stochastic performance robustness. Stochastic performance robustness measures based on classical design specifications are introduced, and the relationship between stochastic robustness measures and control system design parameters are discussed. The application of stochastic performance robustness, and the relationship between performance objectives and design parameters are demonstrated by means of example. The results prove stochastic robustness to be a good overall robustness analysis method that can relate robustness characteristics to control system design parameters.
Ryan, Laurie E.↗
High Performance Adaptive Deep-Reinforcement-Learning-based Real-time Emergency Control (HADREC) to Enhance Power Grid Resilience in Stochastic Environment (Final Report)
The HADREC technology developed in this project features real-time, validated, and predictive emergency control capabilities needed to effectively safeguard the grid against costly disturbances from extreme weather and other disruptive events. It has the potential to revolutionize the emergency control by providing faster and more effective solution for power grid emergency control. The technology can reduce the grid emergency control action time from minutes to seconds and mitigate the impact of outages and reduce system recovery time. The evaluation results using the models and data from PacifiCorp system have shown ~20% improvement in responding time and 70% improved in tripped generator output, comparing against today’s industrial application. This performance can help reduce preventive measurements and improve network utilization and market efficiency, and help lead to a more reliable and resilient power grid with renewable integration. The project has generated significant interest from industry, academic and commercial companies.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Stochastic stability and performance robustness of linear multivariable systems
Stochastic robustness, a simple technique used to estimate the robustness of linear, time-invariant systems, is applied to a single-link robot arm control system. Concepts behind stochastic stability robustness are extended to systems with estimators and to stochastic performance robustness. Stochastic performance robustness measures based on classical design specifications are introduced, and the relationship between stochastic robustness measures and control system design parameters is discussed. The application of stochastic performance robustness and the relationship between performance objectives and design parameters are demonstrated by means of the example. The results prove stochastic robustness to be a good overall robustness analysis method that can relate robustness characteristics to control system design parameters.
Stengel, Robert F.↗