Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

State-space self-tuning controllers for general multivariable stochastic systems

This paper presents a state-space approach for self-tuning control of a more general class of multivariable stochastic systems having a number of inputs equal or different from the number of outputs. The dynamic system is represented in the state-space innovation form with Luenberger's canonical structures. The model parameters and the Kalman gain are identified via either the extended least-squares algorithm or the least-squares ladder algorithm. The Kalman gain matrix and states can be estimated from the identified parameters without utilizing the standard state estimation algorithm. A long division method is introduced for finding the similarity transformation matrix.

Shieh, L. S.↗

Investigation of air transportation technology at Princeton University, 1991-1992

The Air Transportation Research Program at Princeton University proceeded along six avenues during the past year: (1) intelligent flight control; (2) computer-aided control system design; (3) neural networks for flight control; (4) stochastic robustness of flight control systems; (5) microburst hazards to aircraft; and (6) fundamental dynamics of atmospheric flight. This research has resulted in a number of publications, including archival papers and conference papers. An annotated bibliography of publications that appeared between June 1991 and June 1992 appears at the end of this report. The research that these papers describe was supported in whole or in part by the Joint University Program, including work that was completed prior to the reporting period.

Stengel, Robert F.↗

A Monte Carlo approach to the analysis of control system robustness

Stochastic robustness, a simple technique used to estimate the stability and performance robustness of linear, time-invariant systems, is described. The scalar probability of instability is introduced as a measure of stability robustness. Examples are given of stochastic performance robustness measures based on classical time-domain specifications. The relationship between stochastic robustness measures and control system design parameters is discussed. The technique is demonstrated by analyzing an LQG/LTR system designed for a flexible robot arm. It is concluded that the analysis of stochastic robustness offers a good alternative to existing robustness metrics.

Ray, Laura R.↗

A stochastic optimal feedforward and feedback control methodology for superagility

A new control design methodology is developed: Stochastic Optimal Feedforward and Feedback Technology (SOFFT). Traditional design techniques optimize a single cost function (which expresses the design objectives) to obtain both the feedforward and feedback control laws. This approach places conflicting demands on the control law such as fast tracking versus noise atttenuation/disturbance rejection. In the SOFFT approach, two cost functions are defined. The feedforward control law is designed to optimize one cost function, the feedback optimizes the other. By separating the design objectives and decoupling the feedforward and feedback design processes, both objectives can be achieved fully. A new measure of command tracking performance, Z-plots, is also developed. By analyzing these plots at off-nominal conditions, the sensitivity or robustness of the system in tracking commands can be predicted. Z-plots provide an important tool for designing robust control systems. The Variable-Gain SOFFT methodology was used to design a flight control system for the F/A-18 aircraft. It is shown that SOFFT can be used to expand the operating regime and provide greater performance (flying/handling qualities) throughout the extended flight regime. This work was performed under the NASA SBIR program. ICS plans to market the software developed as a new module in its commercial CACSD software package: ACET.

Halyo, Nesim↗

Application of quadratic optimization to supersonic inlet control.

This paper describes the application of linear stochastic optimal control theory to the design of the control system for the air intake, the inlet, of a supersonic air-breathing propulsion system. The controls must maintain a stable inlet shock position in the presence of random airflow disturbances and prevent inlet unstart. Two different linear time invariant controllers are developed. One is designed to minimize a nonquadratic index, the expected frequency of inlet unstart, and the other is designed to minimize the mean square value of inlet shock motion. The quadratic equivalence principle is used to obtain a linear controller that minimizes the nonquadratic index. The two controllers are compared on the basis of unstart prevention, control effort requirements, and frequency response. It is concluded that while controls designed to minimize unstarts are desirable in that the index minimized is physically meaningful, computation time required is longer than for the minimum mean square shock position approach. The simpler minimum mean square shock position solution produced expected unstart frequency values which were not significantly larger than those of the nonquadratic solution.

Lehtinen, B.↗

Design of optimal partial state feedback controllers for linear systems in stochastic environments

The problem of obtaining an optimal control law, which is constrained to be a feedback of the available measurements, is considered for both continuous and discrete time linear systems subjected to additive white process noise and measurement noise. Necessary conditions are obtained for minimizing a quadratic performance function for both finite and infinite duration cases. The feedback gain matrices are constrained to be constant for the infinite duration cases. For all the cases considered, algorithms are derived for generating sequences of feedback gain matrices which successively improve the performance function. Computational aspects are discussed via application to two continuous time processes, including a helicopter/slung load system subjected to measurement noise and random wind gust input.

Joshi, S. M.↗

Structural modelling and control design under incomplete parameter information: The maximum-entropy approach

A stochastic structural control model is described. In contrast to the customary deterministic model, the stochastic minimum data/maximum entropy model directly incorporates the least possible a priori parameter information. The approach is to adopt this model as the basic design model, thus incorporating the effects of parameter uncertainty at a fundamental level, and design mean-square optimal controls (that is, choose the control law to minimize the average of a quadratic performance index over the parameter ensemble).

Hyland, D. C.↗

Stochastic analysis of the control of the movement of the spacecraft in the vicinity of the colinear libration point by means of the forces of luminous pressure

This paper is dedicated to the possible investigation of the utilization of the solar radiation pressure for the spacecraft motion control in the vicinity of collinear libration point of planar restricted ring problem of three bodies. The control is realized by changing the solar sail area at its permanent orientation. In this problem the influence of the trajectory errors and the errors of the execution control is accounted. It is worked out, the estimation method of the solar sail sizes, which are necessary for spacecraft keeping in the vicinity of collinear libration point during the certain time with given probability. The main control parameters were calculated for some examples in case of libration points of the Sun-Earth and Earth-Moon systems.

Lukyanov, S. S.↗

Stochastic Guidance of Buoyancy Controlled Vehicles under Ice Shelves using Ocean Currents

We propose a novel technique for guidance ofbuoyancy-controlled vehicles in uncertain under-ice ocean flows.In-situ melt rate measurements collected at the grounding zoneof Antarctic ice shelves, where the ice shelf meets the underlyingbedrock, are essential to constrain models of future sea levelrise. Buoyancy-controlled vehicles, which control their verticalposition in the water column but have no means of horizontalpropulsion, offer an affordable and reliable platform for suchin-situ data collection. However, reaching the grounding zonerequires vehicles to traverse tens of kilometers under the iceshelf, with approximate position knowledge and no meansof communication, in highly variable and uncertain oceancurrents. To address this challenge, we propose a partiallyobservable MDP approach that exploits model-based knowledgeof the under-ice currents and, critically, of their uncertainty,to synthesize effective guidance policies. The approach usesapproximate dynamic programming to model uncertainty inthe currents, and QMDP to address localization uncertainty.Numerical experiments show that the policy can deliver upto 88.8% of underwater vehicles to the grounding zone – a33% improvement compared to state-of-the-art guidance techniques, and a 262% improvement over uncontrolled drifters.Collectively, these results show that model-based under-iceguidance is a highly promising technique for exploration ofunder-ice cavities, and has the potential to enable cost-effectiveand scalable access to these challenging and rarely observed environments.

Clark, Evan B.↗

Quadratic optimal cooperative control synthesis with flight control application

An optimal control-law synthesis approach is presented that involves simultaneous solution for two cooperating controllers operating in parallel. One controller's structure includes stochastic state estimation and linear feedback of the state estimates, while the other controller involves direct linear feedback of selected system output measurements. This structure is shown to be optimal under the constraint of linear feedback of system outputs in one controller. Furthermore, it is appropriate for flight control synthesis where the full-state optimal stochastic controller can be adjusted to be representative of an optimal control model of the human pilot in a stochastic regulation task. The method is experimentally verified in the case of the selection of pitch-damper gain for optimum pitch tracking, where optimum implies the best subjective pilot rating in the task. Finally, results from application of the method to synthesize a controller for a multivariable fighter aircraft are presented, and implications of the results of this method regarding the optimal plant dynamics for tracking are discussed.

Schmidt, D. K.↗

Robustness of solutions to a benchmark control problem

The stochastic robustness of solutions to a benchmark control design problem has been analyzed. The analysis quantifies the controllers' stability and performance robustness with structured uncertainties in up to six system parameters. The analysis provides insights about system response that are not readily derived from other robustness criteria, providing a common ground for judging controllers produced by alternative methods.

Stengel, Robert F.↗

The insertion of human dynamics models in the flight control loops of V/STOL research aircraft. Appendix 2: The optimal control model of a pilot in V/STOL aircraft control loops

An overview is presented of research work focussed on the design and insertion of classical models of human pilot dynamics within the flight control loops of V/STOL aircraft. The pilots were designed and configured for use in integrated control system research and design. The models of human behavior that were considered are: McRuer-Krendel (a single variable transfer function model); and Optimal Control Model (a multi-variable approach based on optimal control and stochastic estimation theory). These models attempt to predict human control response characteristics when confronted with compensatory tracking and state regulation tasks. An overview, mathematical description, and discussion of predictive limitations of the pilot models is presented. Design strategies and closed loop insertion configurations are introduced and considered for various flight control scenarios. Models of aircraft dynamics (both transfer function and state space based) are developed and discussed for their use in pilot design and application. Pilot design and insertion are illustrated for various flight control objectives. Results of pilot insertion within the control loops of two V/STOL research aricraft (Sikorski Black Hawk UH-60A, McDonnell Douglas Harrier II AV-8B) are presented and compared against actual pilot flight data. Conclusions are reached on the ability of the pilot models to adequately predict human behavior when confronted with similar control objectives.

Zipf, Mark E.↗

Parallel Monte Carlo Simulation for control system design

The research during the 1993/94 academic year addressed the design of parallel algorithms for stochastic robustness synthesis (SRS). SRS uses Monte Carlo simulation to compute probabilities of system instability and other design-metric violations. The probabilities form a cost function which is used by a genetic algorithm (GA). The GA searches for the stochastic optimal controller. The existing sequential algorithm was analyzed and modified to execute in a distributed environment. For this, parallel approaches to Monte Carlo simulation and genetic algorithms were investigated. Initial empirical results are available for the KSR1.

Schubert, Wolfgang M.↗

Optimum impulsive midcourse guidance with control dependent errors.

The problem of determining the optimum guidance policy for an interplanetary spacecraft is treated as a stochastic optimal control problem. An algorithm for computing the optimum velocity correction and the optimum execution time (with allowance for correction-dependent errors) is derived in the case of a single midcourse correction. The performance index was chosen to be an upper bound for the probability that the mission fails, and it is defined as a function of the maximum allowable velocity correction and the maximum allowable deviation of the terminal state. Numerical results obtained for a Jupiter fly-by mission indicate that the execution errors have a significant influence on the performance index, but an acceptably small upper bound on the probability of mission failure can be obtained for sufficiently small execution errors.

Tapley, B. D.↗