SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

All sources NASA NTRS DOE OSTI

NASA NTRS1972

On the determination of optimal costly measurement strategies for linear stochastic systems.

This paper presents the formulation of a class of optimization problems dealing with selecting, at each instant of time, one measurement provided by one out of many sensors. Each measurement has an associated measurement cost. The basic problem is then to select an optimal measurement policy, during a specified observation time interval, so that a weighted combination of prediction accuracy and accumulated observation cost is optimized. The current analysis is limited to the class of linear stochastic dynamic systems and measurement subsystems. The problem of selecting the optimal measurement strategy can be transformed into a deterministic optimal control problem. It is shown that the optimal measurement policy and the associated matched Kalman-type filter can be precomputed.

Athans, M.↗

NASA NTRS1995

Research of Stochastic Robustness: Results and conclusions

With stochastic robustness we are creating tools to design robust compensators for practical systems. During this year, the stochastic robustness research achieved the following results: refined the search tools needed for synthesis; successfully designed robust compensators for the American Controls Conference benchmark problem; and successfully designed robust compensators for a nonlinear hypersonic aircraft model with uncertainties in 28 parameters.

Marrison, Chris↗

NASA NTRS1986

Control design for robust stability in linear regulators: Application to aerospace flight control

Time domain stability robustness analysis and design for linear multivariable uncertain systems with bounded uncertainties is the central theme of the research. After reviewing the recently developed upper bounds on the linear elemental (structured), time varying perturbation of an asymptotically stable linear time invariant regulator, it is shown that it is possible to further improve these bounds by employing state transformations. Then introducing a quantitative measure called the stability robustness index, a state feedback conrol design algorithm is presented for a general linear regulator problem and then specialized to the case of modal systems as well as matched systems. The extension of the algorithm to stochastic systems with Kalman filter as the state estimator is presented. Finally an algorithm for robust dynamic compensator design is presented using Parameter Optimization (PO) procedure. Applications in a aircraft control and flexible structure control are presented along with a comparison with other existing methods.

Yedavalli, R. K.↗

NASA NTRS2016

Hybrid Differential Dynamic Programming with Stochastic Search

Differential dynamic programming (DDP) has been demonstrated as a viable approach to low-thrust trajectory optimization, namely with the recent success of NASAs Dawn mission. The Dawn trajectory was designed with the DDP-based Static Dynamic Optimal Control algorithm used in the Mystic software. Another recently developed method, Hybrid Differential Dynamic Programming (HDDP) is a variant of the standard DDP formulation that leverages both first-order and second-order state transition matrices in addition to nonlinear programming (NLP) techniques. Areas of improvement over standard DDP include constraint handling, convergence properties, continuous dynamics, and multi-phase capability. DDP is a gradient based method and will converge to a solution nearby an initial guess. In this study, monotonic basin hopping (MBH) is employed as a stochastic search method to overcome this limitation, by augmenting the HDDP algorithm for a wider search of the solution space.

Aziz, Jonathan↗

NASA NTRS2016

Hybrid Differential Dynamic Programming with Stochastic Search

Differential dynamic programming (DDP) has been demonstrated as a viable approach to low-thrust trajectory optimization, namely with the recent success of NASA's Dawn mission. The Dawn trajectory was designed with the DDP-based Static/Dynamic Optimal Control algorithm used in the Mystic software.1 Another recently developed method, Hybrid Differential Dynamic Programming (HDDP),2, 3 is a variant of the standard DDP formulation that leverages both first-order and second-order state transition matrices in addition to nonlinear programming (NLP) techniques. Areas of improvement over standard DDP include constraint handling, convergence properties, continuous dynamics, and multi-phase capability. DDP is a gradient based method and will converge to a solution nearby an initial guess. In this study, monotonic basin hopping (MBH) is employed as a stochastic search method to overcome this limitation, by augmenting the HDDP algorithm for a wider search of the solution space.

Aziz, Jonathan↗

NASA NTRS1976

Linear and nonlinear analysis of orbital telescope/space shuttle dynamics and control

Work completed on the design and study of an annular suspension and pointing (ASP) system for the space shuttle was presented. This system makes use of a magnetically suspended vernier pointing assembly. The following objectives were pursued in this study: (1) development of a detailed mathematical model of the Space Shuttle/ASP system, (2) design of control laws in order to obtain the desired pointing performance, and (3) prediction of the statistical pointing accuracies in the presence of stochastic disturbances such as crew-motion, and sensor and actuator noise. The first two of these objectives are documented in this report.

Roberts, A. S., Jr.↗

NASA NTRS1990

Integrated system identification and modal state estimation for control of flexible space structures

A novel approach of integrated system identification and modal state estimation is proposed for control of linear dynamical systems including flexible space structures. There are four steps involved in this approach. First, the relation between a stochastic state space model of a dynamical system and the coefficients of its autoregressive model with exogenous input is derived. Second, an adaptive least-squares transversal predictor is used to estimate the coefficients of the model. Third, a state space model and a steady state Kalman filter gain of the dynamical system are then identified from the coefficients of the model by using the eigensystem realization algorithm. Fourth, a modal state estimator is constructed using the modal parameters of the identified model. On-line implementation of this algorithm can continually improve the modal parameters and the filter gain. It can also gradually update the system model when the system characteristics are slowly changing. A numerical example is used to illustrate the feasibility of the new approach.

Chen, Chung-Wen↗

NASA NTRS1976

On the optimal minimum order observer-based compensator and the limited state variable feedback controller

Four design problems are considered: two on the optimal minimum order observer-based compensator design and two on the optimal limited state variable feedback controller. The problem of designing an optimal discrete time linear time-invariant observer-based compensator for the regulation of an n dimensional linear discrete time time-invariant plant with m independent outputs is considered. This is a stochastic design problem to the extent that the initial plant state is assumed to be a random vector with known first and second order statistics. The compensator parameters are obtained by minimizing the expectation, with respect to the initial conditions, of the standard cost, quadratic in the state and control vectors with the inclusion of cross terms.

Llorens-Ortiz, B.↗

NASA NTRS1981

Data acquisition and analysis of range-finding systems for spacing construction

For space missions of future, completely autonomous robotic machines will be required to free astronauts from routine chores of equipment maintenance, servicing of faulty systems, etc. and to extend human capabilities in hazardous environments full of cosmic and other harmful radiations. In places of high radiation and uncontrollable ambient illuminations, T.V. camera based vision systems cannot work effectively. However, a vision system utilizing directly measured range information with a time of flight laser rangefinder, can successfully operate under these environments. Such a system will be independent of proper illumination conditions and the interfering effects of intense radiation of all kinds will be eliminated by the tuned input of the laser instrument. Processing the range data according to certain decision, stochastic estimation and heuristic schemes, the laser based vision system will recognize known objects and thus provide sufficient information to the robot's control system which can develop strategies for various objectives.

Shen, C. N.↗

NASA NTRS2012

Improving Balance Function Using Low Levels of Electrical Stimulation of the Balance Organs

Crewmembers returning from long-duration space flight face significant challenges due to the microgravity-induced inappropriate adaptations in balance/sensorimotor function. The Neuroscience Laboratory at JSC is developing a method based on stochastic resonance to enhance the brain's ability to detect signals from the balance organs of the inner ear and use them for rapid improvement in balance skill, especially when combined with balance training exercises. This method involves a stimulus delivery system that is wearable/portable and provides imperceptible electrical stimulation to the balance organs of the human body. Stochastic resonance (SR) is a phenomenon whereby the response of a nonlinear system to a weak periodic input signal is optimized by the presence of a particular non-zero level of noise. This phenomenon of SR is based on the concept of maximizing the flow of information through a system by a non-zero level of noise. Application of imperceptible SR noise coupled with sensory input in humans has been shown to improve motor, cardiovascular, visual, hearing, and balance functions. SR increases contrast sensitivity and luminance detection; lowers the absolute threshold for tone detection in normal hearing individuals; improves homeostatic function in the human blood pressure regulatory system; improves noise-enhanced muscle spindle function; and improves detection of weak tactile stimuli using mechanical or electrical stimulation. SR noise has been shown to improve postural control when applied as mechanical noise to the soles of the feet, or when applied as electrical noise at the knee and to the back muscles. SR using imperceptible stochastic electrical stimulation of the vestibular system (stochastic vestibular stimulation, SVS) applied to normal subjects has shown to improve the degree of association between the weak input periodic signals introduced via venous blood pressure receptors and the heart-rate responses. Also, application of SVS over 24 hours improves the long-term heart-rate dynamics and motor responsiveness as indicated by daytime trunk activity measurements in patients with multi-system atrophy, Parkinson s disease, or both, including patients who were unresponsive to standard therapy for Parkinson s disease. Recent studies conducted at the NASA JSC Neurosciences Laboratories showed that imperceptible SVS, when applied to normal young healthy subjects, leads to significantly improved balance performance during postural disturbances on unstable compliant surfaces. These studies have shown the benefit of SR noise characteristic optimization with imperceptible SVS in the frequency range of 0-30 Hz, and amplitudes of stimulation have ranged from 100 to 400 microamperes.

Bloomberg, Jacob↗

NASA NTRSDate not supplied

Path Planning: Differential Dynamic Programming and Model Predictive Path Integral Control on VTOL Aircraft

This paper explores two optimal control approaches, widely used in robotics, to establish their viability as real-time trajectory planners for vehicle configurations envisioned for the emerging aviation sector of Urban Air Mobility (UAM). Differential Dynamic Programming (DDP) enables planning over highly nonlinear dynamics using second-order approximations along a nominal trajectory, and displays quadratic convergence to a local solution. Model Predictive Path Integral (MPPI) is a stochastic sampling-based algorithm that can optimize for general cost criteria, including potentially highly nonlinear formulations, and supports parallel computation through the use of modern GPU hardware. In this work, DDP and MPPI were implemented using model predictive control (MPC), and the results indicate they are able to successfully transition the aircraft over different flight envelopes and generate trajectories unique to UAM vehicles.

Differential Dynamic Programming↗

NASA NTRS1994

Particle acceleration mechanisms

High-energy particle acceleration is observed to proceed in a diverse variety of astrophysical sites ranging from the terrestrial aurorae to the most distant quasars. Particle acceleration is a fairly common channel for the release of large-scale kinetic, rotational, and magnetic energy. Physical mechanisms include electrostatic acceleration, stochastic processes, and diffusive shock energization. Cosmic-ray energy spectra have shapes which reflect escape, collisional, and radiative losses. The overall acceleration efficiency is controlled by the low-energy particle injection which may, in turn, feed back into the energization. Recent observational developments, which illustrate these general principles and raise fresh questions, are briefly summarized.

Blandford, R. D.↗

NASA NTRS2014

Tuning Monotonic Basin Hopping: Improving the Efficiency of Stochastic Search as Applied to Low-Thrust Trajectory Optimization

Trajectory optimization methods using monotonic basin hopping (MBH) have become well developed during the past decade [1, 2, 3, 4, 5, 6]. An essential component of MBH is a controlled random search through the multi-dimensional space of possible solutions. Historically, the randomness has been generated by drawing random variable (RV)s from a uniform probability distribution. Here, we investigate the generating the randomness by drawing the RVs from Cauchy and Pareto distributions, chosen because of their characteristic long tails. We demonstrate that using Cauchy distributions (as first suggested by J. Englander [3, 6]) significantly improves monotonic basin hopping (MBH) performance, and that Pareto distributions provide even greater improvements. Improved performance is defined in terms of efficiency and robustness. Efficiency is finding better solutions in less time. Robustness is efficiency that is undiminished by (a) the boundary conditions and internal constraints of the optimization problem being solved, and (b) by variations in the parameters of the probability distribution. Robustness is important for achieving performance improvements that are not problem specific. In this work we show that the performance improvements are the result of how these long-tailed distributions enable MBH to search the solution space faster and more thoroughly. In developing this explanation, we use the concepts of sub-diffusive, normally-diffusive, and super-diffusive random walks (RWs) originally developed in the field of statistical physics.

autonomous↗

NASA NTRS1993

Synthesis of robust controllers

At the 1990 American Controls Conference a benchmark problem was issued as a challenge for designing robust compensators. Many compensators were presented in response to the problem. In previous work Stochastic Robustness Analysis (SRA) was used to compare these compensators. In this work SRA metrics are used as guides to synthesize robust compensators, using the benchmark problem as an example.

Marrison, Chris↗

NASA NTRS1990

Random search optimization based on genetic algorithm and discriminant function

The general problem of optimization with arbitrary merit and constraint functions, which could be convex, concave, monotonic, or non-monotonic, is treated using stochastic methods. To improve the efficiency of the random search methods, a genetic algorithm for the search phase and a discriminant function for the constraint-control phase were utilized. The validity of the technique is demonstrated by comparing the results to published test problem results. Numerical experimentation indicated that for cases where a quick near optimum solution is desired, a general, user-friendly optimization code can be developed without serious penalties in both total computer time and accuracy.

Kiciman, M. O.↗

NASA NTRS1977

Optimal filtering and filter stability of linear stochastic delay systems

Optimal filtering equations are obtained for very general linear stochastic delay systems. Stability of the optimal filter is studied in the case where there are no delays in the observations. Using the duality between linear filtering and control, asymptotic stability of the optimal filter is proved. Finally, the cascade of the optimal filter and the deterministic optimal quadratic control system is shown to be asymptotically stable as well.

Kwong, R. H.-S.↗

NASA NTRS1992

Response of Thematic Mapper bands to plant water stress

Changes in leaf reflectance as water content decreases have been hypothesized to occur in the 1.55-1.75 and 2.08-2.35 micron wavelength regions. To evaluate this hypothesis, studies were conducted on ryegrass (Lolium multiflorum Lam.) and oats (Avena sativa L.), which were grown in a controlled, outdoor situation. Both fully-watered control beds and water-stressed beds were periodically examined with a spectroradiometer calibrated against a reflectance reference of polytetrafluoroethylene. The observed changes correspond to those predicted by stochastic leaf models employed by other investigators (leaf reflection increases in the 1.55-1.75 micron region as leaf water content decreases). Although the percentage changes in TM bands 1-3 are nearly as great as those found in TM bands 5 and 7, the absolute values of reflectance change are much lower. It is believed that these patterns are probably characteristic of a broad range of vegetation types. In terms of phenomena detection, these patterns should be considered in any practical remote sensing sensor scenario.

Cibula, W. G.↗

NASA NTRS2019

Gradient-Based Aeroservoelastic Optimization with Static Output Feedback

Static output feedback considers an optimal low-order feedback matrix which directly connects the sensors to the control inputs. This work demonstrates the numerical techniques needed to compute the analytical gradient of the optimal feedback matrix with respect to design variables, which may then be used for gradient-based optimization. The derivatives are demonstrated for aeroservoelastic optimization under a series of closed- loop gust load alleviation constraints, considering a continuous stochastic gust load applied to a transport vehicle configuration, among other design constraints such as utter and maneuver loads. The optimal trade-o s between passive load alleviation and active load alleviation for static output feedback are compared with those from full-state feedback, which may be considered an upper-bound for effective sensor-based control.

Stanford, Bret K.↗