Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Walking the Filament of Feasibility: Global Optimization of Highly-Constrained, Multi-Modal Interplanetary Trajectories Using a Novel Stochastic Search Technique

Interplanetary trajectory optimization problems are highly complex and are characterized by a large number of decision variables and equality and inequality constraints as well as many locally optimal solutions. Stochastic global search techniques, coupled with a large-scale NLP solver, have been shown to solve such problems but are inadequately robust when the problem constraints become very complex. In this work, we present a novel search algorithm that takes advantage of the fact that equality constraints effectively collapse the solution space to lower dimensionality. This new approach walks the filament'' of feasibility to efficiently find the global optimal solution.

Englander, Arnold C.↗

On the determination of optimal costly measurement strategies for linear stochastic systems.

This paper presents the formulation of a class of optimization problems dealing with selecting, at each instant of time, one measurement provided by one out of many sensors. Each measurement has an associated measurement cost. The basic problem is then to select an optimal measurement policy, during a specified observation time interval, so that a weighted combination of prediction accuracy and accumulated observation cost is optimized. The current analysis is limited to the class of linear stochastic dynamic systems and measurement subsystems. The problem of selecting the optimal measurement strategy can be transformed into a deterministic optimal control problem. It is shown that the optimal measurement policy and the associated matched Kalman-type filter can be precomputed.

Athans, M.↗

Optimal policies for identification of stochastic linear systems

The problem of designing closed-loop policies for identification of multiinput-multioutput linear discrete-time systems with random time-varying parameters is considered in this paper using a Bayesian approach. A sensitivity index gives a measure of performance for the closed-loop laws. The computation of the optimal laws is shown to be nontrivial, an exercise in stochastic control, but open-loop, affine, and open-loop feedback optimal inputs are shown to yield tractable problems. Numerical examples are given. For time-invariant systems, the criterion considered is shown to be related to the trace of the information matrix associated with the system.

Lopez-Toledo, A. A.↗

Multiobjective optimization in structural design with uncertain parameters and stochastic processes

The application of multiobjective optimization techniques to structural design problems involving uncertain parameters and random processes is studied. The design of a cantilever beam with a tip mass subjected to a stochastic base excitation is considered for illustration. Several of the problem parameters are assumed to be random variables and the structural mass, fatigue damage, and negative of natural frequency of vibration are considered for minimization. The solution of this three-criteria design problem is found by using global criterion, utility function, game theory, goal programming, goal attainment, bounded objective function, and lexicographic methods. It is observed that the game theory approach is superior in finding a better optimum solution, assuming the proper balance of the various objective functions. The procedures used in the present investigation are expected to be useful in the design of general dynamic systems involving uncertain parameters, stochastic process, and multiple objectives.

Rao, S. S.↗

Surrogate Optimization for Quantum Circuits

Variational quantum Eigensolvers are touted as a near-term algorithm capable of impacting many applications. However, the potential has yet to be realized with few claims of quantum advantage and high resource estimates mainly due to the need for optimization in the presence of noise. Finding algorithms and methods to improve the convergence is essential to accelerate the capabilities of near-term hardware for VQE or more broad applications of hybrid methods in which optimization is required. To this goal we look to use modern approaches recently developed in circuit simulations and stochastic classical optimization that can be combined in a surrogate optimization approach to classical circuits. Using an approximate state vector simulator, we efficiently calculate an approximate Hessian, fed as an input for a detailed quantum circuit simulator. We demonstrate the capabilities of such an approach with and without sampling noise. We also show that this method outperforms Powell in the presence of quantum circuit shot noise by a factor of 2-4

quantum computing↗

Planning with Continuous Resources in Stochastic Domains

We consider the problem of optimal planning in stochastic domains with metric resource constraints. Our goal is to generate a policy whose expected sum of rewards is maximized for a given initial state. We consider a general formulation motivated by our application domain--planetary exploration--in which the choice of an action at each step may depend on the current resource levels. We adapt the forward search algorithm AO* to handle our continuous state space efficiently.

Mausam, Mausau↗

Optimization of Stimulus Characteristics for Vestibular Stochastic Resonance to Improve Balance Function

Stochastic resonance (SR) is a mechanism by which noise can assist and enhance the response of neural systems to relevant sensory signals. Recent studies have shown that applying imperceptible stochastic noise electrical stimulation to the vestibular system significantly improved balance and ocular motor responses. The goal of this study was to optimize the amplitude of the stochastic vestibular signals for balance performance during standing on an unstable surface. Subjects performed a standardized balance task of standing on a block of 10-cm-thick medium-density foam with their eyes closed. Balance performance was measured using a force plate under the foam block and using inertial motion sensors placed on the torso and head segments. Stochastic electrical stimulation was applied to the vestibular system through electrodes placed over the mastoid process. Subjects were tested at seven amplitudes in the 0.01-30Hz frequency range. The root mean square of the signal increased by 30 microamperes for each +/-100 microampere increment in the current range of 0 - +/-700 microampere. Six balance parameters were calculated to characterize the performance of subjects during the baseline and the stimulus periods for all seven amplitudes. Optimal stimulus amplitude was determined as the one at which the ratio of parameters from the stimulus period to the baseline period for any amplitude range was less than that for the no stimulus condition on a minimum of four of six parameters. Results from this study showed that balance performance at the optimal stimulus amplitude showed significant improvement with the application of the vestibular SR stimulation. The amplitude of optimal stimulus for improving balance performance in normal subjects was in the range of +/-100 - +/-300 microamps.

Mulavara, Ajitkumar↗

Optimal Stimulus Amplitude for Vestibular Stochastic Stimulation to Improve Sensorimotor Function

Sensorimotor changes such as postural and gait instabilities can affect the functional performance of astronauts when they transition across different gravity environments. We are developing a method, based on stochastic resonance (SR), to enhance information transfer by applying non-zero levels of external noise on the vestibular system (vestibular stochastic resonance, VSR). Our previous work has shown the advantageous effects of VSR in a balance task of standing on an unstable surface. This technique to improve detection of vestibular signals uses a stimulus delivery system that is wearable or portable and provides imperceptibly low levels of white noise-based binaural bipolar electrical stimulation of the vestibular system. The goal of this project is to determine optimal levels of stimulation for SR applications by using a defined vestibular threshold of motion detection. A series of experiments were carried out to determine a robust paradigm to identify a vestibular threshold that can then be used to recommend optimal stimulation levels for SR training applications customized to each crewmember. Customizing stimulus intensity can maximize treatment effects. The amplitude of stimulation to be used in the VSR application has varied across studies in the literature such as 60% of nociceptive stimulus thresholds. We compared subjects' perceptual threshold with that obtained from two measures of body sway. Each test session was 463s long and consisted of several 15s sinusoidal stimuli, at different current amplitudes (0-2 mA), interspersed with 20-20.5s periods of no stimulation. Subjects sat on a chair with their eyes closed and had to report their perception of motion through a joystick. A force plate underneath the chair recorded medio-lateral shear forces and roll moments. First we determined the percent time during stimulation periods for which perception of motion (activity above a pre-defined threshold) was reported using the joystick, and body sway (two standard deviation of the noise level in the baseline measurement) was detected by the sensors. The percentage time at each stimulation level for motion detection was normalized with respect to the largest value and a logistic regression curve fit was applied to these data. The threshold was defined at the 50% probability of motion detection. Comparison of threshold of motion detection obtained from joystick data versus body sway suggests that perceptual thresholds were significantly lower, and were not impacted by system noise. Further, in order to determine optimal stimulation amplitude to improve balance, two sets of experiments were carried out. In the first set of experiments, all subjects received the same level of stimuli and the intensity of optimal performance was projected back on subjects' vestibular threshold curve. In the second set of experiments, on different subjects, stimulation was administered from 20-400% of subjects' vestibular threshold obtained from joystick data. Preliminary results of our study show that, in general, using stimulation amplitudes at 40-60% of perceptual motion threshold improved balance performance significantly compared to control (no stimulation). The amplitude of vestibular stimulation that improved balance function was predominantly in the range of +/- 100 to +/- 400 micro A. We hypothesize that VSR stimulation will act synergistically with sensorimotor adaptability (SA) training to improve adaptability by increasing utilization of vestibular information and therefore will help us to optimize and personalize a SA countermeasure prescription. This combination will help to significantly reduce the number of days required to recover functional performance to preflight levels after long-duration spaceflight.

Goel, R.↗

Estimation of an Optimal Stimulus Amplitude for Using Vestibular Stochastic Stimulation to Improve Balance Function

Sensorimotor changes such as postural and gait instabilities can affect the functional performance of astronauts when they transition across different gravity environments. We are developing a method, based on stochastic resonance (SR), to enhance information transfer by applying non-zero levels of external noise on the vestibular system (vestibular stochastic resonance, VSR). The goal of this project was to determine optimal levels of stimulation for SR applications by using a defined vestibular threshold of motion detection.

Goel, R.↗

Mathematical model of a flexible space shuttle vehicle

The development of a mathematical model of the lateral motion of a flexible space shuttle vehicle during ascent is described. The model was developed to perform control system synthesis using stochastic constrained optimization techniques. The goals of the control system synthesis are to demonstrate the applicability of the techniques and to discover any problems peculiar to the flexible nature of a shuttle vehicle. The equations of motion are derived. A brief description of the generation of numerical data is given. Explicit definitions and numerical values of trajectory data and coefficients appearing in the equations of motion are included.

Harvey, C. A.↗

Evaluation of performance characteristics for a space antenna system subjected to stochastic disturbances

Control system synthesis for a large space antenna system is investigated based on stochastic linear optimal control techniques and the minimization of a quadratic Gaussian performance index. Parametric studies indicate that suitable combinations of plant and sensor noise characteristics, and state weighting matrices, can be found to meet the mission RMS pointing requirements. Using a combination of the Kalman filter and linear feedback, an optimal control law for the finite element model of the Hoop/Column structural system without damping is obtained. Removing the hoop-mounted actuator resulted in an increase in the RMS errors, an increased control effort, and an increase in the least damped modal time constant. Removing the hoop-mounted sensor resulted in an RMS error increase and estimator performance degradation, with less system RMS performance degradation than noted for removal of the hoop-mounted actuator.

Ananthakrishnan, S.↗

Randomly Sampled-Data Control Systems

The purpose is to solve the Linear Quadratic Regulator (LQR) problem with random time sampling. Such a sampling scheme may arise from imperfect instrumentation as in the case of sampling jitter. It can also model the stochastic information exchange among decentralized controllers to name just a few. A practical suboptimal controller is proposed with the nice property of mean square stability. The proposed controller is suboptimal in the sense that the control structure is limited to be linear. Because of i. i. d. assumption, this does not seem unreasonable. Once the control structure is fixed, the stochastic discrete optimal control problem is transformed into an equivalent deterministic optimal control problem with dynamics described by the matrix difference equation. The N-horizon control problem is solved using the Lagrange's multiplier method. The infinite horizon control problem is formulated as a classical minimization problem. Assuming existence of solution to the minimization problem, the total system is shown to be mean square stable under certain observability conditions. Computer simulations are performed to illustrate these conditions.

Han, Kuoruey↗

Scheduling Earth Observing Satellites with Evolutionary Algorithms

We hypothesize that evolutionary algorithms can effectively schedule coordinated fleets of Earth observing satellites. The constraints are complex and the bottlenecks are not well understood, a condition where evolutionary algorithms are often effective. This is, in part, because evolutionary algorithms require only that one can represent solutions, modify solutions, and evaluate solution fitness. To test the hypothesis we have developed a representative set of problems, produced optimization software (in Java) to solve them, and run experiments comparing techniques. This paper presents initial results of a comparison of several evolutionary and other optimization techniques; namely the genetic algorithm, simulated annealing, squeaky wheel optimization, and stochastic hill climbing. We also compare separate satellite vs. integrated scheduling of a two satellite constellation. While the results are not definitive, tests to date suggest that simulated annealing is the best search technique and integrated scheduling is superior.

Globus, Al↗