Learning applied to successive approximation algorithms.
Linear reinforcement learning scheme to accelerate convergence of successive approximation algorithms in optimal control problems
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Linear reinforcement learning scheme to accelerate convergence of successive approximation algorithms in optimal control problems
Linear reinforcement learning technique for accelerating convergence of successive approximation algorithms
An unsteady lifting service theory for the counter-rotating propeller is presented using the linearized governing equations for the acceleration potential and representing the blades by a surface distribution of pulsating acoustic dipoles distributed according to a modified Birnbaum series. The Birnbaum series coefficients are determined by satisfying the surface tangency boundary conditions on the front and rear propeller blades. Expressions for the combined acoustic resonance modes of the front prop, the rear prop and the combination are also given.
An unsteady lifting service theory for the counter-rotating propeller is presented using the linearized governing equations for the acceleration potential and representing the blades by a surface distribution of pulsating acoustic dipoles distributed according to a modified Birnbaum series. The Birnbaum series coefficients are determined by satisfying the surface tangency boundary conditions on the front and rear propeller blades. Expressions for the combined acoustic resonance modes of the front prop, the rear prop and the combination are also given.
A determination of the dynamic characteristics of a typical turbojet engine with a centrifugal compressor, a sonic-flow turbine-nozzle diaphragm, and fixed area exhaust nozzle is presented. A generalized equation for transient behavior of the engine was developed; this equation was then verified by calculations using compressor and turbine performance charts extrapolated from equilibrium operating data and by experimental data obtained from an engine operated under transients in fuel flow. The results indicate that a linear differential equation for engine acceleration as a function of fuel flow and engine speed for operation near a steady-state operating condition can be written. The coefficients of this equation can be obtained either from actual transient data or, with a fair degree of accuracy, from the steady-state performance maps of the compressor and turbine, and can be corrected for altitude in the same manner that steady-state performance data are corrected.
A nonintrusive velocity diagnostic based on laser induced fluorescence of the 5d4F(5/2)-6p4D(5/2) singly ionized xenon transition was used to interrogate the exhaust of a 1.5 kW Stationary Plasma Thruster (SPT). A detailed map of plume velocity vectors was obtained using a simplified, cost-effective, nonintrusive, semiconductor laser based scheme. Circumferential velocities on the order of 250 m/s were measured which implied induced momentum torques of approximately 5 x 10(exp -2) N-cm. Axial and radial velocities were evaluated one mm downstream of the cathode at several locations across the width of the annular acceleration channel. Radial velocities varied linearly with radial distance. A maximum radial velocity of 7500 m/s was measured 8 mm from the center of the channel. Axial velocities as large as 16,500 m/s were measured.
A general algorithm is developed that reuses available information to accelerate the iterative convergence of linear systems with multiple right-hand sides A x = b (sup i), which are commonly encountered in steady or unsteady simulations of nonlinear equations. The algorithm is based on the classical GMRES algorithm with eigenvector enrichment but also includes a Galerkin projection preprocessing step and several novel Krylov subspace reuse strategies. The new approach is applied to a set of test problems, including an unsteady turbulent airfoil, and is shown in some cases to provide significant improvement in computational efficiency relative to baseline approaches.
Effects of evaporation/condensation on spreading and contact angle were experimentally studied. A sessile drop of R-113 was tested at different vapor environments to determine the effects of evaporation/condensation on the evolution of contact diameter and contact angle of the drop. Condensation on the drop surface occurs at both the saturated and a nonsaturated vapor environments and promotes the spreading. When the drop is placed in the saturated vapor environment it tends to completely wetting and spreads rapidly. In a nonsaturated vapor environment, the evolution of the sessile drop is divided three stages: condensation-spreading stage, evaporation-retracting stage and rapid contracting stage. In the first stage the drop behaves as in the saturated environment. In the evaporation -retracting stage, the competition between spreading and evaporation of the drop determines the evolution characteristics of the contact diameter and the contact angle. A lower evaporation rate struggles against the spreading power to turn the drop from spreading to retracting with a continuous increase of the contact angle. The drop placed in open air has a much higher evaporation rate. The strong evaporation suppresses the spreading and accelerates the retraction of the drop with a linear decrease of the contact diameter. The contraction of the evaporating drops is gradually accelerated when the contact diameter decreases to 3 min and less till drying up, though the evaporation rate is gradually slowing down.
Cardiovascular functions were studied in semi-arboreal rat snakes (Elaphe obsoleta) following long-term, intermittent exposure to +1.5 Gz (head-to-tail acceleration) on a centrifuge. Snakes were held in a nearly straight position within horizontal plastic tubes during periods of centrifugation. Centrifugal acceleration, therefore, subjected snakes to a linear force gradient with the maximal force being experienced at the tail. Compared to non-centrifuged controls, Gz-acclimated snakes showed greater increases of heart rate during head-up tilt or acceleration, greater sensitivity of arterial pressure to circulating catecholamines, higher blood levels of corticosterone, and higher blood ratios of prostaglandin F 2 alpha/prostaglandin E2. Cardiovascular tolerance to increased gravity during graded Gz acceleration was measured as the maximum (caudal) acceleration force at which carotid arterial blood flow became null. When such tolerances were adjusted for effects of body size and other continuous variables incorporated into an analysis of covariance, the difference between the adjusted mean values of control and acclimated snakes (2.37 and 2.84 Gz, respectively) corresponded closely to the 0.5 G difference between the acclimation G (1.5) and Earth gravity (1.0). As in other vertebrates, cardiovascular tolerance to Gz stress tended to be increased by acclimation, short body length, high arterial pressure, and comparatively large blood volume. Voluntary body movements were important for promoting carotid blood flow at the higher levels of Gz stress.
The phase of the translational linear VOR (LVOR) can be adaptively modified by exposure to a visual-vestibular mismatch. We extend here our earlier work on LVOR phase adaptation, and discuss the role of the oculomotor neural integrator. Ten subjects were oscillated laterally at 0.5 Hz, 0.3 g peak acceleration, while sitting upright on a linear sled. LVOR was assessed before and after adaptation with subjects tracking the remembered location of a target at 1 m in the dark. Phase and gain were measured by fitting sine waves to the desaccaded eye movements, and comparing sled and eye position. To adapt LVOR phase, the subject viewed a computer-generated stereoscopic visual display, at a virtual distance of 1 m, that moved so as to require either a phase lead or a phase lag of 53 deg. Adaptation lasted 20 min, during which subjects were oscillated at 0.5 Hz/0.3 g. Four of five subjects produced an adaptive change in the lag condition (range 4-45 deg), and each of five produced a change in the lead condition (range 19-56 deg), as requested. Changes in drift on eccentric gaze suggest that the oculomotor velocity-to-position integrator may be involved in the phase changes.
This project developed a higher-fidelity model of a recently envisioned small spacecraft propulsion system for precision pointing and proximity control. Plasmonic force propulsion harnesses solar light focused onto plasmon reactive subwavelength nanostructures to accelerate and expel nanoparticle propellant via strong optical forces. The goal of the project was to show that plasmonic space propulsion can provide the level of proximity and attitude control envisioned for future NASA nano/picosatellite missions, a level that is better than state-of-the-art approaches. We achieved this goal by showing that plasmonic force thrusters are feasible for a range of advanced mission concepts requiring swarm formations in a deep space environment. We performed three case studies that evaluated the performance of the plasmonic force propulsion thruster in a deep space, microsatellite swarm formation. These case studies assumed the propulsion system could generate thrust at the level predicted from our Phase 1 study (1.6 μN). Through these cases we were able to analyze the concept within a mission specific context through detailed orbital dynamics calculations. Results indicate that, with the Phase 1 estimated thrust level, the approach is promising for providing attitude control to swarm formation spacecraft. Further, we achieved goals related to technology development. Specifically, we experimentally demonstrated nanoparticle acceleration due to plasmonic forces with asymmetric nanostructures excited by focused laser light. Additionally, we investigated the thrust sensitivity and nanoparticle propellant injection dependencies upon thermal effects. As a result of our study, plasmonic force propulsion is at an early TRL 3. Active research and design has been conducted analytically and in the laboratory. Furthermore, practical applications such as the three case studies have been identified for the scientific basic principles that were observed. Future efforts related to fundamental understanding of these techniques should focus on 1) developing a standalone array of asymmetric nanostructures that can effectively interact with a stream or reservoir of particles or 2) experimentally evaluate a dielectrophoretic injector for nanoparticle propellant. The main limitation discovered about plasmonic propulsion regards performance estimates significantly below the Phase 1 estimations. Specifically, original assumptions in the Phase 1 project (notably, a linear array of asymmetric nanostructures) is not a viable approach to achieving significant acceleration, high exhaust velocity, of nanoparticles. More specifically, we assumed in Phase 1 that nanoparticles would be accelerated in series by a long linear array of asymmetric nanostructures. That is, the acceleration of the nanoparticle would build and increase with the kick received by each subsequent nanostructure. This is fundamentally flawed. The potential profile of a single nanostructure is such that it prohibits this phenomenon. The potential energy associated with the plasmon-generated dielectrophoretic force is a potential well, which is good for trapping nanoparticles, but cannot provide significant acceleration of particles to expel them out and away from the nanostructure. Further, a nanoparticle expelled from the first nanostructure would need to overcome the potential barrier for entry into the next nanostructure accelerating stage. Fundamentally, this effect means that a linear array of nanostructures is not a viable accelerating structure. Correspondingly then, acceleration can, or should, only be provided by one nanostructure, and the net acceleration and thrust force of a single nanostructure is small (~cm/s exhaust velocities, sub-nN level thrust vs. the 100’s m/s, μN originally envisioned). While our experiments demonstrated acceleration and manipulation of a nanoparticle using laser light in aqueous environment, the achievable energy and momentum addition to the nanoparticle from a single nanostructure stage is too low for useful propulsion. In terms of thrust prediction, the estimated thrust of 1.6 μN in Phase 1 is reduced to a few nN of thrust with this new insight and understanding of the concept. This thrust level is too small to achieve attitude control of swarms as originally envisioned.
Recursive forward dynamics algorithms are developed and presented for an arbitrary number of robot arms moving a commonly held object. The multiarm forward dynamics problem is to find the angular accelerations at the joints and the contact forces that the arms impart to the task object. The problem also involves finding the acceleration of this object. The multiarm forward dynamics solutions provide a thorough physical and mathematical understanding of the way several arms behave in response to a set of applied joint moments. Such an understanding simplifies and guides the subsequent control design and experimentation process. The forward dynamics algorithms also provide the necessary analytical foundation for conducting analysis and simulation studies. The multiarm algorithms are based on the filtering and smoothing approach recently advanced for single-arm dynamics, and they can be built up modularly from the single-arm algorithms. The algorithms compute recursively the joint angle accelerations, the contact forces, and the task-object accelerations. Algorithms are also developed to evaluate in closed form the linear transformations from the active joint moments to the joint angle accelerations, to the task object accelerations, and to the task-object contact forces. A possible computing architecture is presented as a precursor to a more complete investigation of the computational performance of the dynamics algorithms.
Two advanced reduced-basis methods for linear, transient structural analysis, the force-derivative method and the Lanczos method, are compared to two widely-used modal methods, the mode-displacement method and the mode-acceleration method. Comparisons are made for two linear example problems: a proportionally-damped cantilevered beam subject to a discrete tip load which varies linearly with time, and a discretely-damped multispan beam subject to a uniformly distributed load which varies as a quintic function of time. Results from the methods are compared in terms of the number of basis vectors required to obtain a desired level of accuracy and the associated computational times. The results are problem dependent, and it is shown that for the cantilevered beam problem, the mode-acceleration and force-derivative methods are the most efficient in terms of the number of basis vectors and computational time. The force-derivative method is shown to be the most effective method for solving the multispan beam problem with closely-spaced frequencies. In general, the force-derivative method is shown to produce an accurate solution using very few basis vectors and to require less computational time as compared to the other methods studied.
Investigations of the physical processes responsible for the acceleration of the solar wind were pursued with the development of two new solar wind codes: a hybrid code and a 2-D MHD code. Hybrid simulations were performed to investigate the interaction between ions and parallel propagating low frequency ion cyclotron waves in a homogeneous plasma. In a low-beta plasma such as the solar wind plasma in the inner corona, the proton thermal speed is much smaller than the Alfven speed. Vlasov linear theory predicts that protons are not in resonance with low frequency ion cyclotron waves. However, non-linear effect makes it possible that these waves can strongly heat and accelerate protons. This study has important implications for study of the corona and the solar wind. Low frequency ion cyclotron waves or Alfven waves are commonly observed in the solar wind. Until now, it is believed that these waves are not able to heat the solar wind plasma unless some cascading processes transfer the energy of these waves to high frequency part. However, this study shows that these waves may directly heat and accelerate protons non-linearly. This process may play an important role in the coronal heating and the solar wind acceleration, at least in some parameter space.
This article studies the relativistic theory of the motion of a particle in the presence of a uniform acceleration field. The problem is introduced as a linearization of the fundamental line element of general relativity. The linearized line element is a solution of Einstein's field equations. The equations of geodesics corresponding to this line element are solved and applied to the clock paradox problem.-
Recursive forward dynamics algorithms are developed for an arbitrary number of robot arms moving a commonly held object. The multiarm forward dynamics problem is to find the angular accelerations at the joints and the contact forces that the arms impart to the task object. The problem also involves finding the acceleration of this object. The multiarm forward dynamics solutions provide a thorough physical and mathematical understanding of the way several arms behave in response to a set of applied joint moments. Such an understanding simplifies and guides the subsequent control design and experimentation process. The forward dynamics algorithms also provide the necessary analytical foundation for conducting analysis and simulation studies. The multiarm algorithms are based on the filtering and smoothing approach recently advanced for single-arm dynamics, and they can be built up modularly from the single-arm algorithms. The algorithms compute recursively the joint-angle accelerations, the contact forces, and the task-object accelerations. Algorithms are also developed to evaluate in closed form the linear transformations from the active joint moments to the joint-angle accelerations, to the task-object accelerations., and to the task-object contact forces. A possible computing architecture is presented as a precursor to a more complete investigation of the computational performance of the dynamics algorithms.
This paper presents results from numerical simulations as well as laboratory experiments of buoyancy driven convection in an ampoule under varying heating and gravitational acceleration loadings. The modeling effort in this work resolves the large scale natural convective motion that occurs in the fluid during photodeposition of polydiacetelene films which is due to energy absorbed by the growth solution from a UV source. Consequently, the growth kinetics of the film are ignored in the model discussed here, and also a much simplified ampoule geometry is considered. The objective of this work is to validate the numerical prediction on the strength and structure of buoyancy driven convection that could occur under terrestrial conditions during nonlinear optical film growth. The validation is used to enable a reliable predictive capability on the nature and strength of the convective motion under low gravity conditions. The ampoule geometry is in the form of a parallelepiped with rectangular faces. The numerical results obtained from the solution to the Boussinesq equations show that natural convection will occur regardless of the orientation of the UV source with respect to the gravity vector. The least strong convective motion occurred with the UV beam directed at the top face of the parallelepiped. The strength of the convective motion was found to be almost linearly proportional to the total power of the UV source. Also, it was found that the strength of the convective motion decreased linearly with the gravity due to acceleration. The pattern of the convective flow on the other hand, depended on the source location.
Most active vibration isolation systems that try to a provide quiescent acceleration environment for space science experiments have utilized linear design methods. In this paper, we address adaptive control augmentation of an existing classical controller that employs a high-gain acceleration feedback together with a low-gain position feedback to center the isolated platform. The control design feature includes parametric and dynamic uncertainties because the hardware of the isolation system is built as a payload-level isolator, and the acceleration Sensor exhibits a significant bias. A neural network is incorporated to adaptively compensate for the system uncertainties, and a high-pass filter is introduced to mitigate the effect of the measurement bias. Simulations show that the adaptive control improves the performance of the existing acceleration controller and keep the level of the isolated platform deviation to that of the existing control system.