SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

NASA NTRS1985

Stochastic response analysis, order reduction, and output feedback controllers for flexible spacecraft

Real disturbances and real sensors have finite bandwidths. The first objective of this paper is to incorporate this finiteness in the 'open-loop modal cost analysis' as applied to a flexible spacecraft. Analysis based on residue calculus shows that among other factors, significance of a mode depends on the power spectral density of disturbances and the response spectral density of sensors at the modal frequency. The second objective of this article is to compare performances of an optimal and a suboptimal output feedback controller, the latter based on 'minimum error excitation' of Kosut. Both the performances are found to be nearly the same, leading us to favor the latter technique because it entails only linear computations. Our final objective is to detect an instability due to truncated modes by representing them as a multiplicative and an additive perturbation in a nominal transfer function. In an example problem it is found that this procedure leads to a narrow range of permissible controller gains, and that it labels a wrong mode as a cause of instability. A free beam is used to illustrate the analysis in this work.

Hablani, H. B.↗

DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗

NASA NTRS1974

Approximations to and local properties of diffusions with discontinuous controls

The paper discusses several properties of control systems defined by stochastic differential equations, which are defined by the method of Girsanov, using a transformation of measures, and where the controls are discontinuous. Uniqueness of the multivariate distributions of the process is proved, and it is shown that the process is a limit, in a natural sense, of a certain discrete time approximation. Other questions, concerning the effects on the distributions of the paths, and of the cost of approximating the control by a smooth control and concerning local properties of the solution, are discussed.

Kushner, H. J.↗

NASA NTRS1977

Optimal fine pointing control of a large space telescope using an Annular Momentum Control Device

This paper discusses the application of an Annular Momentum Control Device (AMCD) to fine pointing control of a large space telescope (LST). The AMCD represents a new development in the field of momentum storage devices. A linearized mathematical model is developed for the AMCD/LST system, including the magnetic suspension actuators. Two approaches to control system design are considered. The first approach uses a stochastic linear-quadratic Gaussian controller which utilizes feedback of all states. The second approach considers a more practical control system design in which the axial and radial loops are designed independently.

Nadkarni, A. A.↗

DOE OSTI2025

A Predictive Deep-Reinforcement-Learning-Based Connected Automated Vehicle Anticipatory Longitudinal Control in a Mixed Traffic Lane Change Condition

Maintaining safety and efficiency for mixed traffic consisting of connected automated vehicles (CAVs) and human-driven vehicles (HDVs) is an arduous task due to the inherent HDVs’ stochasticity. Especially for longitudinal control, which is the basic function of vehicle automation, prevailing research primarily considers CAV’s car-following control merely the acceleration and deceleration of leading vehicles. However, this approach overlooks the potential disruptions caused by surrounding vehicles executing lane changes, which can significantly impact the control vehicle’s stability and overall safety. Hence, our study introduces a predictive deep reinforcement learning (DRL) longitudinal CAV controller. This innovative approach leverages prediction from a physics-informed neural network as well as the control capability of DRL to better anticipate and mitigate issues arising from lane-changing, enhancing the safety and efficiency of CAVs in such scenarios. Finally, validated by the numerical simulations embedded with the real-world data, the results indicate that the proposed controller significantly enhances the safety and efficiency of CAVs in situations involving lane changes by other vehicles, showcasing its potential as a valuable tool in advancing CAV technology in mixed traffic.

33 ADVANCED PROPULSION SYSTEMS↗

NASA NTRS1979

VTOL controls for shipboard landing

The problem of landing a VTOL aircraft on a small ship in rough seas using an automatic controller is examined. The controller design uses the linear quadratic Gaussian results of modern control theory. Linear time invariant dynamic models are developed for the aircraft, ship, and wave motions. A hover controller commands the aircraft to track position and orientation of the ship deck using only low levels of control power. Commands for this task are generated by the solution of the steady state linear quadratic gaussian regulator problem. Analytical performance and control requirement tradeoffs are obtained. A landing controller commands the aircraft from stationary hover along a smooth, low control effort trajectory, to a touchdown on a predicted crest of ship motion. The design problem is formulated and solved as an approximate finite-time linear quadratic stochastic regulator. Performance and control results are found by Monte Carlo simulations.

Mcmuldroch, C. G.↗

NASA NTRS1995

The effects of spaceflight on open-loop and closed-loop postural control mechanisms: human neurovestibular studies on SLS-2

Stabilogram-diffusion analysis was used to examine how prolonged periods in microgravity affect the open-loop and closed-loop postural control mechanisms. It was hypothesized that following spaceflight: (1) the effective stochastic activity of the open-loop postural control schemes in astronauts is increased; (2) the effective stochastic activity and uncorrelated behavior, respectively, of the closed-loop postural control mechanisms in astronauts are increased; and (3) astronauts utilized open-loop postural controls schemes for shorter time intervals and smaller displacements. Four crew members and two alternates from the 14-day Spacelab Life Sciences 2 Mission were included in the study. Each subject was tested under eyes-open, quiet-standing conditions on multiple preflight and postflight days. The subjects' center-of-pressure trajectories were measured with a force platform and analyzed according to stabilogram-diffusion analysis. It was found that the effective stochastic activity of the open-loop postural control schemes in three of the four crew members was increased following spaceflight. This result is interpreted as an indication that there may be in-flight adaptations to higher-level descending postural control pathways, e.g., a postflight increase in the tonic activation of postural muscles. This change may also be the consequence of a compensatory (e.g., "stiffening") postural control strategy that is adopted by astronauts to account for general feeling of postflight unsteadiness. The crew members, as a group, did not exhibit any consistent preflight/postflight differences in the steady-state behavior of their closed-loop postural control mechanisms or in the functional interaction of their open-loop and closed-loop postural control mechanisms. These results are interpreted as indications that although there may be in-flight adaptations to the vestibular system and/or proprioceptive system, input from the visual system can compensate for such changes during undisturbed stance.

NASA Program Flight↗

NASA NTRS1990

Stochastic Robustness: Towards a Comprehensive Robustness Tool

Stochastic robustness is a simple technique to determine the robustness of linear, time-invariant systems by Monte Carlo methods. Stochastic stability robustness has been described previously. Those results are extended here to provide insight into control system design for performance. Together, stochastic stability and performance robustness concepts constitute a comprehensive tool that can be used to analyze control system robustness properties. As well, they offer control system design insight that can set the stage for stochastic robustness synthesis. The concept of stochastic stability robustness is reviewed, stochastic performance robustness is introduced, and stochastic robustness synthesis is described qualitatively. Confidence intervals necessary for comparing control laws statistically are presented.

Ray, Laurie Ryan↗

NASA NTRS1985

Application of the Maximum Entropy/optimal Projection Control Design Approach for Large Space Structures

The underlying philosophy and motivation of the optimal projection/maximum entropy (OP/ME) stochastic modelling and reduced order control design method for high order systems with parameter uncertainties are discussed. The OP/ME design equations for reduced-order dynamic compensation including the effect of parameter uncertainties are reviewed and the application of the methodology to several large space structure (LSS) problems of representative complexity is illustrated.

Hyland, D. C.↗

DOE OSTI2026

Noise-canceling quantum feedback: Non-Hermitian dynamics with applications to state preparation and magic state distillation

Time-continuous quantum measurement allows for the tracking of a quantum system in real time via sequences of short, and individually weak, measurement intervals. Such measurements are necessarily invasive, imparting backaction to the system, and allowing the observer to update their state estimate based on stochastic measurement outcomes. Feedback control then involves real-time interventions by an observer, conditioned on the time-continuous measurement signal that they receive. Here, we consider here diffusive quantum trajectories and focus on the “noise-canceling” subset of feedback protocols that aim to minimize the degree of stochasticity in the dynamics. We derive such a class of feedback operations, showing that under the idealized assumptions of pure states, unit measurement efficiency, and zero time delay in implementing feedback operations, perfectly noise-canceling feedback always exists. We consider the resulting noise-canceled dynamics generated by an effective non-Hermitian Hamiltonian; while non-Hermitian Hamiltonians from continuous monitoring generally describe rare dynamics (accessible by costly postselection), the use of noise-canceling feedback here leads to non-Hermitian dynamics that occur deterministically. We demonstrate this via examples of entangled state preparation and stabilization. We then illustrate the potential for the application of noise cancellation to boost success rates in magic state distillation protocols. We show that adding feedback based on noise cancellation into a time-continuous five-to-one distillation protocol leads to higher probabilities of successful distillation across a range of input errors and increases the threshold on input errors for which the protocol is effective. Our results highlight the efficacy of noise-canceling feedback-aided protocols for quantum state preparation and stabilization tasks.

Karmakar, Tathagata [University of California, Ber↗

NASA NTRS1976

Optimal maneuvering and fine pointing control of large space telescope with a new magnetically suspended, single gimballed momentum storage device

This paper considers the application of an Annular Momentum Control Device (AMCD) to both fine pointing and large-angle maneuvering of a large space telescope (LST). The AMCD, which consists principally of a spinning rim suspended in noncontacting electromagnetic bearings, represents a new development in momentum storage devices. A nonlinear mathematical model of the AMCD/LST system is derived. An optimal stochastic fine-pointing controller is designed via LQG theory and the minimum-energy maneuvering problem is solved via a gradient technique. Number of state variable and control variable constraints, as well as all trigonometric nonlinearities, are considered in the latter part.

Nadkarni, A. A.↗

NASA NTRS2003

Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control

An indirect adaptive system has been constructed for robust control of an aircraft with uncertain aerodynamic characteristics. This system consists of a multilayer perceptron pre-trained neural network, online stability and control derivative identification, a dynamic cell structure online learning neural network, and a model following control system based on the stochastic optimal feedforward and feedback technique. The pre-trained neural network and model following control system have been flight-tested, but the online parameter identification and online learning neural network are new additions used for in-flight adaptation of the control system model. A description of the modification and integration of these two stand-alone software packages into the complete system in preparation for initial flight tests is presented. Open-loop results using both simulation and flight data, as well as closed-loop performance of the complete system in a nonlinear, six-degree-of-freedom, flight validated simulation, are analyzed. Results show that this online learning system, in contrast to the nonlearning system, has the ability to adapt to changes in aerodynamic characteristics in a real-time, closed-loop, piloted simulation, resulting in improved flying qualities.

Hageman, Jacob↗

NASA NTRS2003

Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control

Hageman, Jacob J.↗

NASA NTRS1991

Generalized covariance analysis for partially autonomous deep space missions

A new covariance analysis method is presented that is suitable for the evaluation of multiple impulsive controllers acting on some stochastic process x. The method accommodates batch and sequential estimators with equal ease and accounts for time-delay effects in a natural manner. The formalism is developed in terms of a generalized state vector that is formed from the system state vector x, augmented by various fixed epoch estimates, and a data vector formed from discrete time observations of the system. Recursions are developed for time transition, measurement incorporation, and impulsive control updating of the generalized covariance matrix. Means of limiting the dimensional growth of the generalized state vector via the processes of estimator epoch adjustment and measurement vector deflation are described and the application of numerically stable matrix factorization methods to the generalized covariance recursions is outlined. The method is applied to the Magellan spacecraft to demonstrate the capability of ground-based optimal estimation and control of gyro/star scanner misalignment.

Boone, Jack N.↗

NASA NTRS1975

Status of dual control theory

Theoretical studies of decision making and stochastic processes are discussed. Several approaches are described for an improved performing control method. It is shown that control performance is highly dependent on the knowledge of the unknown parameters in the system.

Tse, E.↗

NASA NTRS1994

State-space self-tuner for on-line adaptive control

Dynamic systems, such as flight vehicles, satellites and space stations, operating in real environments, constantly face parameter and/or structural variations owing to nonlinear behavior of actuators, failure of sensors, changes in operating conditions, disturbances acting on the system, etc. In the past three decades, adaptive control has been shown to be effective in dealing with dynamic systems in the presence of parameter uncertainties, structural perturbations, random disturbances and environmental variations. Among the existing adaptive control methodologies, the state-space self-tuning control methods, initially proposed by us, are shown to be effective in designing advanced adaptive controllers for multivariable systems. In our approaches, we have embedded the standard Kalman state-estimation algorithm into an online parameter estimation algorithm. Thus, the advanced state-feedback controllers can be easily established for digital adaptive control of continuous-time stochastic multivariable systems. A state-space self-tuner for a general multivariable stochastic system has been developed and successfully applied to the space station for on-line adaptive control. Also, a technique for multistage design of an optimal momentum management controller for the space station has been developed and reported in. Moreover, we have successfully developed various digital redesign techniques which can convert a continuous-time controller to an equivalent digital controller. As a result, the expensive and unreliable continuous-time controller can be implemented using low-cost and high performance microprocessors. Recently, we have developed a new hybrid state-space self tuner using a new dual-rate sampling scheme for on-line adaptive control of continuous-time uncertain systems.

Shieh, L. S.↗

DOE OSTI2025

PowderJet: Spherical metal powder production via multi-orifice droplet-on-demand metal jetting

Leading metal additive manufacturing techniques, such as laser powder bed fusion and directed energy deposition, rely on high-quality spherical metal powders. However, traditional powder production methods like gas atomization face limitations, including low in-spec yield, asphericity, and internal porosity. We introduce PowderJet, a powder production platform that uses electromagnetic pulses to eject liquid metal droplets from a multi-orifice nozzle. Unlike stochastic methods, PowderJet tightly controls powder size, distribution, and purity through a droplet-on-demand approach. We detail the system’s design, operation, and performance using a combined experimental and computational fluid dynamics (CFD) framework. Initial results with Al4008 and Cu110 alloys demonstrate successful production, yielding unsieved aluminum powder batches with a mean diameter of 200 µm and a narrow size distribution (15 µm standard deviation). The produced powders are highly spherical, achieving a roundness > 0.95. PowderJet operates with a small melt volume (3 mL) and supports continuous refilling, enabling production rates between 30 and 140 cm³/hr depending on jetting frequency, number of orifices and particle size. CFD simulations show that future systems could achieve rates exceeding 1000 cm³/hr for particle sizes as small as 40 µm. PowderJet’s high yield of in-spec powder makes it ideal for producing precious or hazardous materials that are inefficient to manufacture using conventional methods. This platform offers a scalable, precise, and efficient solution for producing high-quality powders tailored for advanced manufacturing applications.

Atomization↗

DOE OSTI2023

Vibrational heat-bath configuration interaction with semistochastic perturbation theory using harmonic oscillator or VSCF modals

Vibrational heat-bath configuration interaction (VHCI)—a selected configuration interaction technique for vibrational structure theory—has recently been developed in two independent works [J. H. Fetherolf and T. C. Berkelbach, J. Chem. Phys. 154, 074104 (2021); A. U. Bhatty and K. R. Brorsen, Mol. Phys. 119, e1936250 (2021)], where it was shown to provide accuracy on par with the most accurate vibrational structure methods with a low computational cost. Here, we eliminate the memory bottleneck of the second-order perturbation theory correction using the same (semi)stochastic approach developed previously for electronic structure theory. This allows us to treat, in an unbiased manner, much larger perturbative spaces, which are necessary for high accuracy in large systems. Stochastic errors are easily controlled to be less than 1 cm−1. We also report two other developments: (i) we propose a new heat-bath criterion and an associated exact implicit sorting algorithm for potential energy surfaces expressible as a sum of products of one-dimensional potentials; (ii) we formulate VHCI to use a vibrational self-consistent field (VSCF) reference, as opposed to the harmonic oscillator reference configuration used in previous reports. Our tests are done with quartic and sextic force fields, for which we find that with VSCF, the minor improvements to accuracy are outweighed by the higher computational cost associated the matrix element evaluations. We expect VSCF-based VHCI to be important for more general potential representations, for which the harmonic oscillator basis function integrals are no longer analytic.

Chemistry↗