Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Indirect Identification of Linear Stochastic Systems with Known Feedback Dynamics

An algorithm is presented for identifying a state-space model of linear stochastic systems operating under known feedback controller. In this algorithm, only the reference input and output of closed-loop data are required. No feedback signal needs to be recorded. The overall closed-loop system dynamics is first identified. Then a recursive formulation is derived to compute the open-loop plant dynamics from the identified closed-loop system dynamics and known feedback controller dynamics. The controller can be a dynamic or constant-gain full-state feedback controller. Numerical simulations and test data of a highly unstable large-gap magnetic suspension system are presented to demonstrate the feasibility of this indirect identification method.

Huang, Jen-Kuang↗
DOE OSTI2021

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and which depend on a vector-valued random control parameter. The cost of a single numerical evaluation of this SCM is assumed to be such that only a limited number of points can be computed for constructing the training dataset (small data). Each point of the training dataset is made up of realizations from a vector-valued stochastic process (the stochastic solution) and the associated random control parameter on which it depends. The presented PLoM constrained by PDE allows for generating a large number of learned realizations of the stochastic process and its corresponding random control parameter. These learned realizations are generated so as to minimize the vector-valued random residual of the PDE in the mean-square sense. Appropriate novel methods are developed to solve this challenging problem. Three applications are presented. The first one is a simple uncertain nonlinear dynamical system with a nonstationary stochastic excitation. The second one concerns the 2D nonlinear unsteady Navier–Stokes equations for incompressible flows in which the Reynolds number is the random control parameter. Here, the last one deals with the nonlinear dynamics of a 3D elastic structure with uncertainties. The results obtained make it possible to validate the PLoM constrained by stochastic PDE but also provide further validation of the PLoM without constraint.

Machine learning↗
DOE OSTI2025

Voltage Probability Density Function Shaping Control Strategy Considering Grid Operational Uncertainties

It is well-known that power systems operation always affected by various uncertainties which make the bus voltage a random process that can be characterized by its probability density function (PDF) at any time instant. In this context, this paper presents a novel PDF-based voltage control framework for power systems. By modeling voltage as a stochastic process, we formulate a stochastic differential equationthat captures grid uncertainties. The associated Fokker-Planck-Kolmogorov equation is derived to describe the evolution of the voltage PDF, which enables the formulation of a PDF-shaping control strategy. To simplify the PDF control formulation, a B-spline neural network is introduced for real-time estimation and regulation of the voltage distribution. The proposed PDF control law updates voltage references for energy storage systems and synchronous generators using real-time PDF measurements and feedback signals. The proposed method is validated on a modified Kundur’s two-area system. Simulation results demonstrate that the controller can significantly improve the voltage stability under stochastic conditions, highlighting its effectiveness in modern inverter-rich grids.

Gui, Yonghao [ORNL] (ORCID:0000000250435534)↗
DOE OSTI2021

Occupancy-Driven Stochastic Decision Framework for Ranking Commercial Building Loads

For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criteria, ranging from the added value to occupants' comfort to the quality of the grid services. In this paper, we present a data-driven stochastic decision-support framework to dynamically rank load control alternatives in a commercial building, addressing the needs of multiple decision criteria (e.g. occupant comfort, grid service quality) under uncertainties in occupancy patterns. We adopt a stochastic multi-criteria decision algorithm recently applied to prioritize residential on/off loads, and extend it to i) consider complex load control decisions (e.g. dimming of lights, changing zone temperature set-points) in a commercial building; and ii) systematically integrate zonal occupancy patterns to better identify short-term (and time-varying) opportunities for grid service participation. We evaluate the performance of the proposed framework for curtailment of air-conditioning, lighting, and plug-loads in a multi-zone commercial office building for a range of design choices. With the help of a prototype system that integrates an interactive \textit{Data Analytics and Visualization} frontend we demonstrate a way for the building operators to monitor and change in real-time the available flexibility in energy consumption and to develop trust in the decision recommendations by interpreting the rationale behind the ranking.

Jain, Milan↗
NASA NTRS1981

Pulse control of single degree-of-freedom system

The possibility of using active control for structural and mechanical systems is examined. Open loop adaptive control of structural systems subjected to deterministic and stochastic excitations is considered by means of an algorithm for a single-degree-of-freedom oscillator. The algorithm is heuristic and requires continuous monitoring of the state variables, with a pulse control applied when some prespecified level of control is exceeded. The control algorithm is based on the principle that the gradual rhythmic increase of the structural response can be eliminated by applying a pulse of suitable magnitude in the proper direction, thereby avoiding the application of large forces over sustained periods of time. The optimum pulse magnitude is determined as the minimum rms response of the system. Application to linear and nonlinear systems, as well as in chatter suppression, are outlined.

Udwadia, F. E.↗
NASA NTRS1989

Flutter suppression control law synthesis for the Active Flexible Wing model

The Active Flexible Wing Project is a collaborative effort between the NASA Langley Research Center and Rockwell International. The objectives are the validation of methodologies associated with mathematical modeling, flutter suppression control law development and digital implementation of the control system for application to flexible aircraft. A flutter suppression control law synthesis for this project is described. The state-space mathematical model used for the synthesis included ten flexible modes, four control surface modes and rational function approximation of the doublet-lattice unsteady aerodynamics. The design steps involved developing the full-order optimal control laws, reducing the order of the control law, and optimizing the reduced-order control law in both the continuous and the discrete domains to minimize stochastic response. System robustness was improved using singular value constraints. An 8th order robust control law was designed to increase the symmetric flutter dynamic pressure by 100 percent. Preliminary results are provided and experiences gained are discussed.

Mukhopadhyay, Vivek↗
NASA NTRS1989

Flutter suppression control law synthesis for the active flexible wing model

The Active Flexible Wing Project is a collaborative effort between the NASA Langley Research Center and Rockwell International. The objectives are the validation of methodologies associated with mathematical modeling, flutter suppression control law development and digital implementation of the control system for application to flexible aircraft. A flutter suppression control law synthesis for this project is described. The state-space mathematical model used for the synthesis included ten flexible modes, four control surface modes and rational function approximation of the doublet-lattice unsteady aerodynamics. The design steps involved developing the full-order optimal control laws, reducing the order of the control law, and optimizing the reduced-order control law in both the continuous and the discrete domains to minimize stochastic response. System robustness was improved using singular value constraints. An 8th order robust control law was designed to increase the symmetric flutter dynamic pressure by 100 percent. Preliminary results are provided and experiences gained are discussed.

Mukhopadhyay, Vivek↗
NASA NTRS1991

Hybrid state-space self-tuning control using dual-rate sampling

This paper presents a hybrid state-space self-tuning control scheme using dual-rate sampling for suboptimal digital adaptive control of linear time-invariant continuous-time multivariable stochastic systems with unknown parameters. An equivalent fast-rate discrete-time state-space innovation model (with estimated states) of the continuous-time system is constructed by using the estimated system parameters and Kalman gain. To utilize the existing optimal regional-pole assignment method developed in the continuous-time domain, the constructed fast-rate discrete-time model is converted into an equivalent continuous-time model for the development of a state-feedback optimal control law with pole placement in a specific region. The developed analog optimal control law is then converted into an equivalent pseudo-slow-rate digital control law via the proposed digital redesign technique, which can be realized via slow-rate digital electronics. The proposed method enables the development of a digitally implementable advanced control algorithm for digital adaptive control of continuous-time multivariable stochastic systems which may be unstable and/or have nonminimum phase.

Shieh, Leang S.↗
DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗
DOE OSTI2025

Uncertainty quantification and sensitivity analysis of a nuclear thermal propulsion reactor startup sequence

The research presented in this article describes progress in applying stochastic methods, uncertainty quantification, parametric studies, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated via the radiation transport code Griffin to simulate neutronics. Our goal is to develop a reduced-order (surrogate) model that can be rapidly sampled with perturbations to multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums (CDs), which is itself controlled by a hybrid proportional-integral-derivative (PID) controller actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time [Λ] and effective delayed neutron fraction [ β eff ] from a transient Griffin simulation executed via Griffin’s improved quasi-static solver to provide the kinetic parameters) as inputs to functions that control the CD rotation angle. By investigating numerous stochastic approaches, we developed a dual-purpose surrogate model of the NTP system, using polynomial regression in the Multiphysics Object-Oriented Simulation Environment (MOOSE) Stochastic Tools Module (STM). The trained model can be rapidly sampled while simultaneously perturbing various input parameters, such as coefficients on the PID control or temperature (directly affecting the neutron cross section). The surrogate model delivers accurate (within 5%) results at speeds orders of magnitude faster (minutes, not days of computational time) than the base model. Once the surrogate model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs as well as the effects of these inputs on the model output. For example, coefficients used in the PID control system may vary due to some type of physical interference, or uncertainty may exist in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters, and operational boundaries can be determined. The goal of this work is to support development of an advanced control system for operating CDs in a functioning NTP system. This work is a scoping study of the MOOSE STM.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Non-Nuclear Advanced Controls Testbed Reactor Mockup

The research presented in this report describes our progress in applying stochastic methods and uncertainty quantification, parametric study, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated with Griffin, with the goal of developing a reduced order (surrogate) model which can be rapidly sampled while perturbing multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums, which are controlled by a hybrid proportional, integral and derivative (PID) controller, actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time and $\beta$ from a transient Griffin simulation executed with the improved quasi-static method to provide the kinetic parameters) as inputs to functions which control the CD rotation angle. Using a number of stochastic method approaches, we developed a dual purpose training-surrogate model of the NTP system using polynomial regression. The trained model can be rapidly sampled while simultaneously perturbing various input parameters of the model, such as coefficients on the PID control, or temperature (directly affect the neutron cross section). The surrogate model delivers accurate results orders-of-magnitude faster (minutes, not days) than the base model. Once the base model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs and their effect on the output. For example, coefficients used in the PID control system may vary due to some physical interference, or there may be uncertainty in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters and operational boundaries can be determined. The goal of this work is to support development of an advanced control system to operate CDs in a functioning NTP system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Shape‐Dependent Multi‐Weight Magnetic Artificial Synapses for Neuromorphic Computing

Abstract In neuromorphic computing, artificial synapses provide a multi‐weight (MW) conductance state that is set based on inputs from neurons, analogous to the brain. Herein, artificial synapses based on magnetic materials that use a magnetic tunnel junction (MTJ) and a magnetic domain wall (DW) are explored. By fabricating lithographic notches in a DW track underneath a single MTJ, 3–5 stable resistance states that can be repeatably controlled electrically using spin‐orbit torque are achieved. The effect of geometry on the synapse behavior is explored, showing that a trapezoidal device has asymmetric weight updates with high controllability, while a rectangular device has higher stochasticity, but with stable resistance levels. The device data is input into neuromorphic computing simulators to show the usefulness of application‐specific synaptic functions. Implementing an artificial neural network (NN) applied to streamed Fashion‐MNIST data, the trapezoidal magnetic synapse can be used as a metaplastic function for efficient online learning. Implementing a convolutional NN for CIFAR‐100 image recognition, the rectangular magnetic synapse achieves near‐ideal inference accuracy, due to the stability of its resistance levels. This work shows MW magnetic synapses are a feasible technology for neuromorphic computing and provides design guidelines for emerging artificial synapse technologies.

Leonard, Thomas↗
DOE OSTI2020

Synchrotron CT imaging of lattice structures with engineered defects

Understanding mechanical failure, crack propagation, and compressive behavior at the micrometer scale is essential for tailoring material properties for structural performance in cellular materials. Typically, modeling of traditional polymer foam materials is clouded by the lack of control in material morphology and its inherent stochastic structure. Additive manufacturing with sub-micrometer resolution provides a direct path for experimenters to specifically tailor structures needed by modelers to explicitly probe mechanical performance. Using laboratory-based 3D X-ray computed tomographic imaging (CT), the examination of deformation and damage provides a critical path to understand how these soft materials behave. Additionally, synchrotron CT yields realistic information at higher strain rates to directly validate the robustness of our finite element modeling. For this study, nanolithographic printing was employed to generate a series of engineered lattices with increasing levels of defects through the random removal of ligaments. These structures were mechanically tested and imaged with laboratory-based microCT. Additionally, synchrotron experiments were conducted in which the structures were imaged in 3D at 14 Hz during compression at a 0.4 s –1 strain rate. These 3D images show the changes in the structure as the ligaments bend, buckle and fracture in real time. This technique provides a robust framework for developing our methodologies and future exploration of engineered structures.

36 MATERIALS SCIENCE↗
NASA NTRS1974

N-Player Stochastic Differential Games

Conditions are described which guarantee that the control strategies adopted by N players constitute an efficient solution, an equilibrium, or a core solution. The system dynamics are described by an Ito equation, and all players have perfect information. It was found that when the set of instantaneous joint costs and velocity vectors is convex, the conditions are necessary.

Varaiya, P.↗
NASA NTRS1978

Specific-optimal control with a dual minimal-order observer-based compensator

The steady-state optimal control of a linear time-invariant stochastic system by means of a minimal-order dual-observer-based compensator is considered in this paper. The structure of the compensator is fixed while the associated gains are to be chosen so as to minimize a quadratic penalty on the plant state. Necessary and sufficient conditions for optimality are given, and an explicit solution is displayed. Salient features pertaining to the optimal system are: a decoupling property, a projection property, and an innovation property. Finally, it is shown that this design corresponds to a singular LQG problem, which is precisely the dual of another singular LQG problem: namely Newmann's problem. A complete picture is then given showing clearly the correspondence between the two designs.

Blanvillain, P. J.↗