Application of imperfect, reduced-state relay control to model-reference systems
Imperfect, reduced-state relay control application to model-refference controller design
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Imperfect, reduced-state relay control application to model-refference controller design
Accurate knowledge of the distribution system topology and parameters is required to achieve good voltage control performance, but this is difficult to obtain in practice. This paper proposes a physical-model-free voltage control method based on a surrogate-model-enabled deep reinforcement learning approach. Specifically, a surrogate model is trained in a supervised manner using the recorded limited number of historical data to learn the relationship between the power injections and voltage fluctuations of each node. Then, the deep reinforcement learning algorithm is applied to learn an optimal control strategy from the experiences obtained by continuous interactions with the surrogate model. The proposed method can achieve physical-model-free control of unbalanced distribution network and inform real-time decisions to deal with fast voltage fluctuations caused by the rapid variation of PV generation. Simulation results on an unbalance IEEE 123-bus system show that the proposed method can achieve similar performance as that of perfect physical-model-based approaches while being advantageous over other traditional methods.
Random variables to use in modeling manual control performance
Purpose: To investigate the hazards in cervical-cancer HDR brachytherapy using a novel hazard-analysis technique, System Theoretic Process Analysis (STPA). The applicability and benefit of STPA to the field of radiation oncology is demonstrated. Methods: We analyzed the tandem and ring HDR procedure through observations, discussions with physicists and physicians, and the use of a previously developed process map. Controllers and their respective control actions were identified and arranged into a hierarchical control model of the system, modeling the workflow from applicator insertion through initiating treatment delivery. We then used the STPA process to identify potentially unsafe control actions. Scenarios were then generated from the identified unsafe control actions and used to develop recommendations for system safety constraints. Results: 10 controllers were identified and included in the final model. From these controllers 32 potentially unsafe control actions were identified, leading to more than 120 potential accident scenarios, including both clinical errors (e.g., using outdated imaging studies for planning), and managerial-based incidents (e.g., unsafe equipment, budget, or staffing decisions). Constraints identified from those scenarios include common themes, such as the need for appropriate feedback to give the controllers an adequate mental model to maintain safe boundaries of operations. As an example, one finding was that the likelihood of the potential accident scenario of the applicator breaking during insertion might be reduced by establishing a feedback loop of equipment-usage metrics and equipment-failure reports to the management controller. Conclusion: The utility of STPA in analyzing system hazards in a clinical brachytherapy system was demonstrated. This technique, rooted in system theory, identified scenarios both technical/clinical and managerial in nature. These results suggest that STPA can be successfully used to analyze safety in brachytherapy and may prove to be an alternative to other hazard analysis techniques.
Modeling and control software that integrates the complexities of solar array models, a space environment, and an electric propulsion system into a rigid body vehicle simulation and control model is provided. A rigid body vehicle simulation of a solar electric propulsion (SEP) vehicle may be created using at least one solar array model, at least one model of a space environment, and at least one model of a SEP propulsion system. Power availability and thrust profiles may be determined based on the rigid body vehicle simulation as the SEP vehicle transitions from a low Earth orbit (LEO) to a higher orbit or trajectory. The power availability and thrust profiles may be displayed such that a user can use the displayed power availability and thrust profiles to determine design parameters for an SEP vehicle mission.
Increased electricity consumption combined with new forms of generation is testing the reliability of our grid infrastructure. This work describes a method to improve the reliability of the grid through large-scale advanced building control. This paper develops a bi-level distributed control framework to shift the load of 153 buildings to achieve a system-level objective of tracking a power reference signal. This bi-level control is based on the previously-developed ANPV-MPC, a predictive controller that uses a Bayesian neural network to generate an accurate control model and adapt to changing conditions over time. By shifting the building electricity demand to better match the available power, the grid system supplying the buildings is more reliable as evidenced by the analysis of node voltages across an IEEE 13-bus distribution system. The proposed bi-level control framework tracks the system-level power reference with enough accuracy to regulate node voltages across the IEEE 13-bus distribution system within ANSI limits of ±5%. Additionally, the adaptive nature of ANPV-MPC allows each building across the system to adapt to changing conditions, further amplifying the system-level reliability.
This paper addresses some modeling and control issues for a mixing chamber used in rocket engine testing at NASA Stennis Space Center. The mixer must combine high pressure liquid hydrogen (LH2) and gaseous hydrogen (GH2) to produce and output flow that meets certain thermodynamic properties before it is fed into a test article. More precisely, this paper considers that the quantities to be tracked and/or regulated are mixer internal pressure, exit mass flow, and exit temperature. The available control inputs are given by three value positions, namely those of the GH2, LH2 and exit valves. The mixer is modelled by a system of two nonlinear ordinary differential equations having density and internal energy as states. The model must be simple enough to lend itself to subsequent feedback controller design, yet its accuracy must be tested against real data. For this reason, the model includes function calls to thermodynamic property data. Some structural properties of the resulting model that pertain to controller design, such as controllability and uniqueness of the equilibrium point are shown to hold. Validation of the model against real data is also provided. As a first control approach, a small-signal (linear) model is developed based on the nonlinear model and simulated as well. Pulse disturbances are introduced to the valve positions and the quality of the linear model is ascertained by comparing its behavior against the nonlinear model simulations. Valve control strategies that simulate an operator-in-the-loop scenario are then explored demonstrating the need for automatic feedback control. Classical optimal single-output and multi-output Proportional/Integral controllers are designed based on the linear model and applied to the nonlinear model with excellent results to track simultaneous, constant setpoint changes in desired exit flow, exit temperature, and mixer pressure, as well as to reject unmeasurable but bounded additive step perturbations in the valve positions. A feedback linearization controller is designed and used to achieve tracking and regulation of the outputs over an extended range of the variables of interest.
A model for motor learning, generalization, and adaptation is presented. It is shown that the equations of motion of a limb can be expressed in a parametric form that facilitates transformation of desired trajectories into plans. These parametric equations are used in conjunction with a quantized multi-dimensional memory organized by state variables. The memory is supplied with data derived from the analysis of practice movements. A small computer and mechanical arm are used to implement the model and study its properties. Results verify the ability to acquire new movements, adapt to mechanical loads, and generalize between similar movements.
Asynchronous finite-state models of manual control systems in which human operator behaves as finite-state machine
Two ground simulation software are used to model the SMAP spacecraft dynamics. The CAST software uses a higher fidelity model than the ADAMS software. The ADAMS software models the spacecraft plant, controller and actuator models, and assumes a perfect sensor and estimator model. In this simulation study, the spacecraft dynamics results from the ADAMS software are used as CAST software is unavailable. The main source of spacecraft dynamics error in the higher fidelity CAST software is due to the estimation error. A signal generation model is developed to capture the effect of this estimation error in the overall spacecraft dynamics. Then, this signal generation model is included in the ADAMS software spacecraft dynamics estimate such that the results are similar to CAST. This signal generation model has similar characteristics mean, variance and power spectral density as the true CAST estimation error. In this way, ADAMS software can still be used while capturing the higher fidelity spacecraft dynamics modeling from CAST software.
This paper presents a modification of the conventional model reference adaptive control (MRAC) architecture in order to improve transient performance of the input and output signals of uncertain systems. A simple modification of the reference model is proposed by feeding back the tracking error signal. It is shown that the proposed approach guarantees tracking of the given reference command and the reference control signal (one that would be designed if the system were known) not only asymptotically but also in transient. Moreover, it prevents generation of high frequency oscillations, which are unavoidable in conventional MRAC systems for large adaptation rates. The provided design guideline makes it possible to track a reference commands of any magnitude from any initial position without re-tuning. The benefits of the method are demonstrated with a simulation example
A facility has been constructed to perform controlled shallow releases of CO2 at flow rates that challenge near surface detection techniques and can be scalable to desired retention rates of large scale CO2 storage projects. Preinjection measurements were made to determine background conditions and characterize natural variability at the site. Modeling of CO2 transport and concentration in saturated soil and the vadose zone was also performed to inform decisions about CO2 release rates and sampling strategies. Four releases of CO2 were carried out over the summer field seasons of 2007 and 2008. Transport of CO2 through soil, water, plants, and air was studied using near surface detection techniques. Soil CO2 flux, soil gas concentration, total carbon in soil, water chemistry, plant health, net CO2 flux, atmospheric CO2 concentration, movement of tracers, and stable isotope ratios were among the quantities measured. Even at relatively low fluxes, most techniques were able to detect elevated levels of CO2 in the soil, atmosphere, or water. Plant stress induced by CO2 was detectable above natural seasonal variations.
This paper presents a field deployment experiment of a real-time traffic signal control algorithm. We implemented the model predictive control (MPC) algorithm based on the virtual phase-link (VPL) model. We selected the deployment locations and times based on an energy saving potential concept. We developed a set of experiment systems, which included sensing, processing, and actuating components, to enable field deployment. We tested the systems rigorously before the experiment days. We reported the key procedures on the experiment days, including the steps taken, the real-time control procedure, and the monitoring of the experiment. We evaluated the impact of the deployment by looking at the changes in delay and energy consumption.
A predictive, multiple model control strategy is developed based on an ensemble of local linear models of the nonlinear system dynamics for a transonic wind tunnel. The local linear models are estimated directly from the weights of a Self Organizing Feature Map (SOFM). Local linear modeling of nonlinear autonomous systems with the SOFM is extended to a control framework where the modeled system is nonautonomous, driven by an exogenous input. This extension to a control framework is based on the consideration of a finite number of subregions in the control space. Multiple self organizing feature maps collectively model the global response of the wind tunnel to a finite set of representative prototype controls. These prototype controls partition the control space and incorporate experimental knowledge gained from decades of operation. Each SOFM models the combination of the tunnel with one of the representative controls, over the entire range of operation. The SOFM based linear models are used to predict the tunnel response to a larger family of control sequences which are clustered on the representative prototypes. The control sequence which corresponds to the prediction that best satisfies the requirements on the system output is applied as the external driving signal. Each SOFM provides a codebook representation of the tunnel dynamics corresponding to a prototype control. Different dynamic regimes are organized into topological neighborhoods where the adjacent entries in the codebook represent the minimization of a similarity metric which is the essence of the self organizing feature of the map. Thus, the SOFM is additionally employed to identify the local dynamical regime, and consequently implements a switching scheme than selects the best available model for the applied control. Experimental results of controlling the wind tunnel, with the proposed method, during operational runs where strict research requirements on the control of the Mach number were met, are presented. Comparison to similar runs under the same conditions with the tunnel controlled by either the existing controller or an expert operator indicate the superiority of the method.
Model reference adaptive control (MRAC) has been studied for decades and successfully applied in multiple areas, including heating, ventilation, and air conditioning (HVAC) systems for buildings. MRAC is efficient in capturing the time-varying characteristics of buildings' indoor temperatures and outdoor weather environments. In this paper, the rate of convergence of MRAC is investigated, where a direct adaptive control with temperature set point reference tracking is used to regulate the indoor temperatures for buildings. Numerical results show that by controlling the HVAC systems of residential buildings using MRAC, the indoor temperatures converge Q-sublinearly to the desired temperature set points. In addition, the rate of convergence for MRAC is compared with a baseline adaptive model-free control method.
Not Available
A decentralized model reference adaptive control (DMRAC) method is developed for large flexible structures (LFS). The development follows that of a centralized model reference adaptive control for LFS that have been shown to be feasible. The proposed method is illustrated using a simply supported beam with collocated actuators and sensors. Results show that the DMRAC can achieve either output regulation or output tracking with adequate convergence, provided the reference model inputs and their time derivatives are integrable, bounded, and approach zero as t approaches infinity.
A theory-based model for the control of plasma currents for steady-state operation in W7-X is proposed and intended for model-based plasma control. The conceptual outline implies the strength of physics-based models: it offer approaches applicable to future conditions of fusion devices or next-step machines. The application at extrapolated settings is related to the validity range of the theory model. Therefore, the predictive power of theory-based control models could be larger than for data-driven approaches and limitations can be predicted from the validity range for the prediction of bootstrap currents in W7-X. The model predicts the L/R response when density or heating power is changed. The model is based on neoclassical bootstrap current calculations and validated for different discharge conditions. While the model was found to be broadly applicable for conducted electron-cyclotron-heated discharges in W7-X, limits were found for cases when the polarization of the electron cyclotron heating was changed from X2 to O2-heating. The validity assessment attempts to quantify the potential of the derived model for model-based control in the operational space (density, heating power) of W7-X.