Search NASA⌕ Search

SEARCH · Search NASA

Results for “Constrained control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗

SU-E-T-284: Dose Plan Optimization When Using Hydrogel Prostate-Rectum Spacer: A Single Institution Experience

Purpose: To describe rectal dose reduction achieved and techniques used to take advantage of the increased peri-rectal spacing provided by injected polyethylene-glycol. Methods: Thirty prostate cancer patents were 2:1 randomized during a clinical trial to evaluate the effectiveness of injected poly-ethylene glycol hydrogel (SpaceOAR System) in creating space between the prostate and the anterior rectal wall. All patients received a baseline CT/MR scan and baseline IMRT treatment plan. Patients were randomized to receive hydrogel injection (n=20) or Control (n=10), followed by another CT/MR scan and treatment plan (single arc VMAT, 6 MV photons, 79.2 Gy, 44 fractions). Additional optimization structures were employed to constrain the dose to the rectum; specifically an avoidance structure to limit V75 <15%, and a control structure to limit the maximum relative dose <105% in the interface region of the anterior rectal wall and the prostate planning target volume. Dose volumetric data was analyzed for rectal volumes receiving 60 through 80 Gy. Results: Rectal dose reduction was observed in all patients who received the hydrogel. Volumetric analysis indicates a median rectal volume and (reduction from baseline plan) following spacer application of 4.9% (8.9%) at V60Gy, 3.8% (8.1%) at V65Gy, 2.5% (7.2%) at V70Gy, 1.6% (5.8%) at V75Gy, and 0.5% (2.5%) at V80Gy. Conclusion: Relative to planning without spacers, rectal dose constraints of 5%, 4%, 3%, 2%, 1% for V60, V65, V70, V75, and V80, should be obtainable when peri-rectal spacers are used. The combined effect of increased peri-rectal space provided by the hydrogel, with strict optimization objectives, resulted in reduced dose to the rectum. To maximize benefit, strict optimization objectives and reduced rectal dose constraints should be employed when creating plans for patients with perirectal spacers. Clinical Trial for SpaceOAR product conducted by Augmenix,Inc. The research site was paid to be a participating site.

60 APPLIED LIFE SCIENCES↗

Adjusting Surfaces Of Large Antenna Reflectors

New approach more effective than traditional rms-surface-distortion approach. Optimization procedure for control of shape of reflector of large space antenna (LSA). Main feature is shape-controlling mathematical mechanism driven by need to satisfy explicit EM design requirements. Uses standard finite-element structural analysis, aperture-integration EM analysis, and constrained optimization techniques to predict set of actuator inputs that improves performance of antenna while minimizing applied control effort. Procedure applicable to wide variety of LSA concepts.

Padula, Sharon L.↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Application of precomputed control laws in a reconfigurable aircraft flight control system

A self-repairing flight control system concept in which the control law is reconfigured after actuator and/or control surface damage to preserve stability and pilot command tracking is described. A key feature of the controller is reconfigurable multivariable feedback. The feedback gains are designed off-line and scheduled as a function of the aircraft control impairment status so that reconfiguration is performed simply by updating the gain schedule after detection of an impairment. A novel aspect of the gain schedule design procedure is that the schedule is calculated using a linear quadratic optimization-based simultaneous stabilization algorithm in which the scheduled gain is constrained to stabilize a collection of plant models representing the aircraft in various control failure modes. A description and numerical evaluation of a controller design for a model of a statically unstable high-performance aircraft are given.

Moerder, Daniel D.↗

Reinforcement Learning of Structured Stabilizing Control for Linear Systems With Unknown State Matrix

This paper delves into designing feedback control gains for a continuous-time linear quadratic regulator (LQR) problem that is constrained to certain predefined structure with unknown state matrix. We bring forth the ideas from reinforcement learning (RL) in conjunction with sufficient stability and performance guarantees in order to design these structured gains using the trajectory measurements of states and controls. Here we first formulate a model-based framework using dynamic programming (DP) to embed the structural constraint to the LQR gain computation in the continuous-time setting, and then subsequently, formulate a policy iteration RL algorithm that can alleviate the requirement of known state matrix in conjunction with maintaining the feedback gain structure. The design enables a distributed learning control design which is necessary for many large-scale cyber-physical systems. Theoretical guarantees are provided for stability and convergence of the structured reinforcement learning (SRL) algorithm. We validate our theoretical results with numerical simulations on a multi-agent networked linear time-invariant (LTI) dynamic system.

42 ENGINEERING↗

Robustness of solutions to a benchmark control problem

The robustness of 10 solutions to a benchmark control design problem presented at the 1990 American Control Conference has been evaluated. The 10 controllers have second-to-eighth-order transfer functions and have been designed using several different methods, including H-infinity optimization, loop-transfer recovery, imaginary-axis shifting, constrained optimization, structured covariance, game theory, and the internal model principle. Stochastic robustness analysis quantifies the controllers' stability and performance robustness with structured uncertainties in up to six system parameters. The analysis provides insights into system response that are not readily derived from other robustness criteria and provides a common ground for judging controllers produced by alternative methods. One important conclusion is that gain and phase margins are not reliable indicators of the probability of instability. Furthermore, parameter variations actually may improve the likelihood of achieving selected performance metrics, as demonstrated by results for the probability of settling-time exceedance.

Stengel, Robert F.↗

Numerical and experimental evaluation for single-axis control of an LSS laboratory model

One of the major problems of LSS attitude control design stems from the modeling uncertainties due to modal truncation errors and modal parameter estimation errors. This modeling problem is investigated by evaluating poles and zeros of the frequency response functions, described in terms of constrained or unconstrained modes. The frequency domain approach is utilized to evaluated the results of modal analyses and direct output feedback controller experiments using a simple flexible spacecraft model consisting of a rigid primary body and flexible aluminum beam(s) with a control moment gyro as an actuator. The modal data are compared under the conditions that the model is constrained as the canti-lever and it is rotationally free on a single-axis air bearing table. In addition, the open-loop responses are experimentally examined under the impulsive disturbance to the appendage. The results of the control experiments show that the first vibration mode of the appendage and the interacted rotational motion of the primary body are damped in a short time as predicted by the numerical analysis, to produce damping ratio of 10-20%.

Ohkami, Y.↗

Evidence for scale‐dependent topographic controls on wildfire spread

Abstract Wildfire ecosystems are thought to be self‐regulated through pattern–process interactions between ignition frequency and location, and patterns of burned and recovering vegetation. Yet, recent increases in the frequency of large wildfires call into question the application of self‐organization theory to landscape resilience. Topography represents a stable bottom‐up template upon which fire interacts as both a physical and an ecological process. However, it is unclear how topographic control changes geographically and across spatial scales. We analyzed fire perimeter and topography data from 16 Bailey ecoregions across the State of California to identify spatial correspondence between ecoregional fire event and topographic patch size distributions. We found both sets of distributions followed a power‐law form and were statistically similar across several orders of magnitude, for most ecoregions. As a direct test of topographic controls on fire event perimeters, we used a paired t ‐test across ~11,000 fires to identify differences in topographic attributes at fire boundaries versus fire interiors. Statistical significance was determined using 500 iterations of a neutral landscape model. Level of topographic control varied significantly by ecoregion and across topographic features. For example, north–south aspect breaks, valley bottoms, and roads showed a consistently high degree of spatial control on wildfire perimeters. Topographic controls were most pronounced in mountainous ecoregions and were least influential in arid regions. Ridgetops provided a low‐level control across all ecoregions. Spatial control was strongest for small (10 0 –10 2 ha) to medium (10 3 –10 4 ha) fire sizes, suggesting that controls were scale‐dependent rather than scale‐invariant. Roads were the dominant control across all ecoregions; however, removing roads from the analyses had no significant effect on the overall role of topography on wildfire extinguishment in this analysis. This result suggested that certain topographic settings show strong spatial control on fire growth, despite the presence of roads. Our results support the observation that both bottom‐up and top‐down factors constrain fire sizes and that there are likely scaling regions within fire size distributions wherein the dominance of these spatial controls varies. Human influences on fire spread may either diminish or enhance the role of some bottom‐up and top‐down factors, adding further complexity.

Povak, Nicholas A.↗

The use of singular value gradients and optimization techniques to design robust controllers for multiloop systems

A method for designing robust feedback controllers for multiloop systems is presented. Robustness is characterized in terms of the minimum singular value of the system return difference matrix at the plant input. Analytical gradients of the singular values with respect to design variables in the controller are derived. A cumulative measure of the singular values and their gradients with respect to the design variables is used with a numerical optimization technique to increase the system's robustness. Both unconstrained and constrained optimization techniques are evaluated. Numerical results are presented for a two output drone flight control system.

Newsom, J. R.↗

CAD of control systems: Application of nonlinear programming to a linear quadratic formulation

The familiar suboptimal regulator design approach is recast as a constrained optimization problem and incorporated in a Computer Aided Design (CAD) package where both design objective and constraints are quadratic cost functions. This formulation permits the separate consideration of, for example, model following errors, sensitivity measures and control energy as objectives to be minimized or limits to be observed. Efficient techniques for computing the interrelated cost functions and their gradients are utilized in conjunction with a nonlinear programming algorithm. The effectiveness of the approach and the degree of insight into the problem which it affords is illustrated in a helicopter regulation design example.

Fleming, P.↗

The Use of Software Agents for Autonomous Control of a DC Space Power System

In order to enable manned deep-space missions, the spacecraft must be controlled autonomously using on-board algorithms. A control architecture is proposed to enable this autonomous operation for an spacecraft electric power system and then implemented using a highly distributed network of software agents. These agents collaborate and compete with each other in order to implement each of the control functions. A subset of this control architecture is tested against a steadystate power system simulation and found to be able to solve a constrained optimization problem with competing objectives using only local information.

autonomous control↗

Dual arm coordination and control

A generalized master/slave technique and experimental results for coordinated control of two arms rigidly grasping an object is described. An interactive program has been developed to allow a user the flexibility to select appropriate control modes for a given experiment. This interface allows for control gain adjustments. The results of several experiments performed on this system to demonstrate its capabilities such as transporting an object with or without induced internal forces and movement of a constrained object are offered. The system is further developed to achieve a so-called shared control mode in which an operator specifies the free motion trajectory for a point on the object of manipulation via a joystick while the autonomous control system is used for coordination and control of the arms.

Hayati, Samad↗

Stochastic Control Synthesis of Systems with Structured Uncertainty

This paper presents a study on the design of robust controllers by using random variables to model structured uncertainty for both SISO and MIMO feedback systems. Once the parameter uncertainty is prescribed with probability density functions, its effects are propagated through the analysis leading to stochastic metrics for the system's output. Control designs that aim for satisfactory performances while guaranteeing robust closed loop stability are attained by solving constrained non-linear optimization problems in the frequency domain. This approach permits not only to quantify the probability of having unstable and unfavorable responses for a particular control design but also to search for controls while favoring the values of the parameters with higher chance of occurrence. In this manner, robust optimality is achieved while the characteristic conservatism of conventional robust control methods is eliminated. Examples that admit closed form expressions for the probabilistic metrics of the output are used to elucidate the nature of the problem at hand and validate the proposed formulations.

Padula, Sharon L.↗

Control of mechanical systems with rolling constraints: Application to dynamic control of mobile robots

There are many examples of mechanical systems that require rolling contacts between two or more rigid bodies. Rolling contacts engender nonholonomic constraints in an otherwise holonomic system. In this article, we develop a unified approach to the control of mechanical systems subject to both holonomic and nonholonomic constraints. We first present a state space realization of a constrained system. We then discuss the input-output linearization and zero dynamics of the system. This approach is applied to the dynamic control of mobile robots. Two types of control algorithms for mobile robots are investigated: trajectory tracking and path following. In each case, a smooth nonlinear feedback is obtained to achieve asymptotic input-output stability and Lagrange stability of the overall system. Simulation results are presented to demonstrate the effectiveness of the control algorithms and to compare the performane of trajectory-tracking and path-following algorithms.

Sarkar, Nilanjan↗

CATS Near Real Time Data Products: Applications for Assimilation Into the NASA GEOS-5 AGCM

From February 2015 through October 2017, the NASA Cloud-Aerosol Transport System (CATS) backscatter lidar operated on the International Space Station (ISS) as a technology demonstration for future Earth Science Missions, providing vertical measurements of cloud and aerosols properties. Owing to its location on the ISS, a cornerstone technology demonstration of CATS was the capability to acquire, process, and disseminate near-real time (NRT) data within 6 hours of observation time. CATS NRT data has several applications, including providing notification of hazardous events for air traffic control and air quality advisories, field campaign flight planning, as well as for constraining cloud and aerosol distributions in via data assimilation in aerosol transport models. Â Recent developments in aerosol data assimilation techniques have permitted the assimilation of aerosol optical thickness (AOT), a 2-dimensional column integrated quantity that is reflective of the simulated aerosol loading in aerosol transport models. While this capability has greatly improved simulated AOT forecasts, the vertical position, a key control on aerosol transport, is often not impacted when 2-D AOT is assimilated. Here, we present preliminary efforts to assimilate CATS aerosol observations into the NASA Goddard Earth Observing System version 5 (GEOS-5) atmospheric general circulation model and assimilation system using a 1-D Variational (1-D VAR) ensemble approach, demonstrating the utility of CATS for future Earth Science Missions.

Hlavka, D. L.↗

The Detection and Attribution Model Intercomparison Project (DAMIP v1.0)contribution to CMIP6

Detection and attribution (D&A) simulations were important components of CMIP5 and underpinned the climate change detection and attribution assessments of the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. The primary goals of the Detection and Attribution Model Intercomparison Project (DAMIP) are to facilitate improved estimation of the contributions of anthropogenic and natural forcing changes to observed global warming as well as to observed global and regional changes in other climate variables; to contribute to the estimation of how historical emissions have altered and are altering contemporary climate risk; and to facilitate improved observationally constrained projections of future climate change. D&A studies typically require unforced control simulations and historical simulations including all major anthropogenic and natural forcings. Such simulations will be carried out as part of the DECK and the CMIP6 historical simulation. In addition D&A studies require simulations covering the historical period driven by individual forcings or subsets of forcings only: such simulations are proposed here. Key novel features of the experimental design presented here include firstly new historical simulations with aerosols-only, stratospheric-ozone-only, CO2-only, solar-only, and volcanic-only forcing, facilitating an improved estimation of the climate response to individual forcing, secondly future single forcing experiments, allowing observationally constrained projections of future climate change, and thirdly an experimental design which allows models with and without coupled atmospheric chemistry to be compared on an equal footing.

58 GEOSCIENCES↗