Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal Control Problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
NASA NTRS1973

On the decentralized control of large-scale systems

The decentralized control of stochastic large scale systems was considered. Particular emphasis was given to control strategies which utilize decentralized information and can be computed in a decentralized manner. The deterministic constrained optimization problem is generalized to the stochastic case when each decision variable depends on different information and the constraint is only required to be satisfied on the average. For problems with a particular structure, a hierarchical decomposition is obtained. For the stochastic control of dynamic systems with different information sets, a new kind of optimality is proposed which exploits the coupled nature of the dynamic system. The subsystems are assumed to be uncoupled and then certain constraints are required to be satisfied, either in a off-line or on-line fashion. For off-line coordination, a hierarchical approach of solving the problem is obtained. The lower level problems are all uncoupled. For on-line coordination, distinction is made between open loop feedback optimal coordination and closed loop optimal coordination.

Chong, C.↗
NASA NTRS1973

Limiting performance of dynamic systems subject to random inputs

The problem of determining the limiting performance characteristics of mechanical systems subject to random input is studied. A review is presented of the classical work in the optimal design of stochastic systems. Some recent results of stochastic optimal control theory are employed. The solution to the limiting performance problem is formulated in both the frequency and time domains. Both formulations require substantial, burdensome computations when applied to large scale systems.

Pilkey, W. D.↗
DOE OSTI2020

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗
NASA NTRS1993

Modal grammian approach to actuator and sensor placement for flexible structures

The problem of selecting optimal locations of actuators and sensors for the control of flexible structures is addressed. Novel geometrical and physical interpretations are given for both controllability and observability grammians which enhances the intuitive aspects of the actuator and sensor placement problem. The explicit form of controllability and observability grammians for flexible structures is used to define modal grammian coefficients, which provides the basis for an actuator and sensor placement technique. The relationship of the proposed metric to three different existing criteria are given. The method is demonstrated on a model of an experimental large flexible structure.

Lim, K. B.↗
NASA NTRS1981

Optimal air-breathing launch vehicle design

A generalized two-point boundary problem methodology, similar to techniques used in deterministic optimal control studies, is applied to the design and flight analysis of a two-stage air-breathing launch vehicle. Simultaneous consideration is given to configuration and trajectory by treating geometry, dynamic discontinuities, and time-dependent flight variables all as controls to be optimized with respect to a single mathematical performance measure. While minimizing fuel consumption, inequality constraints are applied to dynamic pressure and specific force. The optimal system fuel consumption and staging Mach number are found to vary little with changes in the inequality constraints due to substantial geometry and trajectory adjustments. Staging, from an air-breathing first stage to a rocket-powered second stage, consistently occurs near Mach 3.5. The dynamic pressure bound has its most pronounced effects on vehicle geometry, particularly the air-breathing propulsion inlet area, and on the first-stage altitude profile. The specific force has its greatest influence on the second-stage thrust history.

Hattis, P. D.↗
NASA NTRS1983

Altitude/path-angle transitions in fuel-optimal problems for transport aircraft

Altitude/path angle transitions to fuel-optimal, energy climb and descent paths are examined for subsonic transport aircraft. These transitions are termed boundary layers in singular perturbation theory, the framework used herein to simplify solutions to the state-Euler system. The energy climb and descent paths provide equilibrium or stationary points for the boundary layer system, and thus for moderate transitions, presumed valid for the class of aircraft considered, the boundary layer system may be linearized. This simplification allows derivation of an explicit solution to the two-point boundary-value, boundary layer problem and, as a consequence, yields a nearly optimal control law, in feedback form, for the transitions. Numerical simulation results using the feedback control law are presented for a Boeing 737 airframe (NASA-ATOPS Vehicle) employing twin JT8D-7-7A engines.

Gracey, C.↗
NASA NTRS1986

A guidance-motivated sensitivity analysis of an aero-assisted boost vehicle

A simple model of an aero-assisted booster is used to examine the contributions of propulsion system type, aerodynamic lift and flight trajectory to the efficiency with which payloads can be placed into low earth orbit. The higher propulsive efficiency of ramjet and scramjet propulsion has the potential of increasing the payload mass ratio significantly. The contributions of turbojet propulsion and aerodynamic lift are less significant. The additional complexity involved in using aerodynamic propulsion and lift requires dealing with a more comprehensive set of design variables than for rocket boosters. The approach taken is to derive a set of sensitivity functions which relate booster performance to the design variables. The problems of optimum mixing of aerodynamic lift with thrust and determining the optimal boost trajectory is treated. The potential payload capacity of a horizontal take-off air-breathing boost vehicle is examined. The optimization problem which considers propulsive efficiency, aerodynamic configuration, and control and guidance issues is discussed.

Taylor, L. W.↗
NASA NTRS1991

Fixed-order multi-model estimation and control

The problems of determining a feedback controller or estimator that optimizes an H2 performance criterion involving a collection of plant models is considered. The approach is based upon fixed-structure optimization in which the estimator or controller order is fixed prior to the development of optimality conditions. The question of maximal controller order is also investigated.

Macmartin, Douglas G.↗
NASA NTRS1993

Theory and computation of optimal low- and medium-thrust transfers

This report presents the formulation of the optimal low- and medium-thrust orbit transfer control problem and methods for numerical solution of the problem. The problem formulation is for final mass maximization and allows for second-harmonic oblateness, atmospheric drag, and three-dimensional, non-coplanar, non-aligned elliptic terminal orbits. We setup some examples to demonstrate the ability of two indirect methods to solve the resulting TPBVP's. The methods demonstrated are the multiple-point shooting method as formulated in H. J. Oberle's subroutine BOUNDSCO, and the minimizing boundary-condition method (MBCM). We find that although both methods can converge solutions, there are trade-offs to using either method. BOUNDSCO has very poor convergence for guesses that do not exhibit the correct switching structure. MBCM, however, converges for a wider range of guesses. However, BOUNDSCO's multi-point structure allows more freedom in quesses by increasing the node points as opposed to only quessing the initial state in MBCM. Finally, we note an additional drawback for BOUNDSCO: the routine does not supply information to the users routines for switching function polarity but only the location of a preset number of switching points.

Chuang, C.-H.↗
NASA NTRS1991

A non-iterative method for computing the infimum in H(infinity)-optimization

The authors, as an extension of their earlier work, present a simple noniterative procedure for the computation of the exact value of the infimum in the singular H(infinity)-optimization problem and is an extension of their earlier work. The problem formulation is general and does not place any restrictions on the direct feedthrough terms between the disturbance input and the measurement output variables. The method is applicable to a class of singular H(infinity)-optimization problems for which the transfer functions from the control input to the controlled output and from the disturbance input to the measurement output have no invariant zeros on the j-omega axis and also satisfy certain geometric conditions.

Chen, Ben M.↗
NASA NTRS1998

Distributed Control with Collective Intelligence

We consider systems of interacting reinforcement learning (RL) algorithms that do not work at cross purposes , in that their collective behavior maximizes a global utility function. We call such systems COllective INtelligences (COINs). We present the theory of designing COINs. Then we present experiments validating that theory in the context of two distributed control problems: We show that COINs perform near-optimally in a difficult variant of Arthur's bar problem [Arthur] (and in particular avoid the tragedy of the commons for that problem), and we also illustrate optimal performance in the master-slave problem.

Wolpert, David H.↗
DOE OSTI2018

Privacy-Preserving Aggregation of Controllable Loads to Compensate Fluctuations in Solar Power

Cybersecurity and privacy are of the utmost importance for safe, reliable operation of the electric grid. It is well known that the increased connectivity/interoperability between all stakeholders (e.g., utilities, suppliers, and consumers) will enable personal information collection. Significant advanced metering infrastructure (AMI) deployment and demand response (DR) programs across the country, while enable enhanced automation, also generate energy data on individual consumers that can potentially be used for exploiting privacy. Inspired by existing works which consider DR, battery-based perturbation, and differential privacy noise adding, we novelly consider the aggregator (cluster) level privacy issue in the DR framework of solar photovoltaic (PV) generation following. Different from most of the existing works which mainly rely on the charging/discharging scheduling of rechargeable batteries, we utilize controllable building loads to serve as virtual storage devices to absorb a large portion of the PV genertaion while delicately keeping desired noisy terms to satisfy the differential privacy for the raw load profiles at the aggregator level. This not only ensures differential privacy, but also improves the DR efficiency in load following since part of the noisy signal in solar PV generation has been filtered out. In particular, a mixed integer quadratic optimization problem is formulated to optimally dispatch a population of on/off controllable loads to achieve this privacy-preserving DR service.

Dong, Jin↗
DOE OSTI2019

Coordinated PEV Charging for Distribution System Management

Plug-in electric vehicles (PEVs) can help to reduce worldwide dependence on petroleum and carbon emissions. In the past a few years, PEVs have received considerable attention as an eco-friendly and cost-effective alternative to conventional gasoline vehicles. PEVs consume higher power from the grid during charging compared to conventional residential loads. Therefore, the emerging fleet of PEVs will introduce a considerable amount of additional load on power system. On the other hand, majority of PEVs are parked for more than 90% of the time, making them ideal for providing various services through Electric Vehicle Supply Equipment (EVSE), a.k.a. charging stations which are PEVs’ connection points to the power system. In this project, coordinated PEV charging are developed to provide distribution system services, considering PEV characteristics, realistic travel pattern, charging behaviors, and EVSE power rating and availability. The main efforts and contributions are summarized as follows. • Mobility models and EVSE charging capability/availability are indispensable for evaluating PEV charging coordination strategies and developing PEV charging control. Many existing studies utilize simplified mobility models assuming that the entire vehicle fleet returns home in the evening and is parked at home until the next morning. Some other PEV models better represent diversified home arrival and departure time, but cannot capture varying charging flexibility and capability at different locations, and therefore are not appropriate to study the impacts of public EVSE on PEV load and utilization. In this work, a mobility and charging flexibility model is proposed to better represent the temporal availability and varying charging capability from PEV onboard charger and EVSE. • Based on the mobility model, a generalized optimization method is proposed to evaluate different PEV charging coordination strategies. In existing literature, different algorithms and methods need to be designed to evaluate each charging strategy from both vehicle owners’ and system’s perspective. With the optimization method proposed in this work, different charging control strategies can be studied and compared by only updating objective functions. Moreover, optimization tricks are provided to convert the optimization problems to equivalent linear programming problems, which can be efficiently solved with existing solvers. • An innovative scheduling and control framework is proposed to enable smart PEV charging for grid services while meeting PEV owners’ travel needs. In the proposed framework, each set of EVSE is equipped with a controller that estimates charging power and energy flexibility based on vehicle characteristics, EVSE power rating, battery energy state, and upcoming trip information. With the simplified charging flexibility model received from each EVSE controller, the central coordinator determines the optimal power allocation for a look-ahead time window for the given grid services. The proposed charging control can help reduce the computational complexity and communication requirement compared with existing methods. It is also scalable to the expanding PEV fleet and robust to uncertainties in upcoming vehicle trips and future system condition. • The proposed charging strategy evaluation and smart charging control methods are applied to one of the prototypical feeders developed by the Pacific Northwest National Laboratory (PNNL) for case studies. Detailed trip information extracted from the National Household Travel Survey (NHTS) is used to represent travel and parking patterns. Different scenarios are simulated to evaluate the performance of the proposed methods and understand how PEV mobility and public EVSE availability affect PEV load and potential grid services.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1990

System identification and controller design using experimental frequency response data

Recent findings from modeling and controller design for the NASA-Marshall Single Structure Control Facility have raised questions regarding the ability of modern control design techniques and modern modeling techniques to deal effectively with the stringent modeling and control design requirements of Large Space Structure Control. A brief and general discussion is presented of the results of studies into the modeling and control issues performed under sponsorship of the NASA/ASEE Summer Faculty Fellowship Program. Several issues are addressed. The first is a study of a modeling technique based on least squares identification of individual transfer functions from measured frequency response data. The second is a study of multiobjective optimization techniques applied to the modeling, or system identification, problem. The third issue is a study into the question of whether multiobjective optimization approaches can be effectively used for control system design using only frequency response data, thereby bypassing the difficult modeling problem. The last issue studied involves the resolution of seeming discrepancies between predicted and measured control computer time delays in the Single Structure Control Facility.

Irwin, R. Dennis↗
DOE OSTI2020

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗
NASA NTRS1985

Multivariable control of VTOL aircraft for shipboard landing

The problem of the automatic landing of VTOL aircraft on small ships is considered. Linear quadratic optimal control theory is used to design a VTOL ship motion tracking controller. Optimal root-loci and step responses are obtained to study the dynamics of the closed-loop system. Standard deviations of the ship motion tracking errors, and of the VTOL control amplitudes are computed, illustrating the tradeoff between accurate tracking, and limited control authority. Multivariable robustness margins are also obtained. The tracking of the vertical motion presents the difficulty of requiring large variations of the VTOL total thrust, a control which is limited both in amplitude and in bandwidth. Lateral controls are less restricted, but the motions are strongly coupled, with some adverse couplings in the ship motions, and in the aircraft dynamics. The advantage of the LQ control theory is demonstrated however, by its ability to account for these couplings in a robust manner, and, when possible, to use them to limit the control amplitudes.

Bodson, M.↗
NASA NTRS1980

A singular perturbation analysis of minimum time long range intercept

The application of singular perturbation theory for deriving algorithms suitable for on board real time computation of optimal aircraft trajectory control was investigated. Minimum time intercept in three dimensions was selected as a pilot problem formulation, and data for an early version F-4 aircraft was used to represent aircraft aerodynamic and propulsion characteristics. Results include the derivation of nonlinear, near optimal feedback control laws that are readily implementable in an aircraft flight computer, performance results for a variety of initial conditions (including optimal intercept at short ranges), and a point mass three dimensional simulation suitable for representing fighter aircraft under closed loop optimal control.

Calise, A.↗