Search NASA⌕ Search

SEARCH · Search NASA

Results for “nonlinear dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Exponential Decay in the Sensitivity Analysis of Nonlinear Dynamic Programming

In this report, we study the sensitivity of discrete-time dynamic programs with nonlinear dynamics and objective to perturbations in the initial conditions and reference parameters. Under uniform controllability and boundedness assumptions for the problem data, we prove that the directional derivative of the optimal state and control at time $k$, $x^*_k$, and $u^*_k$, with respect to the reference signal at time $i$, $d_i$, will have exponential decay in terms of $|k-i|$ with a decay rate $\rho$ independent of the temporal horizon length. The key technical step is to prove that a version of the convexification approach proposed by Verschueren et al. can be applied to the KKT conditions and results in a convex quadratic program with uniformly bounded data. In turn, Riccati techniques can be further employed to obtain the sensitivity result, borne from the observation that the directional derivatives are solutions of quadratic programs with structure similar to the KKT conditions themselves. We validate our findings with numerical experiments on a small nonlinear, nonconvex, dynamic program.

97 MATHEMATICS AND COMPUTING↗

A Fast Temporal Decomposition Procedure for Long-Horizon Nonlinear Dynamic Programming

We propose a fast temporal decomposition procedure for solving long-horizon nonlinear dynamic programs. The core of the procedure is sequential quadratic programming (SQP) that utilizes a differentiable exact augmented Lagrangian as the merit function. Within each SQP iteration, we approximately solve the Newton system using an overlapping temporal decomposition strategy. We show that the approximate search direction is still a descent direction of the augmented Lagrangian provided the overlap size and penalty parameters are suitably chosen, which allows us to establish the global convergence. Moreover, we show that a unit step size is accepted locally for the approximate search direction and further establish a uniform, local linear convergence over stages. This local convergence rate matches the rate of the recent Schwarz scheme (Na et al. 2022). However, the Schwarz scheme has to solve nonlinear subproblems to optimality in each iteration, whereas we only perform a single Newton step instead. Numerical experiments validate our theories and demonstrate the superiority of our method.

97 MATHEMATICS AND COMPUTING↗

Dynamic Investment and Counterparty Risk

We introduce a dynamic optimization framework in which collateral is used to mitigate losses arising at counterparty’s default. The investor faces two sources of risk: the default risk of the entity referencing the traded credit swap security, and counterparty risk generated from the default event of the trading counterparty. We show that the value function of the control problem coincides with the classical solution of a nonlinear dynamic programming equation. We provide an explicit characterization of the optimal investment strategy, and show that the investor does not trade if counterparty risk is sufficiently high. These findings suggest that moving credit swap trades into well-designed clearinghouses may stimulate economic activities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Superconvergence of Online Optimization for Model Predictive Control

We develop a one-Newton-step-per-horizon, online, lag-L, model predictive control (MPC) algorithm for solving discrete-time, equality-constrained, nonlinear dynamic programs. Based on recent sensitivity analysis results for the target problems class, we prove that the approach exhibits a behavior that we call superconvergence; that is, the tracking error with respect to the full horizon solution is not only stable for successive horizon shifts, but also decreases with increasing shift order to a minimum value that decays exponentially in the length of the receding horizon. The key analytical step is the decomposition of the one-step error recursion of our algorithm into algorithmic error and perturbation error. We show that the perturbation error decays exponentially with the lag between two consecutive receding horizons, while the algorithmic error, determined by Newton’s method, achieves quadratic convergence instead. Overall this approach induces our local exponential convergence result in terms of the receding horizon length for suitable values of L. In conclusion, numerical experiments validate our theoretical findings.

97 MATHEMATICS AND COMPUTING↗

Optimal Control of a Surge-Mode WEC in Random Waves

The objective of this project was to develop one or more real-time feedback and feed-forward (MPC) control algorithms for an Oscillating Surge Wave Converter (OSWC) developed by RME called SurgeWEC™ that leverages recent innovations in wave energy converter (WEC) control theory to maximize power production in random wave environments. The control algorithms synthesized innovations in dynamic programming and nonlinear wave dynamics using anticipatory wave sensors and localized sensor measurements; e.g. position and velocity of the WEC Power Take Off (PTO), with predictive wave forecasting data. The result was an advanced control system that uses feedback or feed-forward data from an array of sensor channels comprised of both localized and deployed sensors fused into a single decision process that optimally compensates for uncertainties in the system dynamics, wave forecasts, and sensor measurement errors.

16 TIDAL AND WAVE POWER↗

Finite Element Analysis of the TRUST Nonlinear Dynamics Testbed

This paper builds on prior work conducted within the Los Alamos National Laboratory (LANL) Testbeds to Reduce Uncertainty in Simulations and Tests (TRUST) program. Specifically, it builds on finite element (FE) modeling efforts for the TRUST program’s Nonlinear Dynamics (ND) testbed. Historically, the FE model for the ND testbed has exclusively utilized a Lanczos eigensolver that linearly extracts the system’s natural frequencies. This paper investigates the Abaqus 2024’s explicit dynamic solver, which implements a central difference explicit solver. The central difference method used in Abaqus can capture nonlinear material responses in structural dynamic simulations making it suitable for the ND FE model.

42 ENGINEERING↗

On the Value Function of Weakly Coercive Problems in Nonlinear Stochastic Control

In this paper we investigate via a dynamic programming approach some nonlinear stochastic control problems where the control set is unbounded and a classical coercivity hypothesis is replaced by some weaker assumptions. We prove that these problems can be approximated by finite fuel problems; show the continuity of the relative value functions and characterize them as unique viscosity solutions of a quasi-variational inequality with suitable boundary conditions.

97 MATHEMATICS AND COMPUTING↗

Optimal Control for Battery Storage Using Nonlinear Models

Battery storage system (BSS) becomes increasingly popular for grid applications due to the advance in battery and power electronics technologies as well as the growing need of flexibility and reserve from power systems with rapidly developed renewable generation. Successful assessment and deployment of BSS requires optimizing its operation and therefore maximizing the potential benefits. Although there exist studies that develop optimal control for evaluation or operational scheduling of BSS, modeling of charging/discharging operation and the corresponding impacts on state-of-charge (SOC) is over simplified in these methods. This paper develops an optimal control for BSS evaluation and operational scheduling using a general nonlinear model that expresses the change of SOC as a function of charging/discharging power and SOC level. The proposed method is compared with a typical existing method through a real-world energy storage evaluation project to show the significance of the proposed method.

battery, energy storage system, dynamic programmin↗

Adaptive nonlinear wavefront shaping in layered TMDs

Two-dimensional transition metal dichalcogenides are promising candidates for nonlinear photonics applications, offering strong nonlinear susceptibility and compatibility with integrated platforms. Although considerable effort has been devoted to manipulating second harmonic generation in these materials, the dynamic control of nonlinear wavefronts remains largely unexplored. Metasurfaces have enabled significant progress in nonlinear beam engineering, yet their practical implementation is limited by low conversion efficiencies and restricted design flexibility. In this work, we employ feedback-based wavefront shaping using spatial light modulators to enhance SHG from pyramid-like WS 2 multilayer structures by over three orders of magnitude in selected spatial regions. This approach allows us to program nonlinear holograms and dynamically shape the SHG signal through phase-only modulation, opening new possibilities for nonlinear imaging, optical information processing, and data communication.

Mavian, Alex [Rensselaer Polytechnic Inst., Troy, ↗

Minimax Program Terminal Control in Two-Level Hierarchic Nonlinear Discrete Dynamical System

We consider a discrete dynamical system consisting of a number of controllable objects whose dynamics is governed by vector nonlinear discrete recurrent relations with control parameters and perturbations (noises). In such system, two levels of making management decisions are distinguished: the dominating (first) level and the subordinate (second) level, which have different criteria of functioning. These levels are integrated by certain information and control relations. We consider the problem of two-level minimax program terminal control in a discrete dynamical system and propose its mathematical statement and a general scheme of its solution.

97 MATHEMATICS AND COMPUTING↗

Automatic Identification of Closed-Loop Wind Turbine Dynamics via Genetic Programming

Wind turbines are nonlinear systems that operate in turbulent environments. As such, their behavior is difficult to characterize accurately across a wide range of operating conditions by physically meaningful models. Customarily, data-based models of wind turbines are defined in 'black box' format, lacking in both conciseness and physical intelligibility. To address this deficiency, we identify models of a modern horizontal-axis wind turbine in symbolic form using a recently developed symbolic regression method. The method used relies on evolutionary multi-objective optimization to produce succinct dynamic models from operational data without 'a priori' knowledge of the system. We compare the produced models with models derived by other methods for their estimation capacity and evaluate the tradeoff between model intelligibility and accuracy. Several succinct models are found that predict wind turbine behavior as well as or better than more complex alternatives derived by other methods.

17 WIND ENERGY↗

Momentum flow in black-hole binaries. I. Post-Newtonian analysis of the inspiral and spin-induced bobbing

A brief overview is presented of a new Caltech/Cornell research program that is exploring the nonlinear dynamics of curved spacetime in binary black-hole collisions and mergers, and of an initial project in this program aimed at elucidating the flow of linear momentum in binary black holes (BBHs). The 'gauge-dependence' (arbitrariness) in the localization of linear momentum in BBHs is discussed, along with the hope that the qualitative behavior of linear momentum will be gauge-independent. Harmonic coordinates are suggested as a possibly preferred foundation for fixing the gauge associated with linear momentum. For a BBH or other compact binary, the Landau-Lifshitz formalism is used to define the momenta of the binary's individual bodies in terms of integrals over the bodies' surfaces or interiors, and define the momentum of the gravitational field (spacetime curvature) outside the bodies as a volume integral over the field's momentum density. These definitions will be used in subsequent papers that explore the internal nonlinear dynamics of BBHs via numerical relativity. This formalism is then used, in the 1.5 post-Newtonian approximation, to explore momentum flow between a binary's bodies and its gravitational field during the binary's orbital inspiral. Special attention is paid to momentum flow and conservation associated with synchronous spin-induced bobbing of the black holes, in the so-called 'extreme-kick configuration' (where two identical black holes have their spins lying in their orbital plane and antialigned)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Discrete Time McKean–Vlasov Control Problem: A Dynamic Programming Approach

We consider the stochastic optimal control problem of nonlinear mean-field systems in discrete time. We reformulate the problem into a deterministic control problem with marginal distribution as controlled state variable, and prove that dynamic programming principle holds in its general form. We apply our method for solving explicitly the mean-variance portfolio selection and the multivariate linear-quadratic McKean–Vlasov control problem.

97 MATHEMATICS AND COMPUTING↗

Regulation of Dynamical Systems to Optimal Solutions of Semidefinite Programs: Algorithms and Applications to AC Optimal Power Flow

This paper considers a collection of networked nonlinear dynamical systems, and addresses the synthesis of feedback controllers that seek optimal operating points corresponding to the solution of pertinent network-wide optimization problems. Particular emphasis is placed on the solution of semidefinite programs (SDPs). The design of the feedback controller is grounded on a dual e-subgradient approach, with the dual iterates utilized to dynamically update the dynamical-system reference signals. Global convergence is guaranteed for diminishing stepsize rules, even when the reference inputs are updated at a faster rate than the dynamical-system settling time. The application of the proposed framework to the control of power-electronic inverters in AC distribution systems is discussed. The objective is to bridge the time-scale separation between real-time inverter control and network-wide optimization. Optimization objectives assume the form of SDP relaxations of prototypical AC optimal power flow problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DEPLOYING FAST CHARGING INFRASTRUCTURE FOR ELECTRIC VEHICLES IN URBAN NETWORKS: AN ACTIVITY-BASED APPROACH

This paper explores an important problem under the domain of network modeling, the optimal configuration of charging infrastructure for electric vehicles (EVs) in urban networks considering EV users' daily activities and charging behavior. This study proposes a charging behavior simulation model considering different initial state of charge (SOC), travel distance, availability of home chargers, and the daily schedule of trips for each traveler. The proposed charging behavior simulation model examines the complete chain of trips for EV users as well as the interdependency of trips traveled by each driver. The problem of finding the optimum charging configuration is then formulated as a mixed-integer nonlinear programming problem that considers the dynamics of travel time and travel distance, the interdependency of trips made by each driver, limited range of EVs, remaining battery capacity for recharging, waiting time in queue, and detour to access a charging station. This problem is solved using a metaheuristic approach for a large-scale case network. A series of examples are presented to demonstrate the model efficacy and explore the impact of energy consumption on the final SOC and the optimum charging infrastructure.

Chain of Trips↗

Max-Plus Stochastic Control and Risk-Sensitivity

In the Maslov idempotent probability calculus, expectations of random variables are defined so as to be linear with respect to max-plus addition and scalar multiplication. This paper considers control problems in which the objective is to minimize the max-plus expectation of some max-plus additive running cost. Such problems arise naturally as limits of some types of risk sensitive stochastic control problems. The value function is a viscosity solution to a quasivariational inequality (QVI) of dynamic programming. Equivalence of this QVI to a nonlinear parabolic PDE with discontinuous Hamiltonian is used to prove a comparison theorem for viscosity sub- and super-solutions. An example from mathematical finance is given, and an application in nonlinear H-infinity control is sketched.

97 MATHEMATICS AND COMPUTING↗

Connected Vehicle-Based Traffic Signal Coordination

This study presents a connected vehicles (CVs)-based traffic signal optimization framework for a coordinated arterial corridor. The signal optimization and coordination problem are first formulated in a centralized scheme as a mixed-integer nonlinear program (MINLP). The optimal phase durations and offsets are solved together by minimizing fuel consumption and travel time considering an individual vehicle’s trajectories. Due to the complexity of the model, we decompose the problem into two levels: an intersection level to optimize phase durations using dynamic programming (DP), and a corridor level to optimize the offsets of all intersections. In order to solve the two-level model, a prediction-based solution technique is developed. The proposed models are tested using traffic simulation under various scenarios. Compared with the traditional actuated signal timing and coordination plan, the signal timing plans generated by solving the MINLP and the two-level model can reasonably improve the signal control performance. When considering varies vehicle types under high demand levels, the proposed two-level model reduced the total system cost by 3.8% comparing to baseline actuated plan. MINLP reduced the system cost by 5.9%. It also suggested that coordination scheme was beneficial to corridors with relatively high demand levels. For intersections with major and minor street, coordination conducted for major street had little impacts on the vehicles at the minor street.

42 ENGINEERING↗