Search NASA⌕ Search

SEARCH · Search NASA

Results for “Differential dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

COBRA-DDP: Trajectory Generation and Collision Avoidance Augmentations for eVTOL Vehicles

This paper presents a receding horizon model predictive control variation of the combined Bernstein polynomial optimal reciprocal collision avoidance (ORCA) differential dynamic programming (COBRA-DDP) algorithm for AAM vehicles. Collision avoidance in combination with effective trajectory replanning are expected to be core components of AAM vehicles operating within a crowded airspace. This environment necessitates the use of real-time trajectory planning algorithms that are capable of planning around large amounts of stationary and moving obstacles. Previous work on COBRA-DDP demonstrated the capability of the algorithm to produce dynamically feasible trajectories for AAM vehicles and general collision avoidance. This paper improves upon the previous work by increasing the number of stationary and moving obstacles, implementing a variation of COBRA-DDP that lends itself to real-time application. These advancements are demonstrated on a vertical takeoff and landing (VTOL) vehicle simulation with highly nonlinear vehicle dynamics.

COBRA-DDP↗

COBRA-DDP: Trajectory Generation and Collision Avoidance Augmentations for eVTOL Vehicles

This paper presents a receding horizon model predictive control variation of the combined Bernstein polynomial optimal reciprocal collision avoidance (ORCA) differential dynamic programming (COBRA-DDP) algorithm for AAM vehicles. Collision avoidance in combination with effective trajectory replanning are expected to be core components of AAM vehicles operating within a crowded airspace. This environment necessitates the use of real-time trajectory planning algorithms that are capable of planning around large amounts of stationary and moving obstacles. Previous work on COBRA-DDP demonstrated the capability of the algorithm to produce dynamically feasible trajectories for AAM vehicles and general collision avoidance. This paper improves upon the previous work by increasing the number of stationary and moving obstacles, implementing a variation of COBRA-DDP that lends itself to real-time application. These advancements are demonstrated on a vertical takeoff and landing (VTOL) vehicle simulation with highly nonlinear vehicle dynamics.

COBRA-DDP↗

Comparison of some optimal control methods for the design of turbine blades

This paper attempts a comparative study of some numerical methods for the optimal control design of turbine blades whose vibration characteristics are approximated by Timoshenko beam idealizations with shear and incorporating simple boundary conditions. The blade was synthesized using the following methods: (1) conjugate gradient minimization of the system Hamiltonian in function space incorporating penalty function transformations, (2) projection operator methods in a function space which includes the frequencies of vibration and the control function, (3) epsilon-technique penalty function transformation resulting in a highly nonlinear programming problem, (4) finite difference discretization of the state equations again resulting in a nonlinear program, (5) second variation methods with complex state differential equations to include damping effects resulting in systems of inhomogeneous matrix Riccatti equations some of which are stiff, (6) quasi-linear methods based on iterative linearization of the state and adjoint equation. The paper includes a discussion of some substantial computational difficulties encountered in the implementation of these techniques together with a resume of work presently in progress using a differential dynamic programming approach.

Desilva, B. M. E.↗

End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman

Abstract Motivation Multiple sequence alignments (MSAs) of homologous sequences contain information on structural and functional constraints and their evolutionary histories. Despite their importance for many downstream tasks, such as structure prediction, MSA generation is often treated as a separate pre-processing step, without any guidance from the application it will be used for. Results Here, we implement a smooth and differentiable version of the Smith–Waterman pairwise alignment algorithm that enables jointly learning an MSA and a downstream machine learning system in an end-to-end fashion. To demonstrate its utility, we introduce SMURF (Smooth Markov Unaligned Random Field), a new method that jointly learns an alignment and the parameters of a Markov Random Field for unsupervised contact prediction. We find that SMURF learns MSAs that mildly improve contact prediction on a diverse set of protein and RNA families. As a proof of concept, we demonstrate that by connecting our differentiable alignment module to AlphaFold2 and maximizing predicted confidence, we can learn MSAs that improve structure predictions over the initial MSAs. Interestingly, the alignments that improve AlphaFold predictions are self-inconsistent and can be viewed as adversarial. This work highlights the potential of differentiable dynamic programming to improve neural network pipelines that rely on an alignment and the potential dangers of optimizing predictions of protein sequences with methods that are not fully understood. Availability and implementation Our code and examples are available at: https://github.com/spetti/SMURF. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

An historical survey of computational methods in optimal control.

Review of some of the salient theoretical developments in the specific area of optimal control algorithms. The first algorithms for optimal control were aimed at unconstrained problems and were derived by using first- and second-variation methods of the calculus of variations. These methods have subsequently been recognized as gradient, Newton-Raphson, or Gauss-Newton methods in function space. A much more recent addition to the arsenal of unconstrained optimal control algorithms are several variations of conjugate-gradient methods. At first, constrained optimal control problems could only be solved by exterior penalty function methods. Later algorithms specifically designed for constrained problems have appeared. Among these are methods for solving the unconstrained linear quadratic regulator problem, as well as certain constrained minimum-time and minimum-energy problems. Differential-dynamic programming was developed from dynamic programming considerations. The conditional-gradient method, the gradient-projection method, and a couple of feasible directions methods were obtained as extensions or adaptations of related algorithms for finite-dimensional problems. Finally, the so-called epsilon-methods combine the Ritz method with penalty function techniques.

Polak, E.↗

A Smoothed Eclipse Model for Solar Electric Propulsion Trajectory Optimization

Solar electric propulsion (SEP) is the dominant design option for employing low-thrust propulsion on a space mission. Spacecraft solar arrays power the SEP system but are subject to blackout periods during solar eclipse conditions. Discontinuity in power available to the spacecraft must be accounted for in trajectory optimization, but gradient-based methods require a differentiable power model. This work presents a power model that smooths the eclipse transition from total eclipse to total sunlight with a logistic function. Example trajectories are computed with differential dynamic programming, a second-order gradient-based method.

trajectory design↗

A Smoothed Eclipse Model for Solar Electric Propulsion Trajectory Optimization

Solar electric propulsion (SEP) is the dominant design option for employing low-thrust propulsion on a space mission. Spacecraft solar arrays power the SEP system but are subject to blackout periods during solar eclipse conditions. Discontinuity in power available to the spacecraft must be accounted for in trajectory optimization, but gradient-based methods require a differentiable power model. This work presents a power model that smooths the eclipse transition from total eclipse to total sunlight with a logistic function. Example trajectories are computed with differential dynamic programming, a second-order gradient-based method.

optimization↗

Trajectory Planning and Online Performance Model Estimation for Advanced Air Mobility

We propose a framework for adaptive guidance based on optimal control and estimation using closed-loop performance models. In the proposed approach, parameters of a reduced-order performance model are estimated in real time so that trajectories and guidance commands are replanned with more accurate knowledge of the system's response and performance capabilities. To apply this methodology to flight control systems, we introduce a simple yet expressive performance model modified from a reference linear design model. The proposed framework is applied to guidance of a simulated Advanced Air Mobility class concept aircraft experiencing control effector failures. We demonstrate that, by optimizing performance model parameters in real time, guidance commands can be intelligently adjusted to recover system stability and the performance of a full-order vehicle model, even in the event of effector failures. Furthermore, the reduced-order performance model requires a fraction of the computational cost of the full-order model, facilitating real-time use of adaptive, optimal guidance.

Differential dynamic programming↗

Trajectory Planning and Online Performance Model Estimation for Advanced Air Mobility

We propose a framework for adaptive guidance based on optimal control and estimation using closed-loop performance models. In the proposed approach, parameters of a reduced-order performance model are estimated in real time so that trajectories and guidance commands are replanned with more accurate knowledge of the system's response and performance capabilities. To apply this methodology to flight control systems, we introduce a simple yet expressive performance model modified from a reference linear design model. The proposed framework is applied to guidance of a simulated Advanced Air Mobility class concept aircraft experiencing control effector failures. We demonstrate that, by optimizing performance model parameters in real time, guidance commands can be intelligently adjusted to recover system stability and the performance of a full-order vehicle model, even in the event of effector failures. Furthermore, the reduced-order performance model requires a fraction of the computational cost of the full-order model, facilitating real-time use of adaptive, optimal guidance.

Differential dynamic programming↗

Ground resonance analysis using a substructure modeling approach

A convenient and versatile procedure for modeling and analyzing ground resonance phenomena is described and illustrated. A computer program is used which dynamically couples differential equations with nonlinear and time dependent coefficients. Each set of differential equations may represent a component such as a rotor, fuselage, landing gear, or a failed damper. Arbitrary combinations of such components may be formulated into a model of a system. When the coupled equations are formed, a procedure is executed which uses a Floquet analysis to determine the stability of the system. Illustrations of the use of the procedures along with the numerical examples are presented.

Chen, S. Y.↗

Ground resonance analysis using a substructure modeling approach

A convenient and versatile procedure for modeling and analyzing ground resonance phenomena is described and illustrated. A computer program is used which dynamically couples differential equations with nonlinear and time dependent coefficients. Each set of differential equations may represent a component such as a rotor, fuselage, landing gear, or a failed damper. Arbitrary combinations of such components may be formulated into a model of a system. When the coupled equations are formed, a procedure is executed which uses a Floquet analysis to determine the stability of the system. Illustrations of the use of the procedures along with the numerical examples are presented.

Chen, S.-Y.↗