A discrete-time differential dynamic programming algorithm with application to optimal orbit transfer
Discrete time differential dynamic programming algorithm with application to optimal orbit transfer
Gershwin, S. B.↗
SEARCH · Search NASA
Results for “algorithmic differentiation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Information and Collaboration Levels in Vehicular Strings: A Comparative Study
The potential safety, productivity, and energy benefits of automated vehicles have driven a surge of research interest in their algorithms. Even within single-lane driving, control engineers now have a profusion of approaches available to them. Algorithm classes include classical controllers, receding horizon controllers, and constrained eco-driving formulae based on Pontryagin’s Minimum Principle. Differing connectivity architectures and collaboration levels further differentiate algorithms from one another. This study evaluated six controllers in two drive cycle-based scenarios using an electric powertrain model for energy analysis. Individual-vehicle and string performance were examined, including string stability and length. Algorithms with greater access to information generally performed best. Although collaboration affected energy use only slightly, it made a greater impact on string length.
Dollar, R. Austin↗
MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade
The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model’s main branch and is now freely available.
Adjoints↗
Reverse-mode differentiation in arbitrary tensor network format: with application to supervised learning.
This paper describes an efficient reverse-mode differentiation algorithm for contraction operations of tensor networks that may have arbitrary and unconventional network topologies. The approach leverages the tensor contraction tree of Evenbly and Pfeifer (2014), which provides an instruction set for the contraction sequence of a network. We show that this tree can be efficiently leveraged for differentiation of a full tensor network contraction using a recursive scheme that exploits (1) the bilinear property of contraction and (2) the property that trees have single path from root to leaves. While differentiation of tensor-tensor contraction is already possible in most automatic differentiation packages, we show that exploiting these two additional properties in the specific context of contraction sequences can improve efficiency. Following a description of the algorithm and computational complexity analysis, we investigate its utility for gradient-based supervised learning for low-rank function recovery and for fitting real-world unstructured datasets. We demonstrate improved performance over alternating least-squares optimization approaches and the capability to handle heterogeneous and arbitrary tensor network formats. When compared to alternating minimization algorithms, we find that the gradient-based approach requires a smaller oversampling ratio (number of samples compared to number model parameters) for recovery. This increased efficiency extends to fitting unstructured data of varying dimensionality and when employing a variety of tensor network formats. Here, we show improved learning using the hierarchical Tucker method over the tensor-train in high-dimensional settings on a number of benchmark problems.
97 MATHEMATICS AND COMPUTING↗
Improving the FLORIS wind plant model for compatibility with gradient-based optimization
The FLORIS (FLOw Redirection and Induction in Steady-state) model, a parametric wind turbine wake model that predicts steady-state wake characteristics based on wind turbine position and yaw angle, was developed for optimization of control settings and turbine locations. This article provides details on changes made to the FLORIS model to make the model more suitable for gradient-based optimization. Changes to the FLORIS model were made to remove discontinuities and add curvature to regions of non-physical zero gradient. Exact gradients for the FLORIS model were obtained using algorithmic differentiation. A set of three case studies demonstrate that using exact gradients with gradient-based optimization reduces the number of function calls by several orders of magnitude. The case studies also show that adding curvature improves convergence behavior, allowing gradient-based optimization algorithms used with the FLORIS model to more reliably find better solutions to wind farm optimization problems.
17 WIND ENERGY↗
TurboRVB: A many-body toolkit for ab initio electronic simulations by quantum Monte Carlo
TurboRVB is a computational package for ab initio Quantum Monte Carlo (QMC) simulations of both molecular and bulk electronic systems. The code implements two types of well established QMC algorithms: Variational Monte Carlo (VMC) and diffusion Monte Carlo in its robust and efficient lattice regularized variant. A key feature of the code is the possibility of using strongly correlated many-body wave functions (WFs), capable of describing several materials with very high accuracy, even when standard mean-field approaches [e.g., density functional theory (DFT)] fail. The electronic WF is obtained by applying a Jastrow factor, which takes into account dynamical correlations, to the most general mean-field ground state, written either as an antisymmetrized geminal power with spin-singlet pairing or as a Pfaffian, including both singlet and triplet correlations. This WF can be viewed as an efficient implementation of the so-called resonating valence bond (RVB) Ansatz, first proposed by Pauling and Anderson in quantum chemistry [L. Pauling, The Nature of the Chemical Bond (Cornell University Press, 1960)] and condensed matter physics [P.W. Anderson, Mat. Res. Bull 8, 153 (1973)], respectively. The RVB Ansatz implemented in TurboRVB has a large variational freedom, including the Jastrow correlated Slater determinant as its simplest, but nontrivial case. Moreover, it has the remarkable advantage of remaining with an affordable computational cost, proportional to the one spent for the evaluation of a single Slater determinant. Therefore, its application to large systems is computationally feasible. The WF is expanded in a localized basis set. Several basis set functions are implemented, such as Gaussian, Slater, and mixed types, with no restriction on the choice of their contraction. The code implements the adjoint algorithmic differentiation that enables a very efficient evaluation of energy derivatives, comprising the ionic forces. Thus, one can perform structural optimizations and molecular dynamics in the canonical NVT ensemble at the VMC level. For the electronic part, a full WF optimization (Jastrow and antisymmetric parts together) is made possible, thanks to state-of-the-art stochastic algorithms for energy minimization. In the optimization procedure, the first guess can be obtained at the mean-field level by a built-in DFT driver. The code was efficiently parallelized by using a hybrid MPI-OpenMP protocol, which is also an ideal environment for exploiting the computational power of modern Graphics Processing Unit accelerators.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Rapid multiphase-field model development using a modular free energy based approach with automatic differentiation in MOOSE/MARMOT
In this paper, we present a novel rapid phase-field model development capability using a modular free energy based approach in the finite element based MOOSE framework. The phase-field equations are implemented in a general form as separate code form the model specific data such as the thermodynamic free energy density and mobility functions. This isolates researchers from complicated code and allows them to focus on implementing new material models. In addition, using a native symbolic differentiation algorithm, all required derivatives of the free energy density are automatically determined, removing sources for potential human error, and guaranteeing optimally preconditioned equation systems through fully populated Jacobian matrices. Free energy terms contributing to a phase-field model are abstracted into self contained objects that can be combined at will at simulation run time. Combining multiple chemical and mechanical free energy contributions allows the construction of coupled phase-field, mechanics, and multiphase models. Through just-in-time compilation, we greatly reduce the computational time required to evaluate the differentiated expressions. Lastly, we demonstrate the new capability on a variety of example simulations.
97 MATHEMATICS AND COMPUTING↗
Quandary
Quandary numerically simulates and optimizes the time-evolution of open quantum systems. The underlying dynamics are modelled by Lindblad's master equation, a linear ordinary differential equation (ODE) describing quantum systems interacting with the environment. Quandary solves this ODE numerically by applying a time-stepping integration scheme, and utilizes a gradient-based optimization approach to determine optimal control pulses that drive the quantum system to a desired target state. Two optimization objectives are considered: (a) Unitary gate optimization that finds controls to realize a unitary gate transformation, and (b) optimal reset that aims to drive the quantum system to the ground states. Gradient-based optimization schemes utilizing Petsc's Tao optimization package are applied to generate control pulses that minimize the respective measure. To evaluate the gradient of the objective function, the discrete adjoint method is used while leveraging techniques from Algorithmic Differentiation to produce exact and consistent gradients. To mitigate excessive execution run times, the software can be build together with the XBraid software library which provides a parallelization strategy to distribute the time-evolution of the underlying dynamics onto multiple processor.
Petersson, NilsA.↗
Graph-based Reversible Evaluation and Tangents Library
GRETL is a C++ library for evaluation, re-evaluation and algorithmic differentiation of functional operations on an arbitrary computational graph with limited memory usage. Similar to popular machine learning frameworks in Python, like PyTorch and JAX, it tracks and stores both operations and output data as functions are evaluated. Once this composition of functions is built up, the entire chain of operations can be back propagated to compute sensitivities of the final result with respect to any number of inputs. In contrast to most machine learning applications, memory usage becomes the bottleneck for back propagation in many physics applications, especially for time-dependent PDEs. Dynamic check pointing becomes essential. An important distinguishing feature of GRETL is its ability to limit the maximum memory usage by automatically dynamic checkpointing the data output for each graph operation (see Wang, Moin, Iaccarino, 2009). During backpropagation, parts of the graph that are no longer in memory are automatically re-evaluated from upstream checkpointed states as needed for derivative sensitivity calculations (or more precisely, for vector-Jacobian products). GRETL is particularly beneficial for applications, such as coupled multi-physics, where deriving adjoint-based sensitivities and managing checkpoint memory across modules becomes onerous. Cases which can be readily handled by the GRETL library include: different time-integration algorithms per physics (e.g., coupled predictor-corrector algorithms, IMEX, etc.), sub-cycling, asynchronous integrators, state dependent timestep sizes, iterative solvers and coupling algorithms, controller algorithms, and more.
Tupek, MichaelR [Lawrence Livermore National Labor↗
Measurement of coherent exclusive J/ψ → μ+μ− production in ultraperipheral Pb+Pb collisions at sNN=5.36 TeV with the ATLAS detector
The ATLAS experiment has performed a measurement of coherent exclusive J/ψ → μ+μ− production in ultraperipheral Pb+Pb collisions at sNN=5.36$$ \sqrt{s_{\textrm{NN}}}=5.36 $$ TeV. The data was recorded at the Large Hadron Collider (LHC) during 2023, and corresponds to an integrated luminosity of 79 μb−1. Exclusive J/ψ candidates were selected with a dedicated track-sensitive trigger based on the ATLAS transition radiation tracker. The analysis involves reconstruction of the dimuon invariant mass based on muon tracks from the inner detector, as the muon transverse momentum range of interest precludes the use of the standard muon reconstruction and identification algorithms. Differential cross sections are measured as a function of J/ψ rapidity and are compared with theoretical predictions. After extrapolation to sNN=5.02$$ \sqrt{s_{\textrm{NN}}}=5.02 $$ TeV, they are also compared with previous measurements performed by other experiments using data from LHC Run 2. While the results agree reasonably well with theoretical predictions, they are in tension with previous Run-2 results for the central rapidity region.
Aad, G↗
Simple formalism for efficient derivatives and multi-determinant expansions in quantum Monte Carlo
We present a simple and general formalism to compute efficiently the derivatives of a multi-determinant Jastrow-Slater wave function, the local energy, the interatomic forces, and similar quantities needed in quantum Monte Carlo. Through a straightforward manipulation of matrices evaluated on the occupied and virtual orbitals, we obtain an efficiency equivalent to algorithmic differentiation in the computation of the interatomic forces and the optimization of the orbital parameters. Furthermore, for a large multi-determinant expansion, the significant computational gain afforded by a recently introduced table method is here extended to the local value of any one-body operator and to its derivatives, in both all-electron and pseudopotential calculations.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Augmenting subspace optimization methods with linear bandits
In this work, we consider the framework of methods for unconstrained minimization that are, in each iteration, restricted to a model that is only a valid approximation to the objective function on some affine subspace containing an incumbent point. These methods are of practical interest in computational settings where derivative information is either expensive or impossible to obtain. Recent attention has been paid in the literature to employing randomized matrix sketching for generating the affine subspaces within this framework. We consider a relatively straightforward, deterministic augmentation of such a generic subspace optimization method. In particular, we consider a sequential optimization framework where actions consist of one-dimensional linear subspaces and rewards consist of (approximations to) the magnitudes of directional derivatives computed in the direction of the action subspace. Reward maximization in this context is consistent with maximizing lower bounds on descent guaranteed by first-order Taylor models. This sequential optimization problem can be analysed through the lens of dynamic regret. We modify an existing linear upper confidence bound (UCB) bandit method and prove sublinear dynamic regret in the subspace optimization setting. We demonstrate the efficacy of employing this linear UCB method in a setting where forward-mode algorithmic differentiation can provide directional derivatives in arbitrary directions and in a derivative-free setting. For the derivative-free setting, we propose SS-POUNDers, an extension of the derivative-free optimization method POUNDers that employs the linear UCB mechanism to identify promising subspaces. Our numerical experiments suggest a preference, in either computational setting, for employing a linear UCB mechanism within a subspace optimization method.
97 MATHEMATICS AND COMPUTING↗
Predicting Ice Sheet and Climate Evolution at Extreme Scales
A main research objectives of PISCEES is the development of formal methods for quantifying uncertainties in ice sheet modeling. Uncertainties in simulating and projecting mass loss from the polar ice sheets arise primarily from initial conditions, surface and basal boundary conditions, and model parameters. In general terms, two main chains of uncertainty propagation may be identified: 1. inverse propagation of observation and/or prior onto posterior control variable uncertainties; 2. forward propagation of prior or posterior control variable uncertainties onto those of target output quantities of interest (e.g., climate indices or ice sheet mass loss). A related goal is the development of computationally efficient methods for producing initial conditions for an ice sheet that are close to available present-day observations and essentially free of artificial model drift, which is required in order to be useful for model projections (“initialization problem”). To be of maximum value, such optimal initial states should be accompanied by “useful” uncertainty estimates that account for the different sources of uncerainties, as well as the degree to which the optimum state is constrained by available observations. The PISCEES proposal outlined two approaches for quantifying uncertainties. The first targets the full exploration of the uncertainty in model projections with sampling-based methods and a workflow managed by DAKOTA (the main delivery vehicle for software developed under QUEST). This is feasible for low-dimensional problems, e.g., those with a handful of global parameters to be inferred. This approach can benefit from derivative/adjoint information, but it is not necessary, which is why it often referred to as “non-intrusive”. The second approach makes heavy use of derivative information from model adjoints to address quantifying uncertainty in high-dimensions (e.g., basal boundary conditions in ice sheet models). The use of local gradient, or Hessian information (i.e., second derivatives of the cost function), requires additional code development and implementation, and is thus often referred to as an “intrusive” approach. Within PISCEES, MIT has been tasked to develop methods for derivative-based UQ, the ”intrusive” approach discussed above. These methods rely on the availability of first (adjoint) and second (Hessian) derivative code, developed through intrusive methods such as algorithmic differentiation (AD). While representing a significant burden in terms of code development, derivative-baesd UQ is able to cope with very high-dimensional uncertainty spaces. That is, unlike sampling methods (all variations of Monte Carlo), calculational burden is independent of the dimension of the uncertainty space. This is a significant advantage for spatially distributed uncertainty fields, such as threedimensional initial conditions, three-dimensional parameter fields, or two-dimensional surface and basal boundary conditions. Importantly, uncertainty fields for ice sheet models generally fall into this category.
97 MATHEMATICS AND COMPUTING↗
A study on the sensitivity and simultaneous adjustment of a hoop-column antenna surface
The results of a recent surface adjustment of the 15-meter diameter hoop-column antenna are presented. A least-squares differential algorithm is used to adjust the surface shape as close as possible to a perfect parabola. Since the desired perfect parabola is not uniquely known a priori, parameters of the perfect parabola are included in the design vector along with the cable length changes. As an extension to an earlier study, lateral sensitivity is included in the least-squares adjustment procedure. In addition, the effect of cable length uncertainties on the surface RMS error is considered and an error bound is derived. The results in this study indicate an improvement over earlier studies. The sensitivity analysis provided a quantitative measure of the needed accuracy of the cable adjustments in the laboratory. Recommendations are included to further enhance shape adjustment.
Lim, Kyong Been↗
Solar Sail Transfers from Invariant Objects to L5 Periodic Orbits
The rising interest in a mission to the Sun-Earth L5 point for heliophysics or Trojan asteroid search and the development of solar sails has opened the question of using solar radiation pressure for such a mission. Different solar sail trajectories to the Sun-Earth L5 point are constructed. Different invariant objects in the neighbourhood of Earth are considered for departure: equilibrium points, families of periodic orbits and their associated invariant manifold. Using a multi-objective genetic algorithm, differential correction and the optimal control solver PSOPT the transfers are obtained. The approach followed results in fast solar sail transfers which can be used for the preliminary design of a mission to the Sun-Earth L5 point.
Fernandez, Alvaro↗
Toward Adjoint-Based Aeroacoustic Optimization for Propeller and Rotorcraft Applications
The goal of the present project is to build a multidisciplinary, rapid, robust, and accurate computational tool to optimize wing-mounted propeller designs. The full Farassat’s formulation F1Afor aeroacoustic analysis is implemented in the open-source software SU2.This extension enables the prediction of far-field noise generated by moving sources. The formulation is verified, for a stationary and rotating sphere in a wind tunnel and for a tiltrotor in forward flight, by comparing the acoustic predictions ofSU2 with the predictions computed by NASA’s aeroacoustics code ANOPP2. The algorithmic differentiation capability of SU2 provides discretely consistent, adjoint-based sensitivity analysis for this formulation. The adjoint-based sensitivities are verified through comparison with complex-step sensitivities
R Omur Icke↗
Aeroacoustic Optimization of Installed Propeller Configurations with Scattering and Shielding Effects
An optimization capability is developed for acoustic scattering and shielding of installed propellers and rotors, based on a spacetime Galerkin time domain boundary element method (TDBEM). The time domain approach is particularly suitable for efficient simulation of transient, rotating, and broadband noise sources such as propellers. The use of algorithmic differentiation allows efficient evaluation of design sensitivities required for gradient-based design optimization with a large number of design variables. We present a validation exercise for the coherent broadband scattering capability against an analytical solution, showing excellent agreement. We then demonstrate the optimization tool on a series of inverse design cases with broadband and rotating sources, as well as an optimization problem for a propeller-wing configuration. The results show good performance for optimization problems with the characteristics of realistic installed propeller configurations.
Maks J Groom↗
Aeroacoustic Optimization of Installed Propeller Configurations with Scattering and Shielding Effects
An optimization capability is developed for acoustic scattering and shielding of installed propellers and rotors, based on a spacetime Galerkin time domain boundary element method (TDBEM). The time domain approach is particularly suitable for efficient simulation of transient, rotating, and broadband noise sources such as propellers. The use of algorithmic differentiation allows efficient evaluation of design sensitivities required for gradient-based design optimization with a large number of design variables. We present a validation exercise for the coherent broadband scattering capability against an analytical solution, showing excellent agreement. We then demonstrate the optimization tool on a series of inverse design cases with broadband and rotating sources, as well as an optimization problem for a propeller-wing configuration. The results show good performance for optimization problems with the characteristics of realistic installed propeller configurations.
Maks J Groom↗