Search NASA⌕ Search

SEARCH · Search NASA

Results for “Adjoint methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Invertible Neural Networks for Airfoil Design

We report the airfoil design problem, in which an engineer seeks a shape with desired performance characteristics, is fundamental to aerodynamics. Design workflows traditionally rely on iterative optimization methods using low-fidelity integral boundary-layer methods as higher-fidelity adjoint-based computational fluid dynamics methods are computationally expensive. Surrogate-based approaches can accelerate the design process but still rely on some iterative inverse design procedure. In this work, we leverage emerging invertible neural network (INN) tools to enable the rapid inverse design of airfoil shapes for wind turbines. INNs are specialized deep-learning models with well-defined inverse mappings. When trained appropriately, INN surrogate models are capable of forward prediction of aerodynamic and structural quantities for a given airfoil shape as well as inverse recovery of airfoil shapes with specified aerodynamic and structural characteristics. The INN approach offers a roughly 100 times speed-up compared to adjoint-based methods for inverse design. We demonstrate the INN tool for inverse design on three test cases of 100 airfoils each that satisfy the performance characteristics close to those of airfoils used in wind-turbine blades. All generated shapes satisfy the desired aerodynamic characteristics, demonstrating the success of the INN approach for inverse design of airfoils.

17 WIND ENERGY↗

Reverse-Mode Algorithmic Differentiation of an OpenMP-Parallel Compressible Flow Solver

y Reverse-mode algorithmic differentiation (AD) is an established method for obtaining adjoint derivatives of computer simulation applications. In computational fluid dynamics (CFD), adjoint derivatives of a cost function output such as drag or lift with respect to design parameters such as surface coordinates or geometry control points are a key ingredient for shape optimization, uncertainty quantification and flow control. The computational cost of CFD applications and their derivatives makes it essential to use high-performance computing hardware efficiently, including multi- and many-core architectures. Nevertheless, OpenMP is not supported in most AD tools, and previously shown methods achieve poor scalability of the derivative code. We present the AD of an OpenMP-parallelized finite volume compressible flow solver for unstructured meshes. Our approach enables us to reuse the parallelization of the original code in the computation of adjoint derivatives. The method works by identifying code segments that can be differentiated in reverse-mode without changing their memory access pattern. The OpenMP parallelization is integrated into the derivative code during the build process in a way that is robust to modifications of the original code and independent of the OpenMP support of the differentiation tool. We show the scalability of our adjoint CFD solver on test cases ranging from thousands to millions of finite volume mesh cells on CPUs with up to 16 threads as well as on an Intel XeonPhi card with 236 threads. We demonstrate that our approach is more practical to implement for production-sized CFD codes and produces more efficient adjoint derivative code than previously shown AD methods.

Huckelheim, Jan↗

Towards Aerodynamic Shape Optimization Using an Immersed Boundary Overset Grid Method

Traditional Reynolds-averaged Navier-Stokes grid methods applied to aerodynamic shapeoptimization can struggle with the deformation of surface and volume grids at componentintersections, such as at wing-fuselage junctions. To overcome this, we propose an approachwhich utilizes curvilinear overset grids for the discretization of the domain, with the presenceof the body modeled using an immersed boundary method. This approach handles complexgeometries without the need for their explicit integration into the grid. The goal of this approachis to reduce grid generation time and allow for greater geometric freedom for component-basedaerodynamic shape optimization. Two different methods are presented: a source-term-basedand a ghost-node-based immersed boundary method. Flow analyses and adjoint solutionsobtained using the proposed methods show promising comparisons with standard body-fittedgrid methods. Preliminary aerodynamic shape optimization results obtained using one of theimmersed boundary methods are also presented.

TTT↗

Assessment of Multi-Step CADIS Parameter Sensitivity to Neutron Flux Spectrum in Shutdown Dose Rate Calculations

Shutdown dose rate (SDDR) analysis requires (a) a neutron transport calculation to estimate neutron flux fields, (b) an activation calculation to compute radionuclide inventories and associated photon sources, and (c) a photon transport calculation to estimate final dose rate. In some applications, accurate full-scale Monte Carlo (MC) SDDR simulations are needed for very large systems with massive amounts of shielding materials. For example, SDDR assessments are required throughout the biological shield (bio-shield) of the ITER experimental facility to evaluate the required waiting period after the shutdown of ITER and to identify the locations where human accessibility should be prohibited. The bio-shield is a large cylindrical concrete structure (30 m tall and 34 m in diameter) surrounding the very complex tokamak machine. Determining the effects on SDDR of important factors, such as the cross talk (interactions) between the different ports of ITER, is possible only through full-scale simulations that involve all the complex inner details of the ITER tokamak machine. These simulations are impractical because calculation of space- and energy-dependent neutron fluxes throughout the structural materials is needed to estimate the distribution of radioisotopes causing the SDDR. Determining a good importance function that can be used in biasing a neutron MC calculation for SDDR is complicated because it is difficult to explicitly express the SDDR response function, which depends on subsequent computational steps. The Multi-Step Consistent Adjoint Driven Importance Sampling (MS-CADIS) hybrid MC/deterministic method was developed to speed up the SDDR MC neutron transport calculation using an importance function that represents the neutron importance to the final SDDR. The MS-CADIS method uses the CADIS method, which has been Notice: This manuscript has been authored by UT-Battelle, LLC, under Contract No. DE-AC0500OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for the United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan). successfully used for more than a decade in radiation shielding applications to generate consistent source biasing and weight window (WW) variance reduction parameters to accelerate continuous-energy MC simulations. However, because MS-CADIS focuses on multi-step shielding calculations such as SDDR calculations, it develops an importance function for the initial radiation transport calculation (e.g., the neutron calculations in SDDR simulations) that represents the importance of particles to the final response of the overall simulation. To develop this importance function, the MS-CADIS method uses an adjoint calculation with a specific neutron adjoint source that represents the neutron's contribution to the final SDDR. Brute force calculation of the MS-CADIS neutron adjoint source requires a deterministic neutron transport calculation coupled with activation calculations in each element of the deterministic mesh. These calculations are needed to determine the MS-CADIS parameter for the neutron interactions that produce radioisotopes contributing to the SDDR. The MS-CADIS parameter is the microscopic cross section of the radioisotope-producing interaction, multiplied by the mass of this radioisotope existing at the end of the irradiation and decay scenario, and divided by the steady-state rate of the interaction. Because the activation calculations are performed for each radionuclide in each mesh element, implementation of the MS-CADIS method can be computationally expensive. However, these neutron transport and activation calculations are not needed if we assume that the radioisotopes are created due to single neutron interactions and their concentrations do not change as a result of burnup by neutron irradiation. The use of this approximation, which renders the MS-CADIS parameter independent of the neutron flux, seems reasonable in calculating the MS-CADIS importance function because this function is needed only to speed up the MC calculation, not to calculate the final SDDR. In this work, we investigate the validity of this approximation by investigating the behavior of the MS-CADIS parameter as a function of the neutron flux spectra in the Fusion Evaluated Nuclear Data Library (FENDL) Neutronics and Shielding Benchmark problem that contains representative isotopes and flux environments of fusion energy systems. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Discretization Error Estimation and Control for Farfield Acoustic Signatures

We investigate the utility of adjoint-based error estimates for sonic boom farfield simulations governed by solutions of the augmented Burgers’ equation. Solution of this nonlinear system uses operator splitting with a second-order finite volume discretization in space and second-order Runge-Kutta time marching, while the absorption and molecular relaxation are solved using second-order central differencing. The discretization error in selected ground sonic boom cost functionals is estimated using the method of adjoint-weighted residuals. Key elements of the implementation process are emphasized with details provided on the practical aspects as appliedto the sonic boom farfield propagation. We establish the accuracy of the adjoint solutions usingcomplex step and finite difference approaches, and examine the accuracy of the error estimates using analytical N-wave solutions. We then apply it to a pressure waveform corresponding to the X-59 research aircraft. The investigations demonstrate that the method of adjoint-weighted residuals accurately predicts the level of discretization error present in sonic boom farfield simulations while offering insight into which features of the near field signal are the primary drivers of ground noise metrics. The numerical results indicate that at sampling frequencies as low as50kHz, discretization error in the propagation is under 0.01 dB[A] for realistically complex examples.

CST↗

A posteriori error estimation for multi-stage Runge–Kutta IMEX schemes

Implicit–Explicit (IMEX) schemes are widely used for time integration methods for approximating solutions to a large class of problems. In this work, we develop accurate a posteriori error estimates of a quantity-of-interest for approximations obtained from multi-stage IMEX schemes. This is done by first defining a finite element method that is nodally equivalent to an IMEX scheme, then using typical methods for adjoint-based error estimation. Furthermore, the use of a nodally equivalent finite element method allows a decomposition of the error into multiple components, each describing the effect of a different portion of the method on the total error in a quantity-of-interest.

97 MATHEMATICS AND COMPUTING↗

Adjoint Waveform Tomography for Next Generation Seismic Analyses and Monitoring

The development of methods and capabilities to compute complete waveform simulations in three-dimensional (3D) Earth models along with adjoint methods for computing the fully 3D sensitivity kernels in the 2000's set the stage for new advances in seismic imaging. I believe that the full benefits of adjoint waveform tomography (AWT) are not yet fully realized and this will be an important direction for the future of seismic tomography.

58 GEOSCIENCES↗

Sensitivity analysis of discrete structural systems: A survey

Methods for calculating sensitivity derivatives for discrete structural systems are surveyed, primarily covering literature published during the past two decades. Methods are described for calculating derivatives of static displacements and stresses, eigenvalues and eigenvectors, transient structural response, and derivatives of optimum structural designs with respect to problem parameters. The survey is focused on publications addressed to structural analysis, but also includes a number of methods developed in nonstructural fields such as electronics, controls, and physical chemistry which are directly applicable to structural problems. Most notable among the nonstructural-based methods are the adjoint variable technique from control theory, and the Green's function and FAST methods from physical chemistry.

Adelman, H. M.↗

Sensitivity analysis of discrete structural systems

Methods for calculating sensitivity derivatives for discrete structural systems are surveyed, primarily covering literature published during the past two decades. Methods are described for calculating derivatives of static displacements and stresses, eigenvalues and eigenvectors, transient structural response, and derivatives of optimum structural designs with respect to problem parameters. The survey is focused on publications developed in nonstructural fields such as electronics, controls, and physical chemistry which are directly applicable to structural problems. Most notable among the nonstructural-based methods are the adjoint variable technique from control theory, and the Green's function and FAST methods from physical chemistry.

Adelman, H. M.↗

Probability density adjoint for sensitivity analysis of the Mean of Chaos

Sensitivity analysis, especially adjoint based sensitivity analysis, is a powerful tool for engineering design which allows for the efficient computation of sensitivities with respect to many parameters. However, these methods break down when used to compute sensitivities of long-time averaged quantities in chaotic dynamical systems. This paper presents a new method for sensitivity analysis of ergodic chaotic dynamical systems, the density adjoint method. The method involves solving the governing equations for the system's invariant measure and its adjoint on the system's attractor manifold rather than in phase-space. This new approach is derived for and demonstrated on one-dimensional chaotic maps and the three-dimensional Lorenz system. It is found that the density adjoint computes very finely detailed adjoint distributions and accurate sensitivities, but suffers from large computational costs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Efficient Gradient-Based Shape Optimization Methodology Using Inviscid/Viscous CFD

The formerly developed preconditioned-biconjugate-gradient (PBCG) solvers for the analysis and the sensitivity equations had resulted in very large error reductions per iteration; quadratic convergence was achieved whenever the solution entered the domain of attraction to the root. Its memory requirement was also lower as compared to a direct inversion solver. However, this memory requirement was high enough to preclude the realistic, high grid-density design of a practical 3D geometry. This limitation served as the impetus to the first-year activity (March 9, 1995 to March 8, 1996). Therefore, the major activity for this period was the development of the low-memory methodology for the discrete-sensitivity-based shape optimization. This was accomplished by solving all the resulting sets of equations using an alternating-direction-implicit (ADI) approach. The results indicated that shape optimization problems which required large numbers of grid points could be resolved with a gradient-based approach. Therefore, to better utilize the computational resources, it was recommended that a number of coarse grid cases, using the PBCG method, should initially be conducted to better define the optimization problem and the design space, and obtain an improved initial shape. Subsequently, a fine grid shape optimization, which necessitates using the ADI method, should be conducted to accurately obtain the final optimized shape. The other activity during this period was the interaction with the members of the Aerodynamic and Aeroacoustic Methods Branch of Langley Research Center during one stage of their investigation to develop an adjoint-variable sensitivity method using the viscous flow equations. This method had algorithmic similarities to the variational sensitivity methods and the control-theory approach. However, unlike the prior studies, it was considered for the three-dimensional, viscous flow equations. The major accomplishment in the second period of this project (March 9, 1996 to March 8, 1997) was the extension of the shape optimization methodology for the Thin-Layer Navier-Stokes equations. Both the Euler-based and the TLNS-based analyses compared with the analyses obtained using the CFL3D code. The sensitivities, again from both levels of the flow equations, also compared very well with the finite-differenced sensitivities. A fairly large set of shape optimization cases were conducted to study a number of issues previously not well understood. The testbed for these cases was the shaping of an arrow wing in Mach 2.4 flow. All the final shapes, obtained either from a coarse-grid-based or a fine-grid-based optimization, using either a Euler-based or a TLNS-based analysis, were all re-analyzed using a fine-grid, TLNS solution for their function evaluations. This allowed for a more fair comparison of their relative merits. From the aerodynamic performance standpoint, the fine-grid TLNS-based optimization produced the best shape, and the fine-grid Euler-based optimization produced the lowest cruise efficiency.

Baysal, Oktay↗

Three-dimensional traction microscopy accounting for cell-induced matrix degradation

Tractions exerted by cells on the extracellular matrix (ECM) are critical in many important physiological and pathological processes such as embryonic morphogenesis, wound healing, and cancer metastasis. Three-dimensional Traction Microscopy (3DTM) is a tool to quantify cellular tractions by first measuring the displacement field in the ECM in response to these tractions, and then using this measurement to infer tractions. Most applications of 3DTM have assumed that the ECM has spatially-uniform mechanical properties, but cells secrete enzymes that can locally degrade the ECM. In this work, a novel computational method is developed to quantify both cellular tractions and ECM degradation. In particular, the ECM is modeled as a hyperelastic, Neo-Hookean solid, whose material parameters are corrupted by a single degradation parameter. The feasibility of determining both the traction and the degradation parameter is first demonstrated by showing the existence and uniqueness of the solution. An inverse problem is then formulated to determine the nodal values of the traction vector and the degradation parameter, with the objective of minimizing the difference between a predicted and measured displacement field, under the constraint that the predicted displacement field satisfies the equation of equilibrium. The inverse problem is solved by means of a gradient-based optimization approach, and the gradient is computed efficiently using appropriately derived adjoint fields. The computational method is validated in-silico using a geometrically realistic neuronal cell model and synthetic traction and degradation fields. It is found that the method accurately recovers both the traction and degradation fields. Moreover, it is found that neglecting ECM degradation can yield significant errors in traction measurements. Finally, our method can extend the range of context where tractions can be appropriately measured.

42 ENGINEERING↗

Monte Carlo Perturbation Theory Estimates of Sensitivities to System Dimensions

Here, Monte Carlo methods are developed using adjoint-based perturbation theory and the differential operator method to compute the sensitivities of the k-eigenvalue, linear functions of the flux (reaction rates), and bilinear functions of the forward and adjoint flux (kinetics parameters) to system dimensions for uniform expansions or contractions. The calculation of sensitivities to system dimensions requires computing scattering and fission sources at material interfaces using collisions occurring at the interface—which is a set of events with infinitesimal probability. Kernel density estimators are used to estimate the source at interfaces using collisions occurring near the interface. The methods for computing sensitivities of linear and bilinear ratios are derived using the differential operator method and adjoint-based perturbation theory and are shown to be equivalent to methods previously developed using a collision history–based approach. The methods for determining sensitivities to system dimensions are tested on a series of fast, intermediate, and thermal critical benchmarks as well as a pressurized water reactor benchmark problem with iterated fission probability used for adjoint-weighting. The estimators are shown to agree within 5% and 3σ of reference solutions obtained using direct perturbations with central differences for the majority of test problems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

An optimized treatment for algorithmic differentiation of an important glaciological fixed-point problem

We apply an optimized method to the adjoint generation of a time-evolving land ice model through algorithmic differentiation (AD). The optimization involves a special treatment of the fixed-point iteration required to solve the nonlinear stress balance, which differs from a straightforward application of AD software, and leads to smaller memory requirements and in some cases shorter computation times of the adjoint. The optimization is done via implementation of the algorithm of Christianson (1994) for reverse accumulation of fixed-point problems, with the AD tool OpenAD. For test problems, the optimized adjoint is shown to have far lower memory requirements, potentially enabling larger problem sizes on memory-limited machines. In the case of the land ice model, implementation of the algorithm allows further optimization by having the adjoint model solve a sequence of linear systems with identical (as opposed to varying) matrices, greatly improving performance. Finally, the methods introduced here will be of value to other efforts applying AD tools to ice models, particularly ones which solve a hybrid shallow ice/shallow shelf approximation to the Stokes equations.

58 GEOSCIENCES↗

Photon detector response function methodology using MCNP and shift hybrid radiation transport code for wide-area contamination assay applications

Here, radiation transport modeling using the Monte Carlo N-Particle (MCNP) radiation transport code and Monte Carlo code, Shift, were employed to model detector responses for a variety of wide-area photon contamination scenarios. In this study, 2" × 2" and 3" × 3" cylindrical NaI(Tl) scintillation detector configurations at source detector-distances of 0.5 cm, 1 cm, 2.54 cm, 10 cm, and 30 cm were modeled. Media of soil, concrete, and steel were evaluated for contamination depths ranging from surface to a depth of an infinite thickness in each medium for photon energies ranging from 20 keV to 3 MeV, which correspond to the energies that current detectors can discern. Monoenergetic photon surface contamination detector responses for each of the media, source–detector distances, and detectors were estimated using MCNP v6.2. Shift was harnessed for improved variance reduction of particle transport in highly attenuating media to obtain average cell fluxes in the two MCNP NaI(Tl) scintillation detector configurations. Average cell flux values in Shift were coupled with detector responses from MCNP to convert average cell flux in a void to energy distribution of pulses in the NaI(Tl) scintillation detector crystal of interest. An optimized detector response function methodology was developed by coupling the MCNP radiation transport method with the Consistent Adjoint Driven Importance Sampling (CADIS) hybrid radiation transport method built into Shift to significantly decrease the runtime of thousands of MCNP pulse height simulations. The methodology may be utilized to quickly and accurately facilitate the assessment of a broad range of wide-area environmental contamination assay and decommissioning cleanup applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Improved Hybrid Modeling of Spent Fuel Storage Facilities

This work developed a new computational method for improving the ability to calculate the neutron flux in deep-penetration radiation shielding problems that contain areas with strong streaming. The “gold standard” method for radiation transport is Monte Carlo (MC) as it samples the physics exactly and requires few approximations. Historically, however, MC was not useful for shielding problems because of the computational challenge of following particles through dense shields. Instead, deterministic methods, which are superior in term of computational effort for these problems types but are not as accurate, were used. Hybrid methods, which use deterministic solutions to improve MC calculations through a process called variance reduction, can make it tractable from a computational time and resource use perspective to use MC for deep-penetration shielding. Perhaps the most widespread and accessible of these methods are the Consistent Adjoint Driven Importance Sampling (CADIS) and Forward-Weighted CADIS (FW-CADIS) methods. For problems containing strong anisotropies, such as power plants with pipes through walls, spent fuel cask arrays, active interrogation, and locations with small air gaps or plates embedded in water or concrete, hybrid methods are still insufficiently accurate. In this work, a new method for generating variance reduction parameters for strongly anisotropic, deep penetration radiation shielding studies was developed. This method generates an alternate form of the adjoint scalar flux quantity, Φ Ω , which is used by both CADIS and FW-CADIS to generate variance reduction parameters for local and global response functions, respectively. The new method, called CADIS-Ω, was implemented in the Denovo/ADVANTG software. Results indicate that the flux generated by CADIS-Ω incorporates localized angular anisotropies in the flux more effectively than standard methods. CADIS-Ω outperformed CADIS in several test problems. This initial work indicates that CADIS- may be highly useful for shielding problems with strong angular anisotropies. This is a benefit to the public by increasing accuracy for lower computational effort for many problems that have energy, security, and economic importance.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗