Search NASA⌕ Search

SEARCH · Search NASA

Results for “algorithmic differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

An inexact semismooth Newton method with application to adaptive randomized sketching for dynamic optimization

In many applications, one can only access the inexact gradients and inexact hessian times vector products. Thus it is essential to consider algorithms that can handle such inexact quantities with a guaranteed convergence to solution. An inexact adaptive and provably convergent semismooth Newton method is considered to solve constrained optimization problems. In particular, dynamic optimization problems, which are known to be highly expensive, are the focus. A memory efficient semismooth Newton algorithm is introduced for these problems. The source of efficiency and inexactness is the randomized matrix sketching. Further, applications to optimization problems constrained by partial differential equations are also considered.

97 MATHEMATICS AND COMPUTING↗

Fast methods for multisite charge transfer. Processes II. Analytic nuclear gradients and nonadiabatic dynamics for cCASSCF(1,n) and cCASSCF(2n-1,n) wavefunctions

In this work we derive and implement analytic nuclear gradients and derivative couplings for a constrained complete active space self-consistent field with a small active space designed to model electron or hole transfer. Using a Lagrangian formalism, we are able to differentiate both the CASSCF energy and the constraint (which is required for smooth surfaces over a wide range of parameter space), and the resulting efficient algorithm can be immediately applied to nonadiabatic dynamics simulations of charge transfer processes. Here, we run initial surface-hopping simulations of a proton coupled electron transfer event for a phenoxyl–phenol system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A differentiable perturbation-based weak lensing shear estimator

Upcoming imaging surveys will use weak gravitational lensing to study the large-scale structure of the Universe, demanding sub-per cent accuracy for precise cosmic shear measurements. We present a new differentiable implementation of our perturbation-based shear estimator (fpfs), using jax, which is publicly available as part of a new suite of analytic shear algorithms called anacal. This code can analytically calibrate the shear response of any non-linear observable constructed with the fpfs shapelets and detection modes utilizing autodifferentiation (ad), generalizing the formalism to include a family of shear estimators with corrections for detection and selection biases. Using the ad capability of jax, it calculates the full Hessian matrix of the non-linear observables, which improves the previously presented second-order noise bias correction in the shear estimation. As an illustration of the power of the new anacal framework, we optimize the effective galaxy number density in the space of the generalized shear estimators using an LSST-like galaxy image simulation for the 10 yr LSST. For the generic shear estimator, the magnitude of the multiplicative bias |m| is below 3 × 10 –3 (99.7 per cent confidence interval), and the effective galaxy number density is improved by 5 per cent. We also discuss some planned future additions to the anacal software suite to extend its applicability beyond the fpfs measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-Resolution X-Ray Lensless Imaging by Differential Holographic Encoding

X-ray free electron lasers (X-FELs) will soon offer femtosecond pulses of laterally coherent x-rays with sufficient intensity to record single-shot coherent scattering patterns for nanoscale imaging. Pulse trains created by split and- delay techniques even open the door for cinematography on unprecedented nanometer length and femtosecond time scales. A key to real space ultrafast motion pictures is fast and reliable inversion of the recorded reciprocal space scattering patterns. Here we for the first time demonstrate in the x-ray regime the power of a novel technique for lensless high resolution imaging, previously suggested by Guizar-Sicairos and Fienup termed holography with extended reference by autocorrelation linear differential operation, HERALD0. We have achieved superior resolution over conventional x-ray Fourier transform holography (FTH) without sacrifices in SNR or significant increase in algorithmic complexity. By combining images obtained from individual sharp features on an extended reference, we further show that the resolution can be even extended beyond the reference fabrication limits. Direct comparison to iterative phase retrieval image reconstruction and images recorded with state of-the-art zone plate microscopes is presented. Our results demonstrate the power of HERALDO as a favorable candidate for robust inversion of single-shot coherent scattering patterns.

36 MATERIALS SCIENCE↗

Assessment of Calibration Approaches for the Stress Relaxation Test

Advanced manufacturing technologies are enabling the next generation of superalloys for extreme temperatures, pressures, and longevity. There is a need for Accelerated Creep Test (ACT) methods to reduce the time needed to implement new creep resistant superalloys. Without the development of ACTs, the qualification of new superalloys using conventional creep tests can take 11+ years corresponding to the 100,000-hour service life of long-lived turbomachinery components. A refined stress relaxation test (SRT) is introduced to succeed real-time conventional creep tests (CCTs). The stress relaxation test generates extensive stress versus creep-strain-rate data within a single specimen. Since the specimen is held below the elastic limit and relatively little creep deformation has occurred, several SRTs at different temperatures can be performed using a single specimen. To obtain data, specimens are rapidly loaded in force-control to just below the elastic limit. The specimen is switched to displacement-control and held at a fixed displacement while stress relaxation occurs. This generates a stress versus time curve that must be converted into stress versus creep-strain-rate. The stress versus creep-strain-rate curves are utilized to calculate creep activation energy and produce a creep-strain-rate master curve. The objective of this study is to determine the best calibration approach for SRT: regression of stress, regression of creep strain, and the finite difference of creep strain. It is recommended that the differentiation be applied; however, finite difference applied to the raw data produces inconsistent calculations of the creep-strain-rate. In this study, a MATLAB algorithm is written to evaluate all three calibration options where, stress and creep deformation are regressed into natural logarithm functions. The resulting creep-strain-rate curves are compared to determine the most reliable and consistent method. Analyzing and evaluating the results the regression of stress and regression or creep strain calibration methods prove to provide accurate results. These methods will help replace CCTs by conducting less expensive ACTs, while increasing the overall efficiency of the development of new materials.

36 MATERIALS SCIENCE↗

The PENELOPE Physics Models and Transport Mechanics. Implementation into Geant4

A translation of the PENELOPE physics subroutines to C++, designed as an extension of the GEANT4 toolkit, is presented. The Fortran code system PENELOPE performs Monte Carlo simulation of coupled electron-photon transport in arbitrary materials for a wide energy range, nominally from 50 eV up to 1 GeV. PENELOPE implements the most reliable interaction models that are currently available, limited only by the required generality of the code. In addition, the transport of electrons and positrons is simulated by means of an elaborate class II scheme in which hard interactions (involving deflection angles or energy transfers larger than pre-defined cutoffs) are simulated from the associated restricted differential cross sections. After a brief description of the interaction models adopted for photons and electrons/positrons, we describe the details of the class-II algorithm used for tracking electrons and positrons. The C++ classes are adapted to the specific code structure of GEANT4. They provide a complete description of the interactions and transport mechanics of electrons/positrons and photons in arbitrary materials, which can be activated from the G4ProcessManager to produce simulation results equivalent to those from the original PENELOPE programs. The combined code, named PENG4, benefits from the multi-threading capabilities and advanced geometry and statistical tools of GEANT4.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Generic Biogeochemical Module for Earth System Models: Next Generation BioGeoChemical Module (NGBGC), Version 1.0

Physical and biogeochemical processes regulate soil carbon dynamics and CO2 flux to and from atmosphere, influencing global climate changes. Integration of these processes into earth system models (e.g., community land models (CLM)), however, currently faces three major challenges: 1) extensive efforts are required to modify modeling structures and to rewrite computer programs to incorporate new or updated processes as new knowledge is being generated, 2) computational cost is prohibitively expensive to simulate biogeochemical processes in land models due to large variations in the rates of biogeochemical processes, and 3) various mathematical representations of biogeochemical processes exist to incorporate different aspects of fundamental mechanisms, but systematic evaluation of the different mathematical representations is difficult, if not possible. To address these challenges, we propose a new computational framework to easily incorporate physical and biogeochemical processes into land models. The new framework consists of a new biogeochemical module with a generic algorithm and reaction database so that new and updated processes can be incorporated into land models without the need to manually set up the ordinary differential equations to be solved numerically. The reaction database consists of processes of nutrient flow through the terrestrial ecosystems in plants, litter and soil. This framework facilitates effective comparison studies of biogeochemical cycles in an ecosystem using different conceptual models under the same land modeling framework. The approach was first implemented in CLM and benchmarked against simulations from the original CLM-CN code. A case study was then provided to demonstrate the advantages of using the new approach to incorporate a phosphorus cycle into the CLM model. To our knowledge, the phosphorus-incorporated CLM is a new model that can be used to simulate phosphorus limitation on the productivity of terrestrial ecosystems.

Fang, Yilin↗

Sequential triangulation of orbital photography

The feasibility of structuring the satellite photogrammetric triangulation as an iterative Extended Kalman estimation algorithm is demonstrated. Comparative numerical results of the sequential against batch estimation algorithm are presented. Difficulty of accurately modeling of the attitude motion is overcome by utilizing the on-board angular rate measurements. Solutions of the differential equations and the evaluation of state transition matrix are carried out numerically.

Rajan, M.↗

Stability analysis of numerical boundary conditions and implicit difference approximations for hyperbolic equations

Implicit, noniterative, finite difference schemes were recently developed by several authors for multidimensional systems of nonlinear hyperbolic partial differential equations. When applied to linear model equations with periodic boundary conditions those schemes are unconditionally stable (A-stable). As applied in practice the algorithms often face a severe time step restriction. A major source of the difficulty is the treatment of the numerical boundary conditions. One conjecture was that unconditional stability requires implicit numerical boundary conditions. An apparent counter example was the space time extrapolation considered by Gustafsson, Kreiss, and Sunstrom. Spatial (implicit) and space time (explicit) extrapolation using normal mode analysis for a finite and infinite number of spatial mesh intervals are examined. The results indicate that for unconditional stability with a finite number of spatial mesh intervals, the numerical boundary conditions must be implicit.

Beam, R. M.↗

Solidification of a binary mixture

The time dependent concentration and temperature profiles of a finite layer of a binary mixture are investigated during solidification. The coupled time dependent Stefan problem is solved numerically using an implicit finite differencing algorithm with the method of lines. Specifically, the temporal operator is approximated via an implicit finite difference operator resulting in a coupled set of ordinary differential equations for the spatial distribution of the temperature and concentration for each time. Since the resulting differential equations set form a boundary value problem with matching conditions at an unknown spatial point, the method of invariant imbedding is used for its solution.

Antar, B. N.↗

Control-System Design Program

Control-theory design package, Optimal Regulator Algorithms for Control of Linear Systems (ORACLS), developed to aid in design of controllers and optimal filters for systems modeled by linear, time-invariant differential and difference equations. Optimal linear quadratic regulator theory, Linear-Quadratic-Gaussian (LQG) problem, most widely accepted method of determining optimal control policy. Provides for solution to time-in-variant continuous or discrete LQG problems. Attractive to control-system designer providing rigorous tool for dealing with multi-input and multi-output dynamic systems in continuous and discrete form. CDO version written in FORTRAN IV. VAX version written in FORTRAN 77.

Frisch, Harold P.↗

An approach to probabilistic finite element analysis using a mixed-iterative formulation

An efficient algorithm for computing the response sensitivity of finite element problems based on a mixed-iterative formulation is proposed. This method does not involve explicit differentiation of the tangent stiffness array and can be used with formulations for which a consistent tangent stiffness is not readily available. The method has been successfully applied to probabilistic finite element analysis of problems using the proposed mixed formulation, and this exercise has provided valuable insights regarding the extension of the method to a more general class of problems to include material and geometric nonlinearities.

Dias, J. B.↗

Research highlights: June 1990 - May 1991

Linear instability calculations at MSFC have suggested that the Geophysical Fluid Flow Cell (GFFC) should exhibit classic baroclinic instability at accessible parameter settings. Interest was in the mechanisms of transition to temporal chaos and the evolution of spatio-temporal chaos. In order to understand more about such transitions, high resolution numerical experiments for the physically simplest model of two layer baroclinic instability were conducted. This model has the advantage that the numerical code is exponentially convergent and can be efficiently run for very long times, enabling the study of chaotic attractors without the often devastating effects of low-order trunction found in many previous studies. Numerical algorithms for implementing an empirical orthogonal function (EOF) analysis of the high resolution numerical results were completed. Under conditions of rapid rotation and relatively low differential heating, convection in a spherical shell takes place as columnar banana cells wrapped around the annular gap, but with axes oriented along the axis of rotation; these were clearly evident in the GFFC experiments. The results of recent numerical simulations of columnar convection and future research plans are presented.

Source record↗

Computational Study of Flow Establishment in Hypersonic Pulse Facilities

This paper presents a study of the temporal evolution of the combustion flowfield established by the interaction of ram-accelerator-type projectiles with an explosive gas mixture accelerated to hypersonic speeds in an expansion tube. The Navier-Stokes equations for a chemically reacting gas are solved in a fully coupled manner using an implicit, time accurate algorithm. The solution procedure is based on a spatially second order, total variation diminishing (TVD) scheme and a temporally second order, variable-step, backward differentiation formula method. The hydrogen-oxygen chemistry is modeled with a 9-species, 19-step mechanism. The accuracy of the solution method is first demonstrated by several benchmark calculations. Numerical simulations of expansion tube flowfields are then presented for two different configurations. In particular, the development of the shock-induced combustion process is followed. In one case, designed to ensure ignition only in the boundary layer, the lateral extent of the combustion front during the initial transient phase was surprisingly large. The time histories of the calculated thrust and drag forces on the ram accelerator projectile are also presented.

Yungster, S.↗

Differential Adaptive Stress Testing of Airborne Collision Avoidance Systems

The next-generation Airborne Collision Avoidance System (ACAS X) is currently being developed and tested to replace the Traffic Alert and Collision Avoidance System (TCAS) as the next international standard for collision avoidance. To validate the safety of the system, stress testing in simulation is one of several approaches for analyzing near mid-air collisions (NMACs). Understanding how NMACs can occur is important for characterizing risk and informingdevelopment of the system. Recently, adaptive stress testing (AST) has been proposed as a way to find the most likely path to a failure event. The simulation-based approach accelerates search by formulating stress testing as a sequential decision process then optimizing it using reinforcement learning. The approach has been successfully applied to stress test a prototype of ACAS Xin various simulated aircraft encounters. In some applications, we are not as interestedin the system's absolute performance as its performance relative to another system. Such situations arise, for example, during regression testing or when deciding whether a new system should replace an existing system. In our collision avoidance application, we are interested in finding cases where ACAS X fails but TCAS succeeds in resolving a conflict. Existing approaches do not provide an efficient means to perform this type of analysis. This paper extends the AST approach to differential analysis by searching two simulators simultaneously and maximizing the difference between their outcomes. We call this approach differential adaptive stress testing (DAST). We apply DAST to compare a prototype of ACAS X against TCAS and show examples of encounters found by the algorithm.

Lee, Ritchie↗

SUNDIALS time integrators for exascale applications with many independent systems of ordinary differential equations

Many complex systems can be accurately modeled as a set of coupled time-dependent partial differential equations (PDEs). However, solving such equations can be prohibitively expensive, easily taxing the world’s largest supercomputers. One pragmatic strategy for attacking such problems is to split the PDEs into components that can more easily be solved in isolation. This operator splitting approach is used ubiquitously across scientific domains, and in many cases leads to a set of ordinary differential equations (ODEs) that need to be solved as part of a larger “outer-loop” time-stepping approach. The SUNDIALS library provides a plethora of robust time integration algorithms for solving ODEs, and the U.S. Department of Energy Exascale Computing Project (ECP) has supported its extension to applications on exascale-capable computing hardware. In this paper, we highlight some SUNDIALS capabilities and its deployment in combustion and cosmology application codes (Pele and Nyx, respectively) where operator splitting gives rise to numerous, small ODE systems that must be solved concurrently.

97 MATHEMATICS AND COMPUTING↗

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗

Convolutional Neural Networks for Hydrometeor Classification using Dual Polarization Doppler Radars

Traditional fuzzy logic hydrometeor classification algorithm is a common way to classify precipitation type from dual polarization doppler radar. We propose a deep learning-based method to estimate hydrometeors efficiently using observed radar variables such as horizontal reflectivity (Z H ), differential reflectivity (Z DR ), correlation coefficient (ρ HV ) and specific differential phase (K DP ) from National Weather Service NEXRAD collected at Vance AFB facility at the first elevation angle from January 1st, 2015 to July 31th, 2019. We stack matrices of values from these four polarimetric variables as one 3D array. Samples are preprocessed and divided into training, validation and test set with four target hydrometeor categories (Ice Crystals (IC), Dry Snow (DS), Light and/or Moderate Rain (RA) and Big Drops (rain) (BD)). We developed and optimized five Convolutional Neural Networks (CNNs) architectures and achieved an accuracy of 87.23% and 93.736% respectively using modified ResNet with two different input data selection strategies for hydrometeor classification. Training data selection strategies were important to ensure use of available samples in training for robust performance evaluated by applying the models to novel time period beyond what was use to train the model. Seasonal variation in atmospheric conditions lead to seasonal patterns of liquid vs solid forms of precipitation, that poses challenge for classifier and offer insights into domain specific approaches required for problem of hydrometeor identification. Computationally efficient and scalable approach for classification of hydrometeors offer opportunties to effectively use the large volumes of rich time series of radar observations that are becoming increasingly available.

Lu, Yuping↗