Search NASA⌕ Search

SEARCH · Search NASA

Results for “algorithmic differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

A broadband gamma-ray spectrometry using novel unfolding algorithms for characterization of laser wakefield-generated betatron radiation

We present a high-flux, broadband gamma-ray spectrometry capable of characterizing the betatron radiation spectrum over the photon energy range from 10 keV to 20 MeV with respect to the peak photon energy, spectral bandwidth, and unique discrimination from background radiations, using a differential filtering spectrometer and the unfolding procedure based on the Monte Carlo code GEANT4. These properties are experimentally verified by measuring betatron radiation from a cm-scale laser wakefield accelerator (LWFA) driven by a 1-PW laser, using a differential filtering spectrometer consisting of a 15-filter and image plate stack. The gamma-ray spectra were derived by unfolding the photostimulated luminescence (PSL) values recorded on the image plates, using the spectrometer response matrix modeled with the Monte Carlo code GEANT4. The accuracy of unfolded betatron radiation spectra was assessed by unfolding the test PSL data simulated with GEANT4, showing an ambiguity of less than 20% and clear discrimination from the background radiation with less than 10%. The spectral analysis of betatron radiation from laser wakefield-accelerated electron beams with energies up to 3 GeV revealed radiation spectra characterized by synchrotron radiation with the critical photon energy up to 7 MeV. The gamma-ray spectrometer and unfolding method presented here facilitate an in-depth understanding of betatron radiation from LWFA process and a novel radiation source of high-quality photon beams in the MeV regime.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Power System Frequency Dynamics Modeling, State Estimation, and Control using Neural Ordinary Differential Equations (NODEs) and Soft Actor-Critic (SAC) Machine Learning Approaches

With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.

97 MATHEMATICS AND COMPUTING↗

Time sequence determination of parent–daughter radionuclides using gamma-spectrometry

The acquisition of time-stamped list (TLIST) data provides additional information useful to gamma-spectrometry analysis. A novel technique is described that uses non-linear least-squares fitting and the Levenberg-Marquardt algorithm to simultaneously determine parent-daughter atoms from time sequence measurements of only the daughter radionuclide. This has been demonstrated for the radioactive decay of short-lived radon progeny (214Pb/214Bi, 212Pb/212Bi) described using the Bateman first-order differential equation. The calculated atoms are in excellent agreement with measured atoms, with a difference of 1.3 – 4.8% for parent atoms and 2.4% - 10.4% for daughter atoms. Measurements are also reported with reduced uncertainty. The technique has potential to redefine gamma-spectrometry analysis.

Burnett, J. L. (ORCID:0000000322586252)↗

Cardiac Amyloidosis: Updates in Imaging

Purpose of Review: We summarize key features pertaining to the two most commonly encountered types of cardiac amyloidosis (CA), monoclonal immunoglobulin light chain (AL) and transthyretin type (ATTR), expanding upon the clinical application and utility of various imaging techniques in diagnosing CA. Recent Findings: Advances in imaging have led to earlier identification, improved diagnosis of CA and higher discriminatory power to differentiate CA from other hypertrophic phenocopies. The application of cardiac magnetic resonance imaging (CMR) has led to a deeper understanding of underlying pathophysiological processes in CA, owing largely to its intrinsic tissue characterization properties. The widespread adoption of bone scintigraphy algorithms has reduced the need for cardiac biopsy and improved diagnostic confidence in ATTR CA. Summary: As new treatments for CA are rapidly developing, there will be even greater reliance on imaging, as the requirement to diagnose disease earlier, monitor response and amend treatment strategies accordingly intensifies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Collocation methods for nonlinear differential equations on low-rank manifolds

We introduce new methods for integrating nonlinear differential equations on low-rank manifolds. These methods rely on interpolatory projections onto the tangent space, enabling low-rank time integration of vector fields that can be evaluated entry-wise. A key advantage of our approach is that it does not require the vector field to exhibit low-rank structure, thereby overcoming significant limitations of traditional dynamical low-rank methods based on orthogonal projection. To construct the interpolatory projectors, we develop a sparse tensor sampling algorithm based on the discrete empirical interpolation method (DEIM) that parameterizes tensor train manifolds and their tangent spaces with cross interpolation. Using these projectors, we propose two time integration schemes on low-rank tensor train manifolds. The first scheme integrates the solution at selected interpolation indices and constructs the solution with cross interpolation. The second scheme generalizes the well-known orthogonal projector-splitting integrator to interpolatory projectors. We demonstrate the proposed methods with applications to several tensor differential equations arising from the discretization of partial differential equations.

97 MATHEMATICS AND COMPUTING↗

Measurement of the radius dependence of charged-particle jet suppression in Pb–Pb collisions at $\sqrt{s_{NN}}=5.02$ TeV

The ALICE Collaboration reports a differential measurement of inclusive jet suppression using pp and Pb–Pb collision data at a center-of-mass energy per nucleon–nucleon collision $\sqrt{s_{NN}}=5.02$ TeV. Charged-particle jets are reconstructed using the anti-$k_T$ algorithm with resolution parameters R=0.2, 0.3, 0.4, 0.5, and 0.6 in pp collisions and R=0.2, 0.4, 0.6 in central (0–10%), semi-central (30–50%), and peripheral (60–80%) Pb–Pb collisions. A novel approach based on machine learning is employed to mitigate the influence of jet background. This enables measurements of inclusive jet suppression in new regions of phase space, including down to the lowest jet $p_T$ ≥ 40 GeV/c at R=0.6 in central Pb–Pb collisions. This is an important step for discriminating different models of jet quenching in the quark–gluon plasma. The transverse momentum spectra, nuclear modification factors, derived cross section, and nuclear modification factor ratios for different jet resolution parameters of charged-particle jets are presented and compared to model predictions. A mild dependence of the nuclear modification factor ratios on collision centrality and resolution parameter is observed. The results are compared to a variety of jet-quenching models with varying levels of agreement.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Heterogeneous Graph Neural Network for identifying hadronically decayed tau leptons at the High Luminosity LHC

Here, we present a new algorithm that identifies reconstructed jets originating from hadronic decays of tau leptons against those from quarks or gluons. No tau lepton reconstruction algorithm is used. Instead, the algorithm represents jets as heterogeneous graphs with tracks and energy clusters as nodes and trains a Graph Neural Network to identify tau jets from other jets. Different attributed graph representations and different GNN architectures are explored. We propose to use differential track and energy cluster information as node features and a heterogeneous sequentially-biased encoding for the inputs to final graph-level classification.

47 OTHER INSTRUMENTATION↗

TAS: 89 0227: TAS Recovery Act - Optimization and Control of Electric Power Systems: ARRA

The name SuperOPF is used to refer several projects, problem formulations and soft-ware tools intended to extend, improve and re-define some of the standard methods of optimizing electric power systems. Our work included applying primal-dual interior point methods to standard AC optimal power flow problems of large size, as well as extensions of this problem to include co-optimization of multiple scenarios. The original SuperOPF problem formulation was based on co-optimizing a base scenario along with multiple post-contingency scenarios, where all AC power flow models and constraints are enforced for each, to find optimal energy contracts, endogenously determined locational reserves and appropriate nodal energy prices for a single period optimal power flow problem with uncertainty. This led to example non-linear programming problems on the order of 1 million constraints and half a million variables. The second generation SuperOPF formulation extends this by adding multiple periods and multiple base scenarios per period. It also incorporates additional variables and constraints to model load following reserves, ramping costs, and storage resources. A third generation of the multi-period SuperOPF, adds both integer variables and a receding horizon framework in which the problem type is more challenging (mixed integer), the size is even larger, and it must be solved more frequently, pushing the limits of currently available algorithms and solvers. The consideration of transient stability constraints in optimal power flow (OPF) problems has become increasingly important in modern power systems. Transient stability constrained OPF (TSCOPF) is a nonlinear optimization problem subject to a set of algebraic and differential equations. Solving a TSCOPF problem can be challenging due to (i) the differential-equation constraints in an optimization problem, (ii) the lack of a true analytical expression for transient stability in OPF. To handle the dynamics in TSCOPF, the set of differential equations can be approximated or converted into equivalent algebraic equations before they are included in an OPF formulation. In Chapter 4, a rigorous evaluation of using a predefined and fixed threshold for rotor angles as a mean to determine transient stability of the system is developed. TSCOPF can be modeled as a large-scale nonlinear programming problem including the constraints of differential-algebraic equations (DAE). Solving a TSCOPF problem can be challenging due to (i) the differential-equation constraints in an optimization problem, (ii) the lack of a true analytical expression for transient stability constraint in OPF. Unfortunately, even the current best TSCOPF solvers still suffer from the curse of dimensionality and unacceptable computational time, especially for large-scale power systems with multiple contingencies. In chapter 5, thse issues will be addressed and a new method to incorporate the transient stability constraints will be presented.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Structural parameter identification of distributed systems using finite element approximation

A system identification technique is developed for classes of distributed systems using finite element approximations. Vibrating systems represented by partial differential equations have physical parameters associated with mass, stiffness, and damping distributions which need to be known in order to properly control and design mathematical models of the system. In order to identify these parameters a weighted least-squares algorithm and modified Newton-Raphson method is used for the identification process. The theory and technique is demonstrated by estimating the system parameters of a vibrating cantilever beam made up of several different structural properties.

Lee, K. Y.↗

Numerical study of finite-rate supersonic combustion using parabolized equations

A set of partial differential equations, describing the two-dimensional supersonic chemically-reacting flow of the hydrogen-air system, is formulated such that the equations are parabolic in the streamwise direction. A fully-implicit fully-coupled finite-difference algorithm is used to develop a computer code which solves the governing equations by marching in the streamwise direction. The combustion process is modeled by a two-step finite-rate chemistry whereas turbulence is simulated by an algebraic turbulence model. Results of two calculations of internal supersonic reacting flow show fairly good agreement with the results obtained by the more costly full Navier-Stokes procedure.

Chitsomboon, T.↗

Multi-Dimensional Asymptotically Stable 4th Order Accurate Schemes for the Diffusion Equation

An algorithm is presented which solves the multi-dimensional diffusion equation on co mplex shapes to 4th-order accuracy and is asymptotically stable in time. This bounded-error result is achieved by constructing, on a rectangular grid, a differentiation matrix whose symmetric part is negative definite. The differentiation matrix accounts for the Dirichlet boundary condition by imposing penalty like terms. Numerical examples in 2-D show that the method is effective even where standard schemes, stable by traditional definitions fail.

Abarbanel, Saul↗

Measurement and QCD analysis of double-differential inclusive jet cross sections in pp collisions at $ \sqrt{s}=8 $ TeV and cross section ratios to 2.76 and 7 TeV

A measurement of the double-differential inclusive jet cross section as a function of the jet transverse momentum p$_{T}$ and the absolute jet rapidity |y| is presented. Data from LHC proton-proton collisions at $ \sqrt{s}=8 $ TeV, corresponding to an integrated luminosity of 19.7 fb$^{−1}$, have been collected with the CMS detector. Jets are reconstructed using the anti-k$_{T}$ clustering algorithm with a size parameter of 0.7 in a phase space region covering jet p$_{T}$ from 74 GeV up to 2.5 TeV and jet absolute rapidity up to |y| = 3.0. The low-p$_{T}$ jet range between 21 and 74 GeV is also studied up to |y| = 4.7, using a dedicated data sample corresponding to an integrated luminosity of 5.6 pb$^{−1}$. The measured jet cross section is corrected for detector effects and compared with the predictions from perturbative QCD at next-to-leading order (NLO) using various sets of parton distribution functions (PDF). Cross section ratios to the corresponding measurements performed at 2.76 and 7 TeV are presented. From the measured double-differential jet cross section, the value of the strong coupling constant evaluated at the Z mass is α$_{S}$(M$_{Z}$) = 0.1164$_{− 0.0043}^{+ 0.0060}$ , where the errors include the PDF, scale, nonperturbative effects and experimental uncertainties, using the CT10 NLO PDFs. Improved constraints on PDFs based on the inclusive jet cross section measurement are presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

CYRANO3 the EDF fuel code performance: Global overview and recent developments on MOX fuel

CYRANO3 is the thermal mechanical industrial code developed and used by EDF to simulate the nuclear fuel rod performance in pile, and during the disposal storage period as well. This code has already been used successfully for the last ten years by the EDF engineering teams in justifying the overall reloading options covering various fuels: UO{sub 2}, UO{sub 2} + gadolinium, MOX, UO{sub 2} plus additives, and various cladding as well proposed by the nuclear fuel suppliers. Its particularity is related to a construction around a standard one-dimensional thermal and mechanical finite elements kernel with an appropriate architecture to plug in any new functionalities or models. Since the beginning it is developed as a module able integrating within a core calculation chain. Other constrain is to always guaranty a running time consistent with the calculation of a core within a reasonable time. The objective is to provide the EDF designers with a convivial and qualified code, with robust algorithms and able to quickly evolve with computer performances. Algorithms are able to account for adiabatic transients and are robust enough to avoid any undesirable overflows. The permanent challenge is indeed to provide with the more descriptive simulations not degrading to much the running time. Developments are obviously performed within the strict Quality Insurance rules. The code is then associated to a large documentation base, including model specification, realization, validation and test procedures. Maintenance is managed through a system of anomaly and improvement forms. Computers are still evolving quickly. Therefore, after an architecture adaptation, the CYRANO3 code is now integrated in the PLEIADES platform as a PWR industrial application. The platform is an exchange space allowing sharing functionalities, models and properties. In this paper, we will give a global overview of the capabilities of CYRANO3 code to simulate the thermomechanical behavior of fuel rods, and we will focus on recent developments realized on MOX fuel. In CYRANO3 code, heterogeneous models (neutronic model, micromechanical behavior law and fission gas model) are developed for MOX fuels and integrated in order to account for differential evolutions between phases under irradiation. The methodology and these models are presented in this paper. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Computationally efficient and error aware surrogate construction for numerical solutions of subsurface flow through porous media

Limiting the injection rate to restrict the pressure below a threshold at a critical location can be an important goal of simulations that model the subsurface pressure between injection and extraction wells. The pressure is approximated by the solution of Darcy’s partial differential equation for a given permeability field. The subsurface permeability is modeled as a random field since it is known only up to statistical properties. This induces uncertainty in the computed pressure. Solving the partial differential equation for an ensemble of random permeability simulations enables estimating a probability distribution for the pressure at the critical location. These simulations are computationally expensive, and practitioners often need rapid online guidance for real-time pressure management. An ensemble of numerical partial differential equation solutions is used to construct a Gaussian process regression model that can quickly predict the pressure at the critical location as a function of the extraction rate and permeability realization. The Gaussian process surrogate analyzes the ensemble of numerical pressure solutions at the critical location as noisy observations of the true pressure solution, enabling robust inference using the conditional Gaussian process distribution. Our first novel contribution is to identify a sampling methodology for the random environment and matching kernel technology for which fitting the Gaussian process regression model scales as O ( n log n ) instead of the typical O ( n 3 ) rate in the number of samples n used to fit the surrogate. The surrogate model allows almost instantaneous predictions for the pressure at the critical location as a function of the extraction rate and permeability realization. Our second contribution is a novel algorithm to calibrate the uncertainty in the surrogate model to the discrepancy between the true pressure solution of Darcy’s equation and the numerical solution. Finally, although our method is derived for building a surrogate for the solution of Darcy’s equation with a random permeability field, the framework broadly applies to solutions of other partial differential equations with random coefficients.

54 ENVIRONMENTAL SCIENCES↗

Constraint Embedding Technique for Multibody System Dynamics

Multibody dynamics play a critical role in simulation testbeds for space missions. There has been a considerable interest in the development of efficient computational algorithms for solving the dynamics of multibody systems. Mass matrix factorization and inversion techniques and the O(N) class of forward dynamics algorithms developed using a spatial operator algebra stand out as important breakthrough on this front. Techniques such as these provide the efficient algorithms and methods for the application and implementation of such multibody dynamics models. However, these methods are limited only to tree-topology multibody systems. Closed-chain topology systems require different techniques that are not as efficient or as broad as those for tree-topology systems. The closed-chain forward dynamics approach consists of treating the closed-chain topology as a tree-topology system subject to additional closure constraints. The resulting forward dynamics solution consists of: (a) ignoring the closure constraints and using the O(N) algorithm to solve for the free unconstrained accelerations for the system; (b) using the tree-topology solution to compute a correction force to enforce the closure constraints; and (c) correcting the unconstrained accelerations with correction accelerations resulting from the correction forces. This constraint-embedding technique shows how to use direct embedding to eliminate local closure-loops in the system and effectively convert the system back to a tree-topology system. At this point, standard tree-topology techniques can be brought to bear on the problem. The approach uses a spatial operator algebra approach to formulating the equations of motion. The operators are block-partitioned around the local body subgroups to convert them into aggregate bodies. Mass matrix operator factorization and inversion techniques are applied to the reformulated tree-topology system. Thus in essence, the new technique allows conversion of a system with closure-constraints into an equivalent tree-topology system, and thus allows one to take advantage of the host of techniques available to the latter class of systems. This technology is highly suitable for the class of multibody systems where the closure-constraints are local, i.e., where they are confined to small groupings of bodies within the system. Important examples of such local closure-constraints are constraints associated with four-bar linkages, geared motors, differential suspensions, etc. One can eliminate these closure-constraints and convert the system into a tree-topology system by embedding the constraints directly into the system dynamics and effectively replacing the body groupings with virtual aggregate bodies. Once eliminated, one can apply the well-known results and algorithms for tree-topology systems to solve the dynamics of such closed-chain system.

Woo, Simon S.↗

Bayesian sparse learning with preconditioned stochastic gradient MCMC and its applications

Deep neural networks have been successfully employed in an extensive variety of research areas, including solving partial differential equations. Despite its significant success, there are some challenges in effectively training DNN, such as avoiding overfitting in over-parameterized DNNs and accelerating the optimization in DNNs with pathological curvature. Here, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an adaptive empirical method. That is, one will alternatively sample from the posterior using preconditioned stochastic gradient Langevin Dynamics (PSGLD), and optimize the latent variables via stochastic approximation. The sparsity of the network is achieved while optimizing the hyperparameters with adaptive searching and penalizing. A popular SG-MCMC approach is Stochastic gradient Langevin dynamics (SGLD). However, considering the complex geometry in the model parameter space in nonconvex learning, updating parameters using a universal step size in each component as in SGLD may cause slow mixing. To address this issue, we apply a computationally manageable preconditioner in the updating rule, which provides a step-size parameter to adapt to local geometric properties. Moreover, by smoothly optimizing the hyperparameter in the preconditioning matrix, our proposed algorithm ensures a decreasing bias, which is introduced by ignoring the correction term in the preconditioned SGLD. According to the existing theoretical framework, we show that the proposed algorithm can asymptotically converge to the correct distribution with a controllable bias under mild conditions. Numerical tests are performed on both synthetic regression problems and learning solutions of elliptic PDE, which demonstrate the accuracy and efficiency of the present work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fluctuating hydrodynamics and the Rayleigh–Plateau instability

The Rayleigh–Plateau instability occurs when surface tension makes a fluid column become unstable to small perturbations. At nanometer scales, thermal fluctuations are comparable to interfacial energy densities. Consequently, at these scales, thermal fluctuations play a significant role in the dynamics of the instability. These microscopic effects have previously been investigated numerically using particle-based simulations, such as molecular dynamics (MD), and stochastic partial differential equation–based hydrodynamic models, such as stochastic lubrication theory. In this paper, we present an incompressible fluctuating hydrodynamics model with a diffuse-interface formulation for binary fluid mixtures designed for the study of stochastic interfacial phenomena. An efficient numerical algorithm is outlined and validated in numerical simulations of stable equilibrium interfaces. We present results from simulations of the Rayleigh–Plateau instability for long cylinders pinching into droplets for Ohnesorge numbers of Oh = 0.5 and 5.0. Both stochastic and perturbed deterministic simulations are analyzed and ensemble results show significant differences in the temporal evolution of the minimum radius near pinching. Short cylinders, with lengths less than their circumference, were also investigated. As previously observed in MD simulations, we find that thermal fluctuations cause these to pinch in cases where a perturbed cylinder would be stable deterministically. Finally, we show that the fluctuating hydrodynamics model can be applied to study a broader range of surface tension–driven phenomena.

97 MATHEMATICS AND COMPUTING↗