Search NASA⌕ Search

SEARCH · Search NASA

Results for “algorithmic differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Computational complexities and storage requirements of some Riccati equation solvers

The linear optimal control problem of an nth-order time-invariant dynamic system with a quadratic performance functional is usually solved by the Hamilton-Jacobi approach. This leads to the solution of the differential matrix Riccati equation with a terminal condition. The bulk of the computation for the optimal control problem is related to the solution of this equation. There are various algorithms in the literature for solving the matrix Riccati equation. However, computational complexities and storage requirements as a function of numbers of state variables, control variables, and sensors are not available for all these algorithms. In this work, the computational complexities and storage requirements for some of these algorithms are given. These expressions show the immensity of the computational requirements of the algorithms in solving the Riccati equation for large-order systems such as the control of highly flexible space structures. The expressions are also needed to compute the speedup and efficiency of any implementation of these algorithms on concurrent machines.

Utku, Senol↗

Overview of Sensitivity Analysis and Shape Optimization for Complex Aerodynamic Configurations

This paper presents a brief overview of some of the more recent advances in steady aerodynamic shape-design sensitivity analysis and optimization, based on advanced computational fluid dynamics. The focus here is on those methods particularly well- suited to the study of geometrically complex configurations and their potentially complex associated flow physics. When nonlinear state equations are considered in the optimization process, difficulties are found in the application of sensitivity analysis. Some techniques for circumventing such difficulties are currently being explored and are included here. Attention is directed to methods that utilize automatic differentiation to obtain aerodynamic sensitivity derivatives for both complex configurations and complex flow physics. Various examples of shape-design sensitivity analysis for unstructured-grid computational fluid dynamics algorithms are demonstrated for different formulations of the sensitivity equations. Finally, the use of advanced, unstructured-grid computational fluid dynamics in multidisciplinary analyses and multidisciplinary sensitivity analyses within future optimization processes is recommended and encouraged.

Newman, Perry A.↗

A HOT FLUX ROPE OBSERVED BY SDO/AIA

A filament eruption was observed on 2010 October 31 in the images recorded by the Atmospheric Imaging Assembly (AIA) on board the Solar Dynamic Observatory (SDO) in its Extreme Ultra-Violet (EUV) channels. The filament showed a slow-rise phase followed by a fast rise and was classified to be an asymmetric eruption. In addition, multiple localized brightenings which were spatially and temporally associated with the slow-rise phase were identified, leading us to believe that the tether-cutting mechanism initiated the eruption. An associated flux rope was detected in high-temperature channels of AIA, namely 94 and 131 Å, corresponding to 7 and 11 MK plasma respectively. In addition, these channels are also sensitive to cooler plasma corresponding to 1–2 MK. In this study, we have applied the algorithm devised by Warren et al. to remove cooler emission from the 94 Å channel to deduce only the high-temperature structure of the flux rope and to study its temporal evolution. We found that the flux rope was very clearly seen in the clean 94 Å channel image corresponding to Fe xviii emission, which corresponds to a plasma at a temperature of 7 MK. This temperature matched well with that obtained using Differential Emission Measure analysis. This study provides important constrains in the modeling of the thermodynamic structure of the flux ropes in coronal mass ejections.

79 ASTRONOMY AND ASTROPHYSICS↗

THE FORMATION OF THE FIRST COSMIC STRUCTURES AND THE PHYSICS OF THE z {approx} 20 UNIVERSE

We perform a suite of cosmological simulations in the {Lambda}CDM paradigm of the formation of the first structures in the universe prior to astrophysical reheating and reionization (15 {approx}< z < 200). These are the first simulations initialized in a manner that self-consistently accounts for the impact of pressure on the rate of growth of modes, temperature fluctuations in the gas, and the dark matter-baryon supersonic velocity difference. Even with these improvements, these are still difficult times to simulate accurately as the Jeans length of the cold intergalactic gas must be resolved while also capturing a representative sample of the universe. We explore the box size and resolution requirements to meet these competing objectives. Our simulations support the finding of recent studies that the dark matter-baryon velocity difference has a surprisingly large impact on the accretion of gas onto the first star-forming minihalos (which have masses of {approx}10{sup 6} M {sub Sun }). In fact, the halo gas is often significantly downwind of such halos and with lower densities in the simulations in which the baryons have a bulk flow with respect to the dark matter, modulating the formation of the first stars by the local value of this velocity difference. We also show that dynamical friction plays an important role in the nonlinear evolution of the dark matter-baryon differential velocity, acting to erase this velocity difference quickly in overdense gas, as well as sourcing visually apparent bow shocks and Mach cones throughout the universe. We use simulations with both the GADGET and Enzo cosmological codes to test the robustness of these conclusions. The comparison of these codes' simulations also provides a relatively controlled test of these codes themselves, allowing us to quantify some of the tradeoffs between the algorithms. For example, we find that particle coupling in GADGET between the gas and dark matter particles results in spurious growth that mimics nonlinear growth in the matter power spectrum for standard initial setups. This coupling is alleviated by using adaptive gravitational softening for the gas. In a companion paper, we use the simulations presented here to make detailed estimates for the impact of the dark matter-baryon velocity differential on redshifted 21 cm radiation. The initial conditions generator used in this study, CICSASS, can be publicly downloaded.

79 ASTRONOMY AND ASTROPHYSICS↗

Improved Architectures and Training Algorithms for Deep Operator Networks

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of partial differential equations (PDEs) in an entirely self-supervised manner. In this work we analyze the training dynamics of deep operator networks (DeepONets) through the lens of Neural Tangent Kernel theory, and reveal a bias that favors the approximation of functions with larger magnitudes. To correct this bias we propose to adaptively re-weight the importance of each training example, and demonstrate how this procedure can effectively balance the magnitude of back-propagated gradients during training via gradient descent. We also propose a novel network architecture that is more resilient to vanishing gradient pathologies. Taken together, our developments provide new insights into the training of DeepONets and consistently improve their predictive accuracy by a factor of 10-50x, demonstrated in the challenging setting of learning PDE solution operators in the absence of paired input-output observations.

97 MATHEMATICS AND COMPUTING↗

Multi-fidelity Bayesian neural networks: Algorithms and applications

Here we propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential equations (PDEs). These multi-fidelity BNNs consist of three neural networks: The first is a fully connected neural network, which is trained following the maximum a posteriori probability (MAP) method to fit the low-fidelity data; the second is a Bayesian neural network employed to capture the cross-correlation with uncertainty quantification between the low- and high-fidelity data; and the last one is the physics-informed neural network, which encodes the physical laws described by PDEs. For the training of the last two neural networks, we first employ the mean-field variational inference (VI) to maximize the evidence lower bound (ELBO) to obtain informative prior distributions for the hyperparameters in the BNNs, and subsequently we use the Hamiltonian Monte Carlo (HMC) method to estimate accurately the posterior distributions for the corresponding hyperparameters. We demonstrate the accuracy of the present method using synthetic data as well as real measurements. Specifically, we first approximate a one- and four-dimensional function, and then infer the reaction rates in one- and two-dimensional diffusion-reaction systems. Moreover, we infer the sea surface temperature (SST) in the Massachusetts and Cape Cod Bays using satellite images and in-situ measurements. Taken together, our results demonstrate that the present method can capture both linear and nonlinear correlation between the low- and high-fidelity data adaptively, identify unknown parameters in PDEs, and quantify uncertainties in predictions, given a few scattered noisy high-fidelity data. Finally, we demonstrate that we can effectively and efficiently reduce the uncertainties and hence enhance the prediction accuracy with an active learning approach, using as examples a specific one-dimensional function approximation and an inverse PDE problem.

97 MATHEMATICS AND COMPUTING↗

The effects of intrinsic noise on the behaviour of bistable cell regulatory systems under quasi-steady state conditions

We analyse the effect of intrinsic fluctuations on the properties of bistable stochastic systems with time scale separation operating under quasi-steady state conditions. We first formulate a stochastic generalisation of the quasi-steady state approximation based on the semi-classical approximation of the partial differential equation for the generating function associated with the chemical master equation. Such approximation proceeds by optimising an action functional whose associated set of Euler-Lagrange (Hamilton) equations provides the most likely fluctuation path. We show that, under appropriate conditions granting time scale separation, the Hamiltonian can be re-scaled so that the set of Hamilton equations splits up into slow and fast variables, whereby the quasi-steady state approximation can be applied. We analyse two particular examples of systems whose mean-field limit has been shown to exhibit bi-stability: an enzyme-catalysed system of two mutually inhibitory proteins and a gene regulatory circuit with self-activation. Our theory establishes that the number of molecules of the conserved species is order parameters whose variation regulates bistable behaviour in the associated systems beyond the predictions of the mean-field theory. This prediction is fully confirmed by direct numerical simulations using the stochastic simulation algorithm. This result allows us to propose strategies whereby, by varying the number of molecules of the three conserved chemical species, cell properties associated to bistable behaviour (phenotype, cell-cycle status, etc.) can be controlled.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fast Approximate Union Volume in High Dimensions with Line Samples

The classical problem of calculating the volume of the union of d-dimensional balls is known as "Union Volume." We present line-sampling approximation algorithms for Union Volume. Our methods may be extended to other Boolean operations, such as setminus; or to other shapes, such as hyper-rectangles. The deterministic, exact approaches for Union Volume do not scale well to high dimensions. However, we adapt several of these exact approaches to approximation algorithms based on sampling. We perform local sampling within each ball using lines. We have several variations, depending on how the overlapping volume is partitioned, and depending on whether radial, axis-aligned, or other line patterns are used. Our variations fall within the family of Monte Carlo sampling, and hence have about the same theoretical convergence rate, 1 /$\sqrt{M}$, where M is the number of samples. In our limited experiments, line-sampling proved more accurate per unit work than point samples, because a line sample provides more information, and the analytic equation for a sphere makes the calculation almost as fast. We performed a limited empirical study of the efficiency of these variations. We suggest a more extensive study for future work. We speculate that different ball arrangements, differentiated by the distribution of overlaps in terms of volume and degree, will benefit the most from patterns of line samples that preferentially capture those overlaps. Acknowledgement We thank Karl Bringman for explaining his BF-ApproxUnion (ApproxUnion) algorithm [3] to us. We thank Josiah Manson for pointing out that spoke darts oversample the center and we might get a better answer by uniform sampling. We thank Vijay Natarajan for suggesting random chord sampling. The authors are grateful to Brian Adams, Keith Dalbey, and Vicente Romero for useful technical discussions. This work was sponsored by the Laboratory Directed Research and Development (LDRD) Program at Sandia National Laboratories. This material is based upon work supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research (ASCR), Applied Mathematics Program. Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

97 MATHEMATICS AND COMPUTING↗

Measurements of inclusive and differential fiducial cross-sections of $t\bar{t}\gamma $ production in leptonic final states at $\sqrt{s}=13~\text {TeV}$ TeV in ATLAS

Inclusive and differential cross-sections for the production of a top-quark pair in association with a photon are measured with proton-proton collision data corresponding to an integrated luminosity of 36.1 fb –1 , collected by the ATLAS detector at the LHC in 2015 and 2016 at a centre-of-mass energy of 13 TeV. The measurements are performed in single-lepton and dilepton final states in a fiducial volume. Events with exactly one photon, one or two leptons, a channel-dependent minimum number of jets, and at least one b-jet are selected. Neural network algorithms are used to separate the signal from the backgrounds. The fiducial cross-sections are measured to be 521 ± 9(stat.) ± 41(sys.) fb and 69 ± 3(stat.) ± 4(sys.) fb for the single-lepton and dilepton channels, respectively. The differential cross-sections are measured as a function of photon transverse momentum, photon absolute pseudorapidity, and angular distance between the photon and its closest lepton in both channels, as well as azimuthal opening angle and absolute pseudorapidity difference between the two leptons in the dilepton channel. All measurements are in agreement with the theoretical predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nonlinear control of safety factor gradient in tokamaks using spatially variable electron cyclotron current drives

Active control of plasma properties may be necessary to achieve stable operation of next-generation tokamaks over large time scales. Such control algorithms can regulate the plasma properties to avoid the onset of magnetohydrodynamic (MHD) instabilities. For instance, the global and local properties of the safety factor profile are linked to the onset of neoclassical tearing modes (NTMs). This work proposes a model-based control approach for deterring/delaying NTMs through active modulation of one of the safety factor properties - the gradient of the safety factor profile at a particular rational safety factor surface. In particular, a novel control-oriented model for the local safety factor gradient is developed. The nonlinear control model is governed by a nonautonomous ordinary differential equation that accounts for a given rational safety factor surface’s spatial variation over time. Further, to improve the controllability of the spatially evolving parameter, the control model treats ECH&CD positions, along with noninductive powers, as controllable variables. A nonlinear control algorithm based on feedback linearization with optimization is synthesized to achieve the objective of regulating the safety factor gradient around a given target. The proposed algorithm allocates optimal ECH&CD positions, in addition to auxiliary powers, at each time instant as the rational safety factor surface drifts to locations with a low control authority. Stability guarantees of the proposed control law are also discussed in this work. The proposed algorithm is tested for a DIII-D tokamak scenario in nonlinear simulations carried out using the Control Oriented Transport SIMulator (COTSIM). Both fixed and moving ECH&CD cases are studied, and their outcomes are compared. Simulation results demonstrate that enthusiastic regulation of the safety factor gradient can be achieved during the ramp-up and flat-top phases of tokamak operation in both fixed and moving ECH&CD cases. However, real-time updates of ECH&CD positions can prevent the saturation of auxiliary powers.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Topology optimization of finite strain viscoplastic systems under transient loads [Dynamic topology optimization based on finite strain visco-plasticity]

In this paper, a transient finite strain viscoplastic model is implemented in a gradient-based topology optimization framework to design impact mitigating structures. The model's kinematics relies on the multiplicative split of the deformation gradient, and the constitutive response is based on isotropic hardening viscoplasticity. To solve the mechanical balance laws, the implicit Newmark-beta method is used together with a total Lagrangian finite element formulation. The optimization problem is regularized using a partial differential equation filter and solved using the method of moving asymptotes. Sensitivities required to solve the optimization problem are derived using the adjoint method. To demonstrate the capability of the algorithm, several protective systems are designed, in which the absorbed viscoplastic energy is maximized. Finally, the numerical examples demonstrate that transient finite strain viscoplastic effects can successfully be combined with topology optimization.

42 ENGINEERING↗

Measurement of inclusive charged-particle b-jet production in pp and p-Pb collisions at $\sqrt{s_{\mathrm{NN}}}$ = 5.02 TeV

A measurement of the inclusive b-jet production cross section is presented in pp and p-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV, using data collected with the ALICE detector at the LHC. The jets were reconstructed in the central rapidity region |η| < 0.5 from charged particles using the anti-k T algorithm with resolution parameter R = 0.4. Identification of b jets exploits the long lifetime of b hadrons, using the properties of secondary vertices and impact parameter distributions. The p T -differential inclusive production cross section of b jets, as well as the corresponding inclusive b-jet fraction, are reported for pp and p-Pb collisions in the jet transverse momentum range 10 ≤ p T,ch jet ≤ 100 GeV/c, together with the nuclear modification factor, $R^{b-jet}_{pPb}$. The analysis thus extends the lower p T limit of b-jet measurements at the LHC. The nuclear modification factor is found to be consistent with unity, indicating that the production of b jets in p-Pb at $\sqrt{s_{NN}}$ = 5.02 TeV is not affected by cold nuclear matter effects within the current precision. The measurements are well reproduced by POWHEG NLO pQCD calculations with PYTHIA fragmentation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Measurement of the jet mass in hadronic decays of boosted W bosons at 13 TeV and extraction of the W boson mass

The jet mass of W bosons decaying to a quark-antiquark pair is measured in W+jets events from proton-proton collisions at a center-of-mass energy of 13 TeV. The data used were collected by the CMS experiment at the CERN LHC and correspond to an integrated luminosity of 138 fb −1 . Hadronic decays of W bosons with high momenta produce strongly collimated decay products due to the large Lorentz boost, and are reconstructed as single large-radius jets. These jets have a characteristic substructure that is exploited to distinguish them from the large background of quark- and gluon-initiated jets. The jet mass is computed using the soft-drop algorithm, which suppresses soft wide-angle radiation that leads to a broadening of the jet mass distribution. For the first time, unfolded measurements are presented of the double-differential W+jets cross section as a function of the jet transverse momentum and soft-drop mass. From these distributions, the W boson mass is obtained, with a value of 80.83 ± 0.55 GeV in a scheme with mass-dependent width, achieving the smallest uncertainty available today from an all-jets final state at a hadron collider.

hadron-hadron scattering↗

Systems biology approach to study the role of miRNA in promoter targeting during megakaryopoiesis

Highlights: • miRNAs could regulate Cyclins and CDKs by targeting their promoters. • Perl programming was used to identify putative targets of miRNA in promoters. • miR-1273g-3p and miR-619-5p showed significance with longest seed sequence matches. • Through CDK10, CDK11 and Cyclin, these two miRNAs could regulate cell cycle during megakaryopoiesis. The distinct process of megakaryopoiesis requires occurrence of endomitosis for polyploidization of the megakaryocytes. Although, Cyclins, CDKs and have been described to regulate endomitosis, the exact mechanism still remains an enigma. miRNA which were otherwise known as post transcriptional gene silencers are now emerging with various non-canonical functions including gene regulation at pre-transcriptional level by miRNA binding at promoter region. Out of the many processes they regulate, miRNA have been manifested to play a role in megakaryocyte differentiation. In this study an attempt has been made to identify miRNA that could regulate cell cycle genes (Cyclins and CDKs) by targeting their promoters, during megakaryopoiesis. A new computational algorithm was implemented using Perl programming to identify putative targets of miRNA in CDK and Cyclin promoters. Perl script was also used to check nuclear localizing miRNA based on the presence of a consensus sequence. Real-time PCR was performed to analyze the expression of miRNA and their predicted targets in Dami vs. PMA treated Dami cells. Putative targets of miRNAs with longest, high complementarity matches in CDK/Cyclin promoters were obtained. We identified two significant miRNA, miR-1273g-3p and miR-619-5p with longest seed sequence matches. We further identified three main targets (CDK10, CDK11, Cyclin F) through which these two miRNA could regulate cell cycle during megakaryopoiesis. Our results reinforce the role of promoting targeting miRNA in regulation of cell cycle through certain CDK/Cyclins to support the process of endomitosis during megakaryopoiesis.

60 APPLIED LIFE SCIENCES↗

Discovering equations that govern experimental materials stability under environmental stress using scientific machine learning

Abstract While machine learning (ML) in experimental research has demonstrated impressive predictive capabilities, extracting fungible knowledge representations from experimental data remains an elusive task. In this manuscript, we use ML to infer the underlying differential equation (DE) from experimental data of degrading organic-inorganic methylammonium lead iodide (MAPI) perovskite thin films under environmental stressors (elevated temperature, humidity, and light). Using a sparse regression algorithm, we find that the underlying DE governing MAPI degradation across a broad temperature range of 35 to 85 °C is described minimally by a second-order polynomial. This DE corresponds to the Verhulst logistic function, which describes reaction kinetics analogous to self-propagating reactions. We examine the robustness of our conclusions to experimental variance and Gaussian noise and describe the experimental limits within which this methodology can be applied. Our study highlights the promise and challenges associated with ML-aided scientific discovery by demonstrating its application in experimental chemical and materials systems.

36 MATERIALS SCIENCE↗

Quasioptical modeling of wave beams with and without mode conversion. III. Numerical simulations of mode-converting beams

This work continues a series of papers where we propose an algorithm for quasi-optical modeling of electromagnetic beams with and without mode conversion. The general theory was reported in the first paper of this series, where a parabolic partial differential equation was derived for the field envelope that may contain one or multiple modes with close group velocities. In the second paper, we presented a corresponding code PARADE (PAraxial RAy DEscription) and its test applications to single-mode beams. Here, we report quasi-optical simulations of mode-converting beams for the first time. Here, we also demonstrate that PARADE can model splitting of two-mode beams. The numerical results produced by PARADE show good agreement with those of one-dimensional full-wave simulations and also with conventional ray tracing (to the extent that one-dimensional and ray-tracing simulations are applicable).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fortran mimetic abstraction language (Formal) v0.1.

The Fortran mimetic abstraction language ("Formal") is a domain-specific language (DSL) embedded in Fortran 202Y [1]. Formal provides novel software abstractions for simulating phenomena governed by the partial differential equations (PDEs) of vector and tensor calculus. Such equations model an extremely broad set of physical phenomena, ranging from atmospheric winds to light propagation. Formal's data structures and algorithms mimic in form and behavior continuous functions and operators. Formal supports these mathematical constructs using mimetic discretizations that define a discrete calculus satisfying various tensor calculus theorems, thereby ensuring high-fidelity representations of the physics being modeled. [2] Formal 0.1.0 also lays a foundation for the future use of Fortran 202Y type-safe templates to facilitate the formal verification of tensor contractions in computational physics and artificial intelligence [3]. [1] "Fortran 202Y" is Fortran standard committee's informal designation for the next Fortran revision, which will likely be "Fortran 2028". [2] Corbino, J. and Castillo, J. (2020) Journal of Computational and Applied Mathematics, https://doi.org/10.1016/j.cam.2019.06.042. [3] Haveraaen, M., Järvi, J., & Rouson, D. (2019). Reflecting on Generics for Fortran. https://j3-fortran.org/doc/year/19/19-188.pdf.

Rouson, Damian [Lawrence Berkeley National Laborat↗