Search NASA⌕ Search

SEARCH · Search NASA

Results for “tensor methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Performance Optimization of Tensor Contraction Expressions for Many Body Methods in Quantum Chemistry

Complex tensor contraction expressions arise in accurate electronic structure models in quantum chemistry, such as the coupled cluster method. This paper addresses two complementary aspects of performance optimization of such tensor contraction expressions. Transformations using algebraic properties of commutativity and associativity can be used to significantly decrease the number of arithmetic operations required for evaluation of these expressions. The identification of common subexpressions among a set of tensor contraction expressions can result in a reduction of the total number of operations required to evaluate the tensor contractions. The first part of the paper describes an effective algorithm for operation minimization with common subexpression identification and demonstrates its effectiveness on tensor contraction expressions for coupled cluster equations. The second part of the paper highlights the importance of data layout transformation in the optimization of tensor contraction computations on modern processors. A number of considerations such as minimization of cache misses and utilization of multimedia vector instructions are discussed. A library for efficient index permutation of multi-dimensional tensors is described and experimental performance data is provided that demonstrates its effectiveness.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Performance Optimization of Tensor Contraction Expressions for Many Body Methods in Quantum Chemistry

Complex tensor contraction expressions arise in accurate electronic structure models in quantum chemistry, such as the coupled cluster method. This paper addresses two complementary aspects of performance optimization of such tensor contraction expressions. Transformations using algebraic properties of commutativity and associativity can be used to significantly decrease the number of arithmetic operations required for evaluation of these expressions. The identification of common subexpressions among a set of tensor contraction expressions can result in a reduction of the total number of operations required to evaluate the tensor contractions. The first part of the paper describes an effective algorithm for operation minimization with common subexpression identification and demonstrates its effectiveness on tensor contraction expressions for coupled cluster equations. The second part of the paper highlights the importance of data layout transformation in the optimization of tensor contraction computations on modern processors. A number of considerations, such as minimization of cache misses and utilization of multimedia vector instructions, are discussed. A library for efficient index permutation of multidimensional tensors is described, and experimental performance data is provided that demonstrates its effectiveness.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Toward Generalized Tensor Algebra for ab initio Quantum Chemistry Methods

The widespread use of tensor operations in describing electronic structure calculations has motivated the design of software frameworks for productive development of scalable optimized tensor-based electronic structure methods. Whereas prior work focused on Cartesian abstractions for dense tensors, we present an algebra to specify and perform tensor operations on a larger class of block-sparse tensors. We illustrate the use of this framework in expressing real-world computational chemistry calculations beyond the reach of existing frameworks.

Mutlu, Erdal↗

An Adaptive Shifted Power Method for Computing Generalized Tensor Eigenpairs

Several tensor eigenpair definitions have been put forth in the past decade, but these can all be unified under generalized tensor eigenpair framework, introduced by Chang, Pearson, and Zhang [J. Math. Anal. Appl., 350 (2009), pp. 416--422]. Given mth-order, n-dimensional real-valued symmetric tensors ${\mathscr{A}}$ and $\boldsymbol{\mathscr{B}}$, the goal is to find $\lambda \in \mathbb{R}$ and $\mathbf{x} \in \mathbb{R}^{n}, \mathbf{x} \neq 0$ such that ${\mathscr{A}}\mathbf{x}^{m-1} = \lambda {\mathscr{B}}\mathbf{x}^{m-1}$. Different choices for ${\mathscr{B}}$ yield different versions of the tensor eigenvalue problem. We present our generalized eigenproblem adaptive power (GEAP) method for solving the problem, which is an extension of the shifted symmetric higher-order power method (SS-HOPM) for finding Z-eigenpairs. A major drawback of SS-HOPM is that its performance depended on choosing an appropriate shift, but our GEAP method also includes an adaptive method for choosing the shift automatically.

97 MATHEMATICS AND COMPUTING↗

Gauge-symmetrization method for energy-momentum tensors in high-order electromagnetic field theories

For electromagnetic field theories, canonical energy-momentum conservation laws can be derived from the underpinning spacetime translation symmetry according to the Noether procedure. However, the canonical energy-momentum tensors (EMTs) are neither symmetric nor gauge-symmetric (gauge invariant). The Belinfante-Rosenfeld (BR) method is a well-known procedure to symmetrize the EMTs, which also renders them gauge symmetric for first-order field theories. High-order electromagnetic field theories appear in the study of gyrokinetic systems for magnetized plasmas and the Podolsky system for the radiation reaction of classical charged particles. For these high-order field theories, gauge-symmetric EMTs are not necessarily symmetric and vice versa. In the present study, we develop a new gauge-symmetrization method for EMTs in high-order electromagnetic field theories. The Noether procedure is carried out using the Faraday tensor $F_{μν}$, instead of the 4-potential $A_{μ}$, to derive a canonical EMT $T^{μν}_{N}$. We show that the gauge-dependent part of $T^{μν}_{N}$ can be removed using the displacement-potential tensor $F^{σμν}$ ≡ $D^{σμ}A^{ν}/4π$, where $D^{σμ}$ is the antisymmetric electric displacement tensor. This method gauge-symmetrizes the EMT without necessarily making it symmetric, which is adequate for applications not involving general relativity. For first-order electromagnetic field theories, such as the standard Maxwell system, $F^{σμν}$ reduces to the familiar BR superpotential $S^{σμν}$, and the method developed can be used as a simpler procedure to calculate $S^{σμν}$ without employing the angular momentum tensor in 4D spacetime. When the electromagnetic system is coupled to classical charged particles, the gauge-symmetrization method for EMTs is shown to be effective as well.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The method of planes pressure tensor for a spherical subvolume

Various formulas for the local pressure tensor based on a spherical subvolume of radius, R, are considered. An extension of the Method of Planes (MOP) formula of Todd et al. [Phys. Rev. E 52, 1627 (1995)] for a spherical geometry is derived using the recently proposed Control Volume formulation [E. R. Smith, D. M. Heyes, D. Dini, and T. A. Zaki, Phys. Rev. E 85, 056705 (2012)]. The MOP formula for the purely radial component of the pressure tensor is shown to be mathematically identical to the Radial Irving-Kirkwood formula. Novel offdiagonal elements which are important for momentum conservation emerge naturally from this treatment. The local pressure tensor formulas for a plane are shown to be the large radius limits of those for spherical surfaces. The radial-dependence of the pressure tensor computed by Molecular Dynamics simulation is reported for virtual spheres in a model bulk liquid where the sphere is positioned randomly or whose center is also that of a molecule in the liquid. The probability distributions of angles relating to pairs of atoms which cross the surface of the sphere, and the center of the sphere, are presented as a function of R. The variance in the shear stress calculated from the spherical Volume Averaging method is shown to converge slowly to the limiting values with increasing radius, and to be a strong function of the number of molecules in the simulation cell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Flexible Power Method for Solving Infinite Dimensional Tensor Eigenvalue Problems

We propose a flexible power method for computing the leftmost, i.e., algebraically smallest, eigenvalue of an infinite dimensional tensor eigenvalue problem, $H x = \lambda x$, where the infinite dimensional symmetric matrix $H$ exhibits a translational invariant structure. We assume the smallest eigenvalue of $H$ is simple and apply a power iteration of $e^{-H}$ with the eigenvector represented in a compact way as a translational invariant infinite Tensor Ring (iTR). Hence, the infinite dimensional eigenvector can be represented by a finite number of iTR cores of finite rank. In order to implement this power iteration, we use a small parameter $t$ so that the infinite matrix-vector operation $e^{-Ht}x$ can efficiently be approximated by the Lie product formula, also known as Suzuki--Trotter splitting, and we employ a low rank approximation through a truncated singular value decomposition on the iTR cores in order to keep the cost of subsequent power iterations bounded. We also use an efficient way for computing the iTR Rayleigh quotient and introduce a finite size iTR residual which is used to monitor the convergence of the Rayleigh quotient and to modify the timestep $t$. In this paper, we discuss 2 different implementations of the flexible power algorithm and illustrate the automatic timestep adaption approach for several numerical examples.

Beeumen, Roel Van↗

A pseudospectral matrix method for time-dependent tensor fields on a spherical shell

We construct a pseudospectral method for the solution of time-dependent, non-linear partial differential equations on a three-dimensional spherical shell. The problem we address is the treatment of tensor fields on the sphere. As a test case we consider the evolution of a single black hole in numerical general relativity. A natural strategy would be the expansion in tensor spherical harmonics in spherical coordinates. Instead, we consider the simpler and potentially more efficient possibility of a double Fourier expansion on the sphere for tensors in Cartesian coordinates. As usual for the double Fourier method, we employ a filter to address time-step limitations and certain stability issues. We find that a tensor filter based on spin-weighted spherical harmonics is successful, while two simplified, non-spin-weighted filters do not lead to stable evolutions. The derivatives and the filter are implemented by matrix multiplication for efficiency. A key technical point is the construction of a matrix multiplication method for the spin-weighted spherical harmonic filter. As example for the efficient parallelization of the double Fourier, spin-weighted filter method we discuss an implementation on a GPU, which achieves a speed-up of up to a factor of 20 compared to a single core CPU implementation.

97 MATHEMATICS AND COMPUTING↗

Improve the efficiency of the Cartesian tensor based fast multipole method for Coulomb interaction using the traces

To compute the non-oscillating mutual interaction for a systems with N points, the fast multipole method (FMM) has an efficiency that scales linearly with the number of points. Specifically, for Coulomb interaction, FMM can be constructed using either the spherical harmonic functions or the totally symmetric Cartesian tensors. In this paper, we will present that the effciency of the Cartesian tensor-based FMM for the Coulomb interaction can be significantly improved by implementing the traces of the Cartesian tensors in calculation to reduce the independent elements of the n-th rank totally symmetric Cartesian tensor from (n + 1)(n + 2)=2 to 2n + 1. The computation complexity for the operations in FMM are analyzed and expressed as polynomials of the highest rank of the Cartesian tensors. For most operations, the complexity is reduced by one order. Numerical examples regarding the convergence and the effciency of the new algorithm are demonstrated. As a result, a reduction of computation time up to 50% has been observed for a moderate number of points and rank of tensors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

AnisONet: A deep neural operator-based anisotropic permeability upscaler from pore to Darcy scale

Directional permeability variations, which govern directional fluid flow in porous media with anisotropy, are important to accurately predict flow behavior, reactive transport, and fluid–solid interactions for various processes such as enhanced geothermal systems, energy storage devices, and biological systems. However, the intricate architecture of porous media makes it difficult to predict directional permeabilities. In this work, we present a novel machine learning (ML) framework, AnisONet, built upon an integration of a convolutional neural network, Swin transformer, and the deep operator network architecture, designed to predict anisotropic permeability and upscale predictions to larger spatial domains. First, AnisONet was evaluated with three classes of two-dimensional (2D) porous media, including synthetic circular and elliptical grains and natural sandstone grains from micro-computed tomography images. A lattice Boltzmann model (LBM) was used to calculate directional permeabilities at every 10° angle, producing 19 data points per image of porous media. AnisONet is then trained to predict permeability as a function of rotation angle. AnisONet showed strong predictive capability of directional permeability. Second, we tested our model for five upscaling cases with a large image size in the finite-element method (FEM) for 2D Darcy flow with various permeability tensor construction methods. Overall, upscaled permeability tensors in FEM simulations produce a reasonably good match with LBM results, highlighting the importance of selecting appropriate tensor formation strategies for accurate permeability upscaling. AnisONet, as a directional permeability estimator, could be further developed for more complex geometries, with the potential to develop a foundational ML model for various applications in porous media.

42 ENGINEERING↗

Tensor networks for High Energy Physics: contribution to Snowmass 2021

Tensor network methods are becoming increasingly important for high-energy physics, condensed matter physics and quantum information science (QIS). We discuss the impact of tensor network methods on lattice field theory, quantum gravity and QIS in the context of High Energy Physics (HEP). These tools will target calculations for strongly interacting systems that are made difficult by sign problems when conventional Monte Carlo and other importance sampling methods are used. Further development of methods and software will be needed to make a significant impact in HEP. We discuss the roadmap to perform quantum chromodynamics (QCD) related calculations in the coming years. The research is labor intensive and requires state of the art computational science and computer science input for its development and validation. We briefly discuss the overlap with other science domains and industry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The island coalescence problem: Scaling of reconnection in extended fluid models including higher-order moments

As modeling of collisionless magnetic reconnection in most space plasmas with realistic parameters is beyond the capability of today's simulations, due to the separation between global and kinetic length scales, it is important to establish scaling relations in model problems so as to extrapolate to realistic scales. Recently, large scale particle-in-cell simulations of island coalescence have shown that the time averaged reconnection rate decreases with system size, while fluid systems at such large scales in the Hall regime have not been studied. Here, we perform the complementary resistive magnetohydrodynamic (MHD), Hall MHD, and two fluid simulations using a ten-moment model with the same geometry. In contrast to the standard Harris sheet reconnection problem, Hall MHD is insufficient to capture the physics of the reconnection region. Additionally, motivated by the results of a recent set of hybrid simulations which show the importance of ion kinetics in this geometry, we evaluate the efficacy of the ten-moment model in reproducing such results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Real-Time Operator Evolution in Two and Three Dimensions via Sparse Pauli Dynamics

We study real-time operator evolution using sparse Pauli dynamics, a recently developed method for simulating expectation values of quantum circuits. On the examples of energy and charge diffusion in one-dimensional (1D) spin chains and sudden quench dynamics in the 2D transverse-field Ising model, it is shown that this approach can compete with state-of-the-art tensor network methods. We further demonstrate the flexibility of the approach by studying quench dynamics in the 3D transverse-field Ising model that is highly challenging for tensor network methods. For the simulation of expectation value dynamics starting in a computational basis state, we introduce an extension of sparse Pauli dynamics that truncates the growing sum of Pauli operators by discarding terms with a large number of X and Y matrices. This is validated by our 2D and 3D simulations. Finally, we argue that sparse Pauli dynamics is not only capable of converging challenging observables to high accuracy, but can also serve as a reliable approximate approach even when given only limited computational resources. Published by the American Physical Society 2025

Begušić, Tomislav (ORCID:0000000279424134)↗

Nonrelativistic nuclear reduction for tensor couplings in dark matter direct detection and μ → e conversion

The nonrelativistic effective field theory (NRET) is widely used in dark matter direct detection and charged-lepton flavor violation studies through μ → e conversion. However, existing literature has not fully considered tensor couplings. This study fills this gap by utilizing an innovative tensor decomposition method, extending NRET to incorporate previously overlooked tensor interactions. This development is expected to have a significant impact on ongoing experiments seeking physics beyond the Standard Model and on our understanding of the new-physics interactions. Notably, we identify additional operators in μ → e conversion that are absent in scalar and vector couplings. To support further research and experimental analyses, comprehensive tables featuring tensor matrix elements and their corresponding operators are provided. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Traceless Totally Symmetric Tensor Based Fast Multipole Method for Space Charge Field Calculation

The fast multipole method (FMM) is widely used to calculate the Coulomb interaction between a huge amount of charged particles. The efficiency of FMM scales with $O(N)$ for $N$ particles with any arbitrary distribution. Hence it is apposite for problems with complicated charge distribution or geometry. We developed a new FMM code for Coulomb interaction. In the new code the Coulomb potential is expressed as traceless totally symmetric tensors in Cartesian coordinates, in which the number of independent element is only $2n+1$ for the $n^{\mathrm{th}}$ rank, while it is $3^{n}$ for a general Cartesian tensor. The significant reduce of independent element number in Cartesian tensor helps to achieve high efficiency in the new algorithm. Result of test runs for space charge field calculation and multi-particle tracking using the new algorithm will be presented.

Zhang, He↗

A practical introduction to tensor networks: Matrix product states and projected entangled pair states

This is a partly non-technical introduction to selected topics on tensor network methods, based on several lectures and introductory seminars given on the subject. It should be a good place for newcomers to get familiarized with some of the key ideas in the field, specially regarding the numerics. After a very general introduction we motivate the concept of tensor network and provide several examples. We then move on to explain some basics about Matrix Product States (MPS) and Projected Entangled Pair States (PEPS). Selected details on some of the associated numerical methods for 1d and 2d quantum lattice systems are also discussed. - Highlights: • A practical introduction to selected aspects of tensor network methods is presented. • We provide analytical examples of MPS and 2d PEPS. • We provide basic aspects on several numerical methods for MPS and 2d PEPS. • We discuss a number of applications of tensor network methods from a broad perspective.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fast Multipole Method for Coulomb Interaction Based on Traceless Totally Symmetric Tensor

The fast multipole method (FMM) is widely used to calculate the Coulomb interaction between a huge amount of charged particles. The efficiency of FMM scales with O(N) for N particles with any arbitrary distribution. Hence it is apposite for problems with complicated charge distribution or geometry. Under the same FMM framework, there are different approaches, such as using spherical harmonic functions or Maxwell Cartesian tensors. Here we will present a version using traceless totally symmetric Maxwell Cartesian tensor. The previous Maxwell Cartesian tensor based FMM uses totally symmetric tensor. There are (n+1)(n+2)/2 independent elements in a rank n totally symmetric tensor. However, there are only 2n+1 independent elements in a rank n traceless totally symmetric tensor, due to which the efficiency of the traceless version is highly improved compared with the old version, especially when high accuracy is needed and high rank tensors are used.

Huang, He↗

Low-rank Tensor Completion for PMU Data Recovery

This paper proposes a tensor completion method for the recovery of missing phasor measurement unit (PMU) measurements. Tensor completion as the general case of matrix completion has attracted increasing attention in recent years. The imputation accuracy for the existing matrix completion methods may be significantly reduced when there are consecutive data losses across multiple data channels. To tackle this issue, we explore the multi-way characteristics of PMU measurements by using a tensor model. We leverage the low-rank property of the PMU measurements and formulate the missing PMU data recovery problem as a low-rank tensor completion problem. An efficient algorithm based on alternating direction method of multipliers (ADMM) is developed to solve the tensor completion problem. The experiments using the real PMU dataset show that the proposed method exhibits better imputation accuracy compared with the conventional data recovery methods.

Ghasemkhani, Amir↗