Search NASA⌕ Search

SEARCH · Search NASA

Results for “tensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Performance Optimization of Tensor Contraction Expressions for Many Body Methods in Quantum Chemistry

Complex tensor contraction expressions arise in accurate electronic structure models in quantum chemistry, such as the coupled cluster method. This paper addresses two complementary aspects of performance optimization of such tensor contraction expressions. Transformations using algebraic properties of commutativity and associativity can be used to significantly decrease the number of arithmetic operations required for evaluation of these expressions. The identification of common subexpressions among a set of tensor contraction expressions can result in a reduction of the total number of operations required to evaluate the tensor contractions. The first part of the paper describes an effective algorithm for operation minimization with common subexpression identification and demonstrates its effectiveness on tensor contraction expressions for coupled cluster equations. The second part of the paper highlights the importance of data layout transformation in the optimization of tensor contraction computations on modern processors. A number of considerations such as minimization of cache misses and utilization of multimedia vector instructions are discussed. A library for efficient index permutation of multi-dimensional tensors is described and experimental performance data is provided that demonstrates its effectiveness.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Tensor effects in shell evolution at Z, N=8, 20, and 28 using nonrelativistic and relativistic mean-field theory

Tensor effects in shell evolution are studied within the mean-field approach. Particular attention is paid to the analysis of the magic gaps in different regions of the nuclear chart, namely, Z,N=8, 20, and 28. Hartree-Fock calculations with Skyrme and Gogny interactions are performed where the tensor term has a zero and finite range, respectively. Results obtained with and without the tensor component are compared between them and with the experimental data, when available. To complete this analysis, the tensor effect is also investigated within the relativistic Hartree-Fock model, where the exchange of rho mesons and pions is taken into account. It turns out that the tensor effect in the evolution of the magic gaps can be more easily identified in the cases Z,N=8 and 20, whereas the interpretation of the effect is more complicated for Z or N= 28. Consequently, we indicate the regions defined by the magic numbers 8 and 20 as suitable for fitting the tensor parameters in a mean-field approach: We suggest to include explicitly the data associated to these gap evolutions in the fitting procedures. In general, with the parametrizations used in this work (which have not been fitted on these data), the mean-field results obtained with the tensor contribution do not reproduce the experimental trend, that is, the reduction of the gaps at 8 and 20 that is observed when going toward the drip lines. Since some of the considered nuclei have N=Z, a discussion will be devoted to the interpretation of the experimental data concerning these nuclei and to the Wigner-energy correction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Complete algebraic reduction of one-loop tensor Feynman integrals

We set up a new, flexible approach for the tensor reduction of one-loop Feynman integrals. The 5-point tensor integrals up to rank R=5 are expressed by 4-point tensor integrals of rank R-1, such that the appearance of the inverse 5-point Gram determinant is avoided. The 4-point tensor coefficients are represented in terms of 4-point integrals, defined in d dimensions, 4-2{epsilon}{<=}d{<=}4-2{epsilon}+2(R-1), with higher powers of the propagators. They can be further reduced to expressions which stay free of the inverse 4-point Gram determinants but contain higher-dimensional 4-point integrals with only the first power of scalar propagators, plus 3-point tensor coefficients. A direct evaluation of the higher-dimensional 4-point functions would avoid the appearance of inverse powers of the Gram determinants completely. The simplest approach, however, is to apply here dimensional recurrence relations in order to reduce them to the familiar 2- to 4-point functions in generic dimension d=4-2{epsilon}, introducing thereby coefficients with inverse 4-point Gram determinants up to power R for tensors of rank R. For small or vanishing Gram determinants--where this reduction is not applicable--we use analytic expansions in positive powers of the Gram determinants. Improving the convergence of the expansions substantially with Pade approximants we close up to the evaluation of the 4-point tensor coefficients for larger Gram determinants. Finally, some relations are discussed which may be useful for analytic simplifications of Feynman diagrams.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Tensor network method for reversible classical computation

We develop a tensor network technique that can solve universal reversible classical computational problems, formulated as vertex models on a square lattice [Nat. Commun. 8, 15303 (2017)]. By encoding the truth table of each vertex constraint in a tensor, the total number of solutions compatible with partial inputs and outputs at the boundary can be represented as the full contraction of a tensor network. We introduce an iterative compression-decimation (ICD) scheme that performs this contraction efficiently. The ICD algorithm first propagates local constraints to longer ranges via repeated contraction-decomposition sweeps over all lattice bonds, thus achieving compression on a given length scale. It then decimates the lattice via coarse-graining tensor contractions. Repeated iterations of these two steps gradually collapse the tensor network and ultimately yield the exact tensor trace for large systems, without the need for manual control of tensor dimensions. Our protocol allows us to obtain the exact number of solutions for computations where a naive enumeration would take astronomically long times.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An Efficient Mixed-Mode Representation of Sparse Tensors

The Compressed Sparse Fiber (CSF) representation for sparse tensors is a generalization of the Compressed Sparse Row (CSR) format for sparse matrices. For a tensor with d modes, typical tensor methods such as CANDECOMP/PARAFAC decomposition (CPD) require a sequence of d tensor computations, where efficient memory access with respect to different modes is required for each of them.The straightforward solution is to use d distinct representations of the tensor, with each one being efficient for one of the d computations. However, a d-fold space overhead is often unacceptable in practice, especially with memory-constrained GPUs. In this paper, we present a mixed-mode tensor representation that partitions the tensor’s nonzero elements into disjoint sections, each of which is compressed to create fibers along a different mode. Experimental results on the latest generation of GPU device demonstrate that better performance can be achieved by using the mixed-mode representation, while utilizing only a small fraction of the space required to keep d distinct CSF representations.

Nisa, Israt↗

C++ Tensor Toolbox User Manual (V.1.0)

The C++ Tensor Toolbox is a software package for computing tensor decompositions. It is based on the Matlab Tensor Toolbox, and is particularly optimized for sparse data sets. This user manual briefly overviews tensor decomposition mathematics, software capabilities, and installation of the package. Tensors (also known as multidimensional arrays or N-way arrays) are used in a variety of applications ranging from chemometrics to network analysis. The Tensor Toolbox provides classes for manipulating dense, sparse, and structured tensors in C++. The Toolbox compiles into libraries and is intended for use with custom applications written by users.

99 GENERAL AND MISCELLANEOUS↗

The Poisson tensor completion non-parametric differential entropy estimator

We introduce the Poisson tensor completion (PTC) estimator, a non-parametric differential entropy estimator. The PTC estimator leverages inter-sample relationships to compute a low-rank Poisson tensor decomposition of the frequency histogram. Our crucial observation is that the histogram bins are an instance of a space partitioning of counts and thus can be identified with a spatial Poisson process. The Poisson tensor decomposition leads to a completion of the intensity measure over all bins—including those containing few to no samples—and leads to our proposed PTC differential entropy estimator. A Poisson tensor decomposition models the underlying distribution of the count data and guarantees non-negative estimated values and so can be safely used directly in entropy estimation. Our estimator is the first tensor-based estimator that exploits the underlying spatial Poisson process related to the histogram explicitly when estimating the probability density with low-rank tensor decompositions for the purpose of tensor completion. Furthermore, we demonstrate that our PTC estimator is a substantial improvement over standard histogram-based estimators for sub-Gaussian probability distributions because of the concentration of norm phenomenon.

42 ENGINEERING↗

A Latent-Variable Formulation of the Poisson Canonical Polyadic Tensor Model: Maximum Likelihood Estimation and Fisher Information

We establish parameter inference for the Poisson canonical polyadic (PCP) tensor model through a latent-variable formulation. Our approach exploits the observation that any random PCP tensor can be derived by marginalizing an unobservable random tensor of one dimension larger. The loglikelihood of this larger dimensional tensor, referred to as the “complete” loglikelihood, is comprised of multiple rank one PCP loglikelihoods. Using this methodology, we first derive maximum likelihood estimators for the PCP model and demonstrate that several existing algorithms for fitting non-negative matrix and tensor factorizations are Expectation-Maximization algorithms. Next, we derive the observed and expected Fisher information matrices for the PCP model. The Fisher information provides us crucial insights into the well-posedness of the tensor model, such as the role that tensor rank plays in identifiability and indeterminacy. For the special case of rank one PCP models, we demonstrate that these results are greatly simplified.

97 MATHEMATICS AND COMPUTING↗

Visualization of second order tensor fields and matrix data

We present a study of the visualization of 3-D second order tensor fields and matrix data. The general problem of visualizing unsymmetric real or complex Hermitian second order tensor fields can be reduced to the simultaneous visualization of a real and symmetric second order tensor field and a real vector field. As opposed to the discrete iconic techniques commonly used in multivariate data visualization, the emphasis is on exploiting the mathematical properties of tensor fields in order to facilitate their visualization and to produce a continuous representation of the data. We focus on interactively sensing and exploring real and symmetric second order tensor data by generalizing the vector notion of streamline to the tensor concept of hyperstreamline. We stress the importance of a structural analysis of the data field analogous to the techniques of vector field topology extraction in order to obtain a unique and objective representation of second order tensor fields.

Delmarcelle, Thierry↗

Fast Multipole Method for Coulomb Interaction Based on Traceless Totally Symmetric Tensor

The fast multipole method (FMM) is widely used to calculate the Coulomb interaction between a huge amount of charged particles. The efficiency of FMM scales with O(N) for N particles with any arbitrary distribution. Hence it is apposite for problems with complicated charge distribution or geometry. Under the same FMM framework, there are different approaches, such as using spherical harmonic functions or Maxwell Cartesian tensors. Here we will present a version using traceless totally symmetric Maxwell Cartesian tensor. The previous Maxwell Cartesian tensor based FMM uses totally symmetric tensor. There are (n+1)(n+2)/2 independent elements in a rank n totally symmetric tensor. However, there are only 2n+1 independent elements in a rank n traceless totally symmetric tensor, due to which the efficiency of the traceless version is highly improved compared with the old version, especially when high accuracy is needed and high rank tensors are used.

Huang, He↗

Performance Optimization of Tensor Contraction Expressions for Many Body Methods in Quantum Chemistry

Complex tensor contraction expressions arise in accurate electronic structure models in quantum chemistry, such as the coupled cluster method. This paper addresses two complementary aspects of performance optimization of such tensor contraction expressions. Transformations using algebraic properties of commutativity and associativity can be used to significantly decrease the number of arithmetic operations required for evaluation of these expressions. The identification of common subexpressions among a set of tensor contraction expressions can result in a reduction of the total number of operations required to evaluate the tensor contractions. The first part of the paper describes an effective algorithm for operation minimization with common subexpression identification and demonstrates its effectiveness on tensor contraction expressions for coupled cluster equations. The second part of the paper highlights the importance of data layout transformation in the optimization of tensor contraction computations on modern processors. A number of considerations, such as minimization of cache misses and utilization of multimedia vector instructions, are discussed. A library for efficient index permutation of multidimensional tensors is described, and experimental performance data is provided that demonstrates its effectiveness.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A continuous analogue of the tensor-train decomposition

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents functions using a tensor-train ansatz by replacing the three-dimensional TT cores with univariate matrix-valued functions. The main contribution of this paper is a framework to compute the FT that employs adaptive approximations of univariate fibers, and that is not connected to any tensorized discretization. The algorithm can be coupled with any univariate linear or nonlinear approximation procedure. We demonstrate that this approach can generate multivariate function approximations that are several orders of magnitude more accurate, for the same cost, than those based on the conventional approach of compressing the coefficient tensor of a tensor-product basis. Our approach is in the spirit of other continuous computation packages such as Chebfun, and yields an algorithm which requires the computation of “continuous” matrix factorizations such as the LU and QR decompositions of vector-valued functions. To support these developments, we describe continuous versions of an approximate maximum-volume cross approximation algorithm and of a rounding algorithm that re-approximates an FT by one of lower ranks. We demonstrate that our technique improves accuracy and robustness, compared to TT and quantics-TT approaches with fixed parameterizations, of high-dimensional integration, differentiation, and approximation of functions with local features such as discontinuities and other nonlinearities.

42 ENGINEERING↗

Bayesian tensorized neural networks with automatic rank selection

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is a challenging task due to the difficulty of choosing a proper tensor rank. In order to address this challenge, this paper proposes a low-rank Bayesian tensorized neural network. Our Bayesian method performs automatic model compression via an adaptive tensor rank determination. We also present approaches for posterior density calculation and maximum a posteriori (MAP) estimation for the end-to-end training of our tensorized neural network. Here, we provide experimental validation on a two-layer fully connected neural network, a 6-layer CNN and a 110-layer residual neural network where our work produces 7.4x to 137x more compact neural networks directly from the training while achieving high prediction accuracy.

Low-rank tensor↗

Noether symmetries, energy-momentum tensors, and conformal invariance in classical field theory

In the framework of classical field theory, we first review the Noether theory of symmetries, with simple rederivations of its essential results, with special emphasis given to the Noether identities for gauge theories. With this baggage on board, we next discuss in detail, for Poincare invariant theories in flat spacetime, the differences between the Belinfante energy-momentum tensor and a family of Hilbert energy-momentum tensors. All these tensors coincide on shell but they split their duties in the following sense: Belinfante's tensor is the one to use in order to obtain the generators of Poincare symmetries and it is a basic ingredient of the generators of other eventual spacetime symmetries which may happen to exist. Instead, Hilbert tensors are the means to test whether a theory contains other spacetime symmetries beyond Poincare. We discuss at length the case of scale and conformal symmetry, of which we give some examples. We show, for Poincare invariant Lagrangians, that the realization of scale invariance selects a unique Hilbert tensor which allows for an easy test as to whether conformal invariance is also realized. Finally we make some basic remarks on metric generally covariant theories and classical field theory in a fixed curved background.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Global nuclear structure effects of the tensor interaction

A direct fit of the isoscalar spin-orbit (SO) and both isoscalar and isovector tensor coupling constants to the f{sub 5/2}-f{sub 7/2} SO splittings in {sup 40}Ca, {sup 56}Ni, and {sup 48}Ca nuclei requires a drastic reduction of the isoscalar SO strength and strong attractive tensor coupling constants. The aim of this work is to address further consequences of these strong attractive tensor and weak SO fields on binding energies, nuclear deformability, and high-spin states. In particular, the contribution to the nuclear binding energy from the tensor field shows a generic magic structure with tensorial magic numbers N(Z)=14,32,56, or 90, corresponding to the maximum spin asymmetries in 1d{sub 5/2}, 1f{sub 7/2}+2p{sub 3/2}, 1g{sub 9/2}+2d{sub 5/2}, and 1h{sub 11/2}+2f{sub 7/2} single-particle configurations, respectively, and that these numbers are smeared out by pairing correlations and deformation effects. The consequences of strong attractive tensor fields and weak SO interaction for nuclear stability at the drip lines are also examined, particularly those close to the tensorial doubly magic nuclei. The possibility of an entirely new tensor-force-driven deformation effect is discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Non-abelian symmetries in tensor networks: A quantum symmetry space approach

A general framework for non-abelian symmetries is presented for matrix-product and tensor-network states in the presence of well-defined orthonormal local as well as effective basis sets. The two crucial ingredients, the Clebsch-Gordan algebra for multiplet spaces as well as the Wigner-Eckart theorem for operators, are accounted for in a natural, well-organized, and computationally straightforward way. The unifying tensor-representation for quantum symmetry spaces, dubbed QSpace, is particularly suitable to deal with standard renormalization group algorithms such as the numerical renormalization group (NRG), the density matrix renormalization group (DMRG), or also more general tensor networks such as the multi-scale entanglement renormalization ansatz (MERA). In this paper, the focus is on the application of the non-abelian framework within the NRG. A detailed analysis is presented for a fully screened spin- 3/2 three-channel Anderson impurity model in the presence of conservation of total spin, particle-hole symmetry, and SU(3) channel symmetry. The same system is analyzed using several alternative symmetry scenarios based on combinations of U(1){sub charge}, SU(2){sub spin}, SU(2){sub charge}, SU(3){sub channel}, as well as the enveloping symplectic Sp(6) symmetry. These are compared in detail, including their respective dramatic gain in numerical efficiency. In the Appendix, finally, an extensive introduction to non-abelian symmetries is given for practical applications, together with simple self-contained numerical procedures to obtain Clebsch-Gordan coefficients and irreducible operators sets. The resulting QSpace tensors can deal with any set of abelian symmetries together with arbitrary non-abelian symmetries with compact, i.e. finite-dimensional, semi-simple Lie algebras. - Highlights: Black-Right-Pointing-Pointer We introduce a transparent framework for non-abelian symmetries in tensor networks. Black-Right-Pointing-Pointer The framework was successfully applied within the numerical renormalization group. Black-Right-Pointing-Pointer Combinations of SU(N{<=}3) and Sp(6) are implemented and discussed in detail. Black-Right-Pointing-Pointer Non-abelian symmetries allow to speed up calculations by orders of magnitude. Black-Right-Pointing-Pointer The framework is equally applicable to other tensor networks such as DMRG or MERA.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Tensor decomposition in electronic structure calculations on 3D Cartesian grids

In this paper, we investigate a novel approach based on the combination of Tucker-type and canonical tensor decomposition techniques for the efficient numerical approximation of functions and operators in electronic structure calculations. In particular, we study applicability of tensor approximations for the numerical solution of Hartree-Fock and Kohn-Sham equations on 3D Cartesian grids. We show that the orthogonal Tucker-type tensor approximation of electron density and Hartree potential of simple molecules leads to low tensor rank representations. This enables an efficient tensor-product convolution scheme for the computation of the Hartree potential using a collocation-type approximation via piecewise constant basis functions on a uniform nxnxn grid. Combined with the Richardson extrapolation, our approach exhibits O(h{sup 3}) convergence in the grid-size h=O(n{sup -1}). Moreover, this requires O(3rn+r{sup 3}) storage, where r denotes the Tucker rank of the electron density with r=O(logn), almost uniformly in n. For example, calculations of the Coulomb matrix and the Hartree-Fock energy for the CH{sub 4} molecule, with a pseudopotential on the C atom, achieved accuracies of the order of 10{sup -6} hartree with a grid-size n of several hundreds. Since the tensor-product convolution in 3D is performed via 1D convolution transforms, our scheme markedly outperforms the 3D-FFT in both the computing time and storage requirements.

74 ATOMIC AND MOLECULAR PHYSICS↗

Improve the efficiency of the Cartesian tensor based fast multipole method for Coulomb interaction using the traces

To compute the non-oscillating mutual interaction for a systems with N points, the fast multipole method (FMM) has an efficiency that scales linearly with the number of points. Specifically, for Coulomb interaction, FMM can be constructed using either the spherical harmonic functions or the totally symmetric Cartesian tensors. In this paper, we will present that the effciency of the Cartesian tensor-based FMM for the Coulomb interaction can be significantly improved by implementing the traces of the Cartesian tensors in calculation to reduce the independent elements of the n-th rank totally symmetric Cartesian tensor from (n + 1)(n + 2)=2 to 2n + 1. The computation complexity for the operations in FMM are analyzed and expressed as polynomials of the highest rank of the Cartesian tensors. For most operations, the complexity is reduced by one order. Numerical examples regarding the convergence and the effciency of the new algorithm are demonstrated. As a result, a reduction of computation time up to 50% has been observed for a moderate number of points and rank of tensors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗