Search NASA⌕ Search

Engineering topics

Barthel, Thomas

Publications and source records attributed to Barthel, Thomas.

Absence of Barren Plateaus and Scaling of Gradients in the Energy Optimization of Isometric Tensor Network States

Abstract Vanishing gradients can pose substantial obstacles for high-dimensional optimization problems. Here we consider energy minimization problems for quantum many-body systems with extensive Hamiltonians and finite-range interactions, which can be studied on classical computers or in the form of variational quantum eigensolvers on quantum computers. Barren plateaus correspond to scenarios where the average amplitude of the energy gradient decreases exponentially with increasing system size. This occurs, for example, for quantum neural networks and for brickwall quantum circuits when the depth increases polynomially in the system size. Here we prove that the variational optimization problems for matrix product states, tree tensor networks, and the multiscale entanglement renormalization ansatz are free of barren plateaus. The derived scaling properties for the gradient variance provide an analytical guarantee for the trainability of randomly initialized tensor network states (TNS) and motivate certain initialization schemes. In a suitable representation, unitary tensors that parametrize the TNS are sampled according to the uniform Haar measure. We employ a Riemannian formulation of the gradient based optimizations which simplifies the analytical evaluation.

Barthel, Thomas↗

Solving quasi-free and quadratic Lindblad master equations for open fermionic and bosonic systems

The dynamics of Markovian open quantum systems are described by Lindblad master equations. For fermionic and bosonic systems that are quasi-free, i.e. with Hamiltonians that are quadratic in the ladder operators and Lindblad operators that are linear in the ladder operators, we derive the equation of motion for the covariance matrix. This determines the evolution of Gaussian initial states and the steady states, which are also Gaussian. Using ladder super-operators (a.k.a. third quantization), here we show how the Liouvillian can be transformed to a many-body Jordan normal form which also reveals the full many-body spectrum. Extending previous work by Prosen and Seligman, we treat fermionic and bosonic systems on equal footing with Majorana operators, shorten and complete some derivations, also address the odd-parity sector for fermions, give a criterion for the existence of bosonic steady states, cover non-diagonalizable Liouvillians also for bosons, and include quadratic systems. In extension of the quasi-free open systems, quadratic open systems comprise additional Hermitian Lindblad operators that are quadratic in the ladder operators. While Gaussian states may then evolve into non-Gaussian states, the Liouvillian can still be transformed to a useful block-triangular form, and the equations of motion for k-point Green’s functions form a closed hierarchy. Based on this formalism, results on criticality and dissipative phase transitions in such models are discussed in a companion paper.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Criticality and Phase Classification for Quadratic Open Quantum Many-Body Systems

Here we study the steady states of translation-invariant open quantum many-body systems governed by Lindblad master equations, where the Hamiltonian is quadratic in the ladder operators, and the Lindblad operators are either linear or quadratic and Hermitian. These systems are called quasifree and quadratic, respectively. We find that steady states of one-dimensional systems with finite-range interactions necessarily have exponentially decaying Green’s functions. For the quasifree case without quadratic Lindblad operators, we show that fermionic systems with finite-range interactions are noncritical for any number of spatial dimensions and provide bounds on the correlation lengths. Quasifree bosonic systems can be critical in D > 1 dimensions. Last, we address the question of phase transitions in quadratic systems and find that, without symmetry constraints beyond invariance under single-particle basis and particle-hole transformations, all gapped Liouvillians belong to the same phase.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On the closedness and geometry of tensor network state sets

Tensor network states (TNS) are a powerful approach for the study of strongly correlated quantum matter. The curse of dimensionality is addressed by parametrizing the many-body state in terms of a network of partially contracted tensors. These tensors form a substantially reduced set of effective degrees of freedom. In practical algorithms, functionals like energy expectation values or overlaps are optimized over certain sets of TNS. Concerning algorithmic stability, it is important whether the considered sets are closed because, otherwise, the algorithms may approach a boundary point that is outside the TNS set and tensor elements diverge. Here we discuss the closedness and geometries of TNS sets, and we propose regularizations for optimization problems on non-closed TNS sets. We show that sets of matrix product states (MPS) with open boundary conditions, tree tensor network states, and the multiscale entanglement renormalization ansatz are always closed, whereas sets of translation-invariant MPS with periodic boundary conditions (PBC), heterogeneous MPS with PBC, and projected entangled pair states are generally not closed. The latter is done using explicit examples like the W state, states that we call two-domain states, and fine-grained versions thereof.

97 MATHEMATICS AND COMPUTING↗

Eigenstate entanglement scaling for critical interacting spin chains

With increasing subsystem size and energy, bipartite entanglement entropies of energy eigenstates cross over from the groundstate scaling to a volume law. In previous work, we pointed out that, when strong or weak eigenstate thermalization (ETH) applies, the entanglement entropies of all or, respectively, almost all eigenstates follow a single crossover function. The crossover functions are determined by the subsystem entropy of thermal states and assume universal scaling forms in quantum-critical regimes. This was demonstrated by field-theoretical arguments and the analysis of large systems of non-interacting fermions and bosons. Here, we substantiate such scaling properties for integrable and non-integrable interacting spin-1/2 chains at criticality using exact diagonalization. In particular, we analyze XXZ and transverse-field Ising models with and without next-nearest-neighbor interactions. Indeed, the crossover of thermal subsystem entropies can be described by a universal scaling function following from conformal field theory. Furthermore, we analyze the validity of ETH for entanglement in these models. Even for the relatively small system sizes that can be simulated, the distributions of eigenstate entanglement entropies are sharply peaked around the subsystem entropies of the corresponding thermal ensembles.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Scaling functions for eigenstate entanglement crossovers in harmonic lattices

For quantum matter, eigenstate entanglement entropies obey an area law or log-area law at low energies and small subsystem sizes and cross over to volume laws for high energies and large subsystems. This transition is captured by crossover functions, which assume a universal scaling form in quantum critical regimes. We demonstrate this for the harmonic lattice model, which describes quantized lattice vibrations and is a regularization for free scalar field theories, modeling, e.g., spin-0 bosonic particles. In one dimension, the ground-state entanglement obeys a log-area law. For dimensions d ≥ 2, it displays area laws, even at criticality. The distribution of excited-state entanglement entropies is found to be sharply peaked around subsystem entropies of corresponding thermodynamic ensembles in accordance with the eigenstate thermalization hypothesis. Numerically, we determine crossover scaling functions for the quantum critical regime of the model and do a large-deviation analysis. We show how infrared singularities of the system can be handled and how to access the thermodynamic limit using a perturbative trick for the covariance matrix. Eigenstates for quasi-free bosonic systems are not Gaussian. Here, we resolve this problem by considering appropriate squeezed states instead. For these, entanglement entropies can be evaluated efficiently.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Eigenstate Entanglement: Crossover from the Ground State to Volume Laws

For the typical quantum many-body systems that obey the eigenstate thermalization hypothesis (ETH), we argue that the entanglement entropy of (almost) all energy eigenstates is described by a single crossover function. The ETH implies that the crossover functions can be deduced from subsystem entropies of thermal ensembles and have universal properties. These functions capture the full crossover from the ground-state entanglement regime at low energies and small subsystem size (area or log-area law) to the extensive volume-law regime at high energies or large subsystem size. For critical one-dimensional systems, a universal scaling function follows from conformal field theory and can be adapted for nonlinear dispersions. We use it to also deduce the crossover scaling function for Fermi liquids in d > 1 dimensions. Here, the analytical results are complemented by numerics for large noninteracting systems of fermions in d ≤ 3 dimensions and have also been confirmed for bosonic systems and nonintegrable spin chains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Low-energy physics of isotropic spin-1 chains in the critical and Haldane phases

Using a matrix product state algorithm with infinite boundary conditions, we compute high-resolution dynamic spin and quadrupolar structure factors in the thermodynamic limit to explore the low-energy excitations of isotropic bilinear-biquadratic spin-1 chains. Haldane mapped the spin-1 Heisenberg antiferromagnet to a continuum field theory, the nonlinear sigma model (NLσM). In this work, we find that the NLσM fails to capture the influence of the biquadratic term and provides only an unsatisfactory description of the Haldane phase physics. But several features in the Haldane phase can be explained by noninteracting multimagnon states. The physics at the Uimin-Lai-Sutherland point is characterized by multisoliton continua. Moving into the extended critical phase, we find that these excitation continua contract, which we explain using a field-theoretic description. New excitations emerge at higher energies and, in the vicinity of the purely biquadratic point, they show simple cosine dispersions. Using block fidelities, we identify them as elementary one-particle excitations and relate them to the integrable Temperley-Lieb chain.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Optimized Lie–Trotter–Suzuki decompositions for two and three non-commuting terms

Lie–Trotter–Suzuki decompositions are an efficient way to approximate operator exponentials exp ( t H ) when H is a sum of n (non-commuting) terms which, individually, can be exponentiated easily. They are employed in time-evolution algorithms for tensor network states, digital quantum simulation protocols, path integral methods like quantum Monte Carlo, and splitting methods for symplectic integrators in classical Hamiltonian systems. Here, we provide optimized decompositions up to order t 6 . The leading error term is expanded in nested commutators (Hall bases) and we minimize the 1-norm of the coefficients. For n = 2 terms, several of the optima we find are close to those in McLachlan (1995). Generally, our results substantially improve over unoptimized decompositions by Forest, Ruth, Yoshida, and Suzuki. We explain why these decompositions are sufficient to efficiently simulate any one- or two-dimensional lattice model with finite-range interactions. This follows by solving a partitioning problem for the interaction graph.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The matrix product approximation for the dynamic cavity method

Stochastic dynamics of classical degrees of freedom, defined on vertices of locally tree-like graphs, can be studied in the framework of the dynamic cavity method which is exact for tree graphs. Such models correspond for example to spin-glass systems, Boolean networks, neural networks, and other technical, biological, and social networks. The central objects in the cavity method are edge messages—conditional probabilities of two vertex variable trajectories. In this paper, we discuss a rather pedagogical derivation for the dynamic cavity method, give a detailed account of the novel matrix product edge message (MPEM) algorithm for the solution of the dynamic cavity equation as introduced, and present optimizations and extensions. Matrix product approximations of the edge messages are constructed recursively in an iteration over time. Computation costs and precision can be tuned by controlling the matrix dimensions of the MPEM in truncations. Without truncations, the dynamics is exact. Data for Glauber–Ising dynamics shows a linear growth of computation costs in time. In contrast to Monte Carlo simulations, the approach has a much better error scaling. Hence, it gives for example access to low probability events and decaying observables like temporal correlations. Here, we discuss optimized truncation schemes and an extension that allows to capture models which have a continuum time limit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Unitary circuits for strongly correlated fermions

We introduce a scheme for efficiently describing pure states of strongly correlated fermions in higher dimensions using unitary circuits featuring a causal cone. A local way of computing local expectation values is presented. We formulate a dynamical reordering scheme, corresponding to time-adaptive Jordan-Wigner transformation, that avoids nonlocal string operators. Primitives of such a reordering scheme are highlighted. Fermionic unitary circuits can be contracted with the same complexity as in the spin case. The scheme gives rise to a variational description of fermionic models not suffering from a sign problem. We present numerical examples in a 9x9 and 6x6 fermionic lattice model to show the functioning of the approach.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Contraction of fermionic operator circuits and the simulation of strongly correlated fermions

A fermionic operator circuit is a product of fermionic operators of usually different and partially overlapping support. Further elements of fermionic operator circuits (FOCs) are partial traces and partial projections. The presented framework allows for the introduction of fermionic versions of known qudit operator circuits (QUOC), important for the simulation of strongly correlated d-dimensional systems: the multiscale entanglement renormalization ansaetze (MERA), tree tensor networks (TTN), projected entangled pair states (PEPS), or their infinite-size versions (iPEPS etc.). After the definition of a FOC, we present a method to contract it with the same computation and memory requirements as a corresponding QUOC, for which all fermionic operators are replaced by qudit operators of identical dimension. A given scheme for contracting the QUOC relates to an analogous scheme for the corresponding fermionic circuit, where additional marginal computational costs arise only from reordering of modes for operators occurring in intermediate stages of the contraction. Our result hence generalizes efficient schemes for the simulation of d-dimensional spin systems, as MERA, TTN, or PEPS to the fermionic case.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗