Search NASA⌕ Search

Engineering topics

Gordon, Mark S.

Publications and source records attributed to Gordon, Mark S..

LibERI—A portable and performant multi-GPU accelerated library for electron repulsion integrals via OpenMP offloading and standard language parallelism

A portable and performant graphics processing unit (GPU)-accelerated library for electron repulsion integral (ERI) evaluation, named LibERI, has been developed and implemented via directive-based (e.g., OpenMP and OpenACC) and standard language parallelism (e.g., Fortran DO CONCURRENT). Offloaded ERIs consist of integrals over low and high contraction s, p, and d functions using the rotated-axis and Rys quadrature methods. GPU codes are factorized based on previous developments with two layers of integral screening and quartet presorting. In this work, the density screening is moved to the GPU to enhance the computational efficacy for large molecular systems. Here, the L-shells in the Pople basis set are also separated into pure S and P shells to increase the ERI homogeneity and reduce atomic operations and the memory footprint. LibERI is compatible with any quantum chemistry drivers supporting the MolSSI Driver Interface. Benchmark calculations of LibERI interfaced with the GAMESS software package were carried out on various GPU architectures and molecular systems. The results show that the LibERI performance is comparable to other state-of-the-art GPU-accelerated codes (e.g., TeraChem and GMSHPC) and, in some cases, outperforms conventionally developed ERI CUDA kernels (e.g., QUICK) while fully maintaining portability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analysis of bonding motifs in unusual molecules II: infinitene

The bonding structures of infinitene, the Chemical and Engineering News 2021 Molecule of the Year, is studied by means of oriented quasi-atomic orbitals (QUAOs) to assess the degree of aromaticity within the molecule.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Runtime performance of a GAMESS quantum chemistry application offloaded to GPUs

Summary Computational chemistry is at the forefront of solving urgent societal problems, such as polymer upcycling and carbon capture. The complexity of modeling these processes at appropriate length and time scales is mainly manifested in the number and types of chemical species involved in the reactions and may require models of several thousand atoms and large basis sets to accurately capture the chemical complexity and heterogeneity in the physical and chemical processes. The quantum chemistry package General Atomic and Molecular Electronic Structure System (GAMESS) has a wide array of methods that can efficiently and accurately treat complex chemical systems. In this work, we have used the GAMESS Effective Fragment Molecule Orbital (EFMO) method for electronic structure calculation of a challenging mesoporous silica nanoparticle (MSN) model surrounded by about 4700 water molecules to investigate the strong scaling and GPU offloading on hybrid CPU‐GPU nodes. Experiments were performed on the Perlmutter platform at the National Energy Research Scientific Computing Center. Good strong scaling and load balancing have been observed on up to 88 hybrid nodes for different settings of the execution parameters for the calculation considered here. When GPUs are oversubscribed by offloading work from multiple CPU processes, using the NVIDIA multi‐process service (MPS) has consistently reduced time to solution and energy consumed. Additionally, for some configuration parameter settings, oversubscription with MPS improved performance by up to 5.8% over the case without oversubscription.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Effective Fragment Molecular Orbital Method: Achieving High Scalability and Accuracy for Large Systems

The effective fragment molecular orbital (EFMO) method has been developed to predict the total energy of a very large molecular system accurately (with respect to the underlying quantum mechanical method) and efficiently by taking advantage of the locality of strong chemical interactions and employing a two-level hierarchical parallelism. The accuracy of the EFMO method is partly attributed to the accurate and robust intermolecular interaction prediction between distant fragments, in particular, the many-body polarization and dispersion effects, which require the generation of static and dynamic polarizability tensors by solving the coupled perturbed Hartree–Fock (CPHF) and time-dependent HF (TDHF) equations, respectively. Solving the CPHF and TDHF equations is the main EFMO computational bottleneck due to the inefficient (serial) and I/O-intensive implementation of the CPHF and TDHF solvers. In this work, the efficiency and scalability of the EFMO method are significantly improved with a new CPU memory-based implementation for solving the CPHF and TDHF equations that are parallelized by either message passing interface (MPI) or hybrid MPI/OpenMP. Here, the accuracy of the EFMO method is demonstrated for both covalently bonded systems and noncovalently bound molecular clusters by systematically examining the effects of basis sets and a key distance-related cutoff parameter, R cut . R cut determines whether a fragment pair (dimer) is treated by the chosen ab initio method or calculated using the effective fragment potential (EFP) method (separated dimers). Decreasing the value of Rcut increases the number of separated (EFP) dimers, thereby decreasing the computational effort. It is demonstrated that excellent accuracy (<1 kcal/mol error per fragment) can be achieved when using a sufficiently large basis set with diffuse functions coupled with a small R cut value. With the new parallel implementation, the total EFMO wall time is substantially reduced, especially with a high number of MPI ranks. Given a sufficient workload, nearly ideal strong scaling is achieved for the CPHF and TDHF parts of the calculation. For the first time, EFMO calculations with the inclusion of long-range polarization and dispersion interactions on a hydrated mesoporous silica nanoparticle with explicit water solvent molecules (more than 15k atoms) are achieved on a massively parallel supercomputer using nearly 1000 physical nodes. In addition, EFMO calculations on the carbinolamine formation step of an amine-catalyzed aldol reaction at the nanoscale with explicit solvent effects are presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prediction of stability constants of metal–ligand complexes by machine learning for the design of ligands with optimal metal ion selectivity

The new LOGKPREDICT program integrates HostDesigner molecular design software with the machine learning (ML) program Chemprop. By supplying HostDesigner with predicted log K values, LOGKPREDICT enhances the computer-aided molecular design process by ranking ligands directly by metal–ligand binding strength. Harnessing reliable experimental data from a historic National Institute of Standards and Technology (NIST) database and data from the International Union of Pure and Applied Chemistry (IUPAC), we train message passing neural net algorithms. The multi-metal NIST-based ML model has a root mean square error (RMSE) of 0.629 ± 0.044 (R 2 of 0.960 ± 0.006), while two versions of lanthanide-only IUPAC-based ML models have, respectively, RMSE of 0.764 ± 0.073 (R 2 of 0.976 ± 0.005) and 0.757 ± 0.071 (R 2 of 0.959 ± 0.007). For relative log K predictions on an out-of-sample set of six ligands, demonstrating metal ion selectivity, the RMSE value reaches a commendably low 0.25. Here we showcase the use of LOGKPREDICT in identifying ligands with high selectivity for lanthanides in aqueous solutions, a finding supported by recent experimental evidence. We also predict new ligands yet to be verified experimentally. Therefore, our ML models implemented through LOGKPREDICT and interfaced with the ligand design software HostDesigner pave the way for designing new ligands with predetermined selectivity for competing metal ions in an aqueous solution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

R –8 Dispersion Interaction: Derivation and Application to the Effective Fragment Potential Method

The anisotropic and isotropic R –8 dispersion contributions (disp8) are derived and implemented within the framework of the effective fragment potential (EFP) method formulated with imaginary frequency-dependent Cartesian polarizability tensors distributed at the centroids of the localized molecular orbitals (LMOs). Two forms of damping functions, intermolecular overlap-based and Tang–Toennies, are extended for disp8. To obtain LMO polarizability tensors centered at LMO centroids, an origin-shifting transformation is derived and implemented for the dipole–octopole polarizability tensor and the quadrupole–quadrupole polarizability tensor. The analytic gradient is derived and implemented for the isotropic disp8 contribution. Relative to the previously implemented empirical EFP disp8 energy, the isotropic disp8 component of the interaction energy improves the overall agreement of the EFP dispersion energies with the symmetry-adapted perturbation theory (SAPT) benchmarks, reducing the mean absolute errors (MAEs) and mean absolute percentage errors for most of the databases examined in this work. Further, while the anisotropic disp8 can further enhance the accuracy of the EFP dispersion energy and yield smaller MAEs, significantly overbound dispersion energies are predicted by the anisotropic disp8 when the maximum element in the intermolecular overlap matrix is greater than 0.1, possibly due to the breakdown of the approximations made in the EFP dispersion derivation at a short range. For potential energy scan databases, the newly developed EFP dispersion model with isotropic disp8 yields the overall correct curvature and good agreement with SAPT benchmarks around equilibrium and longer but overestimates the dispersion interactions at a short range. While the overlap-based dispersion-damping functions produce better MAEs than Tang–Toennies damping functions, further improvement is needed to better screen the large attractive dispersion energies at a short range (overlap >0.1).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spin–orbit coupling of electrons on separate lanthanide atoms of Pr 2 O 2 and its singly charged cation

Although it plays a critical role in the photophysics and catalysis of lanthanides, spin–orbit coupling of electrons on individual lanthanide atoms in small clusters is not well understood. The major objective of this work is to probe such coupling of the praseodymium (Pr) 4f and 6s electrons in Pr 2 O 2 and Pr 2 O 2 +. The approach combines mass-analyzed threshold ionization spectroscopy and spin–orbit multiconfiguration second-order quasi-degenerate perturbation theory. The energies of six ionization transitions are precisely measured; the adiabatic ionization energy of the neutral cluster is 38 045 (5) cm –1 . Most of the electronic states involved in these transitions are identified as spin–orbit coupled states consisting of two or more electron spins. The electron configurations of these states are 4f 4 6s 2 for the neutral cluster and 4 f 46 s for the singly charged cation, both in planar rhombus-type structures. Finally, the spin–orbit splitting due to the coupling of the electrons on the separate Pr atoms is on the order of hundreds of wavenumbers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The General Atomic and Molecular Electronic Structure System (GAMESS): Novel Methods on Novel Architectures

The primary focus of GAMESS over the last 5 years has been the development of new high-performance codes that are able to take effective and efficient advantage of the most advanced computer architectures, both CPU and accelerators. These efforts include employing density fitting and fragmentation methods to reduce the high scaling of well-correlated (e.g., coupled-cluster) methods as well as developing novel codes that can take optimal advantage of graphical processing units and other modern accelerators. Because accurate wave functions can be very complex, an important new functionality in GAMESS is the quasi-atomic orbital analysis, an unbiased approach to the understanding of covalent bonds embedded in the wave function. Finally, best practices for the maintenance and distribution of GAMESS are also discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analysis of the bonding in tetrahedrane and phosphorus-substituted tetrahedranes

The bonding structures of tetrahedrane, phosphatetrahedrane, diphosphatetrahedrane and triphosphatetrahedrane are studied by employing an intrinsic quasi-atomic orbital analysis. Ethane, cyclopropane and tetrahedral P 4 are employed as reference systems. The orbital analysis is paired with the computation of strain energies via isodesmic reactions. The results show that the increase in geometric strain upon transition from ethane to cyclopropane to tetrahedrane weakens the CC bonds, despite leading to shorter C–C interatomic distances. With the increase in strain, the orbitals centered on C and involved in the bonding of the cage structure are observed to have elevated p-character, and the orbital structure of C deviates from sp 3 hybridization. The systematic substitution of CH groups by P atoms in the cage structure of tetrahedrane leads to stronger CC bonds, larger angles in the cage structures of the resulting phosphatetrahedranes, lower p-character in the orbitals involved in the bonding of the cages, and lower strain energies. It is found that P is more amenable to strained molecular arrangements than is C, and that the propensity of a given atom to hybridize s and p functions, or the lack thereof, has implications in the stability of molecules with strained geometries. The combination of the calculations presented here with the existing literature provides insight into the apparent propensity of tetrahedrane and P 4 to ‘break’ their tetrahedral structures. Trends in the bonding interactions, such as bond strengths, s- and p-orbital characters and charge transfer are identified and related to the strain energy observed in each of the analyzed systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enabling Fortran Standard Parallelism in GAMESS for Accelerated Quantum Chemistry Calculations

The performance of Fortran 2008 DO CONCURRENT (DC) relative to OpenACC and OpenMP target offloading (OTO) with different compilers is studied for the GAMESS quantum chemistry application. Specifically, DC and OTO are used to offload the Fock build, which is a computational bottleneck in most quantum chemistry codes, to GPUs. The DC Fock build performance is studied on NVIDIA A100 and V100 accelerators and compared with the OTO versions compiled by the NVIDIA HPC, IBM XL, and Cray Fortran compilers. The results show that DC can speed up the Fock build by 3.0× compared with that of the OTO model. Finally, with similar offloading efforts, DC is a compelling programming model for offloading Fortran applications to GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High-performance strategies for the recent MRSF-TDDFT in GAMESS

Multiple ERI (Electron Repulsion Integral) tensor contractions (METC) with several matrices are ubiquitous in quantum chemistry. In response theories, the contraction operation, rather than ERI computations, can be the major bottleneck, as its computational demands are proportional to the multiplicatively combined contributions of the number of excited states and the kernel pre-factors. Here, this paper presents several high-performance strategies for METC. Optimal approaches involve either the data layout reformations of interim density and Fock matrices, the introduction of intermediate ERI quartet buffer, and loop-reordering optimization for a higher cache hit rate. The combined strategies remarkably improve the performance of the MRSF (mixed reference spin flip)-TDDFT (time-dependent density functional theory) by nearly 300%. The results of this study are not limited to the MRSF-TDDFT method and can be applied to other METC scenarios.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Porting fragmentation methods to GPUs using an OpenMP API: Offloading the resolution-of-the-identity second-order Møller–Plesset perturbation method

Here, using an OpenMP Application Programming Interface, the resolution-of-the-identity second-order Møller–Plesset perturbation (RI-MP2) method has been off-loaded onto graphical processing units (GPUs), both as a standalone method in the GAMESS electronic structure program and as an electron correlation energy component in the effective fragment molecular orbital (EFMO) framework. First, a new scheme has been proposed to maximize data digestion on GPUs that subsequently linearizes data transfer from central processing units (CPUs) to GPUs. Second, the GAMESS Fortran code has been interfaced with GPU numerical libraries (e.g., NVIDIA cuBLAS and cuSOLVER) for efficient matrix operations (e.g., matrix multiplication, matrix decomposition, and matrix inversion). The standalone GPU RI-MP2 code shows an increasing speedup of up to 7.5× using one NVIDIA V100 GPU with one IBM 42-core P9 CPU for calculations on fullerenes of increasing size from 40 to 260 carbon atoms using the 6-31G(d)/cc-pVDZ-RI basis sets. A single Summit node with six V100s can compute the RI-MP2 correlation energy of a cluster of 175 water molecules using the correlation consistent basis sets cc-pVDZ/cc-pVDZ-RI containing 4375 atomic orbitals and 14 700 auxiliary basis functions in ~0.85 h. In the EFMO framework, the GPU RI-MP2 component shows near linear scaling for a large number of V100s when computing the energy of an 1800-atom mesoporous silica nanoparticle in a bath of 4000 water molecules. The parallel efficiencies of the GPU RI-MP2 component with 2304 and 4608 V100s are 98.0% and 96.1%, respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The nature of the chemical bond

The nature of the chemical bond has long been a topic of much interest, beginning with the speculations of Isaac Newton about the “forces” that hold atoms together to the famous book by Linus Pauling with this title. For chemists, the existence of bonds between the atoms in a molecule is without question, but what are they, how can they be categorized, and what accounts for their existence? Furthermore, early theories focused on the attraction of electrical charges of opposite sign, which could account for the binding in many inorganic molecules. But what would account for the binding in electrically neutral organic molecules? Slightly more than a century ago, G. N. Lewis noted that the chemical bond appeared to be associated with electron pairs. Shortly after the discovery of the wave equation by Irwin Schrödinger in 1925-6, Heitler and London showed that quantum mechanics, in the form of what would eventually be called valence bond (VB) theory, accounted for the binding in that most improbable of molecules, the simple H 2 molecule.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Porting Fragmentation Methods to Graphical Processing Units Using an OpenMP Application Programming Interface: Offloading the Fock Build for Low Angular Momentum Functions

Here, a framework to offload four-index two-electron repulsion integrals to graphical processing units (GPUs) using OpenMP is discussed. The method has been applied to the Fock build for low angular momentum s and p functions in both the restricted Hartree–Fock (RHF) and in the effective fragment molecular orbital (EFMO) framework. Benchmark calculations for the GPU code for the pure RHF method show an increasing speedup relative to the existing OpenMP CPU code in GAMESS from 1.04 to 52× for clusters of 70–569 water molecules. The parallel efficiency on 24 NVIDIA V100 GPU boards also increases when increasing the system size: from 75 to 94% for water clusters that contain 303–1120 molecules. In the EFMO framework, the GPU Fock build shows a high linear scalability up to 4608 V100s with a parallel efficiency of 96% for calculations on a solvated mesoporous silica nanoparticle system with ~67,000 basis functions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗