Search NASA⌕ Search

Engineering topics

Doak, Peter W.

Publications and source records attributed to Doak, Peter W..

11 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A galactic approach to neutron scattering science

Neutron scattering science is leading to significant advances in our understanding of materials and will be key to solving many of the challenges that society is facing today. Improvements in scientific instruments are actually making it more difficult to analyze and interpret the results of experiments due to the vast increases in the volume and complexity of data being produced and the associated computational requirements for processing that data. New approaches to enable scientists to leverage computational resources are required, and Oak Ridge National Laboratory (ORNL) has been at the forefront of developing these technologies. We recently completed the design and initial implementation of a neutrons data interpretation platform that allows seamless access to the computational resources provided by ORNL. For the first time, we have demonstrated that this platform can be used for advanced data analysis of correlated quantum materials by utilizing the world's most powerful computer system, Frontier. In particular, we have shown the end-to-end execution of the DCA++ code to determine the dynamic magnetic spin susceptibility χ(q, ω) for a single-band Hubbard model with Coulomb repulsion U/t = 8 in units of the nearest-neighbor hopping amplitude t and an electron density of n = 0.65. The following work describes the architecture, design, and implementation of the platform and how we constructed a correlated quantum materials analysis workflow to demonstrate the viability of this system to produce scientific results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Software engineering to sustain a high-performance computing scientific application: QMCPACK

We provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum MonteCarlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion ofcontinuous integration (CI) targeting CPU, using GitHub Actions runners, and graphics processing units (GPU) in pre-exascalesystems, using self-hosted hardware; (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Dockercontainers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, sustainable maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the sustainability of community HPC codes and scientific discovery at scale.

Godoy, William↗
DOE OSTI2023

Spin-singlet topological superconductivity in the attractive Rashba-Hubbard model

Fully gapped, spin-singlet superconductors with antisymmetric spin-orbit coupling in a Zeeman magnetic field provide a promising route to realize superconducting states with non-Abelian topological order and therefore fault-tolerant quantum computation. Here we use a quantum Monte Carlo dynamical cluster approximation to study the superconducting properties of a doped two-dimensional attractive Hubbard model with Rashba spin-orbit coupling in a Zeeman magnetic field. We generally find that the Rashba coupling has a beneficial effect towards s-wave superconductivity. In the presence of a finite Zeeman field, when superconductivity is suppressed by Pauli pair breaking, the Rashba coupling counteracts the spin imbalance created by the Zeeman field by mixing the spins, and thus restores superconductivity at finite temperatures. Further, we show that this favorable effect of the spin-orbit coupling is traced to a spin-flip driven enhancement of the amplitude for the propagation of a pair of electrons in time-reversed states. Moreover, by inspecting the Fermi surface of the interacting model, we show that for sufficiently large Rashba coupling and Zeeman field, the superconducting state is expected to be topologically nontrivial.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

A High-Performance Design for Hierarchical Parallelism in the QMCPACK Monte Carlo code

We introduce a new high-performance design for parallelism within the Quantum Monte Carlo code QMCPACK. We demonstrate that the new design is better able to exploit the hierarchical parallelism of heterogeneous architectures compared to the previous GPU implementation. The new version is able to achieve higher GPU occupancy via the new concept of crowds of Monte Carlo walkers, and by enabling more host CPU threads to effectively offload to the GPU. The higher performance is expected to be achieved independent of the underlying hardware, significantly improving developer productivity and reducing code maintenance costs. Scientific productivity is also improved with full support for fallback to CPU execution when GPU implementations are not available or CPU execution is more optimal.

Luo, Ye↗
DOE OSTI2022

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗
DOE OSTI2020

QMCPACK: Advances in the development, efficiency, and application of auxiliary field and real-space variational and diffusion quantum Monte Carlo

We review recent advances in the capabilities of the open source ab initio Quantum Monte Carlo (QMC) package QMCPACK and the workflow tool Nexus used for greater efficiency and reproducibility. The auxiliary field QMC (AFQMC) implementation has been greatly expanded to include k-point symmetries, tensor-hypercontraction, and accelerated graphical processing unit (GPU) support. These scaling and memory reductions greatly increase the number of orbitals that can practically be included in AFQMC calculations, increasing the accuracy. Advances in real space methods include techniques for accurate computation of bandgaps and for systematically improving the nodal surface of ground state wavefunctions. Results of these calculations can be used to validate application of more approximate electronic structure methods, including GW and density functional based techniques. To provide an improved foundation for these calculations, we utilize a new set of correlation-consistent effective core potentials (pseudopotentials) that are more accurate than previous sets; these can also be applied in quantum-chemical and other many-body applications, not only QMC. These advances increase the efficiency, accuracy, and range of properties that can be studied in both molecules and materials with QMC and QMCPACK.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2019

Accelerating DCA++ (Dynamical Cluster Approximation) Scientific Application on the Summit supercomputer

Optimizing scientific applications on today’s accelerator-based high performance computing systems can be challenging, especially when multiple GPUs and CPUs with heterogeneous memories and persistent non-volatile memories are present. An example is Summit, an accelerator-based system at the Oak Ridge Leadership Computing Facility (OLCF) that is rated as the world’s fastest supercomputer to-date. New strategies are thus needed to expose the parallelism in legacy applications, while being amenable to efficient mapping to the underlying architecture.In this paper we discuss our experiences and strategies to port a scientific application, DCA++, to Summit. DCA++ is a highperformance research application that solves quantum manybody problems with a cutting edge quantum cluster algorithm, the dynamical cluster approximation.Our strategies aim to synergize the strengths of the different programming models in the code. These include: (a) streamlining the interactions between the CPU threads and the GPUs, (b) implementing computing kernels on the GPUs and decreasing CPU-GPU memory transfers, (c) allowing asynchronous GPU communications, and (d) increasing compute intensity by combining linear algebraic operations.Full-scale production runs using all 4600 Summit nodes attained a peak performance of 73.5 PFLOPS with a mixed precision implementation.We observed a perfect strong and weak scaling for the quantum Monte Carlo solver in DCA++, while encountering about 2× input/output (I/O) and MPI communication overhead on the time-to-solution for the full machine run. Our hardware agnostic optimizations are designed to alleviate the communication and I/O challenges observed, while improving the compute intensity and obtaining optimal performance on a complex, hybrid architecture like Summit.

Balduzzi, Giovanni↗
DOE OSTI2019

Probing Surface Chemistry at an Atomic Level: Decomposition of 1-Propanethiol on GaP(001) (2 × 4) Investigated by STM, XPS, and DFT

The adsorption and decomposition mechanisms for 1-propanethiol on a Ga-rich GaP(001) (2 × 4) surface are investigated at an atomic level using scanning tunneling microscopy (STM), X-ray photoelectron spectroscopy, and density functional theory (DFT) calculations. Using a combination of experimental and theoretical tools, we probe the detailed structures and energetics of a series of reaction intermediates in the thermal decomposition pathway from 130 to 773 K. At 130 K, the propanethiolate adsorbates are observed at the edge gallium sites, with the thiolate–Ga bonding configuration maintained up to 473 K. Further decomposition produces two new surface features, Ga–S–Ga and P-propyl species at 573 K. Finally, S-induced (1 × 1) and (2 × 1) reconstructions are observed at 673–773 K, which are reportedly associated with arrays of surface Ga–S–Ga bonds and subsurface diffusion of S. To understand the observed site-selectivity on the hydrogen dissociation of the thiol molecule at 130 K, the two most likely dissociation pathways (Ga–P vs Ga–Ga dimer sites) are investigated using DFT Gibbs energy calculations. While the theory predicts the kinetic advantage for the dissociation reaction occurring on the Ga–P dimer (Lewis acid–base combination), we only observed dissociation products on the Ga–Ga dimer (Lewis acid). Here, the DFT calculations clarify that the reversible thiolate diffusion along the Ga dimer row prevents recombinative desorption, which is probable on the Ga–P dimer. Together with experimental and theoretical results, we suggest a thermal decomposition mechanism for the thiol molecule with atomic-level structural details.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

Thermodynamic Control of Two-Dimensional Molecular Ionic Nanostructures on Metal Surfaces

Bulk molecular ionic solids exhibit fascinating electronic properties, including electron correlations, phase transitions and superconducting ground states. In contrast, few of these phenomena have so far been observed in low-dimensional molecular structures, including thin films, nanoparticles and molecular blends, not in the least because most of such structures have so far been composed of nearly closed-shell molecules. It is therefore desirable to develop low-dimensional molecular structures of ionic molecules toward fundamental studies and potential applications. Here we present detailed analysis of monolayer-thick structures of the canonical TTF-TCNQ (tetrathiafulvalene 7,7,8,8-tetracyanoquinodimethane) system grown on low-index gold and silver surfaces. The most distinctive property of the epitaxial growth is the wide abundance of stable TTF/TCNQ ratios, in sharp contrast to the predominance of 1:1 ratio in the bulk. We propose the existence of the surface phase-diagram that controls the structures of TTF-TCNQ on the surfaces, and demonstrate phase-transitions that occur upon progressively increasing the density of TCNQ while keeping the surface coverage of TTF fixed. Based on direct observations, we propose the binding motif behind the stable phases and infer the dominant interactions that enable the existence of the rich spectrum of surface structures. Finally, we also show that the surface phase diagram will control the epitaxy beyond monolayer coverage. Multiplicity of stable surface structures, the corollary rich phase diagram and the corresponding phase-transitions present an interesting opportunity for low-dimensional molecular systems, particularly if some of the electronic properties of the bulk can be preserved or modified in the surface phases.

36 MATERIALS SCIENCE↗