Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as p2r, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these miniapps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The 0E2 benchmarks for PWR UO 2 decay heat: an analysis from the NEA WPNCS

This paper presents the work performed in the subgroup 16 of the Working Party for Nuclear Criticality Safety (WPNCS) of the OECD Nuclear Energy Agency. The main goal was to define two decay heat benchmarks for Spent Nuclear Fuel (one pincell and one assembly), perform calculations and compare and analyze the results in light of existing calorimetric measurements. The selected case is the PWR UO2 assembly 0E2, irradiated at the Ringhals-3 reactor and measured at the Clab facility in Sweden. In total, 21 institutes worldwide participated to the exercise, leading to 55 calculated results (named C). It was found that the measured decay heat values (E) can be satisfactorily reproduced with two-dimensional assembly calculations, leading to an average C/E value of 0.99, with an uncertainty (or one standard deviation) of ±0.01.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Data-Driven Benchmarking of Building Energy Efficiency Utilizing Statistical Frontier Models

Frontier methods quantify the energy efficiency of buildings by forming an efficient frontier (best-practice technology) and by comparing all buildings against that frontier. Because energy consumption fluctuates over time, the efficiency scores are stochastic random variables. Existing applications of frontier methods in energy efficiency either treat efficiency scores as deterministic values or estimate their uncertainty by resampling from one set of measurements. Availability of smart meter data (repeated measurements of energy consumption of buildings) enables using actual data to estimate the uncertainty in efficiency scores. Additionally, existing applications assume a linear form for an efficient frontier; i.e.,they assume that the best-practice technology scales up and down proportionally with building characteristics. However, previous research shows that buildings are nonlinear systems. This paper proposes a statistical method called stochastic energy efficiency frontier (SEEF) to estimate a bias-corrected efficiency score and its confidence intervals from measured data. The paper proposes an algorithm to specify the functional form of the frontier, identify the probability distribution of the efficiency score of each building using measured data, and rank buildings based on their energy efficiency. To illustrate the power of SEEF, this paper presents the results from applying SEEF on a smart meter data set of 307 residential buildings in the United States. SEEF efficiency scores are used to rank individual buildings based on energy efficiency, to compare subpopulations of buildings, and to identify irregular behavior of buildings across different time-of-use periods. SEEF is an improvement to the energy-intensity method (comparing kWh/sq.ft.): whereas SEEF identifies efficient buildings across the entire spectrum of building sizes, the energy-intensity method showed bias toward smaller buildings. The results of this research are expected to assist researchers and practitioners compare and rank (i.e.,benchmark) buildings more robustly and over a wider range of building types and sizes. Eventually, doing so is expected to result in improved resource allocation in energy-efficiency programs.

Kavousian, A↗

Benchmark oxygen-oxygen pair-distribution function of ambient water from x-ray diffraction measurements with a wide Q-range

Four recent x-ray diffraction measurements of ambient liquid water are reviewed here. Each of these measurements represents a significant development of the x-ray diffraction technique applied to the study of liquid water. Sources of uncertainty from statistical noise, Q-range, Compton scattering, and self-scattering are discussed. The oxygen-hydrogen contribution to the measured x-ray scattering pattern was subtracted using literature data to yield an experimental determination, with error bars, of the oxygen-oxygen pair-distribution function, g{sub OO}(r), which essentially describes the distribution of molecular centers. The extended Q-range and low statistical noise of these measurements has significantly reduced truncation effects and related errors in the g{sub OO}(r) functions obtained. From these measurements and error analysis, the position and height of the nearest neighbor maximum in g{sub OO}(r) were found to be 2.80(1) A and 2.57(5) respectively. Numerical data for the coherent differential x-ray scattering cross-section I{sub X}(Q), the oxygen-oxygen structure factor S{sub OO}(Q), and the derived g{sub OO}(r) are provided as benchmarks for calibrating force-fields for water.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmarking gyrokinetic simulations in a toroidal flux-tube

A flux-tube model is implemented in the global turbulence code GEM [Y. Chen and S. E. Parker, J. Comput. Phys. 220, 839 (2007)] in order to facilitate benchmarking with Eulerian codes. The global GEM assumes the magnetic equilibrium to be completely given. The initial flux-tube implementation simply selects a radial location as the center of the flux-tube and a radial size of the flux-tube, sets all equilibrium quantities (B, ∇B, etc.) to be equal to the values at the center of the flux-tube, and retains only a linear radial profile of the safety factor needed for boundary conditions. This implementation shows disagreement with Eulerian codes in linear simulations. An alternative flux-tube model based on a complete local equilibrium solution of the Grad-Shafranov equation [J. Candy, Plasma Phys. Controlled Fusion 51, 105009 (2009)] is then implemented. This results in better agreement between Eulerian codes and the particle-in-cell (PIC) method. The PIC algorithm based on the v{sub ||}-formalism [J. Reynders, Ph.D. dissertation, Princeton University, 1992] and the gyrokinetic ion/fluid electron hybrid model with kinetic electron closure [Y. Chan and S. E. Parker, Phys. Plasmas 18, 055703 (2011)] are also implemented in the flux-tube geometry and compared with the direct method for both the ion temperature gradient driven modes and the kinetic ballooning modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Benchmark tests and spin adaptation for the particle-particle random phase approximation

The particle-particle random phase approximation (pp-RPA) provides an approximation to the correlation energy in density functional theory via the adiabatic connection [H. van Aggelen, Y. Yang, and W. Yang, Phys. Rev. A 88, 030501 (2013)]. It has virtually no delocalization error nor static correlation error for single-bond systems. However, with its formal O(N{sup 6}) scaling, the pp-RPA is computationally expensive. In this paper, we implement a spin-separated and spin-adapted pp-RPA algorithm, which reduces the computational cost by a substantial factor. We then perform benchmark tests on the G2/97 enthalpies of formation database, DBH24 reaction barrier database, and four test sets for non-bonded interactions (HB6/04, CT7/04, DI6/04, and WI9/04). For the G2/97 database, the pp-RPA gives a significantly smaller mean absolute error (8.3 kcal/mol) than the direct particle-hole RPA (ph-RPA) (22.7 kcal/mol). Furthermore, the error in the pp-RPA is nearly constant with the number of atoms in a molecule, while the error in the ph-RPA increases. For chemical reactions involving typical organic closed-shell molecules, pp- and ph-RPA both give accurate reaction energies. Similarly, both RPAs perform well for reaction barriers and nonbonded interactions. These results suggest that the pp-RPA gives reliable energies in chemical applications. The adiabatic connection formalism based on pairing matrix fluctuation is therefore expected to lead to widely applicable and accurate density functionals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Communication: A benchmark-quality, full-dimensional ab initio potential energy surface for Ar-HOCO

A full-dimensional, global ab initio potential energy surface (PES) for the Ar-HOCO system is presented. The PES consists of a previous intramolecular ab initio PES for HOCO [J. Li, C. Xie, J. Ma, Y. Wang, R. Dawes, D. Xie, J. M. Bowman, and H. Guo, J. Phys. Chem. A 116, 5057 (2012)], plus a new permutationally invariant interaction potential based on fitting 12 432 UCCSD(T)-F12a/aVDZ counterpoise-corrected energies. The latter has a total rms fitting error of about 25 cm{sup −1} for fitted interaction energies up to roughly 12 000 cm{sup −1}. Two additional fits are presented. One is a novel very compact permutational invariant representation, which contains terms only involving the Ar-atom distances. The rms fitting error for this fit is 193 cm{sup −1}. The other fit is the widely used pairwise one. The pairwise fit to the entire data set has an rms fitting error of 427 cm{sup −1}. All of these potentials are used in preliminary classical trajectory calculations of energy transfer with a focus on comparisons with the results using the benchmark potential.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmark calculations on the lowest-energy singlet, triplet, and quintet states of the four-electron harmonium atom

For a wide range of confinement strengths ω, explicitly-correlated calculations afford approximate energies E(ω) of the ground and low-lying excited states of the four-electron harmonium atom that are within few μhartree of the exact values, the errors in the respective energy components being only slightly higher. This level of accuracy constitutes an improvement of several orders of magnitude over the previously published data, establishing a set of benchmarks for stringent calibration and testing of approximate electronic structure methods. Its usefulness is further enhanced by the construction of differentiable approximants that allow for accurate computation of E(ω) and its components for arbitrary values of ω. The diversity of the electronic states in question, which involve both single- and multideterminantal first-order wavefunctions, and the availability of the relevant natural spinorbitals and their occupation numbers make the present results particularly useful in research on approximate density-matrix functionals. The four-electron harmonium atom is found to possess the {sup 3}P{sub +} triplet ground state at strong confinements and the {sup 5}S{sub −} quintet ground state at the weak ones, the energy crossing occurring at ω ≈ 0.0240919.

74 ATOMIC AND MOLECULAR PHYSICS↗

On the isotropic Raman spectrum of Ar{sub 2} and how to benchmark ab initio calculations of small atomic clusters: Paradox lost

This is the long-overdue answer to the discrepancies observed between theory and experiment in Ar{sub 2} regarding both the isotropic Raman spectrum and the second refractivity virial coefficient, B{sub R} [Gaye et al., Phys. Rev. A 55, 3484 (1997)]. At the origin of this progress is the advent (posterior to 1997) of advanced computational methods for weakly interconnected neutral species at close separations. Here, we report agreement between the previously taken Raman measurements and quantum lineshapes now computed with the employ of large-scale CCSD or smartly constructed MP2 induced-polarizability data. By using these measurements as a benchmark tool, we assess the degree of performance of various other ab initio computed data for the mean polarizability α, and we show that an excellent agreement with the most recently measured value of B{sub R} is reached. We propose an even more refined model for α, which is solution of the inverse-scattering problem and whose lineshape matches exactly the measured spectrum over the entire frequency-shift range probed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High precision quantum-chemical treatment of adsorption: Benchmarking physisorption of molecular hydrogen on graphane

A multilevel hierarchical ab initio protocol for calculating adsorption on non-conducting surfaces is presented. It employs fully periodic treatment, which reaches local Møller-Plesset perturbation theory of second order (MP2) with correction for the basis set incompleteness via the local F12 technique. Post-MP2 corrections are calculated using finite clusters. That includes the coupled cluster treatment in the local and canonical frameworks (up to perturbative quadruples) and correlated core (with MP2). Using this protocol, the potential surface of hydrogen molecules adsorbed on graphane was computed. According to the calculations, hydrogen molecules are adsorbed on graphane in a perpendicular to the surface orientation with the minimum of the potential surface of around −3.6 kJ/mol located at the distance of 3.85 Å between the bond center of the hydrogen molecule and the mid-plane of graphane. The adsorption sites along the path from the downward-pointing carbon to the ring center of the graphane are energetically virtually equally preferable, which can enable nearly free translations of hydrogen molecules along these paths. Consequently, the hydrogen molecules on graphane most likely form a non-commensurate monolayer. The analysis of the remaining errors reveals a very high accuracy of the computed potential surface with an error bar of a few tenths of a kJ/mol. The obtained results are a high-precision benchmark for further theoretical and experimental studies of hydrogen molecules interacting with graphane.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Analytic energy gradient of excited electronic state within TDDFT/MMpol framework: Benchmark tests and parallel implementation

The time-dependent density functional theory (TDDFT) has become the most popular method to calculate the electronic excitation energies, describe the excited-state properties, and perform the excited-state geometric optimization of medium and large-size molecules due to the implementation of analytic excited-state energy gradient and Hessian in many electronic structure software packages. To describe the molecules in condensed phase, one usually adopts the computationally efficient hybrid Quantum Mechanics/Molecular Mechanics (QM/MM) models. Here, we extend our previous work on the energy gradient of TDDFT/MM excited state to account for the mutual polarization effects between QM and MM regions, which is believed to hold a crucial position in the potential energy surface of molecular systems when the photoexcitation-induced charge rearrangement in the QM region is drastic. The implementation of a simple polarizable TDDFT/MM (TDDFT/MMpol) model in Q-Chem/CHARMM interface with both the linear response and the state-specific features has been realized. Several benchmark tests and preliminary applications are exhibited to confirm our implementation and assess the effects of different treatment of environmental polarization on the excited-state properties, and the efficiency of parallel implementation is demonstrated as well.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparing the accuracy of high-dimensional neural network potentials and the systematic molecular fragmentation method: A benchmark study for all-trans alkanes

Many approaches, which have been developed to express the potential energy of large systems, exploit the locality of the atomic interactions. A prominent example is the fragmentation methods in which the quantum chemical calculations are carried out for overlapping small fragments of a given molecule that are then combined in a second step to yield the system’s total energy. Here we compare the accuracy of the systematic molecular fragmentation approach with the performance of high-dimensional neural network (HDNN) potentials introduced by Behler and Parrinello. HDNN potentials are similar in spirit to the fragmentation approach in that the total energy is constructed as a sum of environment-dependent atomic energies, which are derived indirectly from electronic structure calculations. As a benchmark set, we use all-trans alkanes containing up to eleven carbon atoms at the coupled cluster level of theory. These molecules have been chosen because they allow to extrapolate reliable reference energies for very long chains, enabling an assessment of the energies obtained by both methods for alkanes including up to 10 000 carbon atoms. We find that both methods predict high-quality energies with the HDNN potentials yielding smaller errors with respect to the coupled cluster reference.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmarking semiclassical approaches to strong-field QED: Nonlinear Compton scattering in intense laser pulses

The recoil associated with photon emission is key to the dynamics of ultrarelativistic electrons in strong electromagnetic fields, as found in high-intensity laser-matter interactions and astrophysical environments such as neutron star magnetospheres. When the energy of the photon becomes comparable to that of the electron, it is necessary to use quantum electrodynamics (QED) to describe the dynamics accurately. However, computing the appropriate scattering matrix element from strong-field QED is not generally possible due to multiparticle effects and the complex structure of the electromagnetic fields. Therefore, these interactions are treated semiclassically, coupling probabilistic emission events to classical electrodynamics using rates calculated in the locally constant field approximation. Here, we provide comprehensive benchmarking of this approach against the exact QED calculation for nonlinear Compton scattering of electrons in an intense laser pulse. We find agreement at the percentage level between the photon spectra, as well as between the models' predictions of absorption from the background field, for normalized amplitudes a0 > 5. We discuss possible routes towards improved numerical methods and the implications of our results for the study of QED cascades.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Implementation of analytic gradients for CCSD and EOM-CCSD using Cholesky decomposition of the electron-repulsion integrals and their derivatives: Theory and benchmarks

We present a general formulation of analytic nuclear gradients for the coupled-cluster with single and double substitution (CCSD) and equation-of-motion (EOM) CCSD energies computed using Cholesky decomposition (CD) representations of the electron repulsion integrals. By rewriting the correlated energy and response equations such that the storage of the largest four-index intermediates is eliminated, CD leads to a significant reduction in disk storage requirements, reduced I/O penalties, and an improved parallel performance. CD thus extends the scope of the systems that can be treated by (EOM-)CCSD methods, although analytic gradients in the framework of CD are needed to extend the applicability of (EOM-)CCSD methods in the context of geometry optimizations. This paper presents a formulation of analytic (EOM-)CCSD gradient within the CD framework and reports on the salient details of the corresponding implementation. The accuracy and the capabilities of analytic CD-based (EOM-)CCSD gradients are illustrated by benchmark calculations and several illustrative examples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗