Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Best Practices and Testing Protocols for Benchmarking ORR Activities of Fuel Cell Electrocatalysts Using Rotating Disk Electrode

Abstract Thin-film-rotating disk electrodes (TF-RDEs) are the half-cell electrochemical system of choice for rapid screening of oxygen reduction reaction (ORR) activity of novel Pt supported on carbon black supports (Pt/C) electrocatalysts. It has been shown that the magnitude of the measured ORR activity and reproducibility are highly dependent on the system cleanliness, evaluation protocols, and operating conditions as well as ink formulation, composition, film drying, and the resultant film thickness and uniformity. Accurate benchmarks of baseline Pt/C catalysts evaluated using standardized protocols and best practices are necessary to expedite ultra-low-platinum group metal (PGM) catalyst development that is crucial for the imminent commercialization of fuel cell vehicles. We report results of evaluation in three independent laboratories of Pt/C electrocatalysts provided by commercial fuel cell catalyst manufacturers (Johnson Matthey, Umicore, Tanaka Kikinzoku Kogyo—TKK). The studies were conducted using identical evaluation protocols/ink formulation/film fabrication albeit employing unique electrochemical cell designs specific to each laboratory. The ORR activities reported in this work provide a baseline and criteria for selection and scale-up of novel high activity ORR electrocatalysts for implementation in proton exchange membrane fuel cells (PEMFCs).

Kocha, Shyam S.↗
DOE OSTI2020

Simulation of the BEAVRS benchmark using VERA

The Virtual Environment for Reactor Applications (VERA) is being developed by the Consortium for the Advanced Simulation of Light Water Reactors (CASL). Here, VERA is used to perform the Benchmark for Evaluation and Validation of Reactor Simulations (BEAVRS), which provides two cycles’ worth of operating power history, along with a full, detailed description of the geometry, and measured data. Cycle 1 and 2 are simulated with VERA and the results are compared to the measured zero power physics tests, critical boron concentration, and flux maps.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Spin-orbit couplings within the equation-of-motion coupled-cluster framework: Theory, implementation, and benchmark calculations

We present a formalism and an implementation for calculating spin-orbit couplings (SOCs) within the EOM-CCSD (equation-of-motion coupled-cluster with single and double substitutions) approach. The following variants of EOM-CCSD are considered: EOM-CCSD for excitation energies (EOM-EE-CCSD), EOM-CCSD with spin-flip (EOM-SF-CCSD), EOM-CCSD for ionization potentials (EOM-IP-CCSD) and electron attachment (EOM-EA-CCSD). We employ a perturbative approach in which the SOCs are computed as matrix elements of the respective part of the Breit-Pauli Hamiltonian using zeroth-order non-relativistic wave functions. We follow the expectation-value approach rather than the response-theory formulation for property calculations. Both the full two-electron treatment and the mean-field approximation (a partial account of the two-electron contributions) have been implemented and benchmarked using several small molecules containing elements up to the fourth row of the periodic table. The benchmark results show the excellent performance of the perturbative treatment and the mean-field approximation. When used with an appropriate basis set, the errors with respect to experiment are below 5% for the considered examples. The findings regarding basis-set requirements are in agreement with previous studies. The impact of different correlation treatment in zeroth-order wave functions is analyzed. Overall, the EOM-IP-CCSD, EOM-EA-CCSD, EOM-EE-CCSD, and EOM-SF-CCSD wave functions yield SOCs that agree well with each other (and with the experimental values when available). Using an EOM-CCSD approach that provides a more balanced description of the target states yields more accurate results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2015

A systematic benchmark of the ab initio Bethe-Salpeter equation approach for low-lying optical excitations of small organic molecules

The predictive power of the ab initio Bethe-Salpeter equation (BSE) approach, rigorously based on many-body Green’s function theory but incorporating information from density functional theory, has already been demonstrated for the optical gaps and spectra of solid-state systems. Interest in photoactive hybrid organic/inorganic systems has recently increased and so has the use of the BSE for computing neutral excitations of organic molecules. However, no systematic benchmarks of the BSE for neutral electronic excitations of organic molecules exist. Here, we study the performance of the BSE for the 28 small molecules in Thiel’s widely used time-dependent density functional theory benchmark set [Schreiber et al., J. Chem. Phys. 128, 134110 (2008)]. We observe that the BSE produces results that depend critically on the mean-field starting point employed in the perturbative approach. We find that this starting point dependence is mainly introduced through the quasiparticle energies obtained at the intermediate GW step and that with a judicious choice of starting mean-field, singlet excitation energies obtained from BSE are in excellent quantitative agreement with higher-level wavefunction methods. The quality of the triplet excitations is slightly less satisfactory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A Benchmark Case for the Grid Survivability Analysis

Among current priorities of the power system analysis is the development of metrics and computational tools for the resilience analysis during catastrophic events. New methods and tools are required for such an analysis and they have to be validated prior application to real systems. However, benchmark problems are not readily available due to the analysis novelty. The current paper presents a case based on the IEEE 14-bus system for this purpose. The grid is simplified to a graph with nodes representing generators, loads, and buses. Power inputs are imported from real-time simulations of the IEEE 14-bus system. Outcomes of all possible combinations of failed elements are presented in terms of probabilities for the grid to survive, partially survive, or fail. Only the power grid's ability to withstand adverse events (survivability) is analyzed. The grid's recoverability, the other part of the resilience analysis, is not considered.

power system↗
DOE OSTI2026

SCALE HTR-PROTEUS Benchmark Model

This dataset contains input and result files of computational simulations of HTR-PROTEUS benchmark with the latest version of SCALE code system. The simulations cover criticality control rod worth calculations as well as sensitivity analysis and uncertainty quantification. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Glassy Carbon Substrate Oxidation Effects on Electrode Stability for Oxygen Evolution Reaction Catalysis Stability Benchmarking

Employing benchmarking metrics to capture the activity and stability of electrocatalysts for the oxygen evolution reaction (OER) in acid is a critical practice that enables meaningful comparison of catalyst material candidates reported throughout the literature. In this work, we find that ubiquitously used glassy carbon electrode substrates oxidize under typical OER operating conditions, forming a pacified, electrically insulating, and oxygen-rich surface layer that causes drastic loss of current density over the course of extended chronoamperometric stability tests at an anodic potential of 1.7 VRHE. We show that the experimentally observed stability of glassy carbon-based electrodes is approximately two orders of magnitude lower than that expected solely from dissolution-based catalyst intrinsic stability of Ir-based catalysts. We additionally find that glassy carbon-based electrode stability measured by chronoamperometric holds is greatly impacted by catalyst loading, with high catalyst loadings improving the stability of the overall electrode via a protective effect on the glassy carbon substrate. Altogether, our investigation highlights that glassy carbon is not electrochemically inert under OER conditions on the timescale of common stability tests, which can cause electrodes to exhibit performance losses that do not reflect the intrinsic stability of the actual catalyst material being investigated. In light of our findings, we underscore the usefulness of metrics, such as the S-number, to reflect intrinsic catalyst material stability.

25 ENERGY STORAGE↗
DOE OSTI2018

Electronic Energies Are Not Enough: An Ion Mobility-Aided, Quantum Chemical Benchmark Analysis of H + GPGG Conformers

Peptides and proteins exist not as single, lowest energy structures but as ensembles of states separated by small barriers. In order to study these species we must be able to correctly identify their gas phase conformational distributions, and ion mobility spectrometry (IMS) has arisen as an experimental method for assessing the gas phase energetics of flexible peptides. Here, we present a thorough exploration and benchmarking of the low energy conformers of the small, hairpin peptide H+ GPGG with the aid of ion mobility spectrometry against a wide swath of density functionals (35 dispersion-corrected and uncorrected functionals represented by 21 unique exchange–correlation functionals) and wave function theory methods (15 total levels of theory). The three experimentally resolved IMS peaks were found to correspond to three distinct pairs of conformers, each pair composed of species differing only by the chair or boat configuration of the proline. Two of the H+ GPGG conformer pairs possess a cis configuration about the Pro–Gly1 peptide bond while the other adopts a trans configuration. While the experimental spectrum reports a higher intensity for the cis-1 conformer than the trans conformer, 13 WFT levels of theory, including a complete basis set CCSD(T) extrapolation, obtain trans to be favored in terms of the electronic energy. This same effect is seen in 14 of the 18 dispersion-corrected density functionals studied, whereas the remaining 17 functionals show more variety. Only when Gibbs free energies are considered do the WFT methods and dispersion-corrected functionals reflect the experimental distribution. CAM-B3LYP-D3BJ emerges as the best-performing density functional, matching the experimental distribution and the CCSD(T)/CBS relative energies within 6%. Further analysis reveals the trans conformer to be favored electronically, but entropically disfavored, leading to the experimental preference of the cis-1 conformer. Furthermore, these results highlight the danger in considering only the electronic energies, which is common practice in electronic structure theory predictions of conformational energy distributions. Additionally, the effects of temperature and scaling of the frequencies used in obtaining the Gibbs free energies are explored.

Energy↗
DOE OSTI2020

Quantum Monte Carlo benchmarking of large noncovalent complexes in the L7 benchmark set

We have used diffusion Monte Carlo (DMC) to perform calculations on the L7 benchmark set. DMC is a stochastic numerical integration scheme in real-space and part of a larger set of quantum Monte Carlo methods. The L7 set was designed to test the ability of electronic structure methods to include dispersive interactions. While the agreement between DMC and quantum-chemical state-of-the-art methods is excellent for some of the structures, there are significant differences in others. In contrast to wavefunction-based quantum chemical methods, DMC is a first-principle many-body method with the many-body wavefunction evolving in real space. It includes explicitly all electron–electron interactions and is relatively insensitive to the size of the basis set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1997

NAS Parallel Benchmark. Results 11-96: Performance Comparison of HPF and MPI Based NAS Parallel Benchmarks

High Performance Fortran (HPF), the high-level language for parallel Fortran programming, is based on Fortran 90. HALF was defined by an informal standards committee known as the High Performance Fortran Forum (HPFF) in 1993, and modeled on TMC's CM Fortran language. Several HPF features have since been incorporated into the draft ANSI/ISO Fortran 95, the next formal revision of the Fortran standard. HPF allows users to write a single parallel program that can execute on a serial machine, a shared-memory parallel machine, or a distributed-memory parallel machine. HPF eliminates the complex, error-prone task of explicitly specifying how, where, and when to pass messages between processors on distributed-memory machines, or when to synchronize processors on shared-memory machines. HPF is designed in a way that allows the programmer to code an application at a high level, and then selectively optimize portions of the code by dropping into message-passing or calling tuned library routines as 'extrinsics'. Compilers supporting High Performance Fortran features first appeared in late 1994 and early 1995 from Applied Parallel Research (APR) Digital Equipment Corporation, and The Portland Group (PGI). IBM introduced an HPF compiler for the IBM RS/6000 SP/2 in April of 1996. Over the past two years, these implementations have shown steady improvement in terms of both features and performance. The performance of various hardware/ programming model (HPF and MPI (message passing interface)) combinations will be compared, based on latest NAS (NASA Advanced Supercomputing) Parallel Benchmark (NPB) results, thus providing a cross-machine and cross-model comparison. Specifically, HPF based NPB results will be compared with MPI based NPB results to provide perspective on performance currently obtainable using HPF versus MPI or versus hand-tuned implementations such as those supplied by the hardware vendors. In addition we would also present NPB (Version 1.0) performance results for the following systems: DEC Alpha Server 8400 5/440, Fujitsu VPP Series (VX, VPP300, and VPP700), HP/Convex Exemplar SPP2000, IBM RS/6000 SP P2SC node (120 MHz) NEC SX-4/32, SGI/CRAY T3E, SGI Origin2000.

Saini, Subash↗
DOE OSTI2017

Overview of Experiments for Physics of Fast Reactors from the International Handbooks of Evaluated Criticality Safety Benchmark Experiments and Evaluated Reactor Physics Benchmark Experiments

Overview of Experiments to Study the Physics of Fast Reactors Represented in the International Directories of Critical and Reactor Experiments John D. Bess Idaho National Laboratory Jim Gulliford, Tatiana Ivanova Nuclear Energy Agency of the Organisation for Economic Cooperation and Development E.V.Rozhikhin, M.Yu.Sem?nov, A.M.Tsibulya Institute of Physics and Power Engineering The study the physics of fast reactors traditionally used the experiments presented in the manual labor of the Working Group on Evaluation of sections CSEWG (ENDF-202) issued by the Brookhaven National Laboratory in 1974. This handbook presents simplified homogeneous model experiments with relevant experimental data, as amended. The Nuclear Energy Agency of the Organization for Economic Cooperation and Development coordinates the activities of two international projects on the collection, evaluation and documentation of experimental data - the International Project on the assessment of critical experiments (1994) and the International Project on the assessment of reactor experiments (since 2005). The result of the activities of these projects are replenished every year, an international directory of critical (ICSBEP Handbook) and reactor (IRPhEP Handbook) experiments. The handbooks present detailed models of experiments with minimal amendments. Such models are of particular interest in terms of the settlements modern programs. The directories contain a large number of experiments which are suitable for the study of physics of fast reactors. Many of these experiments were performed at specialized critical stands, such as BFS (Russia), ZPR and ZPPR (USA), the ZEBRA (UK) and the experimental reactor JOYO (Japan), FFTF (USA). Other experiments, such as compact metal assembly, is also of interest in terms of the physics of fast reactors, they have been carried out on the universal critical stands in Russian institutes (VNIITF and VNIIEF) and the US (LANL, LLNL, and others.). Also worth mentioning is the critical experiments with fast reactor fuel rods in water, interesting in terms of justification of nuclear safety during transportation and storage of fresh and spent fuel. These reports provide a detailed review of the experiment, designate the area of their application and include results of calculations on modern systems of constants in comparison with the estimated experimental data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Nitrogen and phosphorus cycling in an ombrotrophic peatland: a benchmark for assessing change

Aims Slow decomposition and isolation from groundwater mean that ombrotrophic peatlands store a large amount of soil carbon (C) but have low availability of nitrogen (N) and phosphorus (P). To better understand the role these limiting nutrients play in determining the C balance of peatland ecosystems, we compile comprehensive N and P budgets for a forested bog in northern Minnesota, USA. Methods N and P within plants, soils, and water are quantified based on field measurements. The resulting empirical dataset are then compared to modern-day, site-level simulations from the peatland land surface version of the Energy Exascale Earth System Model (ELM-SPRUCE).

Salmon, Verity G.↗