Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Analysis of OpenMP 4.5 Offloading in Implementations: Correctness and Overhead

The OpenMP language features have been evolving to meet the rapid development in hardware platforms. This journal focuses on evaluating implementations of OpenMP 4.5 target offload features in compilers such as Clang, XL and GCC that are an integral part of the software harness on supercomputers and clusters. We use Summit (Top supercomputer in the world as of November 2018) as one of our experimental setup. Such an effort is particularly critical on such supercomputers as that is being widely used by application developers to run their scientific codes at scale. Our tests not only evaluate the OpenMP implementations but also expose ambiguities within the OpenMP 4.5 specification. We also assess the overhead of the different OpenMP runtimes in relationship to the different directives and clauses. This helps in assessing the interaction of different OpenMP directives independent of other application artifacts. We are aware that the implementations are constantly evolving and Summit is advertised as having only partial OpenMP 4.x support. This is a synergistic effort to help identify and fix bugs in features’ implementations that are required by applications and prevent deployment delays later on. Going forward, we also plan to interact with standard benchmarking organizations like SPEC/HPG to donate our tests and mini-apps/kernels for potential inclusion in the next release versions of SPEC benchmark suite.

97 MATHEMATICS AND COMPUTING↗

Integral Full Core Multi-Physics PWR Benchmark with Measured Data

In recent years, the importance of modeling and simulation has been highlighted extensively in the DOE research portfolio with concrete examples in nuclear engineering with the CASL and NEAMS programs. These research efforts and similar efforts worldwide aim at the development of high-fidelity multi-physics analysis tools for the simulation of current and next-generation nuclear power reactors. Like all analysis tools, verification and validation is essential to guarantee proper functioning of the software and methods employed. The current approach relies mainly on the validation of single physic phenomena (e.g. critical experiment, flow loops, etc.) and there is a lack of relevant multiphysics benchmark measurements that are necessary to validate high-fidelity methods being developed today. This work introduces a new multi-cycle full-core Pressurized Water Reactor (PWR) depletion benchmark based on two operational cycles of a commercial nuclear power plant that provides a detailed description of fuel assemblies, burnable absorbers, in-core fission detectors, core loading and re-loading patterns. This benchmark enables analysts to develop extremely detailed reactor core models that can be used for testing and validation of coupled neutron transport, thermal-hydraulics, and fuel isotopic depletion. The benchmark also provides measured reactor data for Hot Zero Power (HZP) physics tests, boron letdown curves, and three-dimensional in-core flux maps from 58 instrumented assemblies. The benchmark description is now available online and has been used by many groups. However, much work remains to be done on the quantification of uncertainties and modeling sensitivities. This work aims to address these deficiencies and make this benchmark a true non-proprietary international benchmark for the validation of high-fidelity tools. This report details the BEAVRS uncertainty quantification for the first two cycle of operations and serves as the final report of the project.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Applications of Integral Benchmark Data

The International Reactor Physics Experiment Evaluation Project (IRPhEP) and the International Criticality Safety Benchmark Evaluation Project (ICSBEP) provide evaluated integral benchmark data that may be used for validation of reactor physics / nuclear criticality safety analytical methods and data, nuclear data testing, advanced modeling and simulation, and safety analysis licensing activities. The handbooks produced by these programs are used in over 30 countries. Five example applications are presented in this paper: (1) Use of IRPhEP Data in Uncertainty Analyses and Cross Section Adjustment, (2) Uncertainty Evaluation Methods for Reactor Core Design at JAEA Using Reactor Physics Experimental Data, (3) Application of Benchmarking Data to a Broad Range of Criticality Safety Problems, (4) Cross Section Data Testing with ICSBEP Benchmarks, and (5) Use of the International Handbook of Evaluated Reactor Physics Benchmark Experiments to Support the Power Industry.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Assessment of Pre-Irradiation SiC CMC Joint Performance in Representative Cladding Geometries

Silicon carbide fiber reinforced, silicon carbide matrix composites (SiC-SiC) offer strength at high temperatures, corrosion resistance, and stability during irradiation, and are being developed by General Atomics as cladding for accident tolerant fuel (ATF) applications and advanced reactor concepts. Advanced joining techniques capable of withstanding harsh reactor environments are key to enable GA’s SiGAtm SiC-SiC composite. The objective of this work is to obtain joint-specific material properties for assemblies in representative planar and cladding geometries that will allow for the generation of a material properties database and more accurate simulation of SiC joint behavior across arange of temperatures and irradiation conditions. To support this, three different joint formulations are being assessed for mechanical and thermal performance pre and post irradiation in the High Flux Isotope Reactor (HIFR) at ORNL. GA has previously identified its hybrid SiC (HSiC) joint as the most promising and best suited joining approach for cladding applications [1]. Additionally, oxide and transeutectic phase (TEP) joints are being investigated to make the material property database more comprehensive as these joints have previously shown strength resilience under irradiation in planar geometries [2]. The thermal and mechanical data obtained in this work will address vital knowledge gaps, enabling more accurate modeling of joints in SiC-based components for accelerated material qualification.The scope of work presented here focuses on the mechanical and thermal performance of the joint material prior to irradiation in HFIR. Endplug push-out (EPPO) testing to determine joint strength in tube geometries, and shear strength testing for planar geometries have provided a benchmark for pre-irradiation mechanical performance. These results show that all three selected joint methodologies result in cladding joints capable of withstanding the expected joint stresses in a LWR reactor environment [3]. This has been accompanied by He leak testing of the joint regions on tube specimens to assess the suitability of each joint methodology for cladding applications. Here, only the HSiC formulation consistently met critical leak rate requirements suggesting that other joining strategies require additional development. Finally, pre-irradiation thermal testing has been completed to establish a baseline for comparison after irradiation. Subsequent irradiation of these joints types in HFIR will provide further detail on joint material properties and their appropriateness for nuclear applications.

Gonderman, Sean↗

Evaluation of 3D Simulation Capabilities within xRAGE using a Suite of Test Problems

This presentation describes a 3D verification and validation suite for xRAGE. Three verification test problems for hydrodynamics are presented: the Kidder ball problem, the Verney shell problem, and a 5-material compression problem. There is excellent agreement between 2D and 3D XRAGE simulation results for these problems, and between the xRAGE results and the benchmark solutions. In addition, two 3D ICF test problems are presented, based on an OMEGA direct drive capsule experiment, and on a NIF indirect drive capsule experiment. These two ICF test problems are used to evaluate two hydrodynamic methods within xRAGE. In addition to hydrodynamics the simulations also include three temperature plasma physics, thermal conduction and radiation diffusion. When simulating either capsule in 3D the newer unsplit hydrodynamic method in xRAGE produces more vorticity relative to the older default method. For the indirect drive capsule the 3D simulations are in reasonable agreement with the experimental values of ion temperature and neutron production. Unstable 3D vortex rings are present near the DT ice/carbon interface which enhance the confinement of the DT ice.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling fission product diffusion in TRISO fuel particles with BISON

Diffusion of fission products in intact TRISO particles depends on particle geometry, fission product source rates, time, temperature, and temperature-dependent diffusion coefficients. Simulating this diffusion process requires models for source rates and diffusion coefficients, plus computation of the temperature field if not prescribed. In addition, simulation quality depends on discretization of the geometry, appropriate time stepping, and the accuracy of the solution method. In this paper, we explore the simulation of fission product diffusion in TRISO fuel particles using the finite element method via the fuel performance code Bison. Recent material model development has occurred in Bison for each material present in tri-structural isotropic (TRISO) fuel particles: the buffer, inner pyrolytic carbon, silicon carbide, and outer pyrolytic carbon layers, as well as the fuel kernel. Also, new mesh generation and fission product release fraction capabilities have been added. Diffusion capabilities are shown to converge to the correct solution via formal verification tests. A large number of code benchmarking problems are also given, with good results, showing that Bison’s computed release fractions closely match those of other software tools. Finally, a significant validation effort is detailed in which fission product release, measured as part of the AGR-1 capsule experiments, is compared to Bison outputs. Bison outputs compare very well to the experimental data and to PARFUME results.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Reducing the Cost of CCSD Basis Set Extrapolation in Ab Initio Computational Thermochemistry

Here, a series of approximations to CCSD contributions in computational model chemistries is presented in the context of kcal mol –1 , kJ mol –1 , and 20 cm –1 theoretical predictions of total atomization energies, benchmarked within the HEAT+CH 4 test suite. A specific set of circumstances where MP2, without empirical scaling, may be used as an effective intermediate in the first two of these accuracy ranges was determined. However, SDQ-MP4, a method long used in pursuit of kcal mol –1 accuracy but relatively unstudied in the subchemical accuracy community, offers significant improvement over the quality of MP2 as a basis-set intermediate at significantly reduced cost compared to CCSD. Given this, we argue for SDQ-MP4 as the de facto CCSD basis-set intermediate in sub-chemical accuracy calculations when CCSD in a desired basis set becomes unaffordable. We additionally report on a “CBS-like” scheme, where MP2 and SDQ-MP4 are used in conjunction to create a “cheap” three-part approximation of large CCSD basis set limits. The data for the CCSD approximation schemes are organized in such a way that model chemistry developers can locate an analog of their current approach for the CCSD basis set limit and explore alternative intermediates that either decrease computational cost or increase computational accuracy. We also show, for a handful of molecules, that SDQ-MP4 shows promise as an effective basis-set intermediate for harmonic and fundamental frequency computations, allowing for zero-point corrections of nearly CCSD(T)/ANO1 quality using simple composite methods that only require CCSD(T)/ANO0.

Thorpe, James H. [Argonne National Laboratory (ANL↗

Hotspot Coevolution Is a Key Identifier of Near-Native Protein Complexes

Protein–protein interactions play a key role in mediating numerous biological functions, with more than half the proteins in living organisms existing as either homo- or hetero-oligomeric assemblies. Protein subunits that form oligomers minimize the free energy of the complex, but exhaustive computational search-based docking methods have not comprehensively addressed the challenge of distinguishing a natively bound complex from non-native forms. Current protein docking approaches address this problem by sampling multiple binding modes in proteins and scoring each mode, with the lowest-energy (or highest scoring) binding mode being regarded as a near-native complex. However, high-scoring modes often match poorly with the true bound form, suggesting a need for improvement of the scoring function. Here in this study, we propose a scoring function, KFC-E, that accounts for both conservation and coevolution of putative binding hotspot residues at protein–protein interfaces. We tested KFC-E on four benchmark sets of unbound examples and two benchmark sets of bound examples, with the results demonstrating a clear improvement over scores that examine conservation and coevolution across the entire interface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalar Relativistic Computations and Localized Orbital Analyses of Nuclear Hyperfine Coupling and Paramagnetic NMR Chemical Shifts

A method is reported by which calculated hyperfine coupling constants (HFCCs) and paramagnetic NMR (pNMR) chemical shifts can be analyzed in a chemically intuitive way by decomposition into contributions from localized molecular orbitals (LMOs). A new module for density functional calculations with nonhybrid functionals, global hybrids, and range-separated hybrids, utilizing the two-component relativistic zeroth-order regular approximation (ZORA), has been implemented in the parallel open-source NWChem quantum chemistry package. Benchmark results are reported for a test set of few-atom molecules with light and heavy elements. Finite nucleus effects on ¹⁹⁹Hg HFCCs are shown to be on the order of -11 to -15%. A proof of concept for the LMO analysis is provided for the metal and fluorine HFCCs of TiF₃ and NpF₆. Calculated pNMR chemical shifts are reported for the 2-methylphenyl-t-butylnitroxide radical and for five cyclopentadienyl (Cp) sandwich complexes with 3d metals. Nickelocene and vanadocene carbon pNMR shifts are analyzed in detail, demonstrating that the large carbon pNMR shifts calculated as +1540 for Ni (exptl.: +1514) and -443 for V (exptl.: -510) are caused by different spin-polarization mechanisms. For Ni, Cp to Ni π back-donation dominates the result, whereas for vanadocene, V to Cp σ donation with relaxation of the carbon 1s shells can be identified as the dominant mechanism.

Environmental Molecular Sciences Laboratory↗

Self-assembly of aramid amphiphiles into ultra-stable nanoribbons and aligned nanoribbon threads

Small molecule self-assembly is an established route for producing high surface area nanostructures with readily customizable chemistries and precise molecular organization. However, these structures are fragile, exhibiting molecular exchange, migration, and rearrangement - among other dynamic instabilities - and ultimately disassociate upon drying. Here we show a small molecule platform, the aramid amphiphile (AA), that overcomes these dynamic instabilities by incorporating a Kevlar-inspired domain into the molecular structure. Strong, anisotropic interactions between AAs suppress molecular exchange and elicit spontaneous self-assembly in water to form nanoribbons with lengths of up to 20 microns. The nanoribbons have a Young’s modulus of 1.7 GPa and tensile strength of 1.9 GPa. Here, we exploit this stability to extend small molecule self-assembly to hierarchically ordered macroscopic materials outside of solvated environments. Through an aqueous shear alignment process, we organize AA nanoribbons into arbitrarily long flexible threads that support 200 times their weight when dried. Tensile tests of the threads provide a benchmark for Young’s moduli (between ~400 and 600 MPa) and extensibilities (between ~0.6 and 1.1%) that depend on the counterion chemistry in solution. This bottom-up approach to macroscopic materials could benefit solid-state applications, historically inaccessible by self-assembled nanomaterials.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

ddcMD: A fully GPU-accelerated molecular dynamics program for the Martini force field

We have implemented the Martini force field within Lawrence Livermore National Laboratory’s molecular dynamics program, ddcMD. The program is extended to a heterogeneous programming model so that it can exploit graphics processing unit (GPU) accelerators. In addition to the Martini force field being ported to the GPU, the entire integration step, including thermostat, barostat, and constraint solver, is ported as well, which speeds up the simulations to 278-fold using one GPU vs one central processing unit (CPU) core. A benchmark study is performed with several test cases, comparing ddcMD and GROMACS Martini simulations. The average performance of ddcMD for a protein–lipid simulation system of 136k particles achieves 1.04 µs/day on one NVIDIA V100 GPU and aggregates 6.19 µs/day on one Summit node with six GPUs. The GPU implementation in ddcMD offloads all computations to the GPU and only requires one CPU core per simulation to manage the inputs and outputs, freeing up remaining CPU resources on the compute node for alternative tasks often required in complex simulation campaigns.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Correlation consistent effective core potentials for late 3 d transition metals adapted for plane wave calculations

We construct a new modification of correlation consistent effective core potentials (ccECPs) for late 3d elements Cr–Zn with Ne-core that are adapted for efficiency and low energy cut-offs in plane wave calculations. The decrease in accuracy is rather minor, so that the constructions are in the same overall accuracy class as the original ccECPs. The resulting new constructions work with energy cut-offs at or below ≈400 Ry and, thus, make calculations of large systems with transition metals feasible for plane wave codes. We also provide the basic benchmarks for atomic spectra and molecular tests of this modified option that we denote as ccECP-soft.

Chemistry↗

Systematic non-LTE study of the −2.6 ≤ [Fe/H] ≤ 0.2 F and G dwarfs in the solar neighborhood. I. Stellar atmosphere parameters

We present atmospheric parameters for 51 nearby F and G dwarf and subgiant stars uniformly distributed over the −2.60<[Fe/H]<+0.20 metallicity range that is suitable for the Galactic chemical evolution research. Lines of iron in the two ionization stages, Fe i and Fe ii, were used to derive a homogeneous set of effective temperatures, surface gravities, iron abundances, and microturbulence velocities. Our spectroscopic analyses took advantage of employing high-resolution (R ≥ 60,000) Shane/Hamilton and Canada–France–Hawaii Telescope/ESPaDOnS observed spectra and non-LTE (NLTE) line formation for Fe i and Fe ii in the classical one-dimensional model atmospheres. The spectroscopic method was tested in advance with the 20 benchmark stars, for which there are multiple measurements of the infrared flux method effective temperature and their Hipparcos parallax error is less than 10%. We found NLTE abundances from lines of Fe i and Fe ii to be consistent within 0.06 dex for every benchmark star, when applying a scaling factor of S{sub H} = 0.5 to the Drawinian rates of inelastic Fe+H collisions. The obtained atmospheric parameters were checked for each program star by comparing its position in the log g–T{sub eff} plane with the theoretical evolutionary track of given metallicity and α-enhancement in the Yi et al. grid. Our final effective temperatures lie exactly in between the T{sub IRFM} scales of Alonso et al. and Casagrande et al., with a mean difference of +46 and −51 K, respectively. NLTE leads to higher surface gravity compared with that for LTE. The shift in log g is smaller than 0.1 dex for stars with [Fe/H] ⩾−0.75, T{sub eff} ≤ 5750 K, or log g ≥ 4.20. NLTE analysis is crucial for the very metal-poor turnoff and subgiant stars, for which the shift in log g between NLTE and LTE can be up to 0.5 dex. The obtained accurate atmospheric parameters will be used in the forthcoming papers to determine NLTE abundances of important astrophysical elements from lithium to europium and to improve observational constraints on the chemodynamical models of the Galaxy evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗

Divergence in land surface modeling: linking spread to structure

Divergence in land carbon cycle simulation is persistent and widespread. Regardless of model intercomparison project, results from individual models diverge significantly from each other and, in consequence, from reference datasets. Here we link model spread to structure using a 15-member ensemble of land surface models from the Multi-scale synthesis and Terrestrial Model Intercomparison Project (MsTMIP) as a test case. Our analysis uses functional benchmarks and model structure as predicted by model skill in a machine learning framework to isolate discrete aspects of model structure associated with divergence. We also quantify how initial conditions prejudice present-day model outcomes after centennial-scale transient simulations. Overall, the functional benchmark and machine learning exercises emphasize the importance of ecosystem structure in correctly simulating carbon and water cycling, highlight uncertainties in the structure of carbon pools, and advise against hard parametric limits on ecosystem function. We also find that initial conditions explain 90% of variation in global satellite-era values—initial conditions largely predetermine transient endpoints, historical environmental change notwithstanding. As MsTMIP prescribes forcing data and spin-up protocol, the range in initial conditions and high levels of predetermination are also structural. Our results suggest that methodological tools linking divergence to discrete aspects of model structure would complement current community best practices in model development.

58 GEOSCIENCES↗

Test-state approach to the quantum search problem

The search for 'a quantum needle in a quantum haystack' is a metaphor for the problem of finding out which one of a permissible set of unitary mappings - the oracles - is implemented by a given black box. Grover's algorithm solves this problem with quadratic speedup as compared with the analogous search for 'a classical needle in a classical haystack'. Since the outcome of Grover's algorithm is probabilistic - it gives the correct answer with high probability, not with certainty - the answer requires verification. For this purpose we introduce specific test states, one for each oracle. These test states can also be used to realize 'a classical search for the quantum needle' which is deterministic - it always gives a definite answer after a finite number of steps - and 3.41 times as fast as the purely classical search. Since the test-state search and Grover's algorithm look for the same quantum needle, the average number of oracle queries of the test-state search is the classical benchmark for Grover's algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

RMA-MT Benchmarks

The RMA-MT benchmarks are a suite of performance tests for multi-threaded Message Passing Interface (MPI) Remote Memory Access (RMA) implementations. The suite includes tests for bandwidth and latency with any number of threads. This suite was originally developed and release by Sandia National Laboratory. LANL modifications to the suite include a complete re-write of much of the source code, bi-directional bandwidth, and message rate tests.

Hjelm, Nathan↗

Investigation of protein quaternary structure via stoichiometry and symmetry information

The Protein Data Bank (PDB) is the single worldwide archive of experimentally-determined three-dimensional (3D) structures of proteins and nucleic acids. As of January 2017, the PDB housed more than 125,000 structures and was growing by more than 11,000 structures annually. Since the 3D structure of a protein is vital to understand the mechanisms of biological processes, diseases, and drug design, correct oligomeric assembly information is of critical importance. Unfortunately, the biologically relevant oligomeric form of a 3D structure is not directly obtainable by X-ray crystallography, whilst in solution methods (NMR or single particle EM) it is known from the experiment. Instead, this information may be provided by the PDB Depositor as metadata coming from additional experiments, be inferred by sequence-sequence comparisons with similar proteins of known oligomeric state, or predicted using software, such as PISA (Proteins, Interfaces, Structures and Assemblies) or EPPIC (Evolutionary Protein Protein Interface Classifier). Despite significant efforts by professional PDB Biocurators during data deposition, there remain a number of structures in the archive with incorrect quaternary structure descriptions (or annotations). Further investigation is, therefore, needed to evaluate the correctness of quaternary structure annotations. In this study, we aim to identify the most probable oligomeric states for proteins represented in the PDB. Our approach evaluated the performance of four independent prediction methods, including text mining of primary publications, inference from homologous protein structures, and two computational methods (PISA and EPPIC). Aggregating predictions to give consensus results outperformed all four of the independent prediction methods, yielding 83% correct, 9% wrong, and 8% inconclusive predictions, when tested with a well-curated benchmark dataset. We have developed a freely-available web-based tool to make this approach accessible to researchers and PDB Biocurators.

59 BASIC BIOLOGICAL SCIENCES↗