Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

EBR-II Reactor Physics Benchmark Evaluation Report

This report provides a reactor physics benchmark evaluation with associated uncertainty quantification for the critical configuration of the April 1986 Experimental Breeder Reactor II Run 138B core configuration.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking and Transparency: Resources for State and Local Leaders

This resource guide provides state and local leaders with streamlined access to key existing resources for developing and implementing high-impact building energy benchmarking and transparency programs in their jurisdictions.

Benchmarking, State Government, Local Government, ↗

Hydrogen Bond Benchmark: Focal‐Point Analysis and Assessment of DFT Functionals

We performed a hierarchical, convergent ab initio benchmark study and systematically analyzed the performance of density functional approximations for describing hydrogen bonds in small neutral, cationic, and anionic complexes, as well as in larger systems involving amide, urea, deltamide, and squaramide moieties. Focal point analyses (FPA), extrapolating to the ab initio limit, were carried out using correlated wave function methods up to CCSDT(Q) for the small complexes and CCSD(T) for the larger systems, together with correlation-consistent Gaussian basis sets up to the complete basis set limit. Optimized geometries and vibrational frequencies were obtained at the CCSD(T) level. The resulting FPA hydrogen-bond energies converge within a few tenths of a kcal mol −1 . These reference data were used to evaluate 60 density functionals (including 12 dispersion-corrected), spanning the local-density approximation (LDA), generalized gradient approximations (GGAs), meta-GGAs, hybrids, meta-hybrids, double-hybrids, and range-separated hybrids. Overall, the meta-hybrid M06-2X provides the best performance for both hydrogen bond energies and geometries, while the dispersion-corrected GGAs BLYP-D3(BJ) and BLYP-D4 also yield accurate hydrogen-bond data and can serve as cost-effective options for studying large and complex systems.

coupled cluster theory↗

Clean Energy Manufacturing: Renewable Energy Technology Benchmarks

The manufacturing of clean energy technologies has become a global enterprise. An analysis of four clean energy technology manufacturing processes—wind turbine components, crystalline silicon solar photovoltaic modules, light-duty vehicle lithium-ion battery cells, and light-emitting diodes—was conducted to provide a reference point for comparison over time as this sector evolves. The manufacturing supply chain analysis included processing of raw materials, making required subcomponents, and assembling final products, using benchmarks that crossed 12 economies: Brazil, Canada, China, Germany, India, Japan, Malaysia, Mexico, South Korea, Republic of China (Taiwan), the United Kingdom, and the United States. Larger economies, with extensive manufacturing supply chains and high prevailing wages, tend to retain more value added from clean energy manufacturing than small economies. Manufacturing of clean energy technologies drives extensive trade among economies to support the widely distributed supply chain links. Production of wind turbine components and photovoltaic modules is more centralized than production of light-emitting diodes and lithium-ion battery cells. Across the four clean energy technologies evaluated, there was generally an excess of manufacturing capacity relative to global supply.

benchmarks↗

Performance and Energy Usage of Workloads on KNL and Haswell Architectures. In: High Performance Computing Systems. Performance Modeling, Benchmarking, and Simulation

Manycore architectures are an energy-efficient step towards exascale computing within a constrained power budget. The Intel Knights Landing (KNL) manycore chip is a specific example of this and has seen early adoption by a number of HPC facilities. It is therefore important to understand the performance and energy usage characteristics of KNL. In this paper, we evaluate the performance and energy efficiency of KNL in contrast to the Xeon (Haswell) architecture for applications representative of the workload of users at NERSC. We consider the optimal MPI/OpenMP configuration of each application and use the results to characterize KNL in contrast to Haswell. As well as traditional DDR memory, KNL contains MCDRAM and we also evaluate its efficacy. Our results show that, averaged over our benchmarks, KNL is 1.84 × more energy efficient than Haswell and has 1.27 × greater performance.

Benchmarking↗

Benchmark results for few-body hypernuclei

Here, the Non-Symmetrized Hyperspherical Harmonics method (NSHH) is introduced in the hypernuclear sector and benchmarked with three different ab-initio methods, namely the Auxiliary Field Diffusion Monte Carlo method, the Faddeev–Yakubovsky approach and the Gaussian Expansion Method. Binding energies and hyperon separation energies of three- to five-body hypernuclei are calculated by employing the two-body ΛN component of the phenomenological Bodmer–Usmani potential, and a hyperon-nucleon interaction simulating the scattering phase shifts given by NSC97f. The range of applicability of the NSHH method is briefly discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Benchmark Comparison for a Multi-Processing Ion Mobility Calculator in the Free Molecular Regime

A benchmark comparison between two ion mobility and collision cross-section (CCS) calculators, MOBCAL and IMoS, is presented here as a standard to test the efficiency and performance of both programs. Utilizing 47 organic ions, results are in excellent agreement between IMoS and MOBCAL in He and N{sub 2,} when both programs use identical input parameters. Due to a more efficiently written algorithm and to its parallelization, IMoS is able to calculate the same CCS (within 1%) with a speed around two orders of magnitude faster than its MOBCAL counterpart when seven cores are used. Due to the high computational cost of MOBCAL in N{sub 2}, reaching tens of thousands of seconds even for small ions, the comparison between IMoS and MOBCAL is stopped at 70 atoms. Large biomolecules (>10000 atoms) remain computationally expensive when IMoS is used in N{sub 2} (even when employing 16 cores). Approximations such as diffuse trajectory methods (DHSS, TDHSS) with and without partial charges and projected area approximation corrections can be used to reduce the total computational time by several folds without hurting the accuracy of the solution. These latter methods can in principle be used with coarse-grained model structures and should yield acceptable CCS results. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Benchmark study of the DTU OWC chamber with both two-way and one-way absorption

This paper reports on a benchmark study based on small-scale (1:50) measurements of a single, oscillating water column chamber mounted sideways in a long flume. The geometry of the OWC chamber is extracted from a barge-like, attenuator-type floating concept “KNSwing” with 40 chambers targeted for deployment in the Danish part of the North Sea. In addition to traditional two-way energy extraction we also consider one-way energy extraction with passive venting and compare chamber response, pressures and total absorbed energy between the two methods. A blind study was established for the numerical modeling, with participants applying several implementations of weakly nonlinear potential flow theory and commercial Navier–Stokes solvers (CFD). Both compressible and incompressible models were used for the air phase. Potential flow calculations predict more energy absorption near the chamber resonance for one-way absorption than for two-way absorption, but the opposite is found from the experimental measurements. This outcome is mainly attributed to energy losses in the experimental passive valve system, but this conclusion must be confirmed by better experimental measurements. Modeling the one-way valve in CFD proved to be very challenging and only one team was able to provide results which were generally closer to the experiments. The study illustrates the challenges associated with both numerical and experimental analysis of OWC chambers. Air compressibility effects were not found to be important at this scale, even with the large volume of additional air used for the one-way case.

16 TIDAL AND WAVE POWER↗

Linear and nonlinear benchmarks between the CLT code and the M3D-C1 code for the 2/1 resistive tearing mode and the 1/1 resistive kink mode

Here, the linear and nonlinear benchmarks between the CLT code and the M3D-C1 code for the 2/1 resistive tearing mode and the 1/1 resistive kink mode are presented. CLT is an explicit finite difference code, while M3D-C1 is an implicit finite element code. Although the implementations of CLT and M3D-C1 are totally different, we find that the simulation results of the resistive-kink mode and the m/n=2/1 tearing mode from M3D-C1 and CLT are almost the same, including the linear and nonlinear growth rates, the mode structures, the nonlinear saturation levels, the Poincare plots, and the scaling laws. This confirms that the nonlinear results for the 1/1 resistive-kink mode and 2/1 tearing mode are accurate and reliable.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmarking of Solar Irradiance Nowcast Performance Derived from All-Sky Imagers

Fluctuations of the incoming solar irradiance impact the power generation from photovoltaic and concentrating solar thermal power plants. Accurate solar nowcasting becomes necessary to detect these sudden changes of generated power and to provide the desired information for optimal exploitation of solar systems. In the framework of the International Energy Agency's Photovoltaic Power Systems Program Task 16, a benchmarking exercise has been conducted relying on a bouquet of solar nowcasting methodologies by all-sky imagers (ASI). In this paper, four ASI systems nowcast the Global Horizontal Irradiance (GHI) with a time forecast ranging from 1 to 20 min during 28 days with variable cloud conditions spanning from September to November 2019 in southern Spain. All ASIs demonstrated their ability to accurately nowcast GHI, with RMSE ranging from 6.9% to 18.1%. Under cloudy conditions, all ASIs' nowcasts outperform the persistence models. Under clear skies, three ASIs are better than persistence. Discrepancies in the observed nowcasting performance become larger at increasing forecast horizons. The findings of this study highlight the feasibility of ASIs to reliably nowcast GHI at different sky conditions, time intervals and horizons. Such nowcasts can be used either to estimate solar power at distant times or detect sudden GHI fluctuations.

all-sky imagers↗

Measuring Distribution Performance? Benchmarking Warrants Your Attention

Identifying, designing, and measuring performance metrics is critical to securing customer value, but can be a difficult task. This article examines the use of benchmarks based on publicly available performance data to set challenging, yet fair, metrics and targets.

2017 customer value ranking↗

Using Electrochemistry to Benchmark, Understand, and Develop Noble Metal Nanoparticle Syntheses

The complex chemical nature of metal nanoparticle synthesis presents obstacles for the mechanistic understanding of nanoparticle growth and predictive synthesis design, despite significant progress in this area. Real-time characterization of the chemical processes that take place throughout nanoparticle growth will enable progress toward addressing outstanding challenges in metal nanoparticle synthesis, such as mitigating synthetic reproducibility issues, defining chemical mechanisms that direct nanoparticle growth, and designing synthetic conditions for previously unachievable combinations of nanoparticle shape and composition. In this Perspective, we present open-circuit potential (OCP) measurements as an in situ, real-time method for characterizing chemical changes during nanoparticle growth and discuss the method’s strengths in comparison to and in combination with other characterization techniques. We propose the use of OCP measurements as benchmarks for troubleshooting irreproducibility and streamlining synthetic optimization. Finally, we explore possibilities for using the increased parameter space accessible by electrodeposition to accelerate the development of shape-selective nanoparticle syntheses.

benchmarking↗

The Community Land Model Version 5: Description of New Features, Benchmarking, and Impact of Forcing Uncertainty

The Community Land Model (CLM) is the land component of the Community Earth System Model (CESM) and is used in several global and regional modeling systems. In this paper, we introduce model developments included in CLM version 5 (CLM5), which is the default land component for CESM2. We assess an ensemble of simulations, including prescribed and prognostic vegetation state, multiple forcing data sets, and CLM4, CLM4.5, and CLM5, against a range of metrics including from the International Land Model Benchmarking (ILAMBv2) package. CLM5 includes new and updated processes and parameterizations: (1) dynamic land units, (2) updated parameterizations and structure for hydrology and snow (spatially explicit soil depth, dry surface layer, revised groundwater scheme, revised canopy interception and canopy snow processes, updated fresh snow density, simple firn model, and Model for Scale Adaptive River Transport), (3) plant hydraulics and hydraulic redistribution, (4) revised nitrogen cycling (flexible leaf stoichiometry, leaf N optimization for photosynthesis, and carbon costs for plant nitrogen uptake), (5) global crop model with six crop types and time-evolving irrigated areas and fertilization rates, (6) updated urban building energy, (7) carbon isotopes, and (8) updated stomatal physiology. New optional features include demographically structured dynamic vegetation model (Functionally Assembled Terrestrial Ecosystem Simulator), ozone damage to plants, and fire trace gas emissions coupling to the atmosphere. Conclusive establishment of improvement or degradation of individual variables or metrics is challenged by forcing uncertainty, parametric uncertainty, and model structural complexity, but the multivariate metrics presented here suggest a general broad improvement from CLM4 to CLM5.

58 GEOSCIENCES↗

Benchmark studies of the gyro-Landau-fluid code and gyro-kinetic codes on kinetic ballooning modes

A Gyro-Landau-Fluid (GLF) 3 + 1 model has been recently implemented in BOUT++ framework, which contains full Finite-Larmor-Radius effects, Landau damping, and toroidal resonance [Ma et al., Phys. Plasmas 22, 055903 (2015)]. A linear global beta scan has been conducted using the JET-like circular equilibria (cbm18 series), showing that the unstable modes are kinetic ballooning modes (KBMs). In this work, we use the GYRO code, which is a gyrokinetic continuum code widely used for simulation of the plasma microturbulence, to benchmark with GLF 3 + 1 code on KBMs. To verify our code on the KBM case, we first perform the beta scan based on “Cyclone base case parameter set.” We find that the growth rate is almost the same for two codes, and the KBM mode is further destabilized as beta increases. For JET-like global circular equilibria, as the modes localize in peak pressure gradient region, a linear local beta scan using the same set of equilibria has been performed at this position for comparison. With the drift kinetic electron module in the GYRO code by including small electron-electron collision to damp electron modes, GYRO generated mode structures and parity suggest that they are kinetic ballooning modes, and the growth rate is comparable to the GLF results. However, a radial scan of the pedestal for a particular set of cbm18 equilibria, using GYRO code, shows different trends for the low-n and high-n modes. The low-n modes show that the linear growth rate peaks at peak pressure gradient position as GLF results. However, for high-n modes, the growth rate of the most unstable mode shifts outward to the bottom of pedestal and the real frequency of what was originally the KBMs in ion diamagnetic drift direction steadily approaches and crosses over to the electron diamagnetic drift direction.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Uncertainty Quantification Study of CTF for the OECD/NEA LWR Uncertainty Analysis in Modeling Benchmark

This work describes the results of a quantitative uncertainty analysis of the thermal-hydraulic subchannel code for nuclear engineering applications, Coolant Boiling in Rod Arrays-Three Field (COBRA-TF). CTF is used, which is a version of COBRA-TF developed in cooperation between the Consortium for Advanced Simulation of Light Water Reactors and North Carolina State University. Four steady-state cases from Phase II Exercise 3 of the Organisation for Economic Co-operation and Development/Nuclear Energy Agency Light Water Reactor Uncertainty Analysis in Modeling (UAM) Benchmark are analyzed using the statistical analysis tool, Design Analysis Kit for Optimization and Terascale Applications (Dakota). The input parameters include boundary condition, geometry, and modeling uncertainties, which are selected using a sensitivity study and then defined based on expert judgment. Here, a forward uncertainty quantification method with Latin hypercube sampling (LHS) is used, where the sample size is based on available computational resources.

42 ENGINEERING↗

Integral Nuclear Data and Benchmarking Needs for Fusion Energy Systems

Fusion energy systems are currently being designed and optimized using radiation transport codes. To deal with the unique environment inside a fusion-based system, many of these designs incorporate novel materials able to withstand the high radiation fields, ensure adequate cooling and thermal protection, and produce tritium. Validation plays a vital role in building trust in the predictive power of these models and computational methods. Validation of a code consists of modeling documented real-world experiments and comparing the code-predicted response to the measured response. Adequate validation requires measured responses from real-world experiments, also known as integral data, that mimic the system being designed, including materials, impinging radiation, and temperature, among other variables. The most trusted integral data are experimental responses that have been through a rigorous benchmarking process that develops a recommended computational model and evaluates all experimental uncertainties. Finally, there are a few research groups around the world that have been producing integral data for fusion applications, but a substantial investment is needed to address the unique validation needs of the fusion community.

Fusion↗

Axisymmetric benchmarks of impurity dynamics in extended-magnetohydrodynamic simulations

A verification benchmark has been carried out between the M3D-C1 and NIMROD extended-magnetohydrodynamics (xMHD) codes for simulations of impurity-induced disruption mitigation. Disruptions are a significant concern for future tokamaks, and high-fidelity simulations are required in order to ensure the success of disruption-mitigation techniques (e.g., shattered-pellet injection) in large-scale fusion reactors. Both MHD codes have been coupled to the KPRAD code for impurity dynamics. The codes show excellent agreement in four axisymmetric, nonlinear simulations, particularly during the thermal quench. This agreement is seen in the time histories of global plasma quantities such as thermal energy, radiated power, and total number of electrons, as well as 2D contours of temperature and current density. The simulations predict that, given the same number of atoms injected, argon quenches the plasma two-to-three times as fast as neon. Furthermore, the inclusion of temperature-dependent Spitzer resistivity causes the current to diffuse and to decay, inducing axisymmetric MHD instabilities that result in a current quench. As a result, this work represents an important verification of the coupled impurity and MHD models implemented in M3D-C1 and NIMROD, giving greater confidence in the ability of both codes to perform more sophisticated disruption-mitigation simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗