Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Benchmarking carbon fluxes of the ISIMIP2a biome models

The purpose of this study is to evaluate the eight ISIMIP2a biome models against independent estimates of long-term net carbon fluxes (i.e. Net Biome Productivity, NBP) over terrestrial ecosystems for the recent four decades (1971–2010). Here, we evaluate modeled global NBP against 1) the updated global residual land sink (RLS) plus land use emissions (E LUC ) from the Global Carbon Project (GCP), presented as R + L in this study by Le Quéré et al (2015), and 2) the land CO 2 fluxes from two atmospheric inversion systems: Jena CarboScope s81_v3.8 and CAMS v15r2, referred to as F Jena and F CAMS respectively. The model ensemble-mean NBP (that includes seven models with land-use change) is higher than but within the uncertainty of R + L, while the simulated positive NBP trend over the last 30 yr is lower than that from R + L and from the two inversion systems. ISIMIP2a biome models well capture the interannual variation of global net terrestrial ecosystem carbon fluxes. Tropical NBP represents 31 ± 17% of global total NBP during the past decades, and the year-to-year variation of tropical NBP contributes most of the interannual variation of global NBP. According to the models, increasing Net Primary Productivity (NPP) was the main cause for the generally increasing NBP. Significant global NBP anomalies from the long-term mean between the two phases of El Niño Southern Oscillation (ENSO) events are simulated by all models (p < 0.05), which is consistent with the R + L estimate (p = 0.06), also mainly attributed to NPP anomalies, rather than to changes in heterotrophic respiration (Rh). The global NPP and NBP anomalies during ENSO events are dominated by their anomalies in tropical regions impacted by tropical climate variability. Multiple regressions between R + L, F Jena and F CAMS interannual variations and tropical climate variations reveal a significant negative response of global net terrestrial ecosystem carbon fluxes to tropical mean annual temperature variation, and a non-significant response to tropical annual precipitation variation. According to the models, tropical precipitation is a more important driver, suggesting that some models do not capture the roles of precipitation and temperature changes adequately.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

TOWARD RELIABLE BENCHMARKING OF SOLAR FLARE FORECASTING METHODS

Solar flares occur in complex sunspot groups, but it remains unclear how the probability of producing a flare of a given magnitude relates to the characteristics of the sunspot group. Here, we use Geostationary Operational Environmental Satellite X-ray flares and McIntosh group classifications from solar cycles 21 and 22 to calculate average flare rates for each McIntosh class and use these to determine Poisson probabilities for different flare magnitudes. Forecast verification measures are studied to find optimum thresholds to convert Poisson flare probabilities into yes/no predictions of cycle 23 flares. A case is presented to adopt the true skill statistic (TSS) as a standard for forecast comparison over the commonly used Heidke skill score (HSS). In predicting flares over 24 hr, the maximum values of TSS achieved are 0.44 (C-class), 0.53 (M-class), 0.74 (X-class), 0.54 ({>=}M1.0), and 0.46 ({>=}C1.0). The maximum values of HSS are 0.38 (C-class), 0.27 (M-class), 0.14 (X-class), 0.28 ({>=}M1.0), and 0.41 ({>=}C1.0). These show that Poisson probabilities perform comparably to some more complex prediction systems, but the overall inaccuracy highlights the problem with using average values to represent flaring rate distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Analysis and Benchmarking of feature reduction for classification under computational constraints

Abstract Machine learning is most often expensive in terms of computational and memory costs due to training with large volumes of data. Current computational limitations of many computing systems motivate us to investigate practical approaches, such as feature selection and reduction, to reduce the time and memory costs while not sacrificing the accuracy of classification algorithms. In this work, we carefully review, analyze, and identify the feature reduction methods that have low costs/overheads in terms of time and memory. Then, we evaluate the identified reduction methods in terms of their impact on the accuracy, precision, time, and memory costs of traditional classification algorithms. Specifically, we focus on the least resource intensive feature reduction methods that are available in Scikit-Learn library. Since our goal is to identify the best performing low-cost reduction methods, we do not consider complex expensive reduction algorithms in this study. In our evaluation, we find that at quadratic-scale feature reduction, the classification algorithms achieve the best trade-off among competitive performance metrics. Results show that the overall training times are reduced 61%, the model sizes are reduced 6×, and accuracy scores increase 25% compared to the baselines on average with quadratic scale reduction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

High power conditioning and benchmarking of planar nitrogen-incorporated ultrananocrystalline diamond field emission electron source

Planar nitrogen-incorporated ultrananocrystalline diamond [(N)UNCD] has emerged as a unique field emission source attractive for accelerator applications because of its capability to generate a high charge beam and handle moderate vacuum conditions. Most importantly, (N)UNCD sources are simple to produce: Conventional high aspect ratio isolated emitters are not required to be formed on the surface, and the actual emitter surface roughness is on the order of only 10–100 nm. A careful reliability assessment of (N)UNCD is required before it may find routine application in accelerator systems. In the present study using an L-band normal conducting single-cell rf gun, a (N)UNCD cathode has been conditioned to ~ 42 MV / m in a well-controlled manner. It reached a maximum output charge of 15 nC corresponding to an average current of 6 mA during an emission period of 2.5 $μ$s . Imaging of the emission current revealed a large number of isolated emitters (density over 100/cm 2 ) distributed on the cathode, which is consistent with previous tests in dc environments. The performance metrics, the emission imaging, and the systematic study of emission properties during rf conditioning in a wide gradient range assert (N)UNCD as an enabling electron source for rf injector designs serving industrial and scientific applications. These studies also improve the fundamental knowledge of the practical conditioning procedure via a better understanding of the emission mechanisms.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Benchmarking of hydrodynamic plasma waveguides for multi-GeV laser-driven electron acceleration

Hydrodynamic plasma waveguides initiated by optical field ionization have recently become a key component of multi-GeV laser wakefield accelerators. Here, we present the most complete and accurate experimental and simulation-based characterization to date, applicable to current multi-GeV experiments and future 100 GeV-scale laser plasma accelerators. Crucial to the simulations is the correct modeling of intense Bessel beam interaction with meter-scale gas targets, the results of which are used as initial conditions for hydrodynamic simulations. The simulations are in good agreement with our experiments measuring evolving plasma and neutral hydrogen density profiles using two-color short pulse interferometry, enabling realistic determination of the guided mode structure for application to laser-driven plasma accelerator design. Published by the American Physical Society 2024

Physics↗
DOE OSTI2021

Cohesion and excitations of diamond-structure silicon by quantum Monte Carlo: Benchmarks and control of systematic biases

We have carried out quantum Monte Carlo (QMC) calculations of silicon crystal focusing on the accuracy and systematic biases that affect the electronic structure characteristics. The results show that 64 and 216 atom supercells provide an excellent consistency for extrapolated energies per atom in the thermodynamic limit for ground, excited, and ionized states. We have calculated the ground state cohesion energy with both systematic and statistical errors below ≈ 0.05 eV. The ground state exhibits a fixed-node error of only 1.3(2)% of the correlation energy, suggesting an unusually high accuracy of the corresponding single-reference trial wave function. We obtain a very good agreement between optical and quasiparticle gaps that affirms the marginal impact of excitonic effects. Our most accurate results for band gaps differ from the experiments by about 0.2 eV. This difference is assigned to a combination of residual finite-size and fixed-node errors. In conclusion, we have estimated the crystal Fermi level referenced to vacuum that enabled us to calculate the edges of valence and conduction bands in agreement with experiments.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Spinor $GW$ Bethe-Salpeter calculations in BerkeleyGW: Implementation, symmetries, benchmarking, and performance

Computing the GW quasiparticle band structure and Bethe-Salpeter equation (BSE) absorption spectra for materials with spin-orbit coupling have commonly been done by treating GW corrections and spin-orbit coupling (SOC) as separate perturbations to density-functional theory. However, accurate treatment of materials with strong spin-orbit coupling (such as many topological materials of recent interest, and thermoelectrics) often requires a nonperturbative approach using spinor wave functions in the Kohn-Sham equation and GW/BSE. Such calculations have only recently become available, in particular for the BSE. Here, we have implemented this approach in the plane-wave pseudopotential GW/BSE code BerkeleyGW, which is highly parallelized and widely used in the electronic-structure community. We present reference results for quasiparticle band structures and optical absorption spectra of solids with different strengths of spin-orbit coupling, including Si, Ge, GaAs, GaSb, CdSe, Au, and Bi 2 Se 3 . The calculated quasiparticle band gaps of these systems are found to agree with experiment to within a few tens of meV. SOC splittings are found to be generally in better agreement with experiment, including quasiparticle corrections to band energies. The absorption spectrum of GaAs is not significantly impacted by the inclusion of spin-orbit coupling due to its relatively small value (0.2 eV) in the Λ direction, while the absorption spectrum of GaSb calculated with the spinor GW/BSE captures the large spin-orbit splitting of peaks in the spectrum. For the prototypical topological insulator Bi 2 Se 3 , we find a drastic change in the low-energy band structure compared to that of DFT, with the spinorial treatment of the GW approximation correctly capturing the parabolic nature of the valence and conduction bands after including off-diagonal self-energy matrix elements. We present the detailed methodology, approach to spatial symmetries for spinors, comparison against other codes, and performance compared to spinless GW/BSE calculations and perturbative approaches to SOC. This work aims to spur further development of spinor GW/BSE methodology in excited-state research software and enables a more accurate and detailed exploration of electronic and optical properties of materials containing elements with large atomic numbers.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Benchmarks and results of the two-band Hubbard model from the Gutzwiller conjugate gradient minimization theory

Ground-state properties, such as energies and double occupancies, of a one-dimensional two-band Hubbard model are calculated using a first-principles Gutzwiller conjugate gradient minimization theory. The favorable agreement with the results from the density matrix renormalization group theory demonstrates the accuracy of our method. A rotationally invariant approach is further incorporated into the method to greatly reduce the computational complexity with a speedup of approximately 50 times. Moreover, we investigate the Mott transition between a metal and a Mott insulator by evaluating the charge gap. In conclusion, with greatly reduced computational effort, our method reproduces the phase diagram in reasonable agreement with the density matrix renormalization group theory.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2016

Benchmarking the pseudopotential and fixed-node approximations in diffusion Monte Carlo calculations of molecules and solids

Diffusion Monte Carlo (DMC) calculations of the spectroscopic properties of a large set of molecules were performed, assessing the effect of different approximations. In systems containing elements with large atomic numbers, we show that the errors associated with the use of nonlocal mean-field-based pseudopotentials in DMC calculations can be significant and may surpass the fixed-node error. We suggest practical guidelines for reducing these pseudopotential errors, which allow us to obtain DMC-computed spectroscopic parameters of molecules and equation of state properties of solids in excellent agreement with experiment.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Benchmarking density functional perturbation theory to enable high-throughput screening of materials for dielectric constant and refractive index

We demonstrate a high-throughput density functional perturbation theory (DFPT) methodology capable of screening compounds for their dielectric properties. The electronic and ionic dielectric tensors are calculated for 88 compounds, where the eigenvalues of the total dielectric tensors are compared with single crystal and polycrystalline experimental values reported in the literature. We find that GGA/PBE has a smaller mean average deviation from experiments (MARD=16.2%) when compared to LDA. The prediction accuracy of DFPT is lowest for compounds that exhibit complex structural relaxation effects (e.g., octahedra rotation in perovskites) and/or strong anharmonicity. Despite some discrepancies between DFPT results and reported experimental values, the high-throughput methodology is found to be useful in identifying interesting compounds by ranking. This is demonstrated by the high Spearman correlation factor (ρ=0.92). Finally, we demonstrate that DFPT provides a good estimate for the refractive index of a compound without calculating the frequency dependence of the dielectric matrix (MARD=5.7%).

36 MATERIALS SCIENCE↗
DOE OSTI2019

Experimental M 1 response of 40 Ar as a benchmark for neutrino-nucleus scattering calculations

The excitation of atomic nuclei via magnetic dipole transitions is closely related to the inelastic neutral-current neutrino-nucleus (NC-νA) scattering process due to the similarity of the transition operators. NC-νA-scattering serves for the detection of supernova neutrinos and poses a significant source of background in modern liquid-argon based high-energy neutrino detection experiments. To enable tests of the reliability of predictions for neutrino-nucleus scattering, the magnetic dipole response of 40 Ar below 7.7 MeV was characterized in a nuclear resonance fluorescence experiment using quasimonoenergetic γ-ray beams. The linear polarization of the beams allowed for assignments of electric or magnetic character to previously known dipole excitations. A total magnetic dipole strength of $0.36$ $^{+0.04}_{–0.05}$ $μ$ $^{2}_{N}$ was identified in the energy range of the present experiment. Combined with data from previous measurements, the full magnetic dipole strength of 40 Ar below the neutron separation threshold was investigated. Due to the low background in the energy range within the bandwidth of the γ-ray beams, the previous sensitivity limit was improved. Furthermore, a large-scale nuclear shell model calculation in the sd–fp space satisfactorily agrees with the data in terms of excitation energies and strengths of the observed 1 + states.

39 ≤ A ≤ 58↗

Refine your search to explore more results.