Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Building America Best Practices Series - Volume 15: 40% Whole-House Energy Savings in the Hot-Humid Climate

This best practices guide is the 15th in a series of guides for builders produced by PNNL for the U.S. Department of Energy’s Building America program. This guide book is a resource to help builders design and construct homes that are among the most energy-efficient available, while addressing issues such as building durability, indoor air quality, and occupant health, safety, and comfort. With the measures described in this guide, builders in the hot-humid climate can build homes that have whole-house energy savings of 40% over the Building America benchmark with no added overall costs for consumers. The best practices described in this document are based on the results of research and demonstration projects conducted by Building America’s research teams. Building America brings together the nation’s leading building scientists with over 300 production builders to develop, test, and apply innovative, energy-efficient construction practices. Building America builders have found they can build homes that meet these aggressive energy-efficiency goals at no net increased costs to the homeowners. Currently, Building America homes achieve energy savings of 40% greater than the Building America benchmark home (a home built to mid-1990s building practices roughly equivalent to the 1993 Model Energy Code). The recommendations in this document meet or exceed the requirements of the 2009 IECC and 2009 IRC and those requirements are highlighted in the text. Requirements of the 2012 IECC and 2012 IRC are also noted in text and tables throughout the guide. This document will be distributed via the DOE Building America website: www.buildingamerica.gov.

Building America↗

Building America Best Practices Series - Volume 16: 40% Whole-House Energy Savings in the Mixed-Humid Climate

This best practices guide is the 16th in a series of guides for builders produced by PNNL for the U.S. Department of Energy’s Building America program. This guide book is a resource to help builders design and construct homes that are among the most energy-efficient available, while addressing issues such as building durability, indoor air quality, and occupant health, safety, and comfort. With the measures described in this guide, builders in the mixed-humid climate can build homes that have whole-house energy savings of 40% over the Building America benchmark with no added overall costs for consumers. The best practices described in this document are based on the results of research and demonstration projects conducted by Building America’s research teams. Building America brings together the nation’s leading building scientists with over 300 production builders to develop, test, and apply innovative, energy-efficient construction practices. Building America builders have found they can build homes that meet these aggressive energy-efficiency goals at no net increased costs to the homeowners. Currently, Building America homes achieve energy savings of 40% greater than the Building America benchmark home (a home built to mid-1990s building practices roughly equivalent to the 1993 Model Energy Code). The recommendations in this document meet or exceed the requirements of the 2009 IECC and 2009 IRC and those requirements are highlighted in the text. Requirements of the 2012 IECC and 2012 IRC are also noted in text and tables throughout the guide. This document will be distributed via the DOE Building America website: www.buildingamerica.gov.

Building America↗

Benchmarking state-of-the-art theory and empirical models of pionless neutrino-argon scattering in GENIE

Upcoming experiments need improved simulations of neutrino scattering. This work uses the popular GENIE event generator to test a variety of neutrino interaction models against recent MicroBooNE measurements of pionless charged-current interactions. The GENIE code can easily interchange model components, including nucleon form factor parameterizations, quasielastic cross-section calculations, treatments of the nuclear ground state and hadronic final-state interactions. Leveraging this software capability in comparisons with MicroBooNE data, the performance of some of GENIE’s most theoretically sophisticated model components is evaluated and contrasted with more empirically-driven alternatives.

Neutrino cross section↗

Reactivity impact of {sup 16}O thermal elastic-scattering nuclear data for some numerical and critical benchmark systems

The thermal neutron-elastic-scattering cross-section data for {sup 16}O used in various modern evaluated-nuclear-data libraries were reviewed and found to be generally too high compared with the best available experimental measurements. Some of the proposed revisions to the ENDF/B-VII.0 {sup 16}O data library and recent results from the TENDL system increase this discrepancy further. The reactivity impact of revising the {sup 16}O data downward to be consistent with the best measurements was tested using the JENDL-3.3 {sup 16}O cross-section values and was found to be very small in MCNP5 simulations of the UO{sub 2} and reactor-recycle MOX-fuel cases of the ANS Doppler-defect numerical benchmark. However, large reactivity differences of up to about 14 mk (1400 pcm) were observed using {sup 16}O data files from several evaluated-nuclear-data libraries in MCNP5 simulations of the Los Alamos National Laboratory HEU heavy-water solution thermal critical experiments, which were performed in the 1950's. The latter result suggests that new measurements using HEU in a heavy-water-moderated critical facility, such as the ZED-2 zero-power reactor at the Chalk River Laboratories, might help to resolve the discrepancy between the {sup 16}O thermal elastic-scattering cross-section values and thereby reduce or better define its uncertainty, although additional assessment work would be needed to confirm this. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Group structure selection with random forests

Choosing an appropriate group structure for multigroup transport is far from an exact science. For some applications, one blindly uses a group structure developed years ago by forgotten methods. Furthermore, one sometimes uses the same group structure for a variety of problems, even if the group structure was originally developed with a certain application in mind. In this work, we create optimized group structures with simulated annealing for critical assembly test problems and apply a random forest regressor with bagging to choose the best group structure based on parameters of the different test problems. The optimized group structures were generated using a simulated annealing optimizer for several simple, spherical, and unreflected problems. The optimization was performed to minimize a cost function that included fission rate, absorption rate, leakage, and k{sub eff}. A random forest regressor was then trained on a set of International Criticality Safety Benchmark Evaluation Project inputs and used to select one of these six group structures. The trained machine learning model chose the best group structure 65% of the time, and one of the three best 89% of the time. Furthermore, it decreased the L2 error over all test problems by a factor of 25 when compared to the standard Los Alamos 70-group structure. In other words, the model chose group structure that were far more appropriate for the test problems than the traditional LANL group structure. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Performance Analysis of Memory Transfers and GEMM Subroutines on NVIDIA Tesla GPU Cluster

Commodity clusters augmented with application accelerators are evolving as competitive high performance computing systems. The Graphical Processing Unit (GPU) with a very high arithmetic density and performance per price ratio is a good platform for the scientific application acceleration. In addition to the interconnect bottlenecks among the cluster compute nodes, the cost of memory copies between the host and the GPU device have to be carefully amortized to improve the overall efficiency of the application. Scientific applications also rely on efficient implementation of the BAsic Linear Algebra Subroutines (BLAS), among which the General Matrix Multiply (GEMM) is considered as the workhorse subroutine. In this paper, they study the performance of the memory copies and GEMM subroutines that are critical to port the computational chemistry algorithms to the GPU clusters. To that end, a benchmark based on the NetPIPE framework is developed to evaluate the latency and bandwidth of the memory copies between the host and the GPU device. The performance of the single and double precision GEMM subroutines from the NVIDIA CUBLAS 2.0 library are studied. The results have been compared with that of the BLAS routines from the Intel Math Kernel Library (MKL) to understand the computational trade-offs. The test bed is a Intel Xeon cluster equipped with NVIDIA Tesla GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Upgrading Limiting Peak-Power Analysis Techniques with Modern Validation and Uncertainty Quantification for the Advanced Test Reactor

Here, this work demonstrates the acceptability of the 2D deterministic transport code, HELIOS, to replace the legacy diffusion code, PDQ, for computing the peak-power performance parameters of the Advanced Test Reactor (ATR). The 95% Confidence Rule, commonly used in the commercial reactor sector, is explored to develop the so-called “reliability factors” which provide statistical confidence that the peak-power limits within the hottest location along a fuel plate, referred to as the hot-stripe, will not be exceeded. Additionally, an alternative “legacy” methodology was explored that attempts to mimic the exact PDQ analysis process used for defining the peak-power limits. The legacy methodology, involves interpolating power between regions at azimuthal boundaries subtending the regions of interest. In order to apply the 95% Confidence Rule, a statistically significant calculation-to-measurement bias must first be established. Unlike the commercial world where thousands of power observations can be collected every cycle using on-line flux mapping instrumentation, the ATR power distribution must be measured during “depressurized” zero-power measurements using fission wires in polyethylene wands. In 2012, fission wire activation data was collected during a flux run in the Advanced Test Reactor – Critical facility. Also to improve statistical validity, archival data from ATR zero power flux runs from 1977, 1986, and 1994 were digitized from scanned reports and used to create new benchmark models. Borrowing from least-squares adjustment methods commonly used for neutron activation spectroscopy, adjusted fission wire powers were calculated for all four datasets. The mean and standard deviation of the bias between a priori calculated and adjusted wire-powers was then taken as the bias and uncertainty used in the 95% Confidence Rule.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Muonic force behind flavor anomalies

We develop an economical theoretical framework for combined explanations of the flavor physics anomalies involving muons: (g - 2) μ , R K(*), and b → sμ + μ - angular distributions and branching ratios, that was first initiated by some of us in ref. [1]. The Standard Model (SM) is supplemented with a lepton-flavored U(1) X gauge group. The U(1) X gauge boson with the mass of O(0.1) GeV resolves the (g - 2) μ tension. A TeV-scale leptoquark, charged under the U(1) X , carries a muon number and mediates B-decays without prompting charged lepton flavor violation or inducing proton decay. We explore the theory space of the chiral, anomaly-free U(1) X gauge extensions featuring the above scenario, and identify many suitable charge assignments for the SM+3ν R fermion content with the integer charges in the range X F i $\in$ [-10, 10]. We then carry out a comprehensive phenomenological study of the muonic force in representative benchmark models. Interestingly, we found models which can resolve the tension without conflicting the complementary constraints, and all of the viable parameter space will be tested in future muonic resonance searches. Finally, the catalog of the anomaly-free lepton-non-universal charge assignments motivated us to explore different directions in model building. We present a model in which the muon mass and the (g - 2) μ are generated radiatively from a common short-distance dynamics after the U(1) X breaking. We also show how to charge a vector leptoquark under U(1) μ-τ in a complete gauge model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmarking graph neural networks for materials chemistry

Graph neural networks (GNNs) have received intense interest as a rapidly expanding class of machine learning models remarkably well-suited for materials applications. To date, a number of successful GNNs have been proposed and demonstrated for systems ranging from crystal stability to electronic property prediction and to surface chemistry and heterogeneous catalysis. However, a consistent benchmark of these models remains lacking, hindering the development and consistent evaluation of new models in the materials field. Here, we present a workflow and testing platform, MatDeepLearn, for quickly and reproducibly assessing and comparing GNNs and other machine learning models. We use this platform to optimize and evaluate a selection of top performing GNNs on several representative datasets in computational materials chemistry. From our investigations we note the importance of hyperparameter selection and find roughly similar performances for the top models once optimized. We identify several strengths in GNNs over conventional models in cases with compositionally diverse datasets and in its overall flexibility with respect to inputs, due to learned rather than defined representations. Meanwhile several weaknesses of GNNs are also observed including high data requirements, and suggestions for further improvement for applications in materials chemistry are discussed.

36 MATERIALS SCIENCE↗

Platform for probing radiation transport properties of hydrogen at conditions found in the deep interiors of red dwarfs

We describe an experimental concept at the National Ignition Facility for specifically tailored spherical implosions to compress hydrogen to extreme densities (up to ∼800× solid density, electron number density ne∼4×1025 cm−3) at moderate temperatures (T∼200 eV), i.e., to conditions, which are relevant to the interiors of red dwarf stars. The dense plasma will be probed by laser-generated x-ray radiation of different photon energy to determine the plasma opacity due to collisional (free–free) absorption and Thomson scattering. The obtained results will benchmark radiation transport models, which in the case for free–free absorption show strong deviations at conditions relevant to red dwarfs. This very first experimental test of free–free opacity models at these extreme states will help to constrain where inside those celestial objects energy transport is dominated by radiation or convection. Moreover, our study will inform models for other important processes in dense plasmas, which are based on electron–ion collisions, e.g., stopping of swift ions or electron–ion temperature relaxation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The factory and the beehive. II. Activity and rotation in Praesepe and the Hyades

Open clusters are collections of stars with a single, well-determined age, and can be used to investigate the connections between angular-momentum evolution and magnetic activity over a star's lifetime. We present the results of a comparative study of the relationship between stellar rotation and activity in two benchmark open clusters: Praesepe and the Hyades. As they have the same age and roughly solar metallicity, these clusters serve as an ideal laboratory for testing the agreement between theoretical and empirical rotation-activity relations at ≈600 Myr. We have compiled a sample of 720 spectra—more than half of which are new observations—for 516 high-confidence members of Praesepe; we have also obtained 139 new spectra for 130 high-confidence Hyads. We have also collected rotation periods (P {sub rot}) for 135 Praesepe members and 87 Hyads. To compare Hα emission, an indicator of chromospheric activity, as a function of color, mass, and Rossby number R{sub o} , we first calculate an expanded set of χ values, with which we can obtain the Hα to bolometric luminosity ratio, L {sub Hα}/L {sub bol}, even when spectra are not flux-calibrated and/or stars lack reliable distances. Our χ values cover a broader range of stellar masses and colors (roughly equivalent to spectral types from K0 to M9), and exhibit better agreement between independent calculations, than existing values. Unlike previous authors, we find no difference between the two clusters in their Hα equivalent width or L {sub Hα}/L {sub bol} distributions, and therefore take the merged Hα and P {sub rot} data to be representative of 600 Myr old stars. Our analysis shows that Hα activity in these stars is saturated for R{sub o}≤0.11{sub −0.03}{sup +0.02}. Above that value activity declines as a power-law with slope β=−0.73{sub −0.12}{sup +0.16}, before dropping off rapidly at R{sub o} ≈ 0.4. These data provide a useful anchor for calibrating the age-activity-rotation relation beyond 600 Myr.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimating the density of states of frustrated spin systems

Abstract Estimating the density of states (DOS) of systems with rugged free energy landscapes is a notoriously difficult task of the utmost importance in many areas of physics ranging from spin glasses to biopolymers. DOS estimation has also recently become an indispensable tool for the benchmarking of quantum annealers when these function as samplers. Some of the standard approaches suffer from a spurious convergence of the estimates to metastable minima, and these cases are particularly hard to detect. Here, we introduce a sampling technique based on population annealing enhanced with a multi-histogram analysis and report on its performance for spin glasses. We demonstrate its ability to overcome the pitfalls of other entropic samplers, resulting in some cases in large scaling advantages that can lead to the uncovering of new physics. The new technique avoids some inherent difficulties in established approaches and can be applied to a wide range of systems without relevant tailoring requirements. Benchmarking of the studied techniques is facilitated by the introduction of several schemes that allow us to achieve exact counts of the degeneracies of the tested instances.

Barash, Lev (ORCID:000000022298785X)↗

Development and Evaluation of a Cost-Effective Behind-the-Meter Synchronized Measurement Unit for Enhanced Grid Integration

This paper presents the development of the Inverter Based Resource Monitor (IBRM), an innovative behind-the-meter synchronized measurement unit (SMU) tailored for integration with inverter-based resources (IBRs). The IBRM distinguishes itself as a highly accurate and cost-effective SMU, offering facile deployment and connectivity to IBRs. It is equipped to conduct real-time voltage and current waveform analyses, serving as a phasor measurement unit (PMU) with exceptionally rapid synchrophasor transmission capabilities. The device incorporates a cutting-edge dual-core architecture designed to minimize sampling delays inherent to its microprocessor, thereby enhancing the precision of synchronized waveform measurements. Moreover, the IBRM is adept at recording high-fidelity waveform data, capturing nuances such as waveform distortions, high-order harmonics, and wide-band oscillations prevalent in power grids with substantial IBR presence. A prototype of the IBRM has been constructed and subjected to rigorous testing to assess its functional capabilities and measurement precision, utilizing both idealized signal generators and a real-world off-grid inverter setup as benchmarks.

Wu, Ori [ORNL] (ORCID:0000000326723410)↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

A Multi-TeV Linear Collider Based on CLIC Technology : CLIC Conceptual Design Report

This report describes the accelerator studies for a future multi-TeV e + e - collider based on the Compact Linear Collider (CLIC) technology. The CLIC concept as described in the report is based on high gradient normal-conducting accelerating structures where the RF power for the acceleration of the colliding beams is extracted from a high-current Drive Beam that runs parallel with the main linac. The focus of CLIC R&D over the last years has been on addressing a set of key feasibility issues that are essential for proving the fundamental validity of the CLIC concept. The status of these feasibility studies are described and summarized. The report also includes a technical description of the accelerator components and R&D to develop the most important parts and methods, as well as a description of the civil engineering and technical services associated with the installation. Several larger system tests have been performed to validate the two-beam scheme, and of particular importance are the results from the CLIC test facility at CERN (CTF3). Both the machine and detector/physics studies for CLIC have primarily focused on the 3 TeV implementation of CLIC as a benchmark for the CLIC feasibility. This report also includes specific studies for an initial 500 GeV machine, and some discussion of possible intermediate energy stages. The performance and operation issues related to operation at reduced energy compared to the nominal, and considerations of a staged construction program are included in the final part of the report. The CLIC accelerator study is organized as an international collaboration with 43 partners in 22 countries. An associated report describes the physics potential and experiments at CLIC and a shorter report in preparation will focus on the CLIC implementation strategy, together with a plan for the CLIC R&D studies 2012–2016. Critical and important implementation issues such as cost, power and schedule will be addressed there.

43 PARTICLE ACCELERATORS↗

Optimal gas cooling with minimal aero-opticaldistortion for next generation high-average-power lasers (Progress report, Year 2)

Next-generation lasers that combine high-peak-power ultrashort pulses with high repetition rates have the potential to efficiently deliver the high-average-power outputs required for inertial fusion energy generation, laser-based particle acceleration, and to generate compact secondary x- and 𝛾-ray radiation sources, among others. The combination of long gain length with high surface-to-volume ratio to remove residual heat makes gas-cooled multi-slab amplifier heads an inherently aperture- and average power scalable technology that enables this new class of solid-state lasers, and their thermal management becomes the most pressing technical challenge. As the index-of refraction depends on the gas density, heat removal from the slab surfaces unavoidably entails scattering of propagated light from regions of high temperature fluctuations. The requirement to maximize convective heat extraction from the gain medium under the constraint of minimum optical aberration of the beam renders amplifier slab cooling a technological challenge at the intersection of aero-optics, fluid-mechanics and heat transfer. The goal of this research is to leverage computational fluid dynamics and aero optics simulations of different levels of fidelity to devise a numerical modeling and optimization framework for gas-cooled multi-slab amplifiers. The project will be conducted in close collaboration with the Advanced Photon Technologies Group at Lawrence Livermore National Laboratory, where a gas-cooled test stand for laser materials and thermal management structures will be developed and installed. The final goal of the collaborative effort is to manufacture and benchmark a physical prototype of an numerically optimized amplifier head design. Measurement data on solid-state and thermo-optical distortions will be used for the validation of the numerical models. The key technical challenge in this multi-objective design problem is that of balancing optimal heat removal with minimal optical distortion. To facilitate computationally efficient design optimization and, at the same time, deepen our basic understanding of the interaction of light with turbulence, a complementary study that combines high and low-fidelity flow simulations and aero-optical models is proposed. Along the lines of these two objectives and solution strategies, the project is organized into two thrusts.

42 ENGINEERING↗

Sodium Spray Fire Simulations using CONTAIN-LMR

License applications for sodium fast reactors will include sodium fire analysis and subsequent mitigation strategies. Sodium leaks or ruptures from piping and support systems can lead to significant fires due to the reactive nature of sodium with air and water. Understanding the behavior of sodium fires is crucial for modeling and predicting accidents in sodium fast reactors. This paper describes the initial results of a control volume code, CONTAIN-LMR (CLMR), modeling effort for a sodium spray fire experiment conducted at Sandia National Laboratories (SNL) in Albuquerque, New Mexico in 2010. Additional sodium spray and pool fire tests were conducted at SNL in 2009 and 2010 and will be compared to CLMR results in future papers. The purpose of this analysis was extract information from the evolution of the SNL tests to better understand how to use CLMR in future sodium fire analysis. Thus the following CLMR simulations were not completely the result of blind benchmarking study. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Deploy Nalu/Kokkos algorithmic infrastructure with performance benchmarking.

The former Nalu interior heterogeneous algorithm design, which was originally designed to manage matrix assembly operations over all elemental topology types, has been modified to operate over homogeneous collections of mesh entities. This newly templated kernel design allows for removal of workset variable resize operations that were formerly required at each loop over a Sierra ToolKit (STK) bucket (nominally, 512 entities in size). Extensive usage of the Standard Template Library (STL) std::vector has been removed in favor of intrinsic Kokkos memory views. In this milestone effort, the transition to Kokkos as the underlying infrastructure to support performance and portability on many-core architectures has been deployed for key matrix algorithmic kernels. A unit-test driven design effort has developed a homogeneous entity algorithm that employs a team-based thread parallelism construct. The STK Single Instruction Multiple Data (SIMD) infrastructure is used to interleave data for improved vectorization. The collective algorithm design, which allows for concurrent threading and SIMD management, has been deployed for the core low-Mach element- based algorithm. Several tests to ascertain SIMD performance on Intel KNL and Haswell architectures have been carried out. The performance test matrix includes evaluation of both low- and higher-order methods. The higher-order low-Mach methodology builds on polynomial promotion of the core low-order control volume nite element method (CVFEM). Performance testing of the Kokkos-view/SIMD design indicates low-order matrix assembly kernel speed-up ranging between two and four times depending on mesh loading and node count. Better speedups are observed for higher-order meshes (currently only P=2 has been tested) especially on KNL. The increased workload per element on higher-order meshes bene ts from the wide SIMD width on KNL machines. Combining multiple threads with SIMD on KNL achieves a 4.6x speedup over the baseline, with assembly timings faster than that observed on Haswell architecture. The computational workload of higher-order meshes, therefore, seems ideally suited for the many-core architecture and justi es further exploration of higher-order on NGP platforms. A Trilinos/Tpetra-based multi-threaded GMRES preconditioned by symmetric Gauss Seidel (SGS) represents the core solver infrastructure for the low-Mach advection/diffusion implicit solves. The threaded solver stack has been tested on small problems on NREL's Peregrine system using the newly developed and deployed Kokkos-view/SIMD kernels. fforts are underway to deploy the Tpetra-based solver stack on NERSC Cori system to benchmark its performance at scale on KNL machines.

97 MATHEMATICS AND COMPUTING↗