Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Spin-unrestricted random-phase approximation with range separation: Benchmark on atomization energies and reaction barrier heights

We consider several spin-unrestricted random-phase approximation (RPA) variants for calculating correlation energies, with and without range separation, and test them on datasets of atomization energies and reaction barrier heights. We show that range separation greatly improves the accuracy of all RPA variants for these properties. Moreover, we show that a RPA variant with exchange, hereafter referred to as RPAx-SO2, first proposed by Szabo and Ostlund [J. Chem. Phys. 67, 4351 (1977)] in a spin-restricted closed-shell formalism, and extended here to a spin-unrestricted formalism, provides on average the most accurate range-separated RPA variant for atomization energies and reaction barrier heights. Since this range-separated RPAx-SO2 method had already been shown to be among the most accurate range-separated RPA variants for weak intermolecular interactions [J. Toulouse et al., J. Chem. Phys. 135, 084119 (2011)], this works confirms range-separated RPAx-SO2 as a promising method for general chemical applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Proposed Semi-Analytic Benchmark for Coupled Neutronics/Thermal-Hydraulics Feedback in Multiphysics Simulations

The past decade has seen considerable advancements in multiscale and multiphysics simulations that account for nonlinear effects of feedback between different physical processes within a single calculation. One area of particular interest has been multiphysics simulations that include both neutronics and thermal-hydraulics effects to accurately model the thermal feedback effects present in nuclear reactors. During this time, many groups have successfully modeled thermal feedback effects by coupling a variety of different types of neutron transport and thermal-hydraulic solvers together. However, formal verification and validation of these coupled code systems has proven challenging due to a lack of benchmark problems with well-characterized reference solutions. One approach is to confirm gross energy balance using bulk coolant properties (outlet temperature/enthalpy) for code verification purposes. Alternatively, code-to-code comparisons of results for a predefined reference/challenge problem have been used to establish reasonability of local results (neutron flux, heating, enthalpy rise) for various implementations, for example the VERA Core Physics Progression Problems. While community solutions are valuable for assessing the relative performance and fidelity of different implementations, they are not guaranteed to provide a measure of the absolute accuracy of a given implementation. In fact, these code-to-code comparisons can give a false sense of confidence by masking the effects of errors or approximations that are common to all of the solution methods tested. This is a particular concern when many methods derive from a common approach, such as Picard iteration. To this end, an analytical benchmark would be very valuable for verifying individual coupled physics implementations, as well as for providing a formal assessment of algorithm accuracy and sensitivity to model approximations such as mesh size and number of convergence iterations. However, creation of an analytical benchmark is difficult due to the complex nature of the eigenvalue form of the neutron transport equation (which does not permit a simple analytical solution for non-trivial cases) as well as the variety of different empirical closure relationships used in thermal-hydraulic modeling. In this paper we propose a benchmark for coupled neutronics/thermal-hydraulics simulations. The proposed benchmark overcomes the challenges associated with a multiphysics benchmark problem by using a fixed-source (rather than eigenvalue) formulation of the neutron transport equation and limiting fluid properties to the single-phase regime where the density and temperature of the coolant are related to enthalpy by a known relationship, while still preserving significant nuclear/thermal feedback effects within the simplified problem. The new benchmark is easy to simulate using existing coupled physics implementations, and allows for a direct comparison with a reference solution, as provided in this summary.

42 ENGINEERING↗

New Whole-House Solutions Case Study: Evaluating Through-Wall Air Transfer Fans, Pittsburgh, Pennsylvania

In this project, Building America team IBACOS performed field testing in a new construction unoccupied test house in Pittsburgh, Pennsylvania, to evaluate heating, ventilating, and air conditioning (HVAC) distribution systems during heating, cooling, and midseason conditions. The team evaluated a market-available through-wall air transfer fan system that provides air to the bedrooms.The relative ability of this system was considered with respect to relevant Air Conditioning Contractors of America and ASHRAE standards for house temperature uniformity and stability.

50% Building America Benchmark↗

RF-THERMAL COMBINED SIMULATIONS OF A SUPERCONDUCTING HOM COAXIAL COUPLER

To benchmark a multi-physics code VORPAL developed by Tech-X, the High Order Mode (HOM) coaxial coupler design implemented in Jefferson Lab?s 12GeV upgrade cryomodules is analyzed by use of commercial codes, such as ANSYS, HFSS and Microwave Studio. Testing data from a Horizontal Test Bench (HTB) experiment on a dual-cavity prototype are also utilized in the verification of simulation results. The work includes two stages: first, the HOM feedthrough that has a high RRR niobium probe and sapphire insulator is analyzed for the RF-thermal response when there is travelling wave passing through; second, the HTB testing condition is simulated and results from simulation are compared to thermal measurements from HTB tests. The analyses are of coupled-field nature and involve highly nonlinear temperature dependent thermal conductivities and electric resistivities for the eight types of materials used in the design. Accuracy and efficiency are the main factors in evaluation of the performance of the codes.

43 PARTICLE ACCELERATORS↗

A1.5 Fusion Performance

Analysis and radiation hydrodynamics simulations for expected high-gain fusion target performance on a demonstration 1-GWe Laser Inertial Fusion Energy (LIFE) power plant in the mid-2030s timeframe are presented. The required laser energy driver is 2.2 MJ at a 0.351-{micro}m wavelength, and a fusion target gain greater than 60 at a repetition rate of 16 Hz is the design goal for economic and commercial attractiveness. A scaling-law analysis is developed to benchmark the design parameter space for hohlraum-driven central hot-spot ignition. A suite of integrated hohlraum simulations is presented to test the modeling assumptions and provide a basis for a near-term experimental resolution of the key physics uncertainties on the National Ignition Facility (NIF). The NIF is poised to demonstrate ignition by 2012 based on the central hot spot (CHS) mode of ignition and propagating thermonuclear burn [1]. This immediate prospect underscores the imperative and timeliness of advancing inertial fusion as a carbon-free, virtually limitless source of energy by the mid-21st century to substantially offset fossil fuel technologies. To this end, an intensive effort is underway to leverage success at the NIF and to provide the foundations for a prototype 'LIFE.1' engineering test facility by {approx}2025, followed by a commercially viable 'LIFE.2' demonstration power plant operating at 1 GWe by {approx}2035. The current design goal for LIFE.2 is to accommodate {approx}2.2 MJ of laser energy (entering the high-Z radiation enclosure or 'hohlraum') at a 0.351-{micro}m wavelength operating at a repetition rate of 16 Hz and to provide a fusion target yield of 132 MJ. To achieve this design goal first requires a '0-d' analytic gain model that allows convenient exploration of parameter space and target optimization. This step is then followed by 2- and 3-dimensional radiation-hydrodynamics simulations that incorporate laser beam transport, x-ray radiation transport, atomic physics, and thermonuclear burn [2]. These simulations form the basis for assessing the susceptibility to hydrodynamic instability growth, target performance margins, laser backscatter induced by plasma density fluctuations within the hohlraum, and the threat spectrum emerging from the igniting capsule, e.g., spectra, fluences and anisotropy of the x rays and ions, for input into the chamber survivability calculations. The simulations follow the guidelines of a 'point design' methodology, which formally designates a well-defined milestone in concept development that meets established criteria for experimental testing. In Section 2, the 0-d analytic gain model to survey gain versus laser energy parameter space is discussed. Section 3 looks at the status of integrated hohlraum simulations and the needed improvements in laser-hohlraum coupling efficiency to meet the LIFE.2 threshold (net) target gain of {approx}60. Section 4 considers advanced hohlraum designs to well exceed the LIFE.2 design goal for satisfactory performance margins. We summarize in Sec. 5.

42 ENGINEERING↗

Final Report for CRADA SC16/01880.00

In this project, Sandia National Laboratories (SNL) and Rigetti Quantum Computing (RQC) collaborated to test and evaluate (T&E) an 8-qubit quantum information processor developed by RQC. SNL provided quantum circuits and data analysis protocols to benchmark the performance of the device. These protocols included gate-set tomography (GST) on 1- and 2-qubit subsystems, as well as more advanced protocols for characterizing crosstalk and drift. RQC provided high- and low-level access to the 8-qubit device, via direct collaboration: SNL was able to specify T&E experiments as lists of quantum circuits, delivered to RQC via email, and RQC then ran these experiments and delivered the resulting data back to SNL for analysis. The collaboration characterized the performance of all 1-qubit gates on all 8 qubits, and a sample 2-qubit gate on one pair of qubits. Extensive investigation of crosstalk produced nondefinitive results, and revealed significant drift that interfered with crosstalk detection. Drift was analyzed. As a result of this collaboration, SNL was able to test protocols for crosstalk and drift, and improve them in light of experimental data, while RQC was able to learn about the performance of their device and improve it by debugging.

Blume-Kohout, Robin↗

Semi-Analytical Benchmarks for MCNP6

Code verification is an extremely important process that involves proving or disproving the validity of code algorithms by comparing them against analytical results of the underlying physics or mathematical theory on which the code is based. Monte Carlo codes such as MCNP6 must undergo verification and testing upon every release to ensure that the codes are properly simulating nature. Specifically, MCNP6 has multiple sets of problems with known analytic solutions that are used for code verification. Monte Carlo codes primarily specify either current boundary sources or a volumetric fixed source, either of which can be very complicated functions of space, energy, direction and time. Thus, most of the challenges with modeling analytic benchmark problems in Monte Carlo codes come from identifying the correct source definition to properly simulate the correct boundary conditions. The problems included in this suite all deal with mono-energetic neutron transport without energy loss, in a homogeneous material. The variables that differ between the problems are source type (isotropic/beam), medium dimensionality (infinite/semi-infinite), etc.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Using Likwid and Byfl to Benchmark Hardware Performance

This paper outlines a benchmarking study conducted during my internship at LANL, focusing on CPU (Computer Processing Unit) and program performance assessment. The primary goal was to gather memory access data using three methods across five polybench kernels The data gathered would then be used to compare and contrast to one another and calculate operational intensity for performance comparisons. Benchmarking tools like Byfl and Likwid were employed, with Byfl offering hardware-independent data through LLVM compiler communication and Likwid directly interacting with computer hardware. The study considered various benchmarking factors, including optimization levels, Big O notation ((n)), CPU diversity and specific kernel equations. Big O notation was utilized to simplify code complexity, with detailed breakdwons of operations and memory components for each polybench application. Specific O(n) equations enabled nuanced kernel compariosns, facilitating the identification of performance variations. CPU efficiency assessments were conducted using Likwid tests on two CPUs. The central focus on code optimization aimed at achieving higher speeds and reduced memory usage through streamlined code. Future work propsoes creating a roofline model, synthesizing benchmarking data into a comprehensive data graph to assist in optimizing code and improving hardware performance. The potential impact on the laboratory or national mission was underscored, emphasizing the importance of optimizing applications and hardware to conserve resources and accelerate program execution. The specific relevance to LANL’s operations in math-intensive fields such as Nuclear Fission, Space Exploration, and Nanotechnology highlights the necessity of efficient benchmarking for resource conservation and proram speed. Overall, this study contributes to the understanding of CPU and program performance, providing insights for future optimization efforts in a laboratory setting

97 MATHEMATICS AND COMPUTING↗

A TRACER METHOD FOR COMPUTING TYPE IA SUPERNOVA YIELDS: BURNING MODEL CALIBRATION, RECONSTRUCTION OF THICKENED FLAMES, AND VERIFICATION FOR PLANAR DETONATIONS

We refine our previously introduced parameterized model for explosive carbon–oxygen fusion during thermonuclear Type Ia supernovae (SNe Ia) by adding corrections to post-processing of recorded Lagrangian fluid-element histories to obtain more accurate isotopic yields. Deflagration and detonation products are verified for propagation in a medium of uniform density. A new method is introduced for reconstructing the temperature–density history within the artificially thick model deflagration front. We obtain better than 5% consistency between the electron capture computed by the burning model and yields from post-processing. For detonations, we compare to a benchmark calculation of the structure of driven steady-state planar detonations performed with a large nuclear reaction network and error-controlled integration. We verify that, for steady-state planar detonations down to a density of 5 × 10{sup 6} g cm{sup −3}, our post-processing matches the major abundances in the benchmark solution typically to better than 10% for times greater than 0.01 s after the passage of the shock front. As a test case to demonstrate the method, presented here with post-processing for the first time, we perform a two-dimensional simulation of a SN Ia in the scenario of a Chandrasekhar-mass deflagration–detonation transition (DDT). We find that reconstruction of deflagration tracks leads to slightly more complete silicon burning than without reconstruction. The resulting abundance structure of the ejecta is consistent with inferences from spectroscopic studies of observed SNe Ia. We confirm the absence of a central region of stable Fe-group material for the multi-dimensional DDT scenario. Detailed isotopic yields are tabulated and change only modestly when using deflagration reconstruction.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

Fuel Cell Technology Status Analysis Project: Partnership Opportunities (Fact Sheet)

This fact sheet describes National Renewable Energy Laboratory's (NREL's) Fuel Cell Technology Status Analysis Project. NREL is seeking fuel cell industry partners from the United States and abroad to participate in an objective and credible analysis of commercially available fuel cell products to benchmark the current state of the technology and support industry growth. Participating fuel cell developers share price information about their fuel cell products and/or raw fuel cell test data related to operations, maintenance, and safety with NREL via the Hydrogen Secure Data Center (HSDC). The limited-access, off-network HSDC houses the data and analysis tools to protect proprietary information. NREL shares individualized data analysis results as detailed data products (DDPs) with the partners who supplied the data. Aggregated results are published as composite data products (CDPs), which show the technology status without identifying individual companies. The CDPs are a primary benchmarking tool for the U.S. Department of Energy and other stakeholders interested in tracking the status of fuel cell technologies. They highlight durability advancements, identify areas for continued development, and help set realistic price expectations at small-volume production.

08 HYDROGEN↗

Comparison of Irradiated and Unirradiated Graphite Oxidation Performance

This work examines the oxidation behavior of NBG-25 graphite using irradiated specimens and (not irradiated) companion specimens from the Advanced Graphite Creep (AGC) Experiment. Irradiated and companion specimens were quartered, split into four small samples, to enable four oxidation test runs for each (0.5 inch diameter by 0.25 inch tall) piggyback button obtained from the AGC Experiment inventory. These split samples were oxidized in air in a thermogravimetric analyzer (TGA) and benchmarked against observations with separately sourced same-grade specimens of three geometries oxidized either in the TGA or in a vertical furnace built and operated to satisfy the specifications of ASTM D7542. The study considers both irradiation damage and relief of damage by thermal annealing. A range of isothermal oxidation temperatures were tested for specimens exposed to a similar irradiation environment, nominally 6.5 dpa at 650°C. To assess the dose dependency of observed oxidation behavior, specimens with a range of irradiation exposures (up to 6.8 dpa) were tested at the single oxidation temperature of 650°C. In the conventional analysis (rate determined over the 5-10% mass loss range) any annealing effects appear to be negligible, while irradiation to ~6.5 dpa may double or triple the subsequent oxidation rate. However, examination of rate with extent of reaction (over incremental ranges from initial onset up to 5% mass loss) illustrates that (at least for ~6.5 dpa) irradiation initially inhibits oxidation. Slower rates of oxidation than companion split samples are clearly indicated across all oxidation temperatures tested up to ~0.5% mass loss. Over the range of 0.5-1% mass loss, regardless of normalization strategy, there is no statistically meaningful difference in oxidation rate. However, beyond 0.5% mass loss oxidation of the irradiated sample becomes progressively faster than the companion sample (up to the 10% mass loss level observed).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Concavity-based local erosion and sphere-size-based local dilation applied to lithium-ion battery electrode microstructures for particle identification

Performance metrics of lithium-ion batteries can be extracted from the analysis of electrode microstructures nanoscale imaging. The characterization workflow can involve a challenging particle identification, or instance segmentation, step. In this work, we propose a new identification method based on an original transformation: a sphere-size-based local dilation followed by a concavity-based local erosion, that is local morphology closing. The new transformation is much more efficient than the global morphology closing, with correct identification achieved with only 1.7 % dilation volume and 2.6 % erosion volume on a test geometry, compared to 39.2 % and more than 50 %, respectively, with its global counterpart. The new method has been then benchmarked versus other identification algorithms (watershed and pseudo coulomb repulsive field) on a real electrode microstructure with equal or better segmentation achieved.

25 ENERGY STORAGE↗

Small angle neutron scattering analyses and high temperature mechanical properties of nano-structured oxide dispersion strengthened steels produced via cryomilling

Three oxide dispersion-strengthened (ODS) steels are produced in order to investigate the effect of the mechanical alloying (MA) temperature on the microstructural evolution and high temperature mechanical properties. The microstructural evolution with different MA conditions is examined using small angle neutron scattering. As the MA temperature decreases, the density of the nanoclusters below 10 nm increases and their mean diameter decreases. A low temperature during MA leads to a high strength in the compression tests performed at 500 *C; however, this effect disappears in testing at 900 *C. The milling process at *70 *C exhibits excellent high fracture toughness, which is better than the benchmark material 14YWT-SM10. However, the *150 *C milling process results in significantly worse fracture toughness properties. The reasons for this strong temperature dependency are discussed.

Oxide dispersion strengthened alloy, Fracture toug↗

Estimate long-term impact on battery degradation by considering electric vehicle real-world end-use factors

Many estimates of battery capacity degradation are based on accelerated lab tests that involve charge-discharge cycles or rely on data or electrochemical modeling. These methods are reasonable for technology benchmarking but rarely consider real-world end-use factors. To address this issue, this study develops the Battery Run-down under Electric Vehicle Operation (BREVO) model. It links the driver's travel pattern to physics-based battery degradation and powertrain energy consumption models. The model simulates the impacts of charging behavior, charging rate, driving patterns, and multiple energy management modules on battery capacity degradation. It finds that, over a 10-year timespan, firstly, for a random driver situated in the New England area, daily direct-current fast charging (60 kW) could lead to up to 22% less battery capacity when compared to daily Level-1 charging (1.8 kW). Second, the battery thermal management system can delay battery degradation by approximately 0.5% in the New England area. Third, warmer ambient temperatures enhance BEV battery usage. The model indicates that the battery capacity in the Los Angeles area is 6% higher than that in the New England area. The BREVO model provides crucial information for consumers and BEV manufacturers on range anxiety, BEV battery design, and decision support of battery warranty.

25 ENERGY STORAGE↗

Using artificial intelligence to detect human errors in nuclear power plants: A case in operation and maintenance

Human error (HE) is an important concern in safety-critical systems such as nuclear power plants (NPPs). HE has played a role in many accidents and outage incidents in NPPs. Despite the increased automation in NPPs, HE remains unavoidable. Hence, the need for HE detection is as important as HE prevention efforts. In NPPs, HE is rather rare. Hence, anomaly detection, a widely used machine learning technique for detecting rare anomalous instances, can be repurposed to detect potential HE. In this study, we develop an unsupervised anomaly detection technique based on generative adversarial networks (GANs) to detect anomalies in manually collected surveillance data in NPPs. More specifically, our GAN is trained to detect mismatches between automatically recorded sensor data and manually collected surveillance data, and hence, identify anomalous instances that can be attributed to HE. We test our GAN on both a real-world dataset and an external dataset obtained from a testbed, and we benchmark our results against state-of-the-art unsupervised anomaly detection algorithms, including one-class support vector machine and isolation forest. Our results show that the proposed GAN provides improved anomaly detection performance. Our study is promising for the future development of artificial intelligence based HE detection systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Design and characterization of zero magnetic field chambers for high efficiency neutron polarization transport

Several methods of polarized neutron scattering call for a zero magnetic field region to reduce magnetic field integral aberrations while preserving the neutron polarization. Though the design for large angle neutron scattering has been presented in various places, the design characterization and tuning has not been discussed before. In this report, the tuning procedure will be discussed with both neutron polarization transport and utilization of fluxgate magnetometers. As a tuning procedure, polarized neutrons are sensitive to any local field distortions along all trajectories within the beam, but the process is slow. With fluxgates, the entire region cannot be tested, but very fast and precise measurements can be made in accessible regions of interest. Furthermore, we would like to benchmark the usage of fluxgates as a fast tuning probe compared with polarization measurements made with neutrons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Probing atomic physics at ultrahigh pressure using laser-driven implosions

Abstract Spectroscopic measurements of dense plasmas at billions of atmospheres provide tests to our fundamental understanding of how matter behaves at extreme conditions. Developing reliable atomic physics models at these conditions, benchmarked by experimental data, is crucial to an improved understanding of radiation transport in both stars and inertial fusion targets. However, detailed spectroscopic measurements at these conditions are rare, and traditional collisional-radiative equilibrium models, based on isolated-atom calculations and ad hoc continuum lowering models, have proved questionable at and beyond solid density. Here we report time-integrated and time-resolved x-ray spectroscopy measurements at several billion atmospheres using laser-driven implosions of Cu-doped targets. We use the imploding shell and its hot core at stagnation to probe the spectral changes of Cu-doped witness layer. These measurements indicate the necessity and viability of modeling dense plasmas with self-consistent methods like density-functional theory, which impact the accuracy of radiation transport simulations used to describe stellar evolution and the design of inertial fusion targets.

74 ATOMIC AND MOLECULAR PHYSICS↗