Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Development and Experimental Benchmark of Simulations to Predict Used Nuclear Fuel Cladding Temperatures during Drying and Transfer Operations

Radial hydride formation in high-burnup used fuel cladding has the potential to radically reduce its ductility and suitability for long-term storage and eventual transport. To avoid this formation, the maximum post-reactor temperature must remain sufficiently low to limit the cladding hoop stress, and so that hydrogen from the existing circumferential hydrides will not dissolve and become available to re-precipitate into radial hydrides under the slow cooling conditions during drying, transfer and early dry-cask storage. The objective of this research is to develop and experimentallybenchmark computational fluid dynamics simulations of heat transfer in post-pool-storage drying operations, when high-burnup fuel cladding is likely to experience its highest temperature. These benchmarked tools can play a key role in evaluating dry cask storage systems for extended storage of high-burnup fuels and post-storage transportation, including fuel retrievability. The benchmarked tools will be used to aid the design of efficient drying processes, as well as estimate variations of surface temperatures as a means of inferring helium integrity inside the canister or cask. This work will be conducted effectively because the principal investigator has experience developing these types of simulations, and has constructed a test facility that can be used to benchmark them.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Statistical Hypothesis Testing using CNN Features for Synthesis of Adversarial Counterexamples to Human and Object Detection Vision Systems

Validating the correctness of human detection vision systems is crucial for safety applications such as pedestrian collision avoidance in autonomous vehicles. The enormous space of possible inputs to such an intelligent system makes it difficult to design test cases for such systems. In this report, we present our tool MAYA that uses an error model derived from a convolutional neural network (CNN) to explore the space of images similar to a given input image, and then tests the correctness of a given human or object detection system on such perturbed images. We demonstrate the capability of our tool on the pre-trained Histogram-of-Oriented-Gradients (HOG) human detection algorithm implemented in the popular OpenCV toolset and the Caffe object detection system pre-trained on the ImageNet benchmark. Our tool may serve as a testing resource for the designers of intelligent human and object detection systems.

97 MATHEMATICS AND COMPUTING↗

DRACS thermal performance evaluation for FHR

Direct Reactor Auxiliary Cooling System (DRACS) is a passive decay heat removal system proposed for the Fluoride-salt-cooled High-temperature Reactor (FHR) that combines coated particle fuel and a graphite moderator with a liquid fluoride salt as the coolant. The DRACS features three coupled natural circulation/convection loops, relying completely on buoyancy as the driving force. These loops are coupled through two heat exchangers, namely, the DRACS Heat Exchanger and the Natural Draft Heat Exchanger. In addition, a fluidic diode is employed to minimize the parasitic flow into the DRACS primary loop and correspondingly the heat loss to the DRACS during normal operation of the reactor, and to keep the DRACS ready for activation, if needed, during accidents. To help with the design and thermal performance evaluation of the DRACS, a computer code using MATLAB has been developed. This code is based on a one-dimensional formulation and its principle is to solve the energy balance and integral momentum equations. By discretizing the DRACS system in the axial direction, a bulk mean temperature is assumed for each mesh cell. The temperatures of all the cells, as well as the mass flow rates in the DRACS loops, are predicted by solving the governing equations that are obtained by integrating the energy conservation equation over each cell and integrating the momentum conservation equation over each of the DRACS loops. In addition, an intermediate heat transfer loop equipped with a pump has also been modeled in the code. This enables the study of flow reversal phenomenon in the DRACS primary loop, associated with the pump trip process. Experimental data from a High-Temperature DRACS Test Facility (HTDF) are not available yet to benchmark the code. A preliminary code validation is performed by using natural circulation experimental data available in the literature, which are as closely relevant as possible. The code is subsequently applied to the HTDF that is under construction at the Ohio State University.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Additive Manufacturing for Powering the Blue Economy Applications: A Tidal Turbine Blade Case Study: Preprint

As the marine renewable energy industry continues to expand, innovation in the manufacturing space must grow accordingly to reduce costs and ensure the economic feasibility of new technologies. Additive manufacturing, more commonly known as 3D printing, provides an alternative for rapid prototyping of marine hydrokinetic technologies, particularly supporting Powering the Blue Economy initiatives of the U.S. Department of Energy Water Power Technologies Office. This study explores the application of additive manufacturing in the development of marine hydrokinetic structures, focusing on material and printing method selection, design, and analysis of a 3D-printed spar for an axial-flow tidal turbine blade. Corrosion-resistant metals were deemed ideal due to the loads and harsh marine environment the blade would experience. Laser metal deposition methods were determined to be the most effective and scalable for the considered scale. The designed spar adapts its geometry to the blade - a feature uniquely suited to additive manufacturing - and is intended to serve as the blade's primary structural component. A finite element model was used to study stresses and deformations under loading conditions. The spar was manufactured using 316L stainless steel through direct energy deposition, and defects were assessed and recorded. Future efforts will include mechanical testing of the spar. This research establishes a benchmark process for using additive manufacturing in developing marine hydrokinetic structures, paving the way for future optimization and techno-economic analysis.

additive manufacturing↗

Concordant Mode Approach (CMA): Vibrational Analysis of New and Upgraded Intermolecular Benchmarks for Noncovalent Bonding

The Concordant Mode Approach (CMA) is a novel method that offers tremendous potential for increasing the system size and the level of theory attainable in quantum chemical computations of molecular vibrational frequencies. To investigate the extension of CMA to intermolecular vibrations, computations with coupled cluster singles and doubles with perturbative triples theory [CCSD(T)] using two augmented correlation-consistent polarized-valence triple-ζ basis sets (aug-cc-pVTZ or h-aug-ccpVTZ) were performed on 17 prototypical loosely bound complexes of hydrogen-bonded, dispersion, and mixed character. These Level A results provide new and upgraded benchmarks for noncovalent bonding and a severe test for CMA vibrational analyses. The Level A target frequencies were recovered remarkably well using second-order Møller−Plesset perturbation theory (MP2) with h-aug-cc-pVTZ for generating the underlying (Level B) normal modes of the CMA scheme. Employing this Level B within the lowest-rung CMA-0A method reproduces the 435 benchmark frequencies with a mean absolute error (MAE) of 0.23 cm −1 and a corresponding standard deviation (σ) of 0.84 cm −1 ; strikingly, the corresponding subset of 106 interfragment frequencies exhibits MAE = 0.34 cm −1 and σ = 0.90 cm −1 . Subsequent application of the higher-rung CMA-2A scheme eliminates all outliers and reduces the overall MAE to a minuscule 0.08 cm −1 with the inclusion of only 3.0% of the off-diagonal couplings not accounted for by CMA-0A. Accordingly, the highly efficient CMA methodology proves to be robust even for vibrations on flat potential energy surfaces.

Aromatic compounds↗

Hyundai Avante LPi hybrid level 1 testing report

In collaboration with the Korea Automotive Technology Institute (KATECH), the Korean market only Hyundai Avante LPi Hybrid was purchased and imported to ANL's Advanced Powertrain Research Facility for vehicle-level testing. Data was acquired during testing using non-intrusive sensors, vehicle network information, and facilities equipment (emissions and dynamometer). Standard drive cycles, performance cycles, steady-state cycles, and A/C usage cycles were conducted. The major results are shown in this report. Given the benchmark nature of this assessment, the majority of the testing was done over standard regulatory cycles and sought to obtain a general overview of how the vehicle performs. These cycles include the US FTP cycle (Urban) and Highway Fuel Economy Test cycle as well as the US06, a more aggressive supplemental regulatory cycle. To assess the impacts of more aggressive driving, the LA92 cycle and a UDDS scaled by a factor 1.2x cycles were also included in the testing plan. Data collection for this testing was kept at a fairly high level and includes emissions and fuel measurements from an exhaust emissions bench, high-voltage and accessory current/voltage from a DC power analyzer, and CAN bus data such as engine speed. The following sections will seek to explain some of the basic operating characteristics of the Avante LPi Hybrid and provide insight into unique features of its operation and design. Figure 1 shows the test vehicle in Argonne's soak room.

33 ADVANCED PROPULSION SYSTEMS↗

Benchmark for evaluation and validation of reactor simulations (BEAVRS)

Advances in parallel computing have made possible the development of high-fidelity tools for the design and analysis of nuclear reactor cores, and such tools require extensive verification and validation. This paper introduces BEAVRS, a new multi-cycle full-core Pressurized Water Reactor (PWR) depletion benchmark based on two operational cycles of a commercial nuclear power plant that provides a detailed description of fuel assemblies, burnable absorbers, in-core fission detectors, core loading patterns, and numerous in-vessel components. This benchmark enables analysts to develop extremely detailed reactor core models that can be used for testing and validation of coupled neutron transport, thermal-hydraulics, and fuel isotopic depletion. The benchmark also provides measured reactor data for Hot Zero Power (HZP) physics tests, boron letdown curves, and three-dimensional in-core flux maps from fifty-eight instrumented assemblies. Initial comparisons between calculations performed with MIT's OpenMC Monte Carlo neutron transport code and measured cycle 1 HZP test data are presented, and these results display an average deviation of approximately 100 pcm for the various critical configurations and control rod worth measurements. Computed HZP radial fission detector flux maps also agree reasonably well with the available measured data. All results indicate that this benchmark will be extremely useful in validation of coupled-physics codes and uncertainty quantification of in-core physics computational predictions. The detailed BEAVRS specification and its associated data package is hosted online at the MIT Computational Reactor Physics Group web site (http://crpg.mit.edu/), where future revisions and refinements to the benchmark specification will be made publicly available. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Characterization of Interconnects

Combined-accelerated stress testing (C-AST) simultaneously combines stress factors of the natural environment (including UV radiation, temperature, humidity, electrical current, and external mechanical force) into a single test that requires fewer modules, fewer chambers, and makes it possible to discover weaknesses in new designs that are not known a-priori. C-AST reduces risk, accelerates time to market, and improves bankability by reducing costly overdesign using test levels not exceeding those seen in the natural environment. This project seeks to evaluate strengths and weaknesses of modern cell interconnect designs with combined-accelerated stress testing (C-AST) to screen multiple climates along with finite element and failure analysis to determine the potential for a 50-year life. Supporting this, we seek to develop methods of characterization to assess the degradation of interconnects, enable predictive rate models with material forensics and FEA and show C-AST's ability to find interconnect failures and benchmark it relative to other accelerated stress test methods like temperature cycling and cyclic dynamic mechanical loading. Examples of modern interconnect designs covered are Canadian Solar Hetero Technology ribbon enabling closer cell interconnections, SmartWire (eg. Meyer-Berger technology), and shingled cells with new interconnect materials.

C-AST↗

Verification and validation of the open-source plasma fluid code: Zapdos

Zapdos is an open-source finite element plasma fluid solver based on the MOOSE multiphysics framework. This paper outlines Zapdos verification, benchmarking, and validation efforts for 1D and 2D RF capacitively coupled plasma discharge models for mid-range pressures (0.1 - 1 Torr). The verification process involved using the method of manufactured solutions to assess Zapdos spatial and temporal error convergence. L2 errors ranged from 10 -2 to 10 -4 , while the convergence’s slope were in agreement with the predicted slopes for the tested variable and time integration orders. The benchmarking process involved comparisons to previously results from the validated finite element code, LSODI. These works included 1D and 2D simulations for a range of plasma parameters (densities, temperatures, voltage, etc.). For the 1D cases, Zapdos and LSODI results were in very good agreement. In the 2D cases, variable behaviors matched, with slight discrepancies in peak values. The validation process involved comparisons to experimental works including electron density measurements by microwave interferometry and metastable density measurements by planar laser-induced fluorescence imaging. Results shown reasonable agreement at higher pressure, with results starting to diverge at low pressures. Furthermore, probable causes for this diverges are the limitation of the fluid assumption for plasmas at low pressure, or the need for more robust boundary conditions. Overall, Zapdos shown reasonable results for the verification, benchmarking, and validation efforts, and Zapdos can be downloaded at https://github.com/shannon-lab/zapdos.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Deterministic Modeling of the High Temperature Test Reactor with DRAGON-HEXPEDITE

The Idaho National Laboratory (INL) is tasked with the development of reactor physics analysis capability of the Next Generation Nuclear Power (NGNP) project. In order to examine the INL’s current prismatic reactor analysis tools, the project is conducting a benchmark exercise based on modeling the High Temperature Test Reactor (HTTR). This exercise entails the development of a model for the initial criticality, a 19 fuel column thin annular core, and the fully loaded core critical condition with 30 fuel columns. Special emphasis is devoted to physical phenomena and artifacts in HTTR that are similar to phenomena and artifacts in the NGNP base design. The DRAGON code is used in this study since it offers significant ease and versatility in modeling prismatic designs. DRAGON can generate transport solutions via Collision Probability (CP), Method of Characteristics (MOC) and Discrete Ordinates (Sn). A fine group cross-section library based on the SHEM 281 energy structure is used in the DRAGON calculations. The results from this study show reasonable agreement in the calculation of the core multiplication factor with the MC methods, but a consistent bias of 2-3% with the experimental values is obtained. This systematic error has also been observed in other HTTR benchmark efforts and is well documented in the literature. The ENDF/B VII graphite and U 235 cross sections appear to be the main source of the error. The isothermal temperature coefficients calculated with the fully loaded core configuration agree well with other benchmark participants but are 40% higher than the experimental values. This discrepancy with the measurement partially stems from the fact that during the experiments the control rods were adjusted to maintain criticality, whereas in the model, the rod positions were fixed. In addition, this work includes a brief study of a cross section generation approach that seeks to decouple the domain in order to account for neighbor effects. This spectral interpenetration is a dominant effect in annular HTR physics. This analysis methodology should be further explored in order to reduce the error that is systematically propagated in the traditional generation of cross sections.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmarking the performance of a high-Q cavity qudit using random unitaries

High-coherence cavity resonators are excellent resources for encoding quantum information in higher-dimensional Hilbert spaces, moving beyond traditional qubit-based platforms. A natural strategy is to use the Fock basis to encode information in qudits. One can perform quantum operations on the cavity mode qudit by coupling the system to a non-linear ancillary transmon qubit. However, the performance of the cavity-transmon device is limited by the noisy transmons. It is, therefore, important to develop practical benchmarking tools for these qudit systems in an algorithm-agnostic manner. We gauge the performance of these qudit platforms using sampling tests such as the heavy output generation test as well as the linear cross-entropy benchmark, by way of simulations of such a system subject to realistic dominant noise channels. We use selective number-dependent arbitrary phase and unconditional displacement gates as our universal gateset. Our results show that contemporary transmons comfortably enable controlling a few tens of Fock levels of a cavity mode. This framework allows benchmarking even higher dimensional qudits as those become accessible with improved transmons.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Alternate Reductant Cold Cap Evaluation Furnace Phase II Testing

Savannah River Remediation (SRR) conducted a Systems Engineering Evaluation (SEE) to determine the optimum alternate reductant flowsheet for the Defense Waste Processing Facility (DWPF). Specifically, two proposed flowsheets (nitric–formic–glycolic and nitric–formic–sugar) were evaluated based upon results from preliminary testing. Comparison of the two flowsheets among evaluation criteria indicated a preference towards the nitric–formic–glycolic flowsheet. Further research and development of this flowsheet eliminated the formic acid, and as a result, the nitric–glycolic flowsheet was recommended for further testing. Based on the development of a roadmap for the nitric–glycolic acid flowsheet, Waste Solidification Engineering (WS-E) issued a Technical Task Request (TTR) to address flammability issues that may impact the implementation of this flowsheet. Melter testing was requested in order to define the DWPF flammability envelope for the nitric-glycolic acid flowsheet. The Savannah River National Laboratory (SRNL) Cold Cap Evaluation Furnace (CEF), a 1/12 th scale DWPF melter, was selected by the SRR Alternate Reductant project team as the melter platform for this testing. The overall scope was divided into the following sub-tasks as discussed in the Task Technical and Quality Assurance Plan (TTQAP): Phase I - A nitric–formic acid flowsheet melter test (unbubbled) to baseline the CEF cold cap and vapor space data to the benchmark melter flammability models; Phase II - A nitric–glycolic acid flowsheet melter test (unbubbled and bubbled) to: Define new cold cap reactions and global kinetic parameters in support of the melter flammability model development; Quantify off-gas surging potential of the feed; Characterize off-gas condensate for complete organic and inorganic carbon species. After charging the CEF with cullet from Phase I CEF testing, the melter was slurry-fed with glycolic flowsheet based SB6-Frit 418 melter feed at 36% waste loading and was operated continuously for 25 days. Process data was collected throughout testing and included melter operation parameters and off-gas chemistry. In order to generate off-gas data in support of the flammability model development for the nitric-glycolic flowsheet, vapor space steady state testing in the range of ~300-750°C was conducted under the following conditions, (i) 100% (nominal and excess antifoam levels) and 125% stoichiometry feed and (ii) with and without argon bubbling. Adjustments to feed rate, heater outputs and purge air flow were necessary in order to achieve vapor space temperatures in this range. Surge testing was also completed under nominal conditions for four days with argon bubbling and one day without argon bubbling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Comet whole-core solution to a stylized 3-dimensional pressurized water reactor benchmark problem with UO{sub 2}and MOX fuel

A stylized pressurized water reactor (PWR) benchmark problem with UO{sub 2} and MOX fuel was used to test the accuracy and efficiency of the coarse mesh radiation transport (COMET) code. The benchmark problem contains 125 fuel assemblies and 44,000 fuel pins. The COMET code was used to compute the core eigenvalue and assembly and pin power distributions for three core configurations. In these calculations, a set of tensor products of orthogonal polynomials were used to expand the neutron angular phase space distribution on the interfaces between coarse meshes. The COMET calculations were compared with the Monte Carlo code MCNP reference solutions using a recently published an 8-group material cross section library. The comparison showed both the core eigenvalues and assembly and pin power distributions predicated by COMET agree very well with the MCNP reference solution if the orders of the angular flux expansion in the two spatial variables and the polar and azimuth angles on the mesh boundaries are 4, 4, 2 and 2. The mean and maximum differences in the pin fission density distribution ranged from 0.28%-0.44% and 3.0%-5.5%, all within 3-sigma uncertainty of the MCNP solution. These comparisons indicate that COMET can achieve accuracy comparable to Monte Carlo. It was also found that COMET's computational speed is 450 times faster than MCNP. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An Autonomous MCP Bridge to Rucio: Enhancing Data Management Accessibility for High Energy Physics

The Rucio Data Management System [1] is an important tool used by High Energy Physics experiments, including those at Fermi National Accelerator Laboratory, to store and manage exabyte-scale scientific datasets. Despite its central role in coordinating data across globally distributed storage sites, Rucio's command line interface (CLI) presents a steep learning curve, and makes it difficult for scientists to navigate through. To solve this issue, a containerized Model Context Protocol (MCP) [2] server was built that connects Large Language Models directly to Rucio, allowing AI agents to handle data tasks by using simple, natural language rather than memorized terminal commands. The core engineering focus of this project was moving the server away from slow terminal commands that require text parsing and replacing them with a native Python Client API toolset and a planned REST API framework. Moving to the Python API handles data operations directly in memory, which helps clear up formatting errors, provides the AI with clean, structured JSON data and speeds up tool execution. To prove that the system actually works, a benchmarking pipeline was also built with various questions to test the AI across four different model configurations. The questions included finding data scopes, tracking down specific datasets, and checking replication rules. Through benchmarking, early runs showed that with raw terminal text, the model would get confused and stuck, whereas switching to the Python API to feed the AI clean, structured data yielded massive improvement. By creating an intelligent and autonomous bridge to a storage network, this project shows how AI can be implemented in scientific data management, which ultimately helps scientists at Fermilab spend less time sorting through data and more time focusing on their experiments and analysis.

Akella, Kashyap [William Rainey Harper Coll.]↗

Evaluation of the response to electrons and pions in the scintillating fiber and lead calorimeter for the future electron-ion collider

The performance of the Baby Barrel Electromagnetic Calorimeter (Baby BCAL) — a small-scale lead-scintillating-fiber (Pb/ScFi) prototype of the GlueX Barrel Electromagnetic Calorimeter (BCAL) — was tested in a dedicated beam campaign at the Fermilab Test Beam Facility (FTBF). This study provides a benchmark for the Pb/ScFi component of the future Barrel Imaging Calorimeter (BIC) in the ePIC detector at the Electron-Ion Collider (EIC). The detector response to electrons and pions was studied at beam energies between 4 and 10 GeV, extending previous GlueX tests to a higher energy regime. The calibrated detector exhibits good linearity within uncertainties, and its electron energy resolution meets EIC requirements. The data further constrain the constant term in the energy resolution to below 1.9%, improving upon previous constraints at lower energies. Simulations reproduce key features of the electron and pion data within the limitations of the collected dataset and the FTBF test environment. Electron-pion separation in the test beam setup was analyzed using multiple methods, incorporating varying degrees of beam-related effects. The inclusion of longitudinal shower profile information enhanced the separation performance, underscoring its relevance for the full-scale BIC in ePIC. These results provide essential benchmarks for the Pb/ScFi section of the future BIC, validating detector simulations and guiding optimization strategies for electron-pion discrimination.

47 OTHER INSTRUMENTATION↗

DYNA3D/ParaDyn Regression Test Suite Inventory

The following table constitutes an initial assessment of feature coverage across the regression test suite used for DYNA3D and ParaDyn. It documents the regression test suite at the time of preliminary release 16.1 in September 2016. The columns of the table represent groupings of functionalities, e.g., material models. Each problem in the test suite is represented by a row in the table. All features exercised by the problem are denoted by a check mark (√) in the corresponding column. The definition of “feature” has not been subdivided to its smallest unit of user input, e.g., algorithmic parameters specific to a particular type of contact surface. This represents a judgment to provide code developers and users a reasonable impression of feature coverage without expanding the width of the table by several multiples. All regression testing is run in parallel, typically with eight processors, except problems involving features only available in serial mode. Many are strictly regression tests acting as a check that the codes continue to produce adequately repeatable results as development unfolds; compilers change and platforms are replaced. A subset of the tests represents true verification problems that have been checked against analytical or other benchmark solutions. Users are welcomed to submit documented problems for inclusion in the test suite, especially if they are heavily exercising, and dependent upon, features that are currently underrepresented.

97 MATHEMATICS AND COMPUTING↗

Fit Fly: A Case Study of Interconnect Innovation through Parallel Simulation

To meet the demand for exascale-level performance from high-performance computing (HPC) interconnects, many system architects are turning to simulation results for accurate and reliable predictions of the performance of prospective technologies. Testing full-scale networks with a variety of benchmarking tools, including synthetic workloads and application traces, can give crucial insight into what ideas are most promising without needing to physically construct a test network. While flexible, however, this approach is extremely compute time intensive. We address this time complexity challenge through the use of large-scale, optimistic parallel simulation that ultimately leads to faster HPC network architecture innovations. In this paper we demonstrate this innovation capability through a real-world network design case study. Specifically, we have simulated and compared four extreme-scale interconnects: Dragonfly, Megafly, Slim Fly, and a new dual-rail-dual-plane variation of the Slim Fly network topology. We present this new variant of Slim Fly, dubbed Fit Fly, to show how interconnect innovation and evaluation-beyond what is possible through analytic methods-can be achieved through parallel simulation. We validate and compare the model with various network designs using the CODES interconnect simulation framework. By running large-scale simulations in a parallel environment, we are able to quickly generate reliable performance results that can help network designers break ground on the next generation of high-performance network designs.

High Performance Computing↗