Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

CATHARE calculations of Phenix ultimate natural convection test

The Phenix Sodium cooled Fast Reactor (SFR) started operation in 1973 and it was stopped in 2009. Before the reactor was definitively shutdown, in order to collect experimental data for code assessments in the frame of Generation IV an intensive program of ultimate tests was set up. Among these ultimate experiments, two thermal hydraulic tests were performed: an asymmetrical test consisting in a trip on one secondary pump and a natural convection test in the primary circuit. The natural convection test has been used for an international benchmark on system codes in the frame of the IAEA. The CATHARE code - initially developed for water cooled reactors and now extended for safety analyses for other kinds of reactors, including Sodium Fast Reactor - was used by CEA for this benchmark. The paper reminds briefly the Phenix reactor with the main physical parameters and the instrumentation used during the natural convection test. Main test results are also briefly reminded including the evolution of the core and the heat exchangers inlet and outlet temperatures, and some local temperature measurements. The main developments to perform CATHARE SFR computations and the strategy of system code assessment are presented. Then the CATHARE modelling of Phenix reactor is depicted and the various assumptions are pointed out. CATHARE encountered no problem to predict the initial nominal state. Afterwards, the whole transient scenario is calculated and CATHARE calculations are compared to the Phenix measurements. The global trend is rather well predicted by the CATHARE code. Nevertheless, due to complex flow phenomena occurring in large plena and components, the system code encountered physical limitations, leading to remaining discrepancies between code prediction and plant data. Various sensitivity calculations are presented and they bring partial answers. Additional analyses are in progress to understand more deeply the complex 3D phenomena involved during the different phases of the natural convection test. Additional work for coupling CATHARE system code and TRIO-U CFD code is in progress and will bring useful information to better understand the physical phenomena involved during the natural convection test and to improve system modeling for future SFR safety analysis. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Improving IMRT-plan quality with MLC leaf position refinement post plan optimization

Purpose: In intensity-modulated radiation therapy (IMRT) planning, reducing the pencil-beam size may lead to a significant improvement in dose conformity, but also increase the time needed for the dose calculation and plan optimization. The authors develop and evaluate a postoptimization refinement (POpR) method, which makes fine adjustments to the multileaf collimator (MLC) leaf positions after plan optimization, enhancing the spatial precision and improving the plan quality without a significant impact on the computational burden. Methods: The authors' POpR method is implemented using a commercial treatment planning system based on direct aperture optimization. After an IMRT plan is optimized using pencil beams with regular pencil-beam step size, a greedy search is conducted by looping through all of the involved MLC leaves to see if moving the MLC leaf in or out by half of a pencil-beam step size will improve the objective function value. The half-sized pencil beams, which are used for updating dose distribution in the greedy search, are derived from the existing full-sized pencil beams without need for further pencil-beam dose calculations. A benchmark phantom case and a head-and-neck (HN) case are studied for testing the authors' POpR method. Results: Using a benchmark phantom and a HN case, the authors have verified that their POpR method can be an efficient technique in the IMRT planning process. Effectiveness of POpR is confirmed by noting significant improvements in objective function values. Dosimetric benefits of POpR are comparable to those of using a finer pencil-beam size from the optimization start, but with far less computation and time. Conclusions: The POpR is a feasible and practical method to significantly improve IMRT-plan quality without compromising the planning efficiency.

60 APPLIED LIFE SCIENCES↗

Detection of Isotopes in Urban Source Search Gamma Spectra Using Hopfield Neural Network

Source search campaigns involve the measurement of consecutive background gamma-ray spectra obtained with a mobile detector-spectrometer, such as tellurium-doped sodium iodide NaI(Tl) scintillator detector-spectrometer. Counts are measured with NaI(Tl) detector in short acquisition intervals, such as one second. Detection of isotopes in search data is challenging because of the low signal-to-noise ratio (S/N) of the spectral lines and highly varying background due to naturally occurring radioactive material (NORM). In this work, we investigate the performance of the detection of orphan Cs-137, Am-241, and I-131 isotopes in a gamma ray data set obtained in a search survey. Isotopic detection is performed with a Hopfield Neural Network (HNN), which implements an auto-associative memory by matching incoming measurements to the closest one of its memory-stored signature patterns. HNN is trained on examples of spectra of calibrated isotopic sources with well-resolved spectral lines. During testing, HNN processes spectra with partially complete or distorted isotopic lines. The performance of the HNN detection algorithm is benchmarked with Precision, Recall, and F1 scores. Test results demonstrate the potential of HNN to detect the isotope of interest with high accuracy (F1 > 90%) for all isotopes in this study.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MC 2 -3: Multigroup Cross Section Generation Code for Fast Reactor Analysis

This paper presents the methods and performance of the MC2 -3 code, which is a multigroup cross-section generation code for fast reactor analysis, developed to improve the resonance self-shielding and spectrum calculation methods of MC2 -2 and to simplify the current multistep schemes generating region-dependent broad-group cross sections. Using the basic neutron data from ENDF/B data files, MC2 -3 solves the consistent P1 multigroup transport equation to determine the fundamental mode spectra for use in generating multigroup neutron cross sections. A homogeneous medium or a heterogeneous slab or cylindrical unit cell problem is solved in ultrafine (2082) or hyperfine (~400 000) group levels. In the resolved resonance range, pointwise cross sections are reconstructed with Doppler broadening at specified temperatures. The pointwise cross sections are directly used in the hyperfine group calculation, whereas for the ultrafine group calculation, self-shielded cross sections are prepared by numerical integration of the pointwise cross sections based upon the narrow resonance approximation. For both the hyperfine and ultrafine group calculations, unresolved resonances are self-shielded using the analytic resonance integral method. The ultrafine group calculation can also be performed for a two-dimensional whole-core problem to generate region-dependent broad-group cross sections. Verification tests have been performed using the benchmark problems for various fast critical experiments including Los Alamos National Laboratory critical assemblies; Zero-Power Reactor, Zero-Power Physics Reactor, and Bundesamt für Strahlenschutz experiments; Monju start-up core; and Advanced Burner Test Reactor. Verification and validation results with ENDF/B-VII.0 data indicated that eigenvalues from MC2 -3/DIF3D agreed well with Monte Carlo N-Particle5 MCNP5 or VIM Monte Carlo solutions within 200 pcm and regionwise one-group fluxes were in good agreement with Monte Carlo solutions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Mathematical Basis and Test Cases for Colloid-Facilitated Radionuclide Transport Modeling in GDSA-PFLOTRAN

This report provides documentation of the mathematical basis for a colloid-facilitated radionuclide transport modeling capability that can be incorporated into GDSA-PFLOTRAN. It also provides numerous test cases against which the modeling capability can be benchmarked once the model is implemented numerically in GDSA-PFLOTRAN. The test cases were run using a 1-D numerical model developed by the author, and the inputs and outputs from the 1-D model are provided in an electronic spreadsheet supplement to this report so that all cases can be reproduced in GDSA-PFLOTRAN, and the outputs can be directly compared with the 1-D model. The cases include examples of all potential scenarios in which colloid-facilitated transport could result in the accelerated transport of a radionuclide relative to its transport in the absence of colloids. Although it cannot be claimed that all the model features that are described in the mathematical basis were rigorously exercised in the test cases, the goal was to test the features that matter the most for colloid-facilitated transport; i.e., slow desorption of radionuclides from colloids, slow filtration of colloids, and equilibrium radionuclide partitioning to colloids that is strongly favored over partitioning to immobile surfaces, resulting in a substantial fraction of radionuclide mass being associated with mobile colloids.

54 ENVIRONMENTAL SCIENCES↗

Assessment of Grizzly Capabilities for Reactor Pressure Vessels and Reinforced Concrete Structures

Over the last several years, capabilities to simulate the progression and effects of degradation in critical structures in light water reactor (LWR) nuclear power plants have been under development in the Grizzly code. Age-related material degradation is important for a number of systems in LWRs, but the main focus for Grizzly development has been on reactor pressure vessels (RPVs) and concrete structures because of their central role and the difficulty of replacement of these structures if they are found to be degraded to an unacceptable degree. The capabilities for analyzing both RPVs and concrete structures in Grizzly have reached a point where the feature sets are sufficiently complete to perform credible analyses of those types of structures. Because of this, the emphasis has shifted from foundational development to assessing the accuracy of these modeling capabilities on representative problems of interest and on improving the physical basis of those models to improve their ability to predict the actual response of those structural systems. This report documents a first set of test cases that have been developed to assess the Grizzly code on real-world problems for these two types of structures. For RPVs, these test cases consist of a set of benchmark problems where Grizzly is compared to another code. For concrete structures, a set of models of experimental specimens designed to characterize the multidimensional swelling response of reinforced concrete members due to alkali-silica reaction (ASR) has been developed and compared with experimental results. Both the RPV and concrete test cases developed here are much more computationally intensive than the small regression tests that are used in the testing that Grizzly undergoes every time a proposed set of changes is made to ensure that those changes do not adversely affect previously established behavior. A system for regularly running these large problems to monitor the behavior of the code as it is developed has been instituted. While these test cases generally indicate good comparison with the benchmark results, they also indicate areas where further development is warranted.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DYNA3D/ParaDyn Regression Test Suite Inventory

The following table constitutes an initial assessment of feature coverage across the regression test suite used for DYNA3D and ParaDyn. It documents the regression test suite at the time of production release 10.1 in September 2010. The columns of the table represent groupings of functionalities, e.g., material models. Each problem in the test suite is represented by a row in the table. All features exercised by the problem are denoted by a check mark in the corresponding column. The definition of ''feature'' has not been subdivided to its smallest unit of user input, e.g., algorithmic parameters specific to a particular type of contact surface. This represents a judgment to provide code developers and users a reasonable impression of feature coverage without expanding the width of the table by several multiples. All regression testing is run in parallel, typically with eight processors. Many are strictly regression tests acting as a check that the codes continue to produce adequately repeatable results as development unfolds, compilers change and platforms are replaced. A subset of the tests represents true verification problems that have been checked against analytical or other benchmark solutions. Users are welcomed to submit documented problems for inclusion in the test suite, especially if they are heavily exercising, and dependent upon, features that are currently underrepresented.

42 ENGINEERING↗

Development Plan for Acoustic Emission and Vibration Sensors

This document discusses the need for high temperature, radiation tolerant sensors for monitoring vibration and acoustic emissions in advanced reactors and irradiation experiments. Testing of several commercial sensors using infrastructure available at Idaho National Laboratory was performed to benchmark currently available sensors as well as the test facilities. Finally, a strategy for developing sensors for more extreme environments is presented.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Impact of Coating Defects on Performance of Coated Zirconium Cladding

Research on accident tolerant fuels (ATF) has started after the Fukushima accident [1–3]. While efforts have been expended on both fuel and cladding ATF concepts, the bulk of work has been devoted to improved cladding. The overarching goal of these approaches is to extend the coping time available during a severe accident before any event would result in release of radioactivity to the public. The most basic ATF cladding concept is obtained by applying a thin coating of highly corrosion-resistant material on the surface of a licensed zirconium cladding alloy. This thin coating is intended to not interfere with the neutronic or mechanical performance of the base cladding under normal operating conditions. Different coating materials, thicknesses, coating processes, process parameters, and testing methods have an impact on the microstructure and mechanical properties and therefore on the results of the applied investigation methods. These challenges have motivated an initial focus on demonstrating that the presence of coatings do not perturb the critical performance benchmarks of uncoated material. Ongoing lead test assembly irradiations of coated zirconium concepts in commercial reactions is intended to establish baseline performance in this regard in the coming years.

36 MATERIALS SCIENCE↗

Experimental aerothermodynamic research of hypersonic aircraft

Wind tunnel tests were conducted to establish a benchmark experimental data base for a genetic hypersonic aircraft vehicle. Comprehensive measurements were made at Mach 7 to give flow visualization, surface pressure, surface convective heat transfer, and flow field Pitot pressure for a delta platform all-body vehicle. The tests were conducted in the NASA/Ames 3.5-Foot Hypersonic Wind Tunnel at Reynolds numbers sufficient to give turbulent flow. Comparisons are made of the experimental results with computational solutions of the flow by an upwind parabolized Navier-Stokes code developed at Ames. Good agreement of experiment with solutions by the code is demonstrated.

Cleary, Joseph W.↗

Graph 500 on OpenSHMEM: Using a Practical Survey of Past Work to Motivate Novel Algorithmic Developments

Graph500 [14] is an effort to offer a standardized benchmark across large-scale distributed platforms which captures the behavior of common communicationbound graph algorithms. Graph500 differs from other large-scale benchmarking efforts (such as HPL [6] or HPGMG [7]) primarily in the irregularity of its computation and data access patterns. The core computational kernel of Graph500 is a breadth-first search (BFS) implemented on an undirected graph. The output of Graph500 is a spanning tree of the input graph, usually represented by a predecessor mapping for every node in the graph. The Graph500 benchmark defines several pre-defined input sizes for implementers to test against. This report summarizes investigation into implementing the Graph500 benchmark on OpenSHMEM, and focuses on first building a strong and practical understanding of the strengths and limitations of past work before proposing and developing novel extensions.

97 MATHEMATICS AND COMPUTING↗

SAS4A/SASSYS-1 Validation with the FFTF LOFWOS Tests #10-12

The FFTF liquid sodium cooled test reactor was built to assist the development and testing of advanced fuels and material for fast reactors. The goals of the FFTF Passive Safety Testing program included confirming the safety margins of FFTF as a liquid metal reactor, providing data for computer code validation, and demonstrating the inherent and passive safety benefits of its specific design features. The program included thirteen unprotected loss of flow without scram tests. The results of modeling and simulation of LOFWOS Tests #10, #11, and #12 are presented in this report to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. These three tests did not use the primary loop pony motors and thus transitioned to natural circulation flow rates from varying initial power levels. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project (CRP) for benchmark analysis of the FFTF LOFWOS Test #13. The SAS4A/SASSYS-1 model originally developed for the CRP has been extended to include LOFWOS Tests #10-12 and modernized to utilize new code features and modeling practices. Predicted results from SAS4A/SASSYS-1 were compared to measured test data and differences were investigated. Overall, it was concluded that, for LOFWOS Tests #10-12, there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating Support for OpenMP Offload Features

The OpenMP language features have been evolving to meet the rapid development in hardware platforms. DOE applications tend to push the bleeding edge of features ratified in the OpenMP specification and tend to expose the rough edges of the features' implementations. The software harness on DOE supercomputers such as Titan and (upcoming) Summit include Cray, Clang, Flang, XL and GCC compilers. It is critical, especially for Summit, that the compilers support OpenMP offloading features. This paper focuses on evaluating support for OpenMP 4.5 target offload directives across compiler implementations on Titan and Summitdev, an early access system, which is one generation removed from Summit's architecture enabling application teams to test the systems' architecture. Our tests not only evaluate the OpenMP implementations but also expose ambiguities in the OpenMP 4.5 specification. We also evaluate compiler implementations using kernels extracted from production DOE applications. This helps in assessing the interaction of different OpenMP directives independent of other application artifacts. We are aware that the implementations are constantly evolving and are advertised as having only partial OpenMP 4.x support. We see this as a synergistic effort to help identify and correct features that are required by DOE applications and prevent deployment delays later on. Going forward, we also plan to interact with standard benchmarking bodies like SPEC/HPG to donate our tests and mini-apps/kernels for potential inclusion in the next release versions of SPEC OMP and SPEC ACCEL benchmark suites.

Monsalve Diaz, Jose↗

A scalable real-time framework for Thomson scattering analysis: Application to NSTX-U

A detailed description of a prototype setup for real-time (RT) Thomson scattering (TS) analysis is presented and implemented in the multi-point Thomson scattering (MPTS) diagnostic system at the National Spherical Torus Experiment Upgrade (NSTX-U). The data acquisition hardware was upgraded with RT capable electronics (RT-analog digital converters and a RT server) that allow for fast digitization of the laser pulse signal of eight radial MPTS channels. In addition, a new TS spectrum analysis software for a rapid calculation of electron temperature ( T e ) and electron density ( n e ) was developed. Testing of the RT hardware and data analysis software was successfully completed and benchmarked against the standard, post-shot evaluation. Timing tests were performed showing that the end-to-end processing time was reproducibly below 17 ms for the duration of at least 5 s, meeting a 60 Hz deadline by the laser pulse repetition rate over the length of a NSTX-U discharge. The presented RT framework is designed to be scalable in system size, i.e., incorporation of additional radial channels by solely adding additional RT capable hardware. In conclusion, it is scalable in its operation duration and was continuously running for up to 30 min, making it an attractive solution for machines with long discharges such as advanced, non-inductive tokamaks or stellarators.

47 OTHER INSTRUMENTATION↗

Bias Between ENDF/B-VIII and ENDF/B-VII.1 for LEU Pin Array Systems

Extensive testing of new cross section data is performed in SCALE prior to its release. The release of ENDF/B-VIII.0 requires the generation and testing of new data libraries which are planned to be included in the release of SCALE 6.3 in 2019 or 2020. KENO benchmark results have been published previously for beta and final releases of ENDF/B-VIII.0 using the entire Verified, Archived Library of Inputs and Data (VALID). This work presents an energy-dependent change in the results for low-enriched uranium (LEU) pin array systems. The process of identifying the difference is highlighted as a case study to determine how data testing and benchmarking can be performed to provide more detailed feedback to the data community on potential data deficiencies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Concept Study of Robotic Camera-Based Foreign Object Detection for EV Wireless Charging

Wireless charging of an electric vehicle (EV) is an emerging charging technology promising convenient, autonomous, and highly efficient EV charging without requiring heavy gauge cables. However, due to the strong electromagnetic field created by this process that surrounds the wireless charger, the presence of foreign objects can detrimentally interact with it, thus affecting wireless power transfer (WPT) performance or leading to harmful and unwanted safety risks. This paper presents the results for a concept study on a robotic camera-based foreign object detection (FOD) system, as a supplement to the industry-existing overlapped FOD coil array method, for EV wireless charging. A Raspberry PI 4 control board and compatible Raspberry PI Camera Module 2 are used to implement camera-based object detection. The FOD program was developed using a state-of-the-art deep learning object detection model with the OpenCV and Pytorch library and is compatible with camera module hardware. A dry-run test with Raspberry PI and a camera module was conducted and the preliminary FOD function was verified. The feasibility assessment is also validated by comparing the performance of five existing state-of-the-art deep learning object detection models for vehicles, animals, persons, and metals subsets, respectively. Satisfactory performance on the benchmark datasets is observed by the tests, but further improvements are needed in future work when detecting small-sized metallic objects. A programable robotic car is also under development as ongoing work for carrying the Raspberry PI and camera module while moving for the maintenance process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Basis set consistent revision of the S22 test set of noncovalent interaction energies

The S22 test set of interaction energies for small model complexes has been very valuable for benchmarking new and existing methods for noncovalent interactions. However, the basis sets utilized to compute the CCSD(T) interaction energies for some of the dimers are insufficient to obtain converged results. Here we consistently extrapolate all CCSD(T)/complete basis set (CBS) interaction energies using larger basis sets for the CCSD(T) component of the computation. The revised values, which we designate S22A, represent the most accurate results to date for this set of dimers. The new values appear to be within a few hundredths of 1 kcal mol –1 of the true CCSD(T)/CBS limit at the given geometries, but the former S22 values are off by as much as 0.6 kcal mol –1 compared to the revised values. Because some of the most promising methods for noncovalent interactions are already achieving this level of agreement (or better) compared to the S22 data, more accurate benchmark values would clearly be helpful. The MP2, SCS-MP2, SCS-CCSD, SCS(MI)-MP2, and B2PLYP-D methods have been tested against the more accurate benchmark set. The B2PLYP-D method outperforms all other methods tested here, with a mean average deviation of only 0.12 kcal mol –1 . Furthermore, the consistent, slight underestimation of the interaction energies computed by the SCS-CCSD method (an overall mean absolute deviation and mean deviation of 0.24 and –0.23 kcal mol –1 , respectively) suggests that the SCS-CCSD method has the potential to become even more accurate with a reoptimization of its parameters for noncovalent interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗