Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Benchmarking Heavy Ion Transport Codes FLUKA, HETC-HEDS MARS15, MCNPX, and PHITS

Powerful accelerators such as spallation neutron sources, muon-collider/neutrino facilities, and rare isotope beam facilities must be designed with the consideration that they handle the beam power reliably and safely, and they must be optimized to yield maximum performance relative to their design requirements. The simulation codes used for design purposes must produce reliable results. If not, component and facility designs can become costly, have limited lifetime and usefulness, and could even be unsafe. The objective of this proposal is to assess the performance of the currently available codes PHITS, FLUKA, MARS15, MCNPX, and HETC-HEDS that could be used for design simulations involving heavy ion transport. We plan to access their performance by performing simulations and comparing results against experimental data of benchmark quality. Quantitative knowledge of the biases and the uncertainties of the simulations is essential as this potentially impacts the safe, reliable and cost effective design of any future radioactive ion beam facility. Further benchmarking of heavy-ion transport codes was one of the actions recommended in the Report of the 2003 RIA R&D Workshop".

43 PARTICLE ACCELERATORS↗

Benchmark Analysis of Subcritical Noise Measurements on a Nickel-Reflected Plutonium Metal Sphere

Subcritical experiments using californium source-driven noise analysis (CSDNA) and Feynman variance-to-mean methods were performed with an alpha-phase plutonium sphere reflected by nickel shells, up to a maximum thickness of 7.62 cm. Both methods provide means of determining the subcritical multiplication of a system containing nuclear material. A benchmark analysis of the experiments was performed for inclusion in the 2010 edition of the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Benchmark models have been developed that represent these subcritical experiments. An analysis of the computed eigenvalues and the uncertainty in the experiment and methods was performed. The eigenvalues computed using the CSDNA method were very close to those calculated using MCNP5; however, computed eigenvalues are used in the analysis of the CSDNA method. Independent calculations using KENO-VI provided similar eigenvalues to those determined using the CSDNA method and MCNP5. A slight trend with increasing nickel-reflector thickness was seen when comparing MCNP5 and KENO-VI results. For the 1.27-cm-thick configuration the MCNP eigenvalue was approximately 300 pcm greater. The calculated KENO eigenvalue was about 300 pcm greater for the 7.62-cm-thick configuration. The calculated results were approximately the same for a 5-cm-thick shell. The eigenvalues determined using the Feynman method are up to approximately 2.5% lower than those determined using either the CSDNA method or the Monte Carlo codes. The uncertainty in the results from either method was not large enough to account for the bias between the two experimental methods. An ongoing investigation is being performed to assess what potential uncertainties and/or biases exist that have yet to be properly accounted for. The dominant uncertainty in the CSDNA analysis was the uncertainty in selecting a neutron cross-section library for performing the analysis of the data. The uncertainty in the Feynman method was equally shared between the uncertainties in fitting the data to the Feynman equations and the neutron multiplicity of 239 Pu. Material and geometry uncertainties in the benchmark experiment were generally much smaller than uncertainties in the analysis methods.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Quantification of a Light Water Pulsed-Neutron Die-Away Experiment to Thermal Neutron Scattering Laws

Thermal neutron scattering laws are important nuclear data for many nuclear science and engineering applications. Validation helps to ensure that a thermal neutron scattering law has a high quality and often employs critical benchmarks as integral experiments. Recently, pulsed-neutron die-away benchmarks have been used as an experiment to validate thermal neutron scattering laws. Herein, we evidence how this alternative integral experiment has a high sensitivity to these nuclear data by performing an uncertainty quantification analysis. The analysis randomly sampled the nuclear model parameters associated with hydrogen bound in light water thermal neutron scattering law and sampled other nuclear data that influenced the experiment’s integral parameter (e.g., elastic scattering, absorption in hydrogen and oxygen) from their respective covariance matrices. The thermal neutron scattering law caused an uncertainty in the integral parameter that reached 2.67%, which exceeds by an order of magnitude the uncertainties induced in commonly used thermal solution critical benchmarks. The validation performed here, although limited due to a poor description of the historical experiment, indicated that the ENDF/B-VIII.0 thermal neutron scattering law well predicted the integral parameter. These results motivate further benchmark and validation efforts using pulsed-neutron die-away experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Analysis of the IFA-432, IFA-597, and IFA-597 MOX Fuel Performance Experiments by FRAPCON-3.4

Validation of advanced nuclear fuel modeling tools requires careful comparison with reliable experimental benchmark data. A comparison to industry-accepted codes, that are well characterized, and regulatory codes is also a useful evaluation tool. In this report, an independent validation of the FRAPCON-3.4 fuel performance code is conducted with respect to three experimental benchmarks, IFA-432, IFA-597, and IFA-597mox. FRAPCON was found to most accurately model the mox rods, to within 2% of the experimental data, depending on the simulation parameters. The IFA-432 and IFA-597 rods were modeled with FRAPCON predicting centerline temperatures different, on average, by 21 percent.

Phillippe, Aaron M.↗

Advancements in Accelerator Physics and System Developments for the EIC

The development and enhancement of the Electron-Ion Collider (EIC) are founded on extensive research and development efforts aimed at achieving rigorous performance goals. This document outlines the crucial research and development (R&D) efforts that underpin the various systems and components of the EIC, including the polarized electron source and linear accelerator (linac) systems. Achieving the collider’s operational benchmarks relies on meticulously enhancing these components to optimize performance.

43 PARTICLE ACCELERATORS↗

ARC Software Validation Work for the FFTF Reactor

Extensive efforts have been carried out at ANL for the verification and validation of the Argonne Reactor Codes (ARC) software package currently used for the design of Versatile Test Reactor (VTR). The ARC software package consists of steady state neutronics and thermal hydraulics modeling capabilities which are being used by the VTR program to develop most of the VTR reactor design details which will be part of the licensing application. It is anticipated that this software will continue to be used for the design work and for initial operations although additional software may be introduced at a later time. The validation work was focused primarily on obtaining validation data consistent with VTR and usable for the ARC software. Because no critical facilities or operating fast spectrum reactors are available to do experiments for the VTR, the next best option is to identify historical experimental data that can be used as validation data. Early on in VTR, the ZPPR-15 set of experiments was identified as good validation data because of 1) the availability and quality of the data, 2) existing staff that are already familiar with the experimental machine and measurements, 3) most of the ZPPR-15 loadings of interest have already been processed into ARC models, and 4) a full uncertainty quantification has already been done for several loadings of ZPPR-15. The FFTF startup and operations data was identified as the most consistent reactor type that has validation data usable for VTR. Finally, the EBR-II fuel depletion measurements were identified as the best available validation data for VTR. It is important to note that both the FFTF and EBR-II reactors typically come with higher uncertainties than the ZPPR. In the frame of the discussed verification and validation efforts, the present document discusses the analysis of selected FFTF measurements included in the benchmark specifications of the International Reactor Physics Experiment (IRPhE) handbook. The FFTF reactor core configurations from the benchmark specification are presented in Section 2. The analysis is performed with the use of the ARC code suite available at ANL for fast reactor studies and is discussed in Section 3. The reactor parameters from the benchmark include criticality, neutron spectra, effective delayed neutron spectra, control rod worth, isothermal temperature coefficient and low energy gamma-ray spectra. The calculated values and the comparison with the experimental data is discussed in Sections 4 to 9 for each considered reactor parameter. Finally, conclusions are presented in Section 10.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A new approach to calculate charge carrier transport mobility in organic molecular crystals from imaginary time path integral simulations

We present a new non-perturbative method to calculate the charge carrier mobility using the imaginary time path integral approach, which is based on the Kubo formula for the conductivity, and a saddle point approximation to perform the analytic continuation. The new method is first tested using a benchmark calculation from the numerical exact hierarchical equations of motion method. Imaginary time path integral Monte Carlo simulations are then performed to explore the temperature dependence of charge carrier delocalization and mobility in organic molecular crystals (OMCs) within the Holstein and Holstein-Peierls models. The effects of nonlocal electron-phonon interaction on mobility in different charge transport regimes are also investigated.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Platinum group metal-free (PGM-free) integrated tandem junction photoelectrochemical (PEC) water splitting devices (Final Technical Report)

This project involves using solar light, a photoabsorber, and a catalyst to split water and produce hydrogen. The Department of Energy (DOE) targets for integrated photoelectrochemical (PEC) cells emphasize cost (electrode cost < $200/m 2 ), performance (> 15% solar to hydrogen (STH) efficiency), and stability (> 6 months electrode lifetime), but most approaches skew toward one specific metric. This project exploited interfacial integration of platinum group metal-free (PGM-free) catalysts on the high performance and high value tandem solar cells to attain or exceed the DOE benchmark STH energy conversion efficiency and durability. This was investigated in two thrusts by developing two PEC devices for direct comparison: the first is a high-performance monolithic device based on state-of-the-art GaInP 2 /GaAs tandem solar cells developed at National Renewable Energy Laboratory (NREL), and the second is a high-value device based on earth-abundant wide band gap photoabsorber materials including oxynitride and hybrid organic-inorganic perovskite (HOIP) coupled with commercial narrow band gap silicon (Si). Both these devices were paired with electrocatalysts developed for this purpose at Rutgers University by adapting them to thin films on the photoabsorbers. These catalysts are based on the hydrogen evolution reaction (HER) catalysts (Ni 5 P 4 ), oxygen evolution reaction (OER) catalysts (LiCo 2 O 4 ) previously developed at Rutgers for high-efficiency electrolyzers. For using the high-performance tandem solar cell and Ni 5 P 4 catalysts, we achieved a durability of > 200 h at a STH efficiency of > 10%. For using the high-value wide band gap single junction solar cells on n + Si, we achieved 0.73 mA/cm 2 at 1.23V vs reversible hydrogen electrode (RHE) and -15.9 mA/cm 2 at 0V vs RHE using the oxynitride- and HOIP-based photoelectrodes, respectively. After comparing their photocurrent densities, we down selected the HOIP photoabsorber to couple Si for fabrication of a tandem photocathode. However, due to the COVID-19 pandemic, both the laboratories at Rutgers and NREL were locked down for three months and reopened only partially in 2020. The HOIP/Si tandem photocathode using robust nickel phosphide thin film catalysts cannot be developed within the project period, which is expected to achieve a STH efficiency of > 20%. Also, the low-cost LiCo 2 O 4 OER catalysts need to replace the benchmark IrO 2 for evaluation. Finally, techonomic analysis of full high-performance and high-value integrated PEC devices needs to be carried out for comparison in terms of cost.

08 HYDROGEN↗

Aerosol-Assisted Deposition for TiO 2 Immobilization on Photocatalytic Fibrous Filters for VOC Degradation

Atomization and spraying are well-established methods for the production of submicrometer- and micrometer- sized powders. In addition, they could be of interest to the immobilization of photocatalytic nanoparticles onto supports because they enable the formation of microporous films with photocatalytic activity. Here, we provide a comparison of aerosol-assisted immobilization methods, such as spray-drying (SD), spray atomization (SA), and spray gun (SG), which were used for the deposition of TiO 2 dispersions onto fibrous filter media. The morphology, microstructure, and electronic properties of the structures with deposited TiO 2 were characterized by SEM and TEM, BET and USAXS, and UV-Vis spectrometry, respectively. The photocatalytic performances of the functionalized filters were evaluated and compared to the benchmark dip-coating method. Our results showed that the SG and SA immobilization methods led to the best photocatalytic and operational performance for the degradation of toluene, whereas the SD method showed the lowest degradation efficiency and poor stability of coating. We demonstrated that TiO2 sprays using the SG and SA methods with direct deposition onto filter media involving dispersed colloidal droplets revealed to be promising alternatives to the dip-coating method owing to the ability to uniformly cover the filter fibers. In addition, the SA method allowed for fast and simple control of the coating thickness as the dispersed particles were continuously directed onto the filter media without the need for repetitive coatings, which is common for the SG and dip-coating methods. Our study highlighted the importance of the proper immobilization method for the efficient photocatalytic degradation of VOCs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improved Quasi-Static Method with Step Doubling Time Adaptation

The imminent restart of the Transient Reactor Testing Facility (TREAT) at Idaho National Laboratory (INL) has brought significant attention to the development of transient reactor modeling. TREAT was designed to subject fuels and other reactor components to various degrees of neutron pulses, from minor transients to accident scenario. Inherently, this task requires predicting pulse responses due to various control rod movements; which is a complicated endeavor. Originally, this was done using an iterative process of rod movements and measuring the resulting response. With the advances in computer modeling, the current goal, preceding the restart, is to use simulation to characterize responses before experiments take place. However, neutron transient modeling is extremely computationally expensive due to the required implicit time-stepping. Therefore, methods that mitigate computation time, with minimal detriment to accuracy, are highly desired. This paper will describe the improved quasi-static method (IQS), which hopes to decrease computation time significantly from traditional 'brute force' transient methods. IQS is a spatial kinetics method that involves factorizing the flux solution into time-dependent amplitude and space- and time-dependent shape. The impetus of the method is the assumption that shape is weakly time-dependent, so expensive space-dependent evaluations are only required on large time steps. While inexpensive amplitude evaluations are performed on much smaller time steps to retain accuracy. IQS has been tested extensively on kinetics benchmarks with constant time steps. However, to test it's viability for TREAT simulations, evaluating IQS's performance with time adaptation is required. The rest of this paper will briefly describe the derivation of IQS, the time adaptation technique used, and results from a kinetic benchmarks. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Programming Model for Massive Data Parallelism with Data Dependencies

Accelerating processors can often be more cost and energy effective for a wide range of data-parallel computing problems than general-purpose processors. For graphics processor units (GPUs), this is particularly the case when program development is aided by environments such as NVIDIA s Compute Unified Device Architecture (CUDA), which dramatically reduces the gap between domain-specific architectures and general purpose programming. Nonetheless, general-purpose GPU (GPGPU) programming remains subject to several restrictions. Most significantly, the separation of host (CPU) and accelerator (GPU) address spaces requires explicit management of GPU memory resources, especially for massive data parallelism that well exceeds the memory capacity of GPUs. One solution to this problem is to transfer data between the GPU and host memories frequently. In this work, we investigate another approach. We run massively data-parallel applications on GPU clusters. We further propose a programming model for massive data parallelism with data dependencies for this scenario. Experience from micro benchmarks and real-world applications shows that our model provides not only ease of programming but also significant performance gains.

43 PARTICLE ACCELERATORS↗

Validation of Oregon State University High Temperature Test Facility Experiments Using Pronghorn

The OSU High Temperature Test Facility is a quarter-scale diameter, 1/64 scale volume test facility meant to replicate thermophysical phenomena in the prototypical General Atomics Modular High Temperature Gas Reactor. Tests pertaining to conduction cooldown events were performed from 2016-2019, providing a large database by which computational methods that are applicable to different length scales can be validated. One of these codes is Pronghorn, which is a coarse-meshed, porous-based subchannel thermal hydraulics code based on the MOOSE application, with the intention of better capturing the physics of both conduction and convection heat transfer within the OSU HTTF core. The goal of this summer project is to develop the framework by which Pronghorn can perform validation exercises of the HTTF core for benchmarking, by generating a mesh appropriate to the geometry of the HTTF core, developing input decks that accurately capture the initial and boundary conditions, materials, and relevant equations to the physics seen in the HTTF core, and using a postprocessor to compare simulation results to various experimental data. While validation of codes is a multi-year project, a mesh has been generated and tested in Pronghorn that meets mass conservation and basic heat transfer principles. The next step is to accurate depict the fluid inlet and outlet boundary conditions, which will be performed using computational fluid dynamics software.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Report on G4-Med, a Geant4 benchmarking system for medical physics applications developed by the Geant4 Medical Simulation Benchmarking Group

Geant4 is a Monte Carlo code extensively used in medical physics for a wide range of applications, such as dosimetry, micro- and nanodosimetry, imaging, radiation protection, and nuclear medicine. Geant4 is continuously evolving, so it is crucial to have a system that benchmarks this Monte Carlo code for medical physics against reference data and to perform regression testing. In this work, to respond to these needs, we developed G4-Med, a benchmarking and regression testing system of Geant4 for medical physics. G4-Med currently includes 18 tests. They range from the benchmarking of fundamental physics quantities to the testing of Monte Carlo simulation setups typical of medical physics applications. Both electromagnetic and hadronic physics processes and models within the prebuilt Geant4 physics lists are tested. The tests included in G4-Med are executed on the CERN computing infrastructure via the use of the geant-val web application, developed at CERN for Geant4 testing. The physical observables can be compared to reference data for benchmarking and to results of previous Geant4 versions for regression testing purposes. This paper describes the tests included in G4-Med and shows the results derived from the benchmarking of Geant4 10.5 against reference data.

60 APPLIED LIFE SCIENCES↗

An O(N logN) multi-layer boundary element method for direct computation of sound propagation in shallow water environments

Direct three-dimensional (3D) numerical simulations of acoustic fields in range-dependent shallow water environments remains a challenge due to environmental complexities and large computational cost.We develop an efficient 3D boundary element method (BEM) for shallow water acoustic propagation which utilizes a Pre-corrected Fast Fourier Transform (PFFT) approach to reduce the computational effort from O ( N 2~3 ) to O ( N log N ) where N is the total number of boundary unknowns. To account for inhomogeneous media, the method allows for arbitrary number of coupled multi-layer BEM sub-domains. With O ( N log N ) efficiency and the use of massively parallel high-performance computing platforms, we are able to conduct multi-layer 3D direct simulations of low-mid frequency acoustics over kilometer ranges. Furthermore we perform extensive validations of the method and provide two shallow water waveguide examples benchmarked against theoretical solutions. To illustrate the efficacy and usefulness of the PFFT-BEM method, we perform 3D large-scale direct simulations to assess the performance of two established canonical models: axisymmetric coupled mode model for 3D seamount; and Kirchhoff approximation and perturbation theory for 3D rough surface scattering.

42 ENGINEERING↗

psst: An open-source power system simulation toolbox in Python

This paper is an overview of Power System Simulation Toolbox (psst). psst is an open-source Python application for the simulation and analysis of power system models. psst simulates the wholesale market operation by solving a DC Optimal Power Flow (DCOPF), Security Constrained Unit Commitment (SCUC) and a Security Constrained Economic Dispatch (SCED). psst also includes models for the various entities in a power system such as Generator Companies (GenCos), Load Serving Entities (LSEs) and an Independent System Operator (ISO). psst features an open modular object oriented architecture that will make it useful for researchers to customize, expand, experiment beyond solving traditional problems. psst also includes a web based Graphical User Interface (GUI) that allows for user friendly interaction and for implementation on remote High Performance Computing (HPCs) clusters for parallelized operations. This paper also provides an illustrative application of psst and benchmarks with standard IEEE test cases to show the advanced features and the performance of toolbox.

97 MATHEMATICS AND COMPUTING↗

Integrated Prediction and Mitigation Methods of Materials Damage and Lifetime Assessment during Plasma Operation and Various Instabilities in Fusion Devices

This report describes implementation of comprehensive and integrated models to evaluate plasma material interactions during normal and abnormal plasma operations. The models in full3D simulations represent state-of-the art worldwide development with numerous benchmarking of various tokamak devices and plasma simulators. In addition, significant number of experimental work has been performed in our center for materials under extreme environment (CMUXE) at Purdue to benchmark the effect of intense particle and heat fluxes on plasma-facing components. This represents one-year worth of work and resulted in more than 23 Journal Publications and numerous conferences presentations. The funding has helped several students to obtain their M.Sc. and Ph.D. degrees and many of them are now faculty members in US and around the world teaching and conducting fusion research. Our work has also been recognized through many awards.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Depletion Benchmark of the AFIP-7 Experiment in the Advanced Test Reactor

Reactor physics depletion benchmarks for low-enriched uranium fuel are limited in number. In particular, there is very limited data for LEU benchmarks for U-10Mo (Uranium-10% Molybdenum) plate fuel developed for use in U.S. high-performance research reactors (USHPRR). USHPRR includes the Advanced Test Reactor (ATR), Advanced Test Reactor Critical Facility (ATR-C), High Flux Isotope Reactor (HFIR), University of Missouri Research Reactor (MURR), Massachusetts Institute of Technology Reactor (MITR), and National Bureau of Standards Reactor (NBSR) at the National Institute of Science and Technology. These reactors are fueled with high-enriched uranium dispersed fuel in a silicon/aluminum matrix. In support of conversion to a HALEU fuel, qualification of U-10Mo formed into a monolithic foil is being performed. Fuel qualification involves irradiated fueled specimens in the ATR. The irradiation tests provide an opportunity to benchmark depletion capabilities of reactor physics codes in support of the ATR operation, as well as develop benchmarks that can be used by other institutions to benchmark other reactor physics codes. This report documents the development of a benchmark model of the irradiation of the ATR Full -size plate In center flux trap Position 7 (AFIP-7) experiment.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Collective I/O Tuning Using Analytical and Machine-Learning Models

The ever larger demand of scientific applications for computation and data is currently driving a continuous increase in scale of parallel computers. The inherent complexity of scaling up a computing systems in terms of both hardware and software stack exposes an increasing number of factors impacting the performance and complicating the process of optimization. In particular, the optimization of parallel I/O has become increasingly challenging due to increasing storage hierarchy and well known performance variability of shared storage systems. This paper focuses on model-based autotuning of the two-phase collective I/O algorithm from a popular MPI distribution on the Blue Gene/Q architecture. We propose a novel hybrid model, constructed as a composition of analytical models for communication and storage operations and black-box models for the performance of the individual operations. We perform an in-depth study of the complexity involved in performance modeling including architecture, software stack and noise. In particular we address this challenges of modeling the performance of shared storage systems by building a benchmark that helps synthesizing factors such as topology, file caching, and noise. The experimental results show that the hybrid approach produces significantly better results than state-of-the-art machine learning approaches and shows a higher robustness to noise, at the cost of a higher modeling complexity

I/O performance modeling↗