Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Sensitivity and uncertainty of the IFR-1 BISON benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered for adoption by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This paper summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment.For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. Here, the resulting variations in benchmark predictions were normalized to calculate sensitivities. These sensitivities were then used to inform input selections for the UQ.The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of the benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because the confidence intervals associated with benchmark predictions were wide. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Novel Hybrid Current Limiter for Grid-Forming Inverter Control During Unbalanced Faults

Grid-forming (GFM) inverter controls have illustrated many desirable features to enable the bulk integration of renewable resources into the future power grid; however, the performance of GFM inverters during unbalanced faults remains underexplored. This paper proposes a novel current-limiting method for GFM inverters to handle unbalanced fault conditions while providing voltage support to the main grid. The proposed current limiter combines concepts of dynamic virtual-impedance and current-reference saturation limiting, all built in the stationary reference frame, to achieve improved current-limiting performance under unbalanced load/fault conditions. System-wide full-order transient simulations with multiple GFM inverters demonstrate the potential of the method and benchmark the performance against state-of-the-art current limiters. Simulation results portray improved voltage balancing performance of the proposed method compared to both current-reference saturation and virtual-impedance limiting.

controller anti windup↗
DOE OSTI2023

Novel Hybrid Current Limiter for Grid-Forming Inverter Control During Unbalanced Faults: Preprint

Grid-forming (GFM) inverter controls have illustrated many desirable features to enable bulk integration of renewable sources into the future power grid. However, the performance of GFM inverters during unbalanced faults remains under-explored. In this paper, a novel current-limiting method is proposed for GFM inverters to handle unbalanced fault conditions while providing voltage support to the main grid. The proposed current limiter combines concepts of dynamic virtual-impedance and current-reference saturation limiting, all built-up in the stationary reference frame to achieve improved current-limiting performance under unbalanced load/fault conditions. System-wide full-order transient simulations with multiple GFM inverters demonstrate the potential of the method and benchmark the performance against state-of-the-art current limiters. Simulation results portray improved voltage balancing performance of the proposed method compared to both current-reference saturation and virtual-impedance limiting.

controller anti windup↗
DOE OSTI2021

Sensitivity and Uncertainty of the IFR-1 BISON Benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This report summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment. For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. The resulting variations in benchmark predictions were normalized to calculate sensitivities. The strongest sensitivities were identified and used to inform input selections for the UQ. The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because of the wide confidence intervals associated with the benchmark predictions. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark development and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗
DOE OSTI2026

Speedup of UEDGE Parameter Scans Using Machine-Learning Optimized OpenMP Parallelization and a Continuation Solver

This article presents the OpenMP parallelization of the preconditioning Jacobian assembly and right‐hand side residual evaluation in UEDGE. A continuation algorithm, utilizing the internal NKSOL implicit Jacobian‐Free Newton‐Krylov solver to efficiently scan physical parameters, is also presented. The implemented parallelization reduces the computational time for a benchmark scan run on 32 threads by compared to the serial version when using trained random forest regression models to identify the optimal decomposition of the system of equations. Random forest regression models applied to the UEDGE time‐dependent and continuation solver algorithms did not yield meaningful improvement in computational performance. A benchmark DIII‐D gas injection rate scan in the 0.35–0.75 kA interval, performed on a test cluster using the parallelized code and continuation solver, produced 1066 steady‐state solutions with a 22 s average wall‐clock computational time per steady‐state solution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Performance Portability Evaluation of Fluid-Structure Interaction Simulations on Heterogeneous Platforms

The rapid proliferation of heterogeneous programming languages and multi-vendor hardware has underscored the critical need to evaluate the performance portability of scientific applications. In this work, we present the systematic porting and optimization of a massively parallel fluid-structure interaction code across multiple heterogeneous programming frameworks for deployment on leadership-class supercomputers from major vendors. Our analysis focuses on at-scale performance for simulations involving hundreds of millions of deformable cells, executed on a combination of CPUs and GPUs spanning thousands of nodes on exascale machines. We benchmark the performance of each implementation, highlighting the trade-offs inherent in adopting diverse programming models. Key insights regarding the portability of CUDA on multi-vendor platforms, the superior multi-core CPU performance from SYCL, and architectural considerations on performance optimization are distilled from our experience, offering guidance to other users of high performance computing based on our findings.

Martin, Aristotle [Duke University]↗
DOE OSTI2023

Final Design for Thermal/Epithermal eXperiments (TEX) with Chloride Absorbers to Provide Validation Benchmarks for Y-12 Electrorefining Facility

Uranium electrorefining operations at Y-12 require validation for chlorine absorption and reflection. Plutonium chloride solution operations at Los Alamos National Laboratory require chlorine absorption validation. The growing need for chlorine validation is evident to the wider criticality safety community, with multiple attendees at the recent TEX 2.0 meeting at Lawrence Livermore National Laboratory (May 2023) requesting validation for chlorine (Idaho National Laboratory (INL), Institute de radioprotection et de surete nucleaire (IRSN), Savannah River Nuclear Site (SRNS), LANL, and Y-12). Los Alamos National Laboratory has recently performed, and benchmarked, an experiment titled Chlorine Worth Study (CWS) for the internal operations at the lab, but due to the difficulties in precisely characterizing the material compositions of the chlorine absorbers it is advantageous to perform a complimentary study with a different chlorine-based absorber material. Furthermore, having a uranium-based vs plutonium-based experiment provides a separate and important validation basis for criticality safety and nuclear data evaluation. The original final design report for the study of chlorine absorption using the TEX-HEU experimental base was presented in 2022, but used the same chlorine-bearing materials that were found to be difficult to characterize in the LANL benchmark. A complete redesign of the experiment has been performed looking at alternative absorber materials in various forms to produce an experiment that is fully characterizable. This report presents five novel chlorine experiments using the TEX-HEU test bed which provides direct comparison to the Y-12 and INL/Terrapower application needs, utilizing sodium chloride (NaCl) absorber plates. The absorber plates will consist of granulated NaCl (≥99.5% pure), which will be fully encapsulated in aluminum tins, providing a simple but effective chlorine-based absorber material that can be completely characterized. Of the five configurations presented in this report, it is expected that two or three configurations will be down selected for the actual experiment, with the other configurations being alternates. Three of the configurations are in the standard configuration, where the absorber is placed directly on the HEU fuel plates, and two in the sandwich configuration, where the absorber is surrounded by polyethylene moderators to force additional neutron thermalization prior to reaching the absorber. There are two thicknesses of NaCl absorber plates: 3/16” and 1/4” active thicknesses (i.e. not including the encapsulation). Both variations of the absorbers have an active absorber radius of 6” and a total radius of 7.5” to match the diameter of the HEU plates, with the outer 1.5” being aluminum encapsulation. The high-density polyethylene (HDPE) moderators are of the thicknesses: 27/16”, 7/4”, 1/8”, 11/16”, and 3/4”. The final configurations have six (one sandwich and one standard configuration), eight (one sandwich and one standard configuration), and 18 total fuel layers (standard configuration). The standard and sandwich configurations were designed such that the differences in moderator thicknesses are 1” HDPE, which were already procured for the original CED-2. The proposed configurations were precisely tuned to closely match the sensitivity profiles and neutron spectra of the Y-12 upset cases and were also compared to the INL/Terrapower upset cases. The assessment of experimental uncertainties of the non-absorber components was predicted to be 0.00114 Δk eff . The assessment of uncertainties resulting from the absorbers was predicted to be 0.00029 Δk eff . This results in a total uncertainty of 0.00118 Δk eff . Many of the largest uncertainties, namely the moderator densities, may be reduced with precision dimensional inspection of the components. The 1” HDPE moderators as well as the HDPE reflectors from the original CED-2 were incorporated in the final designs presented here. Additional HDPE moderator plates must be fabricated to complete the configurations. NaCl absorber plates will by fabricated at LLNL. The total additional cost is expected to be $\$$54,250 for the remaining components. Precise inspection, including dimensional, mass, density, and impurity, is recommended for all components. LLNL estimates that these costs are around $\$$12,000. It is expected, based on previous TEX-HEU experiments, that three weeks of experimental facility time is needed to complete the experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

GPU-acceleration of the ELPA2 distributed eigensolver for dense symmetric and hermitian eigenproblems

The solution of eigenproblems is often a key computational bottleneck that limits the tractable system size of numerical algorithms, among them electronic structure theory in chemistry and in condensed matter physics. Large eigenproblems can easily exceed the capacity of a single compute node, thus must be solved on distributed-memory parallel computers. We here present GPU-oriented optimizations of the ELPA two-stage tridiagonalization eigensolver (ELPA2). On top of cuBLAS-based GPU offloading, we add a CUDA kernel to speed up the back-transformation of eigenvectors, which can be the computationally most expensive part of the two-stage tridiagonalization algorithm. Furthermore, we benchmark the performance of this GPU-accelerated eigensolver on two hybrid CPU–GPU architectures, namely a compute cluster based on Intel Xeon Gold CPUs and NVIDIA Volta GPUs, and the Summit supercomputer based on IBM POWER9 CPUs and NVIDIA Volta GPUs. Consistent with previous benchmarks on CPU-only architectures, the GPU-accelerated two-stage solver exhibits a parallel performance superior to the one-stage counterpart. Finally, we demonstrate the performance of the GPU-accelerated eigensolver developed in this work for routine semi-local KS-DFT calculations comprising thousands of atoms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Towards an Era of Low-Temperature Integral Critical Experiments: Surrogate Testing of Low-Temperature TEX Configurations

United States and IAEA regulations for the transportation of radioactive materials require that fissile materials must be subcritical under expected ambient temperatures ranging from -40°C to 38°C. While historical experiments have been conducted at room and elevated temperatures, no criticality integral benchmarks exist for temperatures below room temperature. The Low-Temperature Thermal Epithermal eXperiments (LT-TEX) aim to provide benchmark evaluations down to -40°C. The LT-TEX design incorporates stacked HEU plates interspersed with varying thicknesses of polyethylene disks to provide varying levels of moderation, with five configurations at 20°C having already been benchmarked. A novel vacuum/cryogenic chamber was fabricated to contain the LT-TEX configurations in a thermally isolated environment and cool it to -40°C. Prior to testing with fissile materials, testing with surrogate fuel plates was performed to characterize the thermal properties of the system, ensure no condensation forms on the stack, and to test that the uranium plates would not warp, or fracture during the thermal cycling. Surrogate testing has characterized the cryogenic chamber and verified its viability to perform the benchmark experiments, allowing for the next steps in the LT-TEX experimental campaign. The results of the surrogate testing are discussed and compared to heat transfer calculations performed as part of the experiment design process, to establish confidence in the thermal behavior of the system.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Qubit-Oscillator Concatenated Codes: Decoding Formalism and Code Comparison

Concatenating bosonic error-correcting codes with qubit codes can substantially boost the errorcorrecting power of the original qubit codes. It is not clear how to concatenate optimally, given that there are several bosonic codes and concatenation schemes to choose from, including the recently discovered Gottesman-Kitaev-Preskill (GKP) – stabilizer codes [Phys. Rev. Lett. 125, 080503 (2020)] that allow protection of a logical bosonic mode from fluctuations of the conjugate variables of the mode. We develop efficient maximum-likelihood decoders for and analyze the performance of three different concatenations of codes taken from the following set: qubit stabilizer codes, analog or Gaussian stabilizer codes, GKP codes, and GKP-stabilizer codes. We benchmark decoder performance against additive Gaussian white noise, corroborating our numerics with analytical calculations. We observe that the concatenation involving GKP-stabilizer codes outperforms the more conventional concatenation of a qubit stabilizer code with a GKP code in some cases. We also propose a GKP-stabilizer code that suppresses fluctuations in both conjugate variables without extra quadrature squeezing and formulate qudit versions of GKP-stabilizer codes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Assessment of fine-tuned large language models for real-world chemistry and material science applications

The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens doors to a wider chemical audience, as field-specific featurization techniques can be omitted. In this work, we explore the potential and limitations of this approach. We studied the performance of fine-tuning three open-source LLMs (GPT-J-6B, Llama-3.1-8B, and Mistral-7B) for a range of different chemical questions. We benchmark their performances against “traditional” machine learning models and find that, in most cases, the fine-tuning approach is superior for a simple classification problem. Depending on the size of the dataset and the type of questions, we also successfully address more sophisticated problems. The most important conclusions of this work are that, for all datasets considered, their conversion into an LLM fine-tuning training set is straightforward and that fine-tuning with even relatively small datasets leads to predictive models. These results suggest that the systematic use of LLMs to guide experiments and simulations will be a powerful technique in any research study, significantly reducing unnecessary experiments or computations.

Van Herck, Joren↗
DOE OSTI2022

Direct visualization of polaron formation in the thermoelectric SnSe

SnSe is a layered material that currently holds the record for bulk thermoelectric efficiency. The primary determinant of this high efficiency is thought to be the anomalously low thermal conductivity resulting from strong anharmonic coupling within the phonon system. Here we show that the nature of the carrier system in SnSe is also determined by strong coupling to phonons by directly visualizing polaron formation in the material. We employ ultrafast electron diffraction and diffuse scattering to track the response of phonons in both momentum and time to the photodoping of free carriers across the bandgap, observing the bimodal and anisotropic lattice distortions that drive carrier localization. Relatively large (18.7 Å), quasi-one-dimensional (1D) polarons are formed on the 300-fs timescale with smaller (4.2 Å) 3D polarons taking an order of magnitude longer (4 ps) to form. This difference appears to be a consequence of the profoundly anisotropic electron–phonon coupling in SnSe, with strong Fröhlich coupling only to zone-center polar optical phonons. These results demonstrate a high density of polarons in SnSe at optimal doping levels. Strong electron-phonon coupling is critical to the thermoelectric performance of this benchmark material and, potentially, high performance thermoelectrics more generally.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Evaluating the ProtoDUNE-SP Detector Performance to Measure a 6 GeV/c Positive Kaon Inelastic Cross Section on Argon

The ProtoDUNE Single-Phase Liquid Argon Time Projection Chamber \\ (ProtoDUNE-SP LArTPC) is a prototype for the Deep Underground Neutrino Experiment (DUNE), a future long-baseline neutrino oscillation experiment. Based at the CERN Neutrino Platform, ProtoDUNE-SP LArTPC collected data from a charged test beam in the fall of 2018. It then took data of cosmic-ray muons from November 2018 to the summer of 2020. The main goals of the prototype were to measure parameters related to charged particle passage in argon and evaluate the performance of the detector to inform future DUNE Far Detector development. The test beam provided kaons, pions, muons, protons, and electrons to the detector. These particles represent common final state particles in neutrino interactions, therefore providing information to DUNE on modeling charged particles in argon for its neutrino physics program. In addition to neutrino physics, DUNE has proposed an analysis using the DUNE Far Detector module to set limits for proton decay through the decay channel $p\rightarrow K^++\bar{\nu}$. This measurement would require information on kaons in argon, providing ProtoDUNE-SP LArTPC another opportunity to aid DUNE. This thesis describes the calibration of ProtoDUNE-SP and its detector performance, which serves as a benchmark for the performance of the DUNE Far Detector modules. A specific calibration highlighted is the evaluation of the liquid argon purity in the detector. These measurements use cosmic-ray muons reconstructed in the detector that are calibrated and matched to data from scintillator strips external to the TPC, known as the Cosmic Ray Tagger (CRT). The thesis will discuss the algorithms to match the data between the ProtoDUNE-SP LArTPC and the CRT and discuss the liquid argon purity measurements using one of the algorithms. Data sets of calibrated tracks measured the liquid argon contamination as consistently below 100 ppt oxygen equivalent. After these discussions on the ProtoDUNE-SP LArTPC detector, the thesis will present an evaluation of the inclusive inelastic, sometimes referred to as a reactive, cross section on argon of kaons from the ProtoDUNE-SP test beam with an average momentum of 6 GeV/c.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Development of a Pulsed Slowing-Down-Time Benchmark of Neutron Thermalization in Graphite

Graphite is a classic neutronic material that has been used as both a reactor reflector and moderator in various nuclear reactor systems. The ability to accurately predict the slowing down and thermalization of neutrons in graphite can have significant implications on the safety and operation of such reactor systems. In reactors, the neutron thermalization process is quantified using the thermal scattering law (TSL) and related cross sections for a given moderator. An ideal approach to assess the validity of TSL data is using benchmark measurement based on the pulsed Slowing-Down-Time technique and its comparison with the appropriate graphite nuclear library. In this work, experimental measurement and computational Monte Carlo simulations were performed to benchmark the slowing down characteristics and thermalization of neutrons in nuclear (reactor-grade) graphite. Given the density of graphite, various graphite libraries were selected for the benchmark analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗