Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

ℤ2 × ℤ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks

This paper presents a comparative analysis of the performance of Equivariant Quantum Neural Networks (EQNNs) and Quantum Neural Networks (QNNs), juxtaposed against their classical counterparts: Equivariant Neural Networks (ENNs) and Deep Neural Networks (DNNs). We evaluate the performance of each network with three two-dimensional toy examples for a binary classification task, focusing on model complexity (measured by the number of parameters) and the size of the training dataset. Our results show that the Z2×Z2 EQNN and the QNN provide superior performance for smaller parameter sets and modest training data samples.

Dong, Zhongtian (ORCID:0000000210003454)↗

DataStager: scalable data staging services for petascale applications

Known challenges for petascale machines are that (1) the costs of I/O for high performance applications can be substantial, especially for output tasks like checkpointing, and (2) noise from I/O actions can inject undesirable delays into the runtimes of such codes on individual compute nodes. This paper introduces the flexible 'DataStager' framework for data staging and alternative services within that jointly address (1) and (2). Data staging services moving output data from compute nodes to staging or I/O nodes prior to storage are used to reduce I/O overheads on applications total processing times, and explicit management of data staging offers reduced perturbation when extracting output data from a petascale machine's compute partition. Experimental evaluations of DataStager on the Cray XT machine at Oak Ridge National Laboratory establish both the necessity of intelligent data staging and the high performance of our approach, using the GTC fusion modeling code and benchmarks running on 1000+ processors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluation of Repurposing Archetypal Preventive Radiological/Nuclear Detectors to the Consequence Management Mission

In the first hours or days after an unplanned release of radioactive material to the environment, the radiation detection instruments most widely available to local first responders may be those currently fielded for interdiction missions. This study investigated how such preventative radiological / nuclear detection instruments could perform if repurposed to consequence management missions. A representative sample of three archetypes (body-worn, human carried, and other/large detection volume) encompassed six categories: personal radiation detector, extended range personal radiation detector, personal emergency radiation detector, radio-isotope identification device, human portable detector/backpack, and vehicle mounted large detection volume. Overall 19 models of equipment were included in the study. Laboratory evaluations were designed to assess the capabilities of the instruments in four consequence management missions: exposure rate, integrated exposure, radiation survey, and contamination screening. As applicable, the evaluations included measurement of exposure rate, integrated exposure, overrange response, and angular response. The results were compared to benchmarks from the American National Standards Institute ANSI N42.49A. The performance of the instruments for initial screening for contamination was assessed by an automated radioactive source moving past the detectors at various speeds and distances. The results demonstrate that if the equipment is used in accordance with the mission analysis and categories, and within the original equipment manufacturer specifications, it is possible to achieve sufficient accuracy to estimate and document doses to responders, plan entries into contaminated areas, detect contamination, and protect the public, until such time as outside resources arrive with sufficient numbers of standard health physics instruments and personnel dosimetry to replace the preventative radiological / nuclear detection instruments. Finally, this evaluation campaign was conducted to complement the National Council on Radiation Protection and Measurements Report-179 on Guidance for Emergency Response Dosimetry.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

OpenACC Profiling Support for Clang and LLVM using Clacc and TAU

Since its launch in 2010, OpenACC has evolved into one of the most widely used portable programming models for accelerators on HPC systems today. Clacc is a project funded by the US Exascale Computing Project (ECP) to bring OpenACC support for C and C++ to the popular Clang and LLVM compiler infrastructure. In this paper, we describe Clacc's support for the OpenACC Profiling Interface, a critical component of the OpenACC specification that standardizes an interface that profiling tools and libraries can depend upon across OpenACC implementations. As part of Clacc's general strategy to build OpenACC support upon OpenMP, we describe how Clacc builds OpenACC Profiling Interface support upon an extended version of OMPT. We then describe how a major profiling and tracing toolkit within ECP, the TAU Performance System, takes advantage of this support. We also describe TAU's selective instrumentation support for OpenACC. Finally, using Clacc and TAU, we present example visualizations for several SPEC ACCEL OpenACC benchmarks running on an IBM AC922 node, and we show that the associated performance overhead is negligible.

Coti, Camille↗

Studies of Space Charge Effects in the Proposed CERN PS2

A new proton synchrotron, the PS2, is under design study to replace the current proton synchrotron at CERN for the LHC upgrade. Nonlinear space charge effects could cause significant beam emittance growth and particle losses and limit the performance of the PS2. In this paper, we report on studies of the potential space-charge effects at the PS2 using three-dimensional self-consistent macroparticle tracking codes, IMPACT, MaryLie/IMPACT, and Synergia. We will present initial benchmark results among these codes. Effects of space-charge on the emittance growth, especially due to synchrotron coupling, aperture sizes, initial painted distribution, and RF ramping scheme will also be discussed.

43 PARTICLE ACCELERATORS↗

Benchmarking characterization methods for noisy quantum circuits

Effective methods for characterizing the noise in quantum computing devices are essential for programming and debugging circuit performance. Existing approaches vary in the information obtained as well as the amount of quantum and classical resources required, with more information generally requiring more resources. Here we benchmark the characterization methods of gate set tomography, Pauli channel noise reconstruction, and empirical direct characterization for developing models that describe noisy quantum circuit performance on a 27-qubit superconducting transmon device. We evaluate these models by comparing the accuracy of noisy circuit simulations with the corresponding experimental observations. Here, we find that the agreement of noise model to experiment does not correlate with the information gained by characterization and that the underlying circuit strongly influences the best choice of characterization approach. Empirical direct characterization scales best of the methods we tested and produced the most accurate characterizations across our benchmarks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CFD modeling of turbulent air flow in self-heated gyroid TPMS structures: Thermal-hydraulic performance and validation

The application of mathematically derived geometries, such as triply periodic minimal surface (TPMS) lattices, has garnered significant interest across various fields, including the nuclear sector, due to their superior thermal-hydraulic characteristics for heat transfer compared to traditional plain or finned tubes. Here, this study validates a computational fluid dynamics (CFD) model, evaluates different turbulence models and CFD model settings, and performs uncertainty quantification to provide a comprehensive analysis. Despite extensive research on CFD modeling of TPMS lattices, such as gyroid and diamond geometries, there is a notable lack of publicly available literature providing comprehensive details on numerical analysis aspects, including convergence and methodological best practices. This study embarks on a benchmark analysis of a gyroid geometry to evaluate its thermal-hydraulic performance under turbulent flow conditions and scrutinize various CFD model configurations. The main contributions of this work include validating the CFD model, assessing and comparing different turbulence models, and enhancing pressure drop and temperature prediction capabilities. The results aim to support the development of methodologies needed to benchmark and enhance numerical analysis techniques for TPMS lattices. This work seeks to complement the existing body of knowledge, support the development of TPMS reactor concepts, and improve best practices for CFD modeling of TPMS lattices, ultimately advancing methodologies to support future applications in this domain.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Studying excited-state-specific perturbation theory on the Thiel set

Here, we explore the performance of a recently introduced N 5 -scaling excited-state-specific second order perturbation theory (ESMP2) on the singlet excitations of the Thiel benchmarking set. We find that, without regularization, ESMP2 is quite sensitive to π system size, performing well in molecules with small π systems but poorly in those with larger π systems. With regularization, ESMP2 is far less sensitive to π system size and shows a higher overall accuracy on the Thiel set than CC2, equation of motion-coupled cluster with singles and doubles, CC3, and a wide variety of time-dependent density functional approaches. Unsurprisingly, even regularized ESMP2 is less accurate than multi-reference perturbation theory on this test set, which can, in part, be explained by the set’s inclusion of some doubly excited states but none of the strong charge transfer states that often pose challenges for state-averaging. Beyond energetics, we find that the ESMP2 doubles norm offers a relatively low-cost way to test for doubly excited character without the need to define an active space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

GPU-accelerated kinetic Hall thruster simulations in WarpX

Abstract Two-dimensional (axial-azimuthal) simulations of a Hall thruster are performed using the open-source particle-in-cell code WarpX. The simulation conditions are chosen to match those of the axial-azimuthal benchmark first reported by Charoy et al. in 2019. A range of numerical and solver parameters is investigated in order to find those which yield the best performance. It is found that WarpX completes the benchmark case in 3.8 days on an Nvidia V100 GPU, and in as low as 1.5 days on a more recent Nvidia H100 GPU. Of the numerical parameters investigated, it is determined that the field-solve tolerance and particle resampling thresholds have the largest effect on the simulation wall time and that particle resampling may artificially widen electron velocity distribution functions, leading to unphysical heating. A semi-implicit scheme for the electrostatic field solve is tested and is found to produce results consistent to within 10% of the benchmark in less than twelve hours. The scaling properties of the electrostatic solver to multiple GPUs are also assessed on a uniform plasma test problem. The results of this work are discussed in the context of advancements in GPU hardware and the suitability of kinetic Hall thruster simulations for engineering applications.

Marks, Thomas A.↗

CALiPER Application Summary Report 22: LED MR16 Lamps

An initial sample of 27 LED MR16 lamps and 8 halogen benchmarks underwent photometric testing according to IES LM-79-08. CALiPER Application Summary Report 22 focuses on the initial performance based on light output, efficacy, distribution, color quality, electrical characteristics, and form factor, with comparisons to the benchmarks and ENERGY STAR qualification thresholds.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Benchmark of Advanced Burner Test Reactor Model Using MCNPX 2.6.0 and ERANOS 2.1

Significant research is currently being performed whereby fast reactor cores have been designed to burn transuranic materials reducing the volume and long-term radiotoxicity of spent nuclear fuel. These core and depletion models depend on various computer codes. This research used MCNPX 2.6.0 and ERANOS 2.1 to model a standard 250MWt Advanced Burner Test Reactor (ABTR) core. The intent was to benchmark criticality and burnup results from a stochastic Monte Carlo code and a deterministic depletion code using a standard ABTR model created by Argonne National Laboratory. Because each of these codes solve the transport and burnup problem differently, there is a need to benchmark the core models in order to verify results and identify root causes for significant differences in results between codes. Flux calculations in ERANOS were performed using diffusion theory, Legendre polynomial approximations (using the VARIANT module) and discrete ordinates methods. The k-effective for the higher-order transport models remained within 1000 pcm of the MCNPX model. The difference between the total heavy nuclide mass balance in ERANOS using the various flux calculations and the MCNPX depletion model was less than 0.4% out to a burnup of 1095 days (67.45 GWd/MTHM). For individual heavy nuclides, the depletion models closely matched (< 5.0 % difference) throughout the depletion for isotopes of Uranium, Neptunium and Plutonium and most of the higher transuranics. Notable exceptions were 242Am, 242Cm, 243Cm and 246Cm where differences ranged from 0.1 – 0.2% after 26 days and increased to 11 - 136% at 1095 days.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SynTec Final Technical Report: Synthetic biology for Tailored Enzyme cocktails

Using a novel enzyme screening method inspired by synthetic biology, Novozymes developed new technology under SynTec which allows for more rapidly tailoring of enzyme cocktails. The methodology can be applied to specific feedstocks, and or coupled to address a specific hydrolytic conversion process context. Using combinatorial high throughput screening of libraries of enzyme domains, we can quickly assess which combination of catalytic modules delivers the best performance for a specific condition. To demonstrate the effectiveness of the screening process, we measured performance of the output catalytic cocktail compared to CTec3/HTec3. SynTec benchmark cocktail - blend of Cellic® CTec3 and HTec3. The test substrate was - ammonia fiber expansion pretreated corn stover (AFEX™ PCS).CTec3/HTec3 was assayed at the optimal pH and temperature, and also in the absence of any pH adjustment. The new enzyme cocktail discovered under SynTec was assayed in the absence of any pH adjustment and at the optimal temperature. Conversion is delivered by SynTec enzyme at significant dose reduction relative to CTec3/HTec3 at the controlled pH optimum, and without titrant required to maintain pH, which delivers additional cost savings relative to current state of the art process. In this 2.5 year $4M project, the team delivered an experimental cocktail that significantly outperformed CTec3/HTec3 for a specific substrate, and for specific hydrolysis conditions. As a means of comparing performance improvement delivered per research dollar spent, we note that SynTec delivered a similar performance improvement to the previous award, in a shorter time and with fewer resources than for the previously successful DOE project DECREASE, a 3.5 year, $25M project, though this project focused on a different substrate and used different hydrolysis conditions. The newly implemented technology for rapid sourcing of new cellulases and hemicellulases from nature is an example of Novozymes' continued innovation that results in more effective products for the advanced biofuel market.

09 BIOMASS FUELS↗

Noiseless Vlasov–Poisson simulations with linearly transformed particles

We introduce a deterministic discrete-particle simulation approach, the Linearly-Transformed Particle-In-Cell (LTPIC) method, that employs linear deformations of the particles to reduce the noise traditionally associated with particle schemes. Formally, transforming the particles is justified by local first order expansions of the characteristic flow in phase space. In practice the method amounts of using deformation matrices within the particle shape functions; these matrices are updated via local evaluations of the forward numerical flow. Because it is necessary to periodically remap the particles on a regular grid to avoid excessively deforming their shapes, the method can be seen as a development of Denavit's Forward Semi-Lagrangian (FSL) scheme (Denavit, 1972 [8]). However, it has recently been established (Campos Pinto, 2012 [20]) that the underlying Linearly-Transformed Particle scheme converges for abstract transport problems, with no need to remap the particles; deforming the particles can thus be seen as a way to significantly lower the remapping frequency needed in the FSL schemes, and hence the associated numerical diffusion. To couple the method with electrostatic field solvers, two specific charge deposition schemes are examined, and their performance compared with that of the standard deposition method. Finally, numerical 1d1v simulations involving benchmark test cases and halo formation in an initially mismatched thermal sheet beam demonstrate some advantages of our LTPIC scheme over the classical PIC and FSL methods. Benchmarked test cases also indicate that, for numerical choices involving similar computational effort, the LTPIC method is capable of accuracy comparable to or exceeding that of state-of-the-art, high-resolution Vlasov schemes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmarking soil moisture and its relationship to ecohydrologic variables in Earth System Models

Soil moisture (SM) is a key regulator of ecosystem biogeophysics, influencing plant water relations and land-atmosphere energy exchanges. We evaluate the representation of SM in 16 Earth System Models from the Coupled Model Intercomparison Project Phase 6 (CMIP6) using the International Land Model Benchmarking (ILAMB) framework, focusing on surface (0–5, 0–10 cm) and rootzone (0–100 cm) depths, as well as key ecohydrological variables like gross primary productivity (GPP), leaf area index (LAI), and evapotranspiration (ET), and their coupling. Models are benchmarked against multiple observational and assimilated datasets to assess both state variables and cross-variable relationships. Surface SM is generally well represented (r > 0.87), while rootzone SM variability is systematically overestimated (normalized standard deviation > 1). ET shows strong agreement with observations (r > 0.9), whereas GPP and LAI exhibit larger inter-model spread. Skill in individual variables does not guarantee realistic SM–ecohydrology coupling, which varies strongly across models and depends on the reference dataset. Köppen-based regional analyses reveal strong regime dependence, with several models performing well in Tropical and Temperate regions but degrading in Continental (high-latitude) zones. Across both global and regional benchmarks, models cluster by land surface framework, indicating that structural choices in soil hydrology and soil–plant coupling exert a first-order control on performance. These results provide process-relevant benchmarks and suggest that improving the representation of vertical soil structure, rooting depth distributions, and soil–plant hydraulic coupling will be central to advancing soil moisture realism in next-generation Earth system models.

CMIP6↗

Comparison of the PHISICS/RELAP5-3D Ring and Block Model Results for Phase I of the OECD MHTGR-350 Benchmark

The INL PHISICS code system consists of three modules providing improved core simulation capability: INSTANT (performing 3D nodal transport core calculations), MRTAU (depletion and decay heat generation) and a perturbation/mixer module. Coupling of the PHISICS code suite to the thermal hydraulics system code RELAP5-3D has recently been finalized, and as part of the code verification and validation program the exercises defined for Phase I of the OECD/NEA MHTGR 350 MW Benchmark were completed. This paper provides an overview of the MHTGR Benchmark, and presents selected results of the three steady state exercises 1-3 defined for Phase I. For Exercise 1, a stand-alone steady-state neutronics solution for an End of Equilibrium Cycle Modular High Temperature Reactor (MHTGR) was calculated with INSTANT, using the provided geometry, material descriptions, and detailed cross-section libraries. Exercise 2 required the modeling of a stand-alone thermal fluids solution. The RELAP5-3D results of four sub-cases are discussed, consisting of various combinations of coolant bypass flows and material thermophysical properties. Exercise 3 combined the first two exercises in a coupled neutronics and thermal fluids solution, and the coupled code suite PHISICS/RELAP5-3D was used to calculate the results of two sub-cases. The main focus of the paper is a comparison of the traditional RELAP5-3D “ring” model approach vs. a much more detailed model that include kinetics feedback on individual block level and thermal feedbacks on a triangular sub-mesh. The higher fidelity of the block model is illustrated with comparison results on the temperature, power density and flux distributions, and the typical under-predictions produced by the ring model approach are highlighted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic-boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8-day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. Here, to further reduce the remaining bias in GPP after LAI bias correction, we re-parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

58 GEOSCIENCES↗

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗

Thermo-mechanical study of bare 48Y UF6 containers exposed to the regulatory fire environment.

Most of the regulatory agencies world-wide require that containers used for the transportation of natural UF6 and depleted UF6 must survive a fully-engulfing fire environment for 30 minutes as described in 10CFR71 and in TS-R-1. The primary objective of this project is to examine the thermo-mechanical performance of 48Y transportation cylinders when exposed to the regulatory hypothetical fire environment without the thermal protection that is currently used for shipments in those countries where required. Several studies have been performed in which UF6 cylinders have been analyzed to determine if the thermal protection currently used on UF6 cylinders of type 48Y is necessary for transport. However, none of them could clearly confirm neither the survival nor the failure of the 48Y cylinder when exposed to the regulatory fire environment without the additional thermal protection. A consortium of five companies that move UF6 is interested in determining if 48Y cylinders can be shipped without the thermal protection that is currently used. Sandia National Laboratories has outlined a comprehensive testing and analysis project to determine if these shipping cylinders are capable of withstanding the regulatory thermal environment without additional thermal protection. Sandia-developed coupled physics codes will be used for the analyses that are planned. A series of destructive and non-destructive tests will be performed to acquire the necessary material and behavior information to benchmark the models and to answer the question about the ability of these containers to survive the fire environment. Both the testing and the analysis phases of this project will consider the state of UF6 under thermal and pressure loads as well as the weakening of the steel container due to the thermal load. Experiments with UF6 are also planned to collect temperature- and pressure-dependent thermophysical properties of this material.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗