Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer system benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

The TENNLab Suite of LIDAR-Based Control Applications for Recurrent, Spiking, Neuromorphic Systems

Recurrent, spiking neuromorphic systems (RSNS’s) have several desirable features compared to conventional neural networks when applied to applications that require real-time control. The TENNLab Exploratory Neuromorphic Computing Framework contains a variety of real-time control applications that use LIDAR for input, and allow a trained RSNS to make real-time decisions for navigation, surveillance and targeting. While each application is interesting on its own, the collection of applications is very useful for benchmarking RSNS’ s, evaluating training algorithms, and designing neuromorphic processing elements. In this paper, we describe the applications that compose the suite, and use them to benchmark four different RSNS’s.

Plank, James↗

Evaluation of the concrete shield compositions from the 2010 criticality accident alarm system Benchmark experiments at the CEA VALDUC silene facility - 14454

In October 2010, a series of benchmark experiments were conducted at the French Commissariat a l'energie Atomique et aux energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the United States Department of Energy Nuclear Criticality Safety Program and the CEA. The purpose of these experiments was to create three benchmarks for the verification and validation of radiation transport codes and evaluated nuclear data used in the analysis of criticality accident alarm systems. This series of experiments consisted of three single-pulsed experiments with the SILENE reactor. For the first experiment, the reactor was bare (unshielded), whereas in the second and third experiments, it was shielded by lead and polyethylene, respectively. The polyethylene shield of the third experiment had a cadmium liner on its internal and external surfaces, which vertically was located near the fuel region of SILENE. During each experiment, several neutron activation foils and thermoluminescent dosimeters (TLDs) were placed around the reactor. Nearly half of the foils and TLDs had additional high-density magnetite concrete, high-density barite concrete, standard concrete, and/or BoroBond shields. CEA Saclay provided all the concrete, and the US Y-12 National Security Complex provided the BoroBond. Measurement data from the experiments were published at the 2011 International Conference on Nuclear Criticality (ICNC 2011) and the 2013 Nuclear Criticality Safety Division (NCSD 2013) topical meeting. Preliminary computational results for the first experiment were presented in the ICNC 2011 paper, which showed poor agreement between the computational results and the measured values of the foils shielded by concrete. Recently the hydrogen content, boron content, and density of these concrete shields were further investigated within the constraints of the previously available data. New computational results for the first experiment are now available that show much better agreement with the measured values. (authors)

42 ENGINEERING↗

ReactionMechanismSimulator.jl: A modern approach to chemical kinetic mechanism simulation and analysis

Abstract We present ReactionMechanismSimulator.jl (RMS), a modern differentiable software for the simulation and analysis of chemical kinetic mechanisms, including multiphase systems. RMS has already been applied to problems in combustion, pyrolysis, polymers, pharmaceuticals, catalysis, and electrocatalysis. RMS is written in Julia, making it easy to develop and allowing it to take advantage of Julia's extensive numerical computing ecosystem. In addition to its extensive library of optimized analytic Jacobians, RMS can generate and use Jacobians computed using automatic differentiation and symbolically generated analytic Jacobians. RMS is demonstrated to be faster than Cantera and Chemkin in several benchmarks. RMS also implements an extensive set of features for analyzing chemical mechanisms, including a library of easy‐to‐call plotting functions, molecular structure resolved flux diagram generation, crash analysis, traditional sensitivity analysis, transitory sensitivity analysis, and an automatic mechanism analysis toolkit. RMS implements efficient adjoint and parallel forward sensitivity analyses. We also demonstrate the ease of adding new features to RMS.

Johnson, Matthew S.↗

Validation of SAS4A/SASSYS-1 for predicting steady-state single-phase natural circulation

The validation of system analysis codes for nuclear reactor systems is required for the development and application of these computational tools. Designed as a comprehensive system analysis code for advanced nuclear reactors, SAS4A/SASSYS-1 requires validation of its physics model for capturing single-phase natural circulation behavior. To support the validation of SAS4A/SASSYS-1, high-precision experiments are performed capturing steady-state single-phase natural circulation on a scaled facility with comprehensive instrumentation. In this work, dedicated tests are performed quantifying the critical modeling parameters, and a single-phase natural circulation benchmark dataset is obtained with well-documented uncertainty and comprehensive facility description. The validation is then performed against the dataset examining the capability of SAS4A/SASSYS-1 in simulating steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators which quantify and restrict numerical errors from discretization. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, quantifying the output uncertainty in a Monte Carlo approach. The composition of the output uncertainty is also quantified through a variance-based sensitivity analysis. With the uncertainty quantified for each individual condition, a detailed comparison between the simulation results and experimental data is performed covering the whole dataset. The results show consistent agreement for all primary parameters. The current validation activity provides a valuable benchmark dataset for the validation of system analysis codes in capturing single-phase natural circulation and demonstrates satisfactory prediction capability of SAS4A/SASSYS1 for steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Correlation energy extrapolation by many-body expansion

Accounting for electron correlation is required for high accuracy calculations of molecular energies. The full configuration interaction (CI) approach can fully capture the electron correlation within a given basis, but it does so at a computational expense that is impractical for all but the smallest chemical systems. In this work, a new methodology is presented to approximate configuration interaction calculations at a reduced computational expense and memory requirement, namely, the correlation energy extrapolation by many-body expansion (CEEMBE). This method combines a MBE approximation of the CI energy with an extrapolated correction obtained from CI calculations using subsets of the virtual orbitals. The extrapolation approach is inspired by, and analogous to, the method of correlation energy extrapolation by intrinsic scaling. Benchmark calculations of the new method are performed on diatomic fluorine and ozone. Finally, the method consistently achieves agreement with CI calculations to within a few mhartree and often achieves agreement to within ~1 millihartree or less, while requiring significantly less computational resources.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Parallel application-level behavioral attributes for performance and energy management of high-performance computing systems

Run time variability of parallel applications continues to present significant challenges to their performance and energy efficiency in high-performance computing (HPC) systems. When run times are extended and unpredictable, application developers perceive this as a degradation of system (or subsystem) performance. Extended run times directly contribute to proportionally higher energy consumption, potentially negating efforts by applications, or the HPC system, to optimize energy consumption using low-level control techniques, such as dynamic voltage and frequency scaling (DVFS). Therefore, successful systemic management of application run time performance can result in less wasted energy, or even energy savings. We have been studying run time variability in terms of communication time, from the perspective of the application, focusing on the interconnection network. More recently, our focus has shifted to developing a more complete understanding of the effects of HPC subsystem interactions on parallel applications. In this context, the set of executing applications on the HPC system is treated as a subsystem, along with more traditional subsystems like the communication subsystem, storage subsystem, etc. To gain insight into the run time variability problem, our earlier work developed a framework to emulate parallel applications (PACE) that stresses the communication subsystem. Evaluation of run time sensitivity to network performance of real applications is performed with a tool called PARSE, which uses PACE. In this paper, we propose a model defining application-level behavioral attributes, that collectively describes how applications behave in terms of their run time performance, as functions of their process distribution on the system (spacial locality), and subsystem interactions (communication subsystem degradation). These subsystem interactions are produced when multiple applications execute concurrently on the same HPC system. We also revisit our evaluation framework and tools to demonstrate the flexibility of our application characterization techniques, and the ease with which attributes can be quantified. The validity of the model is demonstrated using our tools with several parallel benchmarks and application fragments. Results suggest that it is possible to articulate application-level behavioral attributes as a tuple of numeric values that describe course-grained performance behavior.

Computer Science↗

Benchmarking the pseudopotential and fixed-node approximations in diffusion Monte Carlo calculations of molecules and solids

Diffusion Monte Carlo (DMC) calculations of the spectroscopic properties of a large set of molecules were performed, assessing the effect of different approximations. In systems containing elements with large atomic numbers, we show that the errors associated with the use of nonlocal mean-field-based pseudopotentials in DMC calculations can be significant and may surpass the fixed-node error. We suggest practical guidelines for reducing these pseudopotential errors, which allow us to obtain DMC-computed spectroscopic parameters of molecules and equation of state properties of solids in excellent agreement with experiment.

36 MATERIALS SCIENCE↗

A quantum eigenvalue solver based on tensor networks

Electronic ground states are of central importance in chemical simulations, but have remained beyond the reach of efficient classical algorithms except in cases of weak electron correlation or one-dimensional spatial geometry. We introduce a hybrid quantum-classical eigenvalue solver that constructs a wavefunction ansatz from a linear combination of matrix product states in rotated orbital bases, enabling the characterization of strongly correlated ground states with arbitrary spatial geometry. The energy is converged via a gradient-free generalized sweep algorithm based on quantum subspace diagonalization, with a potentially exponential speedup in the off-diagonal matrix element contractions upon translation into compact quantum circuits of linear depth in the number of qubits. Chemical accuracy is attained in numerical experiments for both a stretched water molecule and an octahedral arrangement of hydrogen atoms, achieving substantially better correlation energies compared to a unitary coupled-cluster benchmark, with orders of magnitude reductions in quantum resource estimates and a surprisingly high tolerance to shot noise. This proof-of-concept study suggests a promising new avenue for scaling up simulations of strongly correlated chemical systems on near-term quantum hardware.

chemistry↗

Milestone M1 Report: HBM2/3 Evaluation on Many-core CPU WBS 2.4, Milestone ECP-MT-1000

In HIHE01-1, "Evaluate a PathForward/Facilities memory-relevant performance study/analysis," we conducted a focused study on the performance differences between HBM2 and HBM3 as revealed through execution of representative benchmarks. We used measurements on an existing many-core system, Knight's Landing (KNL), to calibrate simulator settings, and then performed Structural Simulation Toolkit (SST) simulations of KNL-like CPUs that access future high bandwidth memories. This report documents our findings.

97 MATHEMATICS AND COMPUTING↗

Development and Validation of Scale Nuclear Analysis Methods for High Temperature Gas-Cooled Reactors

In support of the U.S. Nuclear Regulatory Commission, ORNL is updating the nuclear analysis methods and data in the SCALE code system to support modeling of HTGRs. Development activities include methods used for reactor physics, criticality safety, and radiation shielding. This paper focuses on the nuclear methods in support of reactor physics, which primarily include lattice physics for cross-section processing of both prismatic and pebble-bed designs, Monte Carlo depletion methods and efficiency improvements for double heterogeneous fuels, and validation against relevant experiments. These methods enhancements are being validated using available experimental data from the HTTR and HTR-10 startup and initial criticality experiments. Results obtained with three-dimensional Monte Carlo models of the HTTR initial core critical configurations with SCALE6/KENO show excellent agreement between the continuous energy and multigroup methods and the results are consistent with results obtained by others. A three-dimensional multigroup Monte Carlo model for the initial critical core of the HTR-10 has been developed with SCALE6/KENO based on the benchmark specifications included in the IRPhE Handbook. The core eigenvalue obtained with this model is in very good agreement with the corresponding value obtained with a consistent continuous energy MCNP5 core model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗

Modeling City Building Stock for Large-Scale Energy Efficiency Improvements using CityBES

Buildings in San Francisco consumed 52% of total primary energy. Improving building energy efficiency is one of the key strategies cities are adopting towards their energy and climate goals. Urban building energy models (UBEM) can support city managers to evaluate and prioritize energy conservation measures for investment and to design effective incentive and rebate programs. This paper introduces methods to develop a standardized dataset of city building stock, and it demonstrates the use of a UBEM tool, City Building Energy Saver (CityBES), for an urban-scale energy retrofit analysis of building stock in the city of San Francisco. CityBES is an open web-based data and computing platform providing city-scale building energy modeling and performance visualization and benchmarking. CityBES utilizes an international standard CityGML to represent the three-dimensional building stock in cities. As an application example, 940 office and retail buildings in six districts of northeast San Francisco were modeled and analyzed with CityBES to evaluate energy savings for five selected measures. The analysis found that replacing existing lighting with LED and adding an air economizer to HVAC systems are cost-effective measures with combined savings per building between 17% to 31%. The CityBES retrofit analysis feature does not require users to have deep knowledge of building systems or building energy models, which helps overcome barriers for city managers and their consultants to adopt UBEM.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Criticality Safety Validation of Scale 6.1

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Experiment Program (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). A total of more than 350 cases from this reference have been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID) maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the Scale 6.1 code system with ENDF/B-VII.0 cross-section data in 238-group and continuous energy is assessed using the VALID models of benchmark experiments. The TSUNAMI tools for sensitivity and uncertainty analysis are utilized to examine some systems further in an attempt to identify potential causes of unexpected results. The critical experiments available for validation of the KENO V.a code cover eight different broad categories of systems. These systems use a range of fissile materials including a range of uranium enrichments, various plutonium isotopic vectors, and mixed uranium-plutonium oxides. The physical form of the fissile material also varies and is represented as metal, solutions, or arrays of rods or plates in a water moderator. The neutron energy spectra of the systems also vary and cover both fast and thermal spectra. Over 300 of the total cases used utilize the KENO V.a code. The critical experiments available for the validation of the KENO-VI code cover three broad categories of systems. The fissile materials in the systems vary and include high and intermediate-enrichment uranium and mixed uranium/plutonium oxides. The physical form of the fissile material is either metal or rod arrays in water. As with KENO V.a, both fast and thermal neutron energy spectra are represented in the systems considered. The results indicate generally good performance of both the KENO V.a and KENO-VI codes across the range of systems analyzed. The bias of calculated k{sub eff} from expected values is less than 0.9% {Delta}k in all cases. All eight categories of experiments show biases of less than 0.5% {Delta}k in KENO V.a with the exception of intermediate enrichment metal systems using the 238-group library. The continuous energy library generally manifests lower biases than the multi-group data. The KENO-VI results show slightly larger biases, though this may primarily be the result of modeling systems with more geometric complexity, which are more difficult to describe accurately, even with a generalized geometry code like KENO-VI. Several additional conclusions can be drawn from the results of this validation effort. These conclusions include that the TSUNAMI tools can be used successfully to explain the cause of aberrant results, that some evaluations in the IHECSBE should be updated to provide more rigorous expected k{sub eff} values and uncertainties, and that potential cross-section errors can be identified by detailed review of the results of this validation. It also appears that the overall cross-section uncertainty as quantified through the Scale covariance library is overestimated. Overall, the KENO V.a and KENO-VI codes are shown to provide consistent, low bias results for a wide range of physical systems of potential interest in criticality safety applications.

Marshall, William BJ J↗

Criticality Safety Validation of SCALE 6.1 (Revised)

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Experiment Program (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). A total of more than 350 cases from this reference have been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID) maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the SCALE 6.1 code system with ENDF/B-VII.0 cross-section data in 238-group and continuous energy is assessed using the VALID models of benchmark experiments. The TSUNAMI tools for sensitivity and uncertainty analysis are utilized to examine some systems further in an attempt to identify potential causes of unexpected results. The critical experiments available for validation of the KENO V.a code cover eight different broad categories of systems. These systems use a range of fissile materials including a range of uranium enrichments, various plutonium isotopic vectors, and mixed uranium/plutonium oxides. The physical form of the fissile material also varies and is represented as metal, solutions, or arrays of rods or plates in a water moderator. The neutron energy spectra of the systems also vary and cover both fast and thermal spectra. Over 300 of the total cases used utilize the KENO V.a code. The critical experiments available for the validation of the KENO-VI code cover three broad categories of systems. The fissile materials in the systems vary and include high- and intermediate-enrichment uranium and mixed uranium/plutonium oxides. The physical form of the fissile material is either metal or rod arrays in water. As with KENO V.a, both fast and thermal neutron energy spectra are represented in the systems considered. The results indicate generally good performance of both the KENO V.a and KENO-VI codes across the range of systems analyzed. The bias of calculated k eff from expected values is less than 0.9% Δk in all cases. All eight categories of experiments show biases of less than 0.5% Δk in KENO V.a with the exception of intermediate enrichment metal systems using the 238-group library. The continuous energy library generally manifests lower biases than the multigroup data. The KENO-VI results show slightly larger biases, though this may primarily be the result of modeling systems with more geometric complexity, which are more difficult to describe accurately, even with a generalized geometry code like KENO-VI. Several additional conclusions can be drawn from the results of this validation effort. These conclusions include that the TSUNAMI tools can be used successfully to explain the cause of aberrant results, that some evaluations in the IHECSBE should be updated to provide more rigorous expected k eff values and uncertainties, and that potential cross-section errors can be identified by detailed review of the results of this validation. It also appears that the overall cross-section uncertainty as quantified through the SCALE covariance library is overestimated. Overall, the KENO V.a and KENO-VI codes are shown to provide consistent, low-bias results for a wide range of physical systems of potential interest in criticality safety applications.

Marshall, William (BJ) J.↗

Benchmark studies of thermal jet mixing in SFRs using a two-jet model

To guide the modeling, simulations and design of Sodium Fast Reactors (SFRs), we explore and compare the predictive capabilities of two numerical solvers COMSOL and OpenFOAM in the thermal jet mixing of two buoyant jets typical of the outlet flow from a SFR tube bundle. This process will help optimize on-going experimental efforts at obtaining high resolution data for V and V of CFD codes as anticipated in next generation nuclear systems. Using the k-{epsilon} turbulence models of both codes as reference, their ability to simulate the turbulence behavior in similar environments was first validated for single jet experimental data reported in literature. This study investigates the thermal mixing of two parallel jets having a temperature difference (hot-to-cold) {Delta}T{sub hc}= 5 deg. C, 10 deg. C and velocity ratios U{sub c}/U{sub h} = 0.5, 1. Results of the computed turbulent quantities due to convective mixing and the variations in flow field along the axial position are presented. In addition, this study also evaluates the effect of spacing ratio between jets in predicting the flow field and jet behavior in near and far fields. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

OpenSHMEM-UCX: Evaluation of UCX for Implementing OpenSHMEM Programming Model, In: OpenSHMEM 2016: OpenSHMEM and Related Technologies. Enhancing OpenSHMEM for Hybrid Environments

The OpenSHMEM reference implementation was developed towards the goal of developing an open source and high-performing OpenSHMEM implementation. To achieve portability and performance across various networks, the OpenSHMEM reference implementation uses GASNet and UCCS for network operations. Recently, new network layers have emerged with the promise of providing high-performance, scalability, and portability for HPC applications. In this paper, we implement the OpenSHMEM reference implementation to use the UCX framework for network operations. Then, we evaluate its performance and scalability on Cray XK systems to understand UCX’s suitability for developing the OpenSHMEM programming model. Further, we develop a benchmark called SHOMS for evaluating the OpenSHMEM implementation. Our experimental results show that OpenSHMEM-UCX outperforms the vendor supplied OpenSHMEM implementation in most cases on the Cray XK system by up to 40% with respect to message rate and up to 70% for the execution of application kernels.

Computer Science↗

OpenSHMEM and Related Technologies. Big Compute and Big Data Convergence

This book constitutes the proceedings of the 4th OpenSHMEM Workshop, held in Annapolis, MD, USA, in August 2017.The 11 full papers presented in this book were carefully reviewed and selected from 14 submissions. The papers discuss a variety of ideas for extending the OpenSHMEM specification and making it efficient for current and next generation systems. This includes new research for communication contexts in OpenSHMEM, different optimizations for OpenSHMEM on shared memory machines, exploring the implementation of OpenSHMEM and its memory model on Intel’s KNL architecture, and implementing new applications and benchmarks with OpenSHMEM.

Gorentla Venkata, Manjunath↗

Comparison of Different Upscaling Methods for Predicting Thermal Conductivity of Complex Heterogeneous Materials System: Application on Nuclear Waste Forms

To develop a strategy in thermal conductivity prediction of a complex heterogeneous materials system, loaded nuclear waste forms, the computational efficiency and accuracy of different upscaling methods have been evaluated. The effective thermal conductivity, obtained from microstructure information and local thermal conductivity of different components, is critical in predicting the life and performance of waste form during storage. Several methods, including the Taylor model, Sachs model, self-consistent model, and statistical upscaling method, were developed and implemented. Microstructure based finite element method (FEM) prediction results were used to as benchmark to determine the accuracy of the different upscaling methods. Micrographs from waste forms with varying waste loadings were used in the prediction of thermal conductivity in FEM and homogenization methods. Prediction results demonstrated that in term of efficiency, boundary models (e.g., Taylor model and Sachs model) are stronger than the self-consistent model, statistical upscaling method, and finite element method. However, when balancing computational efficiency and accuracy, statistical upscaling is a useful method in predicting effective thermal conductivity for nuclear waste forms.

36 MATERIALS SCIENCE↗