Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer system benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

An Expanded Role for Python in Expediting System Simulation Development

The Python programming language has traditionally been used as a “scripting” language and is not generally recognized as a language for building system simulations, where C++, Java, and other compiled languages are typically used. While very powerful and gaining favor for a large set of programming tasks, Python is generally regarded as not having the speed to directly do the extensive numeric computations required in large-scale simulation. This paper aims to present an approach, supported by case studies, to re-think this assertion. Directly using Python in this new role has the potential to expedite an agile, spiral cycle of development of design-test-modify for systems simulation.

programming language↗

Evaluation of the concrete shield compositions from the 2010 criticality accident alarm system Benchmark experiments at the CEA VALDUC silene facility - 14454

In October 2010, a series of benchmark experiments were conducted at the French Commissariat a l'energie Atomique et aux energies Alternatives (CEA) Valduc SILENE facility. These experiments were a joint effort between the United States Department of Energy Nuclear Criticality Safety Program and the CEA. The purpose of these experiments was to create three benchmarks for the verification and validation of radiation transport codes and evaluated nuclear data used in the analysis of criticality accident alarm systems. This series of experiments consisted of three single-pulsed experiments with the SILENE reactor. For the first experiment, the reactor was bare (unshielded), whereas in the second and third experiments, it was shielded by lead and polyethylene, respectively. The polyethylene shield of the third experiment had a cadmium liner on its internal and external surfaces, which vertically was located near the fuel region of SILENE. During each experiment, several neutron activation foils and thermoluminescent dosimeters (TLDs) were placed around the reactor. Nearly half of the foils and TLDs had additional high-density magnetite concrete, high-density barite concrete, standard concrete, and/or BoroBond shields. CEA Saclay provided all the concrete, and the US Y-12 National Security Complex provided the BoroBond. Measurement data from the experiments were published at the 2011 International Conference on Nuclear Criticality (ICNC 2011) and the 2013 Nuclear Criticality Safety Division (NCSD 2013) topical meeting. Preliminary computational results for the first experiment were presented in the ICNC 2011 paper, which showed poor agreement between the computational results and the measured values of the foils shielded by concrete. Recently the hydrogen content, boron content, and density of these concrete shields were further investigated within the constraints of the previously available data. New computational results for the first experiment are now available that show much better agreement with the measured values. (authors)

42 ENGINEERING↗

ReactionMechanismSimulator.jl: A modern approach to chemical kinetic mechanism simulation and analysis

Abstract We present ReactionMechanismSimulator.jl (RMS), a modern differentiable software for the simulation and analysis of chemical kinetic mechanisms, including multiphase systems. RMS has already been applied to problems in combustion, pyrolysis, polymers, pharmaceuticals, catalysis, and electrocatalysis. RMS is written in Julia, making it easy to develop and allowing it to take advantage of Julia's extensive numerical computing ecosystem. In addition to its extensive library of optimized analytic Jacobians, RMS can generate and use Jacobians computed using automatic differentiation and symbolically generated analytic Jacobians. RMS is demonstrated to be faster than Cantera and Chemkin in several benchmarks. RMS also implements an extensive set of features for analyzing chemical mechanisms, including a library of easy‐to‐call plotting functions, molecular structure resolved flux diagram generation, crash analysis, traditional sensitivity analysis, transitory sensitivity analysis, and an automatic mechanism analysis toolkit. RMS implements efficient adjoint and parallel forward sensitivity analyses. We also demonstrate the ease of adding new features to RMS.

Johnson, Matthew S.↗

Validation of SAS4A/SASSYS-1 for predicting steady-state single-phase natural circulation

The validation of system analysis codes for nuclear reactor systems is required for the development and application of these computational tools. Designed as a comprehensive system analysis code for advanced nuclear reactors, SAS4A/SASSYS-1 requires validation of its physics model for capturing single-phase natural circulation behavior. To support the validation of SAS4A/SASSYS-1, high-precision experiments are performed capturing steady-state single-phase natural circulation on a scaled facility with comprehensive instrumentation. In this work, dedicated tests are performed quantifying the critical modeling parameters, and a single-phase natural circulation benchmark dataset is obtained with well-documented uncertainty and comprehensive facility description. The validation is then performed against the dataset examining the capability of SAS4A/SASSYS-1 in simulating steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators which quantify and restrict numerical errors from discretization. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, quantifying the output uncertainty in a Monte Carlo approach. The composition of the output uncertainty is also quantified through a variance-based sensitivity analysis. With the uncertainty quantified for each individual condition, a detailed comparison between the simulation results and experimental data is performed covering the whole dataset. The results show consistent agreement for all primary parameters. The current validation activity provides a valuable benchmark dataset for the validation of system analysis codes in capturing single-phase natural circulation and demonstrates satisfactory prediction capability of SAS4A/SASSYS1 for steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Correlation energy extrapolation by many-body expansion

Accounting for electron correlation is required for high accuracy calculations of molecular energies. The full configuration interaction (CI) approach can fully capture the electron correlation within a given basis, but it does so at a computational expense that is impractical for all but the smallest chemical systems. In this work, a new methodology is presented to approximate configuration interaction calculations at a reduced computational expense and memory requirement, namely, the correlation energy extrapolation by many-body expansion (CEEMBE). This method combines a MBE approximation of the CI energy with an extrapolated correction obtained from CI calculations using subsets of the virtual orbitals. The extrapolation approach is inspired by, and analogous to, the method of correlation energy extrapolation by intrinsic scaling. Benchmark calculations of the new method are performed on diatomic fluorine and ozone. Finally, the method consistently achieves agreement with CI calculations to within a few mhartree and often achieves agreement to within ~1 millihartree or less, while requiring significantly less computational resources.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A determination of the external forces required to move the benchmark active controls testing model in pure plunge and pure pitch

In view of the strong need for a well-documented set of experimental data which is suitable for the validation and/or calibration of modern Computational Fluid Dynamics codes, the Benchmark Models Program was initiated by the Structural Dynamics Division of the NASA Langley Research Center. One of the models in the program, the Benchmark Active Controls Testing Model, consists of a rigid wing of rectangular planform with a NACA 0012 profile and three control surfaces (a trailing-edge control surface, a lower-surface spoiler, and an upper-surface spoiler). The model is affixed to a flexible mount system which allows only plunging and/or pitching motion. An approximate analytical determination of the forces required to move this model, with its control surfaces fixed, in pure plunge and pure pitch at a number of test conditions is included. This provides a good indication of the type of actuator system required to generate the aerodynamic data resulting from pure plunging and pure pitching motion, in which much interest was expressed. The analysis makes use of previously obtained numerical results.

Dcruz, Jonathan↗

NCCDS performance model

The NASA/GSFC Network Control Center (NCC) provides communication services between ground facilities and spacecraft missions in near-earth orbit that use the Space Network. The NCC Data System (NCCDS) provides computational support and is expected to be highly utilized by the service requests needed in the future years. A performance model of the NCCDS has been developed to assess the future workload and possible enhancements. The model computes message volumes from mission request profiles and SN resource levels and generates the loads for NCCDS configurations as a function of operational scenarios and processing activities. The model has been calibrated using the results of benchmarks performed on the operational NCCDS facility and used to assess some future SN service request scenarios.

Richmond, Eric↗

Plug20 Test Report: Particle Image Velocimetry (PIV) Measurements

This report provides turbulent flow statistics made using particle image velocimetry (PIV) for several internally mixed exhaust systems with external plugs (Plug20 designs). The tests were conducted at the NASA Glenn Research Center’s Aero-Acoustic Propulsion Laboratory (AAPL) in May and June 2022. The corresponding acoustic data for the configurations and flows presented in this report can be found in an earlier Technical Memorandum, NASA/TM-20210010291, “Plug20 Test Report.” The Plug20 nozzle family was designed to represent commercial supersonic vehicles in the 2025 to 2035 timeframe with a bypass ratio around 4, having an internal mixer, with and without an external plug to improve nacelle boattail drag and shock. The flow conditions measured represent engine cycles for commercial supersonic aircraft at takeoff, having pressure ratios of 2.0 and heated fan and core streams, measured both with and without a flight stream surrounding the plume. A few unheated flow conditions were also tested to tie results to other baseline test results. The PIV measurements in both streamwise and cross-stream planes are described, along with brief analysis to visually catalog the contents and confirm their validity. In this analysis, the streamwise PIV is found to match benchmark datasets within its experimental error. However, the cross-stream turbulent quantities measured by two systems do not match each other or the streamwise measurements in amplitude—caution is required when using the cross-stream data. Data acquired and included in this report are (1) velocity statistics of the plumes in both a streamwise and several cross-stream planes, and (2) the hot nozzle geometry. Tabular forms of the data and computer-aided design (CAD) files of the hot geometry are presented as supplemental files described in Appendix A (TM-20230006779SUPPL1.zip) and Appendix B (TM-20230006779SUPPL2.zip).

Turbulence↗

Parallel application-level behavioral attributes for performance and energy management of high-performance computing systems

Run time variability of parallel applications continues to present significant challenges to their performance and energy efficiency in high-performance computing (HPC) systems. When run times are extended and unpredictable, application developers perceive this as a degradation of system (or subsystem) performance. Extended run times directly contribute to proportionally higher energy consumption, potentially negating efforts by applications, or the HPC system, to optimize energy consumption using low-level control techniques, such as dynamic voltage and frequency scaling (DVFS). Therefore, successful systemic management of application run time performance can result in less wasted energy, or even energy savings. We have been studying run time variability in terms of communication time, from the perspective of the application, focusing on the interconnection network. More recently, our focus has shifted to developing a more complete understanding of the effects of HPC subsystem interactions on parallel applications. In this context, the set of executing applications on the HPC system is treated as a subsystem, along with more traditional subsystems like the communication subsystem, storage subsystem, etc. To gain insight into the run time variability problem, our earlier work developed a framework to emulate parallel applications (PACE) that stresses the communication subsystem. Evaluation of run time sensitivity to network performance of real applications is performed with a tool called PARSE, which uses PACE. In this paper, we propose a model defining application-level behavioral attributes, that collectively describes how applications behave in terms of their run time performance, as functions of their process distribution on the system (spacial locality), and subsystem interactions (communication subsystem degradation). These subsystem interactions are produced when multiple applications execute concurrently on the same HPC system. We also revisit our evaluation framework and tools to demonstrate the flexibility of our application characterization techniques, and the ease with which attributes can be quantified. The validity of the model is demonstrated using our tools with several parallel benchmarks and application fragments. Results suggest that it is possible to articulate application-level behavioral attributes as a tuple of numeric values that describe course-grained performance behavior.

Computer Science↗

Benchmarking the pseudopotential and fixed-node approximations in diffusion Monte Carlo calculations of molecules and solids

Diffusion Monte Carlo (DMC) calculations of the spectroscopic properties of a large set of molecules were performed, assessing the effect of different approximations. In systems containing elements with large atomic numbers, we show that the errors associated with the use of nonlocal mean-field-based pseudopotentials in DMC calculations can be significant and may surpass the fixed-node error. We suggest practical guidelines for reducing these pseudopotential errors, which allow us to obtain DMC-computed spectroscopic parameters of molecules and equation of state properties of solids in excellent agreement with experiment.

36 MATERIALS SCIENCE↗

A quantum eigenvalue solver based on tensor networks

Electronic ground states are of central importance in chemical simulations, but have remained beyond the reach of efficient classical algorithms except in cases of weak electron correlation or one-dimensional spatial geometry. We introduce a hybrid quantum-classical eigenvalue solver that constructs a wavefunction ansatz from a linear combination of matrix product states in rotated orbital bases, enabling the characterization of strongly correlated ground states with arbitrary spatial geometry. The energy is converged via a gradient-free generalized sweep algorithm based on quantum subspace diagonalization, with a potentially exponential speedup in the off-diagonal matrix element contractions upon translation into compact quantum circuits of linear depth in the number of qubits. Chemical accuracy is attained in numerical experiments for both a stretched water molecule and an octahedral arrangement of hydrogen atoms, achieving substantially better correlation energies compared to a unitary coupled-cluster benchmark, with orders of magnitude reductions in quantum resource estimates and a surprisingly high tolerance to shot noise. This proof-of-concept study suggests a promising new avenue for scaling up simulations of strongly correlated chemical systems on near-term quantum hardware.

chemistry↗

Milestone M1 Report: HBM2/3 Evaluation on Many-core CPU WBS 2.4, Milestone ECP-MT-1000

In HIHE01-1, "Evaluate a PathForward/Facilities memory-relevant performance study/analysis," we conducted a focused study on the performance differences between HBM2 and HBM3 as revealed through execution of representative benchmarks. We used measurements on an existing many-core system, Knight's Landing (KNL), to calibrate simulator settings, and then performed Structural Simulation Toolkit (SST) simulations of KNL-like CPUs that access future high bandwidth memories. This report documents our findings.

97 MATHEMATICS AND COMPUTING↗

Development and Validation of Scale Nuclear Analysis Methods for High Temperature Gas-Cooled Reactors

In support of the U.S. Nuclear Regulatory Commission, ORNL is updating the nuclear analysis methods and data in the SCALE code system to support modeling of HTGRs. Development activities include methods used for reactor physics, criticality safety, and radiation shielding. This paper focuses on the nuclear methods in support of reactor physics, which primarily include lattice physics for cross-section processing of both prismatic and pebble-bed designs, Monte Carlo depletion methods and efficiency improvements for double heterogeneous fuels, and validation against relevant experiments. These methods enhancements are being validated using available experimental data from the HTTR and HTR-10 startup and initial criticality experiments. Results obtained with three-dimensional Monte Carlo models of the HTTR initial core critical configurations with SCALE6/KENO show excellent agreement between the continuous energy and multigroup methods and the results are consistent with results obtained by others. A three-dimensional multigroup Monte Carlo model for the initial critical core of the HTR-10 has been developed with SCALE6/KENO based on the benchmark specifications included in the IRPhE Handbook. The core eigenvalue obtained with this model is in very good agreement with the corresponding value obtained with a consistent continuous energy MCNP5 core model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗

Modeling City Building Stock for Large-Scale Energy Efficiency Improvements using CityBES

Buildings in San Francisco consumed 52% of total primary energy. Improving building energy efficiency is one of the key strategies cities are adopting towards their energy and climate goals. Urban building energy models (UBEM) can support city managers to evaluate and prioritize energy conservation measures for investment and to design effective incentive and rebate programs. This paper introduces methods to develop a standardized dataset of city building stock, and it demonstrates the use of a UBEM tool, City Building Energy Saver (CityBES), for an urban-scale energy retrofit analysis of building stock in the city of San Francisco. CityBES is an open web-based data and computing platform providing city-scale building energy modeling and performance visualization and benchmarking. CityBES utilizes an international standard CityGML to represent the three-dimensional building stock in cities. As an application example, 940 office and retail buildings in six districts of northeast San Francisco were modeled and analyzed with CityBES to evaluate energy savings for five selected measures. The analysis found that replacing existing lighting with LED and adding an air economizer to HVAC systems are cost-effective measures with combined savings per building between 17% to 31%. The CityBES retrofit analysis feature does not require users to have deep knowledge of building systems or building energy models, which helps overcome barriers for city managers and their consultants to adopt UBEM.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Criticality Safety Validation of Scale 6.1

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Experiment Program (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). A total of more than 350 cases from this reference have been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID) maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the Scale 6.1 code system with ENDF/B-VII.0 cross-section data in 238-group and continuous energy is assessed using the VALID models of benchmark experiments. The TSUNAMI tools for sensitivity and uncertainty analysis are utilized to examine some systems further in an attempt to identify potential causes of unexpected results. The critical experiments available for validation of the KENO V.a code cover eight different broad categories of systems. These systems use a range of fissile materials including a range of uranium enrichments, various plutonium isotopic vectors, and mixed uranium-plutonium oxides. The physical form of the fissile material also varies and is represented as metal, solutions, or arrays of rods or plates in a water moderator. The neutron energy spectra of the systems also vary and cover both fast and thermal spectra. Over 300 of the total cases used utilize the KENO V.a code. The critical experiments available for the validation of the KENO-VI code cover three broad categories of systems. The fissile materials in the systems vary and include high and intermediate-enrichment uranium and mixed uranium/plutonium oxides. The physical form of the fissile material is either metal or rod arrays in water. As with KENO V.a, both fast and thermal neutron energy spectra are represented in the systems considered. The results indicate generally good performance of both the KENO V.a and KENO-VI codes across the range of systems analyzed. The bias of calculated k{sub eff} from expected values is less than 0.9% {Delta}k in all cases. All eight categories of experiments show biases of less than 0.5% {Delta}k in KENO V.a with the exception of intermediate enrichment metal systems using the 238-group library. The continuous energy library generally manifests lower biases than the multi-group data. The KENO-VI results show slightly larger biases, though this may primarily be the result of modeling systems with more geometric complexity, which are more difficult to describe accurately, even with a generalized geometry code like KENO-VI. Several additional conclusions can be drawn from the results of this validation effort. These conclusions include that the TSUNAMI tools can be used successfully to explain the cause of aberrant results, that some evaluations in the IHECSBE should be updated to provide more rigorous expected k{sub eff} values and uncertainties, and that potential cross-section errors can be identified by detailed review of the results of this validation. It also appears that the overall cross-section uncertainty as quantified through the Scale covariance library is overestimated. Overall, the KENO V.a and KENO-VI codes are shown to provide consistent, low bias results for a wide range of physical systems of potential interest in criticality safety applications.

Marshall, William BJ J↗

Criticality Safety Validation of SCALE 6.1 (Revised)

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Experiment Program (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). A total of more than 350 cases from this reference have been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID) maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the SCALE 6.1 code system with ENDF/B-VII.0 cross-section data in 238-group and continuous energy is assessed using the VALID models of benchmark experiments. The TSUNAMI tools for sensitivity and uncertainty analysis are utilized to examine some systems further in an attempt to identify potential causes of unexpected results. The critical experiments available for validation of the KENO V.a code cover eight different broad categories of systems. These systems use a range of fissile materials including a range of uranium enrichments, various plutonium isotopic vectors, and mixed uranium/plutonium oxides. The physical form of the fissile material also varies and is represented as metal, solutions, or arrays of rods or plates in a water moderator. The neutron energy spectra of the systems also vary and cover both fast and thermal spectra. Over 300 of the total cases used utilize the KENO V.a code. The critical experiments available for the validation of the KENO-VI code cover three broad categories of systems. The fissile materials in the systems vary and include high- and intermediate-enrichment uranium and mixed uranium/plutonium oxides. The physical form of the fissile material is either metal or rod arrays in water. As with KENO V.a, both fast and thermal neutron energy spectra are represented in the systems considered. The results indicate generally good performance of both the KENO V.a and KENO-VI codes across the range of systems analyzed. The bias of calculated k eff from expected values is less than 0.9% Δk in all cases. All eight categories of experiments show biases of less than 0.5% Δk in KENO V.a with the exception of intermediate enrichment metal systems using the 238-group library. The continuous energy library generally manifests lower biases than the multigroup data. The KENO-VI results show slightly larger biases, though this may primarily be the result of modeling systems with more geometric complexity, which are more difficult to describe accurately, even with a generalized geometry code like KENO-VI. Several additional conclusions can be drawn from the results of this validation effort. These conclusions include that the TSUNAMI tools can be used successfully to explain the cause of aberrant results, that some evaluations in the IHECSBE should be updated to provide more rigorous expected k eff values and uncertainties, and that potential cross-section errors can be identified by detailed review of the results of this validation. It also appears that the overall cross-section uncertainty as quantified through the SCALE covariance library is overestimated. Overall, the KENO V.a and KENO-VI codes are shown to provide consistent, low-bias results for a wide range of physical systems of potential interest in criticality safety applications.

Marshall, William (BJ) J.↗

Automated Generation of Message-Passing Programs: An Evaluation Using CAPTools

Scientists at NASA Ames Research Center have been developing computational aeroscience applications on highly parallel architectures over the past ten years. During that same time period, a steady transition of hardware and system software also occurred, forcing us to expend great efforts into migrating and re-coding our applications. As applications and machine architectures become increasingly complex, the cost and time required for this process will become prohibitive. In this paper, we present the first set of results in our evaluation of interactive parallelization tools. In particular, we evaluate CAPTool's ability to parallelize computational aeroscience applications. CAPTools was tested on serial versions of the NAS Parallel Benchmarks and ARC3D, a computational fluid dynamics application, on two platforms: the SGI Origin 2000 and the Cray T3E. This evaluation includes performance, amount of user interaction required, limitations and portability. Based on these results, a discussion on the feasibility of computer aided parallelization of aerospace applications is presented along with suggestions for future work.

Hribar, Michelle R.↗