Search NASA⌕ Search

SEARCH · Search NASA

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Evaluation of Low Power ARM Processors for Monte Carlo Particle Transport: MCNP6 on the ARM Cortex-A8 - Paper 83

In the push towards exascale computing, the limiting factors are power requirements and heat dissipation. Using current technology, the power required to drive an exascale supercomputer would near 400-MW. Clearly, future computing hardware will have to be more energy efficient in order to achieve exascale performance. Most of the current research in advanced computing architectures is in the use of standard CPUs with accelerators. However, these accelerators are not generally supported by the traditional scientific programming languages (C, C++, and Fortran) and the scientific software must be tailored specifically to take advantage of the accelerators. Large scale scientific software (hundreds-of-thousand to millions of lines of code) can not be easily ported to the computing platform du jour. The widespread use of low power ARM based processors in the mobile computing market offer a low power alternative to accelerators that are also supported by the traditional scientific programming languages and programming paradigms such as MPI and OpenMP. Computing architectures for scientific computing are often assessed using standard benchmarks such as LINPACK benchmark or using suites of mini-applications that are greatly simplified stand-ins for scientific software. Often the real applications that will deployed on the scientific supercomputers are not ported or tested until delivery of the machines. In order to evaluate the use of ARM processors for scientific computing the Monte Carlo particle transport code, MCNP version 6 was compiled on the ARM Cortex-A8 and a set of benchmark problems were used to assess performance in comparison to an Intel Xeon E5-2670 and the low power Intel Atom N270. MCNP is a continuous energy Monte Carlo particle transport code in development at Los Alamos National Laboratory since 1977. MCNP is used to transport neutrons, photon, electrons, and charged particles using continuous energy interaction data. It is commonly used in fields of nuclear power, nuclear medicine, radiation protection, and high-energy physics through-out the world. MCNP version 6 is approximately 450 thousand lines of code, written primary in Fortran90, with some C and C++. MCNP supports distributed multiprocessing using MPI and threading with OpenMP. The ARM Cortex-A8 executes MCNP6 using about twice as much power as the Intel Xeon E5-2670 and about the same amount of power as the Intel Atom N270. However, these results are encouraging for the use of low-power ARM chips in future supercomputers. The ARM Cortex-A8 is a 32-bit CPU and it's NEON general-purpose SIMD (single-instruction multiple data) engine does not support double-precision floating-point arithmetic. More recent ARM processors (ARM Cortex-A53 and Cortex-A57) support 64-bit addressing and have NEON co-processors that support double-precision floating-point arithmetic. ARM claims that the A50 series delivers a performance increase of 15 times the Cortex-A8 performance for similar power usage. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2015

Estimation of uncertainties for subcritical benchmark measurements - 14387

Subcritical measurements are used for many applications including nonproliferation, treaty verification, in-situ monitoring for criticality, and reactor subcriticality monitoring. Most analysis methods involve correlated neutron detection, based upon the property that fission events can create multiple neutrons that are born at nearly the same time (on a scale of 10{sup -13} or 10{sup -14} seconds). Many different time-correlated methods have been used since the 1950's and are still widely utilized today. This particular work describes an uncertainty analysis of measured data using the Hage-Cifarelli formalism of the Feynman Variance-to-Mean method. The Feynman Variance-to-Mean method was introduced by Feynman et al. in 1956 and is based upon the differences between the detector count data and the data that would be expected from measurements taken from a Poissonian source. The Hage-Cifarelli formalism relates moments of the Feynman histograms to several parameters of a system: leakage multiplication (M{sub L}), spontaneous fission rate (F{sub S}), (α,n) neutron emission rate (S{sub α}), detector efficiency (ε), and the moments of the number of neutrons emitted per fission (ν). The first part of the uncertainty method described in this work will show how to determine uncertainties of the first (R{sub 1}) and second (R{sub 2}) reduced factorial moments of the Feynman histograms. The second part of the method will describe how to determine the uncertainties in the other parameters given uncertainties in the reduced factorial moments; in particular, this work will focus on determining the uncertainties in M{sub L} and F{sub S}. This work will utilize measured data from a recent benchmark evaluation with a 4.5 kg sphere of α-phase plutonium to validate the uncertainty analysis. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2011

Evaluating the Performance of Gamma-Ray Imaging Instruments for Detection Applications

A method for evaluating and comparing the performance of benchmark gamma-ray imaging instruments is proposed and demonstrated. This method makes simplifying assumptions that do impact the accuracy of performance estimation and the range of conditions under which performance estimation will be reliable. However, the method provides a valuable means for evaluating imager performance under many conditions of relevance for detection applications, and provides an upper bound for performance that is valid under all conditions. This estimate enables, for the first time, a meaningful means for comparing imaging instruments against one another and for making rapid determinations of the potential viability of using specified imaging instruments for detection application scenarios. The insight provided by this model should also motivate future innovation in imager design.

Detection↗
DOE OSTI2024

A Systematic Comparison for Consistent Scenario Development Using Microscopic Simulation Software

This study aims to explore a methodology that enables the development of consistent traffic micro simulation for emerging traffic and vehicle control technologies for improved mobility and energy efficiency across different modeling platforms. Researchers might study the same application on different platforms and have the need to benchmark across platforms. However, there lacks a systematic study on simulation software comparison, especially for emerging mobility and energy efficiency applications. For this, a systematic scenario development and evaluation approach is presented and demonstrated to compare scenarios generated in different traffic microsimulation platforms. Network-level and vehicle-level trip performance results of the traffic scenario are evaluated in three microscopic simulation platforms - VISSIM, AIMSUN, and SUMO. The results indicate that the network-level performance is consistent among the three software suites except when the demand is high, where the energy consumption performance varies.

Saroj, Abhilasha [ORNL] (ORCID:0000000191178063)↗
DOE OSTI2015

Development and testing of neutron cross-section covariance data for Scale 6.2 - 14604

Neutron cross-section covariance data are essential for many sensitivity/uncertainty and uncertainty quantification assessments performed both within the TSUNAMI suite and more broadly throughout the SCALE code system. The release of ENDF/B-VII.1 included a more complete set of neutron cross-section covariance data: these data form the basis for a new cross-section covariance library to be released in SCALE 6.2. A range of testing is conducted to investigate the properties of these covariance data and ensure that the data are reasonable. These tests include examination of the uncertainty in critical experiment benchmark model k{sub eff} values due to nuclear data uncertainties, as well as similarity assessments of irradiated pressurized water reactor (PWR) and boiling water reactor (BWR) fuel with suites of critical experiments. The contents of the new covariance library, the testing performed, and the behavior of the new covariance data are described in this paper. The neutron cross-section covariances can be combined with a sensitivity data file generated using the TSUNAMI suite of codes within SCALE to determine the uncertainty in system k{sub eff} caused by nuclear data uncertainties. The Verified, Archived Library of Inputs and Data (VALID) maintained at Oak Ridge National Laboratory (ORNL) contains over 400 critical experiment benchmark models, and sensitivity data are generated for each of these models. The nuclear data uncertainty in k{sub eff} is generated for each experiment, and the resulting uncertainties are tabulated and compared to the differences in measured and calculated results. The magnitude of the uncertainty for categories of nuclides (such as actinides, fission products, and structural materials) is calculated for irradiated PWR and BWR fuel to quantify the effect of covariance library changes between the SCALE 6.1 and 6.2 libraries. One of the primary applications of sensitivity/uncertainty methods within SCALE is the assessment of similarities between benchmark experiments and safety applications. This is described by a ck value for each experiment with each application. Several studies have analyzed typical ck values for a range of critical experiments compared with hypothetical irradiated fuel applications. The ck value is sensitive to the cross-section covariance data because the contribution of each nuclide is influenced by its uncertainty; large uncertainties indicate more likely bias sources and are thus given more weight. Changes in ck values resulting from different covariance data can be used to examine and assess underlying data changes. These comparisons are performed for PWR and BWR fuel in storage and transportation systems. (authors)

42 ENGINEERING↗
DOE OSTI2014

Evaluation of COTS Rad Detection Apps

Mobile applications are currently under distribution to smart phones utilizing the built-in charge coupled-device (CCD) camera as a radiation detector. The CCD detector has a very low but measurable gamma interaction cross section so the mechanism is feasible, especially for higher dose rate environments. Given that in a large release of radioactive material these ‘crowd sourced’ measurements will be put forth for consideration, a testing and evaluation of the accuracy and uncertainty of the Apps is a critical endeavor. Not only is the accuracy of the reported measurement of concern to the immediate user’s safety, a quantitative uncertainty is required for a government response such as the Federal Radiological Monitoring and Assessment Center (FRMAC) to accept the values for consideration in the determination of regions exceeding protective action guidelines. Already, prompted by the Fukushima nuclear material releases, several repositories of this crowd-sourced data have been created (http://japan.failedrobot.com, http://www.stubbytour.com/nuc/index_en.asp, and http://www.rdtn.org) although the question remains as to the reliability of measurements incorporated into these repositories. In cases of conflict between the real-time published crowd-sourced data and governmental protective actions prepared literature should be on-hand documenting why the difference, if any, exists. Four applications for iOS devices were obtained along with hardware to benchmark their performance. Gamma/X-Ray Detector by Stephan Hotto, Geiger Camera by Senscare, and RadioactivityCounter App by Hotray LTD are all the applications available for distribution within the US that utilize the CCD camera sensor for detection of radiation levels. The CellRad app under development by Idaho National Laboratory for the Android platform was evaluated. In addition, iRad Geiger with the associated hardware accessory was also benchmarked. Radiation fields were generated in a Cs-137 JL Shepherd Model 89 shielded calibration range. The accuracy of the exposure rate within the box calibrator is +/- 5% of the system settings and NIST traceable. This is the same calibration unit utilized for calibration of US DOE exposure rate meters. Measurements were performed from 0.2 to 40,000 mR/hr. Included in the following sections are discussions on each of the evaluated applications and their performance in reporting radiation field measurements. Unfortunately the applications do not provide a readily identifiable quality of the measurement in order to produce error bars or even out of range conditions. In general all the CCD based applications had issues detecting consistent measurements in radiation fields less than 5 mR/hr. This is most likely attributable to the electronic noise level on the CCD’s becoming comparable to the signal level due to the ionizing radiation photons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

Development and Testing of Neutron Cross Section Covariance Data for SCALE 6.2

Neutron cross-section covariance data are essential for many sensitivity/uncertainty and uncertainty quantification assessments performed both within the TSUNAMI suite and more broadly throughout the SCALE code system. The release of ENDF/B-VII.1 included a more complete set of neutron cross-section covariance data: these data form the basis for a new cross-section covariance library to be released in SCALE 6.2. A range of testing is conducted to investigate the properties of these covariance data and ensure that the data are reasonable. These tests include examination of the uncertainty in critical experiment benchmark model k eff values due to nuclear data uncertainties, as well as similarity assessments of irradiated pressurized water reactor (PWR) and boiling water reactor (BWR) fuel with suites of critical experiments. The contents of the new covariance library, the testing performed, and the behavior of the new covariance data are described in this paper. The neutron cross-section covariances can be combined with a sensitivity data file generated using the TSUNAMI suite of codes within SCALE to determine the uncertainty in system k eff caused by nuclear data uncertainties. The Verified, Archived Library of Inputs and Data (VALID) maintained at Oak Ridge National Laboratory (ORNL) contains over 400 critical experiment benchmark models, and sensitivity data are generated for each of these models. The nuclear data uncertainty in k eff is generated for each experiment, and the resulting uncertainties are tabulated and compared to the differences in measured and calculated results. The magnitude of the uncertainty for categories of nuclides (such as actinides, fission products, and structural materials) is calculated for irradiated PWR and BWR fuel to quantify the effect of covariance library changes between the SCALE 6.1 and 6.2 libraries. One of the primary applications of sensitivity/uncertainty methods within SCALE is the assessment of similarities between benchmark experiments and safety applications. This is described by a c k value for each experiment with each application. Several studies have analyzed typical c k values for a range of critical experiments compared with hypothetical irradiated fuel applications. The c k value is sensitive to the cross-section covariance data because the contribution of each nuclide is influenced by its uncertainty; large uncertainties indicate more likely bias sources and are thus given more weight. Changes in c k values resulting from different covariance data can be used to examine and assess underlying data changes. These comparisons are performed for PWR and BWR fuel in storage and transportation systems.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2011

Reactor Testing and Qualification: Prioritized High-level Criticality Testing Needs

Researchers at the Idaho National Laboratory (INL) were tasked with reviewing possible criticality testing needs to support development of the fission surface power system reactor design. Reactor physics testing can provide significant information to aid in development of technologies associated with small, fast spectrum reactors that could be applied for non-terrestrial power systems, leading to eventual system qualification. Several studies have been conducted in recent years to assess the data and analyses required to design and build a space fission power system with high confidence that the system will perform as designed [Marcille, 2004a, 2004b; Weaver, 2007; Parry et al., 2008]. This report will provide a summary of previous critical tests and physics measurements that are potentially applicable to the current reactor design (both those that have been benchmarked and those not yet benchmarked), summarize recent studies of potential nuclear testing needs for space reactor development and their applicability to the current baseline fission surface power (FSP) system design, and provide an overview of a suite of tests (separate effects, sub-critical or critical) that could fill in the information database to improve the accuracy of physics modeling efforts as the FSP design is refined. Some recommendations for tasks that could be completed in the near term are also included. Specific recommendations on critical test configurations will be reserved until after the sensitivity analyses being conducted by Los Alamos National Laboratory (LANL) are completed (due August 2011).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

Use of Criticality Eigenvalue Simulations for Subcritical Benchmark Evaluations

Subcritical multiplication experiments and simulations are important for a variety of applications including nonproliferation, safeguards, and criticality safety monitoring. Recently, subcritical experiments have been evaluated for inclusion in the International Criticality Safety Benchmark Evaluation Process (ICSBEP). In addition, new subcritical experiments have recently been designed. In these experiments, list-mode data (a list of each absorption in the neutron detector) is recorded and neutron noise analysis is used to determine the leakage multiplication (ML) of each configuration. One downside to the simulation of these types of experiments is that they are computationally expensive. This is because analog Monte Carlo with no variance reduction must be performed in order to maintain the time accuracy required in the measurement analysis. This work demonstrates that criticality eigenvalue simulations can be used to estimate sensitivities and uncertainties for three parameters: singles count rate (R{sub 1}), doubles count rate (R{sub 2}), and leakage multiplication (M{sub L}). This will provide a useful aid both in the design and evaluation of new subcritical measurements. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Fission neutron activations of stainless steel and its corresponding elemental components

Characterizing neutron activation of stainless steel is a critical task for many applications, and yet little activation data is available for this alloy. To address the need, a series of neutron activation experiments have been performed using the Flattop critical assembly at the National Criticality Experiments Research Center. Several experimental conditions were probed for complete understanding of the neutron environment, including foil composition and position within the assembly. The experimental results reported here will aid in the production of stainless steel benchmarks for a range of nuclear data applications including those used in nuclear forensics analysis.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2018

Evaluating Performance Portability of Accelerator Programming Models using SPEC ACCEL 1.2 Benchmarks

As heterogeneous architectures are becoming mainstream for HPC systems, application programmers are looking for programming model implementations that offer both performance and portability across platforms. Two directive-based programming models for accelerator programming that aim at doing this are OpenMP 4/4.5 and OpenACC. Many users want to know the difference between these two programming models, the state of their implementations, how to use them, and evaluate how suitable they are for their applications.The Standard Performance Evaluation Corporation (SPEC) ACCEL benchmarks, developed by the SPEC High Performance Group (HPG), recently released SPEC ACCEL 1.2 benchmark suite to help the evaluation of OpenCL, OpenMP 4.5 and OpenACC on different platforms. Inthis paper we present our preliminary results that evaluates OpenMP4.5 and OpenACC on a variety of accelerator-based systems: POWER9with NVIDIA V100 GPUs (Summit), Intel Xeon Phi 7230 (Percival), and AMD Bulldozer Opteron with NVIDIA K20x (Titan). Comparing these benchmarks on different systems gives us insight into the support for OpenMP and OpenACC and their execution times provide insights about their quality of implementations provided by different vendors. We also compare best of OpenMP and OpenACC to see if a particular programming model favors a particular type of benchmark kernel.

Boehm, Swen↗
DOE OSTI2022

Review of SCALE Validations Applicable to Spent Nuclear Fuel Shielding Calculations

This report presents a review of publicly available documents providing validations of SCALE code system capabilities for depletion and shielding calculations. The validation studies primarily used information available in the Spent Fuel Isotopic Composition Database, the Shielding Integral Benchmark Archive and Database, and the International Criticality Safety Benchmark Evaluation Project Handbook. Validation results based on radiochemical assay data and shielding benchmark experiments relevant to spent nuclear fuel shielding applications are summarized in this report. The information summarized in this report supports pressurized water reactor and boiling water reactor spent fuel storage and transportation safety analyses.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2000

Applications of the Space-Time Conservation Element and Solution Element (CE/SE) Method to Computational Aeroacoustic Benchmark Problems

The Internal Propagation problems, Fan Noise problem, and Turbomachinery Noise problems are solved using the space-time conservation element and solution element (CE/SE) method. The problems in internal propagation problems address the propagation of sound waves through a nozzle. Both the nonlinear and linear quasi 1D Euler equations are solved. Numerical solutions are presented and compared with the analytical solution. The fan noise problem concerns the effect of the sweep angle on the acoustic field generated by the interaction of a convected gust with a cascade of 3D flat plates. A parallel version of the 3D CE/SE Euler solver is developed and employed to obtain numerical solutions for a family of swept flat plates. Numerical solutions for sweep angles of 0, 5, 10, and 15 deg are presented. The turbomachinery problems describe the interaction of a 2D vortical gust with a cascade of flat-plate airfoils with/without a downstream moving grid. The 2D nonlinear Euler Equations are solved and the converged numerical solutions are presented and compared with the corresponding analytical solution. All the comparisons demonstrate that the CE/SE method is capable of solving aeroacoustic problems with/without shock waves in a simple and efficient manner. Furthermore, the simple non-reflecting boundary condition used in the CE/SE method which is not based on the characteristic theory works very well in 1D, 2D and 3D problems.

Wang, Xiao-Yen↗
DOE OSTI2014

Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing

has been widely accepted that software virtualization has a big negative impact on high-performance computing (HPC) application performance. This work explores the potential use of Infiniband hardware virtualization in an OpenNebula cloud towards the efficient support of MPI-based workloads. We have implemented, deployed, and tested an Infiniband network on the FermiCloud private Infrastructure-as-a-Service (IaaS) cloud. To avoid software virtualization towards minimizing the virtualization overhead, we employed a technique called Single Root Input/Output Virtualization (SRIOV). Our solution spanned modifications to the Linux’s Hypervisor as well as the OpenNebula manager. We evaluated the performance of the hardware virtualization on up to 56 virtual machines connected by up to 8 DDR Infiniband network links, with micro-benchmarks (latency and bandwidth) as well as w a MPI-intensive application (the HPL Linpack benchmark).

Pais Pitta de Lacerda Ruivo, Tiago↗
DOE OSTI2025

Prediction of electric and magnetic fields from spectral data using machine learning algorithms for Doppler-free saturation spectroscopy diagnostics

The prediction of electric and magnetic field amplitudes from atomic spectral data is critical for plasma control in fusion devices such as tokamaks. Conventional approaches that rely on physics-based models are computationally expensive and unsuitable for real-time applications. In this work, we develop and benchmark three machine learning algorithms—simulation-based inference (SBI), fully connected neural networks (FCNN), and histogram-based gradient boosting regression (GBR-Hist)—to infer field intensities directly from Doppler-free saturation spectroscopy (DFSS) spectra. Synthetic datasets of spectra were generated using the EZSSS code and evaluated both with and without added Poisson noise to mimic experimental conditions. We find that SBI achieves the highest accuracy and robustness, FCNN provides a strong balance of accuracy and computational efficiency for real-time applications, and GBR-Hist offers the fastest inference but is more sensitive to noise. Furthermore, these results demonstrate the potential of machine learning to accelerate DFSS analysis and enhance its utility for plasma diagnostics and control.

Doppler-free saturation spectroscopy↗
DOE OSTI2026

A large-scale benchmarking of deterministic and stochastic derivative-free optimization algorithms

This presentation summarizes our work in the PrOMMiS project on benchmarking of data-driven optimization algorithms and their applications in self-driving laboratories. This work supports the broader project goal of accelerating the identification of promising separation methods and operating conditions for critical minerals separation processes. We present a systematic benchmarking study of 42 data-driven optimization algorithms on a broad collection of 502 test problems. The results identify BAM, GLCCLUSTER, and MULTIMIN as the most effective optimization solvers, with BAM showing the highest overall performance and solving more than 80% of the benchmark problems. The study also shows that no single solver consistently outperforms the others across all problem types, indicating that our future laboratory applications may benefit from using a small set of strong solvers rather than relying on a single method. The presentation also illustrates an in-silico chemical reactor case study showing that data-driven optimization methods can guide autonomous experimentation in a self-driving laboratory and identify optimal operating conditions within a small number of experiments. Overall, the results provide a basis for selecting efficient optimization methods and demonstrate the practical use of data-driven optimization in self-driving laboratory workflows.

36 MATERIALS SCIENCE↗
NASA NTRS2018

A Benchmark Example for Delamination Propagation Predictions Based on the Single Leg Bending Specimen Under Quasi-Static and Fatigue Loading

Benchmark examples based on Single Leg Bending (SLB) specimens with equal and unequal bending arm thicknesses were used to assess the performance of delamination prediction capabilities in finite element codes. First, the development of the quasi-static benchmark cases using the Virtual Crack Closure Technique (VCCT) is discussed in detail. Second, based on the quasi-static benchmark results, additional benchmark cases to assess delamination propagation under fatigue loading are created. Third, the application is demonstrated for the commercial finite element code Abaqus Standard 2018. The benchmark cases are compared to results obtained from VCCT-based, automated quasi-static propagation analysis. A comparison with results from automated fatigue propagation analysis was not performed at this point since the current version of Abaqus does not include this capability under variable mixed-mode conditions. In general, good agreement between the results obtained from the quasi-static propagation analysis and the benchmark results were achieved. Overall, the benchmarking procedure proved valuable for analysis verification.

Krueger, Ronald↗