Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

EVA Health and Human Performance Benchmarking Study

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Abercromby, A. F.↗
NASA NTRS1988

Machine characterization and benchmark performance prediction

From runs of standard benchmarks or benchmark suites, it is not possible to characterize the machine nor to predict the run time of other benchmarks which have not been run. A new approach to benchmarking and machine characterization is reported. The creation and use of a machine analyzer is described, which measures the performance of a given machine on FORTRAN source language constructs. The machine analyzer yields a set of parameters which characterize the machine and spotlight its strong and weak points. Also described is a program analyzer, which analyzes FORTRAN programs and determines the frequency of execution of each of the same set of source language operations. It is then shown that by combining a machine characterization and a program characterization, we are able to predict with good accuracy the run time of a given benchmark on a given machine. Characterizations are provided for the Cray-X-MP/48, Cyber 205, IBM 3090/200, Amdahl 5840, Convex C-1, VAX 8600, VAX 11/785, VAX 11/780, SUN 3/50, and IBM RT-PC/125, and for the following benchmark programs or suites: Los Alamos (BMK8A1), Baskett, Linpack, Livermore Loops, Madelbrot Set, NAS Kernels, Shell Sort, Smith, Whetstone and Sieve of Erathostenes.

Saavedra-Barrera, Rafael H.↗
NASA NTRS1986

Toward real-time performance benchmarks for Ada

The issue of real-time performance measurements for the Ada programming language through the use of benchmarks is addressed. First, the Ada notion of time is examined and a set of basic measurement techniques are developed. Then a set of Ada language features believed to be important for real-time performance are presented and specific measurement methods discussed. In addition, other important time related features which are not explicitly part of the language but are part of the run-time related features which are not explicitly part of the language but are part of the run-time system are also identified and measurement techniques developed. The measurement techniques are applied to the language and run-time system features and the results are presented.

Clapp, Russell M.↗
DOE OSTI2024

DAISY Benchmark Performance Data

This repository contains the underlying data from benchmark experiments for Drifting Acoustic Instrumentation SYstems (DAISYs) in waves and currents described in "Performance of a Drifting Acoustic Instrumentation SYstem (DAISY) for Characterizing Radiated Noise from Marine Energy Converters" (https://link.springer.com/article/10.1007/s40722-024-00358-6). DAISYs consist of a surface expression connected to a hydrophone recording package by a tether. Both elements are instrumented to provide metadata (e.g., position, orientation, and depth). Information about how to build DAISYs is available at https://www.pmec.us/research-projects/daisy. The repository's primary content is three compressed archives (.zip format), each containing multiple MATLAB binary data files (.mat format). A table relating individual data files to figures in the paper, as well as the structure of each file, is included in the repository as a Word document (Data Description MHK-DR.docx). Most of the files contain time series information for a single DAISY deployment (file naming convention: [site]_DAISY_[Drift #].mat) consisting of processed hydrophone data and associated metadata. For a limited number of DAISY deployments, the hydrophone package was replaced with an acoustic Doppler velocimeter (file naming convention: [site]_DAISY_[Drift #]_ADV.mat). Data were collected over several years at three locations: (1) Sequim Bay at Pacific Northwest National Laboratory's Marine & Coastal Research Laboratory (MCRL) in Sequim, WA, the energetic tidal channel in Admiralty Inlet, WA (Admiralty Inlet), and the U.S. Navy's Wave Energy Test Site (WETS) in Kaneohe, HI. Brief descriptions of data files at each location follow. - MCRL - (1) Drift #4 and #16 contrast the performance of a DAISY and a reference hydrophone (icListen HF Reson), respectively, in the quiescent interior of Sequim Bay (September 2020). (2) Drift #152 and #153 are velocity measurements for a drifting acoustic Doppler velocimeter in in the tidally-energetic entrance channel inside a flow shield and exposed to the flow, respectively (January 2018). (3) Two non-standard files are also included: DAISY_data.mat corresponds to a subset of a DAISY drift over an Adaptable Monitoring Package (AMP) and AMP_data.mat corresponds to approximately co-temporal data for a stationary hydrophone on the AMP (February 2019). - Admiralty Inlet - (1) Drift #1-12 correspond to tests with flow shielded DAISYs, unshielded DAISYs, a reference hydrophone, and drifting acoustic Doppler velocimeter with 5, 10, and 15 m tether lengths between surface expression and hydrophone recording package (July 2022). (2) Drift #13-20 correspond to tests of flow shielded DAISYs with three different tether materials (rubber cord, nylon line, and faired nylon line) in lengths of 5, 10, and 15 m (July 2022). - WETS - (1) Drift #30-32 correspond to tests with a heave plate incorporated into the tether (standard configuration for wave sites), rubber cord only, and rubber cord, but with a flow shielded hydrophone (November 2022). (2) Drift #49-58 and Drift #65-68 correspond to measurements around mooring infrastructure at the 60 m berth where time-delay-of-arrival localization was demonstrated for different DAISY arrangements and hydrophone depths (November 2022).

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Development of a U-19Pu-10Zr fuel performance benchmark case based on the IFR-1 experiment

Metallic nuclear fuels are subject to research and development for use in advanced reactors. Robust, accurate metallic fuel performance models are important for the design, safety analysis, and licensing of these reactors. However, metallic fuel performance models require additional development; they are not as mature as UO 2 fuel performance models. A benchmark case based on the IFR-1 experiment was developed to better gauge the accuracy of existing models, identify models for high-priority development, and potentially quantify any future improvements made by further model development.This work collected publicly available information on the IFR-1 experiment and used it to develop the benchmark case. Fuel behavior during the IFR-1 irradiation was simulated by using the fuel performance code BISON, and the predicted results were compared with postirradiation examination data from the IFR-1 experiment. Furthermore, a sensitivity study and tuning studies were performed as a preliminary investigation into the causes of inaccurate temperature and dimensional change predictions.The benchmark predicted reasonably accurate values for the burnup and fission gas release. There was error in the predicted temperatures, which could be explained by uncertainty in the input parameters and legacy temperatures. BISON over-predicted dimensional changes in the fuel and cladding. The sensitivity study showed that the dimensional changes were most sensitive to the fuel swelling anisotropy and the cladding void swelling model. Future benchmark and model development should focus on cladding swelling behaviors to improve dimensional change predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

25-Pin metallic fuel performance benchmark case based on the EBR-II X430 experiments series

A metallic fuel benchmark case was developed for the fuel performance code BISON based on 25 uranium-zirconium and uranium-plutonium-zirconium pins of the Experimental Breeder Reactor II X430 experiment series. Results of the benchmarks were compared with measurements and calculations made at the time of the experiment as well as subsequent measurements reported in 2019. The comparisons were used to quantify the accuracy of the BISON predictions and to identify patterns in the BISON differences.BISON predicted burnup, plenum pressure, and fission gas release fractions accurately. BISON temperature predictions were somewhat cooler than the temperatures determined at the time of the experiment but appeared to be reasonably accurate considering uncertainties in the legacy temperature calculations, uncertainties in the legacy linear heat rate calculations, and the high sensitivities of the BISON-predicted temperatures to BISON inputs. Fuel axial elongation predictions had errors correlated to fuel composition; BISON tended to underpredict the elongation of binary fuels and overpredict the elongation of ternary fuels. BISON cladding radial dilation predictions were also significantly lower than legacy PIE measurements.Recommendations were made to improve the BISON fuel gaseous swelling model to account for fuel composition, to add additional capabilities to the coolant channel temperature model to ease benchmark development, and to continue developing benchmark cases based on a wide range of experiments in several reactors. Once a wide array of benchmarks is developed, an attempt can be made to enhance or calibrate BISON models to improve the cladding dilation predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2023

Benchmark Performance Metrics of a Vane Propellant Management Device for a 0.15 m3 Liquid Hydrogen Tank

The use of cryogenic propellants has and will continue to play an integral role in manned-space exploration due the high specific impulses offered and its ubiquity through in-situ resource utilization. But guaranteeing vapor-free transfer of such low-surface tension liquids is difficult for traditional capillary-action propellant management devices (PMDs). Screen-channel liquid acquisition devices and compliant origami bladders are potential solutions, but to quantify the benefits these technologies offer, this paper present a cast study analyzing the performance metrics of an orthodox vane PMD as a benchmark for comparison. A 0.15 m3 liquid hydrogen tank at 20.3 K and 103 kPa was selected for study. Then assuming no body forces and no heat transfer (for simplicity), a steady-state 1-D differential equation was numerically solved in tandem with four possible wetted area configurations to yield an expulsion efficiency for a theoretically maximum inputted expulsion flow rate. Maximization of the flow rate was constrained by the onset of choked flow. Additional inputs, including vane height and vane number, were parametrically varied between 0.1 – 10 cm and 4 – 28 vanes, respectively.

Liquid Acquisition Device↗
DOE OSTI2020

A Metallic Fuel Performance Benchmark Problem Based on the IFR-1 Experiment

Metallic nuclear fuels are an active area of research and development for use in advanced reactors. Robust and accurate metallic fuel performance models are necessary for the design, safety analysis, and licensing of such reactors. However, metallic fuel performance models are not as mature as ceramic fuel performance models and require additional development. In order to better gauge the accuracy of existing models, identify high-priority models for development, and quantify the improvements made by future model development, ORNL has developed a benchmark problem based on the IFR-1 experiment. This work gathers all relevant information on the IFR-1 experiment and uses it to develop the benchmark problem. It simulates the problem using the fuel performance code BISON and compare the results to post-irradiation examination data from the experiment. Then a sensitivity analysis is performed on the BISON model to determine the benchmark problem’s sensitivity to uncertainty in the input parameters. The results suggest that BISON’s mechanical models require additional development. Plastic deformation is under-predicted in the cladding and axial swelling is over-predicted in the fuel. These problems may be related. Additionally, there is a bias in the temperature which may be a result of uncertainty in the input parameters rather than an issue with the fuel performance models.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2017

EVA Human Health and Performance Benchmarking Study Overview and Development of a Microgravity Protocol

The primary objective of this study is to develop a protocol to reliably characterize human health and performance metrics for individuals working inside various EVA suits under realistic spaceflight conditions. Expected results and methodologies developed during this study will provide the baseline benchmarking data and protocols with which future EVA suits and suit configurations (e.g., varied pressure, mass, center of gravity [CG]) and different test subject populations (e.g., deconditioned crewmembers) may be reliably assessed and compared. Results may also be used, in conjunction with subsequent testing, to inform fitness-for-duty standards, as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Norcross, Jason↗
NASA NTRS1986

Toward real-time performance benchmarks for Ada

Benchmarks are developed to measure the Ada notion of time, the Ada features believed important to real-time performance, and other time-related features that are not part of the language, but are part of the run-time system; these benchmarks are then applied to the language and run-time system, and the results evaluated.

Clapp, Russell M.↗
NASA NTRSDate not supplied

Optimization Algorithms as Quantum Performance Benchmarks

Combinatorial optimization is anticipated to be one of the primary use cases for quantum computation in the coming years. The Quantum Approximate Optimization Algorithm (QAOA) and Quantum Annealing (QA) have the potential to demonstrate significant run-time performance benefits over current state-of-the-art solutions. Using existing methods for characterizing classical optimization algorithms, we analyze solution quality obtained by solving Max-Cut problems using a quantum annealing device and gate-model quantum simulators and devices. This is used to guide the development of an advanced benchmarking framework for quantum computers designed to evaluate the trade-off between run-time execution performance and the solution quality for iterative hybrid quantum-classical applications. The framework generates performance profiles through effective visualizations that show performance progression as a function of time for various problem sizes and illustrates algorithm limitations uncovered by the benchmarking approach. The framework is an enhancement to the existing open-source QED-C Application-Oriented Benchmark suite and can connect to the open-source analysis libraries. The suite can be executed on various quantum simulators and quantum hardware systems.

benchmarking↗
DOE OSTI2024

Two MCNP Models for Computational Performance Benchmarking

The purpose of this report is to describe two non-trivial MCNP models and execution configurations that are suitable to characterizing computational performance. To that end, this report uses a constructive solid geometry (CSG) representation of the Oak Ridge National Laboratory (ORNL) Pool Critical Assembly (PCA) [1–3] to perform a k-eigenvalue calculation and an unstructured mesh (UM) representation of the International Commission on Radiological Protection (ICRP) publication 145 (ICRP145) male human phantom [4, 5] to perform a fixed-source calculation assuming that a 1 MeV photon source is distributed throughout the phantom’s liver.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Understanding HPC Benchmark Performance on Intel Broadwell and Cascade Lake Processors

Hardware platforms in high performance computing are constantly getting more complex to handle even when considering multicore CPUs alone. Numerous features and configuration options in the hardware and the software environment that are relevant for performance are not even known to most application users or developers. Microbenchmarks, i.e., simple codes that fathom a particular aspect of the hardware, can help to shed light on such issues, but only if they are well understood and if the results can be reconciled with known facts or performance models. The insight gained from microbenchmarks may then be applied to real applications for performance analysis or optimization. In this paper we investigate two modern Intel x86 server CPU architectures in depth: Broadwell EP and Cascade Lake SP. We highlight relevant hardware configuration settings that can have a decisive impact on code performance and show how to properly measure on-chip and off-chip data transfer bandwidths. The new victim L3 cache of Cascade Lake and its advanced replacement policy receive due attention. Finally we use DGEMM, sparse matrix-vector multiplication, and the HPCG benchmark to make a connection to relevant application scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Performance Benchmark of Commercial and Developmental Fission Chambers in Elevated Temperatures

This report documents the testing of two in-core fission chamber technologies for high-temperature irradiation environments. This work is in collaboration with the French Alternative Energies and Atomic Energy Commission (CEA). The fission chamber evaluated by Idaho National Laboratory is the micro-pocket fission detector (MPFD). The fission chamber evaluated by the CEA are the 3 mm miniaturized fission chamber and the 7 mm high-temperature fission chamber. Demonstrations of the MPFD were performed at the Neutron Radiography Facility and the Massachusetts Institute of Technology Reactor. Demonstrations of the CEA fission chambers were performed at the Ohio State University Research Reactor. All demonstrations were conducted with a heated experiment rig up to 850°C.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Edge-cloud computing performance benchmarking for IoT based machinery vibration monitoring

Advances in low cost and reliable sensing, connectivity (Internet of Things), computational power, and advanced analytics, are leading to a new wave of innovation in machinery status sensing and condition monitoring. Significant research efforts are directed towards cloud computing architectures. However, given the latency, bandwidth, cost, security, and privacy concerns, further supported by the ever-increasing capabilities of edge computing devices, there is a need to consider both edge and cloud computing together to make informed decisions based upon context and performance. In this work, we present an edge-cloud performance evaluation for IoT based machinery vibration monitoring, to foster deployment for the contexts considered.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

High-throughput calculations of charged point defect properties with semi-local density functional theory—performance benchmarks for materials screening applications

Abstract Calculations of point defect energetics with Density Functional Theory (DFT) can provide valuable insight into several optoelectronic, thermodynamic, and kinetic properties. These calculations commonly use methods ranging from semi-local functionals with a-posteriori corrections to more computationally intensive hybrid functional approaches. For applications of DFT-based high-throughput computation for data-driven materials discovery, point defect properties are of interest, yet are currently excluded from available materials databases. This work presents a benchmark analysis of automated, semi-local point defect calculations with a-posteriori corrections, compared to 245 “gold standard” hybrid calculations previously published. We consider three different a-posteriori correction sets implemented in an automated workflow, and evaluate the qualitative and quantitative differences among four different categories of defect information: thermodynamic transition levels, formation energies, Fermi levels, and dopability limits. We highlight qualitative information that can be extracted from high-throughput calculations based on semi-local DFT methods, while also demonstrating the limits of quantitative accuracy.

36 MATERIALS SCIENCE↗