SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2019

Adding ($\mathcal{α}$,n) Emission to an Existing Subcritical Benchmark Statistical Uncertainty Method

Subcritical measurements often use radiation detectors to infer parameters related to the physics of a measured system. One type of subcritical measurements typically performed are called neutron noise measurements. These types of measurements utilize the fact that prompt neutrons are produced from fission immediately after a fission event and are therefore correlated in time. Subcritical benchmarks require evaluation of the statistical and systematic uncertainties of a measurement. Previous work established methods for determining statistical and systematic uncertainties in subcritical benchmarks. The data were analyzed using the Hage-Cifarelli formalism of the Feynman Variance-to-Mean method. The previous work made an assumption that the ($\mathcal{α}$,n) emission rate was negligible. This assumption was used because the previous work focused on systems with metal Plutonium. This work extends the existing statistical uncertainty method to include ($\mathcal{α}$,n) emissions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2019

Select Transient Metallic Fuel Bison Benchmarks

To explore the current capabilities of Bison with respect to transient metallic fuel modeling, four transient experiments are compared with their respective Bison model. The four experiments are the OPT-1 experiment of the Experimental Breeder Reactor II~(EBR-II) and the M5, M6, and M7 experiments of the Transient Reactor Test facility (TREAT). Each benchmark is a 2D-RZ geometry of a single pin employing coupled multiphysics. Bison models of the benchmark agree well and illustrate areas needing development. The areas of suggested development deal with better material models, better coolant channel module for transients, proper treatment of material melting, improved feedback with failure models, and an ability to set initial conditions from post irradiation examination (PIE) data. Two Fast Flux Test Facility (FFTF) pins are also modeled with M7 transient conditions to illustrate Bison being applied to investigate potential experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

Benchmark for Fuel Shuffling and Depletion for Pebble-Bed Reactors

Pebble bed reactors have specific operational characteristics when their fuel-cycle and fueling operations are considered. They are specifically distinguished by other type of nuclear reactor designs by their online fuel recycling scheme, where the fuel elements that have not yet reached discharge burnup can be reloaded and recycled continuously during normal operation. The fuel in a pebble bed reactor is not stationary and stochastically moves through the core once or several times during its lifetime, which allows them to operate without requiring a large excess reactivity hold for the burnup. However, this characteristic of pebble bed reactors introduces challenges in simulation, as each pebble can take many different trajectories through the core, its composition depends on the details of the irradiation history that is unique to its aggregated path through the core. For predicting the safety performance characteristics, such as source term, maximum fuel temperatures and fuel failure rates, etc., it is important to accurately incorporate the movement of pebbles through the core during their lifetime in a multi-physics simulation together with other phenomena. The equilibrium core analysis for pebble bed reactors are performed with multi-physics tools including fuel depletion in a multi pass reload coupled to the fuel movement. Currently, there are only a few legacy multi-physics simulation tools that can implement the pebble flow characteristics and perform equilibrium core analysis for pebble bed reactors. However, there are development efforts on-going under Department of Energy's Nuclear Energy Advanced Modelling and Simulation program and also in private industry for including these capabilities into their modelling and simulation tools. Any new development in the modelling and simulation tools needs to be validated by using tools such as experiments, analytical solutions or code-to-code benchmarks. In this work, a code-to-code benchmark for the equilibrium core analysis capability of pebble bed reactors was developed. Multiple cases were identified to capture different fuel cycle strategies that can be used in PBRs. The results of each case are presented in terms of overall equilibrium core characteristics: the discharge burnup; spatial burnup distribution; spatial isotopic distributions; axial and radial neutron flux distributions and power history of fuel elements per pass through the core for both a prototypical pebble bed High Temperature Gas-cooled Reactor and a prototypical pebble bed Fluoride-salt cooled High temperature Reactor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

Benched: Upgrading and Updating the Los Alamos Benchmark Suite for the 21st Century [Slides]

The presentation begins by stating that most organizations make choices to handle specific things when preparing input files for validation, such as which elemental abundance data to use, how to decompose specific elements, and setting calculation precision. It also discusses the consequences, which include differing calculation results between different organizations for the same case, even when using the same code. This is illustrated by the intercomparison exercise and input files that are prepared by one organization and are not necessarily correct for another. The presentation explains that the Los Alamos Benchmark Suite is a centralized repository of high-quality benchmark models currently under development at LANL. The objectives of the new repository are to remain up to date with the latest ICSBEP revision, to have a formal review and revision process, to (eventually) be an open-source repository, and to provide new tools for improved input and output file generation and review.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

NMSBA: Continuous Application Benchmarking & Analysis – CABA

The CABA project is a test of a new tool, Survey,developed by Trenza to be used not only for benchmarking or profiling programs but also to allow incorporation of the information provided by Survey to be utilized in a CI, continuous integration,tool such as GitLab CI.Survey is foremost a means of assessing code performance in terms of time and operations which for computer programmers is known as benchmarking.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

U.S. Solar Photovoltaic System and Energy Storage Cost Benchmark (Q1 2020)

This report benchmarks U.S. solar photovoltaic (PV) system installed costs as of the first quarter of 2020 (Q1 2020). We use a bottom-up method, accounting for all system and project-development costs incurred during the installation to model the costs for residential (with and without storage), commercial (with and without storage), and utility-scale systems (with and without storage). We also incorporate other system characteristics and performance factors, as well as ongoing costs, to benchmark LCOE for PV-standalone systems, and LCOSS for solar+storage.

14 SOLAR ENERGY↗

DOE OSTI2021

LABS: Los Alamos Benchmark Suite - Current status and planning [Slides]

The LABS repository now has over 500 verified and revised input files with about 600 input files left to get up to speed with what we currently use. After that there are many, many more to go. We're in the process of building code infrastructure, moving to template output files, automating input file generation, outputting file data mining for calculation results, and benchmarking selection on sensitivity and other benchmark characteristics. We intend to open source LABS. We'll most likely release the input files sooner rather than later. The associated tool will probably be open sourced later.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Thermal Neutron Scattering Law Benchmark and Validation at NCSU [Slides]

The presentation discusses how the NCSU graphite SDT ORELA experiment is under development as a benchmark. It discusses the testing of various ENDF/B-VII.1 and ENDF/B-VIII.0 graphite libraries that have been performed using the PROTEUS benchmark. The presentation demonstrates that the NSCU Polyethylene ENDF/B-VIII.0 TSL improves agreement with total cross section measurements. The presentation concludes by stating that the NCSU single crystal sapphire TSL library is based on realistic data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

On Integral Benchmarks for Resolving TSL Conflicts for ENDF/B-VIII.1 Release [Slides]

This presentation touches on polystyrene ORNL evaluation in TSL review process for ENDF/B-VIII.1. the presentation found excellent agreement with INS and transmission measurements. Additionally, PS and PE evaluations with different phonon spectra, similar total xs., calculate keff similarly. This presentation found for critical benchmarks. While extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. In conclusion this presentation found INS and transmission measurements need to be the basis of validation of TSLs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Griffin/Pronghorn PBMR-400 Benchmark Results [Slides]

Content Overview: 1) Pronghorn & Griffin, MOOSE based applications overview: Codes capabilities description & MOOSE ecosystem overiew; Current research activities and synergies with other projects; Different multiphysics coupling scheme description. 2) PBMR-400 Benchmark: OECD NEA Benchmark and Pronghorn/Griffin models description; Standalone NK Ex1 and TH Ex2 Results description; Coupled Steady state Ex3; Results analysis for Transiet Ex4a (100-40-100 Load Following) & Ex3 (Protected PLOFC). 3) Conclusions $ Future steps.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2018

BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting

The BuildingsBench datasets consist of: - Buildings-900K: A large-scale dataset of 900K buildings for pretraining models on the task of short-term load forecasting (STLF). Buildings-900K is statistically representative of the entire U.S. building stock. - 7 real residential and commercial building datasets for benchmarking two downstream tasks evaluating generalization: zero-shot STLF and transfer learning for STLF. Buildings-900K can be used for pretraining models on day-ahead STLF for residential and commercial buildings. The specific gap it fills is the lack of large-scale and diverse time series datasets of sufficient size for studying pretraining and finetuning with scalable machine learning models. Buildings-900K consists of synthetically generated energy consumption time series. It is derived from the NREL End-Use Load Profiles (EULP) dataset (see link to this database in the links further below). However, the EULP was not originally developed for the purpose of STLF. Rather, it was developed to "...help electric utilities, grid operators, manufacturers, government entities, and research organizations make critical decisions about prioritizing research and development, utility resource and distribution system planning, and state and local energy planning and regulation." Similar to the EULP, Buildings-900K is a collection of Parquet files and it follows nearly the same Parquet dataset organization as the EULP. As it only contains a single energy consumption time series per building, it is much smaller (~110 GB). BuildingsBench also provides an evaluation benchmark that is a collection of various open source residential and commercial real building energy consumption datasets. The evaluation datasets, which are provided alongside Buildings-900K below, are collections of CSV files which contain annual energy consumption. The size of the evaluation datasets altogether is less than 1GB, and they are listed out below: 1. ElectricityLoadDiagrams20112014 2. Building Data Genome Project-2 3. Individual household electric power consumption (Sceaux) 4. Borealis 5. SMART 6. IDEAL 7. Low Carbon London A README file providing details about how the data is stored and describing the organization of the datasets can be found within each data lake version under BuildingsBench.

Array↗

DOE OSTI2018

Evaluating Uncertainties in Marine Biogeochemical Models: Benchmarking Aerosol Precursors

The effort to accurately estimate global radiative forcing has long been hampered by a degree of uncertainty in the tropospheric aerosol contribution. Reducing uncertainty in natural aerosol processes, the baseline of the aerosol budget, thus becomes a fundamental task. The appropriate representation of aerosols in the marine boundary layer (MBL) is essential to reduce uncertainty and provide reliable information on offsets to global warming. We developed an International Ocean Model Benchmarking package to assess marine biogeochemical process representations in Earth System Models (ESMs), and the package was employed to evaluate surface ocean concentrations and the sea–air fluxes of dimethylsulfide (DMS). Model performances were scored based on how well they captured the distribution and variability contained in high-quality observational datasets. Results show that model-data biases increased as DMS enters the MBL, but unfortunately over three-quarters of the models participating in the fifth Coupled Model Intercomparison Project (CMIP5) did not have a dynamic representation of DMS. When it is present, models tend to over-predict sea surface concentrations in the productive region of the eastern tropical Pacific by almost a factor of two, and the sea–air fluxes by a factor of three. Systematic model-data benchmarking as described here will help to identify such deficiencies and subsequently lead to improved subgrid-scale parameterizations and ESM development.

58 GEOSCIENCES↗

DOE OSTI2021

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

DOE OSTI2016

The trends high-contrast imaging survey. VI. Discovery of a mass, age, and metallicity benchmark brown dwarf

The mass and age of substellar objects are degenerate parameters leaving the evolutionary state of brown dwarfs ambiguous without additional information. Theoretical models are normally used to help distinguish between old, massive brown dwarfs and young, low-mass brown dwarfs but these models have yet to be properly calibrated. We have carried out an infrared high-contrast imaging program with the goal of detecting substellar objects as companions to nearby stars to help break degeneracies in inferred physical properties such as mass, age, and composition. Rather than using imaging observations alone, our targets are pre-selected based on the existence of dynamical accelerations informed from years of stellar radial velocity (RV) measurements. In this paper, we present the discovery of a rare benchmark brown dwarf orbiting the nearby (d = 18.69 ± 0.19 pc), solar-type (G9V) star HD 4747 ([Fe/H] = −0.22 ± 0.04) with a projected separation of only ρ = 11.3 ± 0.2 au (θ = 0.″6). Precise Doppler measurements taken over 18 years reveal the companion’s orbit and allow us to place strong constraints on its mass using dynamics (msin i=55.3±1.9M{sub Jup}). Relative photometry (ΔK {sub s} = 9.05 ± 0.14, M{sub K{sub s}}=13.00±0.14, K{sub s}−L{sup ′}=1.34±0.46) indicates that HD 4747 B is most likely a late-type L-dwarf and, if near the L/T transition, an intriguing source for studying cloud physics, variability, and polarization. We estimate a model-dependent mass of m=72{sub −13}{sup +3} M{sub Jup} for an age of 3.3{sub −1.9}{sup +2.3} Gyr based on gyrochronology. Combining astrometric measurements with RV data, we calculate the companion dynamical mass (m=60.2±3.3M{sub Jup}) and orbit (e = 0.740 ± 0.002) directly. As a new mass, age, and metallicity benchmark, HD 4747 B will serve as a laboratory for precision astrophysics to test theoretical models that describe the emergent radiation of brown dwarfs.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2016

Final Report of the NASA Office of Safety and Mission Assurance Agile Benchmarking Team

To ensure that the NASA Safety and Mission Assurance (SMA) community remains in a position to perform reliable Software Assurance (SA) on NASAs critical software (SW) systems with the software industry rapidly transitioning from waterfall to Agile processes, Terry Wilcutt, Chief, Safety and Mission Assurance, Office of Safety and Mission Assurance (OSMA) established the Agile Benchmarking Team (ABT). The Team's tasks were: 1. Research background literature on current Agile processes, 2. Perform benchmark activities with other organizations that are involved in software Agile processes to determine best practices, 3. Collect information on Agile-developed systems to enable improvements to the current NASA standards and processes to enhance their ability to perform reliable software assurance on NASA Agile-developed systems, 4. Suggest additional guidance and recommendations for updates to those standards and processes, as needed. The ABT's findings and recommendations for software management, engineering and software assurance are addressed herein.

Software Assurance↗

NASA NTRS2021

IFAR Liner Benchmark Challenge #1 - DLR Impedance Eduction of Uniform and Axially Segmented Liners and Comparison with NASA Results

This paper presents the contribution from the German Aerospace Center (DLR) to the first liner benchmark challenge under the framework of the International Forum for Aviation Research (IFAR).Therefore, two sets of acoustically damping wall treatment, called ’liner samples’, have been produced by additive manufacturing based on the design data provided by NASA coordinating this benchmark. These liner samples have been integrated and acoustically characterized in the liner flow test facility DUCT-R at DLR Berlin as well as in the liner flow test facility GFIT at NASA Langley. Besides the dissipation coefficients and the axial pressure profiles, the liner wall impedance was educed by first determining the axial wave numbers and then applying a straightforward method based on the one-dimensional Convected Helmholtz Equation. Finally, the comparison of the liner impedance values to the NASA results show a fairly good agreement.

liner characterization↗

DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

DOE OSTI2022

Verification of MCNP Critical Benchmark Model of U233-COMP-THERM-004

Los Alamos National Laboratory (LANL) has been working on creating a new centralized repository for MCNP models of critical benchmark experiments. The initial model of U233-COMP-THERM-004 was derived from the Whisper Suite provided with MCNP6.2, and was compared against the ICSBEP handbook chapter for the benchmark. Many notable errors were found in the initial model and were revised accordingly. Comparing the computational model of the old and new models confirmed that any Whisper results that relied upon the old model are still valid.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗