Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Benchmarking the Use of BPM Quadrupole Moments to Measure Emittance

For the PIP-II program, transverse emittance in the Fermilab Booster must remain well controlled at higher bunch intensities. 4-plate beam position monitors (BPMs) have a small but measurable quadrupole moment, making it possible to infer transverse emittance. By compositing many BPMs together, it becomes possible to improve the quality of the quadrupole signal. The Fermilab Booster BPM system has been used to measure these quadrupole moments in the past year and derive emittances from them. Recent benchmarks show that the derived BPM emittances show similar emittance evolution and value to IPM and Multiwire data. This approach can both supplement and complement existing non-intercepting emittance monitors in accelerators.

Balcewicz, M. A. [Fermilab]↗
DOE OSTI2020

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗
DOE OSTI2025

DeepBench: A simulation package for physical benchmarking data

We introduce **DeepBench**, a python library that generates simple simulated image data from first principles, such as basic geometric shapes and astronomical objects. These data are highly valuable for developing (calibration, testing, and benchmarking) statistical and machine learning models because they make it possible to connect the final data product to physically interpretable inputs. This software includes tools to curate and store the datasets to maximize reproducibility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

High-Resolution Simulations of Geological CO 2 Injection: Application to the SPE11 Benchmark

Geological carbon sequestration (GCS) will play a critical role in decarbonization and in facilitating the transition to clean energy systems. Because CO 2 is highly mobile, ensuring its safe and permanent injection into subsurface geological formations involves monitoring over larger spatial domains and longer time periods than is typical for hydrocarbon reservoirs. This can benefit from simulation tools capable of modeling key CO 2 trapping mechanisms, particularly those optimized for speed and scalability on high-performance computing systems. Using isothermal versions of the SPE11B and SPE11C benchmark cases, we conduct a mesh refinement study simulating CO 2 injection into kilometer-scale rock formations at centimeter resolution with the GEOS open-source simulation framework. We focus on how mesh refinement improves the accuracy of convective mixing in both 2D and 3D simulations. The computational costs associated with achieving a converged solution highlight the need for predictive upscaling techniques. A systematic performance scaling analysis—including both central processing unit (CPU) and graphics processing unit (GPU) architectures—complements the “Results” section.

Geosciences↗
DOE OSTI2012

Creation of a Full-Core HTR Benchmark with the Fort St. Vrain Initial Core and Assessment of Uncertainties in the FSV Fuel Composition and Geometry

Information and measured data from the intial Fort St. Vrain (FSV) high temperature gas reactor core is used to develop a benchmark configuration to validate computational methods for analysis of a full-core, commercial HTR configuration. Large uncertainties in the geometry and composition data for the FSV fuel and core are identified, including: (1) the relative numbers of fuel particles for the four particle types, (2) the distribution of fuel kernel diameters for the four particle types, (3) the Th:U ratio in the initial FSV core, (4) and the buffer thickness for the fissile and fertile particles. Sensitivity studies were performed to assess each of these uncertainties. A number of methods were developed to assist in these studies, including: (1) the automation of MCNP5 input files for FSV using Python scripts, (2) a simple method to verify isotopic loadings in MCNP5 input files, (3) an automated procedure to conduct a coupled MCNP5-RELAP5 analysis for a full-core FSV configuration with thermal-hydraulic feedback, and (4) a methodology for sampling kernel diameters from arbitrary power law and Gaussian PDFs that preserved fuel loading and packing factor constraints. A reference FSV fuel configuration was developed based on having a single diameter kernel for each of the four particle types, preserving known uranium and thorium loadings and packing factor (58%). Three fuel models were developed, based on representing the fuel as a mixture of kernels with two diameters, four diameters, or a continuous range of diameters. The fuel particles were put into a fuel compact using either a lattice-bsed approach or a stochastic packing methodology from RPI, and simulated with MCNP5. The results of the sensitivity studies indicated that the uncertainties in the relative numbers and sizes of fissile and fertile kernels were not important nor were the distributions of kernel diameters within their diameter ranges. The uncertainty in the Th:U ratio in the intial FSV core was found to be important with a crude study. The uncertainty in the TRISO buffer thickness was estimated to be unimportant but the study was not conclusive. FSV fuel compacts and a regular FSV fuel element were analyzed with MCNP5 and compared with predictions using a modified version of HELIOS that is capable of analyzing TRISO fuel configurations. The HELIOS analyses were performed by SSP. The eigenvalue discrepancies between HELIOS and MCNP5 are currently on the order of 1% but these are still being evaluated. Full-core FSV configurations were developed for two initial critical configurations - a cold, clean critical loading and a critical configuration at 70% power. MCNP5 predictions are compared to experimental data and the results are mixed. Analyses were also done for the pulsed neutron experiments that were conducted by GA for the initial FSV core. MCNP5 was used to model these experiments and reasonable agreement with measured results has been observed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2012

Benchmarking a new closed-form thermal analysis technique against a traditional lumped parameter, finite-difference method

A benchmarking effort was conducted to determine the accuracy of a new analytic generic geology thermal repository model developed at LLNL relative to a more traditional, numerical, lumped parameter technique. The fast-running analytical thermal transport model assumes uniform thermal properties throughout a homogenous storage medium. Arrays of time-dependent heat sources are included geometrically as arrays of line segments and points. The solver uses a source-based linear superposition of closed form analytical functions from each contributing point or line to arrive at an estimate of the thermal evolution of a generic geologic repository. Temperature rise throughout the storage medium is computed as a linear superposition of temperature rises. It is modeled using the MathCAD mathematical engine and is parameterized to allow myriad gridded repository geometries and geologic characteristics [4]. It was anticipated that the accuracy and utility of the temperature field calculated with the LLNL analytical model would provide an accurate 'birds-eye' view in regions that are many tunnel radii away from actual storage units; i.e., at distances where tunnels and individual storage units could realistically be approximated as physical lines or points. However, geometrically explicit storage units, waste packages, tunnel walls and close-in rock are not included in the MathCAD model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2012

Benchmark Imagery Project: Report on Generation of Synthetic Images

The “Benchmark Imagery” project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities (e.g., auto-annotation). The project is a collaborative effort between Los Alamos National Laboratory (LANL) and the Lawrence Livermore National Laboratory (LLNL). Although a variety of image modalities are used to capture overhead photographs of terrestrial facilities, the current focus of the effort of this project is on collecting and annotating conventional visual-band (RGB or RGB/NIR) images. Presently, the set of images consists of 114 airborne images of various US industrial facilities. We have annotated all of the images in the imagery set, using a constrained vocabulary of about a dozen general terms such as “building,” ”tower,” or “electrical substation.” The project plans to include synthetic and composite images in addition to actual photographs. In preparation for using synthetic images, we have built a proof-of-principle synthetic image of a fictitious nuclear power plant. This report describes the key aspects of creating that image.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

Development and benchmarking of codes for simulation of beam-beam effects at the LHC

Beam dynamics in modern hadron colliders is strongly affected by effects of beam-beam interactions, which are complex phenomena and generally require extensive numerical simulations for accurate evaluation. In this note we describe the development of codes used for simulations of beam-beam effects at the LHC. We benchmark the codes on several test cases and report the results of this comparison.

43 PARTICLE ACCELERATORS↗
DOE OSTI2012

International benchmark calculations of field experiments at the Asse Salt Mine

The geomechanical modeling efforts and results for two benchmark calculations performed by Sandia National Laboratories (Sandia) under the third phase of an overall joint project investigating the behavior of advanced geomechanical constitutive models for rock salt are described and discussed in this report. Sandia recently joined the third phase of the project and is a contributing partner to this U.S./German joint effort entitled “Comparison of current constitutive models and simulation procedures on the basis of model calculations of the thermo-mechanical behavior and healing of rock salt”. The geomechanical models, corresponding results, and their comparison to the in-situ data associated with both the so-called Isothermal Free Convergence (IFC) and Heated Free Convergence Probe (HFCP) borehole experiments conducted by the Netherlands Energy Research Foundation, ECN, at the Asse Mine (Germany) in the mid-80’s are detailed herein.

Holland, John Francis↗
DOE OSTI2012

REPORT FOR COMMERCIAL GRADE NICKEL CHARACTERIZATION AND BENCHMARKING

Oak Ridge Associated Universities (ORAU), under the Oak Ridge Institute for Science and Education (ORISE) contract, has completed the collection, sample analysis, and review of analytical results to benchmark the concentrations of gross alpha-emitting radionuclides, gross beta-emitting radionuclides, and technetium-99 in commercial grade nickel. This report presents methods, change management, observations, and statistical analysis of materials procured from sellers representing nine countries on four continents. The data suggest there is a low probability of detecting alpha- and beta-emitting radionuclides in commercial nickel. Technetium-99 was not detected in any samples, thus suggesting it is not present in commercial nickel.

36 MATERIALS SCIENCE↗
DOE OSTI2012

ASCEM Pumping Test Capabilities: Benchmarking and Demonstration for UGTA at U-20 WW

The Advanced Simulation Capability for Environmental Management (ASCEM) High Performance Computing (HPC) simulator, Amanzi, was improved to simulate pumping tests in confined and unconfined aquifers. This report documents the testing and then application of those capabilities to simulate the U-20 WW pumping test on Pahute Mesa. Capabilities added to Amanzi include (1) transient Darcy flow with adaptive time stepping; (2) application of the specific yield term in cells representing unconfined conditions at the water table along the top of model and specific storage at other cells; (3) source/sink term; and (4) hydraulic head boundary conditions. These capabilities are benchmarked using an analytical solution and an existing numerical code. Then, they are implemented in a set of demonstration simulations for UGTA's U-20 WW pumping test.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

Development and Benchmarking of Codes for Simulation of Beam-Beam Effects at the LHC

Beam dynamics in modern hadron colliders is strongly affected by effects of beam-beam interactions, which are complex phenomena and generally require extensive numerical simulations for accurate evaluation. In this note we describe the development of codes used for simulations of beam-beam effects at the LHC. We benchmark the codes on several test cases and report the results of this comparison.

43 PARTICLE ACCELERATORS↗
DOE OSTI2012

Benchmark Imagery for Assessing Geospatial Semantic Content Extraction Algorithms -- Annual Report for FY2012

The primary objective of this project is to create a set of benchmark imagery for validating algorithms designed to extract semantic content from geospatial images of industrial facilities. The goal is not to develop algorithms but to provide images that can be used to do so. The secondary objective is to demonstrate how this imagery could be used for algorithm validation. The project is a collaborative effort between Los Alamos National Laboratory (LANL) and the Lawrence Livermore National Laboratory (LLNL).

42 ENGINEERING↗
DOE OSTI2013

Benchmark Imagery Project: Selection of Real World Images for Creating Composite Images of Facilities

The "Benchmark Imagery" project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery (both real and composite) that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities. A composite image is an image that contains both real elements such as photographic imagery and synthetic elements such as 3D models. Composite images have the advantage of being customizable and distributable, and they can contain complete ground truth. It is our goal to generate composite images which appear realistic to both human and algorithm. When generating composite images of facilities we use real overhead imagery to increase realism and decrease effort. To construct all elements with purely synthetic textures would require too much effort and still may not look as realistic as a real image. We use real time 3D rendering software "SceneWorks" for rendering composite images. In SceneWorks, a scene is constructed by placing 3D models of facility components on top of a base terrain. A base terrain is a 3D model constructed from digital elevation mapping (DEM) data and then textured with overhead orthorectified imagery. The base terrain is constructed to be geospatially accurate using a real location’s source data (DEM and Imagery.) This document outlines the selection criteria in selecting appropriate location and source data for constructing the base terrain. Imagery should have resolution equal or better than desired composite image resolution. The imagery should have no seams. Seams can occur when two or more different imagery data sets exist in a single area with neither set covering the entire area. Elevation data (DEM) resolution generally should be 1/9 arc second or better depending on the variability of elevation. The imagery must contain a flat clearing of land large enough for multiple facility types. There should be no high-rise buildings anywhere in the base terrain.

42 ENGINEERING↗
DOE OSTI2014

Discussion Regarding Aqueous Homogeneous Reactor (AHR) Benchmarks

“Characteristics of Fissile Solution Systems”, LA-UR-14-21513, published by the same authors, detailed the behavior of the subject systems that distinguishes them from those employing solid fuels. This Report, a companion to the presentation by the same name published by the authors as LA-UR-14- 21529, extends that discussion to illustrate this behavior with reference to the operation of historic aqueous homogeneous reactors (AHR). In this report the term “benchmark” refers to those systems for which it is judged that sufficient experimental data exists to serve as a reference for the behavior of the class of fissile solution systems called AHR. As has been discussed in the previous report, AHR exhibit a range of modes of operation generally determined by the amount of excess reactivity inserted into the system from a steady-state condition, such as sub-critical startup, and the rate of that insertion. The amount of reactivity inserted may fall in the range of $\$0.00$ < Reactivity ≤ $\$1.00$, in the usual units of “dollars” and “cents” or > $\$1.00$. The initial region is called “delayed critical” while the latter is referenced as “super prompt critical”. Excess reactivity may be inserted in rates ranging from slow ramp to step, which drives system dynamics; however, regardless of either of these factors, amplitude or rate of insertion, the ultimate result will be steady-state operation.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗