Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

NISQ Benchmarking

Test suite of quantum algorithms for Noisy Intermediate Scale Quantum (NISQ) computers. The test suite includes benchmark-style code for quantum volume circuits (QV), fairness sampling circuits, quantum telecloning circuits, and other NISQ benchmark style algorithms on small problems (i.e., up to 100 qubits), such as Variational Quantum Eigensolver (VQE), Hamiltonian Simulation, and Grover unstructured search example circuits. These benchmark-style applications are implemented in quantum software packages, mostly IBM's QISKIT, but may include vendor-specific frameworks, such as PyQuil (for Rigetti) or Q\# for Microsoft, or CirQ (for Google) as the test suite grows with the vendor sample. The test suite also includes numerical simulation code for Quantum Alternating Operator Ansatz (QAOA) algorithms, VQE, Hamiltonian Simulation and search examples. Numerical simulation code simulates quantum computers on classical computers, which is only possible for small problem instances; the implementation framework of choice is typically within Python, using the numpy/scipy libraries as well as extensions to the Julia language.

Pelofske, Elijah↗
DOE OSTI2023

SABATH: Surrogate AI Benchmarking Applications' Testing Harness

SABATH provides benchmarking infrastructure for evaluating scientific ML/AI models. It contains support for scientific machine learning surrogates from external repositories. The software dependences are explicitly exposed in the surrogate model definition, which allows the use of advanced optimization, communication, and hardware features.

Luszczek, Piotr [Univ. of Tennessee, Knoxville, TN↗
DOE OSTI2020

Online Optimization for Networked Distributed Energy Resources With Time-Coupling Constraints

This paper proposes a Lyapunov optimization-based online distributed (LOOD) algorithmic framework for active distribution networks (ADNs) with numerous photovoltaic inverters and inverter air conditionings (IACs). In the proposed scheme, ADNs can track an active power setpoint reference at the substation in response to transmission-level requests while concurrently minimizing the social utility loss and ensuring the security of voltages. Conventional distributed optimization methods are rarely feasible to track the optimal solutions in fast variable environments using a fine-grained sampling interval where the underlying optimization problem evolves with the iterations of the algorithms. In contrast, based on the framework of online convex optimization (OCO), the developed approach uses a distributed algebraic update to compute the next round decisions relying on the current feedback of measurements. Notably, the time-coupling constraints of IACs are decoupled for online implementation with Lyapunov optimization technique. An incentive scheme is tailored to coordinate the customer-owned assets in lieu of the direct control from network operators. Optimality and convergency are characterized analytically. Finally, we corroborate the proposed method on a modified version of 33-node test feeder. Benchmark tests show that the proposed method is computationally and economically efficient, and outperforming existing algorithms.

active distribution networks↗
DOE OSTI2025

NEA HTTR LOFC Project Test#2 Benchmark Results

The High Temperature Engineering Test Reactor (HTTR) is a 30 MW prismatic high-temperature gas-cooled reactor (HTGR) owned and operated by the Japan Atomic Energy Agency (JAEA). Staring in 2010, HTTR was used in a series of three loss of forced cooling (LOFC) tests without SCRAM to demonstrate the inherent safety of HTGRs.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2014

Noiseless Vlasov–Poisson simulations with linearly transformed particles

We introduce a deterministic discrete-particle simulation approach, the Linearly-Transformed Particle-In-Cell (LTPIC) method, that employs linear deformations of the particles to reduce the noise traditionally associated with particle schemes. Formally, transforming the particles is justified by local first order expansions of the characteristic flow in phase space. In practice the method amounts of using deformation matrices within the particle shape functions; these matrices are updated via local evaluations of the forward numerical flow. Because it is necessary to periodically remap the particles on a regular grid to avoid excessively deforming their shapes, the method can be seen as a development of Denavit's Forward Semi-Lagrangian (FSL) scheme (Denavit, 1972 [8]). However, it has recently been established (Campos Pinto, 2012 [20]) that the underlying Linearly-Transformed Particle scheme converges for abstract transport problems, with no need to remap the particles; deforming the particles can thus be seen as a way to significantly lower the remapping frequency needed in the FSL schemes, and hence the associated numerical diffusion. To couple the method with electrostatic field solvers, two specific charge deposition schemes are examined, and their performance compared with that of the standard deposition method. Finally, numerical 1d1v simulations involving benchmark test cases and halo formation in an initially mismatched thermal sheet beam demonstrate some advantages of our LTPIC scheme over the classical PIC and FSL methods. Benchmarked test cases also indicate that, for numerical choices involving similar computational effort, the LTPIC method is capable of accuracy comparable to or exceeding that of state-of-the-art, high-resolution Vlasov schemes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2017

RIA simulation tests using driver tube for ATF cladding

Pellet-cladding mechanical interaction (PCMI) is a potential failure mechanism for accident-tolerant fuel (ATF) cladding candidates during a reactivity-initiated accident (RIA). This report summarizes Fiscal Year (FY) 2017 research activities that were undertaken to evaluate the PCMI-like hoop-strain-driven mechanical response of ATF cladding candidates. To achieve various RIA-like conditions, a modified-burst test (MBT) device was developed to produce different mechanical pulses. The calibration of the MBT instrument was accomplished by performing mechanical tests on unirradiated Generation-I iron-chromium-aluminum (FeCrAl) alloy samples. Shakedown tests were also conducted in both FY 2016 and FY 2017 using unirradiated hydrided ZIRLO™ tube samples. This milestone report focuses on testing of ATF materials, but the benchmark tests with hydrided ZIRLO™ tube samples are documented in a recent journal article.a For the calibration and benchmark tests, the hoop strain was monitored using strain gauges attached to the sample surface in the hoop direction. A novel digital image correlation (DIC) system composed of a single high-speed camera and an array of six mirrors was developed for the MBT instrument to better resolve the failure behavior of samples and to provide useful data for validation of high-fidelity modeling and simulation tools. The DIC system enable a 360° view of a sample’s outer surface. This feature was added to the instrument to determine the precise failure location on a sample’s surface for strain predictions. The DIC system was tested on several silicon carbide fiber/silicon carbide matrix (SiC/SiC) composite tube samples at various pressurization rates of the driver tube (which correspond to the strain rates for the samples). The hoop strains for various loading conditions were determined for the SiC/SiC composite tube samples. Future work is planned to enhance understanding of the failure behavior of the ATF cladding candidates of age-hardened FeCrAl alloys and SiC/SiC composites in detail during RIA conditions informed by the computational studies performed under the US Department of Energy Office of Nuclear Energy Advanced Fuels Campaign. The testing instrument and the new DIC system will be further developed to reach different stress-state conditions and to perform tests at elevated temperatures.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2016

Identification of fuel cycle simulator functionalities for analysis of transition to a new fuel cycle

Dynamic fuel cycle simulation tools are intended to model holistic transient nuclear fuel cycle scenarios. As with all simulation tools, fuel cycle simulators require verification through unit tests, benchmark cases, and integral tests. Model validation is a vital aspect as well. Although compara-tive studies have been performed, there is no comprehensive unit test and benchmark library for fuel cycle simulator tools. The objective of this paper is to identify the must test functionalities of a fuel cycle simulator tool within the context of specific problems of interest to the Fuel Cycle Options Campaign within the U.S. Department of Energy s Office of Nuclear Energy. The approach in this paper identifies the features needed to cover the range of promising fuel cycle options identified in the DOE-NE Fuel Cycle Evaluation and Screening (E&S) and categorizes these features to facilitate prioritization. Features were categorized as essential functions, integrating features, and exemplary capabilities. One objective of this paper is to propose a library of unit tests applicable to each of the essential functions. Another underlying motivation for this paper is to encourage an international dialog on the functionalities and standard test methods for fuel cycle simulator tools.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2014

MPACT Testing and Benchmarking Results

This document provides detailed reactivity and fission rate distribution results for MPACT for the Core Physics Benchmark Progression Problems 1-5, including comparisons to initial startup data from Watts Bar Nuclear Unit 1. Also included are computer requirements and runtimes for each type of problem and feedback for issues encountered during the testing. Testing for the benchmark problems that do not require thermal-hydraulic feedback has been very successful. Testing for the coupled problems (6 and 7) is still ongoing and will be documented in a future revision or separate document. A few issues have been identified needing more research/investigation before all of these problems have ideal solutions. These items are included in the Section 8 near the end of this document. MPACT has successfully solved all of the zero power core physics progression problems. The computer resources required and runtimes were all acceptable, though faster cases would be preferable considering there was no thermal-hydraulic feedback. MPACT converged very reliably for all 3D problems, expect in a few isolated studies where very thin axial planes were purposely created to attempt to quantify the errors in the control rod tip homogenization model. Despite the issues listed in Section 8, the accuracy of MPACT compared to the reference solution is considered to be very good.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

NEA HTTR LOFC Project Test#3 Benchmark Results

In the second half of FY23, the High Temperature Engineering Test Reactor (HTTR) Loss Of Forced Cooling (LOFC)#3 data for the 9 MW test case with Vessel Cooling System (VCS) off were made available through the Nuclear Energy Agency (NEA) LOFC project framework; the neutronic model developed for the initial test (LOFC#1) achieved a satisfactory level of maturity, demonstrating its accuracy in predicting power evolution and core re-criticality, but LOFC#3 should be used primarily to investigate thermal hydraulic phenomena, as the reactor was shut down prematurely due to overheating in the upper reactor components, which prevented re-criticality; this report focuses on advancing the HTTR thermal hydraulic model to accurately simulate the LOFC#3 scenario, including simulating the LOFC#3 benchmark and generating the corresponding benchmark specifications, aiming to ensure consistency across participant models and provide essential data for future participants, including private industry stakeholders seeking to validate their computational tools.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Evaluating Space Object Conjunction Probabilities Using Characteristic Function Inversion

This report discusses an approach to computing the probability of a conjunction between two space objects in the short-term encounter scenario. A conjunction is defined here as an event where the miss distance between the objects is less than some specified value. The scenario assumptions are that the motion of the objects is linear, their positions are Gaussian distributed, and their velocities are known and constant. Under these assumptions, the squared-miss distance is shown to have the generalized chi-square distribution. An established statistical technique called characteristic function inversion is employed to evaluate the distribution and obtain conjunction probabilities. The method is closely related to a recent approach based on moment generating function inversion, and a qualitative comparison of the approaches is provided. Last, the method is tested on several benchmark test cases where it agrees with numerical integration on the cases with conjunction probabilities above 10 –12 . However, the exact probability in these cases is usually not needed and this probability can be bounded above using an independent Gaussian approximation. Overall, the report shows how to compute conjunction probabilities using a standard statistical method, though numerical integration seems to perform equally well.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2012

ASCEM Pumping Test Capabilities: Benchmarking and Demonstration for UGTA at U-20 WW

The Advanced Simulation Capability for Environmental Management (ASCEM) High Performance Computing (HPC) simulator, Amanzi, was improved to simulate pumping tests in confined and unconfined aquifers. This report documents the testing and then application of those capabilities to simulate the U-20 WW pumping test on Pahute Mesa. Capabilities added to Amanzi include (1) transient Darcy flow with adaptive time stepping; (2) application of the specific yield term in cells representing unconfined conditions at the water table along the top of model and specific storage at other cells; (3) source/sink term; and (4) hydraulic head boundary conditions. These capabilities are benchmarked using an analytical solution and an existing numerical code. Then, they are implemented in a set of demonstration simulations for UGTA's U-20 WW pumping test.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Update to the Microcontroller Benchmark for Radiation Testing

LANL developed a benchmark of software code for radiation testing of microprocessors several years ago, and it was published under an open-source license on GitHub. Publishing the software is necessary for other researchers to adopt and implement this benchmark for radiation testing of other microprocessors to standardize test practices so that test data can be compared across different microprocessors. The original codes have been used several times by other organizations to test a wide range of microcontrollers and microprocessors. After several years of research, LANL is ready to update the benchmark. Changes include: 1. Addition of new codes that allow common software codes to be tested, 2. Addition of new codes that instrument more microprocessor circuitry, 3. Addition of input patterns that allow for a more compressive understanding of how the memory layout affects the sensitivity to radiation-induced faults and better use of automated test pattern generation standards, and 4. Modification of current codes for faster and more resilient detection, reporting and correction of radiation-induced faults. These codes have been tested by LANL researchers over the last few years, which has been published in the open literature. As the code base for the new benchmarks are stable, it is time to release the update to the GitHub repository, where the original codes were released.

Quinn, Heather↗