Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Laboratory of the Rockies's (NLR) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

97 MATHEMATICS AND COMPUTING↗

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Renewable Energy Laboratory's (NREL) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Benchmark of Advanced Burner Test Reactor Model Using MCNPX 2.6.0 and ERANOS 2.1

Significant research is currently being performed whereby fast reactor cores have been designed to burn transuranic materials reducing the volume and long-term radiotoxicity of spent nuclear fuel. These core and depletion models depend on various computer codes. This research used MCNPX 2.6.0 and ERANOS 2.1 to model a standard 250MWt Advanced Burner Test Reactor (ABTR) core. The intent was to benchmark criticality and burnup results from a stochastic Monte Carlo code and a deterministic depletion code using a standard ABTR model created by Argonne National Laboratory. Because each of these codes solve the transport and burnup problem differently, there is a need to benchmark the core models in order to verify results and identify root causes for significant differences in results between codes. Flux calculations in ERANOS were performed using diffusion theory, Legendre polynomial approximations (using the VARIANT module) and discrete ordinates methods. The k-effective for the higher-order transport models remained within 1000 pcm of the MCNPX model. The difference between the total heavy nuclide mass balance in ERANOS using the various flux calculations and the MCNPX depletion model was less than 0.4% out to a burnup of 1095 days (67.45 GWd/MTHM). For individual heavy nuclides, the depletion models closely matched (< 5.0 % difference) throughout the depletion for isotopes of Uranium, Neptunium and Plutonium and most of the higher transuranics. Notable exceptions were 242Am, 242Cm, 243Cm and 246Cm where differences ranged from 0.1 – 0.2% after 26 days and increased to 11 - 136% at 1095 days.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmark Specifications for TREAT Tests M5, M6, and M7

Detailed information describing three TREAT tests performed on metallic fuels has been collected and organized for use as a benchmark in evaluating the performance of metallic fuel models and codes. The tests, designated M5, M6, and M7, subjected EBR-II-irradiated fuel pins to a single type of overpower transient (at prototypical conditions with full coolant flow and an exponential power rise on an 8 second period) in flowing sodium loops. Six fuel pins were tested; five were ternary (U-19Pu-10Zr) alloy fuel clad in D9 with burnup ranging from 0.8 to 9.8 at. %, and one was binary alloy fuel (U-10Zr) clad in HT9 with 2.9 at. % burnup. The information gathered from the test records is expected to be useful for pre-transient characterization of the irradiated fuel pins as well as the transient analysis of the metallic fuel when subjected to severe accident conditions. This report presents benchmark specifications for the M5, M6, and M7 TREAT tests, identifies where primary sources of benchmark-related information can be found, and includes background information to help a user of the data understand their applicability and limitations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Precision Measurements of Electron-Proton Elastic Scattering Cross Sections at Large Q2

The electromagnetic form factors are fundamental quantities characterizing the internal structure of the nucleon. Their measurements have provided significant insight into the spatial distribution and interaction of quarks inside the proton. The knowledge of high Q2 form factors proves essential in understanding the properties of quantum chromodynamics in the transition region from non-perturbative to perturbative behavior. It also provides important links to generalized parton distributions, which describe the three-dimensional structure of hadrons at the parton level. In view of the significant theoretical research activities in this field, high quality experimental data are crucial for providing stringent tests and benchmarks to guide and test different models. The form factors can be accessed in experiments by measuring elastic scattering of electrons off a hydrogen target. Experiment E12-07-108, which took place at the Thomas Jefferson National Accelerator Facility, conducted precise measurements of the unpolarized e-p elastic scattering cross section over a Q2 range of 0.6-16.5 GeV2 . This thesis presents the results for 7 kinematic settings with total uncertainties that are 1.5 times smaller than those of the existing data at large Q2 . The proton magnetic form factors were extracted using a parameterization of the form factor ratio obtained from recent polarized e-p scattering experiments. Comparisons to existing global and phenomenological fits are presented.

Ou, Longwu↗

BENCHMARK EVALUATION OF THE INITIAL ISOTHERMAL PHYSICS MEASUREMENTS AT THE FAST FLUX TEST FACILITY

The benchmark evaluation of the initial isothermal physics tests performed at the Fast Flux Test Facility, in support of Fuel Cycle Research and Development and Generation-IV activities at the Idaho National Laboratory, has been completed. The evaluation was performed using MCNP5 with ENDF/B-VII.0 nuclear data libraries and according to guidelines provided for inclusion in the International Reactor Physics Experiment Evaluation Project Handbook. Results provided include evaluation of the initial fully-loaded core critical, two neutron spectra measurements near the axial core center, 32 reactivity effects measurements (21 control rod worths, two control rod bank worths, six differential control rod worths, two shutdown margins, and one excess reactivity), isothermal temperature coefficient, and low-energy electron and gamma spectra measurements at the core center. All measurements were performed at 400 ºF. There was good agreement between the calculated and benchmark values for the fully-loaded core critical eigenvalue, reactivity effects measurements, and isothermal temperature coefficient. General agreement between benchmark experiment measurements and calculated spectra for neutrons and low-energy gammas at the core midplane exists, but calculations of the neutron spectra below the core and the low-energy gamma spectra at core midplane did not agree well. Homogenization of core components may have had a significant impact upon computational assessment of these effects. Future work includes development of a fully-heterogeneous model for comprehensive evaluation. The reactor physics measurement data can be used in nuclear data adjustment and validation of computational methods for advanced fuel cycle and nuclear reactor systems using Liquid Metal Fast Reactor technology.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Light Water Reactor Sustainability Program: Evaluation of Localized Cable Test Methods for Nuclear Power Plant Cable Aging Management Programs

This Pacific Northwest National Laboratory (PNNL) milestone report describes progress to date on the investigation of nondestructive test (NDE) methods focusing particularly on local measurements that provide key indicators of cable aging and damage. The work includes a review of relevant literature as well as hands-on experimental verification of inspection capabilities. As NPPs consider applying for second, or subsequent, license renewal (SLR) to extend their operating period from 60 years to 80 years, it important to understand how the materials installed in plant systems and components will age during that time and develop aging management programs (AMPs) to assure continued safe operation under normal and design basis events (DBE). Normal component and system tests typically confirm the cables can perform their normal operational function. The focus of the cable test program is directed toward the more demanding challenge of assuring the cable function under accident or DBE. Most utilities already have a program associated with their first life extension from 40 to 60 years. Regrettably, there is neither a clear guideline nor a single NDE that can assure cable function and integrity for all cables. Thankfully, however, practical implementation of a broad range of tests allows utilities to develop a practical program that assures cable function to a high degree. The industry has adopted 50% elongation at break (EAB) relative to the un-aged cable condition as the acceptability standard. All tests are benchmarked against the cable EAB test. EAB is a destructive test so the test programs must apply an array of other NDE tests to assure or infer the overall set of cable’s system integrity. These cable NDE programs vary in rigor and methodology. As the industry gains experience with the efficacy of these programs, it is expected that implementation practice will converge to a more common approach. This report addresses the range of local NDE cable tests that are or could be practically implemented in a field test situation. These tests include: visual, infrared thermography, interdigital capacitance, indenter, relaxation time indenter, dynamic mechanical analyzer, infrared/near-infrared spectrometry, ultrasound, and distributed fiber optic temperature measurement.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Computational and Experimental Benchmarking for Transient Fuel Testing

In 2018 the Transient Reactor Test (TREAT) Facility was restarted. This now-operational facility brings back world-class transient fuel testing capabilities to the U.S. Among a number of parallel efforts prior to the TREAT Facility’s restart a Department of Energy (DoE) Integrated Research Project (IRP) was funded for the purpose of benchmarking the TREAT with several goals in mind: To produce a comprehensive evaluation of existing TREAT Facility neutronics data using the next generation reactor core neutronics codes in accordance with established guidelines per the International Handbook of Evaluated Reactor Physics Benchmark Experiments (IRPhEP). To perform a benchmark using ready-use computational fluid dynamics tools against that of a historically collected sodium loop experiment collected in the TREAT. To design, develop and test a new experimental thermal hydraulic system of a representative TREAT Facility water flow loop. And benchmark the data collected against that produced via RELAP5-3D and TRACE. To develop a comprehensive instrumentation plan for the TREAT Facility by benchmarking performing of advanced in-pile instruments in the Massachusetts Institute of Technology Research Reactor (MITR) and the TREAT. The integrated team brought together collaborating members from three universities including Oregon State University (OSU), the University of Michigan (UM), and Massachusetts Institute of Technology (MIT); three national laboratories, Idaho National Laboratory, Argonne National Laboratory (ANL), and Oak Ridge National Laboratory (ORNL); and two industry partners, TerraPower (TP) and Harris Thermal Transfer Products (HTTP). A brief summary of accomplishments resulting from this IRP includes two filed patents, more than 40 conference papers, two published benchmark reports through IRPhEP, a new representative thermal hydraulic test facility alike the in-pile PWR water flow loop for TREAT and the first advanced instruments tested within the TREAT core upon its restart. The papers presented herein were developed and provide a summary of the significant technical accomplishments which align with the four project’s objectives. The collaborators has significant support from countless parties including the operational and technical staff at TREAT to ensure that their outcomes most impactfully aligned with program needs. Lastly the collaborators would like to acknowledge the fiscal support of the DoE’s Office of Nuclear Energy under work package identification number NU-15-OR-OSU- 0701-01. This report contains selected papers from the Computational and Experimental Benchmarking for Transient Fuel Testing Integrated Research Project.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Advances in benchmarking and round robin testing for PEM water electrolysis: Reference protocol and hardware

While the number of publications in the PEM water electrolysis community increases each year, no common ground concerning reference hardware (test cells and test bench) and testing protocols has been yet established. This would, however, be necessary for the comparability of experimental results. First attempts for such reference hardware and procedures have been made in the framework of the Task 30 Electrolysis within the Technology Collaboration Programme on Advanced Fuel Cells (AFC TCP) of the International Energy Agency (IEA). Since then, improvements of both the test hardware (test cell and components) as well as the measurement protocol were identified, and a revised methodology and key results based on a comprehensive measurement series have been obtained. A detailed protocol for testing commercial reference components with a reference laboratory test cell developed in-house by Fraunhofer ISE is presented. For evaluation of the protocol and the hardware, it was tested at three different institutions at the same time. Impedance spectroscopic and polarization data was acquired and analyzed. The obtained differences in performance were calculated to give the community an expectation window to compare own data to. Finally, the importance of a thorough temperature control and the conditioning phase are demonstrated.

08 HYDROGEN↗

Multi-Purpose, Application-Centric, Scalable I/O Proxy Application

MACSio is a Multi-purpose, Application-Centric, Scalable I/O proxy application. It is designed to support a number of goals with respect to parallel I/O performance testing and benchmarking including the ability to test and compare various I/O libraries and I/O paradigms, to predict scalable performance of real applications and to help identify where improvements in I/O performance can be made within the HPC I/O software stack.

Miller, M.C.↗

Bulk Electrical Cable Non-Destructive Examination Methods for Nuclear Power Plant Cable Aging Management Programs

This Pacific Northwest National Laboratory milestone report describes progress to date on the investigation of nondestructive test methods focusing particularly on bulk electrical test methods that provide key indicators of cable aging and damage. The work includes a review of relevant literature as well as hands-on experimental verification of inspection capabilities. As nuclear power plants consider applying for second, or subsequent, license renewal to extend their operating period from 60 years to 80 years, it is important to understand how the materials installed in plant systems and components will age during that time and develop aging management programs to assure continued safe operation under normal and design basis events (DBE). Normal component and system tests typically confirm the cables can perform their normal operational function. The focus of the cable test program, however, is directed toward the more demanding challenge of assuring the cable function under accident or DBE. The industry has adopted 50% elongation at break (EAB) relative to the un-aged cable condition as the acceptability standard. All tests are benchmarked against the cable EAB test. EAB, however, is a destructive test so the test programs must apply an array of other nondestructive examination (NDE) tests to assure or infer the overall set of cable’s system integrity. Assessment of cable integrity is further complicated in many cases by vendor’s use of dissimilar material for jacket and insulation. Frequently the jacket will degrade more rapidly than the underlying insulation. Although this can serve as an early alert to cable damage, direct test of the cable insulation without violating the protective jacket becomes problematic. This report addresses the range of bulk electrical NDE cable tests that are or could be practically implemented in a field-test situation with a particular focus on frequency domain reflectometry (FDR). The FDR test method offers numerous advantages over many other bulk electrical tests. Two commercial FDR systems plus a laboratory vector network analyzer are used to test an array of aged and un-aged cables under identical conditions. Several conclusions are set forth, and a number of knowledge gaps are identified.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

The Trade-off between Solar Reflectance and Above-Sheathing Ventilation for Metal Roofs on Residential and Commercial Buildings

An alternative to white and cool-color roofs that meets prescriptive requirements for steep-slope (residential and non-residential) and low-slope (non-residential) roofing has been documented. Roofs fitted with an inclined air space above the sheathing (herein termed above-sheathing ventilation, or ASV), performed as well as if not better than high-reflectance, high-emittance roofs fastened directly to the deck. Field measurements demonstrated the benefit of roofs designed with ASV. A computer tool was benchmarked against the field data. Testing and benchmarks were conducted at roofs inclined at 18.34 ; the roof span from soffit to ridge was 18.7 ft (5.7 m). The tool was then exercised to compute the solar reflectance needed by a roof equipped with ASV to exhibit the same annual cooling load as that for a direct-to-deck cool-color roof. A painted metal roof with an air space height of 0.75 in. (0.019 m) and spanning 18.7 ft (5.7 m) up the roof incline of 18.34 needed only a 0.10 solar reflectance to exhibit the same annual cooling load as a direct-to-deck cool-color metal roof (solar reflectance of 0.25). This held for all eight ASHRAE climate zones complying with ASHRAE 90.1 (2007a). A dark heat-absorbing roof fitted with 1.5 in. (0.038 m) air space spanning 18.7 ft (5.7 m) and inclined at 18.34 was shown to have a seasonal cooling load equivalent to that of a conventional direct-to-deck cool-color metal roof. Computations for retrofit application based on ASHRAE 90.1 (1980) showed that ASV air spaces of either 0.75 or 1.5 in. (0.019 and 0.038 m) would permit black roofs to have annual cooling loads equivalent to the direct-to-deck cool roof. Results are encouraging, and a parametric study of roof slope and ASV aspect ratio is needed for developing guidelines applicable to all steep- and low-slope roof applications.

above sheathing ventilation↗

Multi-Purpose, Application-Centric, Scalable I/O Proxy Application

MACSio is a Multi-purpose, Application-Centric, Scalable I/O proxy application. It is designed to support a number of goals with respect to parallel I/O performance testing and benchmarking including the ability to test and compare various I/O libraries and I/O paradigms, to predict scalable performance of real applications and to help identify where improvements in I/O performance can be made within the HPC I/O software stack.

Miller, M. C.↗

A benchmark concept for simulation in radiographic testing

The new standard ISO 17636–2:2013 “NDT of welds: Radiographic testing - Part 2: X- and gamma ray techniques with digital detectors” describes a complex procedure for film replacement by phosphor imaging plates and digital detector arrays. RT modeling software should consider these detector types, X-ray film, and the standard requirements for image quality. Practitioners expect the same visibility of image quality indicators (IQI) in the simulated radiographs as in the experimental exposures. The proposed benchmark test is based on the comparison of experimental radiographs taken at BAM with modeled ones of participants. The experimental setup and the determination of the equivalent penetrameter sensitivity (EPS) as described in the procedure of ASTM E 746 are used for quantitative evaluation of the achievable contrast sensitivity for step hole IQIs as considered in Annex B of ISO 17636–2. System classification data for Computed Radiography (CR) and film systems will be provided by BAM according to ISO 11699–1 for selected film systems and according to ASTM E 2446 for selected CR systems. The classification of films and digital detectors is based on the measurement of the dose response function, the basic spatial resolution (SR{sub b}) of the image, and the measured image noise, which depends on the detector efficiency, the quantum statistics, and the detector fixed pattern noise.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integral Benchmark Data for Nuclear Data Testing Through the ICSBEP & IRPhEP

The status of the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and International Reactor Physics Experiment Evaluation Project (IRPhEP) was last discussed directly with the nuclear data community at ND2007. Since ND2007, integral benchmark data that are available for nuclear data testing have increased significantly. The status of the ICSBEP and the IRPhEP is discussed and selected benchmark configurations that have been added to the ICSBEP and IRPhEP Handbooks since ND2007 are highlighted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ORNL Testing of Multiple Graphite Benchmarks [Slides]

Integral criticality safety and reactor physics benchmark experiments from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) and the International Handbook of Reactor Physics Experiments (IRPhE Handbook) are essential for nuclear data validation and testing

ENDF↗

Final Report Feasibility Study for the California Wave Energy Test Center (CalWavesm)

The California Wave Energy Test Center (CalWave) Feasibility Study project was funded over multiple phases by the Department of Energy to perform an interdisciplinary feasibility assessment to analyze the engineering, permitting, and stakeholder requirements to establish an open water, fully energetic, grid connected, wave energy test center off the coast of California for the purposes of advancing U.S. wave energy research, development, and testing capabilities. Work under this grant included wave energy resource characterization, grid impact and interconnection requirements, port infrastructure and maritime industry capability/suitability to accommodate the industry at research, demonstration and commercial scale, and macro and micro siting considerations. CalWave Phase I performed a macro-siting and down-selection process focusing on two potential test sites in California: Humboldt Bay and Vandenberg Air Force Base. This work resulted in the Vandenberg Air Force Base site being chosen as the most favorable site based on a peer reviewed criteria matrix. CalWave Phase II focused on four siting location alternatives along the Vandenberg Air Force Base coastline and culminated with a final siting down-selection. Key outcomes from this work include completion of preliminary engineering and systems integration work, a robust turnkey cost estimate, shoreside and subsea hazards assessment, storm wave analysis, lessons learned reports from several maritime disciplines, test center benchmarking as compared to existing international test sites, analysis of existing applicable environmental literature, the completion of a preliminary regulatory, permitting and licensing roadmap, robust interaction and engagement with state and federal regulatory agency personnel and local stakeholders, and the population of a Draft Federal Energy Regulatory Commission (FERC) Preliminary Application Document (PAD). Analysis of existing offshore oil and gas infrastructure was also performed to assess the potential value and re-use scenarios of offshore platform infrastructure and associated subsea power cables and shoreside substations. The CalWave project team was well balanced and was comprised of experts from industry, academia, state and federal regulatory agencies. The result of the CalWave feasibility study finds that the CalWave Test Center has the potential to provide the most viable path to commercialization for wave energy in the United States.

16 TIDAL AND WAVE POWER↗

Final Report Feasibility Study for the California Wave Energy Test Center (CalWavesm) - Volume #2 - Appendices #16-17

The California Wave Energy Test Center (CalWave) Feasibility Study project was funded over multiple phases by the Department of Energy to perform an interdisciplinary feasibility assessment to analyze the engineering, permitting, and stakeholder requirements to establish an open water, fully energetic, grid connected, wave energy test center off the coast of California for the purposes of advancing U.S. wave energy research, development, and testing capabilities. Work under this grant included wave energy resource characterization, grid impact and interconnection requirements, port infrastructure and maritime industry capability/suitability to accommodate the industry at research, demonstration and commercial scale, and macro and micro siting considerations. CalWave Phase I performed a macro-siting and down-selection process focusing on two potential test sites in California: Humboldt Bay and Vandenberg Air Force Base. This work resulted in the Vandenberg Air Force Base site being chosen as the most favorable site based on a peer reviewed criteria matrix. CalWave Phase II focused on four siting location alternatives along the Vandenberg Air Force Base coastline and culminated with a final siting down-selection. Key outcomes from this work include completion of preliminary engineering and systems integration work, a robust turnkey cost estimate, shoreside and subsea hazards assessment, storm wave analysis, lessons learned reports from several maritime disciplines, test center benchmarking as compared to existing international test sites, analysis of existing applicable environmental literature, the completion of a preliminary regulatory, permitting and licensing roadmap, robust interaction and engagement with state and federal regulatory agency personnel and local stakeholders, and the population of a Draft Federal Energy Regulatory Commission (FERC) Preliminary Application Document (PAD). Analysis of existing offshore oil and gas infrastructure was also performed to assess the potential value and re-use scenarios of offshore platform infrastructure and associated subsea power cables and shoreside substations. The CalWave project team was well balanced and was comprised of experts from industry, academia, state and federal regulatory agencies. The result of the CalWave feasibility study finds that the CalWave Test Center has the potential to provide the most viable path to commercialization for wave energy in the United States.

16 TIDAL AND WAVE POWER↗