Search NASA⌕ Search

SEARCH · Search NASA

Results for “Round Robin”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

ORNL Analysis of Leach-Burn-Leach Round-Robin Test Samples

An international round-robin test to examine the consistency in leach-burn-leach (LBL) analysis of tristructural-isotropic- (TRISO-) coated particle fuel was conducted by three research organizations from the Generation IV International Forum member countries of the People’s Republic of China, the Republic of Korea, and the United States of America. Two sets of round-robin test samples were exchanged for analysis. One set of samples consisted of a series of nonuranium-bearing, TRISO-coated zirconium dioxide particles seeded with up to four depleted uranium-bearing, TRISO-coated uranium dioxide (UO 2 ) particles, which had intentionally damaged coating layers to simulate either particles with either exposed-kernel defects (i.e., particles with a cracked TRISO coating that should be detected during preburn leaching) or particles with silicon carbide (SiC) defects (i.e., particles with an intact pyrocarbon coating and a hole in the SiC layer that should be detected during postburn leaching). These simulated samples also contained added powder with known quantities of impurities from a coal standard. The other sample set consisted of representative sublots of UO 2 -TRISO particles fabricated in a production-scale coater, except they all contained depleted uranium instead of enriched uranium. In this report, the methodology used at Oak Ridge National Laboratory to conduct LBL analysis of the round-robin samples is presented, and the general results are summarized.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Results of the International Energy Agency Bioenergy Round Robin on the Analysis of Heteroatoms in Biomass Liquefaction Oils

A round robin study evaluating the analysis of biomass liquefaction oils (BLOs) from fast pyrolysis and hydrothermal liquefaction (HTL) was performed, involving fifteen laboratories in seven countries in order to assess the current status of analytical techniques for the determination of nitrogen, sulfur, and chlorine content in BLOs and evaluate potential differences in origin (i.e. fast pyrolysis vs HTL). The BLOs were produced from a range of feedstocks including pine, mixed softwoods, forest residues, micro-algae, miscanthus, and wheat straw to cover a variety in nitrogen, sulfur, and chlorine content and speciation. Nine samples were distributed, comprised of eight separate BLOs and one blind duplicate produced by five producers. The samples were analyzed for water, carbon, hydrogen, nitrogen, sulfur, and chlorine content. No analytical test method was mandated; laboratories were encouraged to utilize whichever method they determined would be most applicable, relying on the existing body of BLO literature as a guide. The results of this round robin study are presented in this paper. The results of the carbon, hydrogen, and water measurements as reference analyses had relative standard deviations (2.9%, 3.5, and 5.6%, respectively) that were comparable to those found in past round robin studies on fast pyrolysis bio-oil. The analysis of nitrogen, sulfur, and chlorine showed higher levels of variability. Laboratories mostly chose the same method for water, carbon, hydrogen and nitrogen determination whereas there were a variety of methods chosen for sulfur and chlorine determination. The results suggest that specific analytical methods for the determination of nitrogen, sulfur, and chlorine should be further refined to ensure reproducible and accurate results for BLO analysis due to their importance on emissions, material selection, and catalyst activity.

Biomass, IEA Bioenergy, pyrolysis, hydrothermal li↗
DOE OSTI2026

An International Round-Robin Study on Thermoelectric Module Testing and Development of Standard Power Generation Modules

An international round-robin study on thermoelectric power generation modules was conducted with nine participating laboratories. Two types of commercially available bismuth telluride modules, 30 mm × 30 mm and 40 mm × 40 mm, were used. A test protocol was followed with five temperature set points from 50°C to 150°C. Graphite sheets were used as thermal interface materials with test pressure at 100 psi (0.69 MPa). The results showed large lab-to-lab variations and the key source of uncertainty for module efficiency was identified as the heat flux measurement. In the meantime, significant uncertainty was also found in maximum electrical power (P max ) measurements. As a result of the round-robin, a “standard module” with 4 × 4 legs on a 20 mm × 20 mm platform was suggested. A skutterudite module and a half-Heusler module were produced with identical geometry and 4 mm × 4 mm × 8 mm legs. All transport properties to calculate the figure-of-merit, zT, were measured from ambient temperature to 500°C. Module performance was measured by two laboratories. Two finite-element-analysis (FEA)-based models were developed independently to simulate and predict the module performance. In conclusion, the standard modules eliminated significant test uncertainties and are aimed at assisting device design and achieving more accurate performance predictions.

Round-robin↗
DOE OSTI2022

Stirred-Reactor Coupon Analysis: An International Round Robin Study

The objective of this task was to determine the precision of the SRCA technique when used to determine the dilute condition corrosion rate. To this end, an interlaboratory round robin study was conducted per the instructions in ASTM Practice E691 to measure the precision with which the SRCA test method can be conducted. Twelve independent labs from eleven different institutions each evaluated four glass compositions in three different conditions. The ASTM procedures recommend at least 6 labs participate in a round robin testing the same 3 materials in the same conditions to determine precision. In this case, 12 labs each performed 12 independent tests. This was only possible thanks to the multi-glass testing capability of the SRCA test. A total of 108 duplicate pairs were used to calculate the repeatability of the tests, with the same glass tested in the same vessel, producing as identical conditions as possible for the replicates. These test results were quite tightly clustered, with a median difference from the average value of the pair of only 2.9%. Based on the calculations outlined in ASTM E177-20 and a measured standard deviation of 4.74%, the intralaboratory repeatability limit (r) was calculated to be within 13.3% of the expected value with 95% confidence level. The reproducibility limit (R) of the test was examined using all 277 data points from the round robin. Because of the differences in dissolution rates due to pH variability and intrinsically for the 12 conditions tested, the reproducibility limits for each condition and overall were calculated from the percent relative residual value for each test. The SRCA test is expected to be reproducible within 64% of the expected value with a 95% confidence level.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

The importance of round-robin validation when assessing machine-learning-based vertical extrapolation of wind speeds

The extrapolation of wind speeds measured at a meteorological mast to wind turbine rotor heights is a key component in a bankable wind farm energy assessment and a significant source of uncertainty. Industry-standard methods for extrapolation include the power-law and logarithmic profiles. The emergence of machine-learning applications in wind energy has led to several studies demonstrating substantial improvements in vertical extrapolation accuracy in machine-learning methods over these conventional power-law and logarithmic profile methods. In all cases, these studies assess relative model performance at a measurement site where, critically, the machine-learning algorithm requires knowledge of the rotor-height wind speeds in order to train the model. This prior knowledge provides fundamental advantages to the site-specific machine-learning model over the power-law and log profiles, which, by contrast, are not highly tuned to rotor-height measurements but rather can generalize to any site. Furthermore, there is no practical benefit in applying a machine-learning model at a site where winds at the heights relevant for wind energy production are known; rather, its performance at nearby locations (i.e., across a wind farm site) without rotor-height measurements is of most practical interest. To more fairly and practically compare machine-learning-based extrapolation to standard approaches, we implemented a round-robin extrapolation model comparison, in which a random-forest machine-learning model is trained and evaluated at different sites and then compared against the power-law and logarithmic profiles. We consider 20 months of lidar and sonic anemometer data collected at four sites between 50 and 100 km apart in the central United States. We find that the random forest outperforms the standard extrapolation approaches, especially when incorporating surface measurements as inputs to include the influence of atmospheric stability. When compared at a single site (the traditional comparison approach), the machine-learning improvement in mean absolute error was 28 % and 23 % over the power-law and logarithmic profiles, respectively. Using the round-robin approach proposed here, this improvement drops to 20 % and 14 %, respectively. These latter values better represent practical model performance, and we conclude that round-robin validation should be the standard for machine-learning-based wind speed extrapolation methods.

17 WIND ENERGY↗
DOE OSTI2024

Summary of Leach-Burn-Leach Round-Robin Test Results

Tristructural isotropic (TRISO) coated particle fuel is of interest to multiple member states associated with the Generation IV International Forum (GIF). Qualification and acceptance testing of TRISO fuel includes the determination of particle defect fractions and impurities in the as-fabricated TRISO fuel particle and/or composited fuel form, which are typically determined using burn-leach (BL) or leach-burn-leach (LBL) analysis methods. A round-robin test focusing on LBL analysis was undertaken by the GIF Very High Temperature Reactor System Fuel and Fuel Cycle Project Management Board. Participating in this LBL round-robin test were research staff from the Institute of Nuclear and New Energy Technology (INET) in the People’s Republic of China, the Korean Atomic Energy Research Institute (KAERI) in the Republic of Korea, and Oak Ridge National Laboratory (ORNL) in the United States of America. The motivation of this LBL benchmarking exercise was to explore consistency in results generated by LBL and to elucidate the potential influence of variations in the procedures used by the participating members on the accurate determination of the measured fuel properties.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Complete Round-Robin Hydrogen Gas Analysis Capability Comparison (Milestone 2.6)

The Department of Energy (DOE) is currently evaluating strategies for the extended dry storage of aluminum-clad spent nuclear fuel (ASNF). Part of this assessment concerns the extent of radiolytic molecular hydrogen (H2) generation from the aluminum cladding’s oxyhydroxide corrosion layers. Understanding this radiation-induced process and the factors effecting it (e.g., system conditions such as temperature and gaseous environment) are essential for the development of predictive computer models to support the Technical Considerations and Challenges for Extended (> 50 yrs) Dry Storage of ASNF program. To achieve this goal and ensure that the experimental data gathered by Task 2 (Oxyhydroxide Layer Radiolytic Gas Generation Resolution) research groups (Idaho National Laboratory and Savannah River National Laboratory) are consistent, a round-robin H2 analysis capability comparison was initiated. Here we present the results from said round-robin and conclude that despite differences in sample preparation, irradiation parameters, and analytical procedures, the measured data are sufficiently consistent between the two laboratories (= 15%).

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2026

AMMT Round Robin 316H HFIR Irradiation Test Matrix and Readiness for Insertion

The Round Robin 316H HFIR-2 irradiation campaign, conducted under the Advanced Materials and Manufacturing Technologies (AMMT) Program, is designed to evaluate the variability in irradiation response of laser powder bed fusion (LPBF) stainless steel (SS)-316H across multiple national laboratories, powder heats, and processing conditions, with comparison to wrought counterparts. A total of 11 materials are intended for irradiation in the High Flux Isotope Reactor (HFIR), targeting two irradiation temperatures (400°C and 600°C) and one level of irradiation damage (2 dpa). This irradiation campaign utilizes the standardized general tensile (GENTEN) capsule design to accommodate subsized tensile specimens of these materials. Thermal analyses were performed to ensure appropriate temperature control by design and uniformity within the capsules. All the capsules for this irradiation except one have been successfully assembled, welded, and tested and are ready for HFIR insertion. The last capsule requires re-build following a failed weld. All eight capsules are intended to be inserted in HFIR cycle 517, which is scheduled to start September 8, 2026. This report summarizes the design, material selection, and readiness for insertion of the capsules.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Round-Robin Interlaboratory Study on Rare-Earth Elements in U.S.-Based Geologic Materials

In a study funded by the U.S. Department of Energy (DOE) National Energy Technology Laboratory (NETL), the University of North Dakota (UND) Energy and Environmental Research Center (EERC) performed a first-of-its-kind round-robin interlaboratory study (RRIS) to determine lab-to-lab and method-to-method variability in analyzing the rare earth element (REE) content of domestic resources. Analyses of REEs on eleven different materials were accomplished by the laboratories using four different procedures: ASTM D6357 (Procedure A), ASTM D4503 (Procedure B), an alternate in-house procedure for digestion and REE analysis (Procedure C), and neutron activation analysis (NAA). The results of the RRIS suggest that NAA is the most accurate and reliable method for many of the REEs in these types of materials; however, the method is limited in that it is able to determining only ten of the sixteen REEs. Five of the seven labs reporting data for Procedure A and three of the five labs reporting for Procedure B showed excellent performance in terms of repeatability, reproducibility, agreement with NAA, and SRM recoveries based on AOAC International guidelines on method performance. This indicates that when strictly followed these methods are suitable for REE determination in most materials, although are subject to the overall capabilities and experience of individual laboratories.

58 GEOSCIENCES↗
DOE OSTI2026

Anion-exchange membrane water electrolysis: insights from round-robin testing

As research and industrial interest in anion-exchange membrane water electrolysis (AEMWE) grows, there is an increasing need for reliable baselines and cross-lab validation of results. The wide variety of material sets and operating conditions under consideration for AEMWE has thus far limited efforts for standardization. In this study, round-robin testing was conducted in deionized water and KOH-based supporting electrolyte by 5 institutions from academia, national laboratories, and industry to provide baseline performance data and identify sources of cross-lab variability. Baseline membrane electrode assemblies were fabricated with commercial catalysts, membranes, and transport layers using standard techniques and tested using reagent-grade electrolytes, aiming for accessibility rather than state-of-the-art performance. From all tests, the average voltage at 1 A/cm 2 was 2.72 ± 0.17 V and 1.87 ± 0.03 V in deionized water and 0.1 M KOH, respectively. The maximum in-house and cross-lab variations at this current density were 118 mV and 476 mV in water and 60 and 88 mV in 0.1 M KOH. The KOH purity, station contamination, and temperature control were identified as possible factors affecting performance between labs, with in-house specific variation attributed to sample-to-sample differences in fabrication, cell assembly, and station contamination. This work provides a commercial baseline for the field and highlights the need for improved standardization and reproducibility in AEMWE research.

08 HYDROGEN↗
DOE OSTI2024

Preliminary Results of the 3D-shape Round-Robin

In the framework of SFERA-III WP10 Task3, ENEA has organized the 3D-shape round-robin (RR); the purpose is to compare the main geometrical parameters of 3D shape measurement of parabolic-trough (PT) reflective panels evaluated with the instruments adopted by each participant among: ENEA, DLR, F-ISE, NREL, and SANDIA. The last two institutions are outside of the EU, but benefited from the Transnational Access institute to visit several European laboratories, including the ENEA Casaccia research center where they accomplished some measurements with a portable experimental set-up. RR is based on the inter-laboratory circulation of 3 inner plus 3 outer PT panels. The start of the RR was delayed by the covid pandemic, then the circulation of the specimen-set and their measurement took more than one year. At the time of drafting this deliverable at the end of SFERA-III project, NREL has not yet completed the analysis of the measurements, making available only the deviations of the slopes. Therefore here will be reported only the preliminary results. The full comparison will be published as soon as possible, maybe in the open access venue Open Research Europe.

14 SOLAR ENERGY↗
DOE OSTI2020

Round Robin Summary for ASTM Method C1733

This report was prepared to summarize the results of an inter- and intra-laboratory round robin of ASTM Method C1733-17 (now C1733-20a) Distribution Coefficients of Inorganic Species by the Batch Method. The testing used the sorption of cesium (Cs) to a standard reference soil from the San Joaquin Valley (Standard Reference Material 2709a). The data collected from the nine participants was used for a statistical analysis to assess the precision of the method and generate a precision and bias statement to update the C1733-20a standard.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

RESULTS OF A VIRTUAL ROUND ROBIN STUDY TO ESTIMATE PROBABILITY OF DETECTION FOR DISSIMILAR METAL WELDS

This paper presents efforts to overcome challenges with empirical probability of detection (POD) estimations in the nuclear power industry through the utilization of a novel virtual flaw method. A virtual round robin (VRR) study was conducted under the Program for Investigation Of NDE by International Collaboration (PIONIC), organized by the United States Nuclear Regulatory Commission (NRC) utilizing data generated by the virtual flaw method. Analysis of results from the VRR was performed by teams from Pacific Northwest National Laboratory (PNNL), Electric Power Research Institute (EPRI), and Aalto University. Empirically derived POD estimations are presented, and challenges associated with obtaining these estimations are discussed. The virtual flaw method is introduced and some details of its implementation for the VRR activity are described. Results from POD analysis of the VRR data by PNNL, EPRI, and Aalto University are presented and a discussion regarding differences in analysis results is provided. Finally, potential future efforts to improve the application of the virtual flaw method and its estimation of POD are discussed.

Probability of detection, Dissimilar Metal Weld, P↗
DOE OSTI2021

Ion Chromatography (IC) Round Robin Analyses of Low Glycolate Concentrations in Recycle Collection Tank (RCT) Post Permanganate Treatment Simulant

This work is a demonstration of Ion Chromatography (IC) analysis of low concentrations of glycolate in chemical simulant designed to mimic the matrix in the Recycle Collection Tank (RCT) at the Defense Waste Processing Facility (DWPF) after sodium permanganate oxidation treatment. The IC method was previously developed [1] and this report covers the results of round robin testing with three analytical laboratories located at the Savannah River Site (SRS). The laboratories are termed the Sensing & Metrology (S&M) laboratory at the Savannah River National Laboratory (SRNL), the Processing Science Analytical Laboratory (PSAL) at SRNL, and the DWPF laboratory at SRS. Each laboratory received four samples: (1) 200 mL of 21.3 mg/L glycolate in RCT post permanganate strike sulfite quenched simulant, (2) 200 mL of 38.0 mg/L glycolate in RCT post permanganate strike sulfite quenched simulant, (3) 200 mL of 54.9 mg/L glycolate in RCT post permanganate strike sulfite quenched simulant, and (4) 600 mL of RCT post permanganate strike sulfite quenched simulant to use for matrix matched blanks.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Round Robin Measurements of Molten Salt Properties for LiF-NaF-KF (FLiNaK) and NaCl-KCl Mixtures

The development, operation, and regulation of nuclear reactors that utilize molten salts as fuel or as heat transfer media require knowledge of the thermal properties of the salt systems and quantification of the corresponding uncertainties. Knowledge of molten salt properties is also necessary for applications in material synthesis, processing, separations, solar thermal power generation, and energy storage. A round robin was conducted with national laboratory and university participants from twenty-one laboratories in five countries to compare property measurements, to better understand uncertainties, and to identify possible best practices. Two salt mixtures, each from a common batch, were distributed to participants for evaluation: equimolar NaCl-KCl and 45.0LiF-13.7NaF-41.3KF mol % (FLiNaK). Measurements were performed to determine the major constituent composition, oxygen content, density, thermal expansivity, melting point, and thermal conductivity. Error analysis was performed on each measurement for uncertainty quantification for each type of property that was explored. Finally, the resulting discussion of the methodologies used in this work is meant to lay the groundwork for the development of standard methods and reference materials for future high-temperature property measurements on halide melts.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

How accurate is a machine learning-based wind speed extrapolation under a round-robin approach?

As the size of commercial wind turbines keeps increasing, having accurate ways to vertically extrapolate wind speed is essential to obtain a precise characterization of the wind resource for wind energy production. Recently, machine learning has been proposed and applied to extrapolate wind speed to hub heights. However, previous studies trained and tested the machine learning methods at the same site, giving them an unfair advantage over the conventional extrapolation techniques, which are instead more universal. Here, we use data from four sites in Oklahoma to test a round-robin validation approach for machine learning, under which we train a random forest at a site, and test it at a different site, where the model has no prior knowledge of the wind resource. We quantify how the accuracy of this technique varies with distance from the training site, and we find that it outperforms conventional techniques for wind extrapolation at all the considered spatial separations. We then assess how the accuracy of the machine-learning based approach varies when it is used to predict wind speed in a wind farm far wake. Finally, we explore as case study the performance of the random forest in extrapolating winds during a low-level jet event.

17 WIND ENERGY↗