Search NASA⌕ Search

SEARCH · Search NASA

Results for “Proficiency testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

NWAL Validation Report for U Assay by Potentiometric Titration (Modified Davies and Gray Technique) and U and PU Assay by Isotope Dilution Mass Spectrometry

SRNL Sensing & Metrology, previously Analytical Laboratory, is a member of the IAEA Network of Analytical Laboratories for Nuclear Material Measurement that is qualified to provide Uranium and Plutonium isotopic analysis of nuclear materials by Thermal Ionization Mass Spectrometry. As part of the membership, SRNL participated in the 2019 Nuclear Material Round Robin to maintain the qualification to provide isotopic analysis. SRNL also participated with the additional intent to qualify Uranium Assay by Potentiometric Titration (Davies and Gray method) and Uranium and Plutonium Isotope Dilution by Thermal Ionization Mass Spectrometry as part of the International Atomic Energy Agency’s Network of Analytical Laboratories. The proficiency test exercise was conducted by the Office of Safeguards Analytical Services, Department of Safeguards.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

Why accredit ISO/CEI 17025 a nuclear waste management laboratory? - 15112

When there is no storage, nor repository, available on a site, the entity in charge of nuclear waste management should find outlets in order to evacuate outside the site. Each outlet has his rules and waste acceptance criteria (packaging rules, physical/chemical/radiological criteria for example). Before you are able to evacuate your waste, an acceptance's process (or contract review) takes place. This process scans the entire measures implemented by the site in order to satisfy outlet's criteria. When the acceptance is obtained, shipments could be organized, and the process gets into an observation's phase. During this phase, the outlet could choose to inspect a finished nuclear waste package or to audit regularly the waste management process. In this last case, the outlet re-scans the entire documents and implemented measures. This audit lasts from one to several days. A way to tackle/approach the audit is to acknowledge, by a trusted third party (i.e. independent from the outlet), all or part of waste management system, in order to base one's reputation on this organism and win outlet's trust. For this purpose, the entity could choose certification or accreditation. Certification (ISO 9001 as often as not) aims at evaluating a system for managing the quality of one product or service. Accreditation (ISO 17025, for example) provides formal recognition for technical skills within a quality management system (clauses 5 and 4 of the ISO 17025 standard). In 2006, the LDM laboratory is the first French laboratory accredited, in accordance with ISO 17025 standard, for the characterization by gamma spectrometry on 100 L- and 200 L- radioactive waste drums (accreditation No 1-1712 - scope available on www.cofrac.fr). This accreditation allows the lab: - to update the quality management system, - to compile the entire technical file of the gamma-ray assay (description, evaluation of the uncertainties, calibration, proficiency testing programs, measurement procedures,...), - to pass previous identified constraints on to producers and nuclear waste package production, - to maintain permanent quality improvement loop, - to lighten the programs of outlets audits, through the acknowledgement of the technical competence of the laboratory to evaluate by gamma spectrometry the activity contained in our nuclear waste drums. On the other hand, the lab is re-evaluated periodically to ensure its continued compliance with requirements: within a 12 month's interval for an internal audit, with a 18 month's period for COFRAC (French sole official national accreditation body). Since 2006, the lab is accredited. His accreditation renewed in 2010. A new entire renewal audit is planned in 2015. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrated Data Collection Analysis (IDCA) Program - AN and Bullseye Smokeless Powder

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of ammonium nitrate (AN) mixed with Bullseye® smokeless powder (Gunpowder). The participants found the AN/Gunpowder to: 1) have a range of sensitivity to impact, comparable to or less than RDX, 2) be fairly insensitive to friction as measured by BAM and ABL, 3) have a range for ESD, from insensitive to more sensitive than PETN, and 4) have thermal sensitivity about the same as PETN and Gunpowder. This effort, funded by the Department of Homeland Security (DHS), is putting the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study has the potential to suggest new guidelines and methods and possibly establish the SSST testing accuracies needed when developing safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods. Note, however, the test procedures differ among the laboratories. The testing performers involved are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), Sandia National Laboratories (SNL), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to compare results when these testing variables cannot be made consistent. Keywords: Small-scale safety testing, proficiency test, impact-, friction-, spark discharge-, thermal testing, round-robin test, safety testing protocols, HME, RDX, potassium perchlorate, potassium chlorate, sodium chlorate, sugar, dodecane, PETN, carbon, ammonium nitrate, Gunpowder, Bullseye® smokeless powder.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - SSST Testing Methods

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the methods used for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis during the IDCA program. These methods changed throughout the Proficiency Test and the reasons for these changes are documented in this report. The most significant modifications in standard testing methods are: 1) including one specified sandpaper in impact testing among all the participants, 2) diversifying liquid test methods for selected participants, and 3) including sealed sample holders for thermal testing by at least one participant. This effort, funded by the Department of Homeland Security (DHS), is putting the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study will suggest new guidelines and methods and possibly establish the SSST testing accuracies needed to develop safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods wherever possible. The testing performers involved are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), Sandia National Laboratories (SNL), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to compare results when these testing variables cannot be made consistent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - RDX Standard Data Set 2

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Type II Class 5 standard, from testing the second time in the Proficiency Test. This RDX testing (Set 2) compared to the first (Set 1) was found to have about the same impact sensitivity, have more BAM friction sensitivity, less ABL friction sensitivity, similar ESD sensitivity, and same DSC sensitivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning for continuous quantum error correction on superconducting qubits

Abstract Continuous quantum error correction has been found to have certain advantages over discrete quantum error correction, such as a reduction in hardware resources and the elimination of error mechanisms introduced by having entangling gates and ancilla qubits. We propose a machine learning algorithm for continuous quantum error correction that is based on the use of a recurrent neural network to identify bit-flip errors from continuous noisy syndrome measurements. The algorithm is designed to operate on measurement signals deviating from the ideal behavior in which the mean value corresponds to a code syndrome value and the measurement has white noise. We analyze continuous measurements taken from a superconducting architecture using three transmon qubits to identify three significant practical examples of non-ideal behavior, namely auto-correlation at temporal short lags, transient syndrome dynamics after each bit-flip, and drift in the steady-state syndrome values over the course of many experiments. Based on these real-world imperfections, we generate synthetic measurement signals from which to train the recurrent neural network, and then test its proficiency when implementing active error correction, comparing this with a traditional double threshold scheme and a discrete Bayesian classifier. The results show that our machine learning protocol is able to outperform the double threshold protocol across all tests, achieving a final state fidelity comparable to the discrete Bayesian classifier.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Integrated Data Collection Analysis (IDCA) Program — Quarterly Review Meeting

On November 9 and 10, 2011 the IDCA had the annual quarterly meeting. The meeting started the afternoon of the first day with a tour of the NSWC IHD explosives safety testing and analysis facilities. The meeting on the second day addressed the formal sponsor review and further technical issues for the IDCA. Examination of the IHD equipment during the tour, lead to a long discussion on liquid test methods. The discussion resulted in revision of liquid test methods in the impact test and selection of a new liquid test standard. In addition, modifications to friction, spark and thermal test methods were discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Savannah River National Laboratory Participation in the International Atomic Energy Agency CPC Interlaboratory Comparison Exercise 2

International Atomic Energy Agency Safeguards Analytical Services (IAEA-SGAS) oversees coordinating the second Controlled Potential Coulometry Quality Control Interlaboratory Comparison (CPC QC ILC) on behalf of the Nuclear Material Laboratory (NML). The purpose of the exercise is to: (1) verify the ability of participating laboratories to measure the Pu concentration in the sample solutions, and (2) estimate the method performance (repeatability and intermediate reproducibility). Sample shipping coordination was performed by IAEA-SGAS. The test sample is a plutonium nitrate solution (estimated molarity of 3-5 M), delivered in two PTFE screw-capped quartz ampoules. Each participating laboratory is to receive two ampoules. Each ampoule holds approximately 8 mL of solution containing approximately 10 mg Pu/g. The gross weights of the ampoules were provided. The test sample is assumed to have an iron content below the level of significance for the CPC. The isotopic composition of the plutonium test sample was provided; however, no analysis date was provided. In addition, IAEA-SGAS provided analytical instructions to participants. On September 20, 2022, SRNL received the samples sent by IAEA-SGAS.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Integrated Data Collection Analysis (IDCA) Program - RDX Type II Class 5 Standard, Data Set 1

This document describes the results of the first reference sample material—RDX Type II Class 5—examined in the proficiency study for small-scale safety and thermal (SSST) testing of explosive materials for the Integrated Data Collection Analysis (IDCA) Program. The IDCA program is conducting proficiency testing on homemade explosives (HMEs). The reference sample materials are being studied to establish the accuracy of traditional explosives safety testing for each performing laboratory. These results will be used for comparison to results from testing HMEs. This effort, funded by the Department of Homeland Security (DHS), ultimately will put the issues of safe handling of these materials in perspective with standard military explosives. The results of the study will add SSST testing results for a broad suite of different HMEs to the literature, potentially suggest new guidelines and methods for HME testing, and possibly establish what are the needed accuracies in SSST testing to develop safe handling practices. Described here are the results for impact, friction, electrostatic discharge, and scanning calorimetry analysis of a reference sample of RDX Type II Class 5. The results from each participating testing laboratory are compared using identical test material and preparation methods wherever possible. Note, however, the test procedures differ among the laboratories. These results are then compared to historical data from various sources. The performers involved are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Air Force Research Laboratory/ RXQL (AFRL), Indian Head Division, Naval Surface Warfare Center, (IHD-NSWC), and Sandia National Laboratories (SNL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to understand how to compare results when test protocols are not identical.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Statistical scoring procedures applicable to laboratory performance evaluation

Two statistical scoring procedures based on p-values have been developed to evaluate the overall performance of analytical laboratories performing environmental measurements. The overall scores of bias and standing are used to determine how consistently a laboratory is able to measure the true (unknown) value correctly over time. The overall scores of precision and standing are used to determine how well a laboratory is able to reproduce its measurements in the long run. Criteria are established for qualitatively labeling measurements as Acceptable, Warning, and Not Acceptable and for identifying areas where laboratories should re-evaluate their measurement procedures. These statistical scoring procedures are applied to two real environmental data sets.

97 MATHEMATICS AND COMPUTING↗

Integrated Data Collection Analysis (IDCA) Program — RDX Standard Data Sets

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Type II Class 5 standard, for a third and fourth time in the Proficiency Test and averaged with the analysis results from the first and second time. The results, from averaging all four sets (1, 2, 3 and 4) of data suggest a material to have slightly more impact sensitivity, more BAM friction sensitivity, less ABL friction sensitivity, similar ESD sensitivity, and same DSC sensitivity, compared to the results from Set 1, which was used previously as the values for the RDX standard in IDCA Analysis Reports.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) program--KClO 4 /Dodecane Mixture

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of a mixture of KClO 4 and dodecane—KClO 4 /dodecane mixture. This material was selected because of the challenge of performing SSST testing of a mixture of solid and liquid materials. The mixture was found to: 1) be less sensitive to impact than RDX, and PETN, 2) less sensitive to friction than RDX and PETN, and 3) less sensitive to spark than RDX and PETN. The thermal analysis showed little or no exothermic features suggesting that the dodecane volatilized at low temperatures. A prominent endothermic feature was observed and assigned to a phase transition of KClO 4 . This effort, funded by the Department of Homeland Security (DHS), ultimately will put the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study has the potential to suggest new guidelines and methods and possibly establish the SSST testing accuracies needed to develop safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods wherever possible. Note, however, the test procedures differ among the laboratories. The results are compared among the laboratories and then compared to historical data from various sources. The testing performers involved for the KClO 4 /dodecane mixture are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to understand how to compare results when these testing variables cannot be made consistent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - KClO 4 /Carbon Mixture

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of a mixture of KClO 4 and activated carbon—KClO 4 /C mixture. This material was selected because of the challenge of performing SSST testing of a mixture of two solids. The mixture was found to be insensitive to impact, friction, and thermal stimulus, and somewhat sensitive to spark discharge. This effort, funded by the Department of Homeland Security (DHS), ultimately will put the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study has the potential to suggest new guidelines and methods and possibly establish the SSST testing accuracies needed to develop safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods wherever possible. Note, however, the test procedures differ among the laboratories. The results are compared among the laboratories and then compared to historical data from various sources. The testing performers involved for the KClO 4 /carbon mixture are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to understand how to compare results when these testing variables cannot be made consistent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗