Search NASA⌕ Search

SEARCH · Search NASA

Results for “Proficiency testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Efficient derivatization of methylphosphonic and aminoethylsulfonic acids related to nerve agents simultaneously in soils using trimethyloxonium tetrafluoroborate for their enhanced, qualitative detection and identification by EI-GC–MS and GC–FPD

Trimethyloxonium tetrafluoroborate (TMO·BF 4 ) has been used here in the simultaneous derivatization of phosphonic and 2-aminoethylsulfonic acids related to nerve agents in different soils for their enhanced detection and identification by electron ionization gas chromatography-mass spectrometry (EI-GC–MS). The panel of acids consisted of five Schedule 2 phosphonic acids (methyl methylphosphonic acid, ethyl methylphosphonic acid, isopropyl methylphosphonic acid, pinacolyl methylphosphonic acid and cyclohexyl methylphosphonic acid) along with two sulfonic acids, N,N-diethyl-2-aminoethylsulfonic acid and N,N-diisopropyl-2-aminoethylsulfonic acid. The acids were converted to their corresponding methyl esters at ambient temperature when present at a 10 μg g -1 concentration in three separate soils: Virginia type A soil, Ottawa sand and Nebraska EPA soil. The concentration of the acids reflects values typically encountered during proficiency tests (PTs) administered annually by the Organisation for the Prohibition of Chemical Weapons (OPCW). Derivatization times to yield detectable signals for the methyl ester products for all the acids was found to vary among all three soil samples, however, it was found that generally the most optimal time across all the matrices involved was 3 h after the addition of TMO·BF 4 . Concomitantly, the analysis of the samples was complemented using GC coupled to flame photometric detection (GC–FPD). The inclusion of GC–FPD in the analysis yielded stronger signals for all seven methylated analytes making their detection after merely 3 h possible relative to the ones initially obtained with EI-GC–MS. Regarding the three soils employed in our study, a greater methylating efficiency was found in the Virginia type A soil and Ottawa sand yielding results that were significantly larger in magnitude to those found during the same time points for the Nebraska EPA soil sample. Prolonged reaction times (up to 72 h) were explored to find the time for the highest yield of methyl ester production were found instead to be deleterious to the process showcasing the importance of the fast yielding nature of the process specifically in situations where time-sensitive analysis is crucial (e.g. OPCW-PT).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Residual Agar Determination in Bacterial Spores by Electrospray Ionization Mass Spectrometry

Presented here is an analytical method to detect residual agar from a bacterial spore sample as an indication of culturing on an agar plate. This method is based on the resolubilization of agar polysaccharide from a bacterial spore sample, enzymatic digestion, followed by electrospray ionization tandem mass spectrometry (ESI-MSn) analysis for detection of a specific agar fragment ion. A range of Bacillus species and strains were selected to demonstrate the effectiveness of this approach. The characteristic agar fragment ion was detected in the spores grown on agar that were washed from 1 to 5 times, irradiated or non-irradiated and not in the spores grown in broth. A sample containing approximately 108 spores is currently needed for confident detection of residual agar from culture on agar plates in the presence of bacterial spores with a limit of detection of approximately 1 ppm agar spiked into a broth-grown spore sample. The results of a proficiency test with 42 blinded samples are presented demonstrating the utility of this method with no false positives and only 3 false negatives for samples that were below the detection level of the method as documented.

59 BASIC BIOLOGICAL SCIENCES↗

Carbamoylation as an Effective Tool in the Analysis of the Soman Nerve Agent Marker Pinacolyl Alcohol in Soil Matrices by EI-GC-MS and LC-HRMS

Pinacolyl alcohol (PA) is a Schedule 2 chemical commonly featured in most proficiency tests (PTs) administered by the Organisation for the Prohibition of Chemical Weapons (OPCW) due to its direct as well as forensic link to the nerve agent Soman. Therefore, its detection by Chemical Weapons Convention (CWC) inspection teams during on-site investigations is a strong indicator of the past or latent presence of Soman in the environment. Its small molecular weight (102), early elution time, and poor ionization profile make PA a challenging analyte to detect particularly at low concentrations (∼1–10 μg/g). In this work, 1,1′-carbonyldimidazole (CDI) has been used to effectively modify PA for the first time in two different soil matrices (Virginia type A soil and silt sediment) at two separate concentrations (1 and 10 μg/g) for its subsequent detection by EI-GC-MS and LC-HRMS methods. For the EI-GC-MS analysis, the PA carbamate derivative (PIC) exhibits improved chromatography relative to PA such as improved peak shape, increased molecular weight (196 for PIC and 102 for PA) and increased retention time (16.9 min for PIC and ∼4.1 min for PA). In addition, the derivatization also improves the detection of PA by LC-HRMS as the PIC product possesses protonation sites (i.e., imidazole ring) relative to none exhibited by PA. More importantly, the carbamoylation proceeds under mild conditions (55 °C, no base) and rapidly (3 h), characteristics that make it an appealing protocol for the analysis of PA during OPCW PTs or real case scenarios particularly in instances where it is present at low concentrations. It is anticipated that the protocol can be applied to the forensic analysis of this important Soman marker in various environmental matrices.

Chemistry↗

Practical benzylation of N,N -substituted ethanolamines related to chemical warfare agents for analysis and detection by Electron Ionization Gas Chromatography-Mass Spectrometry

The benzylation of three, low-molecular weight N,N-disubstituted ethanolamines related to chemical warfare agents (CWAs) to furnish derivatives with improved Gas Chromatography-Mass Spectrometry (GC-MS) profiles is described. Due to their low molecular weight and polar nature, N,N-disubstituted ethanolamines are notoriously difficult to detect by routine GC-MS analyses during Organisation for the Prohibition of Chemical Weapons (OPCW) proficiency tests (PTs), particularly in scenarios when they are present at low levels (~1-10 ppm) amidst more abundant interferences. Our studies revealed that the optimal derivatization conditions involved the treatment of the ethanolamine with benzyl bromide in the presence of an inorganic base (e.g., Na 2 CO 3 ) in dichloromethane at 55 °C for 2 hours. This optimized set of conditions were then successfully applied to the derivatization of N,N-dimethylethanolamine, N,N-diethylethanolamine and N,N-diisopropylethanolamine present separately at 1 and 10 μg/mL concentrations in a glycerol-rich matrix sample featured in the 48 th OPCW PT. The benzylated derivatives of the three ethanolamines possessed retention times long enough to clear the massive glycerol-containing matrix interferences. In conclusion, the protocol herein is introduced as an alternative method for derivatization of these CWA and pharmaceutically important species and should find broad applicability in laboratories where their routine forensic analysis is carried out.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - KClO 4 /Aluminum Mixture

The Integrated Data Collection Analysis (IDCA) program is conducting a Proficiency Test for Small-Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of a mixture of KClO 4 and aluminum—KClO 4 /Al mixture. This material was selected because of the challenge of performing SSST testing of a mixture of two solids. The mixture was found to be: 1) much less sensitive to impact than RDX, (LLNL being the exception) and PETN, 2) more sensitive to friction than RDX and PETN, and 3) extremely sensitive to spark. The thermal analysis showed little or no exothermic character. One prominent endothermic feature was observed in the temperature range studied and identified as a phase transition of KClO 4 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Extended Study on the Uncertainty Quantification of a Photodiode's Spectral Responsivity

An extended study was done on the analysis procedure for spectral responsivity of a silicon detector from the range of 200 nm to 1100 nm for the Optical Component Calibration laboratory at Livermore Operations in Livermore California. As a result, the uncertainty of the procedure was quantified to account for variables that contribute to uncertainty; such as the reproducibility and repeatability of the working standards, quantifying Type A and B uncertainties, validating laboratory equipment and associated software, and looking at environmental variables. The findings lead to a revised analysis reporting procedure that reports uncertainties depending on three spectral ranges, 300 nm to 400 nm, 400 nm to 700 nm, and 700 nm to 1100 nm. A proficiency test was done to compare the difference between both methods and a noticeable difference was found. The results showed that the previous reporting method over estimated uncertainty as much as 3.5% for the 300 nm to 400 nm range, 4% in the >400 nm to 700 nm range, and 2% in the >700 nm to 1100 nm range. The findings lead to the use of the revised procedure when producing calibration certificates, better quantified measurement uncertainties, and will be used for the process of updating the scope of accreditation from the National Voluntary Laboratory Accreditation Program.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NWAL Validation Report for U Assay by Potentiometric Titration (Modified Davies and Gray Technique) and U and PU Assay by Isotope Dilution Mass Spectrometry

SRNL Sensing & Metrology, previously Analytical Laboratory, is a member of the IAEA Network of Analytical Laboratories for Nuclear Material Measurement that is qualified to provide Uranium and Plutonium isotopic analysis of nuclear materials by Thermal Ionization Mass Spectrometry. As part of the membership, SRNL participated in the 2019 Nuclear Material Round Robin to maintain the qualification to provide isotopic analysis. SRNL also participated with the additional intent to qualify Uranium Assay by Potentiometric Titration (Davies and Gray method) and Uranium and Plutonium Isotope Dilution by Thermal Ionization Mass Spectrometry as part of the International Atomic Energy Agency’s Network of Analytical Laboratories. The proficiency test exercise was conducted by the Office of Safeguards Analytical Services, Department of Safeguards.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

The three R's of training: Recording, Retaining, and Reporting - The training management system that synergizes

NASA's Kennedy Space Center employs a Training and Certification Record System (TCRS) which tracks and maintains records for each of its employees, encompassing all aspects of training history: training courses, physical examinations, proficiency tests, on-the-job training, standboards, and certifications with completions and expiration dates. TCRS, which is fully automated, includes an expiration-alert notification capability to project recurring expirations, thereby functioning as a forecasting tool for training budgets.

Ingram, Dick D.↗

Why accredit ISO/CEI 17025 a nuclear waste management laboratory? - 15112

When there is no storage, nor repository, available on a site, the entity in charge of nuclear waste management should find outlets in order to evacuate outside the site. Each outlet has his rules and waste acceptance criteria (packaging rules, physical/chemical/radiological criteria for example). Before you are able to evacuate your waste, an acceptance's process (or contract review) takes place. This process scans the entire measures implemented by the site in order to satisfy outlet's criteria. When the acceptance is obtained, shipments could be organized, and the process gets into an observation's phase. During this phase, the outlet could choose to inspect a finished nuclear waste package or to audit regularly the waste management process. In this last case, the outlet re-scans the entire documents and implemented measures. This audit lasts from one to several days. A way to tackle/approach the audit is to acknowledge, by a trusted third party (i.e. independent from the outlet), all or part of waste management system, in order to base one's reputation on this organism and win outlet's trust. For this purpose, the entity could choose certification or accreditation. Certification (ISO 9001 as often as not) aims at evaluating a system for managing the quality of one product or service. Accreditation (ISO 17025, for example) provides formal recognition for technical skills within a quality management system (clauses 5 and 4 of the ISO 17025 standard). In 2006, the LDM laboratory is the first French laboratory accredited, in accordance with ISO 17025 standard, for the characterization by gamma spectrometry on 100 L- and 200 L- radioactive waste drums (accreditation No 1-1712 - scope available on www.cofrac.fr). This accreditation allows the lab: - to update the quality management system, - to compile the entire technical file of the gamma-ray assay (description, evaluation of the uncertainties, calibration, proficiency testing programs, measurement procedures,...), - to pass previous identified constraints on to producers and nuclear waste package production, - to maintain permanent quality improvement loop, - to lighten the programs of outlets audits, through the acknowledgement of the technical competence of the laboratory to evaluate by gamma spectrometry the activity contained in our nuclear waste drums. On the other hand, the lab is re-evaluated periodically to ensure its continued compliance with requirements: within a 12 month's interval for an internal audit, with a 18 month's period for COFRAC (French sole official national accreditation body). Since 2006, the lab is accredited. His accreditation renewed in 2010. A new entire renewal audit is planned in 2015. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrated Data Collection Analysis (IDCA) Program - AN and Bullseye Smokeless Powder

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of ammonium nitrate (AN) mixed with Bullseye® smokeless powder (Gunpowder). The participants found the AN/Gunpowder to: 1) have a range of sensitivity to impact, comparable to or less than RDX, 2) be fairly insensitive to friction as measured by BAM and ABL, 3) have a range for ESD, from insensitive to more sensitive than PETN, and 4) have thermal sensitivity about the same as PETN and Gunpowder. This effort, funded by the Department of Homeland Security (DHS), is putting the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study has the potential to suggest new guidelines and methods and possibly establish the SSST testing accuracies needed when developing safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods. Note, however, the test procedures differ among the laboratories. The testing performers involved are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), Sandia National Laboratories (SNL), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to compare results when these testing variables cannot be made consistent. Keywords: Small-scale safety testing, proficiency test, impact-, friction-, spark discharge-, thermal testing, round-robin test, safety testing protocols, HME, RDX, potassium perchlorate, potassium chlorate, sodium chlorate, sugar, dodecane, PETN, carbon, ammonium nitrate, Gunpowder, Bullseye® smokeless powder.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - SSST Testing Methods

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the methods used for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis during the IDCA program. These methods changed throughout the Proficiency Test and the reasons for these changes are documented in this report. The most significant modifications in standard testing methods are: 1) including one specified sandpaper in impact testing among all the participants, 2) diversifying liquid test methods for selected participants, and 3) including sealed sample holders for thermal testing by at least one participant. This effort, funded by the Department of Homeland Security (DHS), is putting the issues of safe handling of these materials in perspective with standard military explosives. The study is adding SSST testing results for a broad suite of different HMEs to the literature. Ultimately the study will suggest new guidelines and methods and possibly establish the SSST testing accuracies needed to develop safe handling practices for HMEs. Each participating testing laboratory uses identical test materials and preparation methods wherever possible. The testing performers involved are Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), Indian Head Division, Naval Surface Warfare Center, (NSWC IHD), Sandia National Laboratories (SNL), and Air Force Research Laboratory (AFRL/RXQL). These tests are conducted as a proficiency study in order to establish some consistency in test protocols, procedures, and experiments and to compare results when these testing variables cannot be made consistent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Integrated Data Collection Analysis (IDCA) Program - RDX Standard Data Set 2

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Type II Class 5 standard, from testing the second time in the Proficiency Test. This RDX testing (Set 2) compared to the first (Set 1) was found to have about the same impact sensitivity, have more BAM friction sensitivity, less ABL friction sensitivity, similar ESD sensitivity, and same DSC sensitivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning for continuous quantum error correction on superconducting qubits

Abstract Continuous quantum error correction has been found to have certain advantages over discrete quantum error correction, such as a reduction in hardware resources and the elimination of error mechanisms introduced by having entangling gates and ancilla qubits. We propose a machine learning algorithm for continuous quantum error correction that is based on the use of a recurrent neural network to identify bit-flip errors from continuous noisy syndrome measurements. The algorithm is designed to operate on measurement signals deviating from the ideal behavior in which the mean value corresponds to a code syndrome value and the measurement has white noise. We analyze continuous measurements taken from a superconducting architecture using three transmon qubits to identify three significant practical examples of non-ideal behavior, namely auto-correlation at temporal short lags, transient syndrome dynamics after each bit-flip, and drift in the steady-state syndrome values over the course of many experiments. Based on these real-world imperfections, we generate synthetic measurement signals from which to train the recurrent neural network, and then test its proficiency when implementing active error correction, comparing this with a traditional double threshold scheme and a discrete Bayesian classifier. The results show that our machine learning protocol is able to outperform the double threshold protocol across all tests, achieving a final state fidelity comparable to the discrete Bayesian classifier.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Integrated Data Collection Analysis (IDCA) Program — Quarterly Review Meeting

On November 9 and 10, 2011 the IDCA had the annual quarterly meeting. The meeting started the afternoon of the first day with a tour of the NSWC IHD explosives safety testing and analysis facilities. The meeting on the second day addressed the formal sponsor review and further technical issues for the IDCA. Examination of the IHD equipment during the tour, lead to a long discussion on liquid test methods. The discussion resulted in revision of liquid test methods in the impact test and selection of a new liquid test standard. In addition, modifications to friction, spark and thermal test methods were discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Savannah River National Laboratory Participation in the International Atomic Energy Agency CPC Interlaboratory Comparison Exercise 2

International Atomic Energy Agency Safeguards Analytical Services (IAEA-SGAS) oversees coordinating the second Controlled Potential Coulometry Quality Control Interlaboratory Comparison (CPC QC ILC) on behalf of the Nuclear Material Laboratory (NML). The purpose of the exercise is to: (1) verify the ability of participating laboratories to measure the Pu concentration in the sample solutions, and (2) estimate the method performance (repeatability and intermediate reproducibility). Sample shipping coordination was performed by IAEA-SGAS. The test sample is a plutonium nitrate solution (estimated molarity of 3-5 M), delivered in two PTFE screw-capped quartz ampoules. Each participating laboratory is to receive two ampoules. Each ampoule holds approximately 8 mL of solution containing approximately 10 mg Pu/g. The gross weights of the ampoules were provided. The test sample is assumed to have an iron content below the level of significance for the CPC. The isotopic composition of the plutonium test sample was provided; however, no analysis date was provided. In addition, IAEA-SGAS provided analytical instructions to participants. On September 20, 2022, SRNL received the samples sent by IAEA-SGAS.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗