A Semi-Supervised Model for Multi-Label Radioisotope Classification and Out-of-Distribution Detection
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
A comprehensive analysis and simulation of two memristor-based neuromorphic architectures for nuclear radiation detection is presented. Both scalable architectures retrofit a locally competitive algorithm to solve overcomplete sparse approximation problems by harnessing memristor crossbar execution of vector–matrix multiplications. The proposed systems demonstrate excellent accuracy and throughput while consuming minimal energy for radionuclide detection. To ensure that the simulation results of our proposed hardware are realistic, the memristor parameters are chosen from our own fabricated memristor devices. Based on these results, we conclude that memristor-based computing is the preeminent technology for a radiation detection platform.
In the machine learning problem of multilabel classification, the objective is to determine for each test instance which classes the instance belongs to. In this work, we consider an extension of multilabel classification, called multilabel proportion prediction, in the context of radioisotope identification (RIID) using gamma spectra data. We aim to not only predict radioisotope proportions, but also identify out-of-distribution (OOD) spectra. We achieve this goal by viewing gamma spectra as discrete probability distributions, and based on this perspective, we develop a custom semi-supervised loss function that combines a traditional supervised loss with an unsupervised reconstruction error function. Our approach was motivated by its application to the analysis of short-lived fission products from spent nuclear fuel. In particular, we demonstrate that a neural network model trained with our loss function can successfully predict the relative proportions of 37 radioisotopes simultaneously. The model trained with synthetic data was then applied to measurements taken by Pacific Northwest National Laboratory (PNNL) to conduct analysis typically done by subject-matter experts. Here, we also extend our approach to successfully identify when measurements are OOD, and thus should not be trusted, whether due to the presence of a novel source or novel proportions.
Following the events of September 11, 2001, international border crossing have been equipped with radiation portal monitors (RPMs) to identify illicit radioactive material. Polyvinyl toluene (PVT) scintillators are commonly used due to their low cost and reasonable maintainability, however they offer low spectral resolution. Despite the fact that over twenty years has transpired since this event, radioisotopes are still typically identified by hand-crafted classification algorithms, e.g., total counts or energy windowing, and exhibit relatively poor performance in detecting threats at the low false alarm rates required to support the stream of commerce. While some improvement to performance has been realized via the use of supervised machine learning, these classification algorithms typically utilize simulations in lieu of real data due to the sparsity of data for one or more classes. Accordingly, the performance of these algorithms is somewhat less than optimal when examining experiments or simulations with model mismatch. Consequently, in this work, we examine the application of a number of unsupervised machine learning, anomaly detection based algorithms, to circumvent the inverse crime when analyzing spectroscopy data for RPMs. We also compare anomaly detection results with those obtained via the use of supervised classification detection ML algorithms when model mismatch is introduced between the simulated threat items utilized for training/testing. Finally, we compared the performance of the PVT scintillators to those obtained with higher resolution detectors using both anomaly detection and supervised classification algorithms.
This work explores the potential of utilizing temporal data from gamma-ray detectors, known as list-mode data, to enhance radioisotope identification. Traditional identification methods, which rely on full gamma-ray spectrum analysis, often require long dwell times and struggle with spectra containing similarly spaced spectral peaks. We hypothesize that by leveraging the probabilistic nature of nuclear decay and the time-encoded information from decay sequences and interactions with surrounding materials, we can improve classification accuracy over static spectral analysis. This research examines the temporal content of list-mode data through exploratory data analysis via correlation discovery and qualitative distribution analysis. Additionally, we propose a probabilistic classification model that can utilize spectral data, temporal data, or both to determine if the incorporation of temporal information improves radioisotope identification. Our findings suggest that the temporal information present in list-mode gamma-ray data has merit and should be further investigated to develop more robust and optimal methods for utilizing this temporal information in applications requiring radioisotope identification.
This work explores the potential of utilizing temporal data from gamma-ray detectors, known as list-mode data, to enhance radioisotope identification. Traditional identification methods, which rely on full gamma-ray spectrum analysis, often require long dwell times and struggle with “confuser” sources, or spectra with similarly spaced spectral peaks. We hypothesize that by leveraging the probabilistic nature of nuclear decay and the time-encoded information from decay sequences and interactions with surrounding materials, we can improve classification accuracy over static spectral analysis. This research rigorously examines the temporal content of list-mode data through exploratory data analysis via correlation discovery and information theory. We further propose a basic classification model that can utilize spectral or temporal data (or both) to determine if the incorporation of temporal information can improve radioisotope identification. The findings suggest that the temporal information present in list-mode gamma-ray data has merit and should be further investigated.
Greater-than-Class C (GTCC) waste is low-level waste (LLW) that exceeds the Class C concentrations tabulated in Title 10, Code of Federal Regulations (CFR), Part 61. Disposal of GTCC waste in the near surface (i.e. upper 30 m of the earth's surface) is prohibited in the United States. Though GTCC waste disposal is generally prohibited, the Commission can approve disposal according to 10 CFR 61.55(a)(2)(iv) on a case-by-case basis. The waste classification tables, developed in the early 1980's, were based on model projections of dose to an inadvertent intruder in agricultural, construction, and discovery exposure scenarios. The assumptions and parameters used were documented in a series of public reports. Though different disposal facility designs and site conditions were considered, the waste classification tables were based on a disposal facility design located in a specific environment. The tables were based on shallow (i.e., top few meters) trench facility designs and did not consider deeper facilities. To determine the suitability of GTCC waste disposal in the near-surface, site-specific analyses must account for differences between GTCC waste and Class A, B, and C LLW (hereafter, traditional LLW). GTCC waste can have concentrations of radionuclides that are much higher than traditional LLW. Because of these higher concentrations, processes that are typically not significant for traditional LLW may be significant with respect to disposal of GTCC waste. These processes include, but are not limited to, heat generation, criticality, and radiolysis. The form of the waste as well as the barriers to release of the waste (e.g. waste package) could be substantially different than they are for traditional LLW. These barriers need to be considered when assessing the impacts of accidents during receipt and placement and in evaluating long-term performance. Some GTCC radioactivity is either embedded in stainless steel or contained in stainless steel barriers. Stainless steel can have very low corrosion rates under a variety of environmental conditions. Finally, and possibly most importantly, GTCC waste would likely need to be disposed deeper than traditional LLW to reduce the probability of disturbance. The waste classification table values of traditional LLW are based on an inadvertent intruder excavating into the waste and bringing some of the material to the land surface. If waste is deeper than approximately 5 m, the excavation scenario becomes very unlikely. Therefore, other intruder scenarios, such as drilling exposure scenarios, need to be evaluated. This paper summarizes key technical issues for the disposal of GTCC waste. Our previous study shows that certain GTCC waste may be suitable for near surface disposal whereas others may not. This study may support ongoing technical analyses assessing potential disposal of GTCC in a near surface disposal facility. (authors)
Recommendations from the International Commission for Radiological Protection (ICRP) and the International Atomic Energy Agency (IAEA) identify the need to consider potential inadvertent human intrusion into a near-surface radioactive waste disposal facility when developing limits for radionuclide concentrations that can be disposed. The recommendations also provide perspective on expectations for performance criteria and general assumptions for such analyses. Inadvertent human intrusion analyses are conducted to address the potential failure of institutional controls and loss of memory of a disposal facility. The analyses consider potential consequences of human actions that result in unknowingly bringing waste to the surface. Inadvertent human intrusion scenarios consider potential impacts to someone involved in an activity that actually disturbs the waste (e.g., drilling or excavation of a basement) or that exposes the person to emanations from the waste (e.g., radioactive gases) and also for the case where there may be longer term exposures to waste that has been brought to the surface. In practice, inadvertent human intrusion analyses have proven to be a critical consideration for the development of waste classification systems and for the determination of disposal requirements and limitations on wastes that can be disposed at shallow depths. The IAEA implemented a project on Human Intrusion in the context of Disposal of Radioactive waste (HIDRA) to further explore the regulatory expectations and practical implementation of analyses of potential inadvertent human intrusion. The paper begins with a discussion of international recommendations related to consideration of inadvertent human intrusion and then summarizes examples of some topical considerations related to addressing inadvertent human intrusion that are being discussed as part of the second phase of the HIDRA project. The topical considerations are planned to be addressed in a formal IAEA publication. All information in this paper simply reflects on-going project discussions and no formal recommendations are implied for these topical considerations at this time. (authors)
Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.
Training machine learning models for radioisotope identification using gamma spectroscopy remains an elusive challenge for many practical applications, largely stemming from the difficulty of acquiring and labeling large, diverse experimental datasets. Simulations can mitigate this challenge, but the accuracy of models trained on simulated data can deteriorate substantially when deployed to an out-of-distribution operational environment. In this study, we demonstrate that unsupervised domain adaptation (UDA) can improve the ability of a model trained on synthetic data to generalize to a new testing domain, provided unlabeled data from the target domain are available. Conventional supervised techniques are unable to utilize this data because the absence of isotope labels precludes defining a supervised classification loss. Instead, we first pretrain a spectral classifier using labeled synthetic data and subsequently leverage unlabeled target data to align the learned feature representations between the source and target domains. We compare a range of different UDA techniques, finding that minimizing the maximum mean discrepancy (MMD) between source and target feature vectors yields the most consistent improvement to testing scores. For instance, using a custom transformer-based neural network, we achieved a testing accuracy of $0.904 \pm 0.022$ on an experimental LaBr test set after performing unsupervised feature alignment via MMD minimization, compared to $0.754 \pm 0.014$ before alignment. Overall, our results highlight the potential of using UDA to adapt a radioisotope classifier trained on synthetic data for real-world deployment.
This paper compares the Light-Weight Radioisotope Heater Unit (LWRHU) historical testing to Department of Transportation (DOT) Special Form criteria per 49 CFR Part 173, Shippers-General Requirements for Shipments and Packages, Section 469, Tests for special form Class 7 (radioactive) materials as specified in DOE-STD-1027, Hazard Categorization of DOE Nuclear Facilities. Compliance with the aforementioned criteria allows for the exclusion of radioactive sources from the facility’s nuclear material inventory. As part of a new program at Los Alamos National Laboratory (LANL), LWRHUs are planned to be moved into TA-55, PF-5 Power Source Assembly Area (PSAA) for assembly and testing activities. The PSAA Facility is categorized as a low hazard, non-nuclear facility per DOE STD-1027 and is described in TA55-PF-5-FHC-11-001, Facility Hazard Categorization of the PSAA at PF-5, TA-55. The Facility Hazard Categorization document states, there must be documentation that radioactive sources are engineered to pass the special form testing specified by DOT in 49 CFR 173.469, Tests for special form Class 7 (radioactive) materials or ANSI N43.6, Sealed Radioactive Sources - Classification. This paper documents the extensive historical environmental safety testing of the LWRHU and demonstrates its ability to survive potential launch safety accident scenarios. The testing results are used herein to demonstrate through a comparative analysis that the robust design of the LWRHU meets or exceeds the special form testing specifications in 49 CFR 173.469, enabling the LWRHU to be transported and handled in PF-5 in support of testing and assembly program.
Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: THE CHERNOBYL ACCIDENT: 1 Chernobyl Accident Management Actions, A. R Sich 25 The IAEA-ASSET Approach to Avoiding Accidents is to Recognize the Precursors to Prevent Incidents, F. Reisch; ACCIDENT ANALYSIS: 36 A Review of the Available Information on the Triggering Stage of a Steam Explosion, D. F. Fletcher; 58 Analysis and Modeling of Flow-Blockage-Induced Steam Explosion Events in the High-Flux Isotope Reactor, R. P. Taleyarkhan, V. Georgevich, C. W. Nestor, U. Gat, B. L. Lepard, D. H. Cook, J. Freels, S. J. Chang, C. Luttrell, R. C. Gwaltney, and J. Kirkpatrick; 74 An Analysis of Disassembling the Radial Reflector of a Thermionic Space Nuclear Reactor Power System, M. S. El-Genk and D. V. Paramonov; CONTROL AND INSTRUMENTATION: 86 Standards for High-Integrity Software, D. R. Wallace, D. R. Kuhn, L M. Ippolito, and L. Beltracchi; DESIGN FEATURES: 98 Adoption of New Design Features for the Next Generation Nuclear Power Reactors, L. S. Tong; 114 Review of Nuclear Piping Seismic Design Requirements, G. C. Slagis and S. E. Moore; ENVIRONMENTAL EFFECTS: 128 PC-Based Probabilistic Safety Assessment Study for a Geological Waste Repository Placed in a Bedded Salt Formation, S. A. Khan; OPERATING EXPERIENCES: 142 Managing Aging in Nuclear Power Plants: Insights from NRC’s Maintenance Team Inspection Reports, A. Fresco and M. Subudhi; 150 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 153 Selected Safety-Related Events, Compiled by G. A. Murphy; RECENT DEVELOPMENTS: 158 Reports, Standards, and Safety Guides, D. S. Queener; 168 Proposed Rule Changes as of Dec. 31, 1993; ANNOUNCEMENTS: 177 Symposium on Radioactive and Mixed Waste—Risk as a Basis for Waste Classification; 177 1995 Incineration Conference 178 Ninth Power Plant Dynamics Control and Testing Symposium; 174 The Authors
Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. THE CHERNOBYL ACCIDENT: 1 Chernobyl Accident Management Actions, A. R Sich; GENERAL SAFETY CONSIDERATIONS: 25 The IAEA-ASSET Approach to Avoiding Accidents is to Recognize the Precursors to Prevent Incidents, F. Reisch; ACCIDENT ANALYSIS: 36 A Review of the Available Information on the Triggering Stage of a Steam Explosion, D. F. Fletcher; 58 Analysis and Modeling of Flow-Blockage-Induced Steam Explosion Events in the High-Flux Isotope Reactor, R. P. Taleyarkhan, V. Georgevich, C. W. Nestor, U. Gat, B. L. Lepard, D. H. Cook, J. Freels, S. J. Chang, C. Luttrell, R. C. Gwaltney, and J. Kirkpatrick; 74 An Analysis of Disassembling the Radial Reflector of a Thermionic Space Nuclear Reactor Power System, M. S. El-Genk and D. V. Paramonov; CONTROL AND INSTRUMENTATION: 86 Standards for High-Integrity Software, D. R. Wallace, D. R. Kuhn, L M. Ippolito, and L. Beltracchi; DESIGN FEATURES: 98 Adoption of New Design Features for the Next Generation Nuclear Power Reactors, L. S. Tong; 114 Review of Nuclear Piping Seismic Design Requirements, G. C. Slagis and S. E. Moore; ENVIRONMENTAL EFFECTS: 128 PC-Based Probabilistic Safety Assessment Study for a Geological Waste Repository Placed in a Bedded Salt Formation, S. A. Khan; OPERATING EXPERIENCES: 142 Managing Aging in Nuclear Power Plants: Insights from NRC’s Maintenance Team Inspection Reports, A. Fresco and M. Subudhi; 150 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 153 Selected Safety-Related Events, Compiled by G. A. Murphy; RECENT DEVELOPMENTS: 158 Reports, Standards, and Safety Guides, D. S. Queener; 168 Proposed Rule Changes as of Dec. 31, 1993; ANNOUNCEMENTS: 177 Symposium on Radioactive and Mixed Waste—Risk as a Basis for Waste Classification; 177 1995 Incineration Conference 178 Ninth Power Plant Dynamics Control and Testing Symposium; 174 The Authors
The most important factor underlying optimal waste management is developing a clear picture of the radioactivity content of the waste and its impact on waste disposal cost. For over 35 years since the publishing of 10CFR61, waste characterization has relied on sampling the final waste product after formation. In the days following 10CFR61, the cost of final disposal was marginal with only a small impact on the overall costs. Constraints were added by provisions of the Low Level Waste Policy Act of 1985 leading to increasingly limited access to those disposal sites that remained available. In addition, Nuclear Regulatory Commission (NRC) pressure promoting waste volume reduction led to disposal costs inevitably rising. Despite this, characterization practices in monitoring of waste generation for activity content still center on the same dated processes. This results in a disposal classification on the basis of endpoint sampling without consideration of the homogeneity of the waste mixture. It can also disregard consideration of the representativeness of the single or small sample base. As a minimum effort, a formalized sampling program of a fixed grouping of waste streams can be implemented that could account for more than 95% of all of the activity carried in solid waste products. The sample results for each radionuclide could then be trended as time passes to develop reasonable scaling factors for difficult to measure radionuclides. This process, identified in NRC guidance, has been rigorously followed by a relatively small number of facilities. The trended scaling factors serve to improve accuracy by identifying anomalous results that could otherwise go undetected. Direct monitoring of the accumulation of activity in process streams generating solid radwaste, including demineralizers and filter streams, is a more precise approach. Nearly all of these streams are monitored by plant chemistry on a regular schedule to maintain water quality. This paper discusses viable options for developing the basis for characterization through process monitoring of the accumulation of activity at the point of generation. Special focus is on resin bed tracking and how process knowledge of these streams can be brought together to form a consistent and precise solid waste radioactivity inventory. Some of the specific points covered in this paper include the merger of the fission product release computer program, 3R-STAT, with the radwaste sample analysis computer program, SCAN4 to create 3R-SCAN, the importance of individual waste stream influences on the overall source term, and the use of historic sample data to develop scaling factors using an automated process. (authors)