Search NASA⌕ Search

Engineering topics

Ghawaly, James M.

Publications and source records attributed to Ghawaly, James M..

Explaining machine-learning models for gamma-ray detection and identification

As more complex predictive models are used for gamma-ray spectral analysis, methods are needed to probe and understand their predictions and behavior. Recent work has begun to bring the latest techniques from the field of Explainable Artificial Intelligence (XAI) into the applications of gamma-ray spectroscopy, including the introduction of gradient-based methods like saliency mapping and Gradient-weighted Class Activation Mapping (Grad-CAM), and black box methods like Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP). In addition, new sources of synthetic radiological data are becoming available, and these new data sets present opportunities to train models using more data than ever before. In this work, we use a neural network model trained on synthetic NaI(Tl) urban search data to compare some of these explanation methods and identify modifications that need to be applied to adapt the methods to gamma-ray spectral data. We find that the black box methods LIME and SHAP are especially accurate in their results, and recommend SHAP since it requires little hyperparameter tuning. We also propose and demonstrate a technique for generating counterfactual explanations using orthogonal projections of LIME and SHAP explanations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Radiation Detection Data Competition Report

In FY2018 through FY2020, NA-22, the Defense Nuclear Nonproliferation Research and Development Program, funded a Data Science project to develop and implement statistical methodology to effectively host data competitions with the goal of leveraging the opportunity provided by crowdsourcing. By accessing and engaging expertise from a broader research community, there is an opportunity to attract innovative solutions from a variety of different research disciplines to advance the ability to solve important non-proliferation problems. This report summarizes the key results of this project after hosting two data competitions focused on urban radiation detection. The first competition was focused on attracting participants from the U.S. national laboratories, while the second, hosted by TopCoder, was open to the broader international community and awarded prize money to the top 10 competitors. At the start of the project, there was strong interest from NA-22 to explore and develop the capability to host data competitions as a means of leveraging the broader community to solve important nuclear nonproliferation problems. Having a standard data set on which to compare different approaches based on clearly defined criteria was desirable to be able to evaluate the state of solutions for important problems. Initially, it was not clear that it would even be possible logistically and bureaucratically to host a competition with an international field of competitors and to award the prize money needed to attract solutions from top competitors. Happily, a path to host the competitions was ultimately found that allowed this powerful accelerator of improvements to be leveraged.

61 RADIATION PROTECTION AND DOSIMETRY↗

Data for training and testing radiation detection algorithms in an urban environment

The detection, identification, and localization of illicit nuclear materials in urban environments is of utmost importance for national security. Most often, the process of performing these operations consists of a team of trained individuals equipped with radiation detection devices that have built-in algorithms to alert the user to the presence nuclear material and, if possible, to identify the type of nuclear material present. To encourage the development of new detection, radioisotope identification, and source localization algorithms, a dataset consisting of realistic Monte Carlo-simulated radiation detection data from a 2 in. × 4 in. × 16 in. NaI(Tl) scintillation detector moving through a simulated urban environment based on Knoxville, Tennessee, was developed and made public in the form of a Topcoder competition. The methodology used to create this dataset has been verified using experimental data collected at the Fort Indiantown Gap National Guard facility. Realistic signals from special nuclear material and industrial and medical sources are included in the data for developing and testing algorithms in a dynamic real-world background.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Generation of Synthetic Data for a Radiation Detection Algorithm Competition

This paper details the generation of synthetic radiation data using large-scale Monte Carlo transport models to evaluate radiation search detection algorithms. Modular 3-D Monte Carlo models spanning multiple city blocks were constructed, loosely based on downtown Knoxville, TN, containing buildings composed of multiple materials (brick, granite, and concrete), sidewalks, a four-lane road, side streets, parking lots, and grassy fields. Background and simulated source detector response calculations from these models were used to create synthetic list mode data sets for a 2"×4"×16" NaI(Tl) detector moving through a city street at a constant speed. For the background simulations, major isotopes were computed individually so that background composition and variability could be computed efficiently outside Monte Carlo. The source detector response included six simulated sources placed at 15 source locations. Detector response was developed to be periodic through the city street so that a detector path could begin at one end of the model and wrap around to the other. This framework allowed for the creation of diverse data sets, each with its own unique background and simulated source detector response. Synthetic data allows for high-quality labels, which are useful in developing data-driven radiation detection algorithms. This methodology was used to create synthetic data sets which were released as part of a public data competition to spur the development of new radiation detection algorithms for radiological search applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Classification of Dissolution Events Using Fusion of Effluents Measurements and Classifiers

Classifiers for dissolution events at a radiochemical processing facility are studied using gamma spectra measurements of effluents collected by a high purity germanium detector located at its off-gas stack. Data sets collected at the Oak Ridge National Laboratory’s Radiochemical Engineering Development Center under a Pu dissolution campaign spanning a three months period are utilized. Features corresponding to the activity levels of 15 radionuclides, including isotopes of iodine, krypton, and xenon, that are indicated by the target decay chains, are computed from the spectra at 1 hour intervals. A conceptualization diagram is developed to reflect the steps from the source to measurement to feature computation that depend on fission products indicated by decay chains, chemical processing, and effluents transport to the off-gas stack. A diverse set of eight classifiers based on different design principles are trained using the ground truth data for this campaign, and the outputs of top three classifiers, namely, classification trees, Ensemble of Trees (EOT), and k-nearest neighbor, are combined using EOT classifier-fuser. Our results show that for 5-fold cross validation, features associated with isotopes of xenon provide the lowest classification error among the different elements across the classifiers; the classification error is furthered improved when all 15 isotope features are used by each classifier, and it is again improved by the fusion of three classifiers. Further reduction in classification error is achieved by using a measurement window of 1-2 days which is identified based on half-life time estimates of the isotopes; it is long enough for the stabilization of feature estimates while being short enough not to be affected by the follow on dissolution events. As a net result of feature and classifier fusion, combined with the incorporation of decay chain and isotope half-life information, this approach achieves 98% detection rate while maintaining a false alarm rate under 2% for this data set.

Rao, Nageswara↗

Localization of a radioactive source in an urban environment using Bayesian Metropolis methods [Bayesian Metropolis methods for source localization in an urban environment]

Here, we present a method for localizing an unknown source of radiation in an urban environment using a distributed detector network. This method employs statistical parameter estimation techniques, relying on an approximation for the response of a detector to the source based on a simplified model of the underlying transport phenomena, combined with a Metropolis-type sampler that is modified to propagate the effect of fixed epistemic uncertainties in the material macroscopic cross sections of objects in the scene. We apply this technique to data collected during a measurement campaign conducted in a realistic analog for an urban scene using a network of six mobile detectors. Our initial results are able to localize the source to within approximately 8 m over a scene of size 300 m 200 m in two independent trials with 30 min count times, including a characterization of the uncertainty associated with the poorly known macroscopic cross sections of objects in the scene. In these measurements, the nearest detectors were between 20 m to 30 m from the source, and recorded count rates between approximately 3 and 13 times background. A few detectors had line-of-sight to the source, while the majority were obscured by objects present in the scene. After extending our model to account for the orientation of the detectors and correcting for anomalies in the measurement data we were able to further improve the localization accuracy to approximately 2 m in both trials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗