Search NASA⌕ Search

SEARCH · Search NASA

Results for “Analyst”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Deep Learning for Unsupervised Insider Threat Detection in Structured Cybersecurity Data Streams

Situational awareness data is a prototypical example of structured heterogeneous streaming data with asynchronous timing that can quickly scale beyond the cognitive power of a human analyst. We present deep learning methods that can train in real time from unlabeled streams and provide probabilistic anomaly scores. We compare our novel deep and recurrent neural network models to three baseline systems using threat detection recall on the CERT Insider Threat Dataset v6.2. In our experiments, our deep neural network and our recurrent neural network systems outperformed all baselines, and we found that using aggregated activity count features yielded the best performance. Our best model produces on average an anomaly score of 95.53 percentile for the day, suggesting it can facilitate a great reduction in analyst workload. Our models are also interpretable, in that they break down the anomaly score into individual features of user behavior, which could further aid analysts in reviewing potential cases of insider threat.

Tuor, Aaron R.↗

Quantifying the Contribution of Individual Display Features on Mental Workload to Support Human-System Interface Design in Nuclear Power Plants

Abstract. The integration of new digital instrumentation and control (I&C) technologies like advanced human-system interfaces in U.S. nuclear power plant main control rooms is important for addressing long-term aging and obsolescence of existing I&C. Nonetheless, attention should be made to ensure these technologies reflect state-of-the-art human factors engineering (HFE) principles. Often, there is conflicting guidance from one guideline to another, requiring the analyst to make a judgment call on addressing these 'tradeoffs.' The objective of this research was to inform the analyst of these tradeoffs through an empirical investigation of how certain display features that characterize common HFE guidelines concerning visual clutter and saliency influence information processing in a naturalistic context. By understanding the unique contribution of each display feature using a multilevel model, the HFE analyst should have an understanding of the interrelations of each feature with its impact on cognitive processes. Results and implications are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗

Verification of the Uniformly-Ordered Binary Decision Algorithm in Correlated-Benchmark Whisper Calculations

Whisper is a nuclear criticality safety code package that aids analysts in validation exercises by computing upper subcritical limits (USL) for applications of interest. To obtain statistically meaningful, significant, and conservative USLs, the analyst must ensure that Whisper selects a sufficient number of benchmarks that are neutronically similar to the application. Many of the available benchmarks are correlated but are currently treated as independent, leading to an artificially small sample size, as their individual information contributions will be overestimated. To aid the analyst in obtaining a sufficient sample size, prior work [2] demonstrated application of the Uniformly-Ordered Binary Decision (UOBD) algorithm in adjusting benchmark weights to account for benchmark correlations. This work provides verification of the Whisper implementation and considers the impact of updated benchmark correlations compared to those available previously. We demonstrate that the UOBD algorithm performs as expected with an analytic example. With HEU-SOL-THERM-001 cases 1 through 10 as the applications, we compare the USLs computed with benchmark correlations available in the Whisper 1.1 release only to those computed with additional benchmark correlations from DICE 2023 and demonstrate substantive differences.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Ceci n'est pas une micromachine.

The image created in reflected light DIC can often be interpreted as a true three-dimensional representation of the surface geometry, provided a clear distinction can be realized between raised and lowered regions in the specimen. It may be helpful if our definition of saliency embraces work on the human visual system (HVS) as well as the more abstract work on saliency, as it is certain that understanding by humans will always stand between recording of a useful signal from all manner of sensors and so-called actionable intelligence. A DARPA/DSO program lays down this requirement in a current program (Kruse 2010): The vision for the Neurotechnology for Intelligence Analysts (NIA) Program is to revolutionize the way that analysts handle intelligence imagery, increasing both the throughput of imagery to the analyst and overall accuracy of the assessments. Current computer-based target detection capabilities cannot process vast volumes of imagery with the speed, flexibility, and precision of the human visual system.

99 GENERAL AND MISCELLANEOUS↗

Web-based visual data exploration for improved radiological source detection

Radiation detection can provide a reliable means of detecting radiological material. Such capabilities can help to prevent nuclear and/or radiological attacks, but reliable detection in uncontrolled surroundings requires algorithms that account for environmental background radiation. The Berkeley Data Cloud (BDC) facilitates the development of such methods by providing a framework to capture, store, analyze, and share data sets. In the era of big data, both the size and variety of data make it difficult to explore and find data sets of interest and manage the data. Thus, in the context of big data, visualization is critical for checking data consistency and validity, identifying gaps in data coverage, searching for data relevant to an analyst's use cases, and choosing input parameters for analysis. Downloading the data and exploring it on an analyst's desktop using traditional tools are no longer feasible due to the size of the data. This study describes the design and implementation of a visualization system that addresses the problems associated with data exploration within the context of the BDC. Finally, the visualization system is based on a JavaScript front end communicating via REST with a back end web server.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

In the nuclear explosion monitoring context, what is an anomaly?

Abstract In the early years of nuclear explosion monitoring, experts used downwind detections with meaningful ratios of radioactive species to identify an explosion. Today’s reality is sparse networks of radionuclide monitoring stations looking for weak signals. Analysts need to discriminate between industrial background radioactivity and nuclear explosion signals, even using the detection of one isotope. Aerosol and xenon measurements potentially related to nuclear tests in 2006 and 2013 announced by the Democratic People’s Republic of Korea and from worldwide civilian background radioactivity are considered when defining radionuclide detection anomalies to objectively guide the use of limited analyst resources and reduce the possibility of not detecting nuclear explosions.

Miley, Harry S.↗

Compositional analysis of biomass reference materials: Results from an interlaboratory study

Biomass compositional methods are used to compare different lignocellulosic feedstocks, to measure component balances around unit operations and to determine process yields and therefore the economic viability of biomass-to-biofuel processes. Four biomass reference materials (RMs NIST 8491–8494) were prepared and characterized, via an interlaboratory comparison exercise in the early 1990s to evaluate biomass summative compositional methods, analysts, and laboratories. Having common, uniform, and stable biomass reference materials gives the opportunity to assess compositional data compared to other analysts, to other labs, and to a known compositional value. The expiration date for the original characterization of these RMs was reached and an effort to assess their stability and recharacterize the reference values for the remaining material using more current methods of analysis was initiated. We sent samples of the four biomass RMs to 11 academic, industrial, and government laboratories, familiar with sulfuric acid compositional methods, for recharacterization of the component reference values. In this work, we have used an expanded suite of analytical methods that are more appropriate for herbaceous feedstocks, to recharacterize the RMs’ compositions. We report the median values and the expanded uncertainty values for the four RMs on a dry-mass, whole-biomass basis. The original characterization data has been recalculated using median statistics to facilitate comparisons with this data. We found improved total component closures for three out of the four RMs compared to the original characterization, and the total component closures were near 100 %, which suggests that most components were accurately measured and little double counting occurred. Here, the major components were not statistically different in the recharacterization which suggests that the biomass materials are stable during storage and that additional components, not seen in the original characterization, were quantified here.

09 BIOMASS FUELS↗

High-Resolution Mass Spectrometry Quantification: Impact of Differences in Data Processing of Centroid and Continuum Data

High-resolution mass spectrometry (HRMS) in full scan mode acquires all ions present in the sample of interest offering a lot of qualitative information. This, in combination with the improved performance of the new generation HRMS systems, triggers more (bio) analysts to switch from triple quad MS systems to HRMS for quantitative analysis. Quantitative processing of HRMS data is performed based on narrow mass extraction windows rather than on nominal mass product ion chromatograms (SRM or MRM). Optimal processing of HRMS data requires different considerations and software tools and can have an impact on data processing and final results. The selection of centroid versus continuum/profile data for processing, selection of the optimal narrow mass extraction window, using theoretical versus measured accurate mass for the extraction of the ion chromatograms as well as differences in calculations and data handling residing in the different vendor software packages are tackled in the presented manuscript. These differences are illustrated on HRMS data acquired for the same plasma samples on three different platforms, i.e., a Sciex QToF, a Waters QToF, and a Thermo Orbitrap system, and processed in four different software packages, i.e., Sciex Analyst® TF, Waters Masslynx, Waters Unifi, and Thermo Xcalibur. The impact of these differences on quantitative HRMS performance was evaluated on calibration curves of eight small molecule compounds in plasma using four different ways of processing. Simple guidelines are provided for the selection of an optimal mass extraction window for continuum and centroided data. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Recovery of DNA from fired and unfired cartridge casings: comparison of two DNA collection methods

For over 10 years, various studies have attempted to increase the recovery of DNA from ammunition by modifying the DNA collection, extraction, purification, and amplification procedures, with varying levels of success. This study focused on the “soaking” method of Montpetit & O’Donnell [1] and the “rinse-and-swab" method of Bille et al. [2]. First, testing for the presence of exogenous DNA, 210 boxed cartridges (brass, steel, and nickel-plated) from nine manufacturers were swabbed and DNA was extracted, concentrated, and quantified. Extracts that quantified > 0 ng/µL (44 of 210) were amplified and genotyped with GlobalFiler™. Of those, only one extract yielded two alleles indicating that the manufacturing and packaging of ammunition was virtually DNA free. Next, to obtain a baseline comparison of two DNA collection methods on a non-metallic substrate and identify a suitable number of cells to spot on cartridges, different DNA input amounts of primary human adult epidermal keratinocytes (HEKa) were tested. Thereafter, 300 brass and 300 nickel-plated, cartridges were spotted with HEKa cells containing ~5 ng of DNA, fired or unfired, and processed with either method. Finally, five methods representing hybrids of the soaking and rinse-and-swab methods were tested to determine if variations of those methods could be used to increase DNA yield and recovery. The results show that the soaking method consistently yielded more DNA than the rinse-and-swab method from a non-metallic substrate. However, the comparison study demonstrated that both methods performed comparably for cartridges. On average, the soaking method recovered 0.25 ng of DNA (5.1% recovery) and the rinse-and-swab method recovered 0.28 ng (5.8% recovery). However, average recoveries were significantly different among three analysts and considerable variation in yields were observed, possibly due to storage time. Furthermore, consistent with prior reports, the DNA recovered from brass casings was only 16% of that recovered from nickel-plated casings and the average yield of DNA from fired casings was reduced to 67% of unfired casings. Moreover, DNA extracts from brass or nickel-plated casings did not appear to contain amplification inhibitors and only 30/596 appeared severely degraded. Finally, both the published rinse-and-swab and soaking methods yielded more DNA than all modifications of the two methods. Overall, both methods yielded equivalent DNA quantities. Additionally, recovery of DNA from any given cartridge casing may be dependent on storage time as well as the skill, proficiency, and experience of the analyst and may reflect stochastic effects, particularly for casings containing low copy and/or degraded DNA.

59 BASIC BIOLOGICAL SCIENCES↗

Integration of facility modeling capabilities for nuclear nonproliferation analysis

Developing automated methods for data collection and analysis that can facilitate nuclear nonproliferation assessment is an important research area with significant consequences for the effective global deployment of nuclear energy. Facility modeling that can integrate and interpret observations collected from monitored facilities in order to ascertain their functional details will be a critical element of these methods. Although improvements are continually sought, existing facility modeling tools can characterize all aspects of reactor operations and the majority of nuclear fuel cycle processing steps, and include algorithms for data processing and interpretation. Assessing nonproliferation status is challenging because observations can come from many sources, including local and remote sensors that monitor facility operations, as well as open sources that provide specific business information about the monitored facilities, and can be of many different types. Although many current facility models are capable of analyzing large amounts of information, they have not been integrated in an analyst-friendly manner. This paper addresses some of these facility modeling capabilities and illustrates how they could be integrated and utilized for nonproliferation analysis. The inverse problem of inferring facility conditions based on collected observations is described, along with a proposed architecture and computer framework for utilizing facility modeling tools. After considering a representative sampling of key facility modeling capabilities, the proposed integration framework is illustrated with several examples.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Assessment of HRA method predictions against operating crew performance: Part I: Study background, design and methodology

This is the first in a series of four papers document ing two large -scale human reliability analysis (HRA) empirical studies – the International HRA Empirical Study and the US HRA Empirical Study. The two studies are the first major efforts in recent years to benchmark HRA methods by comparing HRA method predictions against actual operator performance in accident scenarios simulated on nuclear power plant (NPP) simulators. When a met hod was applied by different analyst teams, the predictions of the different teams were also compared against each other. The purpose of the comparisons was to obtain insights concerning the strengths and weaknesses of the HRA methods addressed in the studies as well as the factors contributing to inter-analyst (or intra-method) variability. The background and motivation for the studies is first presented in the article. Then, the overall study design is described with a discussion on high-level tasks and participants. Next, the methodology to achieve the high-level tasks is discussed. Finally, concluding remarks are made concerning lessons learned on benchmarking HRA methods with crew performance of scenarios on NPP simulators.

97 MATHEMATICS AND COMPUTING↗

Assessment of HRA method predictions against operating crew performance: Part II: Overall simulator data, HRA method predictions, and intra-method comparisons

This is the third in a series of four papers documenting two large-scale human reliability analysis (HRA) empirical studies – the International HRA Empirical Study and the US HRA Empirical Study. Here, the goal of the two studies was to develop an empirically-based understanding of the performance, strengths, and weaknesses of HRA methods by comparing HRA method predictions against actual operator performance in simulated accident scenarios on nuclear power plant (NPP) simulators. However, since in most cases only a single HRA team applied a given method in the International study, it was often difficult to separate analyst effects from variability in results related to the methods themselves. Since at least two HRA teams used each of the HRA methods in the US Study, intra-method comparisons were performed to identify method strengths and weaknesses independent of analyst specific effects where possible. This paper first summarizes the intra-method comparison results from the U.S. Study. Then, it discusses the reasons for the observed HRA predictive differences and the underlying methodological and guidance limitations that permitted the differences to arise. In the fourth paper, this information is combined wit h the results of the comparisons of method predictions to the actual crew data, from both the International and U.S. Studies, to develop the final conclusions about overall strengths and weaknesses of HRA methods.

97 MATHEMATICS AND COMPUTING↗

Toward adaptive decision support for assessing infrastructure system resilience using hidden performance measures

The understanding of resilience is an emerging topic within the study of risks affecting distributed transportation infrastructure systems. Although recent studies have explored the quantification of system resilience, there has been limited research aimed at understanding the role of multiple performance measures, geographies, and modeling uncertainties within the assessment of resilience and associated decision-making. Under real-world conditions, there is an increased burden on analysts for translating observed system data (from human and electronic sensor observations) into the estimation of system performance that may not be directly observable. This paper addresses these issues using a scenario-based risk modeling approach to understand: 1) resilience of complex systems, often in cases of hidden (not readily observable) measures of performance, 2) resilience sensitivity to modeling uncertainties in event and system characteristics, and 3) resilience sensitivity to the measurement of performance across multiple dimensions. The methods in this paper integrate uncertainty-driven risk and probabilistic modeling within a multi-state Markov approach. This study contributes to the state-of-the-art by developing methodologies for assessing community perceptions of infrastructure system resilience using observable factors and inferring possibly hidden performance measures for facilitating adaptive decision-support. The methods are demonstrated with hypothetical spatiotemporal data for the Washington, District of Columbia and Baltimore, Maryland urban regions in the United States against evacuation-causing and shelter-in-place disruptive scenarios across multiple system performance dimensions. The analysis results may be useful for risk managers, supply chain analysts, emergency decision-makers, and the general public.

Infrastructure System Resilience, Risk Management,↗

A New Shutdown Dose Rate Benchmark Problem for Representative Fusion Applications

Here, this work introduces a new benchmark problem for calculating shutdown dose rates (SDDRs) aimed at fusion reactor applications. The model is designed to represent a simplified version of a typical ITER port plug. The responses of interest include neutron flux, gamma flux, and gamma SDDR at 12 different locations scattered throughout the port. This article outlines the geometry specifications of the problem, provides material definitions for the components, specifies the required responses to be calculated, and presents the source definition information. The need for this benchmark arises from the limited availability of publicly accessible references, with only one benchmark representing the typical dimensions and materials found in fusion systems. This existing benchmark has been cited extensively, reflecting the demand within the scientific community to test both established and novel workflows for SDDR calculations. However, since its presentation at a conference in 2011, the results have become increasingly well known. Moreover, the absence of formal publication and peer review has led to the details of this benchmark being extracted from secondary sources, such as subsequent studies that reference it. As a result, analysts are left with significant flexibility in interpreting the key parameters, which can be adjusted to account for unknown systematic errors, ultimately reproducing the already well-known responses. This new benchmark serves as an updated version of that earlier work, with the aim of providing a more reliable description of the materials and their impurities, which is crucial for assessing activation and subsequent gamma emission. Additionally, it seeks to provide a geometry that more closely represents an ITER port plug. The improvements in the problem definition will lead to a more reproducible benchmark problem, while also presenting the radiation transport community with a completely new challenge. The results will be published in a future article to allow analysts adequate time to analyze this problem independently.

Benchmark↗

Uncertainty quantification in the analyses of operational wind power plant performance

In the present work, we examine the variation introduced in the evaluation of an operating plant's wind power production as a result of the choices analysts make in the processing of the operational data. For this study, an idealized power production for individual turbines over an operational period was predicted by fitting power curves to the turbine production data collected during expected operation (that is, without curtailment or availability losses). A set of 240 possible methods were developed for (a) defining what data represented expected operation and (b) modeling the power curve. The spread in the idealized power production as predicted by the different methods was on average almost 3% for the 100 turbines considered. Such significant variation places a lower bound on the precision with which analysts may employ such data as benchmarks for calibration of their energy estimation processes and limits the potential for identification of refinements to the energy estimation models for improved accuracy.

17 WIND ENERGY↗

Evaluating Awkward Arrays, uproot, and coffea as a query platform for High Energy Physics Data

Query languages for High Energy Physics (HEP) are an ever present topic within the field. A query language that can efficiently represent the nested data structures that encode the statistical and physical meaning of HEP data will help analysts by ensuring their code is more clear and pertinent. As the result of a multi-year effort to develop an in-memory columnar representation of high energy physics data, the NumPy, Awkward Array, and uproot Python packages present a mature and efficient interface to HEP data. Atop that base, the coffea package adds functionality to launch queries at scale, manage and apply experiment-specific transformations to data, and present a rich object-oriented columnar data representation to the analyst. Recently, a set of Analysis Description Language (ADL) benchmarks has been established to compare HEP queries in multiple languages and frameworks. In this paper we present these benchmark queries implemented within the coffea framework and discuss their readability and performance characteristics. We find that the columnar queries perform as well or better than the implementations given in previous studies.

Gray, L.↗