Search NASA⌕ Search

SEARCH · Search NASA

Results for “human performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Human-System Interface Design Review Guidelines

The U.S. Nuclear Regulatory Commission (NRC) staff reviews the human factors engineering (HFE) aspects of nuclear power plants in accordance with the Standard Review Plan (NUREG-0800, Standard Review Plan for the Review of Safety Analysis Reports for Nuclear Power Plants: LWR Edition). The Human Factors Engineering Program Review Model (NUREG-0711, Revision 3, issued November 2012) contains detailed design review procedures. As part of the review process, the interfaces between plant personnel and the plant's systems and components are evaluated for conformance with HFE guidelines. This document, Human-System Interface Design Review Guidelines (NUREG-0700, Revision 3), provides the guidelines necessary to perform this evaluation. The review guidelines address the physical and functional characteristics of human-system interfaces (HSIs). Because these guidelines only address the HFE aspects of design and not other related considerations, such as instrumentation and control and structural design, they are referred to as HFE guidelines. In addition to the review of actual HSIs, the NRC staff can use the NUREG-0700 guidelines to evaluate a design-specific HFE guidelines document or style guide. The HFE guidelines are organized into four basic parts, which are divided into sections. Part I contains guidelines for the basic HSI elements: information displays, user-interface interaction and management, and analog displays and controls. These elements are used as building blocks to develop HSI systems to serve specific functions. Part II contains the guidelines for reviewing the following HSI systems: alarm system, safety parameter display system, group-view display system, soft control system, computer-based procedure system, automation system, and communication system. Part III provides guidelines for the review of workstations and workplaces. Part IV provides guidelines for the review of HSI support (i.e., maintainability of digital systems and degraded HSI and instrumentation and control conditions).

42 ENGINEERING↗

Performing Numerical Analysis of Cybersecurity Options Using Dynamic Risk Analysis Tool EMRALD

Cyberattacks can have many different attack paths, durations, and goals. There are also many different mitigation options involving hardware, software, and/or humans. Considering a cyber threat should involve defense-in-depth methods and a quantitative or numerical evaluation of overall effectiveness against dynamic, time-dependent attacks to make cost and risk-informed decisions. Typical cyberattack modeling methods only provide a qualitative evaluation. The main areas of cybersecurity are confidentiality, integrity, and availability. For companies with cyber-physical systems such as advanced nuclear reactors, cyber-related safety is a requirement set by North American Electric Reliability and the U.S. Nuclear Regulatory Commission. They are also concerned about availability or reliability as a business case. As cyber threats are evolving to a business-for-hire structure, more attacks may focus on disrupting business success and reliability, causing financial and economic stability risk. Companies want to know business reliability and recovery from those threats, and that requires modeling physical behavior of the targets. Dynamic-state-based and Markov-based modeling provides a method for better cyber scenario modeling with different tools having issues such as state-base explosion. Dynamic modeling enables time and conditional features not found in other numerical evaluation methods. EMRALD (Event Modeling Risk Assessment using Lined Diagrams) is a dynamic risk analysis modeling and simulation tool and has features that reduce modeling issues. It has been used to model different time-dependent events including plant behavior and operator procedures. As a general modeling tool, EMRALD can also be used to model cyberattack scenarios with varying mitigation options and quantify effectiveness, producing numerical data for risk-informed decisions. This paper uses EMRALD to demonstrate that dynamic numerical risk analysis can be used for cyber threat modeling to provide insights for design decision-making and optimize defense strategies. Keywords: cyber modeling; cyber-physical systems; numerical cyber modeling

97 - MATHEMATICS AND COMPUTING↗

Optimization of a Lethal, Combat-Relevant Model of Sterile Inflammation in Mice for Drug Candidate Screening

ABSTRACT Introduction Extensive trauma, commonly seen in wounded military Service Members, often leads to a severe sterile inflammation termed systemic inflammatory response syndrome (SIRS), which can progress to multiple organ dysfunction syndrome (MODS) and death. MODS is a serious threat to wounded Service Members, historically causing 10% of all deaths in trauma admissions at a forward deployed combat hospital. The importance of this problem will be exacerbated in large-scale combat operations, in which evacuation will be delayed and care of complex injuries at lower echelons of care may be prolonged. The main goal of this study was to optimize an existing mouse model of lethal SIRS/MODS as a therapeutic screening platform for the evaluation of immunomodulatory drugs. Materials and Methods Male C57BL/6 mice were euthanized, and the bones and muscles were collected and blended into a paste termed tissue–bone matrix (TBX). The TBX at 12.5%–20% relative to body weight of each recipient mouse was implanted into subcutaneous pouches created on the dorsum of anesthetized animals. Mice were observed for clinical scores for up to 48 hours postimplantation and euthanized at the preset point of moribundity. To test effects of anesthetics on TBX-induced mortality, animals received isoflurane or ketamine/xylazine (K/X). In a separate set of studies, mice received TBX followed by intraperitoneal injection with 20 mg/kg or 40 mg/kg Eritoran or a placebo carrier. All Eritoran studies were performed in a blinded fashion. Results We observed that K/X anesthesia significantly increased the lethality of the implanted TBX in comparison to inhaled anesthetics. Although all the mice anesthetized with isoflurane and implanted with 12.5% TBX survived for 24 hours, 60% of mice anesthetized with K/X were moribund by 24 hours postimplantation. To mimic more closely the timing of lethal SIRS/MODS following polytrauma in human patients, we extended observation to 48 hours. We performed TBX dose–response studies and found that as low as 15%, 17.5%, and 20% TBX caused moribundity/mortality in 50%, 80%, and 100% mice, respectively, over a 48-hour time period. With 17.5% TBX, we tested if moribundity/mortality could be rescued by anti-inflammatory drug Eritoran, a toll-like receptor 4 antagonist. Neither 20 mg/kg nor 40 mg/kg doses of Eritoran were found to be effective in this model. Conclusions We optimized a TBX mouse model of SIRS/MODS for the purpose of evaluating novel therapeutic interventions to prevent trauma-related pathophysiologies in wounded Service Members. Negative effects of K/X on lethality of TBX should be further evaluated, particularly in the light of widespread use of ketamine in treatment of pain. By mimicking muscle crush, bone fracture, and necrosis, the TBX model has pleiotropic effects on physiology and immunology that make it uniquely valuable as a screening tool for the evaluation of novel therapeutics against trauma-induced SIRS/MODS.

General & Internal Medicine↗

Exposing new taxonomic variation with inflammation — a murine model-specific genome database for gut microbiome researchers

The murine CBA/J mouse model widely supports immunology and enteric pathogen research. This model has illuminated Salmonella interactions with the gut microbiome since pathogen proliferation does not require disruptive pretreatment of the native microbiota, nor does it become systemic, thereby representing an analog to gastroenteritis disease progression in humans. Despite the value to broad research communities, microbiota in CBA/J mice are not represented in current murine microbiome genome catalogs. Here we present the first microbial and viral genomic catalog of the CBA/J murine gut microbiome. Using fecal microbial communities from untreated and Salmonella-infected, highly inflamed mice, we performed genomic reconstruction to determine the impacts on gut microbiome membership and functional potential. From high depth whole community sequencing (~ 42.4 Gbps/sample), we reconstructed 2281 bacterial and 4516 viral draft genomes. Salmonella challenge significantly altered gut membership in CBA/J mice, revealing 30 genera and 98 species that were conditionally rare and unsampled in non-inflamed mice. Additionally, inflamed communities were depleted in microbial genes that modulate host anti-inflammatory pathways and enriched in genes for respiratory energy generation. Our findings suggest decreases in butyrate concentrations during Salmonella infection corresponded to reductions in the relative abundance in members of the Alistipes. Strain-level comparison of CBA/J microbial genomes to prominent murine gut microbiome databases identified newly sampled lineages in this resource, while comparisons to human gut microbiomes extended the host relevance of dominant CBA/J inflammation-resistant strains. This CBA/J microbiome database provides the first genomic sampling of relevant, uncultivated microorganisms within the gut from this widely used laboratory model. Using this resource, we curated a functional, strain-resolved view on how Salmonella remodels intact murine gut communities, advancing pathobiome understanding beyond inferences from prior amplicon-based approaches. Salmonella-induced inflammation suppressed Alistipes and other dominant members, while rarer commensals like Lactobacillus and Enterococcus endure. The rare and novel species sampled across this inflammation gradient advance the utility of this microbiome resource to benefit the broad research needs of the CBA/J scientific community, and those using murine models for understanding the impact of inflammation on the gut microbiome more generally.

59 BASIC BIOLOGICAL SCIENCES↗

Benchmarking large language models for materials synthesis: The case of atomic layer deposition

In this work, we introduce an open-ended question benchmark, ALDbench, to evaluate the performance of large language models (LLMs) in materials synthesis, and, in particular, in the field of atomic layer deposition, a thin film growth technique used in energy applications and microelectronics. Our benchmark comprises questions with a level of difficulty ranging from the graduate level to domain expert current with the state of the art in the field. Human experts reviewed the questions along the criteria of difficulty and specificity, and the model responses along four different criteria: overall quality, specificity, relevance, and accuracy. We ran this benchmark on an instance of OpenAI’s GPT-4o. The responses from the model received a composite quality score of 3.7 on a 1–5 scale, consistent with a passing grade. However, 36% of the questions received at least one below average score. An in-depth analysis of the responses identified at least five instances of suspected hallucination. Finally, we observed statistically significant correlations between the difficulty of the question and the quality of the response, the difficulty of the question and the relevance of the response, the specificity of the question, and the accuracy of the response as graded by the human experts. Furthermore, this emphasizes the need to evaluate LLMs across multiple criteria beyond difficulty or accuracy.

Artificial intelligence↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

Tractometry of the Human Connectome Project: resources and insights

The Human Connectome Project (HCP) has become a keystone dataset in human neuroscience, with a plethora of important applications in advancing brain imaging methods and an understanding of the human brain. We focused on tractometry of HCP diffusion-weighted MRI (dMRI) data. We used an open-source software library (pyAFQ; https://yeatmanlab.github.io/pyAFQ) to perform probabilistic tractography and delineate the major white matter pathways in the HCP subjects that have a complete dMRI acquisition (n = 1,041). We used diffusion kurtosis imaging (DKI) to model white matter microstructure in each voxel of the white matter, and extracted tract profiles of DKI-derived tissue properties along the length of the tracts. We explored the empirical properties of the data: first, we assessed the heritability of DKI tissue properties using the known genetic linkage of the large number of twin pairs sampled in HCP. Second, we tested the ability of tractometry to serve as the basis for predictive models of individual characteristics (e.g., age, crystallized/fluid intelligence, reading ability, etc.), compared to local connectome features. To facilitate the exploration of the dataset we created a new web-based visualization tool and use this tool to visualize the data in the HCP tractometry dataset. Finally, we used the HCP dataset as a test-bed for a new technological innovation: the TRX file-format for representation of dMRI-based streamlines. We released the processing outputs and tract profiles as a publicly available data resource through the AWS Open Data program's Open Neurodata repository. We found heritability as high as 0.9 for DKI-based metrics in some brain pathways. We also found that tractometry extracts as much useful information about individual differences as the local connectome method. We released a new web-based visualization tool for tractometry—“Tractoscope” (https://nrdg.github.io/tractoscope). We found that the TRX files require considerably less disk space-a crucial attribute for large datasets like HCP. In addition, TRX incorporates a specification for grouping streamlines, further simplifying tractometry analysis.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying wildfire drivers and predictability in boreal peatlands using a two-step error-correcting machine learning framework in TeFire v1.0

Abstract. Wildfires are becoming an increasing challenge to the sustainability of boreal peatland (BP) ecosystems and can alter the stability of boreal carbon storage. However, predicting the occurrence of rare and extreme BP fires proves to be challenging, and gaining a quantitative understanding of the factors, both natural and anthropogenic, inducing BP fires remains elusive. Here, we quantified the predictability of BP fires and their primary controlling factors from 1997 to 2015 using a two-step correcting machine learning (ML) framework that combines multiple ML classifiers, regression models, and an error-correcting technique. We found that (1) the adopted oversampling algorithm effectively addressed the unbalanced data and improved the recall rate by 26.88 %–48.62 % when using multiple datasets, and the error-correcting technique tackled the overestimation of fire sizes during fire seasons; (2) nonparametric models outperformed parametric models in predicting fire occurrences, and the random forest machine learning model performed the best, with the area under the receiver operating characteristic curve ranging from 0.83 to 0.93 across multiple fire datasets; and (3) four sets of factor-control simulations consistently indicated the dominant role of temperature, air dryness, and climate extreme (i.e., frost) for boreal peatland fires, overriding the effects of precipitation, wind speed, and human activities. Our findings demonstrate the efficiency and accuracy of ML techniques in predicting rare and extreme fire events and disentangle the primary factors determining BP fires, which are critical for predicting future fire risks under climate change.

54 ENVIRONMENTAL SCIENCES↗

Building MCP-native hierarchical AI scientist ecosystems: a perspective on scaling multi-agent scientific discovery

Large language models (LLMs) are evolving from chatbots with limited tool-using capabilities to agentic AI systems that can perform deep research, assist in proposing hypotheses, help design experiments, automate data analysis, and draft scientific reports. However, there are currently two bottlenecks limiting LLMs' real-world impact on the broader scientific research community beyond academic demonstrations: lack of interoperability (repetitive manual tool-integration is required across scenarios) and the need for scalable coordination (unstructured communication and memory become brittle as the number of agents grows). In this Perspective, we argue that the next phase of agentic scientific discovery requires the development of an ecosystem of protocol-native agents and tools organized through hierarchies inspired by human society, beyond the current paradigm of a single monolithic “AI scientist”. We use Model Context Protocol (MCP) as a concrete example of an emerging interoperability layer for scientific tool and context exchange, and we propose three complementary pathways to increase the scaling capabilities of an MCP-native scientific ecosystem by addressing the composability issues: (1) MCP servers for high-value scientific tools maintained by domain experts, (2) automated transformation of existing code repositories into MCP services, and (3) autonomous invention and evolution of new agents and workflows. Finally, we provide a practical roadmap for scaling AI-driven scientific discovery by expanding tool supply and coordination in MCP-native scientific ecosystems.

97 MATHEMATICS AND COMPUTING↗

Physiological Characterization of Language Comprehension

In this project, our goal was to develop methods that would allow us to make accurate predictions about individual differences in human cognition. Understanding such differences is important for maximizing human and human-system performance. There is a large body of research on individual differences in the academic literature. Unfortunately, it is often difficult to connect this literature to applied problems, where we must predict how specific people will perform or process information. In an effort to bridge this gap, we set out to answer the question: can we train a model to make predictions about which people understand which languages? We chose language processing as our domain of interest because of the well- characterized differences in neural processing that occur when people are presented with linguistic stimuli that they do or do not understand. Although our original plan to conduct several electroencephalography (EEG) studies was disrupted by the COVID-19 pandemic, we were able to collect data from one EEG study and a series of behavioral experiments in which data were collected online. The results of this project indicate that machine learning tools can make reasonably accurate predictions about an individual?s proficiency in different languages, using EEG data or behavioral data alone.

42 ENGINEERING↗

4th Big Data for Nuclear Power Plants Workshop 2023

The Ohio State University and Idaho National Laboratory organized the 4 th Big Data for Nuclear Power Plants Workshop in November, 2023 in Columbus, Ohio. Workshop topics were chosen to understand the challenges and gaps that need to be addressed to maximize the impact of data on the nuclear industry, as well as the associated applications and risks. Discussions were focused around six specific application areas: Operation and Maintenance; Machine Learning in Nuclear Materials and Advanced Manufacturing; Cybersecurity; High-Performance Computing and Massive Computation; Big Data and Digital Twins; and Nuclear Non-Proliferation. The opportunities, challenges, and risks identified in the six focus areas explored in this workshop are diverse, but some common themes emerge, such as the importance of data integrity, quality, coverage, privacy, and traceability. Big data and AI/ML tools can be leveraged to reduce costs, optimize human tasking, and reduce human error across various application areas. In order for the nuclear industry to benefit from big data and advanced analytic capabilities, it is essential to address challenges and risks, such as data privacy, model reliability, and computational resource availability. Learning from other industries that have successfully implemented big data and AI/ML technologies, like the aerospace industry, can help the nuclear industry successfully integrate these technologies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Two MCNP Models for Computational Performance Benchmarking

The purpose of this report is to describe two non-trivial MCNP models and execution configurations that are suitable to characterizing computational performance. To that end, this report uses a constructive solid geometry (CSG) representation of the Oak Ridge National Laboratory (ORNL) Pool Critical Assembly (PCA) [1–3] to perform a k-eigenvalue calculation and an unstructured mesh (UM) representation of the International Commission on Radiological Protection (ICRP) publication 145 (ICRP145) male human phantom [4, 5] to perform a fixed-source calculation assuming that a 1 MeV photon source is distributed throughout the phantom’s liver.

97 MATHEMATICS AND COMPUTING↗

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗

Data-Enabled Fusion Technology (Final Scientific/Technical Report)

Advancing Scientific Understanding in Fusion Energy and Machine Learning This research represented a significant step forward in machine learning (ML) applications for fusion energy experiments. The project integrated advanced data-driven modeling, optimization techniques, and artificial intelligence to enhance the predictive capabilities and operational efficiency of plasma-based fusion systems. Specifically, tasks focused on ML-enhanced diagnostics, operator guidance tools, and predictive modeling helped improve the ability to interpret complex fusion experiments. Key areas of advancement included: 1) data-driven plasma control, i.e., using ML algorithms to optimize experimental conditions and classify plasma behaviors based on historical data; 2) spectroscopy and diagnostics, i.e., applying AI models to extract previously inaccessible insights from experimental spectroscopy data; and 3) configuration mapping and operator guidance, i.e., developing a predictive framework to assist scientists in identifying the most effective experimental parameters, reducing reliance on manual adjustments. By refining these ML-driven techniques, the project contributed to the broader scientific community’s understanding of plasma dynamics and fusion energy viability. Technical Effectiveness and Economic Feasibility The methods investigated demonstrated high technical effectiveness, as reflected in milestones assessing the predictive accuracy, performance, and optimization of fusion configurations. The development of an Operator Guidance Tool (OGT), for example, led to more precise control of plasma conditions by learning from experimental data and offering real-time adjustments. From an economic standpoint, DeFT provided: 1) the ability to reduce trial-and-error experimentation, which lowered operational costs; 2) improved data interpretation methods, which enabled more efficient resource allocation in large-scale fusion research projects; and 3) the automation of key diagnostic tasks, which reduced manual labor and human error, increasing overall efficiency. 13 The final assessments of predictive models and optimization strategies demonstrated that these approaches were scalable and could be implemented across multiple fusion energy research programs. Public Benefit and Societal Impact This project contributed directly to the broader goal of achieving sustainable and commercially viable fusion energy, which had profound implications for clean energy production and climate change mitigation. The integration of AI-driven solutions into fusion research: 1) sped up scientific discovery, accelerating progress towards achieving energy breakthroughs; 2) reduced the cost of experimentation, making fusion research more accessible; and 3) provided a framework for future AI applications in high-energy physics, benefiting adjacent fields like space exploration, material science, and renewable energy. Additionally, by fostering collaborations between AI researchers and plasma physicists, this project promoted interdisciplinary innovation that could lead to broader applications beyond fusion research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗

Digitalization mapping and assessment process supporting ION strategic transformation activities

The existing fleet of commercial nuclear power plants (NPPs) are an important asset in the nation’s portfolio of electrical generating resources. Their continued safe and reliable operation are critical to providing a large source of carbon-free electricity to power the nation’s economy. The United States Department of Energy’s (DOE) Light Water Reactor Sustainability (LWRS) Program develops the scientific bases, methods, and tools, for the continued safe and economical operation of the nation's commercial NPPs. The Plant Modernization Pathway within LWRS Program focuses on providing guidance to industry on the full-scale implementation of modernization solutions for NPPs that significantly reduce the technical and financial risks associated with modernization. This research is focused on helping the nuclear industry understand how to digitize and digitalize their NPPs so that they can design their modernization solutions to be scalable, sustainable, and integrated both laterally and horizontally within their organization. That is, this research creates a digital transformation in NPPs by reshaping cultural mindsets and by identifying business efficiencies. In partnership with industry, and using four previously established guiding principles for digitalization, this research supported NPP modernization through assessing readiness for digitalization as a means to achieve integrated operations for nuclear. Specifically, this research created an assessment to review an entire organization’s work processes to gather information about the digitalization health of the plant. The assessment tools were administered to plant employees, and the results were used to develop a digitalization plan. The survey assessment identified the optimal candidate processes that would most benefit from a digitalization initiative which were revealed through analytical frameworks. One analysis calculated mean digitalization health indicator scores for all endorsed activities which allowed the researchers to rank and color code the results for easy identification. Individual health indicator scores are also provided, should our industry partner wish to understand these findings according to their own organizational priorities, business considerations and desired end-state. The results were also analyzed from the perspective that organizations are comprised of different types of innovators (e.g., generators, optimizers, conceptualizers, and implementers), which differentially affects the organization’s ability to comprehend and adapt to change (i.e., opportunities to innovate). Understanding the relative composition of innovator types at an NPP allows them to gather insights into the strengths and weaknesses they have in innovating how work is performed. For the utility that partnered with this research team, the results showed that implementers make up the largest portion of respondents and conceptualizers the smallest portion. Knowing the proportion of innovator types gave this organization insights on how they can effectively implement their innovation solutions. Additionally, the results were analyzed from a technical, economic, and risk perspective to identify and quantify work reduction opportunities (WROs). Recognizing that not all cost-saving opportunities are the same, a Technical, Economic and Risk Assessment (TERA) was performed to evaluate WROs to identify areas of greatest potential and lowest risk. The key results from TERA included a digitalization opportunity score for each activity, and a calculation of potential cost savings. These two outputs formed the bases for calculating a priority index and rank for the activities/processes assessed. From the prioritization calculations, TERA can then help the utility 1) decide what digitalization priorities to invest money in implementing and then 2) calculates how much should be invested in the digitalization initiatives selected to achieve cost savings and/or an acceptable return on investment. Last, onsite interviews revealed several inefficiencies in the standard work processes that occur cross-departmentally that are due to the absence of digitized and digitalized processes. Examples of these include time spent scanning paper documents and then uploading the documents electronically, obtaining signatures, and searching for desired information. This represents a digital but not digitalized process. Over 15 opportunities to improve work processes were identified through this multi-method digitalization assessment. The various analytical assessments used (e.g., TERA, digitalization health indicator scores), as well as discussions with the utility partner, corroborated that all the opportunities identified had a strong potential to make work processes more efficient and to improve overall performance of the NPP.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

CY2019 Annual Closure Monitoring Report for Corrective Action Unit 98, Frenchman Flat, Underground Test Area, Nevada National Security Site, Nevada (January 2019–December 2019), Revision 1

Three types of monitoring are performed for CAU 98: water quality, water level, and institutional control. These are monitored to determine whether the URs remain protective of human health and the environment, and to ensure that the regulatory boundary objectives are being met. Monitoring data will be used in the future, once multiple years of data are available, to evaluate consistency with the groundwater flow and contaminant transport models because the contaminant boundaries calculated with the models are the primary basis of the UR boundaries. Six wells were sampled for water-quality monitoring in 2019. Contaminants of concern were detected only in the two source/plume wells already known to contain contamination as a result of a radionuclide migration experiment. Tritium concentrations in both of these wells, RNM-2S and UE-5n, remain above the Safe Drinking Water Act maximum contaminant level of 20,000 picocuries per liter but declined in 2019 as compared to measurements in 2018. All other contaminants of concern are below the minimum detection level plus analytical error. The water-level monitoring network includes 16 wells. Depth to water measured in 2019 is generally consistent with recent measurements for all wells. Many wells continue to exhibit a long-term downward trend in water level, though changes from 2018 to 2019 are minimal. The sharp 2016 decline in water level in Well ER-5-3-2 remains unexplained, with the lower level persisting through 2019. Rising water-level trends continue to be observed in Well ER-5-3 deep piezometer and former water supply Well WW-5A. Water supply Well WW-5B experienced a rise in water level as a result of an absence of pumping in the first part of the year (due to a mechanical problem), whereas water levels declined in WW-4 and WW-4A in response to greater pumping in 2019. Institutional control monitoring confirmed the URs are recorded in U.S. Department of Energy and U.S. Air Force land management systems, and that no activities within Frenchman Flat basin are occurring that could potentially affect the contaminant boundaries. Survey of groundwater resources in basins surrounding Frenchman Flat similarly identify no current or pending development that would indicate the need to increase monitoring activities or would otherwise cause concern for the closure decision. The URs continue to prevent exposure of the public, workers, and the environment to contaminants of concern by preventing use of potentially contaminated groundwater.

54 ENVIRONMENTAL SCIENCES↗

HOP and Cybersecurity: Leveraging safety and reliability experience to improve digital security culture

This presentation will introduce participants to key mental models on how to think about and understand safety and the organizational attributes that support it from three of the leading voices in the discipline – David Marx, Dr. Erik Hollnagel and Dr. Todd Conklin – and from there we ask the simple question of “how can we apply this to cybersecurity?” Opportunities, similarities, and differences from the history of accomplishment applying human and organizational performance principles to safety and reliability can be collectively leveraged to the meet the challenge of cybersecurity for OT/ICS/cyber-physical systems. This is the same intent as the "Cybersecurity Culture" principle of Cyber-Informed Engineering (CIE).

42 ENGINEERING↗