Search NASA⌕ Search

SEARCH · Search NASA

Results for “usability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

Systematization of Password Manager Use Cases and Design Paradigms

Despite efforts to replace them, passwords remain the primary form of authentication on the web. Password managers seek to address many of the problems with passwords by helping users generate, store, and fill strong and unique passwords. Even though experts frequently recommend password managers, there is limited information regarding their usability. To aid in designing such usability studies, we systematize password manager use cases, identifying ten essential use cases, three recommended use cases, and four extended use cases. We also systematize the system designs employed to satisfy these use cases, designs that should be examined in usability studies to understand their relative strengths and weaknesses. Finally, we describe observations from 136 cognitive walkthroughs exploring the identified essential use cases in eight popular managers. Ultimately, we expect that this work will serve as the foundation for an explosion of new research into the usability of password managers.

Simmons, James↗

Soft Robotic Glove System for Wearable Haptic Teleoperation - 18373

Managing nuclear waste is a difficult, dangerous, and costly task. Teleoperation of robotic operators is an important functionality for this application, allowing robotic devices to operate in dangerous environments while still leveraging the existing abilities and technical knowledge of human workers. One difficulty in implementing effective teleoperation systems is that human operators rely on more senses beside sight: in particular, touch. The sense of touch could provide significant benefits for teleoperation, preventing environmental mishaps that could cost millions of dollars. To help remedy this problem, we present a soft haptic feedback glove system. The primary functionality of this system is to provide tactile and force feedback on the user's hands. This was achieved using custom cylindrical pneumatic actuators. These actuators consist of plastic sheeting folded into a hollow-walled cylinder which is connected to a pressure source. When pressurized, the cylinder walls expand and the cylinder straightens, with the force being related to the pressure. The glove system has one of these actuators over each of the user's three main fingers (index, middle, and thumb), where pressurizing the actuator applies a reaction force to the finger of the user, mimicking the resistance of a grasped object. The expansion of these actuators also causes them to physically press against the user's fingers, giving them the feeling of contact. To demonstrate the usability of this system, we implemented a virtual environment in V-REP simulating the interactions between a robotic Jaco Arm and a floating ball. This simulation receives hand and figure positions from the haptic glove and used them to drive the state of the simulated Jaco Arm. In response to the interactions between the Jaco and the floating ball, the simulation returns commands to the glove, instructing it to pressurize or depressurize its actuators as appropriate, allowing the user to feel the ball in their hand. We tested users in their ability to prevent the ball from floating away using this system with and without the haptic feedback. Results show that the addition of haptic feedback significantly improved the ability of users to interact precisely with the environment. We also used the finger positions of the haptic glove to control a physical robotic hand, and demonstrated the system's usability for control of real robots, though the lack of sensors on the robot made providing the tactile feedback impractical. However, there is more to grasping and holding an object than just the feeling of contact and the resistance to closing one's hand. The weight of the object will apply forces to the user's other joints as they hold it. To this end, we added a haptic feedback device for the user's wrist, a technique that can be generalized to the user's other joints. This is made up of reverse Pneumatic Artificial Muscles (rPAMs) stretching across the wrist between mounts on the hand and forearm. These rPAM actuators are tubes of silicone wrapped in thread such that they extend when pressurized. This extension can apply torque on the user's wrist, mimicking the feeling of gravity, or allowing the simulation of additional contact forces (such as the user's hand impacting an object). We tested this wrist device independently using a simulated path-following experiment. Users showed a significant improvement in performance when aided by haptic feedback during sinusoidal path experiments, demonstrating the usability of this approach. We then integrated the two systems, further demonstrating the usability of this approach. This project represents the first step towards a more effective robotic teleoperation system, allowing skilled human workers to perform tasks more effectively while remaining out of danger. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Improving the User Interface of the DeepLynx Data Warehouse

DeepLynx is an open-source ontology-based data warehouse created by INL to support the creation and life cycle of digital engineering projects, with a particular emphasis on digital twins [1]. Digital twins are systems that represent physical assets and process in a real-time digital environment [1]. Most well-known commercial data warehouses use Graphical User Interfaces (GUIs) for users to interact with their systems [3]. Limited publications have addressed the design of these interfaces and understanding of their target users. The current users and development team acknowledge the need to improve the current UI, not just for aesthetics but to improve functionality and workflow of DeepLynx. Traditional data warehouse users are developers, data scientists and business analysts [2]. DeepLynx users have a vast range of experience using data warehouses, and diverse roles, including engineers, scientists and management positions. Because there is a broader audience of target users for DeepLynx than a typical data warehouse, it is essential that DeepLynx has a useable and intuitive user interface. To achieve this the team performed human-computer interaction methods, including a Heuristic Evaluation of current UI using Neilsen’s Usability Heuristic, create personas based on current users by designing a user survey, data analysis and develop of personas. Followed by a redesign of the UI following using Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design in industry standard software Figma. Lastly a Heuristic Evaluation of new UI design, using Neilsen’s Usability Heuristic and User testing of redesign UI and have a group of users complete a Thinking Aloud Test of the new UI. Preliminary results of the Heuristic Evaluation of current UI arise issue with Consistency and Standards, Visibility of System Status, Match System and Real World and Recognition Rather than Recall. These issues were addressed in the proposed redesign by applying Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design. Next steps include formalized list of lessons learned and design implications for future publications.

97 MATHEMATICS AND COMPUTING↗

User-Centered Evaluation of Visual Analytics

Visual analytics systems are becoming very popular. More domains now use interactive visualizations to analyze the ever-increasing amount and heterogeneity of data. More novel visualizations are being developed for more tasks and users. We need to ensure that these systems can be evaluated to determine that they are both useful and usable. A user-centered evaluation for visual analytics needs to be developed for these systems. While many of the typical human-computer interaction (HCI) evaluation methodologies can be applied as is, others will need modification. Additionally, new functionality in visual analytics systems needs new evaluation methodologies. There is a difference between usability evaluations and user-centered evaluations. Usability looks at the efficiency, effectiveness, and user satisfaction of users carrying out tasks with software applications. User-centered evaluation looks more specifically at the utility provided to the users by the software. This is reflected in the evaluations done and in the metrics used. In the visual analytics domain this is very challenging as users are most likely experts in a particular domain, the tasks they do are often not well defined, the software they use needs to support large amounts of different kinds of data, and often the tasks last for months. These difficulties are discussed more in the section on User-centered Evaluation. Our goal is to provide a discussion of user-centered evaluation practices for visual analytics, including existing practices that can be carried out and new methodologies and metrics that need to be developed and agreed upon by the visual analytics community. The material provided here should be of use for both researchers and practitioners in the field of visual analytics. Researchers and practitioners in HCI and interested in visual analytics will find this information useful as well as a discussion on changes that need to be made to current HCI practices to make them more suitable to visual analytics. A history of analysis and analysis techniques and problems is provided as well as an introduction to user-centered evaluation and various evaluation techniques for readers from different disciplines. The understanding of these techniques is imperative if we wish to support analysis in the visual analytics software we develop. Currently the evaluations that are conducted and published for visual analytics software are very informal and consist mainly of comments from users or potential users. Our goal is to help researchers in visual analytics to conduct more formal user-centered evaluations. While these are time-consuming and expensive to carryout, the outcomes of these studies will have a defining impact on the field of visual analytics and help point the direction for future features and visualizations to incorporate. While many researchers view work in user-centered evaluation as a less-than-exciting area to work, the opposite is true. First of all, the goal is user-centered evaluation is to help visual analytics software developers, researchers, and designers improve their solutions and discover creative ways to better accommodate their users. Working with the users is extremely rewarding as well. While we use the term “users” in almost all situations there are a wide variety of users that all need to be accommodated. Moreover, the domains that use visual analytics are varied and expanding. Just understanding the complexities of a number of these domains is exciting. Researchers are trying out different visualizations and interactions as well. And of course, the size and variety of data are expanding rapidly. User-centered evaluation in this context is rapidly changing. There are no standard processes and metrics and thus those of us working on user-centered evaluation must be creative in our work with both the users and with the researchers and developers.

intelligence analysis↗

Novel Acid Catalysts from Waste-Tire-Derived Carbon: Application in Waste-to-Biofuel Conversion

Many inexpensive biofuel feedstocks, including those containing free fatty acids (FFAs) in high concentrations, are typically disposed of as waste due to our inability to efficiently convert them into usable biofuels. Here we demonstrate that carbon derived from waste tires could be functionalized with sulfonic acid (-SO 3 H) to effectively catalyze the esterification of oleic acid or a mixture of fatty acids to usable biofuels. Waste tires were converted to hard carbon, then functionalized with catalytically active -SO 3 H groups on the surface through an environmentally benign process that involved the sequential treatment with L-cysteine, dithiothreitol, and H 2 O 2 . In conclusion, when benchmarked against the same waste-tire derived carbon material treated with concentrated sulfuric acid at 150 °C, similar catalytic activity was observed. Both catalysts could also effectively convert oleic acid or a mixture of fatty acids and soybean oil to usable biofuels at 65 °C and 1 atm without leaching of the catalytic sites.

09 BIOMASS FUELS↗

Evaluation of Visualization Heuristics

Heuristics have been used since the early 1990's in the Human Computer Interaction (HCI) domain, for evaluating user interfaces. Most notably, heuristics developed by Nielsen and Molich (1990) have been used by the HCI community. Forsell and Johansson (2010) used the same methodology as Nielsen and Molich and developed a set of 10 heuristics for information visualization. Currently, neither the information visualization or the visual analytics community has adopted these heuristics. However, several studies have been conducted using heuristics. Hearst et al. (2015) found that using the heuristics for visualizations along with asking questions about the data resulted in complementary results as the questions about the data could compensate for heuristics that were difficult to understand and apply. Heli Väätäjä et al. (2016) found that heuristics related to interaction, veracity, and aesthetics needed to be added to the Forsell and Johansson (2010) set. They also noted that a lack of domain knowledge caused the evaluators issues in conducting a heuristic evaluation. We conducted a controlled experiment to determine what factors might impact the expert evaluators' capability to conduct a heuristic evaluation of a static information visualization. In particular, we wanted to understand how their familiarity with the visualizations and their experience in conducting heuristic evaluations impacted their evaluations of visualizations. We recruited 10 participants who were domain experts in the visualization field each having experience with one of more of the following: user experience design or research, user interface development, and human computer interaction research. We used a heuristic set proposed by Forsell and Johansson. Participants were also asked to complete a demographic survey in which they rated their experience with each visualization type generally, their experience conducting heuristic evaluations, their experience using each visualization type to extract information, and their experience developing and creating each visualization type. The participants were shown a series of 5 common visualizations (Scatterplots, Sunbursts, Tree Maps, Parallel Sets, and Area Graphs) all displaying the VAST 2008 Mini Challenge Two- Migrant Boats data . Participants were given a suggested analytical question related to each visualization to keep in mind as they applied the 10 heuristics to each visualization. They were asked if they could find any usability problems in the visualizations and which heuristic(s) helped them to identify these problems. The participants were asked to rate how relevant each heuristic was for evaluating each visualization along with rating how confident they felt in their ability to apply the heuristic to evaluate each visualization. At the conclusion of the study, participants provided qualitative feedback on the usability issues of each visualization. Additionally, we collected eye tracking data on 6 of the 10 participants. We will be using this data to determine how long participants looked at the various visualizations and what parts of the visualizations they focused on. We had two hypotheses for this empirical evaluation: 1.The Forsell and Johansson heuristics of Orientation and help, Data set reduction, and Prompting are less useful for static visualizations because they require some interaction in order to test completely. 2.Participants that do not have experience with heuristic evaluation will provide lower evaluation scores for the heuristics compared to those that have experience. Related to hypothesis 1, as our study used only static visualizations, interaction-related usability challenges should be harder to identify. This should result in lower usefulness ratings for those heuristics. Preliminary results indicate that participants found it more difficult to apply heuristics to unfamiliar visualizations.

Williams, Ryan G.↗

Modeling the impact of extreme summer drought on conventional and renewable generation capacity: Methods and a case study on the Eastern U.S. power system

Across recent years, there has been a growing prevalence of extreme weather events throughout the United States, posing significant challenges to the reliable and resilient operation of power systems. Specifically, summer droughts threaten to severely reduce available generation capacity to meet regional electricity demand, potentially leading to power outages. This underscores the importance of accurate resource adequacy (RA) assessment to ensure the reliable operation of the nation’s energy infrastructure. Accurately evaluating the usable capacity of regional generation fleets is a challenging undertaking due to the intricate interactions between power systems and hydro-climatic systems. Here, this paper proposes a systematic and analytical framework to evaluate the impacts of extreme summer drought events on the available capacity of various generating technologies, incorporating both meteorological and hydrologic factors. The framework provides detailed plant-level capacity derating models for hydroelectric, thermoelectric, and renewable power plants, facilitating evaluations with high temporal and spatial resolution. The application of the proposed impact assessment framework to the 2025 generation fleet of the real-world power system within the PJM and SERC regions of the United States yields insightful results. By analyzing the daily usable capacity of 6,055 at-risk generators across the study region, it shows that the summer capacity deration is most significant for hydroelectric and once-through thermal power plants, followed by recirculating thermal power plants and combustion turbines. In the event of the recurrence of the 2007 southeastern summer drought event in the near future, the generation fleet could experience a substantial reduction in available capacity, estimated at approximately 8.5 GW, compared to typical summer conditions. The sensitivity analysis reveals that the usable capacity of the generation fleet would suffer an even more significant decrease under conditions of increasingly severe summer droughts. The proposed approach and the findings of this study provide valuable methodologies and insights, empowering stakeholders to bolster the resilience of power systems against the potentially devastating effects of future extreme drought events.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Retrofitting stoves with forced jets of primary air improves speed, emissions, and efficiency: Evidence from six types of biomass cookstoves

Incorporating jets of forced air into biomass cookstove combustion has been shown to potentially decrease harmful emissions, leading to a variety of designs in recent years. These have shown mixed success in terms of real-world performance, usability, and durability. The Jet-Flame forced draft retrofit accessory was recently developed to implement forced jets of primary air at a low cost into a wide range of types of cookstoves using a small 1.5-W fan housed in a low-cost cast iron body to be inserted beneath the fuel bed of a biomass cooking fire. This research sought to quantify the potential efficiency and emissions performance impacts of the Jet-Flame when installed in six different types of biomass cookstoves (three open or shielded fires and three rocket stoves) versus the natural draft performance of each. The effect of the operating fan voltage was also measured. A series of tests following a modified ISO 19867-1:2018 protocol were performed in the laboratory using the Aprovecho Laboratory Emissions Measurement System (LEMS) equipped with additional oxygen and temperature sensors. Results for each stove carefully tended with a single layer of sticks showed that the global average PM 2.5 reduction with the Jet-Flame was 89 % relative to the natural draft cases, with larger relative improvements seen in the most rudimentary stoves. CO was reduced by a global average of 74 %, reaching tier 4 or 5 for all stoves. Thermal efficiency was also improved by 34 % when calculated without taking into account the energy content of the remaining char (or 21 % with char), illustrating the value of burning char to provide cooking energy rather than leaving it unburned in the combustion chamber as is common in many natural draft stoves. Time to boil was also reduced by 8 %. In addition, adjusting the voltage of the jet-flame assisted in modulating firepower, improving the usability of the stove. These results indicate a strong potential for the Jet-Flame to help reduce emissions and fuel consumption in a wide range of cookstove designs at a relatively low cost or need for changes in behavior, fuel, or cooking device. The unit also provides enhanced usability in terms of ease of startup, cooking speed, low PM emissions at high power, and burning char. Additional studies are needed to measure performance in the field and under a variety of operational conditions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Reproducibility of Tumor Motion Probability Distribution Function in Stereotactic Body Radiation Therapy of Lung Cancer

Purpose: To evaluate the reproducibility of tumor motion probability distribution function (PDF) in stereotactic body radiation therapy (SBRT) of lung cancer using cine megavoltage (MV) images. Methods and Materials: Cine MV images of 20 patients acquired during three-dimensional conformal (6-11 beams) SBRT treatments were retrospectively analyzed to extract tumor motion trajectories. For each patient, tumor motion PDFs were generated per fraction (PDF{sub n}) using three selected 'usable' beams. Patients without at least three usable beams were excluded from the study. Fractional PDF reproducibility (R{sub n}) was calculated as the Dice similarity coefficient between PDF{sub n} to a 'ground-truth' PDF (PDF{sub g}), which was generated using the selected beams of all fractions. The mean of R{sub n}, labeled as R{sub m}, was calculated for each patient and correlated to the patient's mean tumor motion rang (A{sub m}). Change of R{sub m} during the course of SBRT treatments was also evaluated. Intra- and intersubject coefficient of variation (CV) of R{sub m} and A{sub m} were determined. Results: Thirteen patients had at least three usable beams and were analyzed. The mean of R{sub m} was 0.87 (range, 0.84-0.95). The mean of A{sub m} was 3.18 mm (range, 0.46-7.80 mm). R{sub m} was found to decrease as A{sub m} increases following an equation of R{sub m} = 0.17e{sup -0.9Am} + 0.84. R{sub m} also decreased slightly throughout the course of treatments. Intersubject CV of R{sub m} (0.05) was comparable to intrasubject CV of R{sub m} (range, 0.02-0.09); intersubject CV of A{sub m} (0.73) was significantly greater than intrasubject CV of A{sub m} (range, 0.09-0.24). Conclusions: Tumor motion PDF can be determined using cine MV images acquired during the treatments. The reproducibility of lung tumor motion PDF decreased exponentially as the tumor motion range increased and decreased slightly throughout the course of the treatments.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Lowering entry barriers to developing custom simulators of distributed applications and platforms with SimGrid

Researchers in parallel and distributed computing (PDC) often resort to simulation because experiments conducted using a simulator can be for arbitrary experimental scenarios, are less resource-, labor-, and time-consuming than their real-world counterparts, and are perfectly repeatable and observable. Many frameworks have been developed to ease the development of PDC simulators, and these frameworks provide different levels of accuracy, scalability, versatility, extensibility, and usability. Further, the SimGrid framework has been used by many PDC researchers to produce a wide range of simulators for over two decades. Its popularity is due to a large emphasis placed on accuracy, scalability, and versatility, and is in spite of shortcomings in terms of extensibility and usability. Although SimGrid provides sensible simulation models for the common case, it was difficult for users to extend these models to meet domain-specific needs. Furthermore, SimGrid only provided relatively low-level simulation abstractions, making the implementation of a simulator of a complex system a labor-intensive undertaking. In this work we describe developments in the last decade that have contributed to vastly improving extensibility and usability, thus lowering or removing entry barriers for users to develop custom SimGrid simulators.

97 MATHEMATICS AND COMPUTING↗

Exceptional hydrogen storage achieved by screening nearly half a million metal-organic frameworks

Few hydrogen adsorbents balance high usable volumetric and gravimetric capacities. Although metal-organic frameworks (MOFs) have recently demonstrated progress in closing this gap, the large number of MOFs has hindered the identification of optimal materials. Here, a systematic assessment of published databases of real and hypothetical MOFs is presented. Nearly 500,000 compounds were screened computationally, and the most promising were assessed experimentally. Three MOFs with capacities surpassing that of IRMOF-20, the record-holder for balanced hydrogen capacity, are demonstrated: SNU-70, UMCM-9, and PCN-610/NU-100. Analysis of trends reveals the existence of a volumetric ceiling at ~ 40 g H 2 L -1 . Surpassing this ceiling is proposed as a new capacity target for hydrogen adsorbents. Counter to earlier studies of total hydrogen uptake in MOFs, usable capacities in the highest-capacity materials are negatively correlated with density and volumetric surface area. Instead, capacity is maximized by increasing gravimetric surface area and porosity. This suggests that property/performance trends for total capacities may not translate to usable capacities.

36 MATERIALS SCIENCE↗

Overview of the interactive task in BioCreative V

Fully automated text mining (TM) systems promote efficient literature searching, retrieval, and review but are not sufficient to produce ready-to-consume curated documents. These systems are not meant to replace biocurators, but instead to assist them in one or more literature curation steps. To do so, the user interface is an important aspect that needs to be considered for tool adoption. The BioCreative Interactive task (IAT) is a track designed for exploring user-system interactions, promoting development of useful TM tools, and providing a communication channel between the biocuration and the TM communities. In BioCreative V, the IAT track followed a format similar to previous interactive tracks, where the utility and usability of TM tools, as well as the generation of use cases, have been the focal points. The proposed curation tasks are user-centric and formally evaluated by biocurators. In BioCreative V IAT, seven TM systems and 43 biocurators participated. Two levels of user participation were offered to broaden curator involvement and obtain more feedback on usability aspects. The full level participation involved training on the system, curation of a set of documents with and without TM assistance, tracking of time-on-task, and completion of a user survey. Here, the partial level participation was designed to focus on usability aspects of the interface and not the performance per se. In this case, biocurators navigated the system by performing pre-designed tasks and then were asked whether they were able to achieve the task and the level of difficulty in completing the task. In this manuscript, we describe the development of the interactive task, from planning to execution and discuss major findings for the systems tested.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Machine Learning Based Network Parameter Estimation Using AMI Data

The expansion of distribution power system and the growing penetration of distributed energy resources present new challenges for situational awareness. Calibrating the extended system model with sensor measurements and maintaining the usability is critical for utilities. This paper presents a distribution network parameter estimation (DNPE) approach using machine learning (ML) and metering data that improve the quality of extended distribution power system modeling. The reliability model can improve the ability of endpoint data to be translated into network-level situational awareness in real time and help distribution system operators (DSOs) solve branch flow and voltage problems. In addition, a data analytic and automate processing scheme is proposed to improve the sensor data quality and prevent misleading information. The effectiveness of the proposed method is verified with actual advanced metering infrastructure (AMI) data on a real utility feeder model, while considering the higher penetration of photovoltaic power generation. The test of DNPE and study results are demonstrated in this paper.

Parameter estimation, machine learning, power dist↗

Method to Investigate Cognitive Aging Effects in Nuclear Operations Using the Rancor Microworld Simulator

Many nuclear power plant (NPP) operators are close to, or at retirement age. Since NPP operators are responsible for tasks that engage different and complex cognitive abilities, human factors researchers recently called for the need to examine cognitive aging effects and potential interactions with modernized control rooms. One way control rooms are being modernized is by replacing paper-based procedures with computer-based procedures (CBPs). This paper outlines a method for testing preference and usability of three types of CBPs as a function of age, in simulated NPP operations. The Rancor Microworld Simulator will be used, which mimics an NPP control room, allowing novices to learn to perform operator tasks quickly. The experiment will have two independent variables: age (young and old) and CBP-type (Type 1, Type 2, and Type 3). The three types of CBPs vary in levels of embedded instrumentation and controls. Adults aged 18–25 years (young group) and =60 years (older group) will be recruited from the general population. The dependent variables will be preference and usability metrics via survey and simulator logs. All participants will perform two scenario types (startup and loss of feedwater operations) and will be randomly assigned to one type of CBP to guide them through the scenario. Analyses of variance (ANOVAs) will be used to determine whether there is a main effect of age and any age x CBP-type interactions on the preference and usability dependent variables.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Investigating User Experiences with Data Abstractions on High Performance Computing Systems

Scientific exploration generates expanding volumes of data that commonly require High Performance Computing (HPC) systems to facilitate research. HPC systems are complex ecosystems of hardware and software that frequently are not user friendly. The Usable Data Abstractions (UDA) project set out to build usable software for scientific workflows in HPC environments by undertaking multiple rounds of qualitative user research. Qualitative research investigates how individuals accomplish their work and our interview-based study surfaced a variety of insights about the experiences of working in and with HPC ecosystems. This report examines multiple facets to the experiences of scientists and developers using and supporting HPC systems. We discuss how stakeholders grasp the design and configuration of these systems, the impacts of abstraction layers on their ability to successfully do work, and the varied perceptions of time that shape this work. Examining the adoption of the Cori HPC at NERSC we explore the anticipations and lived experiences of users interacting with this system’s novel storage feature, the Burst Buffer. We present lessons learned from across these insights to illustrate just some of the challenges HPC facilities and their stakeholders need to account for when procuring and supporting these essential scientific resources to ensure their usability and utility to a variety of scientific practices.

97 MATHEMATICS AND COMPUTING↗

Enhancing the Useability of the IAEA's Physical Model: An Analysis of User Feedback

This study presents the results of Physical Model user interviews conducted with 12 people who have International Atomic Energy Agency (IAEA) safeguards experience. The goal of this report is to provide additional context for policy makers when prioritizing the needs of the IAEA regarding support for enhancements to the Physical Model. The interviews covered the general usability of the Physical Model, its effectiveness as a technical reference, and the scope and utility of the Physical Model's indicators and content. The key conclusions from these interviews are as follows: 1) The Physical Model is difficult to find and not well advertised. 2) The Physical Model can be difficult to use due to its format, which makes searching for information difficult, and lack of visual content. Therefore, the Physical Model should be supported in multiple formats (print, PDF, web) to maximize its usability for different stakeholders. 3) The scope of the Physical Model's content and indicators is likely sufficient, and translating indicators into other languages is unlikely to be worth the effort. 4) Despite its inefficiencies and other issues, the Physical Model in its current form is a vital (albeit under-utilized) resource for key stakeholders. 5) Despite its broad use case the Physical Model is not a catch-all tool and force-fitting the Physical Model into functions for which it has not been designed for would likely diminish its value. 6) It can be difficult to disentangle challenges related to the Physical Model and its usability from broader challenges at the Agency, such as general issues with communication and coordination. Based on these conclusions and considering the results of past studies on the Physical Model funded by NA-241, the analysis team developed a list of recommendations and associated actions for IAEA consideration. These recommendations are prioritized based on the assessed level of difficulty for the IAEA to implement a recommendation, emphasizing low hanging fruit then building to more ambitious changes to the Physical Model's format and content.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗