Search NASA⌕ Search

SEARCH · Search NASA

Results for “usability experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Liquid Metal Walls, Lithium, And Low Recycling Boundary Conditions In Tokamaks

At present, the only solid material believed to be a viable option for plasma-facing components (PFCs) in a fusion reactor is tungsten. Operated at the lower temperatures typical of present-day fusion experiments, tungsten is known to suffer from surface degradation during long-term exposure to helium-containing plasmas, leading to reduced thermal conduction to the bulk, and enhanced erosion. Existing alloys are also quite brittle at temperatures under 700oC. However, at a sufficiently high operating temperature (700 - 1000 oC), tungsten is selfannealing and it is expected that surface damage will be reduced to the point where tungsten PFCs will have an acceptable lifetime in a reactor environment. The existence of only one potentially viable option for solid PFCs, though, constitutes one of the most significant restrictions on design space for DEMO and follow-on fusion reactors. In contrast, there are several candidates for liquid metal-based PFCs, including gallium, tin, lithium, and tin-lithium eutectics. We will discuss options for liquid metal walls in tokamaks, looking at both high and low recycling materials. We will then focus in particular on one of the candidate liquids, lithium. Lithium is known to have a high chemical affinity for hydrogen, and has been shown in test stands1 and fusion experiments2,3 to produce a low recycling surface, especially when liquid. Because it is also low-Z and is usable in a tokamak over a reasonable temperature range (200 - 400 oC), it has been now been used as a PFC in several confinement experiments (TFTR, T11- M, CDX-U, NSTX, FTU, and TJ-II), with favorable results. The consequences of substituting low recycling walls for the traditional high recycling variety on tokamak equilibria are very extensive. We will discuss some of the expected modifications, briefly reviewing experimental results, and comparing the results to expectations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

UX Focused Development Work During Recent ORNL EPICS-Based Instrument Control System Upgrade Projects

The importance of usability and easy-to-use user interfaces (UI) have been recognized across many domains. However, the user-friendliness of scientific experiment control systems often lags behind industry standards in the flourishing user experience (UX) field. Scientific control systems can certainly benefit from these new UX research methods and approaches. Recent instrument control system upgrade projects at the SNS and HFIR facilities at Oak Ridge National Laboratory demonstrate the effectiveness of UX focused development work, and further reveal the need for more utilization of such techniques coming from the UX field. The ongoing control system upgrades are targeting the key facility-level priority of higher scientific productivity, and UX is one of the important tools to help us achieve this priority. We will highlight research methods and practices, introduce our findings and deliverables, and share challenges and lessons learned in applying UX methods to scientific control systems.

Yao, Marie Xingxing↗

Optimization of a coherent soft x-ray beamline for coherent scattering experiments at NSLS-II

The coherent soft x-ray and full polarization control (CSX) beamline at the National Synchrotron Light Source - II (NSLS-II) will deliver 1013 coherent photons per second in the energy range of 0.2-2 keV with a resolving power of 2000. The source, a dual elliptically polarizing undulator (EPU), and beamline optics should be optimized to deliver the highest possible coherent flux in a 10-30 {micro}m spot for use in coherent scattering experiments. Using the computer code Synchrotron Radiation Workshop (SRW), we simulate the photon source and focusing optics in order to investigate the conditions which provide the highest usable coherent intensity on the sample. In particular, we find that an intermediate phasing magnet is needed to correct for the relative phase between the two EPUs and that the optimum phase setting produces a spectrum in which the desired wavelength is slightly red-shifted thus requiring a larger aperture than originally anticipated. This setting is distinct from that which produces an on-axis spectrum similar to a single long undulator. Furthermore, partial coherence calculations, utilizing a multiple electron approach, indicate that a high degree of spatial coherence is still obtained at the sample location when such an aperture is used. The aperture size which maximizes the signal-to-noise ratio of a double-slit experiment is explored. This combination of high coherence and intensity is ideally suited for x-ray ptychography experiments which reconstruct the scattering density from micro-diffraction patterns. This technique is briefly reviewed and the effects on the image quality of proximity to the beamline focus are explored.

36 MATERIALS SCIENCE↗

Leveraging Existing Mission Tools in a Re-Usable, Component-Based Software Environment

Emerging methods in component-based software development offer significant advantages but may seem incompatible with existing mission operations applications. In this paper we relate our positive experiences integrating existing mission applications into component-based tools we are delivering to three missions. In most operations environments, a number of software applications have been integrated together to form the mission operations software. In contrast, with component-based software development chunks of related functionality and data structures, referred to as components, can be individually delivered, integrated and re-used. With the advent of powerful tools for managing component-based development, complex software systems can potentially see significant benefits in ease of integration, testability and reusability from these techniques. These benefits motivate us to ask how component-based development techniques can be relevant in a mission operations environment, where there is significant investment in software tools that are not component-based and may not be written in languages for which component-based tools even exist. Trusted and complex software tools for sequencing, validation, navigation, and other vital functions cannot simply be re-written or abandoned in order to gain the advantages offered by emerging component-based software techniques. Thus some middle ground must be found. We have faced exactly this issue, and have found several solutions. Ensemble is an open platform for development, integration, and deployment of mission operations software that we are developing. Ensemble itself is an extension of an open source, component-based software development platform called Eclipse. Due to the advantages of component-based development, we have been able to vary rapidly develop mission operations tools for three surface missions by mixing and matching from a common set of mission operation components. We have also had to determine how to integrate existing mission applications for sequence development, sequence validation, and high level activity planning, and other functions into a component-based environment. For each of these, we used a somewhat different technique based upon the structure and usage of the existing application.

Greene, Kevin↗

Method to Investigate Cognitive Aging Effects in Nuclear Operations Using the Rancor Microworld Simulator

Many nuclear power plant (NPP) operators are close to, or at retirement age. Since NPP operators are responsible for tasks that engage different and complex cognitive abilities, human factors researchers recently called for the need to examine cognitive aging effects and potential interactions with modernized control rooms. One way control rooms are being modernized is by replacing paper-based procedures with computer-based procedures (CBPs). This paper outlines a method for testing preference and usability of three types of CBPs as a function of age, in simulated NPP operations. The Rancor Microworld Simulator will be used, which mimics an NPP control room, allowing novices to learn to perform operator tasks quickly. The experiment will have two independent variables: age (young and old) and CBP-type (Type 1, Type 2, and Type 3). The three types of CBPs vary in levels of embedded instrumentation and controls. Adults aged 18–25 years (young group) and =60 years (older group) will be recruited from the general population. The dependent variables will be preference and usability metrics via survey and simulator logs. All participants will perform two scenario types (startup and loss of feedwater operations) and will be randomly assigned to one type of CBP to guide them through the scenario. Analyses of variance (ANOVAs) will be used to determine whether there is a main effect of age and any age x CBP-type interactions on the preference and usability dependent variables.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of Visualization Heuristics

Heuristics have been used since the early 1990's in the Human Computer Interaction (HCI) domain, for evaluating user interfaces. Most notably, heuristics developed by Nielsen and Molich (1990) have been used by the HCI community. Forsell and Johansson (2010) used the same methodology as Nielsen and Molich and developed a set of 10 heuristics for information visualization. Currently, neither the information visualization or the visual analytics community has adopted these heuristics. However, several studies have been conducted using heuristics. Hearst et al. (2015) found that using the heuristics for visualizations along with asking questions about the data resulted in complementary results as the questions about the data could compensate for heuristics that were difficult to understand and apply. Heli Väätäjä et al. (2016) found that heuristics related to interaction, veracity, and aesthetics needed to be added to the Forsell and Johansson (2010) set. They also noted that a lack of domain knowledge caused the evaluators issues in conducting a heuristic evaluation. We conducted a controlled experiment to determine what factors might impact the expert evaluators' capability to conduct a heuristic evaluation of a static information visualization. In particular, we wanted to understand how their familiarity with the visualizations and their experience in conducting heuristic evaluations impacted their evaluations of visualizations. We recruited 10 participants who were domain experts in the visualization field each having experience with one of more of the following: user experience design or research, user interface development, and human computer interaction research. We used a heuristic set proposed by Forsell and Johansson. Participants were also asked to complete a demographic survey in which they rated their experience with each visualization type generally, their experience conducting heuristic evaluations, their experience using each visualization type to extract information, and their experience developing and creating each visualization type. The participants were shown a series of 5 common visualizations (Scatterplots, Sunbursts, Tree Maps, Parallel Sets, and Area Graphs) all displaying the VAST 2008 Mini Challenge Two- Migrant Boats data . Participants were given a suggested analytical question related to each visualization to keep in mind as they applied the 10 heuristics to each visualization. They were asked if they could find any usability problems in the visualizations and which heuristic(s) helped them to identify these problems. The participants were asked to rate how relevant each heuristic was for evaluating each visualization along with rating how confident they felt in their ability to apply the heuristic to evaluate each visualization. At the conclusion of the study, participants provided qualitative feedback on the usability issues of each visualization. Additionally, we collected eye tracking data on 6 of the 10 participants. We will be using this data to determine how long participants looked at the various visualizations and what parts of the visualizations they focused on. We had two hypotheses for this empirical evaluation: 1.The Forsell and Johansson heuristics of Orientation and help, Data set reduction, and Prompting are less useful for static visualizations because they require some interaction in order to test completely. 2.Participants that do not have experience with heuristic evaluation will provide lower evaluation scores for the heuristics compared to those that have experience. Related to hypothesis 1, as our study used only static visualizations, interaction-related usability challenges should be harder to identify. This should result in lower usefulness ratings for those heuristics. Preliminary results indicate that participants found it more difficult to apply heuristics to unfamiliar visualizations.

Williams, Ryan G.↗

Record High Hydrogen Storage Capacity in the Metal–Organic Framework Ni 2 ( m -dobdc) at Near-Ambient Temperatures

Hydrogen holds promise as a clean alternative automobile fuel, but its on-board storage presents significant challenges due to the low temperatures and/or high pressures required to achieve a sufficient energy density. The opportunity to significantly reduce the required pressure for high density H 2 storage persists for metal-organic frameworks due to their modular structures and large internal surface areas. The measurement of H 2 adsorption in such materials under conditions most relevant to on-board storage is crucial to understanding how these materials would perform in actual applications, although such data have to date been lacking. In the present work, the metal-organic frameworks M 2 (m-dobdc) (M = Co, Ni; m-dobdc 4- = 4,6-dioxido-1,3-benzenedicarboxylate) and the isomeric frameworks M 2 (dobdc) (M = Co, Ni; dobdc 4- = 1,4-dioxido-1,3-benzenedicarboxylate), which are known to have open metal cation sites that strongly interact with H 2 , were evaluated for their usable volumetric H 2 storage capacities over a range of near-ambient temperatures relevant to on-board storage. Based upon adsorption isotherm data, Ni 2 (m-dobdc) was found to be the top-performing physisorptive storage material with a usable volumetric capacity between 100 and 5 bar of 11.0 g/L at 25 °C and 23.0 g/L with a temperature swing between -75 and 25 °C. Additional neutron diffraction and infrared spectroscopy experiments performed with in situ dosing of D 2 or H 2 were used to probe the hydrogen storage properties of these materials under the relevant conditions. Finally, the results provide benchmark characteristics for comparison with future attempts to achieve improved adsorbents for mobile hydrogen storage applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

In-situ TEM Holder for Ultrafast, Multimodal Imaging

This project developed a prototype in-situ specimen holder product to transmission electron microscope (TEM) users that drastically expand the usability of TEM by combining nanoscale laser excitation and optical signal collection. A commercial prototype has been constructed and a few nanoscale materials characterization experiments have been performed to validate its performance and demonstrate its utility in real scientific studies, for example, in-situ characterization and mapping of defects in the synthesis of nanostructures.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Exploring the effectiveness of a back-supporting exosuit: Trunk muscle activity and user experience in controlled and real-world shoveling scenarios

Introduction: This study evaluates the effectiveness of a passive wearable exosuit (HeroWear Apex) in reducing lumbar muscle effort while shoveling. Method: Two experiments were conducted, involving: (1) moving calibrated sandbags at a predefined pace in a laboratory, and (2) moving loose dirt in an in-field setting. Studies were designed to emulate real-world shoveling conditions at Department of Energy - Environmental Management sites. Muscle activity of the lumbar and oblique muscles was analyzed, along with user perceptions. Due to the asymmetric nature of shoveling, analysis of muscle activity was split between the weighted and unweighted sides, with the weighted side being defined as the side of the body closest to the head of the shovel in a neutral posture. Results: While donning the device, both experiments showed a significant decrease in muscle activity for at least one lumbar muscle on the weighted side. Participants rated the device with a high usability score, and perceived exertion ratings were significantly lower while wearing the exosuit. While opinions varied regarding the device’s helpfulness, participants felt the device was comfortable and did not hinder motion during the task. Practical applications: The reduction in back muscle activity associated with wearing the exosuit has the potential to reduce muscle fatigue resulting from repetitive motions.

Exoskeleton↗

Comparison of Procedures for Dual and Triple Closely Spaced Parallel Runways

A human-in-the-loop high fidelity flight simulation experiment was conducted, which investigated and compared breakout procedures for Very Closely Spaced Parallel Approaches (VCSPA) with two and three runways. To understand the feasibility, usability and human factors of two and three runway VCSPA, data were collected and analyzed on the dependent variables of breakout cross track error and pilot workload. Independent variables included number of runways, cause of breakout and location of breakout. Results indicated larger cross track error and higher workload using three runways as compared to 2-runway operations. Significant interaction effects involving breakout cause and breakout location were also observed. Across all conditions, cross track error values showed high levels of breakout trajectory accuracy and pilot workload remained manageable. Results suggest possible avenues of future adaptation for adopting these procedures (e.g., pilot training), while also showing potential promise of the concept.

triple approaches↗

Containerization in ATLAS Software Development and Data Production

The ATLAS experiment's software production and distribution on the grid benefits from a semi-automated infrastructure that provides up-to-date information about software usability and availability through the CVMFS dis-tribution service for all relevant systems. The software development process uses a Continuous Integration pipeline involving testing, validation, packag-ing and installation steps. For opportunistic sites that can not access CVMFS, containerized releases are needed. These standalone containers are currently created manually to support Monte-Carlo data production at such sites. In this paper we will describe an automated procedure for the containerization of AT-LAS software releases in the existing software development infrastructure, its motivation, integration and testing in the distributed computing system.

97 MATHEMATICS AND COMPUTING↗

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their operations. 1 1 https://www.ciodive.com/news/how-data-science-tools-can-lighten-the-load-for-cybersecurity-teams/572209/ In light of such widespread adoption, it is vital for the research community to identify and address usability concerns. This work presents the results of the first in situ usability assessment of ML-based tools. With the support of the US Navy, we leveraged the national cyber range-a large, air-gapped cyber testbed equipped with state-of-the-art network and user emulation capabilities-to study six US Naval SOC analysts' usage of two tools. Our analysis identified several serious usability issues, including multiple violations of established usability heuristics for user interface design. We also discovered that analysts lacked a clear mental model of how these tools generate scores, resulting in mistrust a and/or misuse of the tools themselves. Surprisingly, we found no correlation between analysts' level of education or years of experience and their performance with either tool, suggesting that other factors such as prior background knowledge or personality play a significant role in ML-based tool usage. Our findings demonstrate that ML-based security tool vendors must put a renewed focus on working with analysts, both experienced and inexperienced, to ensure that their systems are usable and useful in real-world security operations settings.

Oesch, T↗

Beyond the Prototype: The Design Evolution of a Deployed AI System

Our previous experiences with deployed intelligent control agents for NASA advanced life support systems (Schreckenghost et al., 2002) inspired us to develop the Distributed Collaboration and Interaction (DCI) system to help humans and mostly-autonomous software agents work together. We discovered many unaddressed needs for human interaction with control agents that operate continuously over months to years to monitor and perform process control for regenerative life support systems. These systems recover usable water or air from the waste products created by biological systems over time. Through the DCI project, we have addressed the needs for interaction between humans and autonomous control systems. This paper describes the software engineering aspects of our experiences, first, in designing and developing a prototype of the DCI system, and later, in adjusting the implementation to make the leap from initial prototype to a system ready to be applied under varying circumstances to meet different needs. The details in the paper focus primarily on the second stage of development. The DCI system is currently deployed, operating 24/7, to assist humans to interact with an advanced Water Recovery System (WRS). In addition, we have demonstrated an application of DCI to support ground personnel in mission support roles.

Martin, C.↗

Beyond the Prototype: The Design Evolution of a Deployed AI System

Our previous experiences with deployed intelligent control agents for NASA advanced life support systems (Schreckenghost et al., 2002) inspired us to develop the Distributed Collaboration and Interaction (DCI) system to help humans and mostly-autonomous software agents work together. We discovered many unaddressed needs for human interaction with control agents that operate continuously over months to years to monitor and perform process control for regenerative life support systems. These systems recover usable water or air from the waste products created by biological systems over time. Through the DCI project, we have addressed the needs for interaction between humans and autonomous control systems. This paper describes the software engineering aspects of our experiences, first, in designing and developing a prototype of the DCI system, and later, in adjusting the implementation to make the leap from initial prototype to a system ready to be applied under varying circumstances to meet different needs. The details in the paper focus primarily on the second stage of development. The DCI system is currently deployed, operating 24/7, to assist humans to interact with an advanced Water Recovery System (WRS). In addition, we have demonstrated an application of DCI to support ground personnel in mission support roles.

Martin, Cheryl↗

Sputter sample preparation for ion beam delivery of radium-223 at ATLAS

A radium-223 ion beam was delivered to an experiment from the electron cyclotron resonance ion source, ECR2, at the Argonne Tandem Linac Accelerator System (ATLAS). Here, the radium-223 material was in a nitrate salt form within a vial, prior to being converted to a usable sputter sample. The sputter sample was produced using a new sample preparation method, where the radium nitrate was dissolved into a solution and pipetted onto pressed aluminum powder. This sample was then allowed to dry, distributing the radium-223 material throughout the sputter sample. Ion source operation using the radium sputter sample is described with the operating parameters listed. The intensity and energy requirements for this ion beam were 1 × 10 6 particles/s and 1.07 GeV, respectively. Because the intensity is relatively low compared to most experiments at ATLAS, previously developed accelerator mass spectrometry methods were used Scott et al. to avoid the need for tuning of the low-intensity beam of interest. Handling of the radium material, as well as loading and unloading of the sputter sample from ECR2, required collaboration with Health Physics. Procedures were used and dry runs were carried out before, during, and after the experiment to ensure the safety of the workers. The processes used and lessons learned are described within.

07 ISOTOPE AND RADIATION SOURCES↗

Understanding the Impact of Data Staging for Coupled Scientific Workflows

We report the rate of data generated by cutting-edge experimental science facilities and large-scale simulations enabled by current high-performance computing (HPC) systems has continued to grow at a far greater pace than the development of the network and storage capabilities on which these systems rely. To cope with this challenge, scientist are moving toward the creation of autonomous experiments and HPC simulations using machine learning. However, efficiently moving, storing, and processing large amounts of data away from the point of origin presents an incredible challenge. In-memory computing, in situ analysis, data staging, and data streaming are recognized viable alternatives to traditional file-based methods for transferring data between coupled workflows. However, the performance trade-offs and limitations for these methods are not fully understood when used in HPC applications. This article presents a comprehensive performance assessment of the current solutions for data staging when applied to applications that are not necessary I/O intensive which makes them not ideal candidates for these methods. Our study is based on experiments running at scale on Oak Ridge National Laboratory's Summit supercomputer using applications and simulations that cover typical computational motifs and patterns. We investigated the usability and cost/benefit trade-offs of staging algorithms for HPC applications under different scenarios and highlight opportunities for optimizing the dataflow between coupled simulation workflows.

97 MATHEMATICS AND COMPUTING↗

Restoration of Apollo Data by the NSSDC and the PDS Lunar Data Node

The Lunar Data Node (LDN), under the auspices of the Geosciences Node of the Planetary Data System (PDS), is restoring Apollo data archived at the National Space Science Data Center. The Apollo data were arch ived on older media (7 -track tapes. microfilm, microfiche) and in ob solete digital formats, which limits use of the data. The LDN is maki ng these data accessible by restoring them to standard formats and archiving them through PDS. The restoration involves reading the older m edia, collecting supporting data (metadata), deciphering and understa nding the data, and organizing into a data set. The data undergo a pe er review before archive at PDS. We will give an update on last year' s work. We have scanned notebooks from Otto Berg, P.1. for the Lunar Ejecta and Meteorites Experiment. These notebooks contain information on the data and calibration coefficients which we hope to be able to use to restore the raw data into a usable archive. We have scanned Ap ollo 14 and 15 Dust Detector data from microfilm and are in the proce ss of archiving thc scans with PDS. We are also restoring raw dust de tector data from magnetic tape supplied by Yosio Nakamura (UT Austin) . Seiichi Nagihara (Texas Tech Univ.) and others in cooperation with NSSDC are recovering ARCSAV tapes (tapes containing raw data streams from all the ALSEP instruments). We will be preparing these data for archive with PDS. We are also in the process of recovering and archivi ng data not previously archived, from the Apollo 16 Gamma Ray Spectro meter and the Apollo 17 Infrared Spectrometer.

Williams, David R.↗

TCL3 UTM (UAS Traffic Management) Flight Tests, Airspace Operations Laboratory (AOL) Report

The Technology Capability Level-3 (TCL3) flight tests were conducted at six different test sites located across the USA from March to May of 2018. The campaign resulted in over 830 data collection flights using 28 different aircraft and involving 20 flight crews. Flights not only varied in duration, but also in the environments and terrains over which they flew. The TCL3 tests highlighted four different types of tests: three tests focused on Communication, Navigation and Surveillance (CNS); six tests focused on Sense and Avoid (SAA) technologies; six tests focused on USS Data and Information Exchange (DAT); and five tests focused on exploring fundamental Concepts of the project (CON). This document presents data collected during the TCL3 tests that informed the operator’s experiences—the quality of the unmanned aerial system (UAS) Service Supplier (USS) information that the operator was provided with, the usefulness of this information, and the usability of the automation, both while airborne and on the ground. It is intended to complement the reports written by the test sites and the quantitative reports and presentations of the UAS Traffic Management (UTM) project. With the goal of instructing what the minimum information requirements and/or best practices might be in TCL3 operations, the driving enquiry was: How do you get the information you need, when you need it, to successfully fly a UAS in UTM airspace? This enquiry touches on two requirements for displays, which are to provide adequate situation awareness (SA) and to share information through a USS. The six test sites participating in the TCL3 tests flew a subset of the 20 tests (outlined above), with most sites working on a subset of each of the four types: Communications, Navigation and Surveillance (CNS); DAT; CON; and Sense and Avoid (SAA). The, mainly qualitative, data addressed in this report was collected by the AOL (Airspace Operations Laboratory) both on-site and remotely for each test. The data consists of the contents of end-of-day debriefs, end-of-day surveys, observer notes, and flight test information, all submitted as part of the Data Management Plan (DMP).

Martin, Lynne↗