Search NASA⌕ Search

SEARCH · Search NASA

Results for “Usability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment. A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document or procedure into clinical use, associated risks can be identified and mitigated before patient care and clinical workflow are impacted.

60 APPLIED LIFE SCIENCES↗

Measuring the usability of appliance controls

A “smart” device will remain efficient only as long as the settings and other parameters allow it to be. Thus, the degree of usability is becoming an element of energy efficiency similar to other physical characteristics. We developed and tested a procedure to quantify the usability of thermostats. The procedure assumes that usability can be represented by a user’s ability to accomplish a set of tasks. Thirty one subjects were tested in their ability to accomplish six essential tasks on programmable thermostats. The tests revealed a wide variation in the subjects’ ability to accomplish the same task on different thermostats. Thus it was possible to discern thermostats that were more effective than others. We created a metric based on data that are easy to collect and unambiguous that appears to reflect the usability of a task. Metrics from different tasks can be added and an overall usability “score” calculated. This approach, as well as the metric, can be applied to other devices where poor usability may impede energy-saving behaviour.

Meier, A↗

Facilitating Energy Savings through Enhanced Usability of Thermostats

Residential thermostats play a key role in controlling heating and cooling systems. Occupants often find the controls of programmable thermostats confusing, sometimes leading to higher heating consumption than when the buildings are controlled manually. A high degree of usability is vital to a programmable thermostat's effectiveness because, unlike a more efficient heating system, occupants must engage in specific actions after installation to obtain energy savings. We developed a procedure for measuring the usability of thermostats and tested this methodology with 31 subjects on five thermostats. The procedure requires first identifying representative tasks associated with the device and then testing the subjects ability to accomplish those tasks. The procedure was able to demonstrate the subjects wide ability to accomplish tasks and the influence of a device's usability on success rates. A metric based on the time to accomplish the tasks and the fraction of subjects actually completing the tasks captured the key aspects of each thermostat's usability. The procedure was recently adopted by the Energy Star Program for its thermostat specification. The approach appears suitable for quantifying usability of controls in other products, such as heat pump water heaters and commercial lighting.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Making Energy Savings Easier: Usability Metrics for Thermostats

U.S. residential thermostats control approximately 9% of the nation’s energy use. Many building codes now require programmable thermostats (PTs) because of their assumed energy savings. However, several recent field studies have shown no significant savings or even higher energy use in households using PTs compared to those using non-PTs. These studies point to usability problems that lead to incorrect use and wasted energy. However, the lack of clear, consistent metrics has hampered the acceptance of usability concerns by thermostat manufacturers. Thus there is a need for metrics specific to PTs that manufacturers can use to evaluate their products. Here, we report on the results of a usability study conducted on five commercially available PTs and the development of four new metrics suitable for use in evaluating thermostat usability. Our study confirmed usability deficits in the current generation of PTs and showed the metrics are correlated with each other as well as agreeing with the qualitative results of the study.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their operations. 1 1 https://www.ciodive.com/news/how-data-science-tools-can-lighten-the-load-for-cybersecurity-teams/572209/ In light of such widespread adoption, it is vital for the research community to identify and address usability concerns. This work presents the results of the first in situ usability assessment of ML-based tools. With the support of the US Navy, we leveraged the national cyber range-a large, air-gapped cyber testbed equipped with state-of-the-art network and user emulation capabilities-to study six US Naval SOC analysts' usage of two tools. Our analysis identified several serious usability issues, including multiple violations of established usability heuristics for user interface design. We also discovered that analysts lacked a clear mental model of how these tools generate scores, resulting in mistrust a and/or misuse of the tools themselves. Surprisingly, we found no correlation between analysts' level of education or years of experience and their performance with either tool, suggesting that other factors such as prior background knowledge or personality play a significant role in ML-based tool usage. Our findings demonstrate that ML-based security tool vendors must put a renewed focus on working with analysts, both experienced and inexperienced, to ensure that their systems are usable and useful in real-world security operations settings.

Oesch, T↗

Situated Usability Testing for Security Systems

While usability testing is well established, assessing the usability of security software, tools, or methods deserves more careful consideration. It has been argued that dealing with security has become too difficult for individuals or organizations to manage effectively or to use conveniently. As difficult as it is for system administrators and developers to deal with, security is even more challenging for casual users. Indeed, it is much too easy for casual/home users to configure the security of their systems in non-optimal ways that leave their systems inadvertently insecure. This is exacerbated by the fact that casual users are focused on matters other than security, and likely would prefer not even to think about security. This brief report argues that when security and/or privacy are part of the equation, traditional methods for usability testing should be re-considered. The purpose of this brief report is to argue for and outline a method associated with a new approach to usability testing for examining usable security issues.

99 GENERAL AND MISCELLANEOUS↗

Usability Evaluation of the Innovation Portal and Integrated Capability Analysis Platform

The usability evaluation of the ICAP and IP tools was conducted as part of the United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) ION effort with two evaluators for the Idaho National Laboratory. Many nuclear operations in the United States are facing challenges of increased business, operations, and maintenance costs due to subsidized renewables and natural gas. The commercial NPP industry has looked to other industries to develop methods such as Integrated Operations (IO) to use available technologies to reduce operating costs. One concept for reducing costs that has been developed is the Integrated Operations for Nuclear (ION). A capability Stack model was developed as part of the ION effort to break down information related to People, Technology, Processes, and Governance (PTPG). The Innovation Portal (IP) and Integrated Capability Analysis Platform (ICAP) were created from the Capability Stack model as part of the ION effort to help utilities reduce O&M costs by identifying work reduction opportunities. Two heuristic evaluations and a cognitive walkthrough of the ICAP and IP tools were completed to identify usability issues to further develop the tools for use in the ION effort. Usability issues identified were rated by priority levels and across both tools. The priority levels identified were high (5), medium (11), and low (10). Recommendation were made to help reduce usability issues of the systems and help increase the user response rate of using the systems once they are implemented for utilities. Future work on designs for the IP tool and additional heuristic evaluations and external testing are being developed to continue refinement of the ICAP and IP tools for the ION effort.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multivariate Flexible Framework with High Usable Hydrogen Capacity in a Reduced Pressure Swing Process

Step-shaped adsorption-desorption of gaseous payloads by flexible metal-organic frameworks can facilitate the delivery of large usable capacities with significantly reduced energetic penalties. This is desirable for the storage, transport, and delivery of H 2 , as prototypical adsorbents require large swings in pressure and temperature to achieve usable capacities approaching their total capacities. However, the weak physisorption of H 2 typically necessitates undesirably high pressures to induce the framework phase change. As de novo design of flexible frameworks is exceedingly challenging, the ability to intuitively adapt known frameworks is required. We demonstrate that the multivariate linker approach is a powerful tool for tuning the phase change behavior of flexible frameworks. In this work, 2-methyl-5,6-difluorobenzimidazolate was solvothermally incorporated into the known framework CdIF-13 (sod-Cd(benzimidazolate) 2 ), resulting in the multivariate framework sod-Cd(benzimidazolate) 1.87 (2-methyl-5,6-difluorobenzimidazolate) 0.13 (ratio = 14:1), which exhibited a considerably reduced stepped adsorption threshold pressure while maintaining the desirable adsorption-desorption profile and capacity of CdIF-13. At 77 K, the multivariate framework exhibits stepped H 2 adsorption with saturation below 50 bar and minimal desorption hysteresis at 5 bar. At 87 K, saturation of step-shaped adsorption occurs by 90 bar, with hysteresis closing at 30 bar. These adsorption-desorption profiles enable usable capacities in a mild pressure swing process above 1 mass %, representing 85-92% of the total capacities. Here this work demonstrates that the desirable performance of flexible frameworks can be readily adapted through the multivariate approach to enable efficient storage and delivery of weakly physisorbing species.

08 HYDROGEN↗

A computational study of CH 4 storage in porous framework materials with metalated linkers: connecting the atomistic character of CH 4 binding sites to usable capacity

In order to store natural gas (NG) inexpensively at adequate densities for use as a fuel in the transportation sector, new porous materials are being developed. Our work uses computational methods to explore strategies for improving the usable methane storage capacity of adsorbents, including metal-organic frameworks (MOFs), that feature open-metal sites incorporated into their structure by postsynthetic modification. The adsorption of CH 4 on several open-metal sites is studied by calculating geometries and adsorption energies and analyzing the relevant interaction factors. Approximate site-specific adsorption isotherms are obtained, and the open-metal site contribution to the overall CH 4 usable capacity is evaluated. It is found that sufficient ionic character is required, as exemplified by the strong CH 4 affinities of 2,2'-bipyridine-CaCl 2 and Mg, Ca-catecholate. In addition, it is found that the capacity of a single metal site depends not only on its affinity but also on its geometry, where trigonal or "bent" low-coordinate exposed sites can accommodate three or four methane molecules, as exemplified by Ca-decorated nitrilotriacetic acid. The effect of residual solvent molecules at the open-metal site is also explored, with some positive conclusions. Not only can residual solvent stabilize the open-metal site, surprisingly, solvent molecules do not necessarily reduce CH 4 affinity, but can contribute to increased usable capacity by modifying adsorption interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Wehnelt photoemission in an ultrafast electron microscope: Stability and usability

We tested and compared the stability and usability of three different cathode materials and configurations in a thermionic-based ultrafast electron microscope: (1) on-axis thermionic and photoemission from a custom 100 μm diameter LaB 6 source with a graphite guard ring, (2) off-axis photoemission from the Ni aperture surface of the Wehnelt electrode, and (3) on-axis thermionic and photoemission from a custom 200 μm diameter polycrystalline Ta source. For each cathode type and configuration, including the Ni Wehnelt aperture, we illustrate how the photoelectron beam-current stability is deleteriously impacted by simultaneous cooling of the source following thermionic heating. Furthermore, we demonstrate usability via collection of parallel- and convergent-beam electron diffraction patterns and by formation of the optimum probe size. We find that usability of the off-axis Ni Wehnelt-aperture photoemission is at least comparable to on-axis LaB 6 thermionic emission, as well as to on-axis photoemission [the heretofore conventional approach to ultrafast electron microscopy (UEM) in thermionic-based instruments]. However, the stability and achievable beam currents for off-axis photoemission from the Wehnelt aperture were superior to that of the other cathode types and configurations, regardless of the electron-emission mechanism. Beam-current stability for this configuration was found to be ±1% (one standard deviation from the mean) for 70 min (longest duration tested), and steady-state beam current was reached within the sampling-time resolution used here (~1 s) for 15 pA beam currents (i.e., 460 electrons per packet for a 200 kHz repetition rate). Repeatability and robustness of the steady-state condition were also found to be within ±1% of the mean. We discuss the implications of these findings for UEM imaging and diffraction experiments, for pulsed-beam damage measurements, and for practical switching between optimum conventional TEM and UEM operation within the same instrument.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Systems usability case in stepwise control room validation - 125

We present a Systems Usability Case (SUC) approach enabling a requirement-based human factors evaluation of complex technical systems. The approach is especially suitable for stepwise verification and validation (V and V) of nuclear power plant (NPP) control room (CR) systems. A SUC is based on the Safety Case approach and on the Systems Usability (SU) construct. A series of V and V test activities carried throughout the design process and constructed according to SUC enables us to monitor how evaluation evidence is aggregated over variety of V and V steps and how the design solution is maturing towards a tool of a good quality and usability. The paper demonstrates an application of the SUC approach to real data from a stepwise CR validation. The results suggest that SUC has some clear advantages. It makes it easier to conduct the V and V activities in a more systematic fashion and it makes the reasoning process more explicit and transparent. Moreover, it enables building a longitudinal view of the progress of the design process. Most importantly, constructing the SUC enables monitoring of the fulfilment of the requirements from the human factors (i.e., SU) perspective. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Impact relevance and usability of high resolution climate modeling and data

The Aspen Global Change Institute hosted a technical science workshop entitled, “Impact Relevance and Usability of High-Resolution Climate Modeling and Datasets,” on August 2-7, 2015 in Aspen, CO. Kate Calvin (Pacific Northwest National Laboratory), Andrew Jones (Lawrence Berkeley National Laboratory) and Jean-François Lamarque (NCAR) served as co-chairs for the workshop. The meeting included the participation of 29 scientists for a total of 145 participant days. Following the workshop, workshop co-chairs authored a meeting report published in Eos on April 27, 2016. Insights from the workshop directly contributed to the formation of a new DOE-supported project co-led by workshop co-chair Andy Jones. A subset of meeting participants continue to work on a publication on institutional innovations that can support the usability of high resolution modeling, among other sources of climate information.

54 ENVIRONMENTAL SCIENCES↗

Operator Insights and Usability Evaluation of Machine Learning Assistance for Power Grid Contingency Analysis

Introducing machine learning (ML) assistance into any established process comes with adoption barriers, including entrenched procedures, technological and human readiness levels, human-machine trust, and work culture resistance to change. These barriers are even greater in critical operations such as operating a national or regional power grid, in which both regulatory frameworks and the importance of maintaining reliability levels causes additional resistance to the adoption of new computational support. Developers of future systems and job aides must consider not only technical aspects, but also whether new systems are usable by power system operators. This work presents the methodology and results of a study to evaluate the usability and readiness of a prototype recommender system for power grid contingency analysis. We explore operator cognitive load and evaluate operator performance when solving a collection of scenarios both with and without recommender assistance. We also examine operator trust in the system. We report insights gained on the readiness of the system using a collection of evaluation techniques.

Human-Machine Teaming, Power Systems, usability ev↗

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository: Preprint

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗

Computational Optimization of Room Temperature Usable Capacity for Hydrogen Storage in MFU-4-Type Metal–Organic Frameworks via Pairwise Metal Substitutions

The efficient storage of hydrogen is a critical challenge in the quest for sustainable energy solutions. Current adsorbent-based methods achieve satisfactory storage densities predominantly under cryogenic temperatures and/or high pressures, which imposes problems with cost-efficient and safe implementation of this technology. Materials that can bind hydrogen gas reversibly at ambient temperatures and more moderate pressures could play a pivotal role in enabling hydrogen-powered technologies. In this study, we use reliable computational modeling to investigate two synthetically feasible paths for tuning the enthalpy of H2 binding in MFU-4-type metal–organic frameworks (MOFs), aiming to maximize usable capacity. This study examines MIM4 IICl3(bta)6 (bta– = benzotriazolate) Kuratowski-type clusters as a model for strong binding sites in MFU-4l frameworks. We systematically evaluate the impact of separately tuning the central MII metal ion (which plays a structural role) and the peripheral MI metal ion (which binds the substrate) on the energetics of H2 binding. Our computational study reveals that H2 binding at an MI site mostly follows the trend AgI < CuI < NiI < CoI < AuI while a larger central MII site generally weakens the H2 binding at a MI site. Importantly, we have identified three new combinations of MI and MII to achieve high fractional usable capacities of the total H2 adsorbed under a pressure swing from 5 to 100 bar at room temperature. Additionally, we examine the nature of the binding interaction between the peripheral metal atom and the hydrogen molecule. While charge transfer predominantly induces this interaction, for several atom combinations, a change in the polarization (associated with variations in the ionic radius of the MI binding atom) is another important factor for adjusting the strength of the interaction. We suggest that the proposed compositions of Kuratowski-type clusters are highly desirable synthetic targets for future laboratory study.

Tkachenko, Nikolay V↗