Search NASA⌕ Search

SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Situation Awareness and Workload Measures for SAFOR

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

DeMaio, Joe↗

A Safety Index and Method for Flightdeck Evaluation

If our goal is to improve safety through machine, interface, and training design, then we must define a metric of flightdeck safety that is usable in the design process. Current measures associated with our notions of "good" pilot performance and ultimate safety of flightdeck performance fail to provide an adequate index of safe flightdeck performance for design evaluation purposes. The goal of this research effort is to devise a safety index and method that allows us to evaluate flightdeck performance holistically and in a naturalistic experiment. This paper uses Reason's model of accident causation (1990) as a basis for measuring safety, and proposes a relational database system and method for 1) defining a safety index of flightdeck performance, and 2) evaluating the "safety" afforded by flightdeck performance for the purpose of design iteration. Methodological considerations, limitations, and benefits are discussed as well as extensions to this work.

Latorella, Kara A.↗

Three-dimensional analysis of potential vorticity associated with tropopause folds and observed variations of ozone and carbon monoxide

The usability and reliability of potential vorticity as a meteorological stratospheric tracer are evaluated. The concept of potential vorticity conservation during transport in which stratospheric and tropospheric air are mixing is tested. Aircraft data collected on April 20, 1984 in the western and southwestern U.S. are analyzed in order to derive potential vorticity data; vertical cross sections of constant-pressure data and temperature and wind speed gradients are examined. The tropopause fold observed during the April 20, 1984 aircraft flights is described. The potential vorticity, ozone mixing ratio, and carbon monoxide mixing ratio are compared; a positive correlation between potential vorticity and the ozone mixing ratio and a negative correlation between the potential vorticity and the carbon monoxide mixing ratio are detected. The data support the concepts of the conservation of potential vorticity, the entrainment and mixing of tropospheric air across the boundaries of the fold, and the applicability of potential vorticity as a stratospheric tracer.

Danielsen, Edwin F.↗

Earth science information: Planning for the integration and use of global change information

The Consortium for International Earth Science Information Network (CIESIN) was founded in 1989 as a non-profit corporation dedicated to facilitating access to, use and understanding of global change information worldwide. The Consortium was created to cooperate and coordinate with organizations and researchers throughout the global change community to further access the most advanced technology, the latest scientific research, and the best information available for critical environmental decision making. CIESIN study efforts are guided by Congressional mandates to 'convene key present and potential users to assess the need for investment in integration of earth science information,' to 'outline the desirable pattern of interaction with the scientific and policy community,' and to 'develop recommendations and draft plans to achieve the appropriate level of effort in the use of earth science data for research and public policy purposes.' In addition, CIESIN is tasked by NASA to develop a data center that would extend the benefits of Earth Observing System (EOS) to the users of global change information related to human dimensions issues. For FY 1991, CIESIN focused on two main objectives. The first addressed the identification of information needs of global change research and non-research user groups worldwide. The second focused on an evaluation of the most efficient mechanisms for making this information available in usable forms.

Lousma, Jack R.↗

A comparison of CLIPS- and LISP-based approaches to the development of a real-time expert system

This paper describes an ongoing expert system development effort started in 1988 which is evaluating both CLIPS- and LISP- based approaches. The expert system is being developed to a project schedule and is planned for flight on Space Shuttle Mission SLS-2 in 1992. The expert system will help astronauts do the best possible science for a vestibular physiology experiment already scheduled for that mission. The system gathers and reduces data from the experiment, flags 'interesting' results, and proposes changes in the experiment both to exploit the in-flight observations and to stay within the time allowed by Mission Control for the experiment. These tasks must all be performed in real time. Two Apple Macintosh computers are used. The CLIPS- and LISP- based environments are layered above the Macintosh computer Operating System. The 'CLIPS-based' environment includes CLIPS and HyperCard. The LlSP-based environment includes Common LISP, Parmenides (a frame system), and FRuleKit (a rule system). Important evaluation factors include ease of programming, performance against real-time requirements, usability by an astronaut, robustness, and ease of maintenance. Current results on the factors of ease of programming, performance against real-time requirements, and ease of maintenance are discussed.

Frainier, R.↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

ESIP Information Quality Cluster (IQC)

The Information Quality Cluster (IQC) within the Federation of Earth Science Information Partners (ESIP) was initially formed in 2011 and has evolved significantly over time. The current objectives of the IQC are to: 1. Actively evaluate community data quality best practices and standards; 2. Improve capture, description, discovery, and usability of information about data quality in Earth science data products; 3. Ensure producers of data products are aware of standards and best practices for conveying data quality, and data providers distributors intermediaries establish, improve and evolve mechanisms to assist users in discovering and understanding data quality information; and 4. Consistently provide guidance to data managers and stewards on how best to implement data quality standards and best practices to ensure and improve maturity of their data products. The activities of the IQC include: 1. Identification of additional needs for consistently capturing, describing, and conveying quality information through use case studies with broad and diverse applications; 2. Establishing and providing community-wide guidance on roles and responsibilities of key players and stakeholders including users and management; 3. Prototyping of conveying quality information to users in a more consistent, transparent, and digestible manner; 4. Establishing a baseline of standards and best practices for data quality; 5. Evaluating recommendations from NASA's DQWG in a broader context and proposing possible implementations; and 6. Engaging data providers, data managers, and data user communities as resources to improve our standards and best practices. Following the principles of openness of the ESIP Federation, IQC invites all individuals interested in improving capture, description, discovery, and usability of information about data quality in Earth science data products to participate in its activities.

data products↗

Preliminary Skylab MSS channel evaluation

The author has identified the following significant results. A set of 18 channels which were considered of usable quality were identified. These were channels 1-14, 17, 19-21. Channels 15, 16, 18, and 22 were dropped out because they were of poor quality; channels 7 and 11 were dropped to limit the total channel number to 16. From these 16 channels, a total of 22 signatures were obtained. Eight were developed from uniform blocks of the UMAP, and 14 from use of the DCLUS program. These signatures fell into six basic categories and classified more than 90% of the five scenes mapped: agriculture land (6 signatures); forest aland (4); water (2); open nonagriculture land (2); urban (6); and disturbed land (2).

Mcmurtry, G. J.↗

Technology requirements for future Earth-to-geosynchronous orbit transportation systems. Volume 2: Technical results

Technologies either critical to performance of offering cost advantages compared to the investment required to bring them to usable confidence levels are identified. A total transportation system is used as an evaluation yardstick. Vehicles included in the system are a single stage to orbit launch vehicle used in a priority cargo role, a matching orbit transfer vehicle, a heavy lift launch vehicle with a low Earth orbit delivery capability of 226, 575 kg, and a matching solar electric cargo orbit transfer vehicle. The system and its reference technology level are consistent with an initial operational capability in 1990. The 15 year mission scenario is based on early space industrialization leading to the deployment of large systems such as power satellites. Life cycle cost benefits in discounted and undiscounted dollars for each vehicle, technology advancement, and the integrated transportation system are calculated. A preliminary functional analysis was made of the operational support requirements for ground based and space based chemical propulsion orbit transfer vehicles.

Caluori, V. A.↗

The volume change during solidification

The liquid-solid phase transformation of solidifying metallic melts is accompanied by a volume change Delta-Vm. This volume change produces a gravity-independent microscopic flow near the solidification front. In a ground-based laboratory, solidification processes are also affected by convection due to temperature and concentration gradients. A quantitative evaluation of the effects of these flows on the formation of structure requires reproducible values of Delta-Vm. Alloys with Delta-Vm = 0 would be best suited for such an evaluation, while alloys with a constant value for Delta-Vm are still usable. Another requirement is related to a solidus-liquidus interval which is as small as possible. One-phase alloys, which would be particularly well suited, could not be found. For these reasons, alloys which solidify in two phases, as for example eutectics, have been considered, taking into account the Al-Ge system. Attention is given to the volume change at the melting point, the measurement of this change, the volume change at solidification, and applications to terrestrial technology.

Rittich, M.↗

Special Purpose Crew Restraints for Teleoperation

With permanent human presence onboard the International Space Station (ISS), and long duration space missions being planned for the moon and Mars, humans will be living and working in microgravity over increasingly long periods of time. In addition to weightlessness, the confined nature of a spacecraft environment results in ergonomic challenges such as limited visibility, and access to the activity area. These challenges can result in prolonged periods of unnatural postures for the crew, ultimately causing pain, injury, and loss of productivity. Determining the right set of human factors requirements and providing an ergonomically designed environment is crucial to mission success. While a number of general purpose restraints have been used on ISS (handrails, foot loops), experience has shown that these general purpose restraints may not be optimal, or even acceptable for some tasks that have unique requirements. For example, some onboard activities require extreme stability (e.g., glovebox microsurgery), and others involve the use of arm, torso and foot movements in order to perform the task (e-g. robotic teleoperation); standard restraint systems will not work in these situations. The Usability Testing and Analysis Facility (WAF) at the NASA Johnson Space Center began evaluations of crew restraints for these special situations by looking at NASAs Robonaut. Developed by the Robot Systems Technology Branch, Robonaut is a humanoid robot that can be remotely operated through a tetepresence control system by an operator. It was designed to perform work in hazardous environments (e.g., Extra Vehicular Activities). A Robonaut restraint was designed, modeled for the population, and ultimately tested onboard the KC-135 microgravity aircraft. While in microgravity, participants were asked to get in and out of the restraint from different locations, perform maximum reach exercises, and finally to teleoperate Robonaut while in the restraint. The sessions were videotaped, and participants completed a questionnaire at the end of each flight day. Results from this evaluation are being used to develop the human factors design requirements for teleoperation tasks in microgravity.

Whitmore, Mihriban↗

NASA and Me

Topics in this student project report include: biography, NASA history and structure, overview of Johnson Space Center facilities and major projects, and an overview of the Usability Testing and Analysis Facility (UTAF). The UTAF section slides include space habitat evaluations with mockups, crew space vehicle evaluations, and human factors research.

Wong, Douglas T.↗

Homomorphic Encryption for Electrical Metering Aggregation: Protecting the Privacy of Building Tenants

Electrical meters are devices that measure consumer electricity usage. The data collected by these meters is necessary for utility billing and electrical grid management but can also be used to assess the environmental impact of buildings. Prior research has found that unprotected metering data could potentially be used to infer some information about the behaviors of building tenants by detecting changes in electricity usage. For example, a period of low electricity usage could suggest that the tenants are not in the building. As smart metering becomes more common, there is a growing need for data privacy protections for metering data that do not negatively impact the quality and availability of data used for energy management and billing applications. To identify potential solutions, we developed a Python-based data aggregation platform to analyze the potential efficacy of privacy-enhancing technologies for energy metering applications. This platform aggregates groups of metering sites into virtual buildings, which could potentially detach changes in electrical activity from individual tenants, making it more difficult to track the activity of a specific tenant. To further protect data during analysis, this project utilizes homomorphic encryption as part of its initial approach. Homomorphic encryption offers a means of protecting energy consumption data while permitting mathematical operations to be performed without the need to know the data contents. This allows for data to be processed into usable statistics without revealing energy consumption information. A series of homomorphic encryption libraries were evaluated to determine their applicability and limitations in the context of metering data. The use of these techniques may help to reassure consumers and encourage further adoption of smart grid infrastructure.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multi-wire slurry wafering demonstrations

Ten slicing demonstrations on a multi-wire slurry saw, made to evaluate the silicon ingot wafering capabilities, reveal that the present sawing capabilities can provide usable wafer area from an ingot 1.05m/kg (e.g. kerf width 0.135 mm and wafer thickness 0.265 mm). Satisfactory surface qualities and excellent yield of silicon wafers were found. One drawback is that the add-on cost of producing water from this saw, as presently used, is considerably higher than other systems being developed for the low-cost silicon solar array project (LSSA), primarily because the saw uses a large quantity of wire. The add-on cost can be significantly reduced by extending the wire life and/or by rescue of properly plated wire to restore the diameter.

Chen, C. P.↗

Latency in Visionic Systems: Test Methods and Requirements

A visionics device creates a pictorial representation of the external scene for the pilot. The ultimate objective of these systems may be to electronically generate a form of Visual Meteorological Conditions (VMC) to eliminate weather or time-of-day as an operational constraint and provide enhancement over actual visual conditions where eye-limiting resolution may be a limiting factor. Empirical evidence has shown that the total system delays or latencies including the imaging sensors and display systems, can critically degrade their utility, usability, and acceptability. Definitions and measurement techniques are offered herein as common test and evaluation methods for latency testing in visionics device applications. Based upon available data, very different latency requirements are indicated based upon the piloting task, the role in which the visionics device is used in this task, and the characteristics of the visionics cockpit display device including its resolution, field-of-regard, and field-of-view. The least stringent latency requirements will involve Head-Up Display (HUD) applications, where the visionics imagery provides situational information as a supplement to symbology guidance and command information. Conversely, the visionics system latency requirement for a large field-of-view Head-Worn Display application, providing a Virtual-VMC capability from which the pilot will derive visual guidance, will be the most stringent, having a value as low as 20 msec.

Bailey, Randall E.↗

Playbook for UAS: UX of Goal-Oriented Planning & Execution

We are evaluating the tool Playbook, a mission planning and scheduling tool used for analog missions and research experiments at NASA. We are adapting Playbook to support an unmanned aerial vehicle (UAV) demonstration that will simulate a "search and recover" mission. To support this demonstration, we need to test this software and its usability with human subjects. Playbook will be used to plan, edit, and monitor simulated UAV swarms, and we are interested in evaluating these capabilities. Allocation of roles and responsibilities between human-automation systems is key to promoting productive cooperation between these two agents. When guiding swarms the user should not be concerned with moving waypoints, adjusting heading and altitude or any other small actions that traditional pilots control. Providing situational awareness through sensor data including radar, heat, live camera feed, and topographic information are key when managing multiple UAVs together. First responders need a good picture of disaster areas in order to make informed decisions. These sensors can initiate movements in the mission that indicate when the human should take control of single aircraft.

UAV swarms↗

Reassessment of PHDS Fulcrum40h High Purity Germanium (HPGe) Detector System Performance

This report presents a comprehensive evaluation of the updated PHDS Fulcrum40h High Purity Germanium (HPGe) detector system, benchmarking its performance, usability, and software capabilities against the current National Nuclear Security Administration (NNSA) Nuclear Emergency Support Team (NEST) HPGe Detector System Requirements Document. Systematic measurements were conducted using a single Fulcrum40h detector to assess key parameters including gamma efficiency and resolution, neutron detection efficiency, gamma pulse-pileup response, and gamma-to-neutron crosstalk. The Fulcrum40h system, acquired in August 2022, has undergone recent updates by PHDS to address deficiencies identified following the initial NEST requirements release. The results provide critical insights into the detector’s operational capabilities and compliance with NNSA NEST standards.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗