SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2003

A Cockpit Display Designed to Enable Limited Flight Deck Separation Responsibility

Cockpit displays need to be substantially improved to serve the goals of situational awareness, conflict detection, and path replanning, in Free Flight. This paper describes the design of such an advanced cockpit display, along with an initial simulation based usability evaluation. Flight crews were particularly enthusiastic about color coding for relative altitude, dynamically pulsing predictors, and the use of 3-D flight plans for alerting and situational awareness.

Johnson, Walter W.↗

NASA NTRS1997

Increased User Satisfaction Through an Improved Message System

With all of the enhancements in software methodology and testing, there is no guarantee that software can be delivered such that no user errors occur, How to handle these errors when they occur has become a major research topic within human-computer interaction (HCI). Users of the Multimission Spacecraft Analysis Subsystem(MSAS) at the Jet Propulsion Laboratory (JPL), a system of X and motif graphical user interfaces for analyzing spacecraft data, complained about the lack of information about the error cause and have suggested that recovery actions be included in the system error messages...The system was evaluated through usability surveys and was shown to be successful.

Human-computer interaction error handling direct m↗

NASA NTRS2016

Design Concept for a Minimal Volume Spacecraft Cabin to Serve as a Mars Ascent Vehicle Cabin and Other Alternative Pressurized Vehicle Cabins

The Evolvable Mars Campaign is developing concepts for human missions to the surface of Mars. These missions are round-trip expeditions, thereby requiring crew launch via a Mars Ascent Vehicle (MAV). A study to identify the smallest possible pressurized cabin for this mission has developed a conceptual vehicle referred to as the minimal MAV cabin. The origin of this concept will be discussed as well as its initial concept definition. This will lead to a description of possible configurations to integrate the minimal MAV cabin with ascent vehicle engines and propellant tanks. Limitations of this concept will be discussed, in particular those that argue against the use of the minimal MAV cabin to perform the MAV mission. However, several potential alternative uses for the cabin are identified. Finally, recommended forward work will be discussed, including current work in progress to develop a full scale mockup and conduct usability evaluations.

Howard, Robert L., Jr.↗

NASA NTRS1999

Ergonomic Evaluation of the Foot Restraint Equipment Device (FRED)

Within the scope of the Microgravity Workstation and Restraint Evaluation project, funded by the NASA Headquarters Life Sciences Division, evaluations were proposed to be conducted in ground, KC-135, and/or Shuttle environments to investigate the human factors engineering (HFE) issues concerning confined/unique workstations, including crew restraint requirements. As part of these evaluations, KC-135 flights were conducted to investigate user/ workstation/ restraint integration for microgravity use of the FRED with the RMS workstation. This evaluation was a pre-cursor to Detailed Supplementary Objective (DSO) - 904 on STS-88. On that mission, a small-statured astronaut will be using the FRED restraint while working at the Aft RMS workstation. The DSO will collect video for later posture analyses, as well as subjective data in the form of an electronic questionnaire. This report describes the current FRED KC-135 evaluations. The primary objectives were to evaluate the usability of the FRED and to verify the DSO in-flight setup. The restraint interface evaluation consisted of four basic areas of restraint use: 1) adjustability; 2) general usability and comfort; 3) usability at the RMS workstation; and 4) assembly and disassembly.

Whitmore, Mihriban↗

NASA NTRS2006

Dynamic Tunnel Usability Study: Format Recommendations for Synthetic Vision System Primary Flight Displays

A usability study evaluating dynamic tunnel concepts has been completed under the Aviation Safety and Security Program, Synthetic Vision Systems Project. The usability study was conducted in the Visual Imaging Simulator for Transport Aircraft Systems (VISTAS) III simulator in the form of questionnaires and pilot-in-the-loop simulation sessions. Twelve commercial pilots participated in the study to determine their preferences via paired comparisons and subjective rankings regarding the color, line thickness and sensitivity of the dynamic tunnel. The results of the study showed that color was not significant in pilot preference paired comparisons or in pilot rankings. Line thickness was significant for both pilot preference paired comparisons and in pilot rankings. The preferred line/halo thickness combination was a line width of 3 pixels and a halo of 4 pixels. Finally, pilots were asked their preference for the current dynamic tunnel compared to a less sensitive dynamic tunnel. The current dynamic tunnel constantly gives feedback to the pilot with regard to path error while the less sensitive tunnel only changes as the path error approaches the edges of the tunnel. The tunnel sensitivity comparison results were not statistically significant.

Arthur, Jarvis J., III↗

NASA NTRSDate not supplied

The Role of Trust and Usability in Enabling Spaceflight Crew Autonomy

Future long duration exploration missions will require an increased use of onboard automated systems as spaceflight crews venture further than before and have longer communications delays with ground support. The design of these systems must support appropriate crew trust and have sufficient usability to enable spaceflight crew autonomy or risk being misused while crews wait to communicate with ground support. We evaluated trust & usability in our self-scheduling tool, Playbook, for crew mission timelines. Data was collected in a controlled lab experiment with 31 participants. Participants in the study conducted two tasks: scheduling, where participants were responsible for scheduling a majority of a day's operational tasks, and rescheduling, where participants were provided a schedule and asked to reschedule higher priority activities. We found a significant correlation between system trust and usability, irrespective of self-scheduling tasks. We conclude that system usability may play a bigger role in how trust is learned while conducting novel crew autonomy tasks such as self-scheduling. Future research should investigate the role of usability to encourage appropriate trust in onboard automated crew systems and enable crew autonomy.

crew autonomy↗

NASA NTRS1982

Ohio's Abandoned Mine Lands Reclamation Program: a Study of Data Collection and Evaluation Techniques

The planning process for a statewide reclamation plan of Ohio abandoned minelands in response to the Federal Surface Mining Control and Reclamation Act of 1977 included: (1) the development of a screening and ranking methodology; (2) the establishment of a statewide review of major watersheds affected by mining; (3) the development of an immediate action process; and (4) a prototypical study of a priority watershed demonstrating the data collection, analysis, display and evaluation to be used for the remaining state watersheds. Historical methods for satisfying map information analysis and evaluation, as well as current methodologies being used were discussed. Various computer mapping and analysis programs were examined for their usability in evaluating the priority reclamation sites. Hand methods were chosen over automated procedures; intuitive evaluation was the primary reason.

Sperry, S. L.↗

NASA NTRS2014

Usability of EFBs for Viewing NOTAMs and AIS/MET Data Link Messages

Electronic Flight Bags (EFB) are increasingly integral to flight deck information management. A piloted simulation study was conducted at NASA Langley Research Center, one aspect of which was to evaluate the usability and acceptability of EFBs for viewing and managing Notices to Airmen (NOTAMs) and data linked aeronautical information services (AIS) and meteorological information (MET). The study simulated approaches and landings at Memphis International Airport (KMEM) using various flight scenarios and weather conditions. Ten two-pilot commercial airline crews participated, utilizing the Cockpit Motion Facility's Research Flight Deck (CMF/RFD) simulator. Each crew completed approximately two dozen flights over a two day period. Two EFBs were installed, one for each pilot. Study data were collected in the form of questionnaire/interview responses, audio/video recordings, oculometer recordings, and aircraft/system state data. Preliminary usability results are reported primarily based on pilot interviews and responses to questions focused on ease of learning, ease of use, usefulness, satisfaction, and acceptability. Analysis of the data from the other objective measures (e.g., oculometer) is ongoing and will be reported in a future publication. This paper covers how the EFB functionality was set up for the study; the NOTAM, AIS/MET data link, and weather messages that were presented; questionnaire results; selected pilot observations; and conclusions.

Evans, Emory T.↗

NASA NTRS2010

Usability Testing and Analysis Facility (UTAF)

This slide presentation reviews the work of the Usability Testing and Analysis Facility (UTAF) at NASA Johnson Space Center. It is one of the Space Human Factors Laboratories in the Habitability and Human Factors Branch (SF3) at NASA Johnson Space Center The primary focus pf the UTAF is to perform Human factors evaluation and usability testing of crew / vehicle interfaces. The presentation reviews the UTAF expertise and capabilities, the processes and methodologies, and the equipment available. It also reviews the programs that it has supported detailing the human engineering activities in support of the design of the Orion space craft, testing of the EVA integrated spacesuit, and work done for the design of the lunar projects of the Constellation Program: Altair, Lunar Electric Rover, and Outposts

Wong, Douglas T.↗

NASA NTRSDate not supplied

Developing and Validating Measurement Scales During Pandemic Conditions: A Case Study with the Scale for Habitat Usability

At NASA, habitat evaluations often employ subjective measures. Some measures are frequently used, well established tools, whereas others are homegrown measures tailored to specific projects. The variety of measures used makes evaluation comparisons across projects difficult. Additionally, some of these measures are burdensome, may be too specialized, or may require an expert to use and interpret, limiting their utility. Taken together, these drawbacks suggest the need for a new measurement tool. To that purpose, a team at NASA worked on developing a new scale for measuring habitat usability, the Scale for Habitat Usability (SHU). The SHU is intended to be a quick, multi-faceted measure for evaluating habitat usability across the development lifecycle. However, like many research projects, the development of the SHU faced setbacks due to the COVID-19 pandemic. Pandemic prevention protocols precluded in-person data collection, forcing the team to take some non-traditional approaches to scale development. This paper reports the steps the team took to complete the project.

Ian Robertson↗

NASA NTRS2004

NASA Johnson Space Center Usability Testing and Analysis Facility (UTAF) Overview

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

Whitmore, M.↗

NASA NTRS2004

NASA Johnson Space Center Usability Testing and Analysis Facility (WAF) Overview

Whitmore, M.↗

NASA NTRS2005

NASA Johnson Space Center Usability Testing and Analysis facility (UTAF) Overview

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility performs research for NASA's HumanSystems Integration Program, under the HumanSystems Research and Technology Division. Specifically, the UTAF provides human factors support for space vehicles, including the International Space Station, the Space Shuttle, and the forthcoming Crew Exploration Vehicle. In addition, there are ongoing collaborative research efforts with external corporations and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes and requirements. This presentation will provide an overview of ongoing activities, and will address how the UTAF projects will evolve to meet new space initiatives.

Whitmore, Mihriban↗

NASA NTRSDate not supplied

Rapid Assessment of a Lunar Surface Laboratory Module

Johnson Space Center is piloting an innovation team known as the Forge to perform rapid turnaround, concurrent engineering studies. The Forge is intended to be able to pull together a team of strategically selected domain experts to innovatively solve a specified problem within a short period of time. The Forge’s inaugural project being the development of a Lunar Surface Laboratory Module concept. The lab module is intended as an option for the Artemis program’s Lunar Architecture Team. The lab module may allow for increased science productivity and return on investment than a surface architecture with only the habitat. This paper will discuss the configuration of the Lunar Laboratory module, including the pressure vessel, its placement relative to the Surface Habitat and Pressurized Rover, and internal architecture. In order to determine the suitability of such a design, a human factors evaluation is conducted. Historically, a human factors evaluation of a habitable volume could require a month or longer, including time needed to prepare a test plan, conduct the evaluation, compile the data, and produce a report. The entire Forge effort will only last for five weeks, forcing the creation of a rapid assessment process. This rapid assessment includes three evaluation studies, all conducted and processed in the space of a single day, to determine the acceptability of the resulting design. The first evaluation is a card sort evaluation of the laboratory instruments. A brief discussion of the card sort evaluation is provided. This card sort is focused on the relative positioning of the laboratory instruments, determining whether a given instrument should be adjacent to, or separated from, another. It will use human factors personnel and both life and physical scientists as subject matter experts. The second evaluation is a science productivity tabletop evaluation. This evaluation focuses on the selection of instruments and the number of instruments, attempting to assess the amount of work the crew will be able to use the facility to do. It uses life and physical science personnel as subject matter experts. The third evaluation is a CAD or Virtual Reality human factors walkthrough evaluation. This evaluation focuses on the layout of the lab module and its connectivity to the basecamp’s pressurized elements. If possible, astronauts will be used as subject matter experts. Each of these evaluations will focus primarily on objective data with limited subjective comments, reducing the time required for processing responses. The results of each evaluation and their implications will be discussed. Based on the evaluation data, an overall acceptability of the Lunar Surface Laboratory Module produced by the Forge study can be determined. Lessons learned and recommendations for future use of the human factors rapid assessment process in early design trades will also be provided.

Lunar Laboratory↗

NASA NTRS1999

ISS Propulsion Module Crew Systems Interface Analysis in the Intelligent Synthesis Environment

ERGO, a human modeling software for ergonomic assessment and task analysis, was used for the crew systems interface analysis of the International Space Station (ISS) Propulsion Module (PM). The objective of analysis was to alleviate passageway size concerns. Three basic passageway configuration concepts: (1) 45" clear passageway without centerline offset (2) 50" clear passageway, 12" centerline offset, (3) 50" clear passageway, no centerline offset, and were reviewed. 95 percentile male and female models which were provided by the software performed crew system analysis from an anthropometric point of view. Four scenarios in which the crew floats in microgravity through a 50" no-offset passageway as they carry a 16" x 20" x 30" avionics box were simulated in the 10-weeks of intensive study. From the results of the analysis, concept (3) was the preferred option. A full scale, three-dimensional virtual model of the ISS Propulsion Module was created to experience the sense of the Intelligent Synthesis Environment and to evaluate the usability and applicability of the software.

Chen, Di-Wen↗

NASA NTRS2002

Automating CPM-GOMS

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling. available to model human users, the Goals, Operators, Methods, and Selection (GOMS) method [6, 21] has been the most widely used, providing accurate, often zero-parameter, predictions of the routine performance of skilled users in a wide range of procedural tasks [6, 13, 15, 27, 28]. GOMS is meant to model routine behavior. The user is assumed to have methods that apply sequences of operators and to achieve a goal. Selection rules are applied when there is more than one method to achieve a goal. Many routine tasks lend themselves well to such decomposition. Decomposition produces a representation of the task as a set of nested goal states that include an initial state and a final state. The iterative decomposition into goals and nested subgoals can terminate in primitives of any desired granularity, the choice of level of detail dependent on the predictions required. Although GOMS has proven useful in HCI, tools to support the construction of GOMS models have not yet come into general use.

GOMS↗

NASA NTRS2002

Technology Development and Advanced Planning for Curation of Returned Mars Samples

NASA Johnson Space Center (JSC) curates extraterrestrial samples, providing the international science community with lunar rock and soil returned by the Apollo astronauts, meteorites collected in Antarctica, cosmic dust collected in the stratosphere, and hardware exposed to the space environment. Curation comprises initial characterization of new samples, preparation and allocation of samples for research, and clean, secure long-term storage. The foundations of this effort are the specialized cleanrooms (class 10 to 10,000) for each of the four types of materials, the supporting facilities, and the people, many of whom have been doing detailed work in clean environments for decades. JSC is also preparing to curate the next generation of extraterrestrial samples. These include samples collected from the solar wind, a comet, and an asteroid. Early planning and R\&D are underway to support post-mission sample handling and curation of samples returned from Mars. One of the strong scientific reasons for returning samples from Mars is to search for evidence of current or past life in the samples. Because of the remote possibility that the samples may contain life forms that are hazardous to the terrestrial biosphere, the National Research Council has recommended that all samples returned from Mars be kept under strict biological containment until tests show that they can safely be released to other laboratories. It is possible that Mars samples may contain only scarce or subtle traces of life or prebiotic chemistry that could readily be overwhelmed by terrestrial contamination . Thus, the facilities used to contain, process, and analyze samples from Mars must have a combination of high-level biocontainment and organic / inorganic chemical cleanliness that is unprecedented. JSC has been conducting feasibility studies and developing designs for a sample receiving facility that would offer biocontainment at least the equivalent of current maximum containment BSL-4 (BioSafety Level 4) laboratories, while simultaneously maintaining cleanliness levels equaling those of state-of-the-art cleanrooms. Unique requirements for the processing of Mars samples have inspired a program to develop handling techniques that are much more precise and reliable than the approach (currently used for lunar samples) of employing gloved human hands in nitrogen-filled gloveboxes. Individual samples from Mars are expected to be much smaller than lunar samples, the total mass of samples returned by each mission being 0.5- 1 kg, compared with many tens of kg of lunar samples returned by each of the six Apollo missions. Smaller samples require much more of the processing to be done under microscopic observation. In addition, the requirements for cleanliness and high-level containment would be difficult to satisfy while using traditional gloveboxes. JSC has constructed a laboratory to test concepts and technologies important to future sample curation. The Advanced Curation Laboratory includes a new-generation glovebox equipped with a robotic arm to evaluate the usability of robotic and teleoperated systems to perform curatorial tasks. The laboratory also contains equipment for precision cleaning and the measurement of trace organic contamination.

Lindstrom, David J.↗

NASA NTRS1997

Evaluating a Web-Based Interface for Internet Telemedicine

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Lathan, Corinna E.↗