SEARCH · Search NASA

Results for “user-centered evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

6 records

All sources NASA NTRS DOE OSTI

NASA NTRS2020

Evaluation of Low Cost, User-Centered Alerting Devices for the Mitigation of Flight Crew Spatial Disorientation

The National Aeronautics and Space Administration (NASA) is conducting research into technologies which have the potential to reduce flight crew Spatial Disorientation (SD). While flight deck technology has advanced rapidly over the past fifty (50) years, the reported occurrences of flight crew SD have not decreased. The Cost-Effective Devices for Alerting Research (CEDAR) effort has focused on the identification and development of low cost, user-centered alerting solutions for the purpose of mitigating the occurrence of flight crew SD. This effort seeks to evaluate both existing technologies as well as new and emerging technologies which have a viable path to implementation in commercial aviation within the next five (5) years. This research is intended to develop a proof-of-concept for real-time SD mitigation which could eventually be utilized to improve safety in future air transport operations. NASA has partnered with the United States Naval Aeromedical Research Unit in Dayton, OH (NAMRU-D) to conduct flight crew SD research utilizing their Disorientation Research Device (DRD), dubbed “The Kraken”. This high-tech simulator features never-before-seen capabilities for side-by-side commercial aviation flight crew SD research, and is capable of re-creating the forces necessary to induce SD illusions in a safe and repeatable manner. Prototype SD mitigation solutions were incorporated into this simulator for scenario-based testing and evaluation using airline pilots within a contextually representative operational environment. SD mitigation technology prototypes designed to provide haptic feedback for both alerting and guidance, as well as innovative visual and aural alerting displays were evaluated. In December 2014, as a result of analyzing eighteen (18) loss-of-control events, the Commercial Aviation Safety Team (CAST) recommended research into flight deck technologies that have potential to mitigate the problems and contributing factors that lead to flight crew loss of airplane state awareness (ASA) and conditions likely to produce SD. The aviation community (government, industry and academia) have been charged with conducting research into cost-effective, user-centered flight deck alerting systems to alert flight crews; especially for the two conditions that produced SD (sub-threshold rolls and the somatogravic illusion). Somatogravic illusions are defined as illusions in which “there is a false perception of attitude on exposure to a force vector that differs in direction and/or magnitude from the normal gravitational force”. The sub-threshold roll illusion (aka the “leans” illusion) is a false sensation of roll attitude. A prolonged roll of less than two degrees becomes physiologically imperceptible to the pilot, and can lead to an incorrect perception of aircraft orientation. The sub-threshold roll illusion forms the entry point for the “graveyard spiral”, a maneuver in which the pilot’s corrective action (based on their false perception of aircraft orientation) causes the aircraft to spiral down into the ground. In both of these SD illusions, it is when the pilot attempts to correct the aircraft’s attitude (based on a false perception of its state) that problems arise, sometimes with lethal consequences.

Ronald J Daiker↗

NASA NTRSDate not supplied

What is the Role of Usability and Trust in Autonomy?

Usability encompasses learnability, efficiency, memorability, effectiveness, and satisfaction. NASA’s standards for usability acceptance criteria focus on interfaces that help operators achieve their tasks efficiently, effectively, and with satisfaction. However, discussions on usability, especially regarding future highly automated and autonomous systems, rarely include trust. As NASA plans for long-duration exploration missions, it envisions astronauts operating more independently from Mission Control on Earth. This independence will drive the development of these highly automated and autonomous systems that astronauts will use daily. To prepare for this future, our team has developed a scheduling and execution software tool that facilitates self-scheduling, allowing astronauts to independently manage their own schedule without Mission Control’s involvement. Over many years, we have developed, matured, and evaluated our software tool in extreme environments, prioritizing user-centered design and high usability. These evaluations have included multiple campaigns in NASA analogs, including NEEMO, BASALT, and HERA, as well as technology demonstrations onboard the International Space Station. Our recent research on software interfaces for future astronaut autonomy revealed a strong correlation between usability and trust measures. In a controlled lab experiment, we asked novice users to perform a complex scheduling task, during which the software immediately validated the schedule’s constraints and checked for violations. We collected usability (User Experience Questionnaire, UEQ) and trust (Trust in Automated Systems scale, TAS) measures; significant, strong, and moderate correlations emerged between several of the UEQ metrics and TAS. These results support the argument for investing in usability early to enable and sustain trust in highly automated and autonomous systems.

usability↗

NASA NTRS2021

I’ll have the Porter: Interactively Visualizing the Results of Statistical Maneuver Analysis

Mission design and navigation relies on statistical maneuver analysis and Monte Carlo simulations when evaluating candidate mission trajectories. Engineers must analyze large quantities of data to optimize mission safety and propellant margins, but currently rely on static text files and dense PDF slide decks to review simulation results. This approach is time-intensive, non-interactive, and difficult to share or coordinate with other mission designers. To improve this process, we present Porter: a web-based interactive mission analysis tool. This work describes Porter’s user-centered design process, its processing pipeline for importing and processing LAMBIC simulation data, core interactive features, and preliminary user feedback.

Ramaswamy, Basak Alper↗

NASA NTRS1995

Multi-modal virtual environment research at Armstrong Laboratory

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Eggleston, Robert G.↗

NASA NTRS1998

Weather Avoidance Using Route Optimization as a Decision Aid: An AWIN Topical Study

The aviation community is faced with reducing the fatal aircraft accident rate by 80 percent within 10 years. This must be achieved even with ever increasing, traffic and a changing National Airspace System. This is not just an altruistic goal, but a real necessity, if our growing level of commerce is to continue. Honeywell Technology Center's topical study, "Weather Avoidance Using Route Optimization as a Decision Aid", addresses these pressing needs. The goal of this program is to use route optimization and user interface technologies to develop a prototype decision aid for dispatchers and pilots. This decision aid will suggest possible diversions through single or multiple weather hazards and present weather information with a human-centered design. At the conclusion of the program, we will have a laptop prototype decision aid that will be used to demonstrate concepts to industry for integration into commercialized products for dispatchers and/or pilots. With weather a factor in 30% of aircraft accidents, our program will prevent accidents by strategically avoiding weather hazards in flight. By supplying more relevant weather information in a human-centered format along with the tools to generate flight plans around weather, aircraft exposure to weather hazards can be reduced. Our program directly addresses the NASA's five year investment areas of Strategic Weather Information and Weather Operations (simulation/hazard characterization and crew/dispatch/ATChazard monitoring, display, and decision support) (NASA Aeronautics Safety Investment Strategy: Weather Investment Recommendations, April 15, 1997). This program is comprised of two phases, Phase I concluded December 31, 1998. This first phase defined weather data requirements, lateral routing algorithms, an conceptual displays for a user-centered design. Phase II runs from January 1999 through September 1999. The second phase integrates vertical routing into the lateral optimizer and combines the user interface into a prototype software testbed. Phase II concludes with a dispatcher and pilot evaluation of the route optimizer decision aid. This document describes work completed in Phase I in contract with NASA Langley August 1998 - December 1998. This report includes: (1) Discuss how weather hazards were identified in partnership with experts, and how weather hazards were prioritized; (2) Static representations of display layouts for integrated planning function (3) Cost function for the 2D route optimizer; (4) Discussion of the method for obtaining, access to raw data of, and the results of the flight deck user information requirements definition; (5) Itemized display format requirements identified for representing weather hazards in a route planning aid.

Source record↗

NASA NTRS2005

Apex Reference Manual 3.0 Beta

Apex is a toolkit for constructing software that behaves intelligently and responsively in demanding task environments. Reflecting its origin at NASA where Apex continues to be developed, current applications include: a) Providing autonomous mission management and tactical control capabilities for unmanned aerial vehicles including an autonomous surveillance helicopter and a simulation prototype of an unmanned fixed-wing aircraft to be used for wildfire mapping; b) Simulating human air traffic controllers, pilots and astronauts to help predict how people might respond to changes in equipment or procedures; and c) Predicting the precise duration and sequence of routine human behaviors based on a human-computer interaction engineering technique called CPM-GOMS. Among Apex s components are a set of implemented reasoning services, such as those for reactive planning and temporal pattern recognition; a software architecture that embeds and integrates these services and allows additional reasoning elements to be added as extensions; a formal language for specifying agent knowledge; a simulation environment to facilitate prototyping and analysis; and Sherpa, a set of tools for visualizing autonomy logic and runtime behavior. In combination, these are meant to provide a flexible and usable framework for creating, testing, and deploying intelligent agent software. Overall, our goal in developing Apex is to lower economic barriers to developing intelligent software agents. New ideas about how to extend or modify the system are evaluated in terms of their impact in reducing the time, expertise, and inventiveness required to build and maintain applications. For example, potential enhancements to the AI reasoning capabilities in the system are reviewed not only for usefulness and distinctiveness, but also for their impact on the readability and general usability of Apex s behavior representation language (PDL) and on the transparency of resulting behavior. A second central part of our approach is to iteratively refine Apex based on lessons learned from as diverse a set of applications as possible. Many applications have been developed by users outside the core development team including engineers, researchers, and students. Usability is thus a central concern for every aspect of Apex visible to a user, including PDL, Sherpa, the Apex installation process, APIs, and user documentation. Apex users vary in their areas of expertise and in their familiarity with autonomy technology. Focusing on usability, a development philosophy summarized by the project motto "Usable Autonomy," has been important part of enabling diverse users to employ Apex successfully and to provide feedback needed to guide iterative, user-centered refinement.

Freed, Michael A.↗