SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2005

Evaluation of Life Sciences Glovebox (LSG) and Multi-Purpose Crew Restraint Concepts

Within the scope of the Multi-purpose Crew Restraints for Long Duration Spaceflights project, funded by Code U, it was proposed to conduct a series of evaluations on the ground and on the KC-135 to investigate the human factors issues concerning confined/unique workstations, such as the design of crew restraints. The usability of multiple crew restraints was evaluated for use with the Life Sciences Glovebox (LSG) and for performing general purpose tasks. The purpose of the KC-135 microgravity evaluation was to: (1) to investigate the usability and effectiveness of the concepts developed, (2) to gather recommendations for further development of the concepts, and (3) to verify the validity of the existing requirements. Some designs had already been tested during a March KC-135 evaluation, and testing revealed the need for modifications/enhancements. This flight was designed to test the new iterations, as well as some new concepts. This flight also involved higher fidelity tasks in the LSG, and the addition of load cells on the gloveports.

Whitmore, Mihriban↗

NASA NTRSDate not supplied

What is the Role of Usability and Trust in Autonomy?

Usability encompasses learnability, efficiency, memorability, effectiveness, and satisfaction. NASA’s standards for usability acceptance criteria focus on interfaces that help operators achieve their tasks efficiently, effectively, and with satisfaction. However, discussions on usability, especially regarding future highly automated and autonomous systems, rarely include trust. As NASA plans for long-duration exploration missions, it envisions astronauts operating more independently from Mission Control on Earth. This independence will drive the development of these highly automated and autonomous systems that astronauts will use daily. To prepare for this future, our team has developed a scheduling and execution software tool that facilitates self-scheduling, allowing astronauts to independently manage their own schedule without Mission Control’s involvement. Over many years, we have developed, matured, and evaluated our software tool in extreme environments, prioritizing user-centered design and high usability. These evaluations have included multiple campaigns in NASA analogs, including NEEMO, BASALT, and HERA, as well as technology demonstrations onboard the International Space Station. Our recent research on software interfaces for future astronaut autonomy revealed a strong correlation between usability and trust measures. In a controlled lab experiment, we asked novice users to perform a complex scheduling task, during which the software immediately validated the schedule’s constraints and checked for violations. We collected usability (User Experience Questionnaire, UEQ) and trust (Trust in Automated Systems scale, TAS) measures; significant, strong, and moderate correlations emerged between several of the UEQ metrics and TAS. These results support the argument for investing in usability early to enable and sustain trust in highly automated and autonomous systems.

usability↗

NASA NTRS1985

On evaluating parallel computer systems

A workshop was held in an attempt to program real problems on the MIT Static Data Flow Machine. Most of the architecture of the machine was specified but some parts were incomplete. The main purpose for the workshop was to explore principles for the evaluation of computer systems employing new architectures. Principles explored were: (1) evaluation must be an integral, ongoing part of a project to develop a computer of radically new architecture; (2) the evaluation should seek to measure the usability of the system as well as its performance; (3) users from the application domains must be an integral part of the evaluation process; and (4) evaluation results should be fed back into the design process. It is concluded that the general organizational principles are achievable in practice from this workshop.

Adams, George B., III↗

NASA NTRS1980

Stereosat - A new astrodynamics challenge

The paper investigates the astrodynamics requirements for a spacecraft which produces stereo images of the land masses of the earth for use in geoscience investigations, cartography and earth resource exploration. It describes a candidate Stereosat imaging product, presents criteria for evaluating potential image quality and usability, and assesses the impact of various spacecraft and astrodynamic factors on image quality. Several challenges are identified and discussed, namely (1) securing adequate image quality for pixel level elevation measurements, (2) determining absolute location of imaged phenomena in remote regions, (3) satisfying the long-term orbit prediction requirements, and (4) transmitting accurate orbit data along with the image data stream. Meeting these challenges will greatly enhance operational facility.

Driver, J. M.↗

NASA NTRS2016

Self-Guided Multimedia Stress Management and Resilience Training for Flight Controllers

Stress and anxiety-related problems are among the most common and costly behavioral health problems in society, and for those working in operational environments (i.e. astronauts, flight controllers, military) this can seriously impact crew performance, safety, and wellbeing. Technology-based interventions are effective for treating behavioral health problems, and can significantly improve the delivery of evidence-based health care. This study is evaluating the effectiveness, usefulness, and usability of a self-guided multimedia stress management and resilience training program in a randomized controlled trial (RCT) with a sample of flight controllers at Johnson Space Center. The intervention, SMART-OP (Stress Management and Resilience Training for Optimal Performance), is a six-session, cognitive behavioral-based computer program that uses self-guided, interactive activities to teach skills that can help individuals build resilience and manage stress. In a prior RCT with a sample of stressed but otherwise healthy individuals, SMART-OP reduced perceived stress and increased perceived control over stress in comparison to an Attention Control (AC) group. SMART-OP was rated as "highly useful" and "excellent" in usability and acceptability. Based on α-amylase data, individuals in SMART-OP recovered quicker and more completely from a social stress test as compared to the AC group [1]. In the current study, flight controllers are randomized either to receive SMART-OP training, or to a 6-week waitlist control period (WLC) before beginning SMART-OP. Eligible participants include JSC flight controllers and instructors without any medical or psychiatric disorder, but who are stressed based on self-report. Flight controllers provide a valid analog sample to astronauts in that they work in an operational setting, use similar terminology to astronauts, are mission-focused, and work under the same broader work culture. The study began in December 2014, and to date 79 flight controllers and instructors have expressed interest in the study, 49 of those were cleared for participation, we have screened 44 for eligibility, and 23 have met inclusion criteria. Recruitment is ongoing and the study will continue until December 2016. Outcome measures include perceived stress, perceived control over stress, resilience, mood, personality, emotion regulation, sleep, health behaviors, and psychophysiological data such as 24-hour heart rate, alpha amylase, and urinary and salivary cortisol. We are also collecting user feedback such as usability, working alliance, usefulness, and treatment credibility.

Rose, R. D.↗

NASA NTRSDate not supplied

Comparison of Detector Based and Source Based Absolute Radiance Standards

A detailed comparison of two separate radiometric calibration standards was conducted with analysis of error sources for each. One is a detector based standard, with radiance traceable to fundamental units using the electrical substitution method. The other is based on a calibrated field emission lamp (FEL) generating blackbody radiation. This study was motivated by the discontinuance of the FEL lamps by the manufacturer and a desire to calibrate sensors using non-blackbody spectral profiles. Three spectrometers were calibrated simultaneously by both methods to separate spectrometer artifacts from differences in the radiometric standards and error in the irradiance to radiance conversion procedure needed for the FEL. Conducting this study now is important to provide continuity between the extensive prior FEL based calibration database with a replacement method while calibrated FEL lamps are still available. This also begins a longer term repeatability study of the spectrometers used in this work for evaluation as calibrated transfer standards, usable with both monochromatic and broad spectrum radiance sources. Eliminating the tie to the FEL blackbody spectrum with a detector based standard allows for flexibility in the illumination source. In particular, for Earth science sensors intended for use with sunlit scenes, augmenting traditional tungsten halogen lighting with blue and ultraviolet light emitting diodes allows for a better match to the solar spectrum during laboratory testing.

radiometry↗

NASA NTRSDate not supplied

Comparison of Detector Based and Source Based Absolute Radiance Standards

radiometry↗

NASA NTRS2019

In-Flight Evaluation of the Traffic Aware Planner on the NASA HU-25A Guardian Aircraft

NASA’s Traffic Aware Planner (TAP) software is a research-prototype decision support tool that provides pilots with time- and fuel-saving route recommendations that optimize their current trajectory. The software runs on a first-of-a-kind system architecture onboard three aircraft in revenue service conducting operational evaluations with a major domestic airline. Therefore, significant NASA-internal testing is required prior to releasing the software to the partner airline. This paper describes a flight test plan that exercises the functionality of the TAP software in a representative operational environment, describes the system architecture developed and implemented for the NASA Langley HU-25A Guardian aircraft to support the test objectives, presents outcomes of the flight test campaign, and discusses use cases that demonstrate the value of flight testing for this activity.Research into flight path optimization of transport aircraft conducted by the National Aeronautics and SpaceAdministration (NASA) has produced an operational concept known as Traffic Aware Strategic Aircrew Requests(TASAR) [1, 2]. This near-term concept [3] provides the aircrew with a flight deck decision support tool known asthe Traffic Aware Planner (TAP). The TAP software leverages a growing number of information sources on the flightdeck to make time- and fuel-saving route optimization recommendations to the aircrew while en route. The aircrewcan then use the suggestions provided by the tool to make route change requests with a greater likelihood of acceptanceby air traffic control (ATC). Since TASAR is a concept intended for the current operational environment, it isintentionally designed to have no safety-critical impact or require any changes to current Federal AviationAdministration (FAA) rules and procedures [4, 5].The research prototype TAP system [6–8], explained further in Section III.C, continually incorporates up-to-dateaircraft state data from onboard avionics, as well as the latest position of surrounding traffic, the most recent windforecast, and the most recent convective weather forecast, in order to calculate candidate trajectory modifications thatimprove upon the current active route. These trajectories account for user-selectable objective functions [3] of reducedfuel burn, reduced flight time, or an airline-derived combination of factors known as trip cost. Previous analyses andsimulations have estimated substantial savings for airlines employing this technique within the U.S. National AirspaceSystem (NAS) [9–11]. Operational evaluations with Alaska Airlines seek to validate these projected benefits usingmeasured data while simultaneously providing benefits to the airline [12, 13].The TAP software has undergone a number of human-in-the-loop simulations [14] and flight test activities[15–17] in order to validate the operational concept, evaluate human factors considerations (e.g., workload, usability,distraction, etc.), and to assess the ability of the software to function in a representative operational environment (e.g.,connected to live avionics data, using in-flight internet connectivity, etc.). However, these simulations and flight testcampaigns did not account for the hardware architecture implemented on the three aircraft for Alaska Airlines’operational evaluations of the TAP software. Therefore, a need was identified to thoroughly test the functionality ofthe software in a similar hardware architecture to that of the partner airline’s aircraft. Information regarding testapparatus and environments used to evaluate TAP prior to testing on the HU-25A can be found in reference [18].A campaign of flight trials on a NASA aircraft, the HU-25A Guardian, was conducted to ensure that the researchprototype TAP system functions well in a configuration similar to the Alaska Airlines aircraft prior to deployment.This airborne, networked environment enables an assessment of the operational factors unique to the flight environment. Additionally, this activity evaluated the effectiveness and benefit of new TAP functionality andoperation in a relevant flight environment while allowing the rapid prototyping of new concepts and features.This paper is organized as follows: Section II discusses the details of the flight test plan, flight profiles, and theduties of personnel involved with conducting flight operations. Section III describes the test platform, avionicsequipage, and system architecture. Section IV presents a discussion of results, and Section V contains concludingremarks.

Underwood, Matthew C.↗

NASA NTRS1997

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.↗

NASA NTRS1973

Evaluation of ERTS-1 imagery in mapping and managing soil and range resources in the Sand Hills Region of Nebraska

The author has identified the following significant results. Collection of ground truth data provided ground cover percent and the components of ground cover makeup. Percent bare soil appears to have greatest influence on imagery density of sites studied. Forage density estimates can be made on band 5 of MSS, provided site category identification is known. Additional data are provided concerning forage density and vegetation-soil relationship by color composites of MSS imagery. Reflectance differences shown on MSS bands 6 and 7 by Sand Hills lakes are related to water quality and possibly more specifically to total dissolved ions present in the water. Winter imagery with snow cover and low sun angle shows a marked enhancement of topography are associated with differences in forage density. High altitude color infrared photography appears to be a usable tool for recognition, measurement, and evaluation of go-back land.

Seevers, P. M.↗

NASA NTRS1978

Development of a preprototype vapor compression distillation water recovery subsystem

The activities involved in the design, development, and test of a preprototype vapor compression distillation water recovery subsystem are described. This subsystem, part of a larger regenerative life support evaluation system, is designed to recover usable water from urine, urinal rinse water, and concentrated shower and laundry brine collected from three space vehicle crewmen for a period of 180 days without resupply. Details of preliminary design and testing as well as component developments are included. Trade studies, considerations leading to concept selections, problems encountered, and test data are also presented. The rework of existing hardware, subsystem development including computer programs, assembly verification, and comprehensive baseline test results are discussed.

Johnson, K. L.↗

NASA NTRS1987

Commercial potential of European and Japanese space programs, task 5

The current and expected future competitive status in the commercialization of space of the two principal programs competitive with NASA: the European Space Agency (ESA) and the program sponsored by the Ministry of International Trade and Industry (MITI) of Japan are evaluated, quantitatively assessed, and presented in usable format.

Source record↗

NASA NTRS2008

Piloted Evaluation of the H-Mode, a Variable Autonomy Control System, in Motion-Based Simulation

As aircraft become able to autonomously respond to a range of situations with performance surpassing human operators, we are compelled to look for new methods that help understand their use and guide the design of new, more effective forms of automation and interaction. The "H-mode" is one such method and is based on the metaphor of a well-trained horse. The concept allows the pilot to manage a broad range of control automation functionality, from augmented manual control to FMS-like coupling and automation initiated actions, using a common interface system and easily learned set of interaction skills. The interface leverages familiar manual control interfaces (e.g., the control stick) and flight displays through the addition of contextually dependent haptic-multimodal elements. The concept is relevant to manned and remotely piloted vehicles. This paper provides an overview of the H-mode concept followed by a presentation of the results from a recent evaluation conducted in a motion-based simulator. The evaluation focused on assessing the overall usability and flying qualities of the concept with an emphasis on the effects of turbulence and cockpit motion. Because the H-mode results in interactions between traditional flying qualities and management of higher-level flight path automation, these effects are of particular interest. The results indicate that the concept may provide a useful complement or replacement to conventional interfaces, and retains the usefulness in the presence of turbulence and motion.

Goodrich, Kenneth H.↗

NASA NTRS2010

Human Engineering of Space Vehicle Displays and Controls

Proper attention to the integration of the human needs in the vehicle displays and controls design process creates a safe and productive environment for crew. Although this integration is critical for all phases of flight, for crew interfaces that are used during dynamic phases (e.g., ascent and entry), the integration is particularly important because of demanding environmental conditions. This panel addresses the process of how human engineering involvement ensures that human-system integration occurs early in the design and development process and continues throughout the lifecycle of a vehicle. This process includes the development of requirements and quantitative metrics to measure design success, research on fundamental design questions, human-in-the-loop evaluations, and iterative design. Processes and results from research on displays and controls; the creation and validation of usability, workload, and consistency metrics; and the design and evaluation of crew interfaces for NASA's Crew Exploration Vehicle are used as case studies.

Whitmore, Mihriban↗

NASA NTRSDate not supplied

A Crew Seat for Human Exploration in Multiple Gravity Environments

This work attempts to develop a single crew seating solution that is applicable across a range of gravity environments encountered by spacecraft proposed in several conceptual spacecraft architectures. All of these spacecraft will need to provide some sort of stationary accommodation for the crew for performing various activities such as work in science laboratories, maintenance and repair facilities, medical care facilities, and spacecraft operations centers, as well as for basic habitation in crew quarters, entertainment / relaxation facilities, and crew dining facilities. Depending on the spacecraft or architecture, this stationary accommodation may be experienced continuously in microgravity, such as would be the case for the Deep Space Exploration Vehicle. Alternately, it could be in continuous lunar or Martian gravity, such as the Common Habitat base camps. It could experience fractional gravity, such as a Pressurized Rover for In-Space Missions at a Near Earth Asteroid or one of the Martian moons. It could alternate between artificial gravity and microgravity, such as the Nautilus-X. It could alternate between microgravity and lunar or Martian gravity, such as the SpaceX Starship Human Landing System or the Blue Origin Blue Moon Block 2 Human Landing System. Or it could be in continuous Earth gravity, such as ground trainer systems. Prior human spaceflight systems for stationary accommodation have been focused on microgravity applications. These systems have their own limitations and cannot be used in a gravity environment. A public crowdsourcing campaign generated dozens of ideas, which ultimately generated a Gecko Mobility Aids system for crew translation and the Multi-Gravity Crew Seat (MGCS) for stationary accommodation. The MGCS functions in gravity as a traditional terrestrial seat, performing functions of load for the overall body and forearms, as well as head and neck load relief while positioning the body within range of an intended task. In microgravity, the MGCS functions as a body restraint, securing the body against inadvertent drifting by applying a restraining pressure at the front and back of the thighs, shoulders, and back. The initial MGCS concept was developed in a NASA hackathon and was refined through a review of dozens of terrestrial seating styles. Additionally, a review of anthropometry and biomechanics data related to the neutral body posture was conducted to help inform the microgravity configuration of the MGCS. A series of CAD models were iteratively developed, with subject matter expert reviews leading to design improvements. A scale model was constructed and used with a humanoid model to demonstrate MGCS accommodation of a human-like body in both gravity and microgravity modes. Work to develop a full-scale protype of the MGCS is discussed, including design and fabrication of the headrest, arm rest, seat back, seat pan, seat base, and the conversion mechanisms. A 1-g human-in-the-loop evaluation of the prototype assessed the acceptability of performing seated activities in the MGCS, collecting data on the usability, comfort, and ease of ingress/egress. Based on the evaluation results, design modifications needed for reduced gravity testing are documented and initial work is indicated for a reduced gravity test plan.

Restraints and Mobility Aids↗

NASA NTRS1986

NASA PC software evaluation project

The USL NASA PC software evaluation project is intended to provide a structured framework for facilitating the development of quality NASA PC software products. The project will assist NASA PC development staff to understand the characteristics and functions of NASA PC software products. Based on the results of the project teams' evaluations and recommendations, users can judge the reliability, usability, acceptability, maintainability and customizability of all the PC software products. The objective here is to provide initial, high-level specifications and guidelines for NASA PC software evaluation. The primary tasks to be addressed in this project are as follows: to gain a strong understanding of what software evaluation entails and how to organize a structured software evaluation process; to define a structured methodology for conducting the software evaluation process; to develop a set of PC software evaluation criteria and evaluation rating scales; and to conduct PC software evaluations in accordance with the identified methodology. Communication Packages, Network System Software, Graphics Support Software, Environment Management Software, General Utilities. This report represents one of the 72 attachment reports to the University of Southwestern Louisiana's Final Report on NASA Grant NGT-19-010-900. Accordingly, appropriate care should be taken in using this report out of context of the full Final Report.

Dominick, Wayne D.↗

NASA NTRS2014

Learning Extended Finite State Machines

We present an active learning algorithm for inferring extended finite state machines (EFSM)s, combining data flow and control behavior. Key to our learning technique is a novel learning model based on so-called tree queries. The learning algorithm uses the tree queries to infer symbolic data constraints on parameters, e.g., sequence numbers, time stamps, identifiers, or even simple arithmetic. We describe sufficient conditions for the properties that the symbolic constraints provided by a tree query in general must have to be usable in our learning model. We have evaluated our algorithm in a black-box scenario, where tree queries are realized through (black-box) testing. Our case studies include connection establishment in TCP and a priority queue from the Java Class Library.

NASA NTRS2009

Usability: Human Research Program - Space Human Factors and Habitability

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Sandor, Aniko↗