Search NASASearch

SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Data Visualization of Invisible Airflow Hazards During Helicopter Takeoff and Landing Operations

Many aircraft accidents each year are caused by encounters with unseen airflow hazards near the ground such as vortices, downdrafts, wind shear, microbursts, or other turbulence. While such hazards frequently pose problems to fixed-wing airplanes, they are especially dangerous to helicopters, which often have to operate in confined spaces and under operationally stressful conditions. We are developing flight-deck visualizations of airflow hazards during helicopter takeoff and landing operations, and are evaluating their effectiveness with usability studies. Our hope is.that this work will lead to the production of an airflow hazard detection system for pilots that will save lives.

Aragon, Cecilia R.

Dynamic Countermeasure Fabrics for Post-Spaceflight Orthostatic Intolerance

Aerospace orthostatic intolerance garments (OIG) have historically been pneumatic (e.g., NASA’s antigravity suit), an approach that inhibits mobility and requires connection to an air supply. Elastic compression garments, an alternative technology, are difficult to don/doff and cannot be worn in a noncompressive state, resulting in discomfort and usability challenges. This research evaluates a novel technology—contractile shape memory alloy (SMA) knitted actuators—that can enable low-profile, dynamic compression for an aerospace OIG. To characterize the functional capabilities of SMA knitted actuators, displacement control testing was conducted on 10 actuator samples with a range of geometric design parameters. Inactive (FI) and actuated forces (FA) were observed by repeatedly thermally cycling each sample at 0%, 15%, 30%, and 45% structural strain. Compression capabilities were approximated using medical compression hosiery standards and anthropometric data from a representative aerospace population (ANSUR 2012). Dynamic compression predictions reached 52 mmHg (single layer fabric) and 105 mmHg (double layer fabric) at the ankle. Low, inactive pressures (p, 20 mmHg) demonstrate that compression is controllable and can be dynamically increased upon actuation up to 33 mmHg in a single layer system and up to 67 mmHg in a double layer system. The results highlight the potential of SMA knitted actuators to enable low-profile, dynamic compression garments that can reach medically therapeutic pressures on an aerospace population to counteract OI symptoms. In addition to astronautic applications, this technology demonstrates widespread terrestrial medical and high-performance aircraft applicability.

Orthostatic intolerance

A Comparison of Physical and Virtual Reality for the Assessment of Habitat Usability

Can virtual reality (VR) be used to conduct a habitat usability assessment? Traditionally habitat evaluations are conducted with physical mockups of the environment and task. - Potential benefits of VR include reduced costs for prototyping and faster iterative design based on feedback. - Currently, it is unclear if task performance in VR can be considered equivalent to the same task as performed in physical reality (PR).

Vanessa L. Jones

Evaluation of Life Sciences Glovebox (LSG) and Multi-Purpose Crew Restraint Concepts

Within the scope of the Multi-purpose Crew Restraints for Long Duration Spaceflights project, funded by Code U, it was proposed to conduct a series of evaluations on the ground and on the KC-135 to investigate the human factors issues concerning confined/unique workstations, such as the design of crew restraints. The usability of multiple crew restraints was evaluated for use with the Life Sciences Glovebox (LSG) and for performing general purpose tasks. The purpose of the KC-135 microgravity evaluation was to: (1) to investigate the usability and effectiveness of the concepts developed, (2) to gather recommendations for further development of the concepts, and (3) to verify the validity of the existing requirements. Some designs had already been tested during a March KC-135 evaluation, and testing revealed the need for modifications/enhancements. This flight was designed to test the new iterations, as well as some new concepts. This flight also involved higher fidelity tasks in the LSG, and the addition of load cells on the gloveports.

Whitmore, Mihriban

Improving the User Interface of the DeepLynx Data Warehouse

DeepLynx is an open-source ontology-based data warehouse created by INL to support the creation and life cycle of digital engineering projects, with a particular emphasis on digital twins [1]. Digital twins are systems that represent physical assets and process in a real-time digital environment [1]. Most well-known commercial data warehouses use Graphical User Interfaces (GUIs) for users to interact with their systems [3]. Limited publications have addressed the design of these interfaces and understanding of their target users. The current users and development team acknowledge the need to improve the current UI, not just for aesthetics but to improve functionality and workflow of DeepLynx. Traditional data warehouse users are developers, data scientists and business analysts [2]. DeepLynx users have a vast range of experience using data warehouses, and diverse roles, including engineers, scientists and management positions. Because there is a broader audience of target users for DeepLynx than a typical data warehouse, it is essential that DeepLynx has a useable and intuitive user interface. To achieve this the team performed human-computer interaction methods, including a Heuristic Evaluation of current UI using Neilsen’s Usability Heuristic, create personas based on current users by designing a user survey, data analysis and develop of personas. Followed by a redesign of the UI following using Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design in industry standard software Figma. Lastly a Heuristic Evaluation of new UI design, using Neilsen’s Usability Heuristic and User testing of redesign UI and have a group of users complete a Thinking Aloud Test of the new UI. Preliminary results of the Heuristic Evaluation of current UI arise issue with Consistency and Standards, Visibility of System Status, Match System and Real World and Recognition Rather than Recall. These issues were addressed in the proposed redesign by applying Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design. Next steps include formalized list of lessons learned and design implications for future publications.

97 MATHEMATICS AND COMPUTING

What is the Role of Usability and Trust in Autonomy?

Usability encompasses learnability, efficiency, memorability, effectiveness, and satisfaction. NASA’s standards for usability acceptance criteria focus on interfaces that help operators achieve their tasks efficiently, effectively, and with satisfaction. However, discussions on usability, especially regarding future highly automated and autonomous systems, rarely include trust. As NASA plans for long-duration exploration missions, it envisions astronauts operating more independently from Mission Control on Earth. This independence will drive the development of these highly automated and autonomous systems that astronauts will use daily. To prepare for this future, our team has developed a scheduling and execution software tool that facilitates self-scheduling, allowing astronauts to independently manage their own schedule without Mission Control’s involvement. Over many years, we have developed, matured, and evaluated our software tool in extreme environments, prioritizing user-centered design and high usability. These evaluations have included multiple campaigns in NASA analogs, including NEEMO, BASALT, and HERA, as well as technology demonstrations onboard the International Space Station. Our recent research on software interfaces for future astronaut autonomy revealed a strong correlation between usability and trust measures. In a controlled lab experiment, we asked novice users to perform a complex scheduling task, during which the software immediately validated the schedule’s constraints and checked for violations. We collected usability (User Experience Questionnaire, UEQ) and trust (Trust in Automated Systems scale, TAS) measures; significant, strong, and moderate correlations emerged between several of the UEQ metrics and TAS. These results support the argument for investing in usability early to enable and sustain trust in highly automated and autonomous systems.

usability

On evaluating parallel computer systems

A workshop was held in an attempt to program real problems on the MIT Static Data Flow Machine. Most of the architecture of the machine was specified but some parts were incomplete. The main purpose for the workshop was to explore principles for the evaluation of computer systems employing new architectures. Principles explored were: (1) evaluation must be an integral, ongoing part of a project to develop a computer of radically new architecture; (2) the evaluation should seek to measure the usability of the system as well as its performance; (3) users from the application domains must be an integral part of the evaluation process; and (4) evaluation results should be fed back into the design process. It is concluded that the general organizational principles are achievable in practice from this workshop.

Adams, George B., III

Stereosat - A new astrodynamics challenge

The paper investigates the astrodynamics requirements for a spacecraft which produces stereo images of the land masses of the earth for use in geoscience investigations, cartography and earth resource exploration. It describes a candidate Stereosat imaging product, presents criteria for evaluating potential image quality and usability, and assesses the impact of various spacecraft and astrodynamic factors on image quality. Several challenges are identified and discussed, namely (1) securing adequate image quality for pixel level elevation measurements, (2) determining absolute location of imaged phenomena in remote regions, (3) satisfying the long-term orbit prediction requirements, and (4) transmitting accurate orbit data along with the image data stream. Meeting these challenges will greatly enhance operational facility.

Driver, J. M.

Self-Guided Multimedia Stress Management and Resilience Training for Flight Controllers

Stress and anxiety-related problems are among the most common and costly behavioral health problems in society, and for those working in operational environments (i.e. astronauts, flight controllers, military) this can seriously impact crew performance, safety, and wellbeing. Technology-based interventions are effective for treating behavioral health problems, and can significantly improve the delivery of evidence-based health care. This study is evaluating the effectiveness, usefulness, and usability of a self-guided multimedia stress management and resilience training program in a randomized controlled trial (RCT) with a sample of flight controllers at Johnson Space Center. The intervention, SMART-OP (Stress Management and Resilience Training for Optimal Performance), is a six-session, cognitive behavioral-based computer program that uses self-guided, interactive activities to teach skills that can help individuals build resilience and manage stress. In a prior RCT with a sample of stressed but otherwise healthy individuals, SMART-OP reduced perceived stress and increased perceived control over stress in comparison to an Attention Control (AC) group. SMART-OP was rated as "highly useful" and "excellent" in usability and acceptability. Based on α-amylase data, individuals in SMART-OP recovered quicker and more completely from a social stress test as compared to the AC group [1]. In the current study, flight controllers are randomized either to receive SMART-OP training, or to a 6-week waitlist control period (WLC) before beginning SMART-OP. Eligible participants include JSC flight controllers and instructors without any medical or psychiatric disorder, but who are stressed based on self-report. Flight controllers provide a valid analog sample to astronauts in that they work in an operational setting, use similar terminology to astronauts, are mission-focused, and work under the same broader work culture. The study began in December 2014, and to date 79 flight controllers and instructors have expressed interest in the study, 49 of those were cleared for participation, we have screened 44 for eligibility, and 23 have met inclusion criteria. Recruitment is ongoing and the study will continue until December 2016. Outcome measures include perceived stress, perceived control over stress, resilience, mood, personality, emotion regulation, sleep, health behaviors, and psychophysiological data such as 24-hour heart rate, alpha amylase, and urinary and salivary cortisol. We are also collecting user feedback such as usability, working alliance, usefulness, and treatment credibility.

Rose, R. D.

Comparison of Detector Based and Source Based Absolute Radiance Standards

A detailed comparison of two separate radiometric calibration standards was conducted with analysis of error sources for each. One is a detector based standard, with radiance traceable to fundamental units using the electrical substitution method. The other is based on a calibrated field emission lamp (FEL) generating blackbody radiation. This study was motivated by the discontinuance of the FEL lamps by the manufacturer and a desire to calibrate sensors using non-blackbody spectral profiles. Three spectrometers were calibrated simultaneously by both methods to separate spectrometer artifacts from differences in the radiometric standards and error in the irradiance to radiance conversion procedure needed for the FEL. Conducting this study now is important to provide continuity between the extensive prior FEL based calibration database with a replacement method while calibrated FEL lamps are still available. This also begins a longer term repeatability study of the spectrometers used in this work for evaluation as calibrated transfer standards, usable with both monochromatic and broad spectrum radiance sources. Eliminating the tie to the FEL blackbody spectrum with a detector based standard allows for flexibility in the illumination source. In particular, for Earth science sensors intended for use with sunlit scenes, augmenting traditional tungsten halogen lighting with blue and ultraviolet light emitting diodes allows for a better match to the solar spectrum during laboratory testing.

radiometry

Comparison of Detector Based and Source Based Absolute Radiance Standards

A detailed comparison of two separate radiometric calibration standards was conducted with analysis of error sources for each. One is a detector based standard, with radiance traceable to fundamental units using the electrical substitution method. The other is based on a calibrated field emission lamp (FEL) generating blackbody radiation. This study was motivated by the discontinuance of the FEL lamps by the manufacturer and a desire to calibrate sensors using non-blackbody spectral profiles. Three spectrometers were calibrated simultaneously by both methods to separate spectrometer artifacts from differences in the radiometric standards and error in the irradiance to radiance conversion procedure needed for the FEL. Conducting this study now is important to provide continuity between the extensive prior FEL based calibration database with a replacement method while calibrated FEL lamps are still available. This also begins a longer term repeatability study of the spectrometers used in this work for evaluation as calibrated transfer standards, usable with both monochromatic and broad spectrum radiance sources. Eliminating the tie to the FEL blackbody spectrum with a detector based standard allows for flexibility in the illumination source. In particular, for Earth science sensors intended for use with sunlit scenes, augmenting traditional tungsten halogen lighting with blue and ultraviolet light emitting diodes allows for a better match to the solar spectrum during laboratory testing.

radiometry

In-Flight Evaluation of the Traffic Aware Planner on the NASA HU-25A Guardian Aircraft

NASA’s Traffic Aware Planner (TAP) software is a research-prototype decision support tool that provides pilots with time- and fuel-saving route recommendations that optimize their current trajectory. The software runs on a first-of-a-kind system architecture onboard three aircraft in revenue service conducting operational evaluations with a major domestic airline. Therefore, significant NASA-internal testing is required prior to releasing the software to the partner airline. This paper describes a flight test plan that exercises the functionality of the TAP software in a representative operational environment, describes the system architecture developed and implemented for the NASA Langley HU-25A Guardian aircraft to support the test objectives, presents outcomes of the flight test campaign, and discusses use cases that demonstrate the value of flight testing for this activity.Research into flight path optimization of transport aircraft conducted by the National Aeronautics and SpaceAdministration (NASA) has produced an operational concept known as Traffic Aware Strategic Aircrew Requests(TASAR) [1, 2]. This near-term concept [3] provides the aircrew with a flight deck decision support tool known asthe Traffic Aware Planner (TAP). The TAP software leverages a growing number of information sources on the flightdeck to make time- and fuel-saving route optimization recommendations to the aircrew while en route. The aircrewcan then use the suggestions provided by the tool to make route change requests with a greater likelihood of acceptanceby air traffic control (ATC). Since TASAR is a concept intended for the current operational environment, it isintentionally designed to have no safety-critical impact or require any changes to current Federal AviationAdministration (FAA) rules and procedures [4, 5].The research prototype TAP system [6–8], explained further in Section III.C, continually incorporates up-to-dateaircraft state data from onboard avionics, as well as the latest position of surrounding traffic, the most recent windforecast, and the most recent convective weather forecast, in order to calculate candidate trajectory modifications thatimprove upon the current active route. These trajectories account for user-selectable objective functions [3] of reducedfuel burn, reduced flight time, or an airline-derived combination of factors known as trip cost. Previous analyses andsimulations have estimated substantial savings for airlines employing this technique within the U.S. National AirspaceSystem (NAS) [9–11]. Operational evaluations with Alaska Airlines seek to validate these projected benefits usingmeasured data while simultaneously providing benefits to the airline [12, 13].The TAP software has undergone a number of human-in-the-loop simulations [14] and flight test activities[15–17] in order to validate the operational concept, evaluate human factors considerations (e.g., workload, usability,distraction, etc.), and to assess the ability of the software to function in a representative operational environment (e.g.,connected to live avionics data, using in-flight internet connectivity, etc.). However, these simulations and flight testcampaigns did not account for the hardware architecture implemented on the three aircraft for Alaska Airlines’operational evaluations of the TAP software. Therefore, a need was identified to thoroughly test the functionality ofthe software in a similar hardware architecture to that of the partner airline’s aircraft. Information regarding testapparatus and environments used to evaluate TAP prior to testing on the HU-25A can be found in reference [18].A campaign of flight trials on a NASA aircraft, the HU-25A Guardian, was conducted to ensure that the researchprototype TAP system functions well in a configuration similar to the Alaska Airlines aircraft prior to deployment.This airborne, networked environment enables an assessment of the operational factors unique to the flight environment. Additionally, this activity evaluated the effectiveness and benefit of new TAP functionality andoperation in a relevant flight environment while allowing the rapid prototyping of new concepts and features.This paper is organized as follows: Section II discusses the details of the flight test plan, flight profiles, and theduties of personnel involved with conducting flight operations. Section III describes the test platform, avionicsequipage, and system architecture. Section IV presents a discussion of results, and Section V contains concludingremarks.

Underwood, Matthew C.

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.

Evaluation of ERTS-1 imagery in mapping and managing soil and range resources in the Sand Hills Region of Nebraska

The author has identified the following significant results. Collection of ground truth data provided ground cover percent and the components of ground cover makeup. Percent bare soil appears to have greatest influence on imagery density of sites studied. Forage density estimates can be made on band 5 of MSS, provided site category identification is known. Additional data are provided concerning forage density and vegetation-soil relationship by color composites of MSS imagery. Reflectance differences shown on MSS bands 6 and 7 by Sand Hills lakes are related to water quality and possibly more specifically to total dissolved ions present in the water. Winter imagery with snow cover and low sun angle shows a marked enhancement of topography are associated with differences in forage density. High altitude color infrared photography appears to be a usable tool for recognition, measurement, and evaluation of go-back land.

Seevers, P. M.

Development of a preprototype vapor compression distillation water recovery subsystem

The activities involved in the design, development, and test of a preprototype vapor compression distillation water recovery subsystem are described. This subsystem, part of a larger regenerative life support evaluation system, is designed to recover usable water from urine, urinal rinse water, and concentrated shower and laundry brine collected from three space vehicle crewmen for a period of 180 days without resupply. Details of preliminary design and testing as well as component developments are included. Trade studies, considerations leading to concept selections, problems encountered, and test data are also presented. The rework of existing hardware, subsystem development including computer programs, assembly verification, and comprehensive baseline test results are discussed.

Johnson, K. L.

Commercial potential of European and Japanese space programs, task 5

The current and expected future competitive status in the commercialization of space of the two principal programs competitive with NASA: the European Space Agency (ESA) and the program sponsored by the Ministry of International Trade and Industry (MITI) of Japan are evaluated, quantitatively assessed, and presented in usable format.

Source record