Results for “usability evaluation” — Page 6

DOE OSTI2025

Trusted Simulation: Considering Model Quality in the Context of User Trust

A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.

Naugle, Asmeret Bier [Sandia National Laboratories↗

NASA NTRS1991

Approach range and velocity determination using laser sensors and retroreflector targets

Rockwell International is conducting an ongoing program to develop Laser Docking Sensors (LDS) that provide high performance and high intrinsic value while meeting all mission objectives. These LDS systems are now being required to aid future spacecraft docking, station keeping, and berthing/capture systems. Improved automated tracking, rendezvous, soft docking, and capture will be required in the construction and support of SSF and future orbiting platforms. The development of a practical LDS requires an easy-to-operate, low-cost, compact system. A wide range of options for laser range detection equipment, ranging from commercial technology to specialized military systems, was evaluated. This evaluation focused on both direct applicability of existing systems and usability of specific technologies contained in these systems. From these efforts it was determined that a new approach provided the greatest promise of fulfilling all mission requirements at the lowest life-cycle cost.

Race, L.↗

NASA NTRS1997

NiH2 Battery Reconditioning for LEO Applications

This paper summarizes reasons for and benefits of reconditioning nickel-hydrogen (NiH2) batteries used for Low Earth Orbit (LEO) applications. NiH2 battery cells do not have the classic discharge voltage problems more commonly associated with nickel-cadmium (NiCd) cells. This is due, in part, to use of hydrogen electrodes in place of cadmium electrodes. The nickel electrode, however, does have a similar discharge voltage signature for both cell designs. This can have an impact on LEO applications where peak loads at higher relative depths of discharge can impact operations. Periodic reconditioning provides information which can be used for analyzing long term performance trends to predict usable capacity to a specified voltage level. The reconditioning process described herein involves discharging NiH2 batteries at C/20 rates or less, to an average cell voltage of 1.0 volts or less. Recharge is performed at nominal C/5 rates to specified voltage/temperature (V/T) charge levels selected to restore required capacity with minimal overcharge. Reconditioning is a process of restoring reserve capacity lost on cycling, which is commonly called the memory effect in NiCd cells. This effect is characterized by decreases in the discharge voltage curve with operational life and cycling. The end effect of reconditioning NiH2 cells may be hidden in the versatility, of that design over the NiCd cell design and its associated negative electrode fading problem. The process of deep discharge at lower rates by way of reconditioning tends to redistribute electrolyte and water in the NiH2 cell electrode stack, while improving utilization and charge efficiency. NiH2 battery reconditioning effects on life are considered beneficial and may, in fact. extend life based on NiCd experience. In any case, usable capacity data obtained from reconditioning is required for performance evaluation and trend analysis. Characterization and life tests have provided the historical data base used to determine the need for reconditioning in most battery applications. The following sections briefly describe the background of NiH2 battery reconditioning and testing at Lockheed Martin Missiles & Space (LMMS) and other aerospace companies.

Armantrout, J. D.↗

NASA NTRS2005

Human Factors Assessment of Respiratory Support Pack (RSP) Cue Card

The Respiratory Support Pack (RSP) is a medical pack onboard the International Space Station (ISS) that contains much of the necessary equipment for providing aid to a conscious or unconscious crewmember in respiratory distress. Inside the RSP lid pocket is a 5.5 by 11 inch paper cue card, which is used by a Crew Medical Officer as the procedure to set up the equipment and deliver oxygen to a crewmember. In training, crewmembers expressed concerns about the readability and usability of the cue card; consequently, updating the cue card was prioritized as an activity to be completed prior to Space Shuttle return-to-flight. The Usability Testing and Analysis Facility at the Johnson Space Center evaluated the current layout of the cue card, and proposed several new cue card designs based on human factors principals. A series of three studies were performed in order to experimentally compare performance with each of the cue card designs. Nonmedically trained personnel used either a redesigned RSP cue card, or the original card to simulate resuscitation (using a mannequin along with the hardware). Time to completion, errors and subjective ratings were recorded. The addition of pictures, colors, borders, and simplification of the flow of information (making minimal changes to the actual procedure content) elicited great benefits during testing. Time to complete RSP procedures was reduced by as much as three minutes with the final cue card design. Detailed results from these studies, as well as general guidelines for cue card design will be discussed.

Whitmore, Mihriban↗

NASA NTRSDate not supplied

Cross-Measurement Comparisons for a CFD Validation Dataset on Mach 2.5 Axisymmetric Turbulent Shock-Wave/Boundary-Layer Interactions

Experimental data for a shock-wave/boundary-layer interaction has been collected using multiple measurement techniques. Unfortunately, diversity of methods for acquisition begets an aggregation of data which does not directly quantify the same properties of the flowfield. The objective in this paper was to (a) present the collection of flowfield measurements in one venue in a format more usable for those validating CFD models against the data, (b) evaluate the degree to which the experimental data support each other, and (c) highlight the differences and relative advantages/shortcomings of each measurement techniques. To present the various measured quantities into common format, CFD results from a companion paper also submitted for presentation at this meeting are utilized. For the case where the boundary layer remains attached, there is agreement between the various measurements as well as with Reynolds-averaged Navier-Stokes simulation solutions. As the impinging shock strength is increased beyond the point of separating the boundary layer, the congruity of the data wanes. Generally, agreement among the measurements exceeds the degree to which the CFD solutions agree with experiments. This suggests that unmodeled physical phenomena, such as transient motion of the reflected shock and separation bubble, give rise to the discrepancies observed in the computational results.

Shock-wave Boundary-layer interaction↗

NASA NTRS2003

An Independent Human Factors Analysis and Evaluation of the Emergency Medical Protocol Checklist for the International Space Station

Emergency medical capabilities aboard the ISS include a Crew Medical Officer (CMO) (not necessarily a physician), and back-up, resuscitation equipment, and a medical checklist. It is essential that CMOs have reliable, usable and informative medical protocols that can be carried out independently in flight. The study evaluates the existing ISS Medical Checklist layout against a checklist updated to reflect a human factors approach to structure and organization. Method: The ISS Medical checklist was divided into non-emergency and emergency sections, and re-organized based on alphabetical and a body systems approach. A desk-top evaluation examined the ability of subjects to navigate to specific medical problems identified as representative of likely non-emergency events. A second evaluation aims to focus on the emergency section of the Medical Checklist, based on the preliminary findings of the first. The final evaluation will use Astronaut CMOs as subjects comparing the original checklist against the updated layout in the task of caring for a "downed crewmember" using a Human Patient Simulator [Medical Education Technologies, Inc.]. Results: Initial results have demonstrated a clear improvement of the re-organized sections to determine the solution to the medical problems. There was no distinct advantage for either alternative, although subjects stated having a preference for the body systems approach. In the second evaluation, subjects will be asked to identify emergency medical conditions, with measures including correct diagnosis, time to completion and solution strategy. The third evaluation will compare the original and fully updated checklists in clinical situations. Conclusions: Initial findings indicate that the ISS Medical Checklist will benefit from a reorganization. The present structure of the checklist has evolved over recent years without systematic testing of crewmember ability to diagnose medical problems. The improvements are expected to enable ISS Crewmembers to more speedily and accurately respond to medical situations on the ISS.

Marshburn, Thomas↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four crew evaluations on prototypes for the different LOO hardware. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four crew evaluations on prototypes for the different LOO hardware. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRS1986

Development of an Ada package library

A usable prototype Ada package library was developed and is currently being evaluated for use in large software development efforts. The library system is comprised of an Ada-oriented design language used to facilitate the collection of reuse information, a relational data base to store reuse information, a set of reusable Ada components and tools, and a set of guidelines governing the system's use. The prototyping exercise is discussed and the lessons learned from it have led to the definition of a comprehensive tool set to facilitate software reuse.

Burton, Bruce↗

NASA NTRS2006

Development of Point Doppler Velocimetry for Flow Field Investigations

A Point Doppler Velocimeter (pDv) has been developed using a vapor-limited iodine cell as the sensing medium. The iodine cell is utilized to directly measure the Doppler shift frequency of laser light scattered from submicron particles suspended within a fluid flow. The measured Doppler shift can then be used to compute the velocity of the particles, and hence the fluid. Since this approach does not require resolution of scattered light from individual particles, the potential exists to obtain temporally continuous signals that could be uniformly sampled in the manner as a hot wire anemometer. This leads to the possibility of obtaining flow turbulence power spectra without the limitations of fringe-type laser velocimetry. The development program consisted of a methodical investigation of the technology coupled with the solution of practical engineering problems to produce a usable measurement system. The paper outlines this development along with the evaluation of the resulting system as compared to primary standards and other measurement technologies.

Cavone, Angelo A.↗

NASA NTRS2007

Human Factors Assessment and Redesign of the ISS Respiratory Support Pack (RSP) Cue Card

The Respiratory Support Pack (RSP) is a medical pack onboard the International Space Station (ISS) that contains much of the necessary equipment for providing aid to a conscious or unconscious crewmember in respiratory distress. Inside the RSP lid pocket is a 5.5 by 11 inch paper procedural cue card, which is used by a Crew Medical Officer (CMO) to set up the equipment and deliver oxygen to a crewmember. In training, crewmembers expressed concerns about the readability and usability of the cue card; consequently, updating the cue card was prioritized as an activity to be completed. The Usability Testing and Analysis Facility at the Johnson Space Center (JSC) evaluated the original layout of the cue card, and proposed several new cue card designs based on human factors principles. The approach taken for the assessment was an iterative process. First, in order to completely understand the issues with the RSP cue card, crewmember post training comments regarding the RSP cue card were taken into consideration. Over the course of the iterative process, the procedural information was reorganized into a linear flow after the removal of irrelevant (non-emergency) content. Pictures, color coding, and borders were added to highlight key components in the RSP to aid in quickly identifying those components. There were minimal changes to the actual text content. Three studies were conducted using non-medically trained JSC personnel (total of 34 participants). Non-medically trained personnel participated in order to approximate a scenario of limited CMO exposure to the RSP equipment and training (which can occur six months prior to the mission). In each study, participants were asked to perform two respiratory distress scenarios using one of the cue card designs to simulate resuscitation (using a mannequin along with the hardware). Procedure completion time, errors, and subjective ratings were recorded. The last iteration of the cue card featured a schematic of the RSP, colors, borders, and simplification of the flow of information. The time to complete the RSP procedure was reduced by approximately three minutes with the new design. In an emergency situation, three minutes significantly increases the probability of saving a life. In addition, participants showed the highest preference for this design. The results of the studies and the new design were presented to a focus group of astronauts, flight surgeons, medical trainers, and procedures personnel. The final cue card was presented to a medical control board and approved for flight. The revised RSP cue card is currently onboard ISS.

Byrne, Vicky↗

NASA NTRS2015

Freeform Optical Design of Two Mirror Telescopes

Two Mirror telescopes composed of freeform optical surfaces are investigated and surveyed to explore the usable design space. F-number and field of view are evaluated and plotted. A case study is presented to show the benefits of volume reduction using freeform surfaces.

Optical Design↗

NASA NTRSDate not supplied

Evaluation of User Experience of Self-Scheduling Software for Astronauts: Defining a Satisfaction Baseline

As NASA turns its sights to deep-space exploration, a greater focus on sup-porting crew autonomy has led to the development of Playbook, a self-scheduling software tool. Evaluating the user satisfaction of Playbook is essential in ensuring its usability for critical spaceflight operations. Satisfaction of an interface is often quantified with attitude surveys, such as the User Experience Questionnaire (UEQ). This paper demonstrates an application of the UEQ in comparing the user experience of Playbook interface de-signs for displaying graphical data. We lay the foundation for future user experience comparisons by defining a satisfaction baseline, which is crucial as more features are integrated into Playbook’s interface. This work ex-tends a validated user experience framework into a spaceflight domain, allowing optimization of human-computer interaction as future operational tools are developed.

user experience↗

NASA NTRS1991

PERTS: A Prototyping Environment for Real-Time Systems

We discuss an ongoing project to build a Prototyping Environment for Real-Time Systems, called PERTS. PERTS is a unique prototyping environment in that it has (1) tools and performance models for the analysis and evaluation of real-time prototype systems, (2) building blocks for flexible real-time programs and the support system software, (3) basic building blocks of distributed and intelligent real time applications, and (4) an execution environment. PERTS will make the recent and future theoretical advances in real-time system design and engineering readily usable to practitioners. In particular, it will provide an environment for the use and evaluation of new design approaches, for experimentation with alternative system building blocks and for the analysis and performance profiling of prototype real-time systems.

Liu, Jane W. S.↗

NASA NTRS1974

Evaluation of experimental methods for determining dynamic stiffness and damping of composite materials

Various methods potentially usable for determining dynamic stiffness and damping of composite materials are reviewed. Of these, the following most widely used techniques are singled out for more detailed discussion: free vibration, pulse propagation, and forced vibration response. To illustrate the usefulness and validity of dynamic property data, their application in dynamic analyses and comparison with measured structural response are described for the following composite-material structures: free-free sandwich beam with glass-epoxy facings, clamped-edge sandwich plate with similar facings, free-end sandwich conical shell with similar facings, and boron-epoxy free plate with layers arranged at various orientations.

Bert, C. W.↗

NASA NTRS1991

Microgravity cursor control device evaluation for Space Station Freedom workstations

This research addressed direct manipulation interface (curser-controlled device) usability in microgravity. The data discussed are from KC-135 flights. This included pointing and dragging movements over a variety of angles and distances. Detailed error and completion time data provided researchers with information regarding cursor control shape, selection button arrangement, sensitivity, selection modes, and considerations for future research.

Adam, Susan↗