Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Factors Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Ergonomic Evaluations of Microgravity Workstations

Various gloveboxes (GBXs) have been used aboard the Shuttle and ISS. Though the overall technical specifications are similar, each GBX's crew interface is unique. JSC conducted a series of ergonomic evaluations of the various glovebox designs to identify human factors requirements for new designs to provide operator commonality across different designs. We conducted 2 0g evaluations aboard the Shuttle to evaluate the material sciences GBX and the General Purpose Workstation (GPWS), and a KC-135 evaluation to compare combinations of arm hole interfaces and foot restraints (flexible arm holes were better than rigid ports for repetitive fine manipulation tasks). Posture analysis revealed that the smallest and tallest subjects assumed similar postures at all four configurations, suggesting that problematic postures are not necessarily a function of the operator s height but a function of the task characteristics. There was concern that the subjects were using the restrictive nature of the GBX s cuffs as an upper-body restraint to achieve such high forces, which might lead to neck/shoulder discomfort. EMG data revealed more consistent muscle performance at the GBX; the variability in the EMG profiles observed at the GPWS was attributed to the subjects attempts to provide more stabilization for themselves in the loose, flexible gauntlets. Tests revealed that the GBX should be designed for a 95 percentile American male to accommodate a neutral working posture. In addition, the foot restraint with knee support appeared beneficial for GBX operations. Crew comments were to provide 2 foot restraint mechanical modes, loose and lock-down, to accommodate a wide range of tasks without egressing the restraint system. Thus far, we have developed preliminary design guidelines for GBXs and foot.

Whitmore, Mihriban↗
NASA NTRS1996

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Whitmore, Mihriban↗
DOE OSTI2021

Incorporating the Role(s) of Human Actors in Complex System Design for Safety and Security

Traditional systems engineering demonstrates the importance of customer needs in scoping and defining design requirements; yet, in practice, other human stakeholders are often absent from early lifecycle phases. Human factors are often omitted in practice when evaluating and down-selecting design options due to constraints such as time, money, access to user populations, or difficulty in proving system robustness through the inclusion of human behaviors. Advances in systems engineering increasingly include non-technical influences into the design, deployment, operations, and maintenance of interacting components to achieve common performance objectives. Furthermore, such advances highlight the need to better account for the various roles of human actors to achieve desired performance outcomes in complex systems. Many of these efforts seek to infuse lessons and concepts from human factors (enhanced decision-making through Crew Resource Management), systems safety (Rasmussen's “drift toward danger”) and organization science (Giddens' recurrent human acts leading to emergent behaviors) into systems engineering to better understand how socio-technical interactions impact emergent system performance. Safety and security are examples of complex system performance outcomes that are directly impacted by varying roles of human actors. Using security performance of high consequence facilities as a representative use case, this article will outline the System Context Lenses to understand how to include various roles of human actors into systems engineering design. Several exemplar applications of this organizing lenses will be summarized and used to highlight more generalized insights for the broader systems engineering community.

42 ENGINEERING↗
NASA NTRSDate not supplied

A Flight Replanning Tool for Terminal Area Urban Air Mobility Operations

In this presentation we describe and evaluate a flight replanning tool, called the trial planner, for terminal area air transport applications. The trial planner employs predefined airspace structures to generate rerouting options between vertiports. In a simplified definition, vertiports are facilities that provide services for managing the take-off and landing of autonomous or manned electric vertical take-off or landing (eVTOL) aircraft. The airspace structures involved in our test cases are arrival routes that consist of predefined entry points to which a transitional path is computed dynamically from the current position of the aircraft. Rerouting options include the transitional path and approach segment along the arrival route; these rerouting options are not vetted for potential conflicts with other operations until a human operator commits to a choice and forwards the flight plan modification for approval from an automated airspace management service. A selected rerouting option is executed by loading a flight plan file to the aircraft ground control station. We conducted a qualitative evaluation of the trial planner using ratings provided by flight crews and air transportation human factors experts with relevant experience from air traffic control. Evaluation criteria included trust in the route recommendations and adequate explanation for the route options. We detail the logic and implementation of the trial planner, as well as report the results of the evaluation of the implementation herein.

Trial planning↗
DOE OSTI2020

Data Collection and Analysis Challenges and Mitigation Strategies for Quantitative Human Factors Research Studies in Nuclear Power Plant Modernization

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program Plant Modernization Pathway is conducting targeted research and development (R&D) to address aging and reliability concerns with the legacy instrumentation and control and related information systems of the U.S. LWR fleet. In this effort, the application of human factors engineering (HFE) provides an important role in ensuring new digital plant technologies enable broad innovation and business improvement with continued operational safety. Evaluation is a key activity in HFE, which often occurs iteratively through the system design lifecycle. While qualitative methods are important in collecting information of how users perform tasks through observations, quantitative methods are equally important in assessing system design based on performance. In collecting and analyzing this quantitative data, there are notable challenges in the nuclear HFE domain that may threaten the validity and reliability of the inferences made in these studies. Notable challenges include small sample size and limited resources, large error variance and small effect size, an “adding test features to losing degrees of freedom” dilemma, non-normal distribution, and heterogeneity of variance. The results in control room usability studies are often statistically non-significant, which makes it hard to interpret. This work discusses these challenges across different scientific viewpoints and provides real-world examples of these challenges in practice. Collectively, the objective of this work is to position these challenges to the larger data science community as a means of identifying future opportunities to address these issues.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Implications of Safety and Operational Features of Small, Advanced Reactors for the Evaluation of Important Human Actions

The design and operational characteristics of non-light water reactors are likely to change the role of human actions in safety function management and the types of human actions that are deemed important. The objectives of this report are to: • Identify the implications of small, advanced reactor design characteristics on human performance and the changing role of human actions in the management of safety functions. • Identify the methods that may be used to identify important human actions. • Identify how HFE safety reviewers can help ensure that the methods adequately model human actions to identify those that are important to safety. We identified the implications of small, advanced reactor characteristics on the role of personnel in safety function management. Then we addressed how designers can identify which human actions are important to safety using both probabilistic risk assessment (PRA) and deterministic analyses. PRA identifies important human actions using risk-importance criteria. Deterministically identified important human actions include those identified by analyses of situations such as transients and accidents and defense in depth. In all cases, the acceptability of the analyses is dependent on the modeling, quantification, and criterion selection to determine which human actions are important. How well the designers address these processes determines the acceptability of their methodology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. This paper explores how we developed one of the HUNTER modules: namely, the Individual module for evaluating performance shaping factors (PSFs). A PSF is any factor that influences human performance (e.g., workload or complexity). In the existing HRA, they are used to highlight human errors and adjust error probabilities. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, a representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed the human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also designed the Individual module to consist of two functions: (1) the PSF qualification function for automatically or manually evaluating PSF levels, and (2) the PSF quantification function for dynamically or statically determining PSF multiplier values and integrating them to adjust human error probabilities (HEPs). How each function works in regard to the SPAR-H PSFs, and how the PSFs serve to adjust the HEPs, were investigated via literature review and are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS1988

Assessment of satellite communications quality study. Addendum 1: Impact of propagation delay on data transmission

The single factor that irrevocably distinguishes geostationary satellite telephony transmission from terrestrial transmission is the greater propagation delay over satellite links. This difference has always provoked vigorous debate over the impact of delay on the subscribers using services incorporating satellite links. The issue is addressed from a variety of directions including human factors studies, laboratory subjective tests that evaluate delay with and without echo, and field tests that obtain data on the opinion of subscribers regarding the quality of service of operational circuits in both national U.S. domestic and international trans-Atlantic network. The tests involved the use of both echo suppressors and echo cancellers.

Campanella, S. J.↗
NASA NTRS1979

Man-machine analysis of translation and work tasks of Skylab films

An objective approach to determine the concurrent validity of computer-graphic models is real time film analysis. This technique was illustrated through the procedures and results obtained in an evaluation of translation of Skylab mission astronauts. The quantitative analysis was facilitated by the use of an electronic film analyzer, minicomputer, and specifically supportive software. The uses of this technique for human factors research are: (1) validation of theoretical operator models; (2) biokinetic analysis; (3) objective data evaluation; (4) dynamic anthropometry; (5) empirical time-line analysis; and (6) consideration of human variability. Computer assisted techniques for interface design and evaluation have the potential for improving the capability for human factors engineering.

Hosler, W. W.↗
NASA NTRS1993

Marshall Space Flight Center's Virtual Reality Applications Program 1993

A Virtual Reality (VR) applications program has been under development at the Marshall Space Flight Center (MSFC) since 1989. Other NASA Centers, most notably Ames Research Center (ARC), have contributed to the development of the VR enabling technologies and VR systems. This VR technology development has now reached a level of maturity where specific applications of VR as a tool can be considered. The objectives of the MSFC VR Applications Program are to develop, validate, and utilize VR as a Human Factors design and operations analysis tool and to assess and evaluate VR as a tool in other applications (e.g., training, operations development, mission support, teleoperations planning, etc.). The long-term goals of this technology program is to enable specialized Human Factors analyses earlier in the hardware and operations development process and develop more effective training and mission support systems. The capability to perform specialized Human Factors analyses earlier in the hardware and operations development process is required to better refine and validate requirements during the requirements definition phase. This leads to a more efficient design process where perturbations caused by late-occurring requirements changes are minimized. A validated set of VR analytical tools must be developed to enable a more efficient process for the design and development of space systems and operations. Similarly, training and mission support systems must exploit state-of-the-art computer-based technologies to maximize training effectiveness and enhance mission support. The approach of the VR Applications Program is to develop and validate appropriate virtual environments and associated object kinematic and behavior attributes for specific classes of applications. These application-specific environments and associated simulations will be validated, where possible, through empirical comparisons with existing, accepted tools and methodologies. These validated VR analytical tools will then be available for use in the design and development of space systems and operations and in training and mission support systems.

Hale, Joseph P., II↗
NASA NTRS2004

Special Purpose Crew Restraints for Teleoperation

With permanent human presence onboard the International Space Station (ISS), and long duration space missions being planned for the moon and Mars, humans will be living and working in microgravity over increasingly long periods of time. In addition to weightlessness, the confined nature of a spacecraft environment results in ergonomic challenges such as limited visibility, and access to the activity area. These challenges can result in prolonged periods of unnatural postures for the crew, ultimately causing pain, injury, and loss of productivity. Determining the right set of human factors requirements and providing an ergonomically designed environment is crucial to mission success. While a number of general purpose restraints have been used on ISS (handrails, foot loops), experience has shown that these general purpose restraints may not be optimal, or even acceptable for some tasks that have unique requirements. For example, some onboard activities require extreme stability (e.g., glovebox microsurgery), and others involve the use of arm, torso and foot movements in order to perform the task (e-g. robotic teleoperation); standard restraint systems will not work in these situations. The Usability Testing and Analysis Facility (WAF) at the NASA Johnson Space Center began evaluations of crew restraints for these special situations by looking at NASAs Robonaut. Developed by the Robot Systems Technology Branch, Robonaut is a humanoid robot that can be remotely operated through a tetepresence control system by an operator. It was designed to perform work in hazardous environments (e.g., Extra Vehicular Activities). A Robonaut restraint was designed, modeled for the population, and ultimately tested onboard the KC-135 microgravity aircraft. While in microgravity, participants were asked to get in and out of the restraint from different locations, perform maximum reach exercises, and finally to teleoperate Robonaut while in the restraint. The sessions were videotaped, and participants completed a questionnaire at the end of each flight day. Results from this evaluation are being used to develop the human factors design requirements for teleoperation tasks in microgravity.

Whitmore, Mihriban↗
NASA NTRS2009

Human Research Program Space Human Factors Engineering (SHFE) Standing Review Panel (SRP)

The Space Human Factors Engineering (SHFE) Standing Review Panel (SRP) evaluated 22 gaps and 39 tasks in the three risk areas assigned to the SHFE Project. The area where tasks were best designed to close the gaps and the fewest gaps were left out was the Risk of Reduced Safety and Efficiency dire to Inadequate Design of Vehicle, Environment, Tools or Equipment. The areas where there were more issues with gaps and tasks, including poor or inadequate fit of tasks to gaps and missing gaps, were Risk of Errors due to Poor Task Design and Risk of Error due to Inadequate Information. One risk, the Risk of Errors due to Inappropriate Levels of Trust in Automation, should be added. If astronauts trust automation too much in areas where it should not be trusted, but rather tempered with human judgment and decision making, they will incur errors. Conversely, if they do not trust automation when it should be trusted, as in cases where it can sense aspects of the environment such as radiation levels or distances in space, they will also incur errors. This will be a larger risk when astronauts are less able to rely on human mission control experts and are out of touch, far away, and on their own. The SRP also identified 11 new gaps and five new tasks. Although the SRP had an extremely large quantity of reading material prior to and during the meeting, we still did not feel we had an overview of the activities and tasks the astronauts would be performing in exploration missions. Without a detailed task analysis and taxonomy of activities the humans would be engaged in, we felt it was impossible to know whether the gaps and tasks were really sufficient to insure human safety, performance, and comfort in the exploration missions. The SRP had difficulty evaluating many of the gaps and tasks that were not as quantitative as those related to concrete physical danger such as excessive noise and vibration. Often the research tasks for cognitive risks that accompany poor task or information design addressed only part, but not all, of the gaps they were programmed to fill. In fact the tasks outlined will not close the gap but only scratch the surface in many cases. In other cases, the gap was written too broadly, and really should be restated in a more constrained way that can be addressed by a well-organized and complementary set of tasks. In many cases, the research results should be turned into guidelines for design. However, it was not clear whether the researchers or another group would construct and deliver these guidelines.

Wichansky, Anna↗
DOE OSTI2022

The HUNTER Dynamic Human Reliability Analysis Tool: Development of a Module for Performance Shaping Factors

Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a framework to support dynamic human reliability analysis (HRA) in communication with a variety of methods and tools. In this paper, how we have developed one of the HUNTER modules, the individual module for evaluating performance shaping factors (PSFs), is introduced. The PSF refers to any factor that influences human performance such as workload or complexity. It has been used for highlighting human errors and adjusting the error probabilities in the existing HRA. We consider the eight PSFs suggested in the Standardized Plant Analysis Risk-HRA (SPAR-H) method, which is the representative HRA method widely used in the nuclear field. To support our dynamic modeling using the eight SPAR-H PSFs, we reviewed human performance literature and developed data-based mathematical models to rate and quantify PSFs in the context of dynamic HRA. We also design the individual module composed of the two functions: 1) the PSF qualification function that automatically or manually evaluates a PSF level, and 2) the PSF quantification function that dynamically or statically determines the PSF multiplier values and integrate them to adjust human error probabilities (HEPs). How each function works with the SPAR-H PSFs and how the PSFs adjust the HEPs are investigated through literature and discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Discerning Deception: An Empirically-Driven Agent-Based Model of Expert Evaluation of Scientific Content

Both human subject experiments and computational, modeling and simulations have been used to study detection of deception. This work aims to combine these two methods by integrating empirically-derived information (from human subject experiments) into agent-based models to generate novel insights into the complex problems of detection of disinformation content. Computational experiments are used to simulate across multiple scenarios for evaluation and decision-making regarding the validity of potentially deceptive scientific documents. Factors influencing the human agent behaviors in the model were identified through a human subject experiment that was conducted to evaluate and characterize decision making related to disinformation discernment. Correlation and regression analyses were used to translate insights from the human subjects experiment to inform the parameterization of agent features and scenario development. Three scenarios were evaluated with the agent-based models to help evaluate the replicability of the simulations (validation analysis) and assess the influence of human agent and document features (sensitivity analyses). A replication of the human participant experiment demonstrated that the agent-based simulations compare favorably to empirical findings. The agent-based modeling was then used to conduct sensitivity analysis on the accuracy of deception detection as a function of document proportions and human agent features. Results indicate that precision values are adversely impacted when the proportion of deceptive documents is lower in the overall sample, whereas recall values are more sensitive to changes in human agent features. These findings indicate important nuances in accuracy evaluations that should be further considered (including consideration of potential alternate metrics) in future agent-based models of disinformation. Additional areas for future exploration include extension of simulations to consider other ways to align the agent-based model design with psychological theory and inclusion of agent-agent interactions, especially as it pertains to sharing of scientific information within an organizational context.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS2017

Future Exploration Missions' Tasks Associated with the Risk of Inadequate Design of Human and Automation/Robotic Integration

NASA's Human Research Program (HRP) funds research efforts aimed at mitigating various human health and performance risks, including the Risk of Inadequate Design of Human and Automation/Robotic Integration (HARI). As such, within HRP, the Human Factors and Behavioral Performance (HFBP) Element tasked an evaluation of future HARI needs in order to scope and focus the HARI risk research plan. The objective was to provide a systematic understanding of the critical factors associated with effective HARI that will be necessary to achieve the future mission goals for near- and deep-space exploration. Future mission goals are specified by NASA Design Reference Missions (DRMs) that are pertinent to the HRP. The outcome of this evaluation is a set of NASA-relevant HARI tasks, factors, and interactions required for exploration-class missions.

space operations↗
NASA NTRS2002

Tools and Techniques for Evaluating the Effects of Maintenance Resource Management (MRM) in Air Safety

This research project was designed as part of a larger effort to help Human Factors (HF) implementers, and others in the aviation maintenance community, understand, evaluate, and validate the impact of Maintenance Resource Management (MRM) training programs, and other MRM interventions; on participant attitudes, opinions, behaviors, and ultimately on enhanced safety performance. It includes research and development of evaluation methodology as well as examination of psychological constructs and correlates of maintainer performance. In particular, during 2001, three issues were addressed. First a prototype process for measuring performance was developed and used. Second an automated calculator was developed to aid the HF implementer user in analyzing and evaluating local survey data. These results include being automatically compared with the experience from all MRM programs studied since 1991. Third the core survey (the Maintenance Resource Management Technical Operations Questionnaire, or 'MRM/TOQ') was further developed and tested to include topics of added relevance to the industry.

Taylor, James C.↗
NASA NTRS1988

Human error in aviation operations

The role of human error in commercial and general aviation accidents and the techniques used to evaluate it are reviewed from a human-factors perspective. Topics addressed include the general decline in accidents per million departures since the 1960s, the increase in the proportion of accidents due to human error, methods for studying error, theoretical error models, and the design of error-resistant systems. Consideration is given to information acquisition and processing errors, visually guided flight, disorientation, instrument-assisted guidance, communication errors, decision errors, debiasing, and action errors.

Nagel, David C.↗
NASA NTRS1997

Surface Development and Test Facility (SDTF) New R&D Simulator for Airport Operations

A new simulator, the Surface Development and Test Facility (SDTF) is under construction at the NASA Ames Research Center in Mountain View, California. Jointly funded by the FAA (Federal Aviation Administration) and NASA, the SDTF will be a testbed for airport surface automation technologies of the future. The SDTF will be operational in the third quarter of 1998. The SDTF will combine a virtual tower with simulated ground operations to allow evaluation of new technologies for safety, effectiveness, reliability, and cost benefit. The full-scale level V tower will provide a seamless 360 degree high resolution out-the-window view, and a full complement of ATC (air traffic control) controller positions. The imaging system will be generated by two fully-configured Silicon Graphics Onyx Infinite Reality computers, and will support surface movement of up to 200 aircraft and ground vehicles. The controller positions, displays and consoles can be completely reconfigured to match the unique layout of any individual airport tower. Dedicated areas will accommodate pseudo-airport ramp controllers, pseudo-airport operators, and pseudo-pilots. Up to 33 total personnel positions will be able to participate in simultaneous operational scenarios. A realistic voice communication infrastructure will emulate the intercom and telephone communications of a real airport tower. Multi-channel audio and video recording and a sophisticated data acquisition system will support a wide variety of research and development areas, such as evaluation of automation tools for surface operations, human factors studies, integration of terminal area and airport technologies, and studies of potential airport physical and procedural modifications.

Dorighi, Nancy S.↗