Search NASASearch

Engineering topics

Null, Cynthia

Publications and source records attributed to Null, Cynthia.

Accounting for the Speed-Accuracy Trade-Off in Quantifying Human-In-The-Loop Error Probabilities

Human-in-the-loop (HITL) simulations cannot collect enough data from human operators to validate estimates of error probabilities for task components. Error rates for tasks have been estimated by using laboratory data for error rates depending on variables such as the cognitive complexity of the task. The limited channel capacity of human operators compels error rates to be strongly related to the time available for the task, the speed-accuracy trade-off. HITL simulations can provide valuable data on the time available for the operator's tasks. We propose that the response times be used in conjunction with measured speed-accuracy curves to estimate the operator error rates contributing to mission failure. Such analyses should be especially important in the estimation of error rates in off-nominal situations.

probability

The Human Challenges of Remotely Piloted Aircraft Systems

Remotely Piloted Aircraft (RPA) range from small electric quadcopters that are flown close to the ground within visual range of the operator, to larger systems capable of extended flight in airspace shared with conventional aircraft. Before RPA can operate routinely and safely in civilian airspace, we need to understand the unique human factors associated with these aircraft. RPA pilots participated in focus groups where they were asked to recall critical incidents that either presented a threat to safety, or highlighted a case where the pilot contributed to system resilience or mission success. Ninety incidents were gathered from focus-groups. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Some of these concerns have received significant attention in the literature, or are analogous to human factors of manned aircraft. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

Hobbs, Alan

The Cognitive Challenges of Flying a Remotely Piloted Aircraft

A large variety of Remotely Piloted Aircraft (RPA) designs are currently in production or in development. These aircraft range from small electric quadcopters that are flown close to the ground within visual range of the operator, to larger systems capable of extended flight in airspace shared with conventional aircraft. Before RPA can operate routinely and safely in civilian airspace, we need to understand the unique human factors associated with these aircraft. The task of flying an RPA in civilian airspace involves challenges common to the operation of other highly-automated systems, but also introduces new considerations for pilot perception, decision-making, and action execution. RPA pilots participated in focus groups where they were asked to recall critical incidents that either presented a threat to safety, or highlighted a case where the pilot contributed to system resilience or mission success. Ninety incidents were gathered from focus-groups. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Some of these concerns have received significant attention in the literature, or are analogous to human factors of manned aircraft. The presentation will focus on issues that are poorly understood, and have not yet been the subject of extensive human factors study. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

remote pilot station

The Collection of Human Factors Incident Reports via UAS Pilot Focus Groups

There is a need for incident data relevant to the operation of civilian unmanned aircraft systems (UAS) in the National Air Space (NAS). Currently, the tightly-restricted civilian UAS industry has produced relatively few incident reports that shed light on the human factors of UAS operations. An exploratory study is being conducted to examine the feasibility of using the critical incident technique (Flanagan, 1954) to collect reports from UAS pilots. The information is being used to identify areas where human factors guidelines will be of assistance. Experienced UAS pilots are participating in small focus groups in which they are prompted to describe critical incidents that either reveal a system flaw, or highlight a case where the human operator contributed to system resilience or mission success. To date, 90 incidents have been reported by UAS pilots. The de-identified incidents are being analyzed to identify contributing factors, with a focus on design issues that either hindered or assisted the pilot in dealing with the incident..

Hobbs, Alan

Human Factors of Remotely Piloted Aircraft Systems: Lessons from Incident Reports

An exploratory study is being conducted to examine the feasibility of collecting voluntary critical incident reports from RPAS pilots. Twenty-three experienced RPAS pilots volunteered to participate in focus groups in which they described critical incidents from their own experience. Participants were asked to recall (1) incidents that revealed a system flaw, or (2) highlighted a case where the human operator contributed to system resilience or mission success. Participants were asked to only report incidents that could be included in a public document. A total of 90 incidents were reported. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies.

human factors

C2-Related Incidents Reported by UAS Pilots

It has been estimated that aviation accidents are typically preceded by numerous minor incidents arising from the same causal factors that ultimately produced the accident. Accident databases provide in-depth information on a relatively small number of occurrences, however incident databases have the potential to provide insights into the human factors of Remotely Piloted Aircraft System (RPAS) operations based on a larger volume of less-detailed reports. Currently, there is a lack of incident data dealing with the human factors of unmanned aircraft systems. An exploratory study is being conducted to examine the feasibility of collecting voluntary critical incident reports from RPAS pilots. Twenty-three experienced RPAS pilots volunteered to participate in focus groups in which they described critical incidents from their own experience. Participants were asked to recall (1) incidents that revealed a system flaw, or (2) highlighted a case where the human operator contributed to system resilience or mission success. Participants were asked to only report incidents that could be included in a public document. During each focus group session, a note taker produced a de-identified written record of the incident narratives. At the end of the session, participants reviewed each written incident report, and made edits and corrections as necessary. The incidents were later analyzed to identify contributing factors, with a focus on design issues that either hindered or assisted the pilot during the events. A total of 90 incidents were reported. This presentation focuses on incidents that involved the management of the command and control (C2) link. The identified issues include loss of link, interference from undesired transmissions, voice latency, accidental control transfer, and the use of the lost link timer, or lost link OK features.

unmanned aircraft systems

Pilot Critical Incident Reports as a Means to Identify Human Factors of Remotely Piloted Aircraft

It has been estimated that aviation accidents are typically preceded by numerous minor incidents arising from the same causal factors that ultimately produced the accident. Accident databases provide in-depth information on a relatively small number of occurrences, however incident databases have the potential to provide insights into the human factors of Remotely Piloted Aircraft System (RPAS) operations based on a larger volume of less-detailed reports. Currently, there is a lack of incident data dealing with the human factors of unmanned aircraft systems. An exploratory study is being conducted to examine the feasibility of collecting voluntary critical incident reports from RPAS pilots. Twenty-three experienced RPAS pilots volunteered to participate in focus groups in which they described critical incidents from their own experience. Participants were asked to recall (1) incidents that revealed a system flaw, or (2) highlighted a case where the human operator contributed to system resilience or mission success. Participants were asked to only report incidents that could be included in a public document. During each focus group session, a note taker produced a de-identified written record of the incident narratives. At the end of the session, participants reviewed each written incident report, and made edits and corrections as necessary. The incidents were later analyzed to identify contributing factors, with a focus on design issues that either hindered or assisted the pilot during the events. A total of 90 incidents were reported. Human factor issues included the impact of reduced sensory cues, traffic separation in the absence of an out-the-window view, control latencies, vigilance during monotonous and ultra-long endurance flights, control station design considerations, transfer of control between control stations, the management of lost link procedures, and decision-making during emergencies. Pilots participated willingly and enthusiastically in the study, and generally had little difficulty recalling critical incidents. The results suggest that pilot interviews can be a productive method of gathering information on incidents that might not otherwise be reported. Some of the issues described in the reports have received significant attention in the literature, or are analogous to human factors of manned aircraft. In other cases, incident reports involved human factors that are poorly understood, and have not yet been the subject of extensive study. Although many of the reported incidents were related to pilot error, the participants also provided examples of the positive contribution that humans make to the operation of highly-automated systems.

unmanned aircraft systems

Identification of Human Factors in Unmanned Aviation Via Pilot Incident Reports

There is a need for incident data relevant to the operation of civilian unmanned aircraft systems (UAS) in the National Air Space (NAS). Currently, very limited incident and accident data are available from military sources, and the tightly-restricted civilian UAS industry has produced very few incident reports that could shed light on design issues relevant to human factors. An exploratory study is being conducted to examine the feasibility of collecting voluntary critical incident reports from UAS pilots, and using the information to identify areas where human factors guidelines will be of assistance. Experienced UAS pilots are participating in small focus groups in which they are prompted to describe critical incidents that either reveal a system flaw, or highlight a case where the human operator contributed to system resilience or mission success. The de-identified incidents are being analyzed to identify contributing factors, with a focus on design issues that either hindered or assisted the pilot in dealing with the incident. Preliminary findings will be described.

human factors

Defining Reliability and Robustness from a Human Factors Perspective

A human factors team was tasked with assessing best practices for developing a crewed space vehicle that is both reliable and robust. The team identified two broad dimensions of human factors are relevant to system design. Namely, the attributes of the product, and the processes used to develop the product. The “product” includes hardware, software, documentation, training systems, and procedures throughout all phases of the system life, including construction, testing, operation and maintenance. Three product attributes relevant to robustness are the extent to which task demands are within human capabilities, the capacity of the system to cope with unanticipated human actions, and the ability of the system to make use of unique human capabilities during non-routine situations. The “process” dimension of human factors relates to the activities that start in the early stages of design, and continue throughout the life of the system. There are, of course, no guarantees that a formal consideration of human factors throughout the design process will identify all the relevant human issues. In the absence of such a consideration, however, problems are virtually assured.

Hobbs, Alan

Design, Development, Testing, and Evaluation: Human Factors Engineering

While human-system interaction occurs in all phases of system development and operation, this chapter on Human Factors in the DDT&E for Reliable Spacecraft Systems is restricted to the elements that involve "direct contact" with spacecraft systems. Such interactions will encompass all phases of human activity during the design, fabrication, testing, operation, and maintenance phases of the spacecraft lifespan. This section will therefore consider practices that would accommodate and promote effective, safe, reliable, and robust human interaction with spacecraft systems. By restricting this chapter to what the team terms "direct contact" with the spacecraft, "remote" factors not directly involved in the development and operation of the vehicle, such as management and organizational issues, have been purposely excluded. However, the design of vehicle elements that enable and promote ground control activities such as monitoring, feedback, correction and reversal (override) of on-board human and automation process are considered as per NPR8705.2A, Section 3.3.

Adelstein, Bernard

Transitioning from Free-Flight to TRACON Airspace: The Ground Perspective of User-Preferred Descents

Free-flight is considered to play a major role in the future air traffic environment. Studies are underway addressing different concepts for free-flight and self separation in enroute airspace. One common opinion throughout the different concepts is that the airspace surrounding major airports, the Terminal Radar Approach CONtrol (TRACON) will not be a free flight area. This means that aircraft in this area are completely controlled by air traffic controllers, who may be supported by decision support system like the Center TRACON Automation System (CTAS). How the transition from the free-flight area (enroute airspace) to the terminal area will take place is currently unclear, This paper describes a study at NASA Ames Research Center addressing the perspective of air traffic controllers handling user-preferred (FMS-optimized) descent trajectories during this transition phase. Two major issues in enabling user preferred descents from the controllers' point of view are predictability and controllability. In an environment in which the air traffic services are highly responsive to user preferences controllers need to know, where and when aircraft will change their trajectory and they need to have appropriate means and procedures at hand to control the aircraft according to the overall traffic situation. Predictability shall be enhanced by: 1) Indicating airspace corridors for descending aircraft; 2) Modify the controller interface; 3) Using a ground based conflict probe; 4) Making use of downlinked intent information from the aircraft FMS; and 5) Requiring to fly pilots on user preferred trajectories coupled to the FMS in the lateral and vertical axis. Additional controllability shall be achieved by supporting the controllers with CTAS center tools: 1) Traffic Management Advisor (TMA); 2) Conflict Probing and Trial Planning (CP/TP); and 3) Enroute Descent Advisor (E/DA). The paper describes the general concept and the modifications to current systems required to enable the concept. It explains the experiment design and discusses the results with regard to controller acceptability and usability. Potential benefits and drawbacks of the overall concept are indicated.

Prevot, Thomas

An Operational Concept for Flying FMS Trajectories in Center and TRACON Airspace

Current Flight Management Systems (FMS) do a good job of constructing and flying an optimal trajectory for a single aircraft. Unfortunately, flight crews are often unable to fly these FMS routes during arrivals at busy airports. The Center TRACON Automation System (CTAS) has been designed to aid Center and TRACON (Terminal Radar Approach Control) controllers in assigning runways, sequencing and vectoring all classes of aircraft. CTAS bases its advisories on trajectory predictions for arriving aircraft using algorithms very similar to those in airborne FMS systems. This paper presents near and far term operational concepts for how a ground ATM (air traffic management) automation system like CTAS could work more effectively with the airborne automation in FMS equipped aircraft. The concepts for a more compatible air-ground system include: 1) a common route databases for both CTAS and FMS; 2) datalink to downlink information on aircraft weight, final approach speed and trajectory intent and to uplink wind information; 3) new FMS functions to allow flight crews to easily update their FMS trajectory to match the trajectory suggested by the ground automation with voice clearances, and 4) in the far term, datalink to downlink user preferred trajectories and to uplink trajectory clearances in the terminal area. The paper analyses some of the human factors issues that may result in allowing aircraft to fly FMS routes during enroute descent and in the terminal area. A series of linked human in the loop flight deck and air traffic control simulations and a field test with the NASA 757 are being conducted at NASA's Ames and Langley Research Centers to address these issues and to evaluate the operational feasibility of these approaches to more efficient flight and increased airport throughput.

Palmer, Everett

Tutorial on the Psychophysics and Technology of Virtual Acoustic Displays

Virtual acoustics, also known as 3-D sound and auralization, is the simulation of the complex acoustic field experienced by a listener within an environment. Going beyond the simple intensity panning of normal stereo techniques, the goal is to process sounds so that they appear to come from particular locations in three-dimensional space. Although loudspeaker systems are being developed, most of the recent work focuses on using headphones for playback and is the outgrowth of earlier analog techniques. For example, in binaural recording, the sound of an orchestra playing classical music is recorded through small mics in the two "ear canals" of an anthropomorphic artificial or "dummy" head placed in the audience of a concert hall. When the recorded piece is played back over headphones, the listener passively experiences the illusion of hearing the violins on the left and the cellos on the right, along with all the associated echoes, resonances, and ambience of the original environment. Current techniques use digital signal processing to synthesize the acoustical properties that people use to localize a sound source in space. Thus, they provide the flexibility of a kind of digital dummy head, allowing a more active experience in which a listener can both design and move around or interact with a simulated acoustic environment in real time. Such simulations are being developed for a variety of application areas including architectural acoustics, advanced human-computer interfaces, telepresence and virtual reality, navigation aids for the visually-impaired, and as a test bed for psychoacoustical investigations of complex spatial cues. The tutorial will review the basic psychoacoustical cues that determine human sound localization and the techniques used to measure these cues as Head-Related Transfer Functions (HRTFs) for the purpose of synthesizing virtual acoustic environments. The only conclusive test of the adequacy of such simulations is an operational one in which the localization of real and synthesized stimuli are directly compared in psychophysical studies. To this end, the results of psychophysical experiments examining the perceptual validity of the synthesis technique will be reviewed and factors that can enhance perceptual accuracy and realism will be discussed. Of particular interest is the relationship between individual differences in HRTFs and in behavior, the role of reverberant cues in reducing the perceptual errors observed with virtual sound sources, and the importance of developing perceptually valid methods of simplifying the synthesis technique. Recent attempts to implement the synthesis technique in real time systems will also be discussed and an attempt made to interpret their quoted system specifications in terms of perceptual performance. Finally, some critical research and technology development issues for the future will be outlined.

Wenzel, Elizabeth M.

What Determines the Response: Test or Reference?

The stability of sensory memory has been studied by presenting a reference stimulus, a delay, and a test stimulus. As has been pointed out by Lages and Treisman (1998 Vision Research 38 557-572), the usual measure of performance depends only on the effect of test variations on the responses. The Weber fraction characterizing performance is more properly called the test stimulus Weber fraction. We measure the relative contribution of the test and reference to the response by the ratio of the test Weber fraction to the reference Weber fraction. The stimuli were two dark lines on a bright background. Seven reference separations, varying from 9.5 to 16.7 arc min, were intermixed in each run. Interstimulus intervals (ISI) of 50, 200 and 2000 msec and intertrial intervals (ITI) of 500 and 2500 msec were investigated. When the ISI was short (50 or 200 msec), for both ITIs, responses were determined equally by the test and reference. For the long ISI (2000 msec), the reference stimulus contributed less. However, only for the 500 msec ITI (and not for all observers) was the contribution of the reference stimulus negligible, as Treisman's criterion setting theory might suggest.

Chukova, S. V.

Sound For Animation And Virtual Reality

Sound is an integral part of the experience in computer animation and virtual reality. In this course, we will present some of the important technical issues in sound modeling, rendering, and synchronization as well as the "art" and business of sound that are being applied in animations, feature films, and virtual reality. The central theme is to bring leading researchers and practitioners from various disciplines to share their experiences in this interdisciplinary field. The course will give the participants an understanding of the problems and techniques involved in producing and synchronizing sounds, sound effects, dialogue, and music. The problem spans a number of domains including computer animation and virtual reality. Since sound has been an integral part of animations and films much longer than for computer-related domains, we have much to learn from traditional animation and film production. By bringing leading researchers and practitioners from a wide variety of disciplines, the course seeks to give the audience a rich mixture of experiences. It is expected that the audience will be able to apply what they have learned from this course in their research or production.

Hahn, James K.