Search NASA⌕ Search

Engineering topics

Shively, R. J.

Publications and source records attributed to Shively, R. J..

Sensitivity Analysis of Situational Awareness Measures

A great deal of effort has been invested in attempts to define situational awareness, and subsequently to measure this construct. However, relatively less work has focused on the sensitivity of these measures to manipulations that affect the SA of the pilot. This investigation was designed to manipulate SA and examine the sensitivity of commonly used measures of SA. In this experiment, we tested the most commonly accepted measures of SA: SAGAT, objective performance measures, and SART, against different levels of SA manipulation to determine the sensitivity of such measures in the rotorcraft flight environment. SAGAT is a measure in which the simulation blanks in the middle of a trial and the pilot is asked specific, situation-relevant questions about the state of the aircraft or the objective of a particular maneuver. In this experiment, after the pilot responded verbally to several questions, the trial continued from the point frozen. SART is a post-trial questionnaire that asked for subjective SA ratings from the pilot at certain points in the previous flight. The objective performance measures included: contacts with hazards (power lines and towers) that impeded the flight path, lateral and vertical anticipation of these hazards, response time to detection of other air traffic, and response time until an aberrant fuel gauge was detected. An SA manipulation of the flight environment was chosen that undisputedly affects a pilot's SA-- visibility. Four variations of weather conditions (clear, light rain, haze, and fog) resulted in a different level of visibility for each trial. Pilot SA was measured by either SAGAT or the objective performance measures within each level of visibility. This enabled us to not only determine the sensitivity within a measure, but also between the measures. The SART questionnaire and the NASA-TLX, a measure of workload, were distributed after every trial. Using the newly developed rotorcraft part-task laboratory (RPTL) at NASA Ames Research Center, each pilot flew eight trials, four using SAGAT and four using performance measures. Each set of four trials differed by level of visibility as well. The flight paths were very similar in appearance and hazard number, allowing comparison between flight paths. The pilots were tasked with flying along a road at an assigned altitude and speed while avoiding any hazards that they happened upon. The attempt here was not to find a single best measure of SA, but rather to begin an investigation of the sensitivity of common measures of SA. Upon completion of this study, its results, in combination with future studies, should allow us to develop an empirically based taxonomy of SA measures and the contexts for their appropriate use.

Shively, R. J.↗

Pre-flight risk assessment in Emergency Medical Service (EMS) helicopters

The Emergency Medical Service (EMS) industry has been the subject of several television and newspaper articles (Harvey and Jensen, 1987) which emphasized the negative aspects, (e.g., fatalities and high accident rates), rather than the life saving services performed. Until recently, the accident rate of the EMS industry has been five times as high as that of other civil helicopters. This high accident rate has been coupled with the dramatic rise in the number of programs. The industry has built from a single service at its inception in 1972, to over 180 in 1987 (Spray, 1987), to the point that 93 percent of the contiguous U.S. is now covered by some type of EMS service. These factors prompted the National Transportation Safety Board (NTSB) to study the accidents that occurred between May 11, 1978 and December 3, 1986 (NTSB, 1988). The NTSB report concluded that 'Sound pilot judgment is central to safe flight operations.' They further stated that '... factors unique to EMS helicopter operations--such as the influence of the mission itself, program competition, and EMS program management perspectives--can drastically influence pilot judgment during the EMS mission.' One of the most difficult decisions that a pilot must make is whether to accept or decline a mission. A pre-flight risk assessment system (SAFE) was developed at NASA-Ames Research Center for civil EMS operations to aid pilots in making this decision objectively. The ability of the SAFE system to predict mission risk profiles was tested at an EMS facility. The results of this field study demonstrated that the usefulness of SAFE was highly dependent on the type of mission flown. SAFE is now being modified so that it can 'learn' with each mission flown. For example, after flying a mission to a particular site, an EMS pilot would input information about this mission into the system, such as new buildings, wires, or approach procedures. Then, the next time a pilot flew a similar mission or one to the same area, this additional information would be taken into account in computing a risk assessment.

Shively, R. J.↗

The effects of stimulus modality and task integrality: Predicting dual-task performance and workload from single-task levels

The influence of stimulus modality and task difficulty on workload and performance was investigated. The goal was to quantify the cost (in terms of response time and experienced workload) incurred when essentially serial task components shared common elements (e.g., the response to one initiated the other) which could be accomplished in parallel. The experimental tasks were based on the Fittsberg paradigm; the solution to a SternBERG-type memory task determines which of two identical FITTS targets are acquired. Previous research suggested that such functionally integrated dual tasks are performed with substantially less workload and faster response times than would be predicted by suming single-task components when both are presented in the same stimulus modality (visual). The physical integration of task elements was varied (although their functional relationship remained the same) to determine whether dual-task facilitation would persist if task components were presented in different sensory modalities. Again, it was found that the cost of performing the two-stage task was considerably less than the sum of component single-task levels when both were presented visually. Less facilitation was found when task elements were presented in different sensory modalities. These results suggest the importance of distinguishing between concurrent tasks that complete for limited resources from those that beneficially share common resources when selecting the stimulus modalities for information displays.

Hart, S. G.↗

Measuring Pilot Workload in a Moving-base Simulator. Part 2: Building Levels of Workload

Pilot behavior in flight simulators often use a secondary task as an index of workload. His routine to regard flying as the primary task and some less complex task as the secondary task. While this assumption is quite reasonable for most secondary tasks used to study mental workload in aircraft, the treatment of flying a simulator through some carefully crafted flight scenario as a unitary task is less justified. The present research acknowledges that total mental workload depends upon the specific nature of the sub-tasks that a pilot must complete as a first approximation, flight tasks were divided into three levels of complexity. The simplest level (called the Base Level) requires elementary maneuvers that do not utilize all the degrees of freedom of which an aircraft, or a moving-base simulator; is capable. The second level (called the Paired Level) requires the pilot to simultaneously execute two Base Level tasks. The third level (called the Complex Level) imposes three simultaneous constraints upon the pilot.

Kantowitz, B. H.↗