Search NASA⌕ Search

SEARCH · Search NASA

Results for “workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

Ligda, Sarah V.↗

Examining the Relationship between Self-Reported Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart↗

Examining the Relationship Between Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart↗

Enhancing workload assessments for validation activities associated with DBA and BDBA scenarios - 165

After the Fukushima Daiichi accident, nuclear regulators around the world have required that power reactor licensees develop more extensive emergency mitigating responses and severe accident management provisions beyond the defense-in-depth measures for design basis accidents (DBAs), previously in place. Workload assessments represent common validation techniques that are used to demonstrate that workers are able to perform tasks without unacceptable performance degradation. High workload is known to induced stress and fatigue and may severely diminish a worker's capacity to perceive, recognize, and respond appropriately during emergency or unanticipated events, which may result in undesirable consequences. In estimating workload during emergency and severe accident scenarios, power reactor licensees tend to rely on subjective measures of workload, such as NASA-TLX. Due to reported mismatches in the literature between subjective and physiologically-derived estimates of workload, it is prudent to see what more can be done to improve the current state of practice, in the context of emergency and severe accident conditions. To improve confidence in workload estimates, it is advocated that the nuclear industry integrate physiological-based measures into current practices by making use of 'on-body' or 'wearable' physiological sensors. In this paper, an overview of three different types of empirical workload approaches is provided. The advantages of wearable physiological sensors are considered in the context of extreme environments and occupations, with tangible examples including heat stress and pupillometry. Suggestions for a consensus forum on workload are provided and a research plan directed at improving the current practice of workload estimation is offered for consideration. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Relationship between Workload, Performance and Fatigue in a Short-Haul Airline

Short-haul flights are associated with irregular work schedules and increased workload, due to frequent takeoffs and landings. We examined the relationship between pilot workload, performance and subjective fatigue during normal short-haul operations. Ninety airline pilots (8 female), mean age 33 (±8 years) completed a NASA-Task Load Index (NASA-TLX), a Psychomotor Vigilance Task (PVT; a reaction time test sensitive to sleep loss) and a Samn-Perelli (SP) fatigue scale, over a period of 20 duty days at top-of-descent on 2762 short-haul flights. The duty days included either 2 or 4 flights per day starting at different times as scheduled during normal operations. Workload was measured using the six NASA-TLX scales: mental demand, physical demand, temporal demand, effort, performance and frustration. Lapses (reaction times [RT] > 500ms) were calculated for the PVT. Spearman correlations were calculated to identify relationships between the NASA-TLX, PVT lapses, and SP. The six scales of NASA-TLX were positively correlated with the PVT lapses (p < 0.01) showing an increase in workload when lapses increased. There was a positive correlation between subjective fatigue as measured by the SP fatigue scale and each of the six scales of NASA-TLX (p < 0.001) suggesting that pilots reported higher workload when perceived levels of fatigue were higher. Of the six workload scales, mental demand and performance were rated the highest (mental: M = 40.99, SD = 20.32; performance: M = 41.61, SD = 20.71) and effort was rated the lowest (M = 15.59, SD = 8.98). Preliminary analyses suggest that high workload is associated with poorer PVT performance and increased self-reported fatigue in this population of short-haul pilots. Future studies should explore how other workload factors (i.e. flight hours, time of day) influence self-reported and objective fatigue measures.

TLX↗

Workload and transmission data for the installation of a digital breast tomosynthesis system

Purpose: Digital breast tomosynthesis (DBT) differs from conventional mammography in target/filter, kVp range, and imaging geometry. The aim of this study was to assess the breast input exposure of a DBT system by completing a workload survey of DBT installations, and to determine the parameters {alpha}, {beta}, and {gamma} in the Archer equation for the primary radiation generated by the clinical workload distributions. Methods: The authors conducted a retrospective survey of the x-ray breast imaging performed between September 2011 and September 2012 in three clinical DBT rooms equipped with Selenia Dimensions systems (Hologic Inc., Bedford, MA). A total of 343 examinations were analyzed to calculate the workload (mA-minute) and the primary air kerma at 1 m from the source (K{sup 1}). Transmission curves were calculated for the primary radiation generated by the workload distributions of the DBT rooms, and were fitted to the Archer equation. Results: There were large variations in patient volume and workload in the three examination rooms. In all these rooms, the average tube voltage (kVp) was about 31, the average K{sup 1} per patient was 16-21 mGy, and the average mA-minute per patient was 1.4-2.2 times higher than that of the mammography room described in NCRP Report No. 147. Most DBT screening examinations consisted of four two-dimensional mammographic views plus four tomosynthesis scans; the numbers of views acquired in diagnostic examinations varied widely. Tomosynthesis scans contributed about 30% of total mA-minute and about 50% of K{sup 1}. For the primary radiation generated by the clinical workload distributions, {alpha} was similar to that of 40-45 kVp W/Al (target/filter), and {alpha}+{beta} was similar to that of 30 kVp W/Al. Conclusions: The workload (mA-minute and K{sup 1}) distributions of mammographic examinations with DBT differ from conventional mammography. A field survey of patient volume and x-ray tube usage is important for the shielding design of DBT facilities. The clinical workloads and transmission data presented in this paper may be useful for clinical medical physicists.

61 RADIATION PROTECTION AND DOSIMETRY↗

A workload model and measures for computer performance evaluation

A generalized workload definition is presented which constructs measurable workloads of unit size from workload elements, called elementary processes. An elementary process makes almost exclusive use of one of the processors, CPU, I/O processor, etc., and is measured by the cost of its execution. Various kinds of user programs can be simulated by quantitative composition of elementary processes into a type. The character of the type is defined by the weights of its elementary processes and its structure by the amount and sequence of transitions between its elementary processes. A set of types is batched to a mix. Mixes of identical cost are considered as equivalent amounts of workload. These formalized descriptions of workloads allow investigators to compare the results of different studies quantitatively. Since workloads of different composition are assigned a unit of cost, these descriptions enable determination of cost effectiveness of different workloads on a machine. Subsequently performance parameters such as throughput rate, gain factor, internal and external delay factors are defined and used to demonstrate the effects of various workload attributes on the performance of a selected large scale computer system.

Kerner, H.↗

The effects of control order, feedback, practice, and input device on tracking performance and perceived workload

The present experiment examined the influence of several task-related factors on tracking performance and concomitant workload. The manipulated factors included tracking order, the presence or absence of knowledge of performance, and the control device. Summed root mean square error (rmse) and perceived workload were measured at the termination of each trial. Perceived workload was measured using the NASA Task Load Index (TLX) and the Subjective Workload Assessment Technique (SWAT). Results indicated a large and expected effect for track order on both performance and the perception of load. In general, trackball input was more accurate and judged for lower load than input using a mouse. The presence or absence of knowledge of performance had little effect on either performance or workload. There were a number of interactions between factors shown in performance that were mirrored by perceived workload scores. Results from each workload scale were equivalent in terms of sensitivity to task manipulations. The pattern of results affirm the utility of these workload measures in assessing the imposed load of multiple task-related variables.

Hancock, P. A.↗

Quantitative EEG patterns of differential in-flight workload

Four test pilots were instrumented for in-flight EEG recordings using a custom portable recording system. Each flew six, two minute tracking tasks in the Calspan NT-33 experimental trainer at Edwards AFB. With the canopy blacked out, pilots used a HUD display to chase a simulated aircraft through a random flight course. Three configurations of flight controls altered the flight characteristics to achieve low, moderate, and high workload, as determined by normative Cooper-Harper ratings. The test protocol was administered by a command pilot in the back seat. Corresponding EEG and tracking data were compared off-line. Tracking performance was measured as deviation from the target aircraft and combined with control difficulty to achieve an estimate of 'cognitive workload'. Trended patterns of parietal EEG activity at 8-12 Hz were sorted according to this classification. In all cases, high workload produced a significantly greater suppression of 8-12 Hz activity than low workload. Further, a clear differentiation of EEG trend patterns was obtained in 80 percent of the cases. High workload produced a sustained suppression of 8-12 Hz activity, while moderate workload resulted in an initial suppression followed by a gradual increment. Low workload was associated with a modulated pattern lacking any periods of marked or sustained suppression. These findings suggest that quantitative analysis of appropriate EEG measures may provide an objective and reliable in-flight index of cognitive effort that could facilitate workload assessment.

Sterman, M. B.↗

Workload: Measurement and Management

Poster: The workload research project has as its task to survey the available literature on: (1) workload measurement techniques; and (2) the effects of workload on operator performance. The first set of findings provides practitioners with a collection of simple-to-use workload measurement techniques along with characterizations of the kinds of tasks each technique has been shown reliably address. This allows design practitioners to select and use the most appropriate techniques for the task(s) at hand. The second set of findings provides practitioners with the guidance they need to design for appropriate kinds and amounts of workload across all tasks for which the operator is responsible. This guidance helps practitioners design systems and procedures that ensure appropriate levels of engagement across all tasks, and avoid designs and procedures that result in operator boredom, complacency, loss of awareness, undue levels of stress, or skill atrophy that can result from workload that distracts operators from the tasks they perform and monitor, workload levels that are too low, too high, or too consistent or predictable. Only those articles that were peer reviewed, long standing and generally accepted in the field, and applicable to a relevant range of conditions in a select domain of interest, in analogous "extreme" environments to those in space were included. In addition, all articles were reviewed and evaluated on uni-dimensional and multi-dimensional considerations. Casner & Gore also examined the notion of thresholds and the conditions that may benefit mostly from the various methodological approaches. Other considerations included whether the tools would be suitable for guiding a requirement-related and design-related question. An initial review of over 225 articles was conducted and entered into an EndNote database. The reference list included a range of conditions in the domain of interest (subjective/objective measures), the seminal works in workload, as well as summary works

Gore, Brian Francis↗

An Approach to Quantify Workload in a System of Agents

The role of humans in aviation and other domains continues to shift from manual control to automation monitoring. Studies have found that humans are often poorly suited for monitoring roles, and workload can easily spike in off-nominal situations. Current workload measurement tools, like NASA TLX, use human operators to assess their own workload after using a prototype system. Such measures are used late in the design process and can result in ex- pensive alterations when problems are discovered. Our goal in this work is to provide a quantitative workload measure for use early in the design process. We leverage research in human cognition to de ne metrics that can measure workload on belief-desire-intentions based multi-agent systems. These measures can alert designers to potential workload issues early in design. We demonstrate the utility of our approach by characterizing quantitative differences in the workload for a single pilot operations model compared to a traditional two pilot model.

Single Pilot Operations↗

RED-BL: Evaluating dynamic workload relocation for data center networks

In this study, we present RED-BL (Relocate Energy Demand to Better Locations), a framework to minimize the electricity cost for operating data center networks over consecutive intervals of fixed duration. Within each interval, RED-BL provides a mapping of workload to a set of geographically distributed data centers. To this end, RED-BL uses the geographical and temporal variations in electricity prices as exhibited by electrical energy markets. In addition, we incorporate the transition costs associated with a change in workload mapping from one interval to the next, over a planning window comprising multiple such intervals. This results in a sequence of workload mappings that is optimal over the entire planning window, even though the workload mapping in a given interval may not be locally optimal. Our evaluation of RED-BL uses electricity prices from the US markets and workload traces from live Internet applications with millions of users. We find that RED-BL can reduce the electric bill by as much as 45% compared to the case when the workload is uniformly distributed. When compared to existing workload relocation solutions, for a wide range of data center deployment sizes, RED-BL achieves electricity cost savings that are 8.28% higher, on average. This seemingly modest reduction can save millions of dollars for the operators. The cost of this saving is an inexpensive computation at the start of each planning window.

97 MATHEMATICS AND COMPUTING↗

Model-based estimation and prediction of task-imposed mental workload

Mental workload has been an area of intensive research for better than a decade. One specific area of interest in aircrew related workload research is concerned with the development of quantitative indices of workload in aircraft piloting tasks. This paper presents a model-based approach for quantifying mental workload in operational terms. The suggested modeling framework is based on an interpreted Petri net characterization of a task in which 'places' are equated to specific task-related activities and 'transitions' are viewed as internal or external forcing events. It is shown that within this framework quantitative assessments can be made of both cumulative and instantaneous workload associated with the performance of a task and its individual component subtasks. It is suggested that insights gained from analyzing task-specific workload within this modeling paradigm can suggest plausible explanations for reconciling discrepancies between subjectively elicited workload estimates and behavioral/performance measures.

Madni, A. M.↗

The dissociation of subjective measures of mental workload and performance

Dissociation between performance and subjective workload measures was investigated in the theoretical framework of the multiple resources model. Subjective measures do not preserve the vector characteristics in the multidimensional space described by the model. A theory of dissociation was proposed to locate the sources that may produce dissociation between the two workload measures. According to the theory, performance is affected by every aspect of processing whereas subjective workload is sensitive to the amount of aggregate resource investment and is dominated by the demands on the perceptual/central resources. The proposed theory was tested in three experiments. Results showed that performance improved but subjective workload was elevated with an increasing amount of resource investment. Furthermore, subjective workload was not as sensitive as was performance to differences in the amount of resource competition between two tasks. The demand on perceptual/central resources was found to be the most salient component of subjective workload. Dissociation occurred when the demand on this component was increased by the number of concurrent tasks or by the number of display elements. However, demands on response resources were weighted in subjective introspection as much as demands on perceptual/central resources. The implications of these results for workload practitioners are described.

Yeh, Y. H.↗

Modified Petri net model sensitivity to workload manipulations

Modified Petri Nets (MPNs) are investigated as a workload modeling tool. The results of an exploratory study of the sensitivity of MPNs to work load manipulations in a dual task are described. Petri nets have been used to represent systems with asynchronous, concurrent and parallel activities (Peterson, 1981). These characteristics led some researchers to suggest the use of Petri nets in workload modeling where concurrent and parallel activities are common. Petri nets are represented by places and transitions. In the workload application, places represent operator activities and transitions represent events. MPNs have been used to formally represent task events and activities of a human operator in a man-machine system. Some descriptive applications demonstrate the usefulness of MPNs in the formal representation of systems. It is the general hypothesis herein that in addition to descriptive applications, MPNs may be useful for workload estimation and prediction. The results are reported of the first of a series of experiments designed to develop and test a MPN system of workload estimation and prediction. This first experiment is a screening test of MPN model general sensitivity to changes in workload. Positive results from this experiment will justify the more complicated analyses and techniques necessary for developing a workload prediction system.

White, S. A.↗

Memory and subjective workload assessment

Recent research suggested subjective introspection of workload is not based upon specific retrieval of information from long term memory, and only reflects the average workload that is imposed upon the human operator by a particular task. These findings are based upon global ratings of workload for the overall task, suggesting that subjective ratings are limited in ability to retrieve specific details of a task from long term memory. To clarify the limits memory imposes on subjective workload assessment, the difficulty of task segments was varied and the workload of specified segments was retrospectively rated. The ratings were retrospectively collected on the manipulations of three levels of segment difficulty. Subjects were assigned to one of two memory groups. In the Before group, subjects knew before performing a block of trials which segment to rate. In the After group, subjects did not know which segment to rate until after performing the block of trials. The subjective ratings, RTs (reaction times) and MTs (movement times) were compared within group, and between group differences. Performance measures and subjective evaluations of workload reflected the experimental manipulations. Subjects were sensitive to different difficulty levels, and recalled the average workload of task components. Cueing did not appear to help recall, and memory group differences possibly reflected variations in the groups of subjects, or an additional memory task.

Staveland, L.↗

Inflight evaluation of four measures of pilot workload

Four measures of pilot workload were tested in the NASA C-141 Kuiper Airborne Observatory. The measured included a communications analysis, subjective ratings of workload, subjective ratings of additional factors related to workload, and heart rate. Data were collected for 11 flights, each of which lasted approximately seven hours. Heart rate was found to be significantly higher for the pilot who was flying than for the pilot who was not flying and it varied significantly across flight segments, peaking during landing and take off, particularly for the pilot in the left seat who was resonsible for aircraft control. For both left and right seats, the subjective assessment of stress rather than the subjective assessment of workload was significantly correlated with variation in heart rate. Frequencies of different types of communications varied significantly across segments of flight, however, they were not correlated with subjective ratings of workload. There was a significant difference between the left and right seats in the types of activities that contributed to their workload, however, workload was considered to be equivalent for the two.

Hart, S. G.↗

Predicting operator workload during system design

A workload prediction methodology was developed in response to the need to measure workloads associated with operation of advanced aircraft. The application of the methodology will involve: (1) conducting mission/task analyses of critical mission segments and assigning estimates of workload for the sensory, cognitive, and psychomotor workload components of each task identified; (2) developing computer-based workload prediction models using the task analysis data; and (3) exercising the computer models to produce predictions of crew workload under varying automation and/or crew configurations. Critical issues include reliability and validity of workload predictors and selection of appropriate criterion measures.

Aldrich, Theodore B.↗