On the length-difficulty relation in skill performance.
On length difficulty relation in performance of tracking task
OPERATOR PERFORMANCE↗
SEARCH · Search NASA
Results for “complex task performance”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Crew factors in flight operations. Part 3: The operational significance of exposure to short-haul air transport operations
Excessive flightcrew fatigue has potentially serious safety consequences. Laboratory studies have implicated fatigue as a causal factor associated with varying levels of performance deterioration depending on the amount of fatigue and the type of measure utilized in assessing performance. These studies have been of limited utility because of the difficulty of relating laboratory task performance to the demands associated with the operation of a complex aircraft. The performance of 20 volunteer twin-jet transport crews is examined in a full-mission simulator scenario that included most aspects of an actual line operation. The scenario included both routine flight operations and an unexpected mechanical abnormality which resulted in a high level of crew workload. Half of the crews flew the simulation within two to three hours after completing a three-day, high-density, short-haul duty cycle (Post-Duty condition). The other half flew the scenario after a minimum of three days off duty (Pre-Duty) condition). The results revealed that, not surprisingly, Post-Duty crews were significantly more fatigued than Pre-Duty crews. However, a somewhat counter-intuitive pattern of results emerged on the crew performancemeasures. In general, the performance of Post-Duty crews was significantly better than that of Pre-Duty crews, as rated by an expert observer on a number of dimensions relevant to flight safety. Analyses of the flightcrew communication patterns revealed that Post-Duty crews communicated significantly more overall, suggesting, as has previous research, that communication is a good predictor of overall crew performance.
Foushee, H. C.↗
A Piloted Simulation Study of Advanced Controls and Displays for General Aviation Airplanes
A decoupled, fly-by-wire control system combined with a pictorial head-up display has been developed and evaluated on a piloted simulator. The test subjects used in the evaluation were primarily non-pilots who were given no training or practice before the data runs. Despite their lack of experience and training, all of the test subjects were able to complete a complex piloting task on their very first run. The piloting task was performed in reduced visibility conditions and consisted of a continuous series of common maneuvers beginning with a takeoff and ending with a landing. Severe upsets from turbulence and emergency situations such as engine failure were not simulated. Quantitative qualitative data are presented to illustrate the large improvements in subject performance when using the advanced controls and displays compared to the conventional ones.
Eric C. Stewart↗
Structured analysis and modeling of complex systems
The Aircrew Evaluation Sustained Operations Performance (AESOP) facility at Brooks AFB, Texas, combines the realism of an operational environment with the control of a research laboratory. In recent studies we collected extensive data from the Airborne Warning and Control Systems (AWACS) Weapons Directors subjected to high and low workload Defensive Counter Air Scenarios. A critical and complex task in this environment involves committing a friendly fighter against a hostile fighter. Structured Analysis and Design techniques and computer modeling systems were applied to this task as tools for analyzing subject performance and workload. This technology is being transferred to the Man-Systems Division of NASA Johnson Space Center for application to complex mission related tasks, such as manipulating the Shuttle grappler arm.
Strome, David R.↗
Robotic Manipulation Testbeds with HPSC
Interoperability and scalability of robotic manipulators will be key to develop and sustain a lunar surface and cislunar ecosystem. From in-space servicing, assembly, and manufacturing (ISAM) to logistics, maintenance, and science operations, robotic manipulation is a critical NASA capability need and the demand for high-performance spaceflight computing will only rise as robotic tasks become more autonomous. With increased complexity, testbeds for research, feasibility studies, and technology demonstrations will be essential. The Dexterous Robotics Team at NASA Johnson Space Center has established multiple robotic manipulation testbeds taking a supervised autonomous remote operations approach and plans to infuse High-Performance Spaceflight Computing (HPSC) to emulate the flight environment and close the gap between space technology development and flight operations.
Alex Sowell↗
Crew Autonomy through Self-Scheduling: Scheduling Performance Pilot Study
Within the domain of human spaceflight, crew scheduling for International Space Station (ISS) remains a human-driven planning task. Large teams of flight controllers (called Ops Planners) spend weeks creating violation-free schedules for all crewmembers. As NASA considers long-duration exploration missions, the necessary shift of scheduling and planning management from Ops Planners to crew members requires significant research and investigation of crew performance to complete these scheduling tasks. This pilot study was conducted to evaluate non-expert human performance for the task of planning and scheduling, focusing on scheduling problems that increased in complexity based on the number of activities to be scheduled and the number of planning constraints. Nine non-expert planners were recruited to complete scheduling tasks using Playbook, a scheduling software. The results of this pilot study show that scheduling performance decreased as scheduling workload (i.e. number of activities and percent of activities with planning constraints) increased. This paper provides evidence towards developing a model for scheduling task difficulty and identifies potential implications for future automated aids for flight crew scheduling.
planning↗
Crew Autonomy Through Self-Scheduling: Scheduling Performance Pilot Study
Within the domain of human spaceflight, crew scheduling for International Space Station (ISS) remains a human-driven planning task. Large teams of flight controllers (called Ops Planners) spend weeks creating violation-free schedules for all crewmembers. As NASA considers long-duration exploration missions, the necessary shift of scheduling and planning management from Ops Planners to crew members requires significant research and investigation of crew performance to complete these scheduling tasks. This pilot study was conducted to evaluate non-expert human performance for the task of planning and scheduling, focusing on scheduling problems that increased in complexity based on the number of activities to be scheduled and the number of planning constraints. Nine non-expert planners were recruited to complete scheduling tasks using Playbook, a scheduling software. The results of this pilot study show that scheduling performance decreased as scheduling workload (i.e. number of activities and percent of activities with planning constraints) increased. This paper provides evidence towards developing a model for scheduling task difficulty and identifies potential implications for future automated aids for flight crew scheduling.
planning↗
The effects of syntactic complexity on the human-computer interaction
Three divided-attention experiments were performed to evaluate the effectiveness of a syntactic analysis of the primary task of editing flight route-way-point information. For all editing conditions, a formal syntactic expression was developed for the operator's interaction with the computer. In terms of the syntactic expression, four measures of syntactic were examined. Increased syntactic complexity did increase the time to train operators, but once the operators were trained, syntactic complexity did not influence the divided-attention performance. However, the number of memory retrievals required of the operator significantly accounted for the variation in the accuracy, workload, and task completion time found on the different editing tasks under attention-sharing conditions.
Chechile, R. A.↗
Characterization of Deficiencies in the Frequency Domain Forced Response Analysis Technique for Supersonic Turbine Bladed Disks
Turbine blades in rocket and jet engine turbomachinery experience enormous harmonic loading conditions. These loads result from the integer number of upstream and downstream stator vanes as well as the other turbine stages. Assessing the blade structural integrity is a complex task requiring an initial characterization of whether resonance is possible and then performing a forced response analysis if that condition is met. The standard technique for forced response analysis in rocket engines is to decompose a CFD-generated flow field into its harmonic components, and to then perform a frequency response analysis at the problematic natural frequencies. Recent CFD analysis and water-flow testing at NASA/MSFC, though, indicates that this technique may miss substantial harmonic and non-harmonic excitation sources that become present in complex flows. A substantial effort has been made to account for this denser spatial Fourier content in frequency response analysis (described in another paper by the author), but the question still remains whether the frequency response analysis itself is capable of capturing the excitation content sufficiently. Two studies comparing frequency response analysis with transient response analysis, therefore, of bladed-disks undergoing this complex flow environment have been performed. The first is of a bladed disk with each blade modeled by simple beam elements. Six loading cases were generated by varying a baseline harmonic excitation in different ways based upon cold-flow testing from Heritage Fuel Air Turbine Test. It was hypothesized that the randomness and other variation from the standard harmonic excitation would reduce the blade structural response, but the results showed little reduction. The second study was of a realistic model of a bladed-disk excited by the same CFD used in the J2X engine program. It was hypothesized that enforcing periodicity in the CFD (inherent in the frequency response technique) would overestimate the response. The results instead showed that the transient analysis results were up to 10% higher for "clean" nodal diameter excitations and six times larger for "messy" excitations, where substantial Fourier content around the main harmonic exists. Because the bulk of resonance problems are due to the "clean" excitations, a 10% underprediction is not necessarily a problem, especially since the average response in the transient is similar to the frequency response result, and so in a realistic finite life calculation, the life would be same. However, in the rare cases when the "messy" excitations harmonics are identified as the source of potential resonance concerns, this research does indicate that frequency response analysis is inadequate for accurate characterization of blade structural capability.
Brown, Andrew M.↗
Characterization of Deficiencies in the Frequency Domain Forced Response Analysis Technique for Supersonic Turbine Bladed Disks
Turbine blades in rocket and jet engine turbomachinery experience enormous harmonic loading conditions. These loads result from the integer number of upstream and downstream stator vanes as well as the other turbine stages. Assessing the blade structural integrity is a complex task requiring an initial characterization of whether resonance is possible and then performing a forced response analysis if that condition is met. The standard technique for forced response analysis in rocket engine turbines is to decompose a computational fluid dynamics (CFD).generated flow field into its harmonic components, and to then perform a frequency response analysis at the problematic natural frequencies using cyclically symmetric structural dynamic models. Recent CFD analysis and water-flow testing at NASA/MSFC, though, indicates that this technique may miss substantial harmonic and non ]harmonic excitation sources that become present in complex flows. This complex content can only be captured by a CFD flow field encompassing at least an entire revolution. A substantial development effort to create a series of software programs to enable application of the 360 degree forcing function in a frequency response analysis on cyclic symmetric models has been completed (to be described in a future paper), but the question still remains whether the frequency response analysis itself is capable of capturing the excitation content sufficiently. Two studies comparing frequency response analysis with transient response analysis, therefore, of bladed-disks undergoing this complex flow environment have been performed. The first is of a bladed disk with each blade modeled by simple beam elements and the disk modeled with plates (using the finite element code MSC/NASTRAN). The focus of this model is to be representative of response of realistic bladed disks, and so the dimensions are roughly equivalent to the new J2X rocket engine 1st stage fuel pump turbine. The simplicity of the model allows the CFD load to be able to be readily applied, along with analytical and experimental variations in both the temporal and spatial fourier components of the excitation. In addition, this model is a first step in identifying response differences between transient and frequency forced response analysis techniques. The second phase assesses this difference for a much more realistic solid model of a bladed-disk in order to evaluate the effect of the spatial variation in loading on blade dominated modes. Neither research on the accuracy of the frequency response method when used in this context or a comprehensive study of the effect of test-observed variation on blade forced response have been found in the literature, so this research is a new contribution to practical structural dynamic analysis of gas turbines. The primary excitation of the upstream nozzles interacts with the blades on fuel pump of the J2X causes the 5th Nodal diameter modes to be excited, as explained by Tyler and Sofrin1, so a modal analysis was first performed on the beam/plate model and the 5ND bladed-disk mode at 40167 hz was identified and chosen to be the one excited at resonance (see figure 1). The first forced response analysis with this model focuses on identifying differences between frequency and transient response analyses. A hypothesis going into the analysis was that perhaps the frequency response was enforcing a temporal periodicity that did not really exist, and so therefore it would overestimate the response. As high dynamic response was a considerable source of stress in the J2X, examining this concept could potentially be beneficial for the program.
Brown, Andrew M.↗
Centrifuge Study of Pilot Tolerance to Acceleration and the Effects of Acceleration on Pilot Performance
A research program the general objective of which was to measure the effects of various sustained accelerations on the control performance of pilots, was carried out on the Aviation Medical Acceleration Laboratory centrifuge, U.S. Naval Air Development Center, Johnsville, PA. The experimental setup consisted of a flight simulator with the centrifuge in the control loop. The pilot performed his control tasks while being subjected to acceleration fields such as might be encountered by a forward-facing pilot flying an atmosphere entry vehicle. The study was divided into three phases. In one phase of the program, the pilots were subjected to a variety of sustained linear acceleration forces while controlling vehicles with several different sets of longitudinal dynamics. Here, a randomly moving target was displayed to the pilot on a cathode-ray tube. For each combination of acceleration field and vehicle dynamics, pilot tracking accuracy was measured and pilot opinion of the stability and control characteristics was recorded. Thus, information was obtained on the combined effects of complexity of control task and magnitude and direction of acceleration forces on pilot performance. These tests showed that the pilot's tracking performance deteriorated markedly at accelerations greater than about 4g when controlling a lightly damped vehicle. The tentative conclusion was also reached that regardless of the airframe dynamics involved, the pilot feels that in order to have the same level of control over the vehicle, an increase in the vehicle dynamic stability was required with increases in the magnitudes of the acceleration impressed upon the pilot. In another phase, boundaries of human tolerance of acceleration were established for acceleration fields such as might be encountered by a pilot flying an orbital vehicle. A special pilot restraint system was developed to increase human tolerance to longitudinal decelerations. The results of the tests showed that human tolerance of longitudinal deceleration forces was considerably improved through use of the special restraint system.
Creer, Brent Y.↗
Cognitive and affective components of mental workload: Understanding the effects of each on human decision making behavior
Human factors and ergonomics researchers have recognized for some time the increasing importance of understanding the role of the construct of mental workload in flight research. Current models of mental workload suggest that it is a multidimensional and complex construct, but one that has proved difficult to measure. Because of this difficulty, emphasis has usually been placed on using direct reports through subjective measures such as rating scales to assess levels of mental workload. The NASA Task Load Index (NASA/TLX, Hart and Staveland) has been shown to be a highly reliable and sensitive measure of perceived mental workload. But a problem with measures like TLX is that there is still considerable disagreement as to what it is about mental workload that these subjective measures are actually measuring. The empirical use of subjective workload measures has largely been to provide estimates of the cognitive components of the actual mental workload required for a task. However, my research suggests that these measures may, in fact have greater potential in accurately assessing the affective components of workload. That is, for example, TLX may be more likely to assess the positive and negative feelings associated with varying workload levels, which in turn may potentially influence the decision making behavior that directly bears on performance and safety issues. Pilots, for example, are often called upon to complete many complex tasks that are high in mental workload, stress, and frustration, and that have significant dynamic decision making components -- often ones that involve risk as well.
Nygren, Thomas E.↗
Functional brain imaging of a complex navigation task following one night of total sleep deprivation
Study Objectives: To assess the cerebral effects associated with sleep deprivation in a simulation of a complex, real-world, high-risk task. Design and Interventions: A two-week, repeated measures, cross-over experimental protocol, with counterbalanced orders of normal sleep (NS) and total sleep deprivation (TSD). Setting: Each subject underwent functional magnetic resonance imaging (fMRI) while performing a dual-joystick, 3D sensorimotor navigation task (simulated orbital docking). Scanning was performed twice per subject, once following a night of normal sleep (NS), and once following a single night of total sleep deprivation (TSD). Five runs (eight 24s docking trials each) were performed during each scanning session. Participants: Six healthy, young, right-handed volunteers (2 women; mean age 20) participated. Measurements and Results: Behavioral performance on multiple measures was comparable in the two sleep conditions. Neuroimaging results within sleep conditions revealed similar locations of peak activity for NS and TSD, including left sensorimotor cortex, left precuneus (BA 7), and right visual areas (BA 18/19). However, cerebral activation following TSD was substantially larger and exhibited higher amplitude modulations from baseline. When directly comparing NS and TSD, most regions exhibited TSD>NS activity, including multiple prefrontal cortical areas (BA 8/9,44/45,47), lateral parieto-occipital areas (BA 19/39, 40), superior temporal cortex (BA 22), and bilateral thalamus and amygdala. Only left parietal cortex (BA 7) demonstrated NS>TSD activity. Conclusions: The large network of cerebral differences between the two conditions, even with comparable behavioral performance, suggests the possibility of detecting TSD-induced stress via functional brain imaging techniques on complex tasks before stress-induced failures.
Strangman, Gary↗
Building a computer-aided design capability using a standard time share operating system
The paper describes how an integrated system of engineering computer programs can be built using a standard commercially available operating system. The discussion opens with an outline of the auxiliary functions that an operating system can perform for a team of engineers involved in a large and complex task. An example of a specific integrated system is provided to explain how the standard operating system features can be used to organize the programs into a simple and inexpensive but effective system. Applications to an aircraft structural design study are discussed to illustrate the use of an integrated system as a flexible and efficient engineering tool. The discussion concludes with an engineer's assessment of an operating system's capabilities and desirable improvements.
Sobieszczanski, J.↗
High resolution ultrasonic spectroscopy system for nondestructive evaluation
With increased demand for high resolution ultrasonic evaluation, computer based systems or work stations become essential. The ultrasonic spectroscopy method of nondestructive evaluation (NDE) was used to develop a high resolution ultrasonic inspection system supported by modern signal processing, pattern recognition, and neural network technologies. The basic system which was completed consists of a 386/20 MHz PC (IBM AT compatible), a pulser/receiver, a digital oscilloscope with serial and parallel communications to the computer, an immersion tank with motor control of X-Y axis movement, and the supporting software package, IUNDE, for interactive ultrasonic evaluation. Although the hardware components are commercially available, the software development is entirely original. By integrating signal processing, pattern recognition, maximum entropy spectral analysis, and artificial neural network functions into the system, many NDE tasks can be performed. The high resolution graphics capability provides visualization of complex NDE problems. The phase 3 efforts involve intensive marketing of the software package and collaborative work with industrial sectors.
Chen, C. H.↗
Quality assurance and risk management: Perspectives on Human Factors Certification of Advanced Aviation Systems
This paper is based on the experience of engineering psychologists advising the U.K. Ministry of Defense (MoD) on the procurement of advanced aviation systems that conform to good human engineering (HE) practice. Traditional approaches to HE in systems procurement focus on the physical nature of the human-machine interface. Advanced aviation systems present increasingly complex design requirements for human functional integration, information processing, and cognitive task performance effectiveness. These developing requirements present new challenges for HE quality assurance (QA) and risk management, requiring focus on design processes as well as on design content or product. A new approach to the application of HE, recently adopted by NATO, provides more systematic ordering and control of HE processes and activities to meet the challenges of advanced aircrew systems design. This systematic approach to HE has been applied by MoD to the procurement of mission systems for the Royal Navy Merlin helicopter. In MoD procurement, certification is a judicial function, essentially independent of the service customer and industry contractor. Certification decisions are based on advice from MoD's appointed Acceptance Agency. Test and evaluation (T&E) conducted by the contractor and by the Acceptance Agency provide evidence for certification. Certification identifies limitations of systems upon release to the service. Evidence of compliance with HE standards traditionally forms the main basis of HE certification and significant non-compliance could restrict release. The systems HE approach shows concern for the quality of processes as well as for the content of the product. Human factors certification should be concerned with the quality of HE processes as well as products. Certification should require proof of process as well as proof of content and performance. QA criteria such as completeness, consistency, timeliness, and compatibility provide generic guidelines for progressive acceptance and certification of HE processes. Threats to the validity of certification arise from problems and assumptions in T&E methods. T&E should seek to reduce the risk of specification non-compliance and certification failure.
Taylor, Robert M.↗
Controlling Air Traffic (Simulated) in the Presence of Automation (CATS PAu) 1995: A Study of Measurement Techniques for Situation Awareness in Air Traffic Control
As automated systems proliferate in aviation systems, human operators are taking on less and less of an active role in the jobs they once performed, often reducing what should be important jobs to tasks barely more complex than monitoring machines. When operators are forced into these roles, they risk slipping into hazardous states of awareness, which can lead to reduced skills, lack of vigilance, and the inability to react quickly and competently when there is a machine failure. Using Air Traffic Control (ATC) as a model, the present study developed tools for conducting tests focusing on levels of automation as they relate to situation awareness. Subjects participated in a two-and-a-half hour experiment that consisted of a training period followed by a simulation of air traffic control similar to the system presently used by the FAA, then an additional simulation employing automated assistance. Through an iterative design process utilizing numerous revisions and three experimental sessions, several measures for situational awareness in a simulated Air Traffic Control System were developed and are prepared for use in future experiments.
French, Jennifer R.↗
Evaluation of Self-Scheduling Exercises Completed by Analog Crewmembers in NASA's Human Exploration Research Analog (HERA)
NASA human spaceflight missions are inherently dynamic and require frequent scheduling changes in order to adapt to changing mission priorities and objectives. Tactical level changes to the mission plan are traditionally made by a team of expert planners and operations specialists on the ground. However, astronauts are expected to execute missions more autonomously during future long duration missions. Astronauts will need to take on some of the responsibility of managing their own schedule while still abiding by the numerous constraints required by human spaceflight operations. This paper summarizes salient elements of crew performance in NASA’s Human Exploration Research Analog Campaign 3. Analog crewmembers completed a series of self-scheduling exercises to evaluate Playbook’s usability towards enabling self-scheduling without support from ground control. Playbook is a self-scheduling software tool designed and developed by our team. We also investigated how to best communicate self-scheduling tasks and constraints to the crew in order to facilitate efficient self-scheduling during isolation in a realistic environment. Our analysis identified that 30 minutes was sufficient to complete complex self-scheduling tasks. Our evaluation also identified differences between individual and collaborative performance; analog crewmembers completed self-scheduling exercises more quickly as a team as opposed to individually and reported lower subjective difficulty ratings overall.
HERA↗