Search NASA⌕ Search

SEARCH · Search NASA

Results for “Level of Automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Situation Awareness and Levels of Automation: Empirical Assessment of Levels of Automation in the Commercial Cockpit

This report has been prepared to closeout a NASA grant to Mississippi State University (MSU) for research into situation awareness (SA) and automation in the advanced commercial aircraft cockpit. The grant was divided into two obligations including $60,000 for the period from May 11, 2000 to December 25, 2000. The information presented in this report summarizes work completed through this obligation. It also details work to be completed with the balance of the current obligation and unobligated funds amounting to $50,043, which are to be granted to North Carolina State University for completion of the research project from July 31, 2000 to May 10, 2001. This research was to involve investigation of a broad spectrum of degrees of automation of complex systems on human-machine performance and SA. The work was to empirically assess the effect of theoretical levels of automation (LOAs) described in a taxonomy developed by Endsley & Kaber (1999) on naive and experienced subject performance and SA in simulated flight tasks. The study was to be conducted in the context of a realistic simulation of aircraft flight control. The objective of this work was to identify LOAs that effectively integrate humans and machines under normal operating conditions and failure modes. In general, the work was to provide insight into the design of automation in the commercial aircraft cockpit. Both laboratory and field investigations were to be conducted. At this point in time, a high-fidelity flight simulator of the McDonald Douglas (MD) 11 aircraft has been completed. The simulator integrates a reconfigurable flight simulator developed by the Georgia Institute of Technology and stand-alone simulations of MD-11 autoflight systems developed at MSU. Use of the simulator has been integrated into a study plan for the laboratory research and it is expected that the simulator will also be used in the field study with actual commercial pilots. In addition to the flight simulator, an electronic version of the Situation Awareness Global Assessment Technique (SAGAT) has been completed for measuring commercial pilot SA in flight tasks. The SAGAT is to be used in both the lab and field studies. Finally, the lab study has been designed and subjects have been recruited for participation in experiments. This study will investigate the effects of five levels of automation, described in Endsley & Kaber's (1999) taxonomy and applied to the MD-11 autoflight system, on private pilot performance and SA in basic flight tasks by using the MD-11 simulator. The field study remains to be planned and executed.

Kaber, David B.↗
NASA NTRS2007

Methodology for Prototyping Increased Levels of Automation for Spacecraft Rendezvous Functions

The Crew Exploration Vehicle necessitates higher levels of automation than previous NASA vehicles, due to program requirements for automation, including Automated Rendezvous and Docking. Studies of spacecraft development often point to the locus of decision-making authority between humans and computers (i.e. automation) as a prime driver for cost, safety, and mission success. Therefore, a critical component in the Crew Exploration Vehicle development is the determination of the correct level of automation. To identify the appropriate levels of automation and autonomy to design into a human space flight vehicle, NASA has created the Function-specific Level of Autonomy and Automation Tool. This paper develops a methodology for prototyping increased levels of automation for spacecraft rendezvous functions. This methodology is used to evaluate the accuracy of the Function-specific Level of Autonomy and Automation Tool specified levels of automation, via prototyping. Spacecraft rendezvous planning tasks are selected and then prototyped in Matlab using Fuzzy Logic techniques and existing Space Shuttle rendezvous trajectory algorithms.

Hart, Jeremy J.↗
NASA NTRS2014

Level of Automation and Failure Frequency Effects on Simulated Lunar Lander Performance

A human-in-the-loop experiment was conducted at the NASA Ames Research Center Vertical Motion Simulator, where instrument-rated pilots completed a simulated terminal descent phase of a lunar landing. Ten pilots participated in a 2 x 2 mixed design experiment, with level of automation as the within-subjects factor and failure frequency as the between subjects factor. The two evaluated levels of automation were high (fully automated landing) and low (manual controlled landing). During test trials, participants were exposed to either a high number of failures (75% failure frequency) or low number of failures (25% failure frequency). In order to investigate the pilots' sensitivity to changes in levels of automation and failure frequency, the dependent measure selected for this experiment was accuracy of failure diagnosis, from which D Prime and Decision Criterion were derived. For each of the dependent measures, no significant difference was found for level of automation and no significant interaction was detected between level of automation and failure frequency. A significant effect was identified for failure frequency suggesting failure frequency has a significant effect on pilots' sensitivity to failure detection and diagnosis. Participants were more likely to correctly identify and diagnose failures if they experienced the higher levels of failures, regardless of level of automation

performance↗
NASA NTRS1999

Situation Awareness and Levels of Automation

During the first year of this project, a taxonomy of theoretical levels of automation (LOAs) was applied to the advanced commercial aircraft by categorizing actual modes of McDonald Douglas MD-11 autoflight system operation in terms of the taxonomy. As well, high LOAs included in the taxonomy (e.g., supervisory control) were modeled in the context of MD-11 autoflight systems through development of a virtual flight simulator. The flight simulator was an integration of a re-configurable simulator developed by the Georgia Institute Technology and new software prototypes of autoflight system modules found in the MD-11 cockpit. In addition to this work, a version of the Situation Awareness Global Assessment Technique (SAGAT) was developed for application to commercial piloting tasks. A software package was developed to deliver the SAGAT and was integrated with the virtual flight simulator.

Kaber, David B.↗
NASA NTRS2012

Varying Levels of Automation on UAS Operator Responses to Traffic Resolution Advisories in Civil Airspace

Continuing demand for the use of Unmanned Aircraft Systems (UAS) has put increasing pressure on operations in civil airspace. The need to fly UAS in the National Airspace System (NAS) in order to perform missions vital to national security and defense, emergency management, and science is increasing at a rapid pace. In order to ensure safe operations in the NAS, operators of unmanned aircraft, like those of manned aircraft, may be required to maintain separation assurance and avoid loss of separation with other aircraft while performing their mission tasks. This experiment investigated the effects of varying levels of automation on UAS operator performance and workload while responding to conflict resolution instructions provided by the Tactical Collision Avoidance System II (TCAS II) during a UAS mission in high-density airspace. The purpose of this study was not to investigate the safety of using TCAS II on UAS, but rather to examine the effect of automation on the ability of operators to respond to traffic collision alerts. Six licensed pilots were recruited to act as UAS operators for this study. Operators were instructed to follow a specified mission flight path, while maintaining radio contact with Air Traffic Control and responding to TCAS II resolution advisories. Operators flew four, 45 minute, experimental missions with four different levels of automation: Manual, Knobs, Management by Exception, and Fully Automated. All missions included TCAS II Resolution Advisories (RAs) that required operator attention and rerouting. Operator compliance and reaction time to RAs was measured, and post-run NASA-TLX ratings were collected to measure workload. Results showed significantly higher compliance rates, faster responses to TCAS II alerts, as well as less preemptive operator actions when higher levels of automation are implemented. Physical and Temporal ratings of workload were significantly higher in the Manual condition than in the Management by Exception and Fully Automated conditions.

Kenny, Caitlin↗
NASA NTRS1991

Effects of shifts in the level of automation on operator performance

The results of two experiments examining the effects of shifts in the type and level of automation on operator performance are presented. The first examines the costs and benefits of adaptive-automation shifts on operator performance, while the second experiment examines the effects of variations in automation reliability on operator detection of automation failures. Performance consequences of complacency in system monitoring are shown to be related to characteristics of the monitoring task automation, i.e., automation reliability and consistency.

Parasuraman, Raja↗
NASA NTRS2017

The Relationship Between Workload and Performance in Air Traffic Control: Exploring the Influence of Levels of Automation and Variation in Task Demand

In an air traffic environment, task demand is dynamic. However, previous research has largely considered the association of task demand and controller performance using conditions of stable task demand. Further, there is a comparatively restricted understanding of the influence of task demand transitions on workload and performance in association with different types and levels of automation that are available to controllers. This study used an air traffic control simulation to investigate the influence of task demand transitions, and two conditions of automation, on workload and efficiency-related performance. Findings showed that both the direction of the task demand variation and the amount of automation influenced the relationship between workload and performance. Findings are discussed in relation to capacity and arousal theories. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

function allocation↗
NASA NTRS1977

Unexpected dividends from level 16 automated substructuring

The automated multistage substructuring capability now available in NASTRAN level 16 is shown to provide a number of unexpected tools for use in both project planning and the structural design cycle. The payoffs in terms of improved design, more reliable results, and confidence are extra benefits added to the savings in cost and schedule that can be realized. To realize these advantages, some old stereotypical assumptions of what substructuring entails are must be challenged.

Field, E. I.↗
NASA NTRS1991

Electronic checklists - Evaluation of two levels of automation

Two versions of an electronic checklist have been implemented in the Advanced Concepts Flight Simulator (ACFS) at NASA Research Center. The two designs differ in the degree of pilot involvement in conducting the checklists. One version (manual-sensed), requires the crew to manually acknowledge the completion of each checklist item. The other version (automatic-sensed), automatically indicates completed items without requiring pilot acknowledgement. These two designs and a paper checklist (as a control condition) were evaluated in line oriented simulation. Twelve aircrews from one major air-carrier flew a routine, four leg, short-haul trip. This paper presents and discusses the portion of the experiment that was concerned with measuring the effect of the degree of automation on the crews' performance. It discusses and presents evidence for a potential down-side of implementing an electronic checklist that is designed to provide fully redundant monitoring of human procedure execution and monitoring.

Palmer, Everett↗
NASA NTRS2017

Workload and Performance in Air Traffic Control: Exploring the Influence of Levels of Automation and Variation in Task Demand

In air traffic control, task demand and workload have important implications for the safety and efficiency of air traffic. Task demand is dynamic, however, research on demand transitions and associated controller perception and performance is limited. In addition, there is a comparatively restricted understanding of the influence of task demand transitions on workload and performance, in association with automation. This study used an air traffic control simulation to investigate the influence of task demand transitions and two conditions of varying automation, on workload and efficiency-related performance. Findings showed that a both the direction of the task demand variation, and the amount of automation, influenced the relationship between workload and performance. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

air traffic control↗
NASA NTRS2001

Cockpit Adaptive Automation and Pilot Performance

The introduction of high-level automated systems in the aircraft cockpit has provided several benefits, e.g., new capabilities, enhanced operational efficiency, and reduced crew workload. At the same time, conventional 'static' automation has sometimes degraded human operator monitoring performance, increased workload, and reduced situation awareness. Adaptive automation represents an alternative to static automation. In this approach, task allocation between human operators and computer systems is flexible and context-dependent rather than static. Adaptive automation, or adaptive task allocation, is thought to provide for regulation of operator workload and performance, while preserving the benefits of static automation. In previous research we have reported beneficial effects of adaptive automation on the performance of both pilots and non-pilots of flight-related tasks. For adaptive systems to be viable, however, such benefits need to be examined jointly in the context of a single set of tasks. The studies carried out under this project evaluated a systematic method for combining different forms of adaptive automation. A model for effective combination of different forms of adaptive automation, based on matching adaptation to operator workload was proposed and tested. The model was evaluated in studies using IFR-rated pilots flying a general-aviation simulator. Performance, subjective, and physiological (heart rate variability, eye scan-paths) measures of workload were recorded. The studies compared workload-based adaptation to to non-adaptive control conditions and found evidence for systematic benefits of adaptive automation. The research provides an empirical basis for evaluating the effectiveness of adaptive automation in the cockpit. The results contribute to the development of design principles and guidelines for the implementation of adaptive automation in the cockpit, particularly in general aviation, and in other human-machine systems. Project goals were met or exceeded. The results of the research extended knowledge of automation-related performance decrements in pilots and demonstrated the positive effects of adaptive task allocation. In addition, several practical implications for cockpit automation design were drawn from the research conducted. A total of 12 articles deriving from the project were published.

Parasuraman, Raja↗
NASA NTRS2001

Effects of Selected Task Performance Criteria at Initiating Adaptive Task Real locations

In the current report various performance assessment methods used to initiate mode transfers between manual control and automation for adaptive task reallocation were tested. Participants monitored two secondary tasks for critical events while actively controlling a process in a fictional system. One of the secondary monitoring tasks could be automated whenever operators' performance was below acceptable levels. Automation of the secondary task and transfer of the secondary task back to manual control were either human- or machine-initiated. Human-initiated transfers were based on the operator's assessment of the current task demands while machine-initiated transfers were based on the operators' performance. Different performance assessment methods were tested in two separate experiments.

Montgomery, Demaris A.↗
NASA NTRS1976

Three-level sampler having automated thresholds

A three-level sampler is described that has its thresholds controlled automatically so as to track changes in the statistics of the random process being sampled. In particular, the mean value is removed and the ratio of the standard deviation of the random process to the threshold is maintained constant. The system is configured in such a manner that slow drifts in the level comparators and digital-to-analog converters are also removed. The ratio of the standard deviation to threshold level may be chosen within the constraints of the ratios of two integers N and M. These may be chosen to minimize the quantizing noise of the sampled process.

Jurgens, R. F.↗
NASA NTRS1995

Pilot opinions on high level flight deck automation issues: Toward the development of a design philosophy

There has been much concern in recent years about the rapid increase in automation on commercial flight decks. The survey was composed of three major sections. The first section asked pilots to rate different automation components that exist on the latest commercial aircraft regarding their obtrusiveness and the attention and effort required in using them. The second section addressed general 'automation philosophy' issues. The third section focused on issues related to levels and amount of automation. The results indicate that pilots of advanced aircraft like their automation, use it, and would welcome more automation. However, they also believe that automation has many disadvantages, especially fully autonomous automation. They want their automation to be simple and reliable and to produce predictable results. The biggest needs for higher levels of automation were in pre-flight, communication, systems management, and task management functions, planning as well as response tasks, and high workload situations. There is an irony and a challenge in the implications of these findings. On the one hand pilots would like new automation to be simple and reliable, but they need it to support the most complex part of the job--managing and planning tasks in high workload situations.

Tenney, Yvette J.↗
NASA NTRS2021

m:N and Human Autonomy Teaming Concepts for High Density Vertiport Operations

This report focuses on the role of the Fleet Manager (FM) and, in particular, the ways in which automation could support their position as they manage multiple aircraft and operators in a highly dynamic, advanced air mobility (e.g., air taxi) environment, specifically "high-density vertiport" (HDV) regions. Similar to terminal area operations for traditional aviation, operations involving HDVs will need to be highly structured while also remaining resilient to the various contingencies that can happen in that environment. The role of the FM is consistent with an “m:N” architecture, where “m” number of operators cooperatively manage “N” number of vehicles (where “N” is always larger than “m”). In such a paradigm it is critical to provide the operator with the tools and information necessary to manage their fleet safely and navigate the known pitfalls with highly automated, complex systems (e.g., brittleness, insufficient situation awareness, skill degradation). As the field of m:N has expanded as an area of study, a set of higher-level automation concepts have emerged—namely “plays,” “working agreements,” and “human-autonomy teaming” (HAT)—that could support operators in this new role.

human autonomy teaming↗
NASA NTRS2006

Plan Execution Interchange Language (PLEXIL)

Plan execution is a cornerstone of spacecraft operations, irrespective of whether the plans to be executed are generated on board the spacecraft or on the ground. Plan execution frameworks vary greatly, due to both different capabilities of the execution systems, and relations to associated decision-making frameworks. The latter dependency has made the reuse of execution and planning frameworks more difficult, and has all but precluded information sharing between different execution and decision-making systems. As a step in the direction of addressing some of these issues, a general plan execution language, called the Plan Execution Interchange Language (PLEXIL), is being developed. PLEXIL is capable of expressing concepts used by many high-level automated planners and hence provides an interface to multiple planners. PLEXIL includes a domain description that specifies command types, expansions, constraints, etc., as well as feedback to the higher-level decision-making capabilities. This document describes the grammar and semantics of PLEXIL. It includes a graphical depiction of this grammar and illustrative rover scenarios. It also outlines ongoing work on implementing a universal execution system, based on PLEXIL, using state-of-the-art rover functional interfaces and planners as test cases.

Estlin, Tara↗
NASA NTRS2006

Thrust Stand for Electric Propulsion Performance Evaluation

An electric propulsion thrust stand capable of supporting testing of thrusters having a total mass of up to 125 kg and producing thrust levels between 100 microN to 1 N has been developed and tested. The design features a conventional hanging pendulum arm attached to a balance mechanism that converts horizontal deflections produced by the operating thruster into amplified vertical motion of a secondary arm. The level of amplification is changed through adjustment of the location of one of the pivot points linking the system. Response of the system depends on the relative magnitudes of the restoring moments applied by the displaced thruster mass and the twisting torsional pivots connecting the members of the balance mechanism. Displacement is measured using a non-contact, optical linear gap displacement transducer and balance oscillatory motion is attenuated using a passive, eddy-current damper. The thrust stand employs an automated leveling and thermal control system. Pools of liquid gallium are used to deliver power to the thruster without using solid wire connections, which can exert undesirable time-varying forces on the balance. These systems serve to eliminate sources of zero-drift that can occur as the stand thermally or mechanically shifts during the course of an experiment. An in-situ calibration rig allows for steady-state calibration before, during and after thruster operation. Thrust measurements were carried out on a cylindrical Hall thruster that produces mN-level thrust. The measurements were very repeatable, producing results that compare favorably with previously published performance data, but with considerably smaller uncertainty.

Polzin, Kurt A.↗