Search NASA⌕ Search

SEARCH · Search NASA

Results for “cognitive task analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Naturalistic Decision Making for Power System Operators

Motivation – Investigations of large-scale outages in the North American interconnected electric system often attribute the causes to three T’s: Trees, Training and Tools. To document and understand the mental processes used by expert operators when making critical decisions, a naturalistic decision making (NDM) model was developed. Transcripts of conversations were analyzed to reveal and assess NDM-based performance criteria. Findings/Design – An item analysis indicated that the operators’ Situation Awareness Levels, mental models, and mental simulations can be mapped at different points in the training scenario. This may identify improved training methods or analytical/ visualization tools. Originality/Value – This study applies for the first time, the concepts of Recognition Primed Decision Making, Situation Awareness Levels and Cognitive Task Analysis to training of electric power system operators. Take away message – The NDM approach provides a viable framework for systematic training management to accelerate learning in simulator-based training scenarios for power system operators and teams.

24 POWER TRANSMISSION AND DISTRIBUTION↗

View graphs for GSFC Colloquium on OFMspert

Viewgraphs providing an overview of activities concerned with the development and testing of the Operator Function Model (OFM) expert system (OFMspert) are presented. The OFM is a mathematical tool for representing operator interaction with predominantly automated space ground control systems. OFM provides cognitive task analysis and served as the basis for the design of an intelligent operator's associate called OMFspert. An experimental implementation of OFMspert, referred to as Ally, was developed. An empirical evaluation of Ally was conducted to determine the effectiveness of a supervisory control team consisting of a human operator and Ally versus a control team consisting of two human operators. The experiment was carried out in the GT-MSOCC (Georgia Tech MultiSatellite Operations Control Center) domain, a research tool consisting of a high fidelity implementation of the operator interface to a GSFC ground control system. The viewgraphs outline the experimental design, operator performance measures, and preliminary results.

Mitchell, Christine M.↗

Graphical interfaces for cooperative planning systems

Based on a cognitive task analysis of 5 airline flight crews in a simulator study, researchers have designed a testbed for studying computer aids for en route flight path planning. This testbed runs on a Mac II controlling three color monitors, and is being used to study the design of aids for both dispatchers and flight crews. Specifically, the research focuses on design concepts for developing cooperative problem-solving systems. We use en route flight planning (selecting alternate routes or destinations due to unanticipated weather, traffic, malfunctions, etc.) as the context for studying the design of such systems. Researchers are currently exploring three questions in this test environment: (1) When interacting with a flight planning aid, how does the role of the pilot influence overall system performance; (2) Can the architecture for a cooperative planning system be built around Sacerdoti's (1983) concept of an abstraction hierarchy, where the pilot can interact with the system at many different levels of detail (but where the computer aid by default handles lower level details that the pilot has chosen not to deat with); and (3) Can graphical displays and direct manipulation of these displays provide perceptual enhancements (Larkin and Simon, 1987) of the pilot's problem-solving activities. Information is given in viewgraph form.

Smith, Philip J.↗

A testbed for the evaluation of computer aids for enroute flight path planning

A simulator study of the five airline flight crews engaged in various enroute planning activities has been conducted. Based on a cognitive task analysis of this data, a flight planning workstation has been developed on a Mac II controlling three color monitors. This workstation is being used to study design concepts to support the flight planning activities of dispatchers and flight crews in part-task simulators.

Smith, Philip J.↗

Trends in HFE Methods and Tools and Their Applicability to Safety Reviews

The U.S. Nuclear Regulatory Commission's (NRC) conducts human factors engineering (HFE) safety reviews of applicant submittals for new plants and for changes to existing plants. The reviews include the evaluation of the methods and tools (M&T) used by applicants as part of their HFE program. The technology used to perform HFE activities has been rapidly evolving, resulting in a whole new generation of HFE M&Ts. The objectives of this research were to identify the current trends in HFE methods and tools, determine their applicability to NRC safety reviews, and identify topics for which the NRC may need additional guidance to support the NRC's safety reviews. We conducted a survey that identified over 100 new HFE M&Ts. The M&Ts were assessed to identify general trends. Seven trends were identified: Computer Applications for Performing Traditional Analyses, Computer-Aided Design, Integration of HFE Methods and Tools, Rapid Development Engineering, Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. We assessed each trend to determine its applicability to the NRC's review by considering (1) whether the nuclear industry is making use of M&Ts for each trend, and (2) whether M&Ts reflecting the trend can be reviewed using the current design review guidance. We concluded that M&T trends that are applicable to the commercial nuclear industry and are expected to impact safety reviews may be considered for review guidance development. Three trends fell into this category: Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. The other trends do not need to be addressed at this time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Frame of reference for electronic maps - The relevance of spatial cognition, mental rotation, and componential task analysis

Three experiments are reported that examine the difference between north-up and track-up maps for airborne navigation. The results of the first two experiments, conducted in a basic laboratory setting, identified the cost associated with mental rotation, when a north-up map is used. However, the data suggest that these costs are neither large nor consistent. The third experiment examined a range of tasks in a higher fidelity helicopter flight simulation, and associated the costs of north-up maps with a cognitive component related to orientation, and the costs of track-up maps with a cognitive component related to inconsistent landmark location. Different tasks are associated with different dependence on these components. The results are discussed in terms of their implications for map design, and for cognitive models of navigational processes.

Wickens, Christopher D.↗

Experimental Evaluation of Electric Power Grid Visualization Tools in the EIOC

The present study follows an initial human factors evaluation of four electric power grid visualization tools and reports on an empirical evaluation of two of the four tools: Graphical Contingency Analysis, and Phasor State Estimator. The evaluation was conducted within specific experimental studies designed to measure the impact on decision making performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Visualizing Cyber Security: Usable Workspaces

An environment that supports cyber analytics work should enable multiple, simultaneous investigations, information foraging, and provide a solution space for organizing data. We describe our study of cyber security professionals and visualizations in a large, high-resolution display work environment. We discuss the tasks and needs of analysts that such an environment can support and present several prototypes designed to support these needs. We conclude with a usability evaluation of the prototypes and additional lessons learned.

97 MATHEMATICS AND COMPUTING↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗

Brain wave correlates of attentional states: Event related potentials and quantitative EEG analysis during performance of cognitive and perceptual tasks

The increased use of automation in the cockpits of commercial planes has dramatically decreased the workload requirements of pilots, enabling them to function more efficiently and with a higher degree of safety. Unfortunately, advances in technology have led to an unexpected problem: the decreased demands on pilots have increased the probability of inducing 'hazardous states of awareness.' A hazardous state of awareness is defined as a decreased level of alertness or arousal which makes an individual less capable of reacting to unique or emergency types of situations. These states tend to be induced when an individual is not actively processing information. Under such conditions a person is likely to let his/her mind wander, either to internal states or to irrelevant external conditions. As a result, they are less capable of reacting quickly to emergency situations. Since emergencies are relatively rare, and since the high automated cockpit requires progressively decreasing levels of engagement, the probability of being seduced into a lowered state of awareness is increasing. This further decreases the readiness of the pilot to react to unique circumstances such as system failures. The HEM Lab at NASA-Langley Research Center has been studying how these states of awareness are induced and what the physiological correlates of these different states are. Specifically, they have been interested in studying electroencephalographic (EEG) measures of different states of alertness to determine if such states can be identified and, hopefully, avoided. The project worked on this summer involved analyzing the EEG and the event related potentials (ERP) data collected while subjects performed under two conditions. Each condition required subjects to perform a relatively boring vigilance task. The purpose of using these tasks was to induce a decreased state of awareness while still requiring the subject to process information. Each task involved identifying an infrequently presented target stimulus. In addition to the task requirements, irrelevant tones were presented in the background. Research has shown that even though these stimuli are not attended, ERP's to them can still be elicited. The amplitude of the ERP waves has been shown to change as a function of a person's level of alertness. ERP's were also collected and analyzed for the target stimuli for each task. Brain maps were produced based on the ERP voltages for the different stimuli. In addition to the ERP's, a quantitative EEG (QEEG) was performed on the data using a fast Fourier technique to produce a power spectral analysis of the EEG. This analysis was conducted on the continuous EEG while the subjects were performing the tasks. Finally, a QEEG was performed on periods during the task when subjects indicated that they were in an altered state of awareness. During the tasks, subjects were asked to indicate by pressing a button when they realized their level of task awareness had changed. EEG epochs were collected for times just before and just after subjects made this reponse. The purpose of this final analysis was to determine whether or not subjective indices of level of awareness could be correlated with different patterns of EEG.

Freeman, Frederick G.↗

Human-Autonomy Teaming Research in Support of m:N Operations

Since 2019, the NASA and industry partners have been involved in research focused on a novel paradigm for operations of remotely piloted aircraft. This paradigm involves multiple people sharing a fleet of multiple vehicles between them. Referred to as m:N (pronounced “em-to-en”), this configuration describes a ratio where m is the number of operators and N is the number of vehicles. Through force and asset multiplication, the m:N concept seeks to enable a scalable and resilient operation of remotely crewed vehicles. The primary means of obtaining such a robust operation is through allowing a flexible crew of variable size to dynamically attend to the needs of assets in while performing real-time operator workload management. It is in that sense that assets are shared between operators: as needed (such as in events of elevated workload) an operator in an m:N context can “handoff” the responsibility for some amount of assets, nh < N, to be absorbed by the m – 1 crew members on staff. At some time later, these nh assets could be returned to their original owner or they may be further distributed to other crew if called for by the mission. During this panel, I will elaborate on the research activity undertaken by the Human-Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center over the previous three years. The studies conducted by the HAT Lab range from interviews with subject matter experts, a cognitive walkthrough, a task analysis, and two simulation experiments to-date. During experimentation, pilots made use of an advanced Ground Control Station developed by the HAT Lab and industry partners to simulate m:N operations in two large, metropolitan areas of Southern California: Los Angeles and San Diego. Further experimentation planned over the next few years. Results from our research to-date indicates that pilots of a moderately sized fleet of about a dozen remotely crewed aircraft adequately maintained safety performance and situation awareness of their aircraft, even when presented with unexpected situations of heightened workload.

multi-vehicle control↗

User engineering: A new look at system engineering

User Engineering is a new System Engineering perspective responsible for defining and maintaining the user view of the system. Its elements are a process to guide the project and customer, a multidisciplinary team including hard and soft sciences, rapid prototyping tools to build user interfaces quickly and modify them frequently at low cost, and a prototyping center for involving users and designers in an iterative way. The main consideration is reducing the risk that the end user will not or cannot effectively use the system. The process begins with user analysis to produce cognitive and work style models, and task analysis to produce user work functions and scenarios. These become major drivers of the human computer interface design which is presented and reviewed as an interactive prototype by users. Feedback is rapid and productive, and user effectiveness can be measured and observed before the system is built and fielded. Requirements are derived via the prototype and baselined early to serve as an input to the architecture and software design.

Mclaughlin, Larry L.↗

Cognitive Engineering in Training: Monitoring and Pilot-Automation Coordination in Complex Environments

This paper reports our investigation of flight path monitoring in aviation. We interviewed experienced pilots to understand the knowledge and skills underlying effective monitoring and we developed an example learning environment to improve these skills. We explore how design of pilot training and learning, like the design of interfaces and of the underlying automation, benefits from cognitive engineering methods and perspective. In aviation, monitoring and managing flight path are critical activities. The influences on flight path are complex and come from the autoflight system, from control actions by the pilot, and from external factors, including weather and Air Traffic Control (ATC). Indeed, inadequate flight path monitoring is a current aviation concern as it has been implicated in accidents and incidents. Effective piloting depends on strategies for noticing, understanding, and anticipating these influences to monitor and manage flight path. Lack of such skills reduces pilots' ability to maintain safety margin and resilience. Although flightdeck automation is intended to aid pilot understanding and prediction, the Fight Management Systems (FMS) can mislead as well as aid the pilot's understanding and projection of what will happen. In dynamic conditions, FMS predictions may be based on old or incomplete information. Understanding such vulnerabilities is an important part of pilot-autoflight coordination. The learning environment we developed is designed to help pilots proactively monitor and manage flight path. We consider how a broad cognitive engineering approach might inform the "what" and "how" of learning in dynamic work domains.

pilot-monitoring↗

Mixed Initiative Visual Analytics Using Task-Driven Recommendations

Visual data analysis is composed of a collection of cognitive actions and tasks to decompose, internalize, and recombine data to produce knowledge and insight. Visual analytic tools provide interactive visual interfaces to data to support tasks involved in discovery and sensemaking, including forming hypotheses, asking questions, and evaluating and organizing evidence. Myriad analytic models can be incorporated into visual analytic systems, at the cost of increasing complexity in the analytic discourse between user and system. Techniques exist to increase the usability of interacting with such analytic models, such as inferring data models from user interactions to steer the underlying models of the system via semantic interaction, shielding users from having to do so explicitly. Such approaches are often also referred to as mixed-initiative systems. Researchers studying the sensemaking process have called for development of tools that facilitate analytic sensemaking through a combination of human and automated activities. However, design guidelines do not exist for mixed-initiative visual analytic systems to support iterative sensemaking. In this paper, we present a candidate set of design guidelines and introduce the Active Data Environment (ADE) prototype, a spatial workspace supporting the analytic process via task recommendations invoked by inferences on user interactions within the workspace. ADE recommends data and relationships based on a task model, enabling users to co-reason with the system about their data in a single, spatial workspace. This paper provides an illustrative use case, a technical description of ADE, and a discussion of the strengths and limitations of the approach.

active data↗

North American Board of Certified Energy Practitioners Final Report

The U.S. DOE’s Office of EERE National Solar Energy Technology Program (SETP) calls for a “National Accreditation and Certification Program for Installation and Acceptance of Photovoltaic Systems.” A near-term goal listed in the U.S. Photovoltaic Industry’s Roadmap, 2000 - 2020 is to work to establish standards, codes, and certifications which are essential for consumer protection and acceptance as part of the goal of building toward a viable future PV industry. This program paves the way for a voluntary national certification program for PV system practitioners and installers, initiation of the first steps toward certification of hardware, and reinforcement of all five of the technical objectives in the Systems category of SETPs Multi-Year technical Plan. Through this project, NABCEP will direct the continued initiation of and sustained implementation and administration of the NABCEP Solar PV Installer Certification Program (hereafter the “Program”). The NABCEP Program is a national, voluntary program designed to provide certification for those PV installers who demonstrate the requisite skills, abilities and knowledge typically required to install and maintain PV systems. The core document upon which the Program was developed and upon which the national exam is based, is referred to as the (Program) Task Analysis. It is a thorough descriptive document containing specific psychomotor and cognitive tasks for the purposes of identifying the types of training/assessment methods that apply. Psychomotor skills require measuring, assembling, fastening and related activities. Cognitive skills require knowledge processing, decision-making and computations. NABCEP effectively evaluates an applicant’s psychomotor skills through review of a candidate’s PV installations and hands-on training received. NABCEP evaluates the candidate’s cognitive skills through administration of its national Program exam. By first qualifying for and then obtaining the required passing score, NABCEP certificants receive an accreditation that upholds NABCEP’s standards of quality, compliance to applicable codes and safety in PV installation. The objectives of DOE’s National Solar Energy Technology Program (SETP) are intrinsic to NABCEP. As detailed in the PV Roadmap, the lifespan of a PV system is a function of reliability and value. PV system reliability is directly dependent upon the quality of components and, design, installation and maintenance of a system. The latter three are all core components of the NABCEP Task Analysis - accordingly NABCEP certified installers will be instrumental in improving reliability of systems through safe, code and manufacturer-compliant installation and necessary post-installation maintenance of PV systems. This will have the effect of ensuring and increasing the performance of installed systems and, as consumers realize the benefits of well-installed and maintained systems, increased demand will follow and manufacturers will respond - supporting further growth in the PV industry. Furthermore, as more NABCEP certified installers perform these installations and maintenance competently, additional installations (whole system re-installations) and unnecessary repairs can be avoided. This will drive down system costs. This combined with creation/enhancement of the DE-FG36-04GO14348/005 NABCEP Central Data Base of Installers – providing consumers with installation/maintenance service options will further reduce system costs and help meet the overall goal of reducing life cycle costs. As consumers receive more value from PV systems which are providing longer, trouble free, renewable energy, they will join the ranks of professionals and enthusiasts calling for reduced technological barriers to installation (particularly for grid-tied systems). States and utilities will react to pressure and begin easing onerous net-metering and other technological restrictions. The benefits of NABCEP’s Program will be evident to consumers, manufacturers, distributors, state energy officials and solar academic institutions. Consumers benefit through increased system performance and reduced costs. Manufacturers of PV and balance of system components as well as distributors support and benefit from NABCEP because of assurances that systems are installed in accordance to code (i.e., NEC) and their specifications, resulting in longer life. Collaborators including state energy officials (i.e., New York State Energy Research and Development Authority) benefit by knowing that rebate funds are spent on systems whose benefits will far exceed system costs. Program Objectives The improvements and advantages offered by a national voluntary certification program can only expand the horizons for photovoltaic applications.

14 SOLAR ENERGY↗

The design of electronic map displays

This paper presents a cognitive analysis of a pilot's navigation task and describes an experiment comparing a new map display that employs the principle of visual momentum with the two traditional approaches, track-up and north-up. The data show that the advantage of a track-up alignment is its congruence with the egocentered forward view; however, the inconsistency of the rotating display hinders development of a cognitive map. The stability of a north-up alignment aids the acquisition of a cognitive map, but there is a cost associated with the mental rotation of the display to a track-up alignment for tasks involving the ego-centered forward view. The data also show that the visual momentum design captures the benefits and reduces the costs associated with the two traditional approaches.

Aretz, Anthony J.↗

Cooperative Automation Supporting Pilot-Dispatch Negotiation of Enroute Trajectory Change Requests

The advent of advanced technologies in communication, navigation, and surveillance is enabling more integration between the aircraft and the ground systems in managing air traffic operations. As a result, automation has evolved to provide the flight crew, air traffic controllers, and traffic flow managers with capabilities for collaborating on information access, analysis, and decision making. In this paper, we investigate different cooperative schemes between these agents, supported by automation, in managing dynamic trajectory changes while the flight is en route to improve flight and system performance. The analysis was conducted using an abstract cognitive tasking framework to identify trajectory change tasks independently from the agent performing them. Cooperation schemes were then derived by assessing different levels of cooperation on each task between the air and ground agents and their automation. The assessment was based on which automation-supported agent is more capable of performing the task and the expected benefit mechanisms that result from cooperating. The cooperation schemes were compared based on a qualitative, but objective, assessment of the benefits expected from cooperation.

air-ground integration↗