Search NASA⌕ Search

SEARCH · Search NASA

Results for “cognitive training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

SCREAM: Space-based Cognitive Reliability Error Analysis Method

Given both ground-based performance shaping factors (PSFs) collected by the U.S. Nuclear Regulatory Commission (USNRC) and potential space-based PSFs collected by JSC's HH&P, this year's task is to determine how to combine them for future human reliability analysis (HRA) of space missions. All HRA to date for space missions have been based on ground data (i.e. 1-G environment). There is no space-based HRA approach. The target of this project to produce a "first of its kind" HRA approach for space missions. As humans go beyond Earth orbit and missions become longer, human performance and reliability is expected to degrade. The questions become by how much, when, and what, leading to defining the overall effect on crew risk. Knowing this information earlier rather than later will help us mitigate this risk by vehicle design, crew training, and operational workarounds.

Boyer, Roger L.↗

A Possible Approach for Addressing Neglected Human Factors Issues of Systems Engineering

The increasing complexity of safety-critical applications has led to the introduction of decision support tools in the transportation and process industries. Automation has also been introduced to support operator intervention in safety-critical applications. These innovations help reduce overall operator workload, and filter application data to maximize the finite cognitive and perceptual resources of system operators. However, these benefits do not come without a cost. Increased computational support for the end-users of safety-critical applications leads to increased reliance on engineers to monitor and maintain automated systems and decision support tools. This paper argues that by focussing on the end-users of complex applications, previous research has tended to neglect the demands that are being placed on systems engineers. The argument is illustrated through discussing three recent accidents. The paper concludes by presenting a possible strategy for building and using highly automated systems based on increased attention by management and regulators, improvements in competency and training for technical staff, sustained support for engineering team resource management, and the development of incident reporting systems for infrastructure failures. This paper represents preliminary work, about which we seek comments and suggestions.

Johnson, Christopher W.↗

Interface Consistency: Phase I Results & Phase II Status

Future exploration missions will rely on designing and developing vehicles and complex systems from within NASA and through multiple external commercial partners to meet mission goals. Despite existing consistency-related agency requirements, NASA’s approach to commercial spaceflight development encourages providers’ flexibility and innovation. This strategy is resulting in significant design diversity across Artemis vehicles. Design best practices and guidelines champion interface consistency to promote mental model development and knowledge transfer. However, research investigating the benefits of consistency is mixed, and little is known about its role in complex systems. Determining the level of risk that system diversity presents is difficult, as there is no established method for quantifying the degree of consistency within and across interfaces, nor is there information about the differential impacts of different types of inconsistency. Phase I of this project (Characterization and Measurement) served as a starting point to better understand the construct of consistency, its application, and the range of studies and methods for measuring it. The project team created a taxonomy of consistency to apply to interfaces as a framework to guide the development of tools to assess intersystem consistency. Checklist and cognitive walkthrough methods were developed for use by human factors (HF) and human-computer interaction (HCI) experts. The Intersystem Consistency Scale (ICS) was developed for interface evaluations with crew. A pilot study evaluated the methods’ ability to distinguish differences between Artemis-like prototype pairs exhibiting either high or low design consistency. In addition, click errors and time on task were collected within the ICS (crew-like) group. Results from our exploratory analysis and lessons learned from the pilot study will be discussed. The project team will also present the status of Phase II (Risk Assessment, Standards and Guidelines). This includes incorporating feedback to redesign the assessment tools, and inputs from displays and training Subject Matter Experts to update tasks and prototype designs. The team will present the risk assessment study design to identify the types and levels of inconsistency that pose the greatest risk to performance. Plans to apply these results toward agency standards and guideline recommendations will also be discussed.

Human-Computer Interaction↗

Operator modeling in commerical aviation: Cognitive models, intelligent displays, and pilot's assistants

One of the goals of the National Aviation Safety/Automation program is to address the issue of human-centered automation in the cockpit. Human-centered automation is automation that, in the cockpit, enhances or assists the crew rather than replacing them. The Georgia Tech research program focused on this general theme, with emphasis on designing a computer-based pilot's assistant, intelligent (i.e, context-sensitive) displays, and an intelligent tutoring system for understanding and operating the autoflight system. In particular, the aids and displays were designed to enhance the crew's situational awareness of the current state of the automated flight systems and to assist the crew's situational awareness of the current state of the automated flight systems and to assist the crew in coordinating the autoflight system resources. The activities of this grant included: (1) an OFMspert to understand pilot navigation activities in a 727 class aircraft; (2) an extension of OFMspert to understand mode control in a glass cockpit, Georgia Tech Crew Activity Tracking System (GT-CATS); (3) the design of a training system to teach pilots about the vertical navigation portion of the flight management system -VNAV Tutor; and (4) a proof-of-concept display, using existing display technology, to facilitate mode awareness, particularly in situations in which controlled flight into terrain (CFIT) is a potential.

Govindaraj, T.↗

Assessing and Promoting Functional Resilience in Flight Crews During Exploration Missions

NASA plans to send humans to Mars in about 20 years. The NASA Human Research Program supports research to mitigate the major risks to human health and performance on extended missions. However, there will undoubtedly be unforeseen events on any mission of this nature - thus mitigation of known risks alone is not sufficient to ensure optimal crew health and performance. Research should be directed not only to mitigating known risks, but also to providing crews with the tools to assess and enhance resilience, as a group and individually. We can draw on ideas from complexity theory and network theory to assess crew and individual resilience. The entire crew or the individual crewmember can be viewed as a complex system that is composed of subsystems (individual crewmembers or physiological subsystems), and the interactions between subsystems are of crucial importance for overall health and performance. An understanding of the structure of the interactions can provide important information even in the absence of complete information on the component subsystems. This is critical in human spaceflight, since insufficient flight opportunities exist to elucidate the details of each subsystem. Enabled by recent advances in noninvasive measurement of physiological and behavioral parameters, subsystem monitoring can be implemented within a mission and also during preflight training to establish baseline values and ranges. Coupled with appropriate mathematical modeling, this can provide real-time assessment of health and function, and detect early indications of imminent breakdown. Since the interconnected web of physiological systems (and crewmembers) can be interpreted as a network in mathematical terms, we can draw on recent work that relates the structure of such networks to their resilience (ability to self-organize in the face of perturbation). There are many parameters and interactions to choose from. Normal variability is an established characteristic of a healthy physiological response. Healthy coupling has been investigated less extensively, but there are cases in which too tight or too loose coupling can be problematic. This might be in inter-individual behaviors, such as sleep cycles, coordination of work and meal times, and coupled motions during communication. Less apparent are couplings of physiological systems, nevertheless examples abound of coupled systems which might be monitored: cardio-respiratory rhythms; circadian rhythms, body temperature, and sleep; stress markers and cognition, sleep, and performance; profiles of biochemical markers related to immune function and nutritional status; sensorimotor aspects such as motion sickness, ataxia, reaction time, and manual control. Tools for resilience are then the means to measure and analyze these parameters, incorporate them into appropriate models of normal variability and interconnectedness, and recognize when parameters or their couplings are outside of normal limits. What to do when a problem is identified depends on its nature. Changes can be made to crew procedures, work pacing, interpersonal interactions, sleep cycles, meal timing and content, as guided by the model. Use and continued development of these methods could not only provide tools for resilience, but also meaningful autonomous work for the crew on an extended flight.

Shelhamer, Mark↗

Parametric motion control of robotic arms: A biologically based approach using neural networks

A neural network based system is presented which is able to generate point-to-point movements of robotic manipulators. The foundation of this approach is the use of prototypical control torque signals which are defined by a set of parameters. The parameter set is used for scaling and shaping of these prototypical torque signals to effect a desired outcome of the system. This approach is based on neurophysiological findings that the central nervous system stores generalized cognitive representations of movements called synergies, schemas, or motor programs. It has been proposed that these motor programs may be stored as torque-time functions in central pattern generators which can be scaled with appropriate time and magnitude parameters. The central pattern generators use these parameters to generate stereotypical torque-time profiles, which are then sent to the joint actuators. Hence, only a small number of parameters need to be determined for each point-to-point movement instead of the entire torque-time trajectory. This same principle is implemented for controlling the joint torques of robotic manipulators where a neural network is used to identify the relationship between the task requirements and the torque parameters. Movements are specified by the initial robot position in joint coordinates and the desired final end-effector position in Cartesian coordinates. This information is provided to the neural network which calculates six torque parameters for a two-link system. The prototypical torque profiles (one per joint) are then scaled by those parameters. After appropriate training of the network, our parametric control design allowed the reproduction of a trained set of movements with relatively high accuracy, and the production of previously untrained movements with comparable accuracy. We conclude that our approach was successful in discriminating between trained movements and in generalizing to untrained movements.

Bock, O.↗

Adaptive Distributed Environment for Procedure Training (ADEPT)

ADEPT (Adaptive Distributed Environment for Procedure Training) is designed to provide more effective, flexible, and portable training for NASA systems controllers. When creating a training scenario, an exercise author can specify a representative rationale structure using the graphical user interface, annotating the results with instructional texts where needed. The author's structure may distinguish between essential and optional parts of the rationale, and may also include "red herrings" - hypotheses that are essential to consider, until evidence and reasoning allow them to be ruled out. The system is built from pre-existing components, including Stottler Henke's SimVentive instructional simulation authoring tool and runtime. To that, a capability was added to author and exploit explicit control decision rationale representations. ADEPT uses SimVentive's Scalable Vector Graphics (SVG)- based interactive graphic display capability as the basis of the tool for quickly noting aspects of decision rationale in graph form. The ADEPT prototype is built in Java, and will run on any computer using Windows, MacOS, or Linux. No special peripheral equipment is required. The software enables a style of student/ tutor interaction focused on the reasoning behind systems control behavior that better mimics proven Socratic human tutoring behaviors for highly cognitive skills. It supports fast, easy, and convenient authoring of such tutoring behaviors, allowing specification of detailed scenario-specific, but content-sensitive, high-quality tutor hints and feedback. The system places relatively light data-entry demands on the student to enable its rationale-centered discussions, and provides a support mechanism for fostering coherence in the student/ tutor dialog by including focusing, sequencing, and utterance tuning mechanisms intended to better fit tutor hints and feedback into the ongoing context.

Domeshek, Eric↗

Helmet-mounted pilot night vision systems: Human factors issues

Helmet-mounted displays of infrared imagery (forward-looking infrared (FLIR)) allow helicopter pilots to perform low level missions at night and in low visibility. However, pilots experience high visual and cognitive workload during these missions, and their performance capabilities may be reduced. Human factors problems inherent in existing systems stem from three primary sources: the nature of thermal imagery; the characteristics of specific FLIR systems; and the difficulty of using FLIR system for flying and/or visually acquiring and tracking objects in the environment. The pilot night vision system (PNVS) in the Apache AH-64 provides a monochrome, 30 by 40 deg helmet-mounted display of infrared imagery. Thermal imagery is inferior to television imagery in both resolution and contrast ratio. Gray shades represent temperatures differences rather than brightness variability, and images undergo significant changes over time. The limited field of view, displacement of the sensor from the pilot's eye position, and monocular presentation of a bright FLIR image (while the other eye remains dark-adapted) are all potential sources of disorientation, limitations in depth and distance estimation, sensations of apparent motion, and difficulties in target and obstacle detection. Insufficient information about human perceptual and performance limitations restrains the ability of human factors specialists to provide significantly improved specifications, training programs, or alternative designs. Additional research is required to determine the most critical problem areas and to propose solutions that consider the human as well as the development of technology.

Hart, Sandra G.↗

NASA Pilot-Engaged Expert Response Using IBM Watson Technology: Prototype Evaluation of Knowledge Retrieval System

NASA Langley Research Center and IBM have been investigating the use of IBM Watson technology in aerospace research and development. One application of Watson technology is the Pilot-Engaged Expert Response (PEER) use case. The PEER system is envisioned as an in-cockpit advisor that will act as a source of situationally-relevant information for pilots and other flight crew members to assist in decision making about real-time events and situations that arise in the course of aircraft operations. PEER will make available vast stores of knowledge and information quickly and directly, putting important informational resources where they are needed most. IBM has worked with NASA to develop an architecture and articulate a roadmap for the development of the PEER system. That vision is built around Watson Discovery Advisor (WDA) software solution, derived from IBM's Jeopardy!-winning automatic question answering system. PEER makes use of WDA's sophisticated question-answering capabilities as its core, adding important User Interface components and other customizations for the cockpit environment, including communication with flight systems and other external data sources. The development plan for PEER includes four development stages, with the current project constituting the first phase. In this project, a prototype instance of PEER was successfully adapted to the aviation domain, enabling users to ask questions about aviation topics and receive useful and accurate answers to these questions. Major tasks accomplished include the development of procedures for domain adaptation through automatic lexicon extraction from domain glossaries; generation of question-answer training data which was used to train the system; and assessment of the effectiveness of domain adaptation, which showed a dramatic improvement in the ability of the PEER system to answer domain-relevant questions. In addition, the vision for the PEER system was pushed forward by the articulation of a plan for the automatic enhancement of question-answering with contextual information. This initial phase focused on two main goals: 1) the targeted domain adaptation of the underlying WDA system to the aviation domain; and, 2) the design of the software systems needed to leverage flight-contextual data. Domain adaptation of the WDA system proceeds via three main activities: Domain data ingestion, lexical customization and model training. A textual corpus consisting of 1,147 individual documents with more than 7.5 million words of text was ingested into the system and this served as the basis of all further development. A domain lexicon of over 3,500 aviation-domain terms was semi-automatically generated from domain documents and used to train the system. In addition, a set of over 500 question-answer (QA) pairs relevant to the PEER use case was developed; these were used to train and assess the system. These important first steps established the basis for the PEER system. In addition, steps were taken towards the integration of the PEER system into the cockpit environment with the development of a functional design for the Contextual Data Augmentation (CDA) subsystem. This subsystem brings to bear contextual data to improve system responses. It has three main submodules: the Contextual Data Collection module, the Contextual Data Selection module, and the Contextual QA Augmentation module. These modules form a processing pipeline that addresses the problems associated with automatically integrating information from external resources into the knowledge-retrieval mechanism.

Machine learning↗

Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, and Psychosocial Adaptions within a Team

The Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, Communication, and Psychosocial Adaptation within a Team (the Team Risk) is primarily performance-focused, with a secondary emphasis on behavioral health outcomes resulting from team performance and interpersonal interactions. Monitoring tools, measures, and countermeasures are aimed at enhancing team processes and team composition configurations to optimize team performance and functioning. Long-duration exploration missions (LDEMs) will include major challenges that could affect team performance, including social isolation, physical confinement, a small and diverse crew, communication delays between crew and ground, limited or no crew rotation or evacuation options, limited or no resupply, and a high-consequence environment. Each of these conditions will affect the crew’s coordination, cooperation, psychological well-being, and performance. Although the International Space Station (ISS) remains important for studies that require spaceflight testing and validation, the current conditions on the ISS do not adequately mimic the exploration environment that is required for National Aeronautics and Space Administration (NASA) teams research, and thus access to terrestrial or ground-based analogs of LDEM conditions is paramount. The emphasis on analogs for research is reflected in this updated evidence review of the Team Risk, and includes data from studies conducted at isolated, confined, extreme (ICE) environments (e.g., Antarctic stations), and from several mission simulation analogs such as the Human Exploration Research Analog (HERA) (HERA Experiment Information Package, 2014), also known as isolated, confined, controlled (ICC) environments. These studies have characterized many team factors regarding LDEMs, and the Team Risk has now matured from risk characterization to focusing more on countermeasure development. Because spaceflight evidence for team-level research is lacking, no reliable data is available to quantify the impact of team-level variables on individual and team-level outcomes during spaceflight missions. Until recently, no systematic attempt had been undertaken to measure the performance effects of team cohesion, team composition, team training, or team-related psychosocial adaptation during spaceflight. The Team Risk is a relatively young research area for NASA, with substantial growth only since the 2000s, and with limited access to spaceflight performance data. As a result, spaceflight evidence is lacking to identify specifically what team composition, level of training, amount of cohesion, or quality of psychosocial adaptation is necessary to reduce the risk of performance errors in space. However, astronaut journals and interviews and reports from spaceflight subject matter experts (SMEs) provide testimonies that team performance during spaceflight is important for mission success and to maintain crew health. Team spaceflight data is now being collected as part of the Spaceflight Standard Measures task (Clement, 2021)—a set of core measurements related to many human spaceflight risks that are collected from astronauts before, during, and after long-duration missions. The team-related standard measures focus on team cohesion, team performance, group living, team climate, and team processes. Collection of standard measures data is ongoing and published data is not yet available. Finally, although spaceflight evidence is lacking, evidence gleaned from ground studies and spaceflight analog studies will help close the gaps outlined in the Team Risk. Ground-based studies provide quantitative evidence for team functioning in ICE environments. Academic research on teams has produced dozens of meta-analyses that can be used to understand the general relationships among team inputs (e.g., team member characteristics and skills, job context), team processes, and emergent states (e.g., coordination, communication, cooperation, cohesion, trust, shared cognition), and team outcomes (e.g., effectiveness, errors, adaptation). Teams are complex, incorporating individual characteristics of team members, but also existing at a level that is greater than the sum of its parts. Therefore, the Team Risk must be integrated with other individual-focused NASA Human Research Program (HRP) risks, including Behavioral Medicine (BMed), Sleep, and Human-Systems Integration Architecture (HSIA), and emerging research indicates more integration may needed between the Team Risk and the physiologically oriented risks. Much of this integration occurs through the Human Systems Risk Board (HSRB). A lack of team functioning may be a stressor in some circumstances, but the team often acts as a countermeasure. For example, support for team leaders and teammates can facilitate individual functioning and encourage psychological and physically healthy behaviors and attitudes. However, more research is needed regarding teams during LDEMs and the remaining gaps in the research are described in the current report.

Lauren Blackwell Landon↗

Integrating human factors knowledge into certification: The point of view of the Internatioanal Civil Aviation Organization (ICAO)

It is appropriate here to repeat the analogy described in the introduction to this paper which is that: The consideration of human factors requirements during the design stage of advanced, new technology systems may be seen as resting over a three-legged stool. The first leg, the equipment that a system will utilize to achieve its goals, has traditionally attracted ergonomic considerations associated with equipment design, usually centered around 'knobs and dials.' Lately, this view has expanded to include the so-called other important aspect of Human Factor's study which deals with the cognitive, behaviorial and social processes of the human operators. Study in this area must be furthered. The second leg of the stool, the procedures to operate the equipment, however, has been largely unaddressed. Procedures are not inherent to equipment, but must be developed. The importance of proper human factors consideration in the design of procedures can not be overstated. Lastly, the third leg of the stool, the certification of personnel who will operate the equipment, is very much underway, but far from being complete. The real quest now, however, is to integrate these three legs into an indivisible one. Finally, and most importantly, this workshop and its topic are extremely timely in that we are at the dawn of the most ambitious development ever undertaken in international civil aviation. This would allow us the rather unique opportunity to put theory into practice in the near future by ensuring that the concepts developed and furthered by this workshop and the follow-up are implemented in the design and certification of the ICAO future CNS/ATM systems described earlier in this paper. Now is the time to incorporate human factors requirements during the certification processes of these systems. This might act as a test to the feasibility of these ideas. Such endeavors represent a challenge for the research, engineering, training, operational and regulatory communities. But there is certainly more to be gained by attempting to meet the challenge rather than refraining from progress by decrying the difficulties involved.

Maurino, Daniel↗

GeoAI Advances in Specific Landform Mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation.

machine learning↗

Critical Questions for Space Human Factors

Traditional human factors contributions to NASA's crewed space programs have been rooted in the classic approaches to quantifying human physical and cognitive capabilities and limitations in the environment of interest, and producing recommendations and standards for the selection or design of mission equipment. Crews then evaluate the interfaces, displays, or equipment, and with the assistance of human factors experts, improvements are made as funds, time, control documentation, and weight allow. We have come a long way from the early spaceflight days, where men with the ' right stuff were the solution to operating whatever equipment was given to them. The large and diverse Shuttle astronaut corps has impacted mission designs to accommodate a wide range of human capabilities and preferences. Yet with existing long duration experience, we have seen the need to address a different set of dynamics when designing for optimal crew performance: critical equipment and mission situations degrade, and human function changes with mission environment, situation, and duration. Strategies for quantifying the critical nature of human factors requirements are being worked by NASA. Any exploration-class mission will place new responsibilities on mission designers to provide the crew with the information and resources to accomplish the mission. The current duties of a Mission Control Center to monitor system status, detect degradation or malfunction, and provide a proven solution, will need to be incorporated into on-board systems to allow the crew autonomous decision-making. The current option to resupply and replace mission systems and resources, including both vehicle equipment and human operators, will be removed, so considerations of maintenance, onboard training, and proficiency assessment are critical to providing a self-sufficient crew. As we 'move in' to the International Space Station, there are tremendous opportunities to investigate our ability to design for autonomous crews. Yet prioritizing the research that can and should be done by NASA will be based on the critical nature of the issues, and the impact of the individual research questions on mission design. The risks to crew health and safety associated with answering critical human factors issues must be properly included and communicated in order to support the Agency's decisions regarding future space programs.

Woolford, Barbara↗

CATS-based Air Traffic Controller Agents

This report describes intelligent agents that function as air traffic controllers. Each agent controls traffic in a single sector in real time; agents controlling traffic in adjoining sectors can coordinate to manage an arrival flow across a given meter fix. The purpose of this research is threefold. First, it seeks to study the design of agents for controlling complex systems. In particular, it investigates agent planning and reactive control functionality in a dynamic environment in which a variety perceptual and decision making skills play a central role. It examines how heuristic rules can be applied to model planning and decision making skills, rather than attempting to apply optimization methods. Thus, the research attempts to develop intelligent agents that provide an approximation of human air traffic controller behavior that, while not based on an explicit cognitive model, does produce task performance consistent with the way human air traffic controllers operate. Second, this research sought to extend previous research on using the Crew Activity Tracking System (CATS) as the basis for intelligent agents. The agents use a high-level model of air traffic controller activities to structure the control task. To execute an activity in the CATS model, according to the current task context, the agents reference a 'skill library' and 'control rules' that in turn execute the pattern recognition, planning, and decision-making required to perform the activity. Applying the skills enables the agents to modify their representation of the current control situation (i.e., the 'flick' or 'picture'). The updated representation supports the next activity in a cycle of action that, taken as a whole, simulates air traffic controller behavior. A third, practical motivation for this research is to use intelligent agents to support evaluation of new air traffic control (ATC) methods to support new Air Traffic Management (ATM) concepts. Current approaches that use large, human-in-the-loop simulations are unquestionably valuable for this purpose, but pose considerable logistical, fiscal, and experimental control problems. First, data analysis is extremely complicated, owing simply to the large number of participants and data sources in such simulations. In addition, experienced human air traffic controllers working adjacent sectors tend to flexibly adapt to the evolving control problem - potentially shifting to other strategies than those under investigation. In addition, their performance is tightly coupled to the control interface, which in the development phase may support some concepts and supporting strategies better than others. A simple shift in strategy by one controller can change the character of a particular traffic scenario dramatically, which makes experimental comparison of ATC performance under different traffic scenarios difficult. Training a given team of controllers on operations under a new ATM concept for a sufficient period of time could avert such difficulties, but instituting an adequate training program is expensive and logistically difficult.

Callantine, Todd J.↗

Usability Evaluation Technical Report: A Usability Evaluation of the Communication Tool Prototype Prepared in Adobe XD for High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors↗

Examining Performance and Usability of Situation Awareness Communication Tool for NASA's High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors↗

A multimedia adult literacy program: Combining NASA technology, instructional design theory, and authentic literacy concepts

For a number of years, the Software Technology Branch of the Information Systems Directorate has been involved in the application of cutting edge hardware and software technologies to instructional tasks related to NASA projects. The branch has developed intelligent computer aided training shells, instructional applications of virtual reality and multimedia, and computer-based instructional packages that use fuzzy logic for both instructional and diagnostic decision making. One outcome of the work on space-related technology-supported instruction has been the creation of a significant pool of human talent in the branch with current expertise on the cutting edges of instructional technologies. When the human talent is combined with advanced technologies for graphics, sound, video, CD-ROM, and high speed computing, the result is a powerful research and development group that both contributes to the applied foundations of instructional technology and creates effective instructional packages that take advantage of a range of advanced technologies. Several branch projects are currently underway that combine NASA-developed expertise to significant instructional problems in public education. The branch, for example, has developed intelligent computer aided software to help high school students learn physics and staff are currently working on a project to produce educational software for young children with language deficits. This report deals with another project, the adult literacy tutor. Unfortunately, while there are a number of computer-based instructional packages available for adult literacy instruction, most of them are based on the same instructional models that failed these students when they were in school. The teacher-centered, discrete skill and drill-oriented, instructional strategies, even when they are supported by color computer graphics and animation, that form the foundation for most of the computer-based literacy packages currently on the market may not be the most effective or most desirable way to use computer technology in literacy programs. This project is developing a series of instructional packages that are based on a different instructional model - authentic instruction. The instructional development model used to create these packages is also different. Instead of using the traditional five stage linear, sequential model based on behavioral learning theory, the project uses the recursive, reflective design and development model (R2D2) that is based on cognitive learning theory, particularly the social constructivism of Vygotsky, and an epistemology based on critical theory. Using alternative instructional and instructional development theories, the result of the summer faculty fellowship is LiteraCity, a multimedia adult literacy instructional package that is a simulation of finding and applying for a job. The program, which is about 120 megabytes, is distributed on CD-ROM.

Willis, Jerry W.↗

Neuro-Vestibular Examination During and Following Spaceflight (Vestibular Health)

BACKGROUND Adaptation to microgravity during spaceflight causes neurological disturbances that are either directly or indirectly mediated by the vestibular system. These disturbances can include space motion sickness, spatial disorientation, and cognitive impairment, as well as changes in head-eye coordination, vestibulo-ocular reflexes, and control of posture and locomotion. Otolith-mediated reflex gains appear to adapt rapidly during spaceflight and after landing. However, animal studies have shown that structural modifications of the vestibular sensory apparatus develop during long-duration spaceflight. To date, no studies have characterized the severity of vestibular syndromes experienced by astronauts as a function of the duration of spaceflight or whether the effects are caused by changes at the peripheral end organs, midbrain, cerebellum, or vestibular cortex. OBJECTIVES We will investigate temporal vestibular changes in crewmembers of short, 6-month, and one-year missions to identify trends in adaptation of vestibular health and performance in orbit and after landing. We will also determine whether the vestibular organs and/or the central vestibular system undergo structural changes during long-duration exposure to microgravity, which could cause vestibular disorders when transitioning to a different gravitational environment. METHODS Recordings of eye, head, and body movements, as well as subjective reports of perception of motion, will be used to determine the presence of abnormal eye movements, dysmetria, motion sickness symptoms, and illusions of motion during head or body movements. This includes characterization of temporal trends in central compensation for vestibular (otolith) asymmetry. Pre-flight data will be collected 90 days before launch. In-flight examinations will be performed early in the mission (Flight Days 1 and 30) and once every two or three months thereafter. Post-flight examinations will be performed on the following days after return (R) from the mission: R+0, R+4, R+9, and R+30. Ground-based control tests have been performed on healthy volunteers in the laboratory to estimate mean normative responses. RESULTS Data collection for this study is ongoing. Data processing techniques are being refined. Our eye tracking method for measuring three-dimensional eye movement takes advantage of modern computer vision software (OpenCV) and advances in the field of iris recognition to improve measurement of ocular-counterolling. RELEVANCE If the observed symptoms in crewmembers are more deleterious after the year-long missions than those documented after 6-month missions, then relevant countermeasures will be required to maintain the health and operational performance of astronauts during longer missions. Depending on the etiology of the vestibular syndrome revealed by these tests, countermeasures will be proposed based on vestibular rehabilitation therapies currently used in patients with vestibular disorders, such as habituation, gaze stabilization, and/or balance training exercises.

T R Macaulay↗