Search NASA⌕ Search

SEARCH · Search NASA

Results for “crew state monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Frequency Domain Functional Near-Infrared Spectrometer (fNIRS) for Crew State Monitoring

A frequency domain functional near-infrared spectrometer (fNIRS) and accompanying software have been developed by the NASA Glenn Research Center as part of the Airspace Operations and Safety Program (AOSP) Technologies for Airplane State Awareness (TASA)—SE211 Crew State Monitoring (CSM) Project. The goal of CSM was to develop a suite of instruments to measure the cognitive state of operators while performing operational activities. The fNIRS was one of the instruments intended for the CSM, developed to measure changes in oxygen levels in the brain noninvasively.

Jeffrey R Mackey↗

Crew State Monitoring and Line-Oriented Flight Training for Attention Management

Loss of control - inflight (LOC-I) has historically represented the largest category of commercial aviation fatal accidents. A review of worldwide transport airplane accidents (2001-2010) indicated that loss of airplane state awareness (ASA) was responsible for the majority of the LOC-I fatality rate. The Commercial Aviation Safety Team (CAST) ASA study identified 12 major themes that were indicated across the ASA accident and incident events. One of the themes was crew distraction or ineffective attention management, which was found to be involved in all 18 events including flight crew channelized attention, startle/surprise, diverted attention, and/or confirmation bias. Safety Enhancement (SE)-211, "Training for Attention Management" was formed to conduct research to develop and assess commercial airline training methods and realistic scenarios that can address these attention-related human performance limitations. This paper describes NASA SE-211 research for new design approaches and validation of line-oriented flight training (LOFT). Recent accident and incident data suggests that Spatial Disorientation (SD) and Loss-of-Energy State Awareness (LESA) for transport category aircraft are becoming an increasingly prevalent safety concern in all domestic and international operations (Commercial Aviation Safety Team, 2014a). SD is defined as an erroneous perception of aircraft attitude that can lead directly to a Loss-of-Control Inflight (LOC-I) event and result in an accident or incident. LESA is typically characterized by a failure to monitor or understand energy state indications (e.g., airspeed, altitude, vertical speed, commanded thrust) and a resultant failure to maintain safe flight.

Stephens, Chad↗

Flight Simulation Scenarios for Commercial Pilot Training and Crew State Monitoring

NASA Langley researchers addressed the Commercial Aviation Safety Team Safety Enhancement 211 through a series of studies to address "Attention-related Human Performance Limiting States" which include channelized attention, diverted attention, startle/surprise, and confirmation bias. The present report focuses on the development of improved training scenarios for operationally realistic Line-Oriented Flight Training scenarios. Areas addressed in the report include: (1) Highlights of events in the LOFT scenario used; (2) Interesting findings with implications for simulator motion; (3) Eye-tracking heat maps in proximity to failure events; (4) Researcher observations of crews as test subjects versus a pilot and a research team co-pilot; and (5) The results of a follow-up questionnaire completed by pilot participants regarding their usual training as well as the scenarios employed in the SHARP studies. These pilot ratings and comments are of value to simulation training developers.

James R. Comstock, Jr.↗

Predicting Cognitive States Using Machine Learning Fusion Paradigms to Reduce Model Uncertainty

The development of a synergetic system between humans and technology is a challenge that the scientific community has been facing for many years. Our aeronautic research aims to enhance this synergy between humans and machines through predictive human performance modeling for systems to mitigate high-risk situations. By being able to predict and anticipate human states, the crew monitoring system should be able to adjust and support the pilot for aviation safety. Our work focusing on attention-related human performance-limiting states (AHPLS) that impact a pilot’s performance and introduce high-risk catastrophic situations [1]. For example, AHPLS has been cited as a causal factor in more than 50% of all loss control in flight and thus contributes significantly toward commercial aviation fatalities [1, 2]. Cognitive state and its physiological fingerprint can be valuable information for this detecting AHPLS, but human cognitive state detection is still a major limitation for these crew monitoring systems.

machine learning↗

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗

Data Processing And Machine Learning Methods For Multi-Modal Operator State Classification Systems

This document is intended as an introduction to a set of common signal processing learning methods that may be used in the software portion of a functional crew state monitoring system. This includes overviews of both the theory of the methods involved, as well as examples of implementation. Practical considerations are discussed for implementing modular, flexible, and scalable processing and classification software for a multi-modal, multi-channel monitoring system. Example source code is also given for all of the discussed processing and classification methods.

Machine learning↗

Psychophysiological Methods to Assess Pilot Productive Safety Behaviors

The NASA System-Wide Safety (SWS) Project is focused on developing new technologies and operational concepts for the aviation industry to meet the increasing global demand while maintaining the current ultra-safe system safety levels. To achieve this, the SWS Project is developing research priorities, including In-time System-wide Safety Assurance (ISSA) and In-time Aviation Safety Management System (IASMS; Ellis et al., 2019). A critical component of the IASMS is the human as pilot and in other roles in aviation operations as demonstrated by SWS human factors research on rare occurrences of human error and the far more prevalent human safety producing behaviors (e.g., Hollnagel, 2016). The talk presented by Chad Stephens of NASA Langley Research Center and NASA SWS Project will describe the history of human factors research involving psychophysiological and biocybernetics methods supporting aviation safety conducted at NASA. Specific examples of recent NASA crew state monitoring research focused on a psychophysiological assessment method and system to enable Training for Attention Management will be demonstrated. Current SWS research including the SWS Operations and Technologies for Enabling Resilient In-Time Assurance (SOTERIA) flight simulation study and a data testbed created to enable study of Human Contributions to Safety (HC2S) will be presented. Ongoing collaborative research efforts with Boeing researchers will be highlighted and opportunities for further collaboration will be discussed.

psychophysiology↗

Psychophysiological Monitoring of Aerospace Crew State

As next-generation space exploration missions necessitate increasingly autonomous systems, there is a critical need to better detect and anticipate crewmember interactions with these systems. The success of present and future autonomous technology in exploration spaceflight is ultimately dependent upon safe and efficient interaction with the human operator. Optimal interaction is particularly important for surface missions during highly coordinated extravehicular activity (EVA), which consists of high physical and cognitive demands with limited ground support. Crew functional state may be affected by a number of variables including workload, stress, and motivation. Real-time assessments of crew state that do not require a crewmember’s time and attention to complete will be especially important to assess operational performance and behavioral health during flight. In response to the need for objective, passive assessment of crew state, the aim of this work is to develop an accurate and precise prediction model of human functional state for surface EVA using multi-modal psychophysiological sensing. The psychophysiological monitoring approach relies on extracting a set of features from physiological signals and using these features to classify an operator’s cognitive state. This work aims to compile a non-invasive sensor suite to collect physiological data in real-time. Training data during cognitive and more complex functional tasks will be used to develop a classifier to discriminate high and low cognitive workload crew states. The classifier will then be tested in an operationally relevant EVA simulation to predict cognitive workload over time. Once a crew state is determined, further research into specific countermeasures, such as decision support systems, would be necessary to optimize the automation and improve crew state and operational performance.

Wusk, Grace C.↗

Advanced Environmental Monitoring and Control Program: Technology Development Requirements

Human missions in space, from the International Space Station on towards potential human exploration of the moon, Mars and beyond into the solar system, will require advanced systems to maintain an environment that supports human life. These systems will have to recycle air and water for many months or years at a time, and avoid harmful chemical or microbial contamination. NASA's Advanced Environmental Monitoring and Control program has the mission of providing future spacecraft with advanced, integrated networks of microminiaturized sensors to accurately determine and control the physical, chemical and biological environment of the crew living areas. This document sets out the current state of knowledge for requirements for monitoring the crew environment, based on (1) crew health, and (2) life support monitoring systems. Both areas are updated continuously through research and space mission experience. The technologies developed must meet the needs of future life support systems and of crew health monitoring. These technologies must be inexpensive and lightweight, and use few resources. Using these requirements to continue to push the state of the art in miniaturized sensor and control systems will produce revolutionary technologies to enable detailed knowledge of the crew environment.

Jan, Darrell↗

Effects of Varying Gravity Levels on fNIRS Headgear Performance and Signal Recovery

This paper reviews the effects of varying gravitational levels on functional Near-Infrared Spectroscopy (fNIRS) headgear. The fNIRS systems quantify neural activations in the cortex by measuring hemoglobin concentration changes via optical intensity. Such activation measurement allows for the detection of cognitive state, which can be important for emotional stability, human performance and vigilance optimization, and the detection of hazardous operator state. The technique depends on coupling between the fNIRS probe and users skin. Such coupling may be highly susceptible to motion if probe-containing headgear designs are not adequately tested. The lack of reliable and self-applicable headgear robust to the influence of motion artifact currently inhibits its operational use in aerospace environments. Both NASAs Aviation Safety and Human Research Programs are interested in this technology as a method of monitoring cognitive state of pilots and crew.

fNIRS↗

Waveguide Modulator for Interference Tolerant Functional Near Infrared Spectrometer (fNIRS)

Many crew-related errors in aviation and astronautics are caused by hazardous cognitive states including overstress, disengagement, high fatigue and ineffective crew coordination. Safety can be improved by monitoring and predicting these cognitive states in a non-intrusive manner and designing mitigation strategies. Measuring hemoglobin concentration changes in the brain with functional Near Infrared Spectroscopy is a promising technique for monitoring cognitive state and optimizing human performance during both space and aviation operations. A compact, wearable fNIRS system would provide an innovative early warning system during long duration missions to detect and prevent vigilance decrements in pilots and astronauts. This effort focused on developing a waveguide modulator for use in a fNIRS system.

spectroscopy↗

Environmental Monitoring as Part of Life Support for the Crew Habitat for Lunar and Mars Missions

Like other crewed space missions, future missions to the moon and Mars will have requirements for monitoring the chemical and microbial status of the crew habitat. Monitoring the crew habitat becomes more critical in such long term missions. This paper will describe the state of technology development for environmental monitoring of lunar lander and lunar outpost missions, and the state of plans for future missions.

Jan, Darrell L.↗

Monitoring Human Performance on Future Deep Space Missions Abstract

NASA and the commercial spacecraft community are working diligently to put the first woman on the moon in the 2024 timeframe. At the same time, NASA researchers are thinking about how to solve the even larger challenges that future deep space missions will bring. Space travel itself is difficult, but astronauts on deep space missions will face obstacles and unknowns never before experienced. In addition to the altered gravity and hostile/closed environment of a spacecraft, deep space crews will face increased radiation, isolation, and distance from Earth. During Extravehicular Activity (EVA, or “spacewalk”) operations, crew will experience increased physical and cognitive workload due to extended types, frequencies and durations of tasks performed on exploration missions in partial gravity environments. All of these stressors will impact crew physical and mental health and performance in difficult-to-anticipate ways. Crew autonomy may be one of the biggest challenges faced. Communication delays and blackouts will occur, and in those situations, the crew may not have access to the Mission Control Center (MCC). They may be forced to be solely dependent on each other and the available information onboard to stay alive, healthy, and achieve the mission. The only conceivable way to meet the challenges of Earth independence is to enable the crew to monitor their own health and performance -- preferably unobtrusively as they perform their duties. Technologies and techniques must be developed to aid the crew in these assessments. A deep space mission is expected to have relatively short periods of high cognitive demand, stress, and fatigue, alongside potentially long periods of cognitive underload during the transit, where boredom, loneliness, and depression can set in. Both ends of this spectrum are dangerous. Crew must be made aware when their task performance drops significantly, when their cognitive workload is too high, when they have lost situation awareness, or when they are too stressed or too fatigued to perform well. They must be able to identify these risks, and then mitigate them with countermeasures available onboard. A number of self-monitoring technologies are presently being explored by NASA to advance crew state determination capabilities. These range from real-time, physiological workload and situation awareness assessments, to crew health measurements determining physical and mental fitness for duty, to task performance metrics such as suit resource expenditures. For EVA tasks during surface exploration missions, biomedical information such as metabolic rate may be provided to crewmembers for situational awareness related to task performance efficiency. In addition, translation distances, hydration, nutrition, inspired CO2 exposure and other consumables usage rates may be useful input metrics for modeling individualized performance during tasks to inform crew or provide estimates of work efficiency. Oculomotor metrics such as gaze dwell time, pupilometry, and eye tracking collected in advanced helmet mounted displays could potentially be used to characterize crew situation awareness. This paper highlights some of these projects, and provides broader discussion about the need for advanced monitoring and smart technologies, as NASA takes the leap into the next generation of space exploration.

Kritina Holden↗

Supporting Crew Medical Decisions on Deep Space Missions: A Real-Time Performance Monitoring

Crewed missions into deep space will require astronauts to respond autonomously to safety- and time-critical anomalies. These and other potential issues will require the continuous monitoring and recognition of potentially subtle, but complex, anomalous data patterns. NASA continues to investigate real-time metrics for Extravehicular Operations1 and for providing feedback to improve performance2. Since it is unknown how long-term exposure to deep space will affect crew health, continuous monitoring of clinical and subclinical status is warranted. NASA is characterizing crew medical decision-support needs and identifying the recommended requirements of a Clinical Decision Support System (CDSS) within the Exploration Medical Capability Element (ExMC) of the Human Research Program3. Early detection, and continuous monitoring, of performance may provide an effective prognostic capability for assessing crew health state, and the identified requirements could be provided for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. There is evidence to suggest that automatic, unobtrusive collection of keystroke features, such as alphanumeric key latencies, backspaces or typing rhythm, could be a valuable performance screening tool. Keystroke features show significant differences between control subjects and patients with overt clinical illness, such as multiple sclerosis4 and Parkinson’s disease5, as well as behavioral health and performance issues, such as mild cognitive impairment6 and depression7. This work is exploring a capability for the assessment of early task performance decline in crew as they perform daily activities. Timestamped keyboard entries are continuously collected and stored. Nominal keystroke interactions are compared to those obtained after exposure to spaceflight stressors, e.g., fatigue, to determine the methods sensitivity. This work will pave the way toward an objective detection tool that may be deployed in a spaceflight setting.

clinical↗