Search NASA⌕ Search

SEARCH · Search NASA

Results for “AUDITORY TASK”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

89 records · Page 5

Why practice reduces dual-task interference

M. A. Van Selst, E. Ruthruff, and J. C. Johnston (1999) found that practice dramatically reduced dual-task interference in a Psychological Refractory Period (PRP) paradigm with 1 vocal response and 1 manual response. Results from 3 further experiments using the highly trained participants of M. A. Van Selst et al. (1999) support 4 main conclusions: (a) A processing bottleneck exists even after extensive practice; (b) the principal cause of the reduction in PRP interference with practice is shortening of Task 1 bottleneck stages; (c) a secondary cause is that 1 or more, but not all, of the Task 2 substages that are postponed before practice are not postponed after practice (i.e., become automatized); and (d) the extent of PRP reduction with practice depends on the modalities of the 2 responses. A control experiment with 2 manual response tasks showed less PRP reduction with practice than that found by Van Selst et al.

Auditory Perception/physiology↗

A dual-task investigation of automaticity in visual word processing

An analysis of activation models of visual word processing suggests that frequency-sensitive forms of lexical processing should proceed normally while unattended. This hypothesis was tested by having participants perform a speeded pitch discrimination task followed by lexical decisions or word naming. As the stimulus onset asynchrony between the tasks was reduced, lexical-decision and naming latencies increased dramatically. Word-frequency effects were additive with the increase, indicating that frequency-sensitive processing was subject to postponement while attention was devoted to the other task. Either (a) the same neural hardware shares responsibility for lexical processing and central stages of choice reaction time task processing and cannot perform both computations simultaneously, or (b) lexical processing is blocked in order to optimize performance on the pitch discrimination task. Either way, word processing is not as automatic as activation models suggest.

Attention↗

Hesitation in tracking induced by a concurrent manual task

When people are required to track with one hand and perform occasional discrete responses with the other hand, there is a strong possibility that errors will be induced in tracking attributable to the simultaneous action by the other. This problem was investigated by pairing pursuit tracking (right hand) with a handle movement response (left hand) guided by an auditory stimulus. Tracking is assumed to represent flight control and the left hand response to represent other aspects of aircraft system management. The general goal of this research is to identify the types of errors induced into tracking by the requirement of a secondary response with the other hand. An attempt is reported to determine if hesitations can be reduced further by combining tracking emphasis with a higher degree of practice. It is concluded that there is a tendency to freeze the tracking response when a discrete simultaneous response is required of the other hand. By contrast, practice seems to reduce hesitations while also improving left hand reaction time. Thus there appears to be a mode of control which permits tracking and discrete simultaneous responses to occur together.

Kelly, P. A.↗

An interactive driving simulation for driver control and decision-making research

Display techniques and equations of motion for a relatively simple fixed base car simulation are described. The vehicle dynamics include simplified lateral (steering) and longitudinal (speed) degrees of freedom. Several simulator tasks are described which require a combination of operator control and decision making, including response to wind gust inputs, curved roads, traffic signal lights, and obstacles. Logic circuits are used to detect speeding, running red lights, and crashes. A variety of visual and auditory cues are used to give the driver appropriate performance feedback. The simulated equations of motion are reviewed and the technique for generating the line drawing CRT roadway display is discussed. On-line measurement capabilities and experimenter control features are presented, along with previous and current research results demonstrating simulation capabilities and applications.

Allen, R. W.↗

A view of Kanerva's sparse distributed memory

Pentti Kanerva is working on a new class of computers, which are called pattern computers. Pattern computers may close the gap between capabilities of biological organisms to recognize and act on patterns (visual, auditory, tactile, or olfactory) and capabilities of modern computers. Combinations of numeric, symbolic, and pattern computers may one day be capable of sustaining robots. The overview of the requirements for a pattern computer, a summary of Kanerva's Sparse Distributed Memory (SDM), and examples of tasks this computer can be expected to perform well are given.

Denning, P. J.↗

Sequential Phenomena in Psychophysical Judgments: A Theoretical Analysis

This paper deals with an analysis of psychophysical detection experiments designed to assess the limit of a human observer's level of sensitivity. A mathematical theory or the detection process is introduced that, in contrast to previous theories, provides an analysis of the sequential effects observed in psychophysical data. Two variations of the detection task are considered: information feedback and no-information feedback. In the feedback situation the subject is given information concerning the correctness of his responses, whereas in the no-feedback situation he is not. Data from a visual detection experiment with no-information feedback, and from an auditory detection experiment with information feedback are analyzed in terms of the theory. Finally, some general results are derived concerning the relationship between performance in the feedback situation and the no-feedback situation.

Atkinson, R. C.↗

Dual-task interference with equal task emphasis: graded capacity sharing or central postponement?

Most studies using the psychological refractory period (PRP) design suggest that dual-task performance is limited by a central bottleneck. Because subjects are usually told to emphasize Task 1, however, the bottleneck might reflect a strategic choice rather than a structural limitation. To evaluate the possibility that central operations can proceed in parallel, albeit with capacity limitations, we conducted two dual-task experiments with equal task emphasis. In both experiments, subjects tended to either group responses together or respond to one task well before the other. In addition, stimulus-response compatibility effects were roughly constant across stimulus onset asynchronies (SOAs). At the short SOA, compatibility effects also carried over onto response times for the other task. This pattern of results is difficult to reconcile with the possibility that subjects share capacity roughly equally between simultaneous central operations. However, this pattern is consistent with the existence of a structural central bottleneck.

Auditory Perception↗

Visual Image Sensor Organ Replacement

This innovation is a system that augments human vision through a technique called "Sensing Super-position" using a Visual Instrument Sensory Organ Replacement (VISOR) device. The VISOR device translates visual and other sensors (i.e., thermal) into sounds to enable very difficult sensing tasks. Three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. Because the human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns, the translation of images into sounds reduces the risk of accidentally filtering out important clues. The VISOR device was developed to augment the current state-of-the-art head-mounted (helmet) display systems. It provides the ability to sense beyond the human visible light range, to increase human sensing resolution, to use wider angle visual perception, and to improve the ability to sense distances. It also allows compensation for movement by the human or changes in the scene being viewed.

Maluf, David A.↗

Detectability of auditory signals presented without defined observation intervals

Ability to detect tones in noise was measured without defined observation intervals. Latency density functions were estimated for the first response following a signal and, separately, for the first response following randomly distributed instances of background noise. Detection performance was measured by the maximum separation between the cumulative latency density functions for signal-plus-noise and for noise alone. Values of the index of detectability, estimated by this procedure, were approximately those obtained with a 2-dB weaker signal and defined observation intervals. Simulation of defined- and non-defined-interval tasks with an energy detector showed that this device performs very similarly to the human listener in both cases.

Watson, C. S.↗

Upgrading the Space Shuttle Caution and Warning System

A report describes the history and the continuing evolution of an avionic system aboard the space shuttle, denoted the caution and warning system, that generates visual and auditory displays to alert astronauts to malfunctions. The report focuses mainly on planned human-factors-oriented upgrades of an alphanumeric fault-summary display generated by the system. Such upgrades are needed because the display often becomes cluttered with extraneous messages that contribute to the difficulty of diagnosing malfunctions. In the first of two planned upgrades, the fault-summary display will be rebuilt with a more logical task-oriented graphical layout and multiple text fields for malfunction messages. In the second upgrade, information displayed will be changed, such that text fields will indicate only the sources (that is, root causes) of malfunctions; messages that are not operationally useful will no longer appear on the displays. These and other aspects of the upgrades are based on extensive collaboration among astronauts, engineers, and human-factors scientists. The report describes the human-factors principles applied in the upgrades.

McCandless, Jeffrey W.↗

Mitigation of Attentional Tunneling in the Flight Deck Using a Spatial Auditory Display

The role of attentional bias to a specific form of information, e.g., visual versus aural instructions, was evaluated to address the issue of attentional fixation (i.e., "cognitive tunneling") in the flight deck. A method of mitigating attentional tunneling using a spatial auditory display was evaluated in the presence and absence of a biasing factor. Data were gathered for participant recognition, accuracy and response times to aural and visual instructions under different conditions of distractor stimuli. Results showed a significant main effect for target acquisition with the use of spatial audio techniques. No significant main effects or interactions were found for target acquisition timing. Target acquisition was not affected by a "gaming score" biasing factor associated with the distractor tasks.

readback errors↗

The development of system components to provide proprioceptive and tactile information to the human for future telepresence systems

System components are presented that are being implemented to augment teleoperated systems by providing both force and tactile information to the human operator. The concept proposed is the control of a manipulator to perform tasks; i.e., flight line maintenance and repair of combat aircraft or satellites while under the control of a human operator at a remote location to maintain mission effectiveness in a hostile environment. The human would control the motion of the manipulator via a master system with information from the remote site being fed back by direct stimulation of the humans sensory mechanisms or by graphic interpretation of displays. We are interested in providing the operator feedback of position, force, auditory, vision, and tactile information to aide in the human's cognitive ability to control the manipulator. This sensory information from the remote site would then be presented to the operator in such a manner as to enhance his performance while providing him a sense of being present at the remote location, this is known as telepresence. Also discussed is the research done by the Human Sensory Feedback (HSF) facility at the Armstrong Laboratory to provide tactile and proprioceptive feedback to the operator. The system components of this system includes tactile sensor and stimulators, dexterous robotic hands, and the control of positioning and operating industrial robots with exoskeletal mechanisms.

Wright, Ammon K.↗

Quality metrics for sensor images

Methods are needed for evaluating the quality of augmented visual displays (AVID). Computational quality metrics will help summarize, interpolate, and extrapolate the results of human performance tests with displays. The FLM Vision group at NASA Ames has been developing computational models of visual processing and using them to develop computational metrics for similar problems. For example, display modeling systems use metrics for comparing proposed displays, halftoning optimizing methods use metrics to evaluate the difference between the halftone and the original, and image compression methods minimize the predicted visibility of compression artifacts. The visual discrimination models take as input two arbitrary images A and B and compute an estimate of the probability that a human observer will report that A is different from B. If A is an image that one desires to display and B is the actual displayed image, such an estimate can be regarded as an image quality metric reflecting how well B approximates A. There are additional complexities associated with the problem of evaluating the quality of radar and IR enhanced displays for AVID tasks. One important problem is the question of whether intruding obstacles are detectable in such displays. Although the discrimination model can handle detection situations by making B the original image A plus the intrusion, this detection model makes the inappropriate assumption that the observer knows where the intrusion will be. Effects of signal uncertainty need to be added to our models. A pilot needs to make decisions rapidly. The models need to predict not just the probability of a correct decision, but the probability of a correct decision by the time the decision needs to be made. That is, the models need to predict latency as well as accuracy. Luce and Green have generated models for auditory detection latencies. Similar models are needed for visual detection. Most image quality models are designed for static imagery. Watson has been developing a general spatial-temporal vision model to optimize video compression techniques. These models need to be adapted and calibrated for AVID applications.

Ahumada, AL↗

Tactile Cueing as a Gravitational Substitute for Spatial Navigation During Parabolic Flight

INTRODUCTION: Spatial navigation requires an accurate awareness of orientation in your environment. The purpose of this experiment was to examine how spatial awareness was impaired with changing gravitational cues during parabolic flight, and the extent to which vibrotactile feedback of orientation could be used to help improve performance. METHODS: Six subjects were restrained in a chair tilted relative to the plane floor, and placed at random positions during the start of the microgravity phase. Subjects reported their orientation using verbal reports, and used a hand-held controller to point to a desired target location presented using a virtual reality video mask. This task was repeated with and without constant tactile cueing of "down" direction using a belt of 8 tactors placed around the mid-torso. Control measures were obtained during ground testing using both upright and tilted conditions. RESULTS: Perceptual estimates of orientation and pointing accuracy were impaired during microgravity or during rotation about an upright axis in 1g. The amount of error was proportional to the amount of chair displacement. Perceptual errors were reduced during movement about a tilted axis on earth. CONCLUSIONS: Reduced perceptual errors during tilts in 1g indicate the importance of otolith and somatosensory cues for maintaining spatial awareness. Tactile cueing may improve navigation in operational environments or clinical populations, providing a non-visual non-auditory feedback of orientation or desired direction heading.

Montgomery, K. L.↗

Harnessing Artificial Intelligence for Medical Diagnosis and Treatment During Space Exploration Missions

From May 8th to June 9th, 2023, I had the opportunity to participate in an experiential learning experience at Johnson Space Center in Houston, TX with Exploration Medical Capability (ExMC), an element of the NASA Human Research Program. During this research experience, I was not only able to work on the above titled research project, but also gain an immense exposure to the field of aerospace medicine, make numerous connections within the field, tour NASA facilities, as well as travel to the Aerospace Medical Association Annual Conference (AsMA) in New Orleans. To briefly introduce my project, it is well understood that the medical capabilities available to crew medical officers (CMOs) on the International Space Station will be different than the capabilities available and needed during deep space exploration missions to the Moon, Mars, and beyond. Ground support is particularly limited due to distance, communication delays (or lack of communication), and lack of resupply. Therefore, to support medical care by CMOs on these missions, robust clinical decision support systems (CDSSs) must be designed. The recent publication and public launch of generative artificial intelligence (AI) tools based upon large language models (LLM) such as ChatGPT provides the opportunity to create a smart assistant for onboard triage, diagnosis, and treatment of medical conditions. Ultimately, the overall purpose of the project was to research what AI tools currently exist or are in development, and to see how they might be implemented onboard during exploration class spaceflights of the future. The ExMC element is actively developing several tools to be used in preparation for and during deep space exploration missions. One of those tools, known as IMPACT, is a probabilistic risk assessment model which can be used to propose a desired medical system (based on mass and volume) and suggest the clinical outcomes likely to occur for a design reference mission (DRM). The group recently presented the IMPACT model and a DRM of interest titled “Modified Long Duration Lunar Orbital and Lunar Surface” (mLDLOLS) at the recent AsMA conference. The mLDLOLS mock mission is a 9 month and 6-day deep space exploration mission consisting of time in Moon’s orbit (3 months on the Gateway space station), on the lunar surface (3 months within habitat), and another 3 months on Gateway before return to Earth. For this DRM, IMPACT ultimately outlined a preferred medical system that was then associated with medical conditions considered to be most likely based on frequency, most likely to cause astronaut task time loss (TTL), most likely to cause return to definitive care (RTDC), and most likely cause loss of crew life (LOCL). IMPACT also highlighted the medical capabilities/skills that would be required to care for those medical conditions, such as performing a history of present illness or musculoskeletal exam with ultrasound. The primary objective of the project was to perform a survey of the AI tools and systems applicable to the conditions outlined for the proposed mLDLOLS mission. Using PubMed (including most relevant MeSH terms) and Google Scholar, we then created a robust annotated bibliography organized by condition. The 56-page and over 500 reference annotated bibliography was subsequently used to create a review outline that would become the basis for drafting of a future publication. For the review outline, we took those medical conditions researched within the annotated bibliography (condition-based approach) and deployed a systems-based approach, combining those medical conditions and related tools into ten categories. These categories included general/all-purpose CDSSs, tools to diagnose or manage respiratory, dermatologic, neurologic, auditory and vestibular, ophthalmic, musculoskeletal, infection-associated, and gynecologic conditions, as well as tools that could be deployed in the setting of trauma/emergency. With the completion of the 30-page outline, we then began drafting the review paper. To conclude the research experience, I presented the findings from our survey to the ExMC Clinical and Science team. With these objectives, I ultimately learned about the number of AI tools that exist today to assist medical professionals with the triage, diagnosis, and management of several medical conditions. These tools can span from chatbot assistants to help triage knee pain to vision transformer models that can identify ophthalmic conditions based on ocular surface images captured with a cell phone. We also highlighted the current gaps that exist in the literature alongside the advancements that are needed to make the desired CDSS for deep space exploration missions. With this experience, I certainly confirmed an existing career goal and identified several additional skills needed to become an aerospace medical doctor including knowledge of critical care in an extreme medicine setting, aerospace engineering and human integration systems, artificial intelligence, machine learning, and risk models. I also identified numerous transferable skills for this career goal including the basic knowledge of medicine (MD), deployment of the scientific method for critical thought about new scientific questions (PhD), review of published literature, including creating an annotated bibliography (PhD), as well as detailed scientific writing (PhD). The results of my research will likely guide the design of an all-encompassing onboard medical assistant for use during deep space exploration missions of the future. I plan on sharing the outcomes from this experience with my peers at a student seminar in the Fall semester on August 30th. During the seminar, I will detail the project, my experience at NASA and AsMA, as well as offer best practice guidelines for students entertaining similar experiences or careers. In conclusion, I would like to thank the WVU School of Medicine, Research and Graduate Education office, as well as NASA ExMC for the unwavering support of this life-changing experience.

Ryan A. Lacinski↗

Speech Alarms Pilot Study

Currently on the International Space Station (ISS) and other space vehicles Caution & Warning (C&W) alerts are represented with various auditory tones that correspond to the type of event. This system relies on the crew's ability to remember what each tone represents in a high stress, high workload environment when responding to the alert. Furthermore, crew receive a year or more in advance of the mission that makes remembering the semantic meaning of the alerts more difficult. The current system works for missions conducted close to Earth where ground operators can assist as needed. On long duration missions, however, they will need to work off-nominal events autonomously. There is evidence that speech alarms may be easier and faster to recognize, especially during an off-nominal event. The Information Presentation Directed Research Project (FY07-FY09) funded by the Human Research Program included several studies investigating C&W alerts. The studies evaluated tone alerts currently in use with NASA flight deck displays along with candidate speech alerts. A follow-on study used four types of speech alerts to investigate how quickly various types of auditory alerts with and without a speech component - either at the beginning or at the end of the tone - can be identified. Even though crew were familiar with the tone alert from training or direct mission experience, alerts starting with a speech component were identified faster than alerts starting with a tone. The current study replicated the results from the previous study in a more rigorous experimental design to determine if the candidate speech alarms are ready for transition to operations or if more research is needed. Four types of alarms (caution, warning, fire, and depressurization) were presented to participants in both tone and speech formats in laboratory settings and later in the Human Exploration Research Analog (HERA). In the laboratory study, the alerts were presented by software and participants were asked to identify the alert as quickly and as accurately as possible. Reaction time and accuracy were measured. Participants identified speech alerts significantly faster than tone alerts. The HERA study investigated the performance of participants in a flight-like environment. Participants were instructed to complete items on a task list and respond to C&W alerts as they occurred. Reaction time and accuracy were measured to determine if the benefits of speech alarms are still present in an applied setting.

Sandor, A.↗

Speed of mental processing in the middle of the night

This study aimed to determine whether human mental processing actually slows down during the night hours, separately from the previously documented microsleeps, lapses in attention, and general slowing of motor responses. Eighteen healthy young adults were studied during 36 hours of constant wakeful bedrest. Every 2 hours, they performed a logical reasoning task. Items phrased in the negative voice took reliably longer to respond to than items phrased in the positive voice, indicating the need for more mental processing in those items. By subtracting "negative" from "positive" reaction times at each time of day, we were able to plot a circadian rhythm in the time taken for this extra mental processing to be done separately from microsleeps, psychomotor slowing, and inattention. The extra mental processing took longer at night and on the day following sleep loss than it did during the day before the sleep loss, suggesting that human mental processing slows down during the night under sleep deprivation.

Non-NASA Center↗