Search NASA⌕ Search

SEARCH · Search NASA

Results for “VERBAL COMMUNICATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Measurement of operator workload in an information processing task

This was an experimental study to develop an improved methodology for measuring workload in an information processing task and to assess the effects of shift length and communication density (rate of information flow) on the ability to process and classify verbal messages. Each of twelve subjects was exposed to combinations of three shift lengths and two communication densities in a counterbalanced, repeated measurements experimental design. Results indicated no systematic variation in task performance measures or in other dependent measures as a function of shift length or communication density. This is attributed to the absence of a secondary loading task, an insufficiently taxing work schedule, and the lack of psychological stress. Subjective magnitude estimates of workload showed fatigue (and to a lesser degree, tension) to be a power function of shift length. Estimates of task difficulty and fatigue were initially lower but increased more sharply over time under low density than under high density conditions. An interpretation of findings and recommedations for furture research are included. This research has major implications to human workload problems in information processing of air traffic control verbal data.

Jenney, L. L.↗

A Natural Language Understanding Approach for Digitizing Aircraft Ground Taxi Instructions

Recent Advancements in spoken language processing technologies have enabled the development of reliable automation tools to assist air traffic control (ATC) operations. These advancements present a unique opportunity to strategically implement digital taxi instructions for aircraft movement on the ground. Digital taxi instructions issue taxiing procedures to pilots as textual or graphical instructions. There are several benefits of digital instructions, including a reduction in radio congestion, elimination of communication errors, and improved aircraft monitoring capabilities. Natural language understanding (NLU) models can extract digital taxi instructions from verbal instructions issued by air traffic controllers. This capability enables the implementation of a digital taxi communication framework with minimal changes to the existing air traffic controller operational environment. We explore a novel application for NLU: automatically generating digital taxi instructions from air traffic controller speech. We describe the development of an annotation scheme to represent (aircraft) ground traffic communications in the US National Airspace System (NAS).Our annotation scheme uses intent classification and slot filling to extract taxi instructions, enabling NLU models to leverage syntactic information. Several neural network models were trained to categorize the controller’s intent and label information relevant to his or her intent.Our research demonstrates that it is feasible to use NLU to automatically generate digitaltaxi instructions, suggesting that it is a powerful tool for the implementation of digital taxi communications.

Hillel Steinmetz↗

Evaluation of NASA Data Products for RPO Applications

This presentation summarizes preliminary investigations at SSC by NASA's ASD in Air Quality including decision support tools, partner plans, working groups, and committees. An overview of follow-on short-term and long-term objectives is also provided. A table of potential NASA sensors for use with air quality applications is included, along with specifications for MODIS 04 and 06 products. This presentation was originally given by Rich Piorot of the Vermont Department of Environmental Conservation - Air Quality as part of a round-table discussion during "Exploring Collaborative Opportunities in Air Quality Monitoring, Modelling and Communication Workshop" in Boulder, CO, on March 21-22, 2005; verbal consent for this presentation to be provided to Mr. Piorot was given by the NASA SSC ASD Air Quality Program Manager on March 14, 2005.

Frisbie, Troy↗

Navigational demands of low-level helicopter flight

The present study was designed to assess the verbal references to map, terrain, direction, and position, that navigators and pilots communicate during a simulated low-level flight. Two-person crews were asked to communicate normally while negotiating six short flight missions that varied widely in regard to map-terrain characteristics. Half of the crews performed the exercises with fixed, north-up maps and the other half used movable maps that were adjusted to maintain a track-up correspondence to the flight route. An analysis was performed to compare differences in crew communication patterns between map orientations, characteristics, and navigation tasks. The results showed differences in the frequency of communication across categories for map characteristics but not for map orientations or tasks. A difference in the proportion of communications between pilot and navigator occurred when crew were lost. Pilots communicated more than navigators when crews were lost and the reverse was true when crews were not lost. The results support and extend findings from a distance error performance analysis performed on the same flight missions.

Delzell, Susanne↗

Measured Response for UAS Integration into the National Airspace System

The measured response (MR) is the response time of aircraft to Air Traffic Controller (ATCo) commands and clearances. The overall MR can be broken up into several components, including the pilot verbal latencies (MR1), the time between the end of an ATCo clearance and the beginning of the pilots read back, and the execution initiation latency (MR2), the time between the end of the ATCos clearance and when the pilot begins to execute a maneuver. The MR is a crucial concern for the integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS) due to potentially greater latencies stemming from remote pilot communication and command execution. As a result, it is important to quantify what latencies in verbal responding and command execution are acceptable for safe and efficient operations in the NAS. The present studies begin to address these issues in a series of four simulations supported by the UAS Integration into the NAS program.

UAS in the NAS↗

Flight Deck Data Link Displays: An Evaluation of Textual and Graphical Implementations

In Experiment 1, 16 pilots participated in a part-task simulation study that evaluated pilot data link communication for short and long message types and for two textual formats. No differences were found between the two textual formats when evaluating data link transaction times and pilot performance on a secondary task. Pilots initiated flight changes more quickly with the T-Scan format, where location of clearance information roughly corresponded to the cockpit instrument layout. Longer messages were less problematic than two short messages sent in close succession as pilots required more verbal clarification for closely spaced messages. 24 pilots participated in a second experiment that evaluated pilot communication performance for textual data link, two implementations of graphical data link, and a combined graphical and textual information modality. The two modalities incorporating text resulted in significantly faster transaction times and better performance on the secondary task than the two graphical-only implementations. The interval between messages was also more systematically varied in Experiment 2, and a short interval between messages significantly increased the access time for the second message. This delay in access was long enough to increase significantly the total transaction time of the second message, and this effect was exaggerated for the graphical-only implementations. Time to view the message before acknowledgement and time to initiate flight changes were not affected by the interval manipulation, This suggests that pilots adopt a sequential message handling strategy, and presenting messages closely in succession may present operational problems in a data link Air Traffic Control (ATC) environment. The results of this study also indicate that the perceived importance of message content is currently a crucial element in pilot data link communication.

McGann, Alison↗

Communication variations and aircrew performance

The relationship between communication variations and aircrew performance (high-error vs low-error performances) was investigated by analyzing the coded verbal transcripts derived from the videotape records of 18 two-person air transport crews who participated in a high-fidelity, full-mission flight simulation. The flight scenario included a task which involved abnormal operations and required the coordinated efforts of all crew members. It was found that the best-performing crews were characterized by nearly identical patterns of communication, whereas the midrange and poorer performing crews showed a great deal of heterogeneity in their speech patterns. Although some specific speech sequences can be interpreted as being more or less facilitative to the crew-coordination process, predictability appears to be the key ingredient for enhancing crew performance. Crews communicating in highly standard (hence predictable) ways were better able to coordinate their task, whereas crews characterized by multiple, nonstandard communication profiles were less effective in their performance.

Kanki, Barbara G.↗

Communication indices of crew coordination

The relationship between communication patterns and performance in 10 two-person flightcrews is explored with the aim of identifying speech variations which differentiate low- and high-error full mission simulator flights. Verbal data, transcribed from the videotaped performances, are treated as interactive sequences of speech events in which statements spoken by one crewmember are considered within the context of the other crewmember's prior and subsequent speech. Specific speech patterns characterized each crew, but the overriding findings included: a) marked homogeneity of patterns characterizing low-error crews, interpreted as the adoption of a standard form of communicating, and b) heterogeneity of patterns characterizing high-error crews, interpreted as the relative absence of a conventionalized form. Because conventions are regularities which confirm the expectations of those involved, predictability of crewmember behavior should be greater when standard conventions are followed. We conclude that such a practice can facilitate the coordination process and enhance crew performance.

Aerospace Medicine↗

Analyzing Natural Language Context in Human-Machine Teaming using Supervised Machine Learning

Building a foundation for trustworthiness and trust verification in multi-asset teaming is the research challenge of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Design Reference Mission (DRM) for ATTRACTOR is a search and rescue mission objective governed by a multi-member team consisting of human and machine operators. A crucial component to the effort is the communication between humans and autonomous agents throughout both planning and execution stages of the mission. Intuitive communication methods and modalities are posited as critical enablers for certifying trust and trustworthiness. This paper reports on the data collection and analysis conducted in support of the Human Informed Natural-language GANs Evaluation (HINGE)project to attain explainable and trusted communication between human-machine assets. Two identically curated image description datasets were acquired for HINGE, both consisting of two unique input modalities (typed vs. verbal) and retrieved in two distinct contexts (general vs. specific). The gathered datasets were assessed and compared using Parts-of-Speech (POS)features, sentence similarity metrics, and linguistic analysis. Then, the datasets were modeled and tested separately and in combination with one another using machine learning algorithms. The comparison and testing results reveal a superior dataset, by which a preferred context and input is understood, for generating image representations of missing persons using a Generative Adversarial Network (GAN).

Bryan A Barrows↗

Microcoding of communications in accident investigation - Crew coordination in United 811 and United 232

Two recent airline accidents that underscored the value of cockpit resource management (CRM) to line operations, especially under stressful, high workload conditions are reviewed. An analysis of the verbal behavior of each crew was conducted to explore how catastrophic events impact upon the dynamics of crew interaction. In both cases the Captain stated that training in CRM contributed significantly to the overall effectiveness of the crews.

Predmore, Steven C.↗

Two memories for geographical slant: separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

NASA Discipline Space Human Factors↗

Multiuser Collaboration with Networked Mobile Devices

In this paper we describe a multiuser collaboration infrastructure that enables multiple mission scientists to remotely and collaboratively interact with visualization and planning software, using wireless networked personal digital assistants(PDAs) and other mobile devices. During ground operations of planetary rover and lander missions, scientists need to meet daily to review downlinked data and plan science activities. For example, scientists use the Science Activity Planner (SAP) in the Mars Exploration Rover (MER) mission to visualize downlinked data and plan rover activities during the science meetings [1]. Computer displays are projected onto large screens in the meeting room to enable the scientists to view and discuss downlinked images and data displayed by SAP and other software applications. However, only one person can interact with the software applications because input to the computer is limited to a single mouse and keyboard. As a result, the scientists have to verbally express their intentions, such as selecting a target at a particular location on the Mars terrain image, to that person in order to interact with the applications. This constrains communication and limits the returns of science planning. Furthermore, ground operations for Mars missions are fundamentally constrained by the short turnaround time for science and engineering teams to process and analyze data, plan the next uplink, generate command sequences, and transmit the uplink to the vehicle [2]. Therefore, improving ground operations is crucial to the success of Mars missions. The multiuser collaboration infrastructure enables users to control software applications remotely and collaboratively using mobile devices. The infrastructure includes (1) human-computer interaction techniques to provide natural, fast, and accurate inputs, (2) a communications protocol to ensure reliable and efficient coordination of the input devices and host computers, (3) an application-independent middleware that maintains the states, sessions, and interactions of individual users of the software applications, (4) an application programming interface to enable tight integration of applications and the middleware. The infrastructure is able to support any software applications running under the Windows or Unix platforms. The resulting technologies not only are applicable to NASA mission operations, but also useful in other situations such as design reviews, brainstorming sessions, and business meetings, as they can benefit from having the participants concurrently interact with the software applications (e.g., presentation applications and CAD design tools) to illustrate their ideas and provide inputs.

ground operations↗

Automating CapCom Using Mobile Agents and Robotic Assistants

Mobile Agents (MA) is an advanced Extra-Vehicular Activity (EVA) communications and computing system to increase astronaut self-reliance and safety, reducing dependence on continuous monitoring and advising from mission control on Earth. MA is voice controlled and provides information verbally to the astronauts through programs called "personal agents." The system partly automates the role of CapCom in Apollo-including monitoring and managing navigation, scheduling, equipment deployment, telemetry, health tracking, and scientific data collection. Data are stored automatically in a shared database in the habitat/vehicle and mirrored to a site accessible by a remote science team. The program has been developed iteratively in authentic work contexts, including six years of ethnographic observation of field geology. Analog field experiments in Utah enabled empirically discovering requirements and testing alternative technologies and protocols. We report on the 2004 system configuration, experiments, and results, in which an EVA robotic assistant (ERA) followed geologists approximately 150 m through a winding, narrow canyon. On voice command, the ERA took photographs and panoramas and was directed to serve as a relay on the wireless network.

Clancey, William J.↗

Automating CapCom Using Mobile Agents and Robotic Assistants

We have developed and tested an advanced EVA communications and computing system to increase astronaut self-reliance and safety, reducing dependence on continuous monitoring and advising from mission control on Earth. This system, called Mobile Agents (MA), is voice controlled and provides information verbally to the astronauts through programs called personal agents. The system partly automates the role of CapCom in Apollo-including monitoring and managing EVA navigation, scheduling, equipment deployment, telemetry, health tracking, and scientific data collection. EVA data are stored automatically in a shared database in the habitat/vehicle and mirrored to a site accessible by a remote science team. The program has been developed iteratively in the context of use, including six years of ethnographic observation of field geology. Our approach is to develop automation that supports the human work practices, allowing people to do what they do well, and to work in ways they are most familiar. Field experiments in Utah have enabled empirically discovering requirements and testing alternative technologies and protocols. This paper reports on the 2004 system configuration, experiments, and results, in which an EVA robotic assistant (ERA) followed geologists approximately 150 m through a winding, narrow canyon. On voice command, the ERA took photographs and panoramas and was directed to move and wait in various locations to serve as a relay on the wireless network. The MA system is applicable to many space work situations that involve creating and navigating from maps (including configuring equipment for local topology), interacting with piloted and unpiloted rovers, adapting to environmental conditions, and remote team collaboration involving people and robots.

Clancey, William J.↗

SHAPA: An interactive software tool for protocol analysis applied to aircrew communications and workload

As modern transport environments become increasingly complex, issues such as crew communication, interaction with automation, and workload management have become crucial. Much research is being focused on holistic aspects of social and cognitive behavior, such as the strategies used to handle workload, the flow of information, the scheduling of tasks, the verbal and non-verbal interactions between crew members. Traditional laboratory performance measures no longer sufficiently meet the needs of researchers addressing these issues. However observational techniques are better equipped to capture the type of data needed and to build models of the requisite level of sophistication. Presented here is SHAPA, an interactive software tool for performing both verbal and non-verbal protocol analysis. It has been developed with the idea of affording the researchers the closest possible degree of engagement with protocol data. The researcher can configure SHAPA to encode protocols using any theoretical framework or encoding vocabulary that is desired. SHAPA allows protocol analysis to be performed at any level of analysis, and it supplies a wide variety of tools for data aggregation, manipulation. The output generated by SHAPA can be used alone or in combination with other performance variables to get a rich picture of the influences on sequences of verbal or nonverbal behavior.

James, Jeffrey M.↗

Pre-Mission Input Requirements to Enable Successful Sample Collection by a Remote Field/EVA Team

This paper is intended to evaluate the sample collection process with respect to sample characterization and decision making. In some cases, it may be sufficient to know whether a given outcrop or hand sample is the same as or different from previous sampling localities or samples. In other cases, it may be important to have more in-depth characterization of the sample, such as basic composition, mineralogy, and petrology, in order to effectively identify the best sample. Contextual field observations, in situ/handheld analysis, and backroom evaluation may all play a role in understanding field lithologies and their importance for return. For example, whether a rock is a breccia or a clast-laden impact melt may be difficult based on a single sample, but becomes clear as exploration of a field site puts it into context. The FINESSE (Field Investigations to Enable Solar System Science and Exploration) team is a new activity focused on a science and exploration field based research program aimed at generating strategic knowledge in preparation for the human and robotic exploration of the Moon, near-Earth asteroids (NEAs) and Phobos and Deimos. We used the FINESSE field excursion to the West Clearwater Lake Impact structure (WCIS) as an opportunity to test factors related to sampling decisions. In contract to other technology-driven NASA analog studies, The FINESSE WCIS activity is science-focused, and moreover, is sampling-focused, with the explicit intent to return the best samples for geochronology studies in the laboratory. This specific objective effectively reduces the number of variables in the goals of the field test and enables a more controlled investigation of the role of the crewmember in selecting samples. We formulated one hypothesis to test: that providing details regarding the analytical fate of the samples (e.g. geochronology, XRF/XRD, etc.) to the crew prior to their traverse will result in samples that are more likely to meet specific analytical objectives than samples collected in the absence of this premission information. We conducted three tests of this hypothesis. Our investigation was designed to document processes, tools and procedures for crew sampling of planetary targets. This is not meant to be a blind, controlled test of crew efficacy, but rather an effort to recognize the relevant variables that enter into sampling protocol and to develop recommendations for crew and backroom training in future endeavors. Methods: One of the primary FINESSE field deployment objectives was to collect impact melt rocks and impact melt-bearing breccias from a number of locations around the WCIS structure to enable high precision geochronology of the crater to be performed [1]. We conducted three tests at WCIS after two full days of team participation in field site activities, including using remote sensing data and geologic maps, hiking overland to become familiar with the terrain, and examining previously-collected samples from other islands. In addition, the team members shared their projects and techniques with the entire team. We chose our "crew members" as volunteers from the team, all of whom had had moderate training in geologic fieldwork and became familiar with the general field setting. The first two tests were short, focused tests of our hypothesis. Test A was to obtain hydrothermal vugs; Test B was to obtain impact melt and intrusive rock as well as the contact between the two to check for contact metamorphism and age differences. In both cases, the test director had prior knowledge of the site geology and had developed a study-specific objective for sampling prior to deployment. Prior to the field deployment, the crewmember was briefed on the sampling objective and the laboratory techniques that would be used on the samples. At the field sites (Fig. 2), the crewmember was given 30 minutes to survey a small section of outcrop (10-15 m) and acquire a suite of three samples. The crewmember talked through his process and the test director kept track of the timeline in verbal cues to the crewmember. At the conclusion, the team member conducting the scientific study appraised the samples and train of thought. Test C was a 90-minute EVA simulation using two crewmembers working out of line-of-sight in communication with a science backroom. The science objectives were determined by the science backroom team in advance using a Gigapan image of the outcrop (Fig. 1). The science team formulated hypotheses for the outcrop units and created sampling objectives for impact-melt lithologies; the science team turned these into a science plan, which they communicated to the crew in camp prior to crew deployment. As part of the science plan, the science team also discussed their sample needs in depth with the crewmembers, including laboratory methods, objectives, and samples sizes needed. During the deployment, the two crewmembers relayed real-time information to the science backroom by radio with no time delay. Both the crew and science team re-evaluated their hypotheses and science plans in real-time. Discussion: Upon evaluation, we found that the focused tests (Tests A and B) were successful in meeting their scientific objectives. The crewmember used their knowledge of how the samples were to be used in further study (technique, sample size, and scientific need) to focus on the sampling task. The crewmember was comfortable spending minimal time describing and mapping the outcrop. The crewmember used all available time to get a good sample. The larger test was unsuccessful in meeting the sampling objectives. When the crewmembers began describing the lithologies, it was quickly apparent that the lithologies were not as the backroom expected and had communicated to the crew. When the outcrop wasn't as expected, the crew members instinctively switched to field characterization mode, taking significant time to characterize and map the outcrop. One crew member admitted that he "kind of lost track" of the sampling strategy as he focused on the basic outcrop characterization. This is the logical first step in a field geology campaign, that a significant amount of time must be spent by the crew and backroom to understand the outcrop and its significance. Basic field characterization of an outcrop is a focused activity that takes significant time and training [2, 3]. Sampling of representational lithologies can be added to this activity for little cost [4]. However, we have shown that identification of unusual or specific samples for laboratory study also takes significant time and knowledge. We suggest that sampling of this type be considered a separate activity from field characterization, and that crewmembers be trained in sampling needs for different kinds of studies (representative lithologies vs. specialized samples) to acquire a mindset for sampling similar to field mapping. Sampling activities should be given a significant amount of specifically allocated time in scheduling EVA activities; and in the better case, that sampling be done as a second activity to a previously studied outcrop where both crew and backroom are comfortable with its context and characteristics. Our hypothesis posited that crewmember knowledge of how the samples would be used upon return would aid them in choosing relevant samples. Our testing bore this hypothesis out to some extent. We therefore recommend that crewmember training should include exposure to the laboratory techniques and analyses that will be used on the samples to foster this knowledge. There is also the potential for increasing crewmember contextual knowledge real-time in the field through the introduction of in situ geochemical technologies such as field portable XRF. The presence of field portable geochemical technology could enable the astronauts to interrogate the samples for K abundance real-time, ensuring they could collect valuable and dateable samples [5]. Though simulations such as these can teach us a fair bit about decision making processes and timeline building, one EVA participant noted that when he wasn't collecting "real" samples, he wasn't at his best. This effect suggests that higher-fidelity studies involving truly remote participants conducting actual scientific studies merit further attention to capture lessons for application to future crew situations.

sample collection↗

Information Systems for Crew-Led Operations Beyond Low-Earth Orbit

On past and present human space missions, the management of vehicle health and status has primarily been executed from Earth. Missions such as Apollo, Space Shuttle, and ISS have relied on a safety net of ground-based experts with access to real-time telemetry data, broad and deep systems expertise, and powerful analytical and computing capabilities. The ground team monitors and manages the vehicle’s health in real-time and responds quickly to critical situations and malfunctions. Ground operators also provide real-time oversight and verbal guidance to flight crew members, especially during complex procedure execution and high-risk activities like extra-vehicular activities. However, this operational paradigm, in place for 60 years, will not transfer to long duration exploration missions beyond low Earth orbit (LEO). Lunar and deep-space crewed missions will encounter delayed communications that prohibit real-time operational and medical support. Additionally, there will be infrequent resupply and a diminished capacity to evacuate or rescue crew members. A small crew must operate independently, managing the vehicle’s state, responding to time-critical events, and executing complex procedures, all without the safety net of real-time support.

data representation↗

Science Training History of the Apollo Astronauts

Following President Kennedy’s initiation of Project Apollo, NASA underwent substantial changes in personnel, organization, and programs and faced a major question: what to do on the Moon after landing. Once a decision that science activities, particularly geoscience, should be pursued, considerable debate ensued over how to accomplish this. Questions arose over instruments and tools required, samples and photos to be returned, landing site selection, and crew composition. Answers to these questions required major efforts for planning traverses on the Moon and training the astronauts in the extensive procedures necessary in low gravity to use tools, set up instruments, take adequate photos, collect and document samples, and provide proper descriptions. In addition to astronauts on the surface, an astronaut in lunar orbit managed additional instruments, photography and verbal descriptions. Training for these activities averaged nearly one hundred hours per month for over a year for each crew. There were many problems as the training progressed: adjusting groups and backgrounds of the training personnel for the best combination of personalities and skills, overcoming logistical troubles, revising awkward procedures, determining optimum means of communications between all involved groups, and devising contingency procedures for real-time problems. By the last mission these problems were overcome.

Phinney, William C.↗