Search NASASearch

SEARCH · Search NASA

Results for “team”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Improving Human/Autonomous System Teaming Through Linguistic Analysis

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such integration requires humans to work closely with autonomous systems, forming human and autonomous agent teams. The intention behind such teaming is that a team composed of both humans and autonomous agents will operate better than homogenous teams. Procedures exist for licensing pilots to operate in the national airspace system and current work is being done to define methods for validating the function of autonomous systems, however there is no method in place for assessing the interaction of these two disparate systems. Moreover, currently these systems are operated primarily by subject matter experts, limiting their use and the benefits of such teams. Providing additional information about the ongoing mission to the operator can lead to increased usability and allow for operation by non-experts. Linguistic analysis of the context of verbal communication provides insight into the intended meaning of commonly heard phrases such as "What's it doing now?" Analyzing the semantic sphere surrounding these common phrases enables the prediction of the operator's intent and allows the interface to supply the operator's desired information.

Meszaros, Erica L.

Addressing Human Error in International Space Station Flight Control Teams: Advances in Ground Training for Science Operators

In flight control, as with any human in the loop system, operator error is an inevitable reality. On the International Space Station (ISS) where crew time and physical resources are precious and often irreplaceable, operator errors can result in significant, irreversible consequences. Flight controllers at the Payload Operations Integration Center (POIC) located at NASA’s Marshall Space Flight Center (MSFC) in Huntsville, Alabama know this reality well. At the POIC, operator errors can be caused by a variety of factors, from poor hardware or software design to environmental factors such as time pressure or fatigue. The most difficult errors to address, however, are those which result from ineffective teamwork.Academic research in teamwork has resulted in the identification of many factors which make cross-functional teaming difficult, including leadership, trust building, and communication challenges. These factors, especially when combined with the challenging environmental factors flight control teams must contend with daily, make the goal of minimizing operator errors in payload operations challenging to achieve. To address such teamwork errors, trainers at the POIC have drawn best practices from high reliability industries such as commercial aviation, healthcare, and nuclear power plants, as well as from our sister ISS control center in Houston, Texas, to develop and institute a new training program focused specifically on teamwork skills.This training program, called the Team Skills Curriculum, is based on the concept of Crew Resource Management (CRM) which was developed by NASA in the 1970s for the commercial aviation industry in response to a series of aviation disasters resulting from ineffective teamwork. CRM was later tailored by the Johnson Space Center (JSC) for use in astronaut and flight control training. The result, called Space Flight Resource Management (SFRM) was formally introduced into manned spaceflight training in the late 90s. SFRM has evolved over the years, but the focus has remained on helping operators develop the skills needed to work as part of an effective team. Using these concepts as well as the latest research in cross-functional teaming and data on specific errors occurring at the POIC, trainers in the integrated flight control training branch created a custom training program for both new and certified payload operations specialists.

Harris, Samantha S.

How Do You Go From a Concept Idea to a NASA Selected Mission? Formulating the Psyche Discovery Mission with JPL's Concurrent Engineering Teams

JPL’s Office of Formulation provides continuity of support and access to domain subject matter experts, as Principal Investigators mature their mission concepts from “cocktail napkin” ideas to Preliminary Design Reviews [1]. Using NASA’s Psyche mission as a case study, we describe JPL’s concurrent engineering A-Team and Team X support to the Psyche competed concept study team in the areas of 1) Initial Feasibility, 2) Trade Space Exploration, 3) Spacecraft Point Design and Cost Estimate, 4) Science, Technical, Management, and Cost Review, and 5) Strategy and Communication Development. NASA’s Psyche Discovery-class mission started as a grassroots idea from Principal Investigator L.T. ElkinsTanton. Is there a compelling Discovery mission to visit the interior of a body for the first time, by sending a mission to an iron metal asteroid? In less than five years the Psyche concept was selected as a mission under NASA’s Discovery Program. While Psyche had a dedicated concept development team [2], they utilized JPL’s concurrent engineering teams, methods, analysis tools, and subject matter experts throughout their mission concept formulation lifecycle

Ziemer, John

How Do You Go From a Concept Idea to a NASA Selected Mission? Formulating the Psyche Discovery Mission with JPL's Concurrent Engineering Teams

JPL’s Office of Formulation provides continuity of support and access to domain subject matter experts, as Principal Investigators mature their mission concepts from “cocktail napkin” ideas to Preliminary Design Reviews [1]. Using NASA’s Psyche mission as a case study, we will describe JPL’s concurrent engineering ATeam and Team X support to the Psyche competed concept study team in the areas of 1) Science Feasibility, 2) Trade Space Exploration, 3) Spacecraft Point Design and Cost Estimate, 4) Science, Technical, Management, and Cost Review, and 5) Strategy and Communication Development. NASA’s Psyche Discovery class mission started as a grassroots idea in our A-Team facility, and in less than five years was selected as a mission under NASA’s Discovery Program. While Psyche had a dedicated concept development team [2], they utilized JPL’s concurrent engineering teams, methods, analysis tools, and experts throughout their mission concept lifecycle.

Ziemer, John

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, and ISS Teams Risk

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analogs (HERA) campaigns 4 (C4) and 5 (C5), and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogs of the spaceflight environment. A subset of the HFBP-EM suite was collected during spaceflight as part HRP’s Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are kept the same across studies, however, differences across research settings (e.g., experimental manipulations, mission scenarios, mission length) and implementation of the measures require the data are harmonized to ensure comparable views across missions. The purpose of our project is to develop a harmonized database of HFBP-EM data from different settings, and to summarize the trajectory of behavioral health and performance within and between research settings. In this presentation, we will summarize the harmonized dataset and the trajectory of measures related to the Team Risk, including team performance, team cohesion, team processes, and psychological safety, over time and between and within settings.

S T Bell

Usability Evaluation Technical Report: A Usability Evaluation of the Communication Tool Prototype Prepared in Adobe XD for High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors

Examining Performance and Usability of Situation Awareness Communication Tool for NASA's High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors

A Preliminary Study on the Feasibility of Large Language Models for Detecting Micro-Behaviors Among Team Members in Space Missions

Large-language models (LLMs) have been recently used for spoken language understanding (SLU) to infer meaning and semantics from speech in tasks such as speaker intent and sentiment classification. Due to being trained on large amounts of data, and their ability to understand context and relationships between words, LLMs are competent, enabling them to generalize across tasks without requiring many task-specific training samples. This research examines the feasibility of few-shot learning in LLMs for detecting subtle, brief, and possibly unconscious interactions between team members, called ``micro-behaviors," and provides insights into the appropriate design of LLMs for this task. Our data came from 5 teams participating in a 45-day mission at the US National Aeronautics and Space Administration’s (NASA) Human Exploration Research Analog (HERA). More specifically we used data collected from team interaction battery (TIB) tasks teams performed five times in-mission which comprise an average 1.5 hours of conversation data per day. Micro-behaviors were coded according to an adapted version of Smith & Griffins (2022) theoretical framework in terms of Violation (i.e., presence of valenced behavior, uplifting/positive or discouraging/negative), Intensity (i.e., force of behavior in terms of how uplifting or discouraging is the behavior), and Intent (i.e., motive of the behavior in terms of whether it was deliberate or unintentional). We explore the ability of LLMs to detect the presence and intensity of micro-behaviors. We examine employing and fine-tuning readily available LLMs (i.e., RoBERTa, DistilBERT), as well as prompting state-of-the-art sequence classification models (i.e., Llama-2, Llama-3). In a total of 13,058 conversational turns (17.8% uplifting, 3.3% discouraging, 75.76% neutral, 3.14% nulls), we compute the macro F1-score of the 3-way micro-behavior classification task (i.e., classifying among uplifting, discouraging, and neutral; 33% chance). Results indicate that the RoBERTa model achieves a F1-score of 36.2% (uplift: 43.3% precision (P), 15.1% recall (R); discourage: 20% P, 0.5% R). These results significantly improve when we augment the data via paraphrasing in the RoBERTa model, reaching a 41.2% macro F1-score (uplift: 37.7% P, 86.3% R; discourage: 3.5% P, 1.8% R). Finally, the Llama-2 model with 3-shot prompting yields 38% macro F1-score (uplift: 28.7% P, 20% R; discourage: 7.2% P, 18% R), which is slightly better compared to the RoBERTa model without data augmentation, highlighting the effectiveness of sequence classification models in detecting minority classes with a small sample size. Findings indicate that LLMs hold potential to detect subtle behaviors in conversations, which could be valuable in assessing team behavior in space exploration missions. Future studies will evaluate the performance of different LLM prompting strategies or fine-tuning methods.

Ankush Raut

Communication Delays in Cislunar Space: A Lab Study Examining Human System Integration Architecture (HSIA) and Team Risk Concerns

BACKGROUND: Communication delays are an inherent challenge of space missions to the Moon and beyond. Past research studies showed that 50+ second delays adversely affected individual well-being, team cohesion, and overall task performance (Kintz et al., 2016; Larson et al., 2019). However, there is a dearth of research on the effects of shorter delays (on the order of 4-12 seconds one-way) that may present a more immediate challenge during the upcoming Artemis missions. Even these shorter delays could make it difficult or infeasible for ground control to provide real-time support to Artemis astronauts, especially in complex and time-critical tasks such as extra-vehicular activities (EVAs). Results from studies on longer or Mars-like delays cannot be directly applied to Artemis-like delays, due to the large differences in delay magnitude and task types between these mission categories. For example, real-time oversight and guidance from ground control is impossible under Mars-like delays but may be performed under Artemis-like delays, albeit with potentially high workload and communication difficulty. Thus, a better understanding of the effects of Artemis-like communication delays on collaborative task performance is needed. Additionally, there is a need to develop reliable task paradigms that can be used in future studies on communication delays. METHODS: This project will study the effects of Artemis-like communication delays on collaborative task performance in a simulated space-to-ground team task via a lunar Gateway-like interface prototype. Teams of two astronaut-like participants - one serving as “crewmember” and one as “flight controller” - will perform a spaceflight-relevant task under six delay conditions (i.e., 0, 4, 6, 8, 10, and 12 seconds). Audio, video, texting, and file transfer will be delayed between the participants to mimic lunar-like communication delays. Measures related to workload, situation awareness, system usability, task performance, team cohesion, well-being, and communication strategies will be collected. These measures will be compared across delay levels, participant roles, and off-nominal and nominal tasks. Participants will be given the choice to use any combination of video and text communication in order to study preferences in interaction modality. RESEARCH AIMS: One aim is to identify a delay level or range of levels at which there may be significant decrements in individual and team-based measures. Identifying such ranges may help design novel workload management or communication countermeasures for future space missions. Also, the spaceflight-relevant research tasks and corresponding communication delay technology developed as part of this effort may be used for future studies on communication delays. Results from this work are also expected to inform study scenarios in the Human Exploration Research Analog (HERA) Campaign.

S Upasani

Using a Crew Resource Management Framework to Develop Human-Autonomy Teaming Measures

Recent developments in technology have permitted an increased use of autonomy. To work best with humans, autonomy should have the qualities of a good team member. But how can these qualities be measured? One way is to use similar measures to those used to measure good teams with human members. For example, the Non-Technical Skills (NOTECHS) framework measures Crew Resource Management (CRM) skills that allow pilots to work together as a team. The framework consists of skill categories, elements of those categories, and behavioral markers that demonstrate good or poor performance in the elements. This paper introduces CMSD (CooperationManagementSituation AwarenessDecision Making), a measurement system based on NOTECHS and other widely-used skill level systems, which provides quantitative measures of Human-Autonomy Teaming (HAT).

Crew Resource Manaagement

Measuring the Effectiveness of Human Autonomy Teaming

Human-Automation Teaming (HAT), is now recognized as a promising solution to the problems of humans managing increasingly complex work systems. A human-automation team can be defined as the interdependent coupling between one or more human operators and one or more autonomous systems requiring collaboration and coordination to accomplish system and task goals (e.g., Langan-Fox et al., 2009). In this conception, automated agents are considered team members that can operate at various levels of automation, be focused on one or more human-information-processing stages, and the interactions with human operators may be adaptable, adjustable or mixed initiative. We investigated some metrics for assessing HAT effectiveness in a demonstration of a HAT tool used by ground station operators in a Reduced Crew Operations project that was conducted at NASA Ames Human Automation Teaming Laboratory. In this paper, we focus on operator metrics of HAT effectiveness, specifically workload and operator behaviors.

measurements

A status of the activities of the NASA/MSFC pump stage technology team

The Consortium for Computational Fluid Dynamics (CFD) Application in Propulsion Technology was established to aid the transfer of CFD related advancements among academia, government agencies, and industry. The specific goals of the Consortium are to develop CFD methodologies necessary to solve propulsion problems, to validate these methodologies, and to apply these methodologies in the design process. To accomplish these goals, a team of experts in various related fields was formed, a schedule of activities necessary to meet the goals was generated, and funding for the activities was obtained from NASA. During the past year (Mar. 1991 - Mar. 1992) the team's activities have focused on preliminary code validation and on the design of an advanced impeller. Six codes were used to calculate the flow in a Rocketdyne 0.3 flow coefficient inducer, and the results were compared to L2F data available for the inducer. This activity identified shortcomings in the experimental data sets and in the analytical solutions which must be surmounted in any future team activity. The design of the advanced impeller relied heavily on CFD results to obtain an optimized geometry. The optimized geometry was analyzed using four different codes, at design and off-design conditions. Activities for the next year include the optimization of a tandem blade impeller design, benchmark of CFD codes for diffuser and volute flows, the collection of L2F data for 'state-of-the-art' impeller and inducer, and the verification of the advanced pump team impeller design in a water rig.

Garcia, R.

Magellan spacecraft team remote mission operations - Experience and application to future operations systems

The Magellan Venus radar mapping mission was NASA's first planetary launch in 11 years, heralding a successful return to unmanned planetary exploration. This paper first describes the spacecraft, its mission, and its Mission Operations System, including the remotely located spacecraft team. It then discusses how the flight team achieved mission success, in spite of the obstacles imposed by challenges from the spacecraft and its environment, which had to be resolved with the spacecraft team nearly 1000 miles distant from the rest of the flight team. Benefits of remotely distributed spacecraft operations are summarized and suggestions offered, based on Magellan experience, for future mission operations systems considering the use of distributed elements.

Ledbetter, Kenneth W.

Activities of the NASA/Marshall Space Flight Center pump stage technology team

In order to advance rocket propulsion technology, the Consortium for Computational Fluid Dynamics (CFD) Application in Propulsion Technology has been formed at Marshall Space Flight Center (MSFC). The Consortium consists of three Teams: the turbine stage team, the pump stage team (PST), and the combustion devices team. The PST has formulated and is implementing a plan for pump technology development whose end product will be validated CFD codes suitable for application to pump components, test data suitable for validating CFD codes, and advanced pump components optimized using CFD codes. The PST's work during the fall of 1991 and the winter and spring of 1992 is discussed in this paper. This work is highlighted by CFD analyses of an advanced impeller design and collection of laser two-focus velocimeter data for the Space Shuttle Main Engine High Pressure Fuel Pump impeller.

Garcia, R.

Combustion devices technology team - An overview and status of STME-related activities

The Consortium for CFD applications in propulsion technology has been formed at NASA/Marshall Space Flight Center. The combustion devices technology team is one of the three teams that constitute the Consortium. While generally aiming to advance combustion devices technology for rocket propulsion, the team's efforts for the last 1 and 1/2 years have been focused on issues relating to the Space Transportation Main Engine (STME) nozzle. The nozzle design uses hydrogen-rich turbine exhaust to cool the wall in a film/dump scheme. This method of cooling presents challenges and associated risks for the nozzle designers and the engine/vehicle integrators. Within the nozzle itself, a key concern is the ability to effectively and efficiently film cool the wall. From the National Launch System vehicle base standpoint, there are concerns with dumping combustible gases at the nozzle exit and their potential adverse effects on the base thermal environment. The Combustion Team has developed and is implementing plans to use validated CFD tools to aid in risk mitigation for both areas.

Tucker, P. K.

Kennedy Space Center's NASA/Contractor Team-Centered Total Quality Management Seminar: Results, methods, and lessons learned

It is apparent to everyone associated with the Nation's aeronautics and space programs that the challenge of continuous improvement can be reasonably addressed only if NASA and its contractors act together in a fully integrated and cooperative manner that transcends the traditional boundaries of proprietary interest. It is, however, one thing to assent to the need for such integration and cooperation; it is quite another thing to undertake the hard tasks of turning such a need into action. Whatever else total quality management is, it is fundamentally a team-centered and team-driven process of continuous improvement. The introduction of total quality management at KSC, therefore, has given the Center a special opportunity to translate the need for closer integration and cooperation among all its organizations into specific initiatives. One such initiative that NASA and its contractors have undertaken at KSC is a NASA/Contractor team-centered Total Quality Management Seminar. It is this seminar which is the subject of this paper. The specific purposes of this paper are to describe the following: Background, development, and evolution of Kennedy Space Center's Total Quality Management Seminar; Special characteristics of the seminar; Content of the seminar; Meaning and utility of a team-centered design for TQM training; Results of the seminar; Use that one KSC contractor, EG&G Florida, Inc. has made of the seminar in its Total Quality Management initiative; and Lessons learned.

Kinlaw, Dennis C.

A Modified NASA Team Sea Ice Algorithm for the Antarctic

A recent comparative study of the NASA Team and Bootstrap passive microwave sea ice algorithms revealed significantly different sea ice concentration retrievals in some parts of the Antarctic. The study identified potential reasons for the discrepancies including the influence of sea ice temperature variability on the Bootstrap retrievals and the influence of ice surface reflectivity on the horizontally polarized emissivity in the NASA Team retrievals. In this study, we present a modified version of the NASA Team algorithm which reduces the error associated with the use of horizontally polarized radiance data, while retaining the relative insensitivity to ice temperature variations provided by radiance ratios. By retaining the 19 GHz polarization as an independent variable, we also maintain a relatively large dynamic range in sea ice concentration. The modified algorithm utilizes the 19 GHz polarization (PR19) and both gradient ratios, GRV and GRH defined by (37V-19V)/(37V+19V) and (37H-19H)/(37H+19H), respectively, rather than just GRV used in the current NASA Team algorithm. A plot of GRV versus GRH shows that the preponderance of points lie along a quadratic curve, whereas those points affected by surface reflectivity anomalies deviate from this curve. This serves as a method of identifying the problems points. The 19H brightness temperature of these problem points is increased so they too fall along quadratic curve. Sea ice concentrations derived from AVHRR imagery illustrate the extent to which this method reduces the error associated with surface layering.

Cavalieri, Donald J.

Team Formation and Communication Restrictions in Collectives

A collective of agents often needs to maximize a "world utility" function which rates the performance of an entire system, while subject to communication restrictions among the agents. Such communication restrictions make it difficult for agents which try to pursue their own "private" utilities to take actions that also help optimize the world utility. Team formation presents a solution to this problem, where by joining other agents, an agent can significantly increase its knowledge about the environment and improve its chances of both optimizing its own utility and that its doing so will contribute to the world utility. In this article we show how utilities that have been previously shown to be effective in collectives can be modified to be more effective in domains with moderate communication restrictions resulting in performance improvements of up to 75%. Additionally we show that even severe communication constraints can be overcome by forming teams where each agent of a team shares the same utility, increasing performance an additional 25%. We show that utilities and team sizes can be manipulated to form the best compromise between how "aligned" an agent s utility is with the world utility and how easily an agent can learn that utility.

Agogino, Adrian K.