Search NASA⌕ Search

Engineering topics

J C W Miller

Publications and source records attributed to J C W Miller.

Measuring Unique Contextual Factors: Group Living Skills

BACKGROUND The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures used to assess behavioral health and performance risks related to future exploration-class space missions. During the HFBP-EM suite development, the importance of assessing unique contextual factors to understand the drivers of team dynamics was identified. Group living skills are a unique workplace skill which applies to those coworkers who live and work together. As mission lengths become longer, the line between work and non-work life may blur. Extreme living conditions such as spaceflight can result in increased stress over time, negatively impact mood and well-being, decrease team cohesion and increase conflict, deteriorate task performance, and potentially reduce mission success [1]. With no breaks in their isolated and confined environment possible, living with a messy, inconsiderate crewmember can add to the stress. Alternatively, crews with good group living skills may support one another, mitigating the negative effects of the extreme environment. There was no direct measure of group living skills. This work sought to fill this measurement gap and collect data related to group living in isolated, confined, extreme (ICE) environments. METHODS Group living skills as an astronaut competency area were developed with the input of experts familiar with ICE environments. Distinct aspects of this competency were reviewed and discussed by a NASA-invited group of spaceflight experts in 2015 to identify individual and team behavioral health and performance measures for operational environments. This work resulted in a 5-item measure focused on group living experiences with each crewmember (or the crew as a whole). A 6th item asks whether an individual would go on another mission with a particular crewmember or crew as a measure of future-oriented group living, or team viability. The measure was deployed in 24 teams living and working together in isolated and confined environments (e.g., International Space Station, space mission simulation analogs). RESULTS & DISCUSSION In this presentation, we will summarize results which indicate the Group Living Skills (GLS) Survey is a reliable, valid, and operationally feasible measure. Reliability was evaluated in several ways. Two-way multilevel mixed models revealed strong repeated measures reliability (ICC2 = .902, Omega between = .954). Reliability of change within teams was strong (Rc = .81). Factor analysis showed a consistent two-factor structure when individuals rated either the whole crew, all individuals, just peers, or a focal roommate. The latter used a sociometric approach to rating the GLS of the roommates. The two factors were tidiness and being considerate of others. We assessed the criterion-related validity of GLS, by examining GLS operationalized as the team-level aggregated GLS Survey scores as a predictor of team viability, team cohesion, and team performance. We used generalized mixed models to account for the repeated measures and longitudinal data. The marginal R2 change was used to determine the extent to which GLS were related to the team outcomes while controlling for mission day and campaign. Results suggested GLS was strongly related to team viability (marginal R2 change = .40), team cohesion (marginal R2 change = 0.28), social cohesion (marginal R2 change = 0.25), and moderately related to task cohesion (marginal R2 change = 0.18). GLS scores had a small relationship with team performance (marginal R2 change = .08). Results support GLS as a measure that can be used to capture group living skills of crews who live and work together in ICE. Because the items were written to be broadly applicable, less extreme environments with teams living and working together for some length of time also benefit from this measure (e.g., college roommates, camps). See Landon et al. (2024) for full results [2]. SUMMARY We report reliability and validity evidence for a new measure that assesses the Group Living Skills for teams that live and work in operational environments such as spaceflight.

J C W Miller↗

Habitability and Human Factors Assessment (iSHORT, SHAQ, and SHU)

BACKGROUND As long-duration off-planet habitats become a reality, a consideration of habitability and human factors (HF) is crucial. The habitat is more than just a place to live and work. It is also the crew’s perception of the space, and the psychological impacts of size, layout, and usage over time; all of which can support or strain behavioral health and performance (BHP). A previous International Space Station (ISS) habitability study used the iSHORT (Space Habitability Observation Reporting Tool) to collect detailed data about habitability and human factors and inform NASA Standards. Of the previous iSHORT study, only one of the six ISS subjects had a duration of one year; all other ISS and ground analog subjects had shorter mission durations from one week to six months. It is necessary to collect new data with a focus on long-duration exploration missions of > 6 months and on planetary surface habitat design. New data is also needed to compare the iSHORT to other habitability measures. One measure, the SHAQ (Subjective Habitability and Acceptability Questionnaire), assesses the intersection of psychology and habitability. Another complementary measure, the Scale for Habitat Usability (SHU), is a brief subjective scale that captures how habitat design impacts perceived usability of the built environment in relation to task performance. OBJECTIVE Our study aims to (1) understand how individual well-being and team dynamics may relate to HF concerns over time, (2) capture how habitability and HF change over time, (3) compare the three habitability measures (iSHORT, SHAQ, SHU), (4) assess habitats to capture HF design concerns and related BHP impacts of a planetary habitat, and (5) inform future standards for HF design. METHOD Data are being collected on crews living and working in long-duration spaceflight analogs. Individual-level data collections are repeated at regular intervals throughout the missions on several habitat areas, activities, and key equipment (i.e., points of interest). These points of interest (POIs) include the kitchen/galley, crew quarters, and other work and living areas. Assessments include evaluations of privacy, comfort, convenience, control, efficiency, and social density through the lens of subsequent outcomes like sleep, individual performance, group activities performance, stress, mood, and social interactions. Pre- and post-mission evaluations will also allow comparison with homes, pre- and post-mission hotels, and a retrospective reflection of living and working in a long-duration analog. INITIAL DATA COLLECTIONS In this poster, we will describe the measures and data yield. Since the research protocol was designed, the study team has collected iSHORT Standalone four times, nine collections of SHAQ, and three collections of iSHORT with SHAQ. Data collection is ongoing. SUMMARY A novel assessment suite has been developed to further aid the comparison and complementary understanding of the habitability and human factors measures, which will allow for efficient deployment of these measures in analogs and/or spaceflight in near-term research as well as support well-being and performance through design.

J C W Miller↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, and ISS: Teams Risk

BACKGROUNDThe Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analogs (HERA) campaigns 4 (C4) and 5 (C5), and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogsof the spaceflight environment. A subset of the HFBP-EM suite was collected during spaceflight as part HRP’s Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are kept the same across studies, however, differences across research settings (e.g., experimental manipulations, mission scenarios, mission length) and implementation of the measures require the data are harmonized to ensure comparable views across missions. The purpose of our project is to develop a harmonized database of HFBP-EM data from different settings, and to summarize the trajectory of behavioral health and performance within and between research settings. In this presentation, we will summarize the harmonized dataset and the trajectory of measures related to the Team Risk, including team performance, team cohesion, team processes, and psychological safety, over time and between and within settings.METHODSWe followed best practices for data harmonization. Characteristics of each research setting were assessed for harmonization potential, and we deemed NEK-SIRIUS 17 as inappropriate due to study aims, length, and data quality. Common variables of interest were identified. Study characteristics and key variables with which datafiles could be merged were defined as “meta-data.” HFBP-EM data from all settings were processed under a common format. We then created a harmonized team-level database designed to facilitate analyses that address HRP research gaps related to HRP’s Team risk. In this database, team cohesion, processes, performance, psychological safety, and group living were operationalized as the team mean of the crew responses for each data collection (e.g., on mission day 7). Data collected on the International Space Station (ISS) included a subset of scale items administered to participants. Data collected from ISS team members within +/- 7 days of the first data collection and every following 30 +/-4 days were aggregated to the team level. We generated figures that display the mean and variability of team constructs across research settings. We also generated plots of changes in team constructs with mission day and with percentage of the mission completed. Where possible, we compared data from spaceflight analogs with data from astronauts aboard the ISS. RESULTS AND DISCUSSIONThe team-level harmonized database was structured such that each row represents data for a team on a specific mission day. Team constructs (e.g., team cohesion) were included as columns (i.e., wide format) with repeated measures across mission days given in rows (i.e., long format). The database included data from 18 crews: five, 4-person American crews in HERA C4, four 4-person American crews in HERA C5, one 6-person multinational crew in NEK-SIRIUS 19, and eight, 2–11-person multinational crews aboard the ISS. Results provide insights into mission and campaign differences in team functioning and performance. For example, between campaign differences were observed for team processes—the interdependent team actions that orchestrate taskwork in pursuit of the team’s goals [1]. Greater between-team variability on team processes was detected during HERA C4 than during C5, and a downward trend was observed over the duration of C4, but not C5 or SIRIUS 19. This may be due to the campaign-level differences such as the sleep deprivation implemented during C4. Responses on the subset of team process items administered on the ISS indicate between-crew variability more like those observed in C4 than C5 and NEK, with some, but not all ISS crews demonstrating a downward trend over time. Additional findings will be presented. REFERENCESMarks, M. A., et al (2001) Academy of Management Review, 26(3), 356-376.

S T Bell↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, and ISS Teams Risk

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analogs (HERA) campaigns 4 (C4) and 5 (C5), and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogs of the spaceflight environment. A subset of the HFBP-EM suite was collected during spaceflight as part HRP’s Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are kept the same across studies, however, differences across research settings (e.g., experimental manipulations, mission scenarios, mission length) and implementation of the measures require the data are harmonized to ensure comparable views across missions. The purpose of our project is to develop a harmonized database of HFBP-EM data from different settings, and to summarize the trajectory of behavioral health and performance within and between research settings. In this presentation, we will summarize the harmonized dataset and the trajectory of measures related to the Team Risk, including team performance, team cohesion, team processes, and psychological safety, over time and between and within settings.

S T Bell↗

Development and Initial Validation of HFBP-EM Short-Form Surveys

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite includes self-report surveys designed to assess Behavioral Medicine (BMed) and Team risks for future exploration class missions. Survey data was collected during the Human Exploration Research Analog (HERA) Campaign 4 (C4), HERA Campaign 5 (C5), and during SIRIUS19 missions in the Russian Ground Based Experiment Complex, NEK. Crew time in spaceflight analogs and in spaceflight is typically limited. Extensive self-report surveys can be a significant burden to participants and are not operationally acceptable for spaceflight. The purpose of this project was to comprehensively assess the reliability and validity of the standard-length HFBP-EM surveys, identify acceptable short forms to administer during HERA C6, examine initial validation evidence for the proposed short form measures, and identify key measurement gaps in HFBP-EM coverage. In this presentation, we will report reliability and validity metrics of standard form data, describe the proposed new short forms, and present initial psychometric analyses supporting the use of these short forms.

S T Bell↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, And ISS: Behavioral Medicine Risk

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures used to assess behavioral health and performance risks related to future exploration class space missions. The HFBP-EM addresses the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analog (HERA) campaigns 4 and 5, and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogs of spaceflight environments. A subset of the HFBP-EM suite was collected in spaceflight as part of the HRP Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are the same across studies, differences across research settings (e.g., experimental manipulations, mission scenarios, and mission length) and implementation of the measures require that the data are harmonized to ensure comparable views across missions. The purpose of our project was to develop a harmonized database of analyzable HFBP-EM data from spaceflight and analog settings, and to summarize the trajectory of behavioral health and performance outcomes within and between mission settings. In this presentation, we will summarize the harmonized dataset and the trajectory of BMed related measures including depression, neurobehavioral function, mood, cognition, and operationally relevant individual performance over time and by campaign and mission.

S T Bell↗

HUMAN FACTORS AND BEHAVIORAL PERFORMANCE EXPLORATION MEASURES: ASSESSING ASTRONAUT RISK

INTRODUCTION: The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture (HSIA) risks. This presentation will provide an overview of the HFBP-EM program, describe its implementation across spaceflight analogs and the international space station (ISS), and discuss its applicability to audience members. TOPIC: HFBP-EM is a research program designed to develop a standard set of measures that can be used in space and space-analog research to characterize BMed, Team, Sleep, and HSIA risks. It is an ongoing research project that is used examine the validity and reliability of HFBP measures, as well as their shorter forms. It also serves as a test bed for HFBP measures being considered for the spaceflight standard measures. The suite of measures is used to test the efficacy of countermeasures. To date, HFBP-EM has been collected in Human Exploration Research Analogs campaigns 4 and 5, and the SIRIUS 19 mission in the Russian Ground Based Experiment Complex. A subset of the HFBP-EM suite was collected during spaceflight as part of HRP’s Standard Measures in Spaceflight Project. Data was collected from a total of 55 multinational astronaut and astronaut-like crewmembers (mean age: 39.5, SD = 7.6; 31% female; 91% with advanced degrees). Three broad categories of HFBP-EM measures and their relevance to HRP risks will be discussed: 1) surveys that assess team functioning (Teams risk) as well as mood and affect (Bmed risk), 2) performance-based tasks of cognitive functioning and operationally relevant performance (Bmed risk), and 3) physiological biomarkers of sleep (sleep risk) and heart rate (Bmed risk). We will provide an overview of the background of the HFBP-EM program, what the suite currently includes, and next steps in its future development. We will also discuss the application to aerospace practitioners and researchers. APPLICATION: Astronaut teams selected for future space exploration missions will face several challenges that pose significant yet still unknown risks to the behavioral health and performance of astronauts. The HFBP-EM suite provides a comprehensive assessment of behavioral health and performance in space analog and spaceflight settings. This suite can be applied to both operational and research settings to advance risk reduction research for long duration space exploration missions.

S T Bell↗

The Impact of Mood and Affect on Operationally Relevant Performance Among Astronaut-Like Individuals in Space Analog Settings

Crewmembers of future space exploration missions will face many challenges associated with living and working in extreme conditions for prolonged periods of time. Thus, it is imperative to understand how spaceflight hazards impact mood and affect, cognitive functioning, and ultimately, operational performance. The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures used to assess behavioral health and performance related to future exploration class space missions. HFBP-EM includes the Profile of Mood States (POMS) as a self-report measure of psychological distress, and the Robotic On-Board Trainer (ROBoT) as an operationally relevant task that simulates the capture and grappling maneuvers required to operate the Canadarm2 on the International Space Station. Although previous space analog studies have demonstrated fluctuations in mood and affect ratings assessed by the POMS (Basner, 2014), no studies to date have examined impacts on operationally relevant tasks. Here we investigate the relationship between POMS ratings and performance on the ROBoT task in space analog settings.

S I Dev↗

Results for the Subjective Habitability Acceptability Questionnaire From HERA C5 and C6

BACKGROUND The impact of habitability on psychological and performance outcomes is recognized as an important factor in habitat and vehicle design—especially as missions increase in length. Formal evaluation of habitability’s impact is possible using the Spaceflight Habitability Acceptability Questionnaire (SHAQ), which was psychometrically validated by Roma et al. in 2022 [1]. The SHAQ survey systematically quantifies the relationships between habitat areas (e.g., bedroom, kitchen, hygiene area, office, etc.) and behavioral health and performance (BHP) outcomes (i.e., individual and team performance, mood, stress, sleep, social interaction), and considers the moderating effects of key habitability aspects (i.e., privacy, control, convenience, efficiency, comfort, social density) on that relationship. METHOD Respondents were HERA participants from Campaign 5 and 6 (n = 32). Data from three environments were used in our SHAQ analyses: SHAQ in HERA (in-mission), SHAQ at Home (pre-mission), and SHAQ in Hotel (pre- and post-mission for C6, just pre-mission for C5). For each habitat area, respondents are asked how that area layout impacts six BHP outcomes on a 201-point visual analog scale with the anchors: impairs, has no effect, and facilitates. They also had the option to respond “Not Applicable”. Follow up questions asked why six key habitability aspects (e.g., privacy) influenced the way the habitat area affected a given outcome. Participants indicated whether a habitat area’s habitability aspects were inadequate (low score) to adequate (midpoint) to ideal (high score), using a 201-point visual analog scale as well but were binned to a 7-point scale for analyses. RESULTS AND CONCLUSION When comparing across environments, ratings of BHP outcomes were worse in HERA compared to home and pre-mission hotel, but rebounded for the post-mission hotel such that post-mission hotel rating were often higher than all previous ratings. Within HERA, ratings of how a habitat area impacted an outcome skewed towards facilitation with communal areas (i.e., galley and office) rated most facilitating. The follow up questions about why six key aspects related to habitability moderated outcomes indicated that most habitat areas were rated as having “adequate” habitability characteristics. Privacy was the only moderator with average scores below adequate for all habitat areas. The office had the most moderators scoring above adequate for all habitat areas. Ratings indicated small to moderate effects of layouts on BHP outcomes: with facilitating layouts averaging between 4 and 5, and impairing layouts averaging between 2 and 4. The sleeping module layout facilitated sleep, with ratings indicating adequate comfort but inadequate privacy. The galley layout facilitated social interaction and mood, with ratings indicating adequate efficiency and convenience. The office layout facilitated social interaction, team and individual performance, with ratings similarly indicating adequate efficiency and convenience. The hygiene module worsened individual performance, mood and stress, with ratings indicating less than adequate privacy and social density. Our findings suggest there is value in having dedicated team and individual spaces. REFERENCES [1] Roma, P. G., Landon, L.B., Spencer, C. A., Whitmire, A. M., & Williams, T. J. (2022). SHAQ: Development and Validation. Human Factors: Special Issue on Spaceflight, 65(6), 1074-1104. ACKNOWLEDGEMENTS This project was funded by the NASA Human Research Program directed task Human Factors and Behavioral Performance in HERA (PI = S. Bell) to the BHP Lab. KBR Inc. and JES Tech authors were supported by KBR’s Human Health and Performance Contract NNJ15HK11B with NASA.

behavioral health↗