Search NASA⌕ Search

Engineering topics

Jessica J. Marquez

Publications and source records attributed to Jessica J. Marquez.

The Path to Crew Autonomy - Situational Awareness in Scheduling and Rescheduling Tasks for Novice Schedulers

To increase crew autonomy for long duration exploration-class missions (LDEM), certain mission support tasks need to be completed by crew. Currently, crew activities are scheduled over the course of several weeks by ground-based experts with years of experience-based training. These experts display extensive amounts of situational awareness (SA) throughout task execution by maintaining a mental model of additional factors during scheduling such as constraints (e.g. physical space/layout), abilities and skills of the crew, and crew preferences allowing them to anticipate and mitigate potential issues. Thus, situational awareness is a key component for crews to manage their own schedules. In this paper, we examined situational awareness in novice schedulers in both a scheduling and rescheduling task. Our findings indicate that there is no significant difference between scheduling and rescheduling tasks for the development of SA in novice schedulers. Additionally, our experiment shows that novice schedulers are less able to develop sufficient SA for constraints that are dependent on one or more activities. Thus, we propose that software aids may be useful to support novice schedulers and increase SA in scheduling/rescheduling tasks. This work is vital to ensure the successful transfer of mission support tasks to the crew for future LDEM.

situation awareness↗

Towards a Characterization of Scheduling Task Complexity

Future long-duration missions will require astronauts to act more autonomously, manage their schedules, and replan timelines as anomalies and discoveries occur. Astronauts are not professional planners, however, and the complexity of schedules that novice planners can complete successfully is not fully understood. To identify the primary factors which contribute to scheduling task complexity, we conducted a human-in-the-loop study and developed planning algorithms to investigate how the type and amount of constraints affect the difficulty of scheduling and rescheduling. We created rankings of difficulty using a combination of human performance metrics from experimental planning tasks and metrics describing the final plans that participants scheduled. Using the results of our scheduling and rescheduling algorithm algorithms, we created a similar ranking with which to compare. We created rankings which compared well between the experimental and algorithm results for the scheduling task, but the rescheduling task proved more difficult to estimate.

scheduling↗

Promoting Astronaut Autonomy in Human Spaceflight Missions

Mission operations will have to adapt for long duration, long distance human spaceflight missions. This change is driven mainly by the significantly different communication availability between Earth and space. As astronauts travel farther from Earth, the one-way communication latency increases; the amount of bandwidth will be limited; and there will be period of long and/or no communication. Currently, ground flight controllers collaborate and cooperate with astronauts in space to accomplish essential operational functions. Astronaut autonomy, i.e., the crew’s ability to work more independently from mission control, will be a key enabler in future exploration missions. Over the last several years, the NASA Ames Human-Computer Interaction (HCI) Group has investigated various ways to promote and support astronaut autonomy in human spaceflight missions. Software prototypes are researched, designed, implemented, and assessed for their ability to enable astronaut autonomy. From integrated Internet of Thing for Space, advanced procedures interfaces, comm-delayed chats, and self-scheduling tools, the HCI Group has explored different aspects of astronaut autonomy. Specifically, the self-scheduling tool Playbook has been evaluated in analog extreme environments and onboard the International Space Station, successfully paving the way for future autonomous astronauts.

crew autonomy↗

Promoting Crew Autonomy in a Human Spaceflight Earth Analog Mission through Self-Scheduling

Deep space exploration missions face the challenge of communication transmission latencies between ground stations and astronaut crews due to increasing distance between the Earth and spacecraft in transit. To address this, research at NASA has aimed toward supporting crew autonomy by enabling astronauts to schedule their own timelines with minimal oversight from Mission Control. While self-scheduling has been shown to be feasible, it is yet to be studied as an integral part of autonomous crew operations. The current paper reviews the operationalization of self-scheduling and a number of related objectives during Campaign 6 of HERA, a Human Exploration Research Analog. Research objectives include studying the effects of phasic autonomy over the course of a 45-day mission, evaluating differences in scheduling performance produced by software interface aids, and deploying a novel measure of crew attitudes toward self-scheduling and plan execution.

crew autonomy↗

Promoting Crew Autonomy in a Human Spaceflight Earth Analog Mission through Self-Scheduling

Deep space exploration missions face the challenge of communication transmission latencies between ground stations and astronaut crews due to increasing distance between the Earth and spacecraft in transit. To address this, research at NASA has aimed toward supporting crew autonomy by enabling astronauts to schedule their own timelines with minimal oversight from Mission Control. While self-scheduling has been shown to be feasible, it is yet to be studied as an integral part of autonomous crew operations. The current paper reviews the operationalization of self-scheduling and a number of related objectives during Campaign 6 of HERA, a Human Exploration Research Analog. Research objectives include studying the effects of phasic autonomy over the course of a 45-day mission, evaluating differences in scheduling performance produced by software interface aids, and deploying a novel measure of crew attitudes toward self-scheduling and plan execution.

crew autonomy↗

Exploring Self-Scheduling Strategies and Heuristics in Novice Schedulers

Missions beyond low Earth orbit will require crews to act with greater autonomy. Increasing communication delays will require crews to take on tasks currently supported by Mission Control, including the involved process of scheduling and rescheduling their own complex spaceflight timelines to fit a variety of restrictions and constraints. Astronauts, unlike Mission Control, are not expert planners, however, and determining simple strategies and heuristics that enable them to schedule successfully can increase the range of problems they can solve successfully. In two human-in-the-loop scheduling experiments, we analyzed 1) common strategies among novice schedules, and 2) the development of self-scheduling heuristics. We find that, even when participants are instructed to follow a given strategy, they rapidly develop their own self-scheduling heuristics as they learn to successfully complete the scheduling task. Participants conducting naturally learn to schedule activities with the most constraints first, while participants vary in heuristics in the rescheduling task.

self-scheduling↗

Exploring Self-Scheduling Strategies and Heuristics in Novice Schedulers

Missions beyond low Earth orbit will require crews to act with greater autonomy. Increasing communication delays will require crews to take on tasks currently supported by Mission Control, including the involved process of scheduling and rescheduling their own complex spaceflight timelines to fit a variety of restrictions and constraints. Unlike Mission Control, astronauts are not expert planners, and determining strategies and heuristics that enable crews to schedule successfully may increase the range of problems they can solve. In two human-in-the-loop scheduling experiments, we analyzed 1) common strategies among novice schedulers and 2) the development of self-scheduling heuristics. We find that, even when participants are instructed to follow a given strategy, they rapidly develop their own self-scheduling heuristics as they learn to successfully complete the scheduling task. While scheduling, participants naturally learn to arrange activities with the most constraints first, whereas while rescheduling, they display greater variability in their heuristics.

self-scheduling↗

The Role of Trust and Usability in Enabling Spaceflight Crew Autonomy

Future long duration exploration missions will require an increased use of onboard automated systems as spaceflight crews venture further than before and have longer communications delays with ground support. The design of these systems must support appropriate crew trust and have sufficient usability to enable spaceflight crew autonomy or risk being misused while crews wait to communicate with ground support. We evaluated trust & usability in our self-scheduling tool, Playbook, for crew mission timelines. Data was collected in a controlled lab experiment with 31 participants. Participants in the study conducted two tasks: scheduling, where participants were responsible for scheduling a majority of a day's operational tasks, and rescheduling, where participants were provided a schedule and asked to reschedule higher priority activities. We found a significant correlation between system trust and usability, irrespective of self-scheduling tasks. We conclude that system usability may play a bigger role in how trust is learned while conducting novel crew autonomy tasks such as self-scheduling. Future research should investigate the role of usability to encourage appropriate trust in onboard automated crew systems and enable crew autonomy.

crew autonomy↗

Identification of Risks to Eva Created By Ambient Lighting Conditions at the Lunar South Pole

In the coming years, NASA’s Artemis Campaign intends to return humans to the Moon, both to explore and to establish a permanent human presence. The targeted landing and habitation sites are near the Lunar South Pole (LSP). Compared to the middle latitudes where the Apollo landings occurred, the sun at the LSP is consistently low in the sky, creating a much more challenging visual experience. The NASA Engineering & Safety Center (NESC) is working to characterize the extremes in ambient illumination that astronauts will encounter at the LSP, and to help programs characterize the lighting systems and glare protection that will be required to conduct safe surface operations. This paper will describe the LSP natural environments, and efforts to simulate that visual experience. It will also explain the risks derived from the lighting environment for the mission goals currently planned, and the kinds of new capabilities both in simulation techniques and in surface equipment that will be required to support those mission goals.

Identification of Risks↗

Inferring Collaboration Strategies and Usability from Remote Observations in a Spaceflight Analog Environment

Collecting usability and user evaluations of novel software in spaceflight analog missions is challenging. For one such analog mission, we collected audio recordings of crew members as they completed their assigned self-scheduling task using novel software. Conversation analysis provided insight about collaborative nature of task and potential new evaluation measures.

human computer interaction↗

Facilitating Crew-Computer Collaboration During Mixed-Initiative Space Mission Planning

As NASA looks toward longer duration missions, there will inevitably be a stronger emphasis on crew autonomy, particularly in the domains of mission planning. Ensuring that astronauts, while subject to lengthy periods of communication delay with Earth-based mission support personnel, are able to independently adapt their schedules to rapidly changing environments is a critical aspect of deep-space exploration. This task will likely require the assistance of computer support systems, as the task of mission planning is complex and currently requires dedicated console operators. A mixed-initiative approach can help alleviate some of the more workload-heavy aspects of planning by offloading the intricate task of constraint management to a computer, while still allowing the crew member to maintain overall control of the plan. Playbook is a mission planning tool that has been developed specifically to support this type of mixed-initiative scheduling. This paper examines: 1) the operational evidence of the challenges and viability of autonomous crew planning, and 2) the novel scheduling capabilities in Playbook that are meant to address those findings.

human-computer interaction↗

What is the Role of Usability and Trust in Autonomy?

Usability encompasses learnability, efficiency, memorability, effectiveness, and satisfaction. NASA’s standards for usability acceptance criteria focus on interfaces that help operators achieve their tasks efficiently, effectively, and with satisfaction. However, discussions on usability, especially regarding future highly automated and autonomous systems, rarely include trust. As NASA plans for long-duration exploration missions, it envisions astronauts operating more independently from Mission Control on Earth. This independence will drive the development of these highly automated and autonomous systems that astronauts will use daily. To prepare for this future, our team has developed a scheduling and execution software tool that facilitates self-scheduling, allowing astronauts to independently manage their own schedule without Mission Control’s involvement. Over many years, we have developed, matured, and evaluated our software tool in extreme environments, prioritizing user-centered design and high usability. These evaluations have included multiple campaigns in NASA analogs, including NEEMO, BASALT, and HERA, as well as technology demonstrations onboard the International Space Station. Our recent research on software interfaces for future astronaut autonomy revealed a strong correlation between usability and trust measures. In a controlled lab experiment, we asked novice users to perform a complex scheduling task, during which the software immediately validated the schedule’s constraints and checked for violations. We collected usability (User Experience Questionnaire, UEQ) and trust (Trust in Automated Systems scale, TAS) measures; significant, strong, and moderate correlations emerged between several of the UEQ metrics and TAS. These results support the argument for investing in usability early to enable and sustain trust in highly automated and autonomous systems.

usability↗