Search NASASearch

SEARCH · Search NASA

Results for “Playbook”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users

Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.

in-flight monitoring

Playbook for UAS: UX of Goal-Oriented Planning & Execution

We are evaluating Playbook for CASAS (Connected Autonomous Smart Aerospace Systems), a tool designed to aid first responders in disaster relief efforts. We are adapting an existing tool, Playbook, to support a future unmanned aircraft system (UAS) swarm demonstration. Playbook for CASAS will be used to plan, edit, and monitor simulated UAS swarms, and we are interested in evaluating the user experience of this prototype as well as developing recommendations for future UAS interfaces. Allocation of roles and responsibilities between human-automation systems is key to promoting productive cooperation between users and automation. Future interfaces, however, must allow for adaptive management of the swarm not a constant split in human-automation control. Our early research indicates that when a single pilot is controlling swarms of robotic agents, such as UAS or ground rovers, operators require a higher level, goal-based interface with usability at its core. Along with that high-level control, users can leverage sensors within the swarm to be notified when lower level actions must be taken by the pilot. First responders working in disaster relief efforts require a high level of situational awareness (SA) and precise control at key moments within a mission. This balance in operator workload paired with SA can lead to improved safety and mission outcomes. Our research below outlines leverage points as well as the balance between human involvement and autonomy in UAS interfaces.

UAS

Playbook for UAS: UX of Goal-Oriented Planning & Execution

We are evaluating the tool Playbook, a mission planning and scheduling tool used for analog missions and research experiments at NASA. We are adapting Playbook to support an unmanned aerial vehicle (UAV) demonstration that will simulate a "search and recover" mission. To support this demonstration, we need to test this software and its usability with human subjects. Playbook will be used to plan, edit, and monitor simulated UAV swarms, and we are interested in evaluating these capabilities. Allocation of roles and responsibilities between human-automation systems is key to promoting productive cooperation between these two agents. When guiding swarms the user should not be concerned with moving waypoints, adjusting heading and altitude or any other small actions that traditional pilots control. Providing situational awareness through sensor data including radar, heat, live camera feed, and topographic information are key when managing multiple UAVs together. First responders need a good picture of disaster areas in order to make informed decisions. These sensors can initiate movements in the mission that indicate when the human should take control of single aircraft.

UAV swarms

Multi-Operator Multi-UAV (MOMU) Control: Exploring the Influence of Sensor Tools and Playbook Task Delegation

New concepts of operations for Unmanned Aerial Vehicles (UAVs) will require a change from the current 2:1 operator to vehicle crew configuration. One particular control paradigm, largely driven by logistics, manpower, and training burdens, as well as the desire to force multiply, involves a single operator simultaneously managing multiple UAVs. This mode of operations has shown to significantly increase cognitive workload and decrease situation awareness, as operators are required to simultaneously attend to multiple sources of information. One potential way to mitigate potential drawbacks of multi-vehicle control by a single operator is to migrate to a multi-operator multi-UAV (MOMU) crew configuration, whereby M operators control N (> M) vehicles. This type of crew configuration can be organized in several ways to dynamically manage cognitive workload, match operator qualifications and skills to mission requirements, increase utilization of available assets, and thereby achieve maximum force multiplication. The present experiment examined task performance in a simulated MOMU environment and evaluated the potential benefits of sensor management aids ("Tools") as well as integrated sensor and flight automation ("Plays") compared to a fully manual condition ("Manual"). Tools support the operator by facilitating rapid understanding and management of sensor information, while the Plays support the operator by offloading/automating subtasks. Six pairs of participants were recruited for this study and tasked with sharing a pool of UAVs in order to conduct reconnaissance, surveillance, and target acquisition (RSTA) missions in adjacent Areas of Operation (AOs). Participants were given four tasks to accomplish, in order of priority: 1) prosecute High Value Targets (HVTs); 2) identify / track targets (military vehicles); 3) identify / mark civilian vehicles; and 4) respond to chat messages. Performance on the mission tasks was measured in terms of accuracy and reaction time. A composite mission score was also calculated using a payoff matrix that weighted each task according to priority. The results indicate that Playbook demonstrated better performance overall with higher accuracy rates and the highest composite score compared to Tools and Manual. The implications of these results to supporting future MOMU concepts of operations is discussed.

Playbook

Overview of the Interagency Nuclear Safety Review Board Playbook

National Security Presidential Memorandum #20 (NSPM-20) directed the NASA Administrator to establish an Interagency Nuclear Safety Review Board (INSRB), replacing the ad hoc safety review panels used for space nuclear system launch reviews since the 1960s. NSPM-20 provides over-arching direction regarding the Board’s purpose and intent. Upon formation of this new entity, its members recognized that more detailed guidance was needed to ensure predictable and reliable performance of the Board’s functions. The Board drafted and later approved a guidance document referred to as “the Playbook” for this purpose. This paper will summarize the main features of this publicly-available document, along with providing context for its initial drafting and revision. The goal of this paper is to broaden the degree of awareness by the space nuclear system community of INSRB’s activities and intents.

INSRB

Efficiency Project Playbook

This efficiency project playbook is intended to assist those developing efficiency improvement projects with tools and templates to simply prepare plans that can be communicated to and approved by leadership. Not all templates are needed for all projects.

99 GENERAL AND MISCELLANEOUS

Volatile traits expand the microbial playbook

Microbial metabolic functions are increasingly conceptualized as fitness-regulating traits. However, volatile compounds (the volatilome), despite their key roles in metabolism and ecology, are often overlooked in trait-based frameworks. We propose that volatile traits not only reflect ecological strategies but also shape them by mediating responses to selection pressures. Their volatility affects diffusion, substrate access, and interactions across space, conferring selective advantages as resources or waste products. We outline approaches to incorporate volatile traits into predictive models to improve understanding of microbial selection and community dynamics. Furthermore, this integration enables a more holistic view of microbial life by accounting for the ecological and evolutionary consequences of volatile-mediated processes.

54 ENVIRONMENTAL SCIENCES

Voices from Rural Electric Cooperatives: A Call for a DER Integration Playbook for Rural and Agricultural Income & Savings from Renewable Energy (RAISE)

Rural-serving electric utilities (RSEUs)—including electric cooperatives, municipal systems, and small investor-owned utilities—are essential players in the evolving energy landscape. These community-focused entities are increasingly being asked to consider distributed energy resources (DERs) such as rooftop and ground-mounted solar, wind, battery storage, smart water heaters, and demand response programs (NRECA 2025; Lenhart et al. 2020). Yet the path to DER adoption is far from straightforward in the rural context. This report is based on in-depth interviews with managers of rural electric cooperatives across the United States. These conversations offer a grounded, unvarnished look at how DERs are perceived, what barriers exist, and what conditions might enable integration and adoption. While the utilities interviewed vary in geography, size, and DER experience, several clear and common themes emerged across electric cooperatives such that the report recommends the development of a DER Integration Runbook to help utilities assess readiness, define local use cases, engage stakeholders, pilot projects, and iterate, expanding over time.

29 ENERGY PLANNING, POLICY, AND ECONOMY

Evaluation of Crew-Centric Onboard Mission Operations Planning and Execution Tool: Year 2

Currently, mission planning for the International Space Station (ISS) is largely affected by ground operators in mission control. The task of creating a week-long mission plan for ISS crew takes dozens of people multiple days to complete, and is often created far in advance of its execution. As such, re-planning or adapting to changing real-time constraints or emergent issues is similarly taxing. As we design for future mission operations concepts to other planets or areas with limited connectivity to Earth, more of these ground-based tasks will need to be handled autonomously by the crew onboard.There is a need for a highly usable (including low training time) tool that enables efficient self-scheduling and execution within a single package. The ISS Program has identified Playbook as a potential option. It already has high crew acceptance as a plan viewer from previous analogs and can now support a crew self-scheduling assessment on ISS or on another mission. The goals of this work, a collaboration between the Human Research Program and the ISS Program, are to inform the design of systems for more autonomous crew operations and provide a platform for research on crew autonomy for future deep space missions. Our second year of the research effort have included new insights on the crew self-scheduling sessions performed by the crew through use on the HERA (Human Exploration Research Analog) and NEEMO (NASA Extreme Environment Mission Operations) analogs. Use on the NEEMO analog involved two self-scheduling strategies where the crew planned and executed two days of EVAs (Extra-Vehicular Activities). On HERA year two represented the first HERA campaign where we were able to perform research tasks. This involved selected flexible activities that the crew could schedule, mock timelines where the crew completed more complex planning exercises, usability evaluation of the crew self-scheduling features, and more insights into the limit of plan complexity that the crew could effectively self-schedule. In parallel we have added in new features and functionality in the Playbook tool based off of our insights from crew self-scheduling in the NASA analogs. In particular this year we have added in the ability for the crew to add, edit, and remove their own activities in the Playbook tool, expanding the type of planning and re-planning possible in the tool and opening up the ability for more free form plan creation. The ability to group and manipulate groups of activities from the plan task list was also added, allowing crew members to add predefined sets of activities onto their mission timeline. In addition we also added a way for crew members to roll back changes in their plan, in order to allow an undo like capability. These features expand and complement the initial self-scheduling features added in year one with the goal of making crew autonomous planning more efficient. As part of this work we have also finished developing the first version of our Playbook Data Analysis Tool, a research tool built to interpret and analyze the unobtrusively collected data obtained during the NASA analog missions through Playbook. This data which includes user click interaction as well as plan change information, through the Playbook Data Analysis Tool, allows us to playback this information as if a video camera was mounted over the crewmember's tablet. While the primary purpose of this tool is to allow usability analysis of crew self-scheduling sessions used on the NASA analog, since the data collected is structured, the tool can automatically derive metrics that would be traditionally tedious to achieve without manual analysis of video playback. We will demonstrate and discuss the ability for future derived metrics to be added to the tool. In addition to the current data and results gathered in year two we will also discuss the preparation and goals of our International Space Station (ISS) onboard technology demonstration with Playbook. This technology demonstration will be preformed as part of the CAST payload starting in late 2016.

onboard planning

Initial Analysis of and Predictive Model Development for Weather Reroute Advisory Use

In response to severe weather conditions, traffic management coordinators (TMCs) reroute air traffic around regions of airspace affected by the severe weather. Presently, acceptable reroutes are specified by issuing reroute advisories. Advisories, based on reroutes published in the National Severe Weather Playbook, consist of several routes describing routing options. These reroutes are selected by TMCs based on their understanding of weather conditions and their previous experience dealing with similar weather conditions. Providing recommendations and analysis of available reroute options could assist the TMCs in making rerouting decisions. While reroute advisories have historically been based on Playbook plays, plays are frequently modified or combined to generate an advisory. Thus, it is natural to present rerouting suggestions to TMCs as modified Playbook plays. The challenge here is to compare advisory subroutes and play subroutes in a meaningful way in order to map advisories back to the Playbook plays upon which they may have been based. In this work, several subroute comparison metrics are presented and discussed. One of these metrics is then used to match advisories to Playbook plays. With the development and implementation of NextGen technologies, there is currently a trend of moving away from the pre-defined Playbook plays (and related advisories) in favor of a more precise specification of trajectories using GPS based navigation tools, such as area navigation (RNAV). Moving towards ubiquitous use of RNAV routes, the objective of rerouting flights will be met with more precisely specified and accurately flown RNAV routes. In the final version of this paper, significant RNAV routes will be identified by finding RNAV routes that are flown frequently. This will require a trajectory comparison technique to compare actually flown flight tracks to specified RNAV routes. The metrics developed here will be used or modified for this task.

weather required reroutes

Interaction Between Strategic and Local Traffic Flow Controls

The loosely coordinated sets of traffic flow management initiatives that are operationally implemented at the national- and local-levels have the potential to under, over, and inconsistently control flights. This study is designed to explore these interactions through fast-time simulations with an emphasis on identifying inequitable situations in which flights receive multiple uncoordinated delays. Two operationally derived scenarios were considered in which flights arriving into the Dallas/Fort Worth International Airport were first controlled at the national-level, either with a Ground Delay Program or a playbook reroute. These flights were subsequently controlled at the local level. The Traffic Management Advisor assigned them arrival scheduling delays. For the Ground Delay Program scenarios, between 51% and 53% of all arrivals experience both pre-departure delays from the Ground Delay Program and arrival scheduling delays from the Traffic Management Advisor. Of the subset of flights that received multiple delays, between 5.7% and 6.4% of the internal departures were first assigned a pre-departure delay by the Ground Delay Program, followed by a second pre-departure delay as a result of the arrival scheduling. For the playbook reroute scenario, Dallas/Fort Worth International Airport arrivals were first assigned pre-departure reroutes based on the MW_2_DALLAS playbook plan, and were subsequently assigned arrival scheduling delays by the Traffic Management Advisor. Since the airport was operating well below capacity when the playbook reroute was in effect, only 7% of the arrivals were observed to receive both rerouting and arrival scheduling delays. Findings from these initial experiments confirm field observations that Ground Delay Programs operated in conjunction with arrival scheduling can result in inequitable situations in which flights receive multiple uncoordinated delays.

Grabbe, Son

Evaluation of User Experience of Self-Scheduling Software for Astronauts: Defining a Satisfaction Baseline

As NASA turns its sights to deep-space exploration, a greater focus on sup-porting crew autonomy has led to the development of Playbook, a self-scheduling software tool. Evaluating the user satisfaction of Playbook is essential in ensuring its usability for critical spaceflight operations. Satisfaction of an interface is often quantified with attitude surveys, such as the User Experience Questionnaire (UEQ). This paper demonstrates an application of the UEQ in comparing the user experience of Playbook interface de-signs for displaying graphical data. We lay the foundation for future user experience comparisons by defining a satisfaction baseline, which is crucial as more features are integrated into Playbook’s interface. This work ex-tends a validated user experience framework into a spaceflight domain, allowing optimization of human-computer interaction as future operational tools are developed.

user experience

Designing and Building a Crew-Centric Mobile Scheduling and Planning Tool for Exploring Crew Autonomy Concepts Onboard the International Space Station

During 2015, as part of our ongoing research on crew autonomy, our team adapted and extended the plan viewing tool, Playbook, into a mobile tool for exploring crew autonomy onboard the International Space Station (ISS). This work enables crewmembers to intuitively re-plan and schedule on their own with limited input from mission control. Designed for ease of use, re-planning is composed of simple drag and drop interactions and learning the tool requires little to no training. Playbook was successfully uplinked onto ISS as a technology demonstration and completed its onboard ground and crew checkouts in August and September 2015, respectively. We will discuss and describe how Playbook was able to integrate with actual ISS operational plans and operational procedures without disrupting real mission operations. This work will also outline the design and technical constraints required to build a collaborative tool that allows multiple users to simultaneously self-schedule and synchronize during communication dropouts in the restricted networking and computing environment onboard ISS. Finally, we will explore the aspects of crew autonomy that this technology enables as well as discuss our next steps and possible extensions.

ISS

Enabling Communication Between Astronauts and Ground Teams for Space Exploration Missions

Over the last four years, Playbook’s Mission Log has evolved to become an enabling capability for analog missions that simulate deep space, exploration missions with communication transmission latency. Playbook is a planning and execution web-application for mission operations, aggregating multiple sources of information for astronauts to execute the mission in one place: timeline, procedures, chat interface. Playbook’s Mission Log provides a multimedia chat software interface with unique features and functionalities that support asynchronous communication between analog astronauts and ground support teams. This paper describes the iterative design the Mission Log has undergone based on user observations and solicited feedback. Key features include indicators that help users cope with asynchronous communication as well as aids that assist teams coordinate work. Future work and capabilities are outlined, which build upon the increased use of the Mission Log as a communication and coordination tool for space exploration.

communication

Crew Autonomy Through Self-Scheduling: Operational Characterization

NASA’s future long-duration exploration missions (LDEMs) will encounter increasing communication transmission delays as they move farther from Earth-based ground stations. This necessitates a new approach, as crews can no longer rely on real-time support from ground planners and must self-schedule their own operational timelines effectively and efficiently. To enable this transition, our team has developed Playbook, a mission planning and scheduling tool. Our research focuses on quantifying scheduling performance using Playbook to inform the design and development of future features to streamline timeline creation. We also aim to propose standards and guidelines for autonomous crews in LDEMs. In the past year, we have focused on further validating and quantifying the effects of countermeasure aids on self-scheduling performance. There are two software aids in Playbook (self-scheduling platform): Suggested Fixes, which propose an edit to resolve violations within a timeline, and No-Go Zones, which highlight where activities should not be scheduled on a timeline. We have made significant progress in HERA Campaign 7 (C7) data collection, increasing the number of days crew must self-schedule from 4 to 8. As a result, almost 20% of the mission is self-scheduled by the analog astronauts. We have also started data collection on a controlled lab experiment designed to quantify performance effects due to the countermeasures. We expect to present the preliminary results from both efforts. Finally, we have conducted an exploratory analysis of NASA’s HERA Campaign 6 (C6), investigating the mission-level impacts of self-scheduling. We derived basic patterns and descriptive statistics to better characterize crew autonomy through self-scheduling. We also assessed if there are any individual indicators of preference for self-scheduling, such as experience or predilection for autonomy. Preliminary analysis indicates that the HERA C6 crew self-scheduled one out of four flexible activities, indicating unprompted adoption of self-scheduling as a concept of operation for crew autonomy.

analog

Evaluation of Self-Scheduling Exercises Completed by Analog Crewmembers in NASA's Human Exploration Research Analog (HERA)

NASA human spaceflight missions are inherently dynamic and require frequent scheduling changes in order to adapt to changing mission priorities and objectives. Tactical level changes to the mission plan are traditionally made by a team of expert planners and operations specialists on the ground. However, astronauts are expected to execute missions more autonomously during future long duration missions. Astronauts will need to take on some of the responsibility of managing their own schedule while still abiding by the numerous constraints required by human spaceflight operations. This paper summarizes salient elements of crew performance in NASA’s Human Exploration Research Analog Campaign 3. Analog crewmembers completed a series of self-scheduling exercises to evaluate Playbook’s usability towards enabling self-scheduling without support from ground control. Playbook is a self-scheduling software tool designed and developed by our team. We also investigated how to best communicate self-scheduling tasks and constraints to the crew in order to facilitate efficient self-scheduling during isolation in a realistic environment. Our analysis identified that 30 minutes was sufficient to complete complex self-scheduling tasks. Our evaluation also identified differences between individual and collaborative performance; analog crewmembers completed self-scheduling exercises more quickly as a team as opposed to individually and reported lower subjective difficulty ratings overall.

HERA