Search NASA⌕ Search

SEARCH · Search NASA

Results for “Autonomous Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Enabling a Voice Management System for Space Applications, Design and Software Development

Sustainable missions, beyond low Earth orbit, will require autonomous capabilities in order to achieve NASA’s Artemis program objectives. Correspondingly, the crew must have a means to efficiently interact with these autonomous systems; this can be facilitated via voice and speech communications. Voice-based controls enable the user to access autonomous systems hands-free/eyes-free, allowing the user to better focus on critical tasks. The goal of this project was to explore the knowledge and technology needed to successfully design effective voice interfaces for autonomous systems. The main objective was to understand how a crew member, through voice interaction, could most efficiently and intuitively communicate with a notional autonomous vehicle system manager. This project leveraged prior research conducted by the University of Michigan’s Bioastronautics and Life Support System (BLiSS) team as part of a NASA Moon to Mars eXploration Systems and Habitation (M2M X-Hab) 2020 Academic Innovation Challenge. The X-Hab 2020 work from the BliSS Team resulted in an intuitive graphical user interface/user experience that was built on an Internet of Things (IOT) platform. The Voice User Interface (VUI) design for the M2M X-Hab 2021 project leveraged this technology and incorporated a voice-based assistant and NASA’s Platform for Autonomous Systems (NPAS) software. This required technologies to convert voice to text, conduct semantic interpretations, and convert responses from the autonomous system to text and to speech; additionally, the background noise environment of spacecraft was assessed, and a relatable personality for the autonomous system to facilitate human-like conversations was created. This work’s success was largely due to the diverse team that included expertise in Space Systems Engineering, Human Computer Interaction, Aerospace Engineering, Computer Science, Biomedical Engineering, and Applied Physics. The differing perspectives fostered elaborate discussions, resulting in the conception of three main interactions: (1) User-System, (2) NPAS-System, and (3) Environment-System. The system developed, i.e. the VUI, had to be unique, efficient, and intuitive; thus, the team crafted a personality for the system to enable human-like conversation. User surveys sent to students and young professionals were used to help determine these personality traits by capturing perspectives and expectations of the “Artemis Generation Astronauts”. To further simulate human-like conversations, the system had to be able to quickly interpret user speech and be able to integrate with NASA’s NPAS system for quick and reliable information transfer. Results of this research include (1) a working prototype user interface, that is compatible with NASA’s NPAS system; (2) software that demonstrates the ability to interpret user requests and respond appropriately; (3) the capability to implement fully expanded conversations between user and system using intuitive communication in four request categories; and (4) software and hardware recommendations that optimize the system’s ability to operate, i.e. be heard, in a noisy environment. The technologies chosen for this project’s demonstrations included the following: Raspberry Pi, RASA, Mozilla Deep Speech, Coqui, RTX Voice and Adobe XD. This work has laid the foundation for the development of VUI’s used for autonomy, and is intended to provide guidance for future VUI development.

Tara Vega↗

Multi-Spacecraft Autonomous Positioning System

As the number of spacecraft in simultaneous operation continues to grow, there is an increased dependency on ground-based navigation support. The current baseline system for deep space navigation utilizes Earth-based radiometric tracking, requiring long-duration observations to perform orbit determination and generate a state update. The age, complexity, and high utilization of the ground assets pose a risk to spacecraft navigation performance. In order to perform complex operations at large distances from Earth, such as extraterrestrial landing and proximity operations, autonomous systems are required. With increasingly complex mission operations, the need for frequent and Earth-independent navigation capabilities is further reinforced. The Multi-spacecraft Autonomous Positioning System (MAPS) takes advantage of the growing interspacecraft communication network and infrastructure to allow for Earth-autonomous state measurements to enable network-based space navigation. A notional concept of operations is given in figure 1. This network is already being implemented and routinely used in Martian communications through the use of the Mars Reconnaissance Orbiter and Mars Odyssey spacecraft as relays for surface assets. The growth of this communications architecture is continued through MAVEN, and future potential commercial Mars telecom orbiters. This growing network provides an initial Marslocal capability for inter-spacecraft communication and navigation. These navigation updates are enabled by cross-communication between assets in the network, coupled with onboard navigation estimation routines to integrate packet travel time to generate ranging measurements. Inter-spacecraft communication allows for frequent state broadcasts and time updates from trusted references. The architecture is a software-based solution, enabling its implementation on a wide variety of current assets, with the operational constraints and measurement accuracy determined by onboard systems.

Anzalone, Evan↗

Airspace Integration Considerations for Increasingly Autonomous Flight and Operations

There is much interest in autonomous systems and their operations. When it comes to autonomous systems, it is critical to understand various levels of proposed autonomy, reasons for selecting autonomous capabilities, certification approaches and various challenges or research needs associated with the integration of autonomous systems in the National Airspace System (NAS). Furthermore, there are levels of autonomous systems proposed for different types of aircraft including: single pilot operations, remotely piloted operations, fully autonomous operations, and multiple aircraft managed by a single, remote pilot. This preliminary article aims to provide a broad overview rather than concentrate on a specific element of autonomous flight. Hence, the focus of this article is on enabling various types of increasingly autonomous aircraft and their operations routinely within the next five to ten years, consistent with the FAA’s Info-Centric NAS (ICN) vision. Under ICN, a fully integrated information environment supports collaboration across diverse traffic management services and shifts decision-making to the most appropriate actor supported by automation. However, the roles and responsibilities of Air Traffic Services (ATS) personnel providing traditional services are likely to be very similar to today in that humans will still be responsible for majority of decision making. There is another NASA research effort beyond ICN is underway called Sky For All which is not covered in this article as it is in the planning stages.

autonomy↗

Trusted Communication: Utilizing Speech Communication to Enhance Human-Machine Teaming Success

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such an integration requires humans to work closely with autonomous systems, forming teams. Our hypothesis is that a team composed of both humans and autonomous systems will operate better than either entity alone. We have existing procedures for certifying pilots to operate in the national airspace and are currently working on methods for validating the function of autonomous systems, however we have no method in place for assessing the interaction of these two disparate systems. Communication is one avenue. This paper will examine the use of language as a metric for ascertaining human-machine teaming effectiveness. A proof-of-concept of the application of two communication-based analysis techniques, Linguistic Inquiry and Word Count (LIWC) and Latent Semantic Analysis (LSA), for the prediction of success in human/chatbot teaming was conducted. By running these analyses over data from the 2014 and 2015 Loebner Prize competitions of human/chatbot teaming, numerical scores were obtained that can be associated with scores provided by human judges during the competition. Correlating their LIWC and LSA data with the scores provided by the judges, and using linear regression over this correlation, formulae were obtained that predict the score of human/chatbot interaction. These formulae were tested over the 2013 Loebner Prize transcripts, determining that, though there was strong correlation between predicted and actual scores, the predictive success of this method was not strong. However, with specialized topic spaces and lexica, as well as larger data sets, the predictive power of these metrics will improve. Given the importance of providing metrics for human-machine system team success and given the promise shown by the communication-basedLIWCand LSAmethods, continuing research in this area is necessary. After examining the potential for using communication and spoken language as a metric for the success of human/autonomous system teaming, this paper then examines aspects inherent to communication systems that may contribute to unreliability and reduced trust. Modern natural language processing tools rely on deep learning algorithms to create language rules that produce accurate results, but these rules are uninterpretable. The resulting blackbox system lacks transparency necessary for full validation and complete trust. Additionally, speech-based interfaces pose other difficulties to developing coordinated teamwork between humans and autonomous systems. Human communication is infrequently limited to speech only, instead usually relying on a combination of verbal, gestural, and general body language communication. Reducing an analysis of team effectiveness to a study of spoken language alone is problematic as it leaves these other equally important forms of communication out. This paper will examine these problems and the general deficiencies in speech-based metrics for human-machine teaming.

E L Meszaros↗

Methods of determining complete sensor requirements for autonomous mobility

A method of determining complete sensor requirements for autonomous mobility of an autonomous system includes computing a time variation of each behavior of a set of behaviors of the autonomous system, determining mobility sensitivity to each behavior of the autonomous system, and computing a change in mobility based upon the mobility sensitivity to each behavior and the time variation of each behavior. The method further includes determining the complete sensor requirements of the autonomous system through analysis of the relative magnitude of the change in mobility, the mobility sensitivity to each behavior, and the time variation of each behavior, wherein the relative magnitude of the change in mobility, the mobility sensitivity to each behavior, and the time variation of each behavior are characteristic of the stability of the autonomous system.

Curtis, Steven A.↗

Risk-Reduction Autonomy Implementation to Enable NASA Artemis Missions

To achieve NASA’s Artemis program mission objectives a high level of autonomy and ubiquitous autonomy throughout the systems that are being developed will be necessary. The autonomous systems of Artemis will require a distributed autonomy capability, with autonomous systems organized functionally in a hierarchical architecture, where systems at higher levels of the hierarchy have authority over systems at lower levels. The challenge of developing autonomy technologies and concepts of operations for Artemis has been undertaken by the NASA Gateway Working Group. This group has developed requirements, architectures, concepts of operations, and interface control documents, in the context of a hierarchical distributed architecture that includes the following: a Vehicle System Manager (VSM) that autonomously manages the entire Gateway; Module System Managers (MSMs) that autonomously manage each module; and System Managers (SMs) that autonomously manage systems within a module(i.e. ECLSS).A substantially high level of autonomy needs to be achieved by each element of the hierarchy (VSM, MSM, SM)to meet requirements for uncrewed operations; this includes conditions that will have minimal and/or delayed ground intervention (i.e. requirements for sustainability for months of operation without crew or ground support). To advance an implementation of this autonomy design (Gateway Autonomy Design –GAD), a collaboration was established between the Autonomous Systems Laboratory (ASL) at NASA Stennis Space Center and Lockheed Martin. The objectives of this partnership were the following: (1)to implement autonomy at the VSM, MSM, and SM levels;(2) to implement communications among a VSM, 2 MSMs, ORION (a visiting vehicle somewhat equivalent to a module) and 1 SM (a power system), and (3) test autonomous operations with representative use cases. A SM backed by a high-fidelity simulation was created to facilitate demonstrations of use cases that originated in a system of a module. Communication between the VSM and MSMs was implemented according to Concepts of Operations and Interface Control Documents (ICDs). Demonstrations were conducted to address nominal and off-nominal operations and multi-module interactions with VSM. Additionally, user interfaces were created to provide awareness about ongoing processes and results while enhancing the demonstration. Demonstrations included the following use cases: (1)Orion as visiting vehicle registers with VSM;(2) VSM reschedules a module’s timelines when another module’s MSM task fails; and (3) a module’s Power System Manager (PSM) standalone demonstration that included component failure diagnostics, tracing component failure to effected components, which in turn, reports failure information up to the VSM for acknowledgement and display. This paper will describe the detailed technology and autonomous systems developed, and the integrated multi-module demonstrations conducted. Also, challenges that must be met to fully implement the GAD defined by Gateway will be addressed.

Autonomous Systems↗

Knowledge-based and integrated monitoring and diagnosis in autonomous power systems

A new technique of knowledge-based and integrated monitoring and diagnosis (KBIMD) to deal with abnormalities and incipient or potential failures in autonomous power systems is presented. The KBIMD conception is discussed as a new function of autonomous power system automation. Available diagnostic modelling, system structure, principles and strategies are suggested. In order to verify the feasibility of the KBIMD, a preliminary prototype expert system is designed to simulate the KBIMD function in a main electric network of the autonomous power system.

Momoh, J. A.↗

Cislunar Autonomous Positioning System Technology Operations and Navigation Experiment (CAPSTONE) Pathfinder for Artemis Gateway

The Cislunar Autonomous Positioning System Technology Operations and Navigation Experiment (CAPSTONE) mission was developed by NASA in collaboration with Advanced Space, LLC of Westminster, Colorado. This technology demonstration mission serves as a pathfinder for near rectilinear halo orbit (NHRO) operations around the Moon. The NHRO, (Perilune = 3,200 km; Apolune = 70,000 km) is the intended orbit for NASA’s Artemis Gateway, a small, human-tended space station planned for lunar orbit. The CAPSTONE mission will validate simulations and confirm operational planning for Gateway while also validating performance of navigation and stationkeeping requirements for Gateway’s Power and Propulsion Element. Therefore, this mission will provide operational experience to NASA, commercial, and international missions for operations in a demanding orbital regime. The CAPSTONE mission consists of a 12-unit (U)+ CubeSat developed, integrated, and tested by the Terran Orbital Corporation that carries a payload communications system capable of crosslink ranging with NASA’s Lunar Reconnaissance Orbiter (LRO). CAPSTONE contains a chip-scale atomic clock (CSAC) for a one-way ranging experiment with NASA’s Deep Space Network, a dedicated payload flight computer for software demonstration, and a camera. The launch, coordinated by NASA’s Launch Services Program, was provided by Rocket Lab on its Electron launch vehicle using their Photon upper stage to deploy the CAPSTONE spacecraft. The mission launched June 28, 2022. The CAPSTONE spacecraft deployed from the Photon stage and traversed an approximately 4-month, highly fuel-efficient transfer phase entering the NRHO November 13, 2022, for a six-month primary mission phase. The mission is currently in a twelve-month technology enhancement operations phase. The CAPSTONE technology demonstration mission is led by Advanced Space, LLC. Spacecraft development and mission operations are conducted by Terran Orbital Corporation of Irvine, California. Noted accomplishments for the CAPSTONE mission include demonstrating the accessibility of NHROs; validating key operational concepts in the NHRO environment; laying the foundation for commercial support of future lunar operations; and accelerating the availability of peer-to-peer navigation capabilities provided by the Cislunar Autonomous Positioning System (CAPS). The CAPSTONE mission is funded through NASA’s Small Spacecraft Technology (SST) program, which is one of several programs within NASA’s Space Technology Mission Directorate. The program is chartered to develop and demonstrate technologies to enhance and expand the capabilities of small spacecraft with a particular focus on enabling new mission architectures through the use of small spacecraft, expanding the reach of small spacecraft to new destinations, and augmenting future missions with supporting small spacecraft. The CAPSTONE mission launch was provided by NASA’s Exploration Systems Development Missions Directorate’s Advanced Exploration Systems Division. Coordination and acquisition of the launch was managed by NASA’s Launch Services Program. The CAPSTONE mission and project status will be presented.

Elwood Agasid↗

Cislunar Autonomous Positioning System Technology Operations and Navigation Experiment (CAPSTONE) Pathfinder for Artemis Gateway

The Cislunar Autonomous Positioning System Technology Operations and Navigation Experiment (CAPSTONE) mission was developed by NASA in collaboration with Advanced Space, LLC of Westminster, Colorado. This technology demonstration mission serves as a pathfinder for near rectilinear halo orbit (NHRO) operations around the Moon. The NHRO, (Perilune = 3,200 km; Apolune = 70,000 km) is the intended orbit for NASA’s Artemis Gateway, a small, human-tended space station planned for lunar orbit. The CAPSTONE mission will validate simulations and confirm operational planning for Gateway while also validating performance of navigation and station-keeping requirements for Gateway’s Power and Propulsion Element. Thus, this mission will provide operational experience to NASA, commercial, and international missions for operations in a demanding orbital regime. The CAPSTONE mission consists of a 12-unit (U) CubeSat developed, integrated, and tested by the Terran Orbital Corporation that carries a payload communications system capable of cross-link ranging with NASA’s Lunar Reconnaissance Orbiter (LRO). CAPSTONE contains a chip scale atomic clock (CSAC) for a one-way ranging experiment with NASA’s Deep Space Network, a dedicated payload flight computer for software demonstration, and a camera. The launch, coordinated by NASA’s Launch Services Program, was provided by Rocket Lab on its Electron launch vehicle utilizing their Photon upper stage to deploy the CAPSTONE spacecraft into lunar orbit. The mission launched June 28, 2022. The CAPSTONE spacecraft deployed from Rocket Lab’s Photon stage and traversed an approximately 4 month highly efficient transfer phase entering the NRHO Novermber 13, 2022 for a six-month primary mission phase. The mission is currently in a twelve-month technology enhancement operations phase. The CAPSTONE technology demonstration mission is lead by Advanced Space, LLC. Spacecraft development and mission operations is conducted by Terran Orbital Corporation of Irvine, California. Noted accomplishments for the CAPSTONE mission include demonstration of the accessibility of NHROs, validation of key operational concepts in the NHRO environment, laying the foundation for commercial support of future lunar operations, and accelerating the availability of peer-to-peer navigation capabilities provided by the Cislunar Autonomous Positioning System (CAPS). The CAPSTONE mission is funded through NASA's Small Spacecraft Technology (SST) program, which is one of several programs within NASA’s Space Technology Mission Directorate. The program is chartered to develop and demonstrate technologies to enhance and expand the capabilities of small spacecraft with a particular focus on enabling new mission architectures through the use of small spacecraft, expanding the reach of small spacecraft to new destinations, and augmenting future missions with supporting small spacecraft. The CAPSTONE mission launch was provided by NASA’s Exploration Systems Development Missions Directorate’s Advanced Exploration Systems Division. Coordination and acquisition of the launch was managed by NASA’s Launch Services Program. The CAPSTONE mission and project status will be presented.

Elwood Agasid↗

Integrated System for Autonomous Science

The New Millennium Program Space Technology 6 Project Autonomous Sciencecraft software implements an integrated system for autonomous planning and execution of scientific, engineering, and spacecraft-coordination actions. A prior version of this software was reported in "The TechSat 21 Autonomous Sciencecraft Experiment" (NPO-30784), NASA Tech Briefs, Vol. 28, No. 3 (March 2004), page 33. This software is now in continuous use aboard the Earth Orbiter 1 (EO-1) spacecraft mission and is being adapted for use in the Mars Odyssey and Mars Exploration Rovers missions. This software enables EO-1 to detect and respond to such events of scientific interest as volcanic activity, flooding, and freezing and thawing of water. It uses classification algorithms to analyze imagery onboard to detect changes, including events of scientific interest. Detection of such events triggers acquisition of follow-up imagery. The mission-planning component of the software develops a response plan that accounts for visibility of targets and operational constraints. The plan is then executed under control by a task-execution component of the software that is capable of responding to anomalies.

Chien, Steve↗

Integrated System for Autonomous and Adaptive Caretaking (ISAAC) Simulated Cargo Logistics Demo Video

This video shows a simulation of autonomous cargo logistics using ISAAC (Integrated System for Autonomous and Adaptive Caretaking). The video shows autonomous planning and execution of a cargo scenario in which the R2 robot moves a cargo bag from a stowed location to a transfer location in the US Lab on the International Space Station. The Astrobee robot then moves the bag from the transfer location to a new temporary stowage location in the Japanese Experiment Module (JEM).

ISAAC↗

Risk-Reduction Autonomy Implementation to Enable NASA Artemis Missions

To achieve NASA’s Artemis program mission objectives a high level of autonomy that is ubiquitous throughout the systems that are being developed will be necessary. The autonomous systems of Artemis will require a distributed autonomy capability, with autonomous systems organized functionally in a hierarchical architecture, where systems at higher levels of the hierarchy have authority over systems at lower levels. The challenge of developing autonomy technologies and Concepts of Operations (ConOps) for Artemis has been undertaken by the NASA Gateway Working Group. This group has developed requirements, architectures, ConOps, and interface control documents (ICDs), in the context of a hierarchical distributed architecture that includes the following: a Vehicle System Manager (VSM) that autonomously manages the entire Gateway; Module System Managers (MSMs) that autonomously manage each module; and System Managers (SMs) that autonomously manage systems within a module (i.e. ECLSS). A substantially high level of autonomy needs to be achieved by each element of the hierarchy (VSM, MSM, SM) to meet requirements for uncrewed operations; this includes conditions that will have minimal and/or delayed ground intervention (i.e. requirements for sustainability for months of operation without crew or ground support). To advance an implementation of this autonomy design (Gateway Autonomy Design – GAD), a collaboration was established between the Autonomous Systems Laboratory (ASL) at NASA Stennis Space Center and Lockheed Martin. The objectives of this partnership were the following: (1) to implement autonomy at the VSM, MSM, and SM levels; (2) to implement communications among a VSM, 2 MSMs, ORION (a visiting vehicle somewhat equivalent to a module) and 1 SM (a power system), and (3) test autonomous operations with representative use cases. A SM backed by a high-fidelity simulation was created to facilitate demonstrations of use cases that originated in a system of a module. Communication between the VSM and MSMs was implemented according to Concepts of Operations and Interface Control Documents (ICDs). Demonstrations were conducted to address nominal and off-nominal operations and multi-module interactions with the VSM. Additionally, user interfaces were created to provide awareness about ongoing processes and results while enhancing the demonstration. Demonstrations included the following use cases: (1) Orion as visiting vehicle registers with VSM; (2) VSM reschedules a module’s timelines when another module’s MSM task fails; and (3) a module’s Power System Manager (PSM) demonstration that included component failure diagnostics, tracing component failure to effected components, which in turn, reports failure information up to the VSM for acknowledgement and display. This paper will describe the detailed technology and autonomous systems developed, and the integrated multi-module demonstrations conducted. Also, challenges that must be met to fully implement the GAD defined by Gateway will be addressed.

Fernando Figueroa↗

Development and Testing of a Vehicle Management System for Autonomous Spacecraft Habitat Operations

As the increased distance between Earth-based mission control and the spacecraft results in increasing communication delays, small crews cannot take on all functions performed by ground today, and so vehicles must be more automated to reduce the crew workload for such missions. In addition, both near-term and future missions will feature significant periods when crew is not present, meaning the vehicles will need to operate themselves autonomously. NASA's Advanced Exploration Systems Program pioneers new approaches for rapidly developing prototype systems, demonstrating key capabilities, and validating operational concepts for future human missions beyond low-Earth orbit. Under this program, NASA has developed and demonstrated multiple technologies to enable the autonomous operation of a dormant space habitat. These technologies included a fault-tolerant avionics architecture, novel spacecraft power system and power system controller, and autonomy software to control the habitat. The demonstration involved simulation of the habitat and multiple spacecraft sub-systems (power storage and distribution, avionics, and air-side life-support) during a multi-day test at NASA's Johnson Space Center. The foundation of the demonstration was ‘quiescent operations' of a habitat during a 55 minute eclipse period. For this demonstration, the spacecraft power distribution system and air-side life support system were simulated at a high level of fidelity; additional systems were managed, but with lower fidelity operational constraints and system behavior. Operational constraints for real and simulated loads were developed by analyzing on-orbit hardware and evaluating future Exploration capable technology. A total of 13 real and simulated loads were used during the test. Eight scenarios including both nominal and off-nominal conditions were performed. Over the course of the test, every application performed its desired functions successfully during the simulated tests. The results will inform both future tests, as well as provide insight to NASA's domestic and international partners, as they construct the next generation of space habitats to be used on beyond-Earth missions.

Autonomous Systems and Operations↗

Development of management technology for large power systems

Autonomous power management has been proposed as a method to perform optimization of power subsystem performance in connection with the management of multikilowatt space platforms. A concept for a 250-kW utility-type power subsystem was developed. A Cassegrain concentrator solar array primary source is conditioned by a solar array switching unit which supplies seventeen 220 +20 Vdc power channels. A power management subsystem provides the monitoring and control of the overall electrical power subsystem. The discussed system concept for autonomous management of high power space platforms utilizes on-board microprocessors in a decentralized data management architecture. A data bus protocol and a data bus contention resolution scheme were selected in conjunction with the dencentralized management architecture.

Decker, D. K.↗

Hallmarks of an Autonomous Space System’s Development and V&V

NASA’s deep space missions are dependent on autonomy when conditions require a faster response than can be directed by communication to and from Earth. Verification and Validation (V&V) of the autonomy is an essential step for missions to be confident in its use. This paper provides an overview of the development and V&V of one such autonomous system, DIMES (Descent Image Motion Estimation System), used successfully to reduce a critical mission risk during the landings of NASA’s two Mars Exploration Rovers on Mars in 2004.

Feather, Martin↗

Small Autonomous Air/Sea System Concepts for Coast Guard Missions

A number of small autonomous air/sea system concepts are outlined in this paper that support and enhance U.S. Coast Guard missions. These concepts draw significantly upon technology investments made by NASA in the area of uninhabited aerial vehicles and robotic/intelligent systems. Such concepts should be considered notional elements of a greater as-yet-not-defined robotic system-of-systems designed to enable unparalleled maritime safety and security.

Young, Larry A.↗

Enabling a Voice Management System for Space Applications

The sustainable missions beyond Low Earth Orbit (LEO) envisioned for NASA’s Artemis program will require autonomous capabilities. Moreover, Artemis mission crews will need a means to efficiently interact with a spacecraft’s autonomous systems. This interaction can be facilitated by voice and speech communications because voice-based controls enable users to interact hands- and eyes-free, allowing the user to better focus on critical tasks. The goal of our project was to explore the knowledge and technology needed to successfully design effective Voice User Interfaces (VUIs) for autonomous systems utilizing Human Centered Design (HCD) principles. The focus of the human factors’ aspect of engineering, pays close attention to psychological and physiological principles in the development of autonomous crew operation systems. A main objective was to understand how a crew member, through voice interaction, could efficiently and intuitively communicate with a notional autonomous vehicle system manager. This project was a part of the NASA Moon to Mars eXploration Systems and Habitation (M2M X-Hab) 2020 Academic Innovation Challenge. The work from the BLiSS Team, at the University of Michigan, resulted in the design of a system persona, Diego, to which an astronaut may quickly build trust with autonomous systems, to alleviate known stressors on mental health expected during long duration space missions. Optimal software to facilitate integration of the system persona into a reference Lunar orbiting Gateway station was defined. Additionally, a Speech to Text (STT) system and a Graphical User Interface (GUI) that could be implemented in future missions was developed on an Internet of Things (IOT) platform. The Voice User Interface (VUI) design for the M2M X-Hab 2020 project leveraged previous technology developed by the BLiSS team to incorporate a voice-based interface into NASA’s Platform for Autonomous Systems (NPAS) software. This required technologies to convert voice to text, conduct semantic interpretations, and convert responses from the autonomous system to text and to speech; additionally, the spacecraft background noise environment was assessed, a noise mitigation technique was developed, and a relatable personality for the autonomous system was developed in order to facilitate human-like conversations. The success of our effort was largely due to the diversity of the team that included expertise in Space Systems Engineering, Human Computer Interaction, Aerospace Engineering, Computer Science, Biomedical Engineering, and Applied Physics. The diverse perspectives fostered elaborate discussions, resulting in the conception of three main subsystems: (1) User-System, (2) NPAS-System, and (3) Environment-System. The VUI was unique and had to be efficient and intuitive. For this project, 5 subteams were formed, each with a separate objective, Voice Design team, Background Noise Mitigation team, Software Integration team and Graphical User Interface team. The BLiSS team crafted a personality for the VUI to enable human-like conversation and drive user adoption and trust. User surveys were completed and used to help determine the required VUI system personality traits by capturing perspectives and expectations of prospective “Artemis Generation Astronauts”. To further simulate human-like conversations, the system had to be able to quickly interpret user speech and be able to integrate with NASA’s NPAS platform for quick and reliable information transfer. The outcomes of our research were: (1) a working prototype user interface, that is compatible with NASA’s NPAS platform; (2) software that demonstrates the ability of the VUI system to interpret user requests and respond appropriately; (3) the capability to implement fully expanded conversations between user and system using intuitive communication in four request categories; and (4) software and hardware recommendations that optimize the system’s ability to operate in a noisy environment. Our research has laid the foundation for the development of VUI’s for autonomy, and provides a baseline for future VUI developments.

Voice user interface↗