Results for “Automation and Autonomy” — Page 9

NASA NTRSDate not supplied

Human Autonomy Teaming - m:N Operations

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust).

multi-vehicle control↗

NASA NTRSDate not supplied

NASA HAT Lab Activities

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust).

multi-vehicle control↗

NASA NTRSDate not supplied

m:N Working Group

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the background and progress of the m:N working group.

multi-vehicle control↗

NASA NTRSDate not supplied

Future Operations

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N). This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT). This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the future of GCS control stations and need for Human Systems Integration.

multi-vehicle control↗

NASA NTRSDate not supplied

m:N Operations and Future

The principles and reasons for employing Human Autonomy Teaming is discussed. Application of these techniques to multi-vehicle control is described. In several operational environments from small drone delivery to air taxi to autonomous cargo, many companies will need technologies that will allow for the operation of an unmanned aircraft (UAS or eVTOL) by a small crew of individuals that are located in a remote network operations center. That is, Multiple operators supervising an increasing Number of vehicles (M:N).This will require a new control/supervisory paradigm where the supervisors team with automation to achieve their joint tasks; Human Autonomy Teaming (HAT).This task will follow the HAT philosophy and tenants (e.g., trust, bi-directional communication, pilot directed interfaces). It will also develop and employ specific HAT tools (e.g., playbook, working agreements, predictive timeline displays, transparent interfaces to build trust). This presentation discusses the barriers and requirements for future m:N operations.

multi-vehicle control↗

NASA NTRS2001

Architectures and Evaluation for Adjustable Control Autonomy for Space-Based Life Support Systems

In the past five years, a number of automation applications for control of crew life support systems have been developed and evaluated in the Adjustable Autonomy Testbed at NASA's Johnson Space Center. This paper surveys progress on an adjustable autonomous control architecture for situations where software and human operators work together to manage anomalies and other system problems. When problems occur, the level of control autonomy can be adjusted, so that operators and software agents can work together on diagnosis and recovery. In 1997 adjustable autonomy software was developed to manage gas transfer and storage in a closed life support test. Four crewmembers lived and worked in a chamber for 91 days, with both air and water recycling. CO2 was converted to O2 by gas processing systems and wheat crops. With the automation software, significantly fewer hours were spent monitoring operations. System-level validation testing of the software by interactive hybrid simulation revealed problems both in software requirements and implementation. Since that time, we have been developing multi-agent approaches for automation software and human operators, to cooperatively control systems and manage problems. Each new capability has been tested and demonstrated in realistic dynamic anomaly scenarios, using the hybrid simulation tool.

Malin, Jane T.↗

DOE OSTI2026

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗

NASA NTRSDate not supplied

Autonomous Operations: Expectations vs. Reality (at NASA)

- Future deep-space exploration drives need for autonomy - Communication time delay between Earth and deep-space system precludes Earth-based remote-control - Autonomy is: - Acting separately from others (Webster’s Dictionary) - Able to independently choose how to act to achieve goals - Autonomy is a relative term: Autonomous from whom? for what purpose? and when? - Autonomous Operations is: - Automatically controlled operation of a system that replaces human effort - Able to perform a pre-specified set of instructions on its own - Automation is a tool that enables and supports autonomy

Autonomous Operation↗

NASA NTRS2019

Artificial Intelligence: Powering Human Exploration of the Moon and Mars

Artificial Intelligence (AI) is a growing field of computa- tional science techniques designed to mimic functions per- formed by people. Advancements in autonomy will depend on a portfolio of AI technologies. Automated planning and scheduling is a venerable field of study in AI, and is needed for a variety of mission planning functions. Plan execution technology is less well studied, but important for auton- omy and robotics. Specialized forms of automated reason- ing and machine learning are key technologies to enable fault management. Over the past decade, the NASA Au- tonomous Systems and Operations (ASO) project has devel- oped and demonstrated numerous autonomy enabling tech- nologies employing AI techniques. Our work has employed AI in three distinct ways to enable autonomous mission op- erations capabilities. Crew Autonomy gives astronauts tools to assist in the performance of each of these mission oper-ations functions. Vehicle System Management uses AI tech- niques to turn the astronaut's spacecraft into a robot, allow- ing it to operate when astronauts are not present, or to reduce astronaut workload. AI technology also enables Autonomous Robots as crew assistants or proxies when the crew are not present. When these capabilities are used to enable astro- nauts to operate autonomously, they must be integrated with user interfaces, introducing numerous human factors con- siderations; when these capabilities are used to enable vehi- cle system management, they must be integrated with flight software, and run on embedded processors under the control of real-time operating systems.We first describe human spaceflight mission operations capabilities. The remainder of the paper will describe the ASO project, and the development and demonstration per- formed by ASO since 2011. We will describe the AI tech- niques behind each of these demonstrations, which include a variety of symbolic automated reasoning and machine learn- ing based approaches. Finally, we conclude with an assess- ment of future development needs for AI to enable NASA's future Exploration missions.

Mission Operations↗

NASA NTRSDate not supplied

A Framework for Assessment of Autonomy Challenges in Air Traffic Management

Traditionally, air traffic management services have been provided by air traffic controllers and managers stationed in ground facilities, employed or contracted by the public sector, and supported by automation. These centralized, human-centric air traffic management services do not scale to accommodate increasing demands from conventional and new entrant operations for access to the national airspace system. One transformation that provides much needed scalability is increasing the level of autonomy of air traffic management by enabling edge agents of the system, including vehicles, operators, and third-party service suppliers, to collectively self-manage independently from the centralized service providers and enabling the automation to also take on more independent traffic management responsibility from the human agents. This paper identifies challenges to increasing the level of autonomy of air traffic management services. It describes a framework to enable a systematic identification of these challenges. The framework consists of a functional breakdown of air traffic management services and several dimensions characterizing different autonomy scales. The autonomy dimensions include the automation level between human and machine agents, the locus of control between centralized and distributed edge agents, cognitive activities for autonomous situation awareness and decision making, intelligence levels ranging from skill-based to expertise-based autonomous behavior, and uncertainty levels of the dynamics and environment in which autonomous agents operate. Several challenges are identified and categorized using the different dimensions of the autonomy framework.

automation, autonomy framework, collective autonom↗

DOE OSTI2017

Advanced Tele-operation and Shared Autonomy for Nuclearized Robotic Systems - 17333

Remotely-initiated operations have existed for more than 50 years in the nuclear weapons complex, as the environments are far too extreme for humans. We introduce the scope of the nuclear waste cleanup effort and describe some existing applications of robotics technology at specific sites. We offer summaries of both the technology that is currently used, as well as a discussion of the types of problems that the technology is applied to. We contrast this with the current state of practice in other areas where robots are deployed in the real world, such as with military infantry units. We then go on to summarize and discuss the current state of the art in advanced tele-operation research and in shared autonomy, where humans collaborate with closed-loop automation to complete tasks. Our discussion focuses on areas with particular relevance to nuclear waste management, such as remote inspection and manipulation. Armed with this background, we then identify specific technology gaps that must be closed in order to successfully bring advanced tele-operation and shared autonomy technologies to bear on problems in nuclear waste management, such as (1) environmental remediation; (2) sampling, characterization, and disposition of tanks with hazardous and highly radioactive waste and (3) decontamination and decommissioning of facilities with gloveboxes and hot cells. We propose a roadmap for how to transition the current state of the art approaches in advanced robotics and shared autonomy to practice in the nuclear industry and how to close the technology gaps previously identified. This roadmap covers not only the technical advances that need to be made, but also considers the social and societal aspects. Drawing parallels with the adoption of similar technologies in the military and other areas, we offer concrete suggestions for how to deploy these new technologies effectively into the nuclear industry from a human-centered perspective. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2021

m:N and Human Autonomy Teaming Concepts for High Density Vertiport Operations

This report focuses on the role of the Fleet Manager (FM) and, in particular, the ways in which automation could support their position as they manage multiple aircraft and operators in a highly dynamic, advanced air mobility (e.g., air taxi) environment, specifically "high-density vertiport" (HDV) regions. Similar to terminal area operations for traditional aviation, operations involving HDVs will need to be highly structured while also remaining resilient to the various contingencies that can happen in that environment. The role of the FM is consistent with an “m:N” architecture, where “m” number of operators cooperatively manage “N” number of vehicles (where “N” is always larger than “m”). In such a paradigm it is critical to provide the operator with the tools and information necessary to manage their fleet safely and navigate the known pitfalls with highly automated, complex systems (e.g., brittleness, insufficient situation awareness, skill degradation). As the field of m:N has expanded as an area of study, a set of higher-level automation concepts have emerged—namely “plays,” “working agreements,” and “human-autonomy teaming” (HAT)—that could support operators in this new role.

human autonomy teaming↗

NASA NTRS1996

Automation of satellite operations: Experiences and future directions at NASA GSFC

The current state of satellite operation automation at the NASA Goddard Space Flight Center (GSFC), MD, is described, discussing the short term future and presenting a vision of how automation should be used in future systems. The automation practices currently applied in several current programs are surveyed. The rapidly evolving level of spacecraft autonomy is considered, reviewing how future onboard capabilities will affect ground based automation efforts. The optimum role of automation is discussed and automation principles are presented that can be used to identify favorable opportunities for simplifying and reducing the operating cost of spaceborne science missions.

Hartley, Jonathan B.↗

NASA NTRSDate not supplied

Test & Measurement System Security in an IT World

Automated test and measurement systems are coming under increased cybersecurity scrutiny. Most of these systems fall under the “Operational Technology” designation, as defined by NIST, and often have unique requirements that conflict with enterprise security policy. These systems are typically not well understood by traditional enterprise IT personnel, which leaves them ill-supported or invalidated.▪This presentation attempts to help Test System owners recognize the security landscape, determine their unique system requirements and concerns, and negotiate a peer-level working arrangement with an existing IT department while maintaining a NIST-recommended level of autonomy and sovereignty.

automated test↗

DOE OSTI2025

Autonomous Flow Electrochemistry for Accelerated Catalyst Discovery

Our objective is to develop an Autonomous Chemical Experimentation (ACE) platform that accelerates discovery of new catalytic transformations and other energy-relevant chemical reactions and processes. We intentionally designed ACE to be highly modular, both with respect to its rapid deployment to different chemistries and experimental workflows as well as incorporation of a wide range of different AI algorithms. In addition to the development of the core software architecture, initial efforts were made to incorporate Large Language Models to provide human-interpretable reasoning of the optimizer’s actions, and to develop a user-friendly graphical interface for experimental researchers. ACE was demonstrated using a flow electrocatalysis platform containing an inline FTIR spectrometer for real-time analysis and quantification of the reaction outcome. Human-in-the-loop experiments were performed in which a human researcher conducted an experiment using electrode potentials suggested by ACE, then fed the spectral data back to ACE for decision making. After confirming the successful function of the optimizer, efforts were next directed to automation of the hardware and performed full autonomy tests using three reactions: catalytic oxidation of formate, catalytic oxidation of cyclohexanol, and oxidation of hydroquinone. These studies confirm that ACE can close the loop between reaction execution, analysis, and optimization. They also reveal that more improved product detection methods will be essential for ACE to make well-informed decisions for reactions with low conversions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2020

Intelligent Contingency Management for Urban Air Mobility

The third aviation revolution is seeking to enable transportation where users have access to immediate and flexible air travel; the users dictate trip origin, destination and timing. One of the major components of this vision is urban air mobility (UAM) for the masses. UAM means a safe and efficient system for vehicles to move passengers and cargo within a city. In order to reach UAM’s full market potential the vehicle will have to be autonomous. One of the primary challenges of autonomous flight is dealing with off-nominal events, both common and unforeseen; thus, intelligent contingency management (ICM) is one of the enabling technologies. In this context, the vehicle has to be aware of its internal state and external environment at all times, ascertain its capability and make decisions about mission completion or modification. All of these functions require data to model and assess the environment and then take actions based on these models. Necessarily, there is uncertainty associated with the data and the models generated from it. Since we are dealing with safety-critical systems, one of the main challenges of ICM is to generate sufficient data and to minimize its uncertainty to enable practical and safe decision making. We propose an overall architecture that incorporates deterministic and learning algorithms together to assess vehicle capabilities, project these into the future and make decisions on mission management level. A layered approach allows for mature parts and technologies to be integrated into early highly automated vehicles before the final state of autonomy is reached.

data-driven systems↗

NASA NTRS2021

Trust in Collaborative Automation in High Stakes Software Engineering Work

The amount of autonomy in software engineering tools is increasing as developers build increasingly complex systems. Research in other domains shows that too much or too little trust in autonomous tools can have negative consequences, but we are not aware of any study that has investigated trust in autonomous tools in the highly interactive context of a software engineering workplace. We present the results of a ten week ethnographic case study of engineers collaborating with autonomous tools to write flight software at a large national space exploration organization to support high stakes missions. We find that trust in an autonomous software engineering tool in this setting was influenced by four main factors: the tool’s transparency, social context, an organization’s associated processes, and its usability. We outline theoretical implications for future research into trust in autonomous software engineering tools, and practical implications for tool designers and organizations conducting high stakes work with autonomous tools.

Davidoff, Scott↗

NASA NTRSDate not supplied

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility↗