Search NASA⌕ Search

SEARCH · Search NASA

Results for “Autonomy Platforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Enabling a Voice Management System for Space Applications

The sustainable missions beyond Low Earth Orbit (LEO) envisioned for NASA’s Artemis program will require autonomous capabilities. Moreover, Artemis mission crews will need a means to efficiently interact with a spacecraft’s autonomous systems. This interaction can be facilitated by voice and speech communications because voice-based controls enable users to interact hands- and eyes-free, allowing the user to better focus on critical tasks. The goal of our project was to explore the knowledge and technology needed to successfully design effective Voice User Interfaces (VUIs) for autonomous systems utilizing Human Centered Design (HCD) principles. The focus of the human factors’ aspect of engineering, pays close attention to psychological and physiological principles in the development of autonomous crew operation systems. A main objective was to understand how a crew member, through voice interaction, could efficiently and intuitively communicate with a notional autonomous vehicle system manager. This project was a part of the NASA Moon to Mars eXploration Systems and Habitation (M2M X-Hab) 2020 Academic Innovation Challenge. The work from the BLiSS Team, at the University of Michigan, resulted in the design of a system persona, Diego, to which an astronaut may quickly build trust with autonomous systems, to alleviate known stressors on mental health expected during long duration space missions. Optimal software to facilitate integration of the system persona into a reference Lunar orbiting Gateway station was defined. Additionally, a Speech to Text (STT) system and a Graphical User Interface (GUI) that could be implemented in future missions was developed on an Internet of Things (IOT) platform. The Voice User Interface (VUI) design for the M2M X-Hab 2020 project leveraged previous technology developed by the BLiSS team to incorporate a voice-based interface into NASA’s Platform for Autonomous Systems (NPAS) software. This required technologies to convert voice to text, conduct semantic interpretations, and convert responses from the autonomous system to text and to speech; additionally, the spacecraft background noise environment was assessed, a noise mitigation technique was developed, and a relatable personality for the autonomous system was developed in order to facilitate human-like conversations. The success of our effort was largely due to the diversity of the team that included expertise in Space Systems Engineering, Human Computer Interaction, Aerospace Engineering, Computer Science, Biomedical Engineering, and Applied Physics. The diverse perspectives fostered elaborate discussions, resulting in the conception of three main subsystems: (1) User-System, (2) NPAS-System, and (3) Environment-System. The VUI was unique and had to be efficient and intuitive. For this project, 5 subteams were formed, each with a separate objective, Voice Design team, Background Noise Mitigation team, Software Integration team and Graphical User Interface team. The BLiSS team crafted a personality for the VUI to enable human-like conversation and drive user adoption and trust. User surveys were completed and used to help determine the required VUI system personality traits by capturing perspectives and expectations of prospective “Artemis Generation Astronauts”. To further simulate human-like conversations, the system had to be able to quickly interpret user speech and be able to integrate with NASA’s NPAS platform for quick and reliable information transfer. The outcomes of our research were: (1) a working prototype user interface, that is compatible with NASA’s NPAS platform; (2) software that demonstrates the ability of the VUI system to interpret user requests and respond appropriately; (3) the capability to implement fully expanded conversations between user and system using intuitive communication in four request categories; and (4) software and hardware recommendations that optimize the system’s ability to operate in a noisy environment. Our research has laid the foundation for the development of VUI’s for autonomy, and provides a baseline for future VUI developments.

Voice user interface↗

Autonomous Flow Electrochemistry for Accelerated Catalyst Discovery

Our objective is to develop an Autonomous Chemical Experimentation (ACE) platform that accelerates discovery of new catalytic transformations and other energy-relevant chemical reactions and processes. We intentionally designed ACE to be highly modular, both with respect to its rapid deployment to different chemistries and experimental workflows as well as incorporation of a wide range of different AI algorithms. In addition to the development of the core software architecture, initial efforts were made to incorporate Large Language Models to provide human-interpretable reasoning of the optimizer’s actions, and to develop a user-friendly graphical interface for experimental researchers. ACE was demonstrated using a flow electrocatalysis platform containing an inline FTIR spectrometer for real-time analysis and quantification of the reaction outcome. Human-in-the-loop experiments were performed in which a human researcher conducted an experiment using electrode potentials suggested by ACE, then fed the spectral data back to ACE for decision making. After confirming the successful function of the optimizer, efforts were next directed to automation of the hardware and performed full autonomy tests using three reactions: catalytic oxidation of formate, catalytic oxidation of cyclohexanol, and oxidation of hydroquinone. These studies confirm that ACE can close the loop between reaction execution, analysis, and optimization. They also reveal that more improved product detection methods will be essential for ACE to make well-informed decisions for reactions with low conversions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Preparing for Human Missions to Mars: The role of ISS and Artemis as Analogs for Research and Technology Testing

The hazards of spaceflight to the human system are present in in varying degrees on different spaceflight platforms: altered gravity, isolation and confinement, distance from Earth, radiation, and hostile closed environments. A strategic view of the fidelity of hazards experienced on different platforms can shape the testing plans for human research and technology demonstration related to crew health and performance. Working across the international partnership, the International Space Station (ISS) is planning periods of modified operations to improve the fidelity of Mars simulations. To understand transit durations as an independent variable, a series of 1-year, 6-month and 30-45 day missions are being planned on ISS. Standard measurements across ISS missions of different durations, lunar missions and ground analogs offers the opportunity to distinguish different hazards and their effects in the context of the relevance to future mission concepts. The ISS partnership is planning for additional test cases that are aligned with Mars mission plans. (1) Evaluating crew performance capabilities when transitioning to gravity after long durations in microgravity representative of a Mars transit. (2) Simulating crew medical care under Mars-like autonomous operations. (3) Identification and testing of operations under communications delay and autonomy expected for Mars missions and the linked effects on behavioral health and performance of the crew. Artemis missions serve as a valuable analogs for Mars surface operations, with partial gravity and deep space radiation hazards, but with crewmembers that are probably more physically capable than their counterparts would be after a Mars transit. Getting unobtrusive data from early Artemis missions, and knowledge gained from operational experience as Artemis operations develop can improve engineering design, medical requirements and countermeasures, and ultimately ensure mission success on Mars. Linking Mars architectures with the plans and capabilities for ISS and Artemis allows us to plan to most operationally relevant tests of crew health and performance on current spaceflight missions to inform planning for future missions to Mars. By using human spaceflight platforms as well as ground simulation in an integrated way, the international community can improve exploration readiness, develop countermeasures and reduce risks of future human space missions.

International Space Station↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

Graphical programming and the use of simulation for space-based manipulators

Robotic manipulators are difficult to program even without the special requirements of a zero-gravity environment. While attention should be paid to investigating the usefulness of industrial application programming methods to space manipulators, new methods with potential application to both environments need to be invented. These methods should allow various levels of autonomy and human-in-the-loop interaction and simple, rapid switching among them. For all methods simulation must be integrated to provide reliability and safety. Graphical programming of manipulators is a candidate for an effective robot programming method despite current limitations in input devices and displays. A research project in task-level robot programming has built an innovative interface to a state-of-the-art commercial simulation and robot programming platform. The prototype demonstrates simple augmented methods for graphical programming and simulation which may be of particular interest to those concerned with Space Station applications; its development has also raised important issues for the development of more sophisticated robot programming tools. Both aspects of the project are discussed.

Mcgrath, Debra S.↗

Robotic Subsurface Analyzer and Sample Handler for Resource Reconnaissance and Preliminary Site Assessment for ISRU Activities at the Lunar Cold Traps

Since the 1960s, claims have been made that water ice deposits should exist in permanently shadowed craters near both lunar poles. Recent interpretations of data from the Lunar Prospector-Neutron Spectrometer (LP- NS) confirm that significant concentrations of hydrogen exist, probably in the form of water ice, in the permanently shadowed polar cold traps. Yet, due to the large spatial resolution (45-60 Ian) of the LP-NS measurements relative to these shadowed craters (approx.5-25 km), these data offer little certainty regarding the precise location, form or distribution of these deposits. Even less is known about how such deposits of water ice might effect lunar regolith physical properties relevant to mining, excavation, water extraction and construction. These uncertainties will need to be addressed in order to validate fundamental lunar In Situ Resource Utilization (ISRU) precepts by 2011. Given the importance of the in situ utilization of water and other resources to the future of space exploration a need arises for the advanced deployment of a robotic and reconfigurable system for physical properties and resource reconnaissance. Based on a collection of high-TRL. designs, the Subsurface Analyzer and Sample Handler (SASH) addresses these needs, particularly determining the location and form of water ice and the physical properties of regolith. SASH would be capable of: (1) subsurface access via drilling, on the order of 3-10 meters into both competent targets (ice, rock) and regolith, (2) down-hole analysis through drill string embedded instrumentation and sensors (Neutron Spectrometer and Microscopic Imager), enabling water ice identification and physical properties measurements; (3) core and unconsolidated sample acquisition from rock and regolith; (4) sample handling and processing, with minimized contamination, sample containerization and delivery to a modular instrument payload. This system would be designed with three mission enabling goals, including: (1) a self-contained, low power, low mass, "black box'' configuration for operations from a lander, various classes of rovers or a surface-based platform with human assistance or robotic anchoring mechanisms; (2) reconfigurable and scalable sample handling for delivery to various types of instrumentation, depending on mission requirements; and (3) the use of advanced automation control and diagnostic techniques that will afford local human deployed, remote teleoperation and fully autonomous intelligent operations. Though a great deal of technology has been advanced toward these objectives, the SASH system faces significant design challenges, including the low gravity environment, various levels of autonomy in operations, radiation exposure, dust contamination, and temperature extremes and deltas. Significant input from the scientific and engineering communities, as well as a significant environmental testing program, will be required to guide the design process.

Gorevan, S. P.↗

Advances in Autonomous Communications and Operations: Tes-N Series

Advances in nanosat subsystems over the past decade have taken the CubeSat standard from a communication-limited educational tool to a powerful platform enabling space research. The potential for autonomous operations may greatly increase the capability of downlinking even larger data sets. This is enabled through miniaturization of software-defined radio/cognitive communication solutions and a rapidly growing number of ground stations and satellite network crosslinks. The TechEdSat-n orbital flight series is currently demonstrating experiments using cognitive communication concepts including User Initiated Service (UIS) and High-rate Delay Tolerant Networks (HDTN), which show a significant step toward improved capability. At the core of this is the use of the Iridium L-band Short Burst Data (SBD) modems, pioneered by TES-n for space applications. SBD enables unique rapid command, control, and scheduling to initiate the UIS and HDTN protocols. This occurs by performing GPS-assisted on-orbit ephemeris determination, enabling negotiation with high bandwidth ground assets to repeatedly downlink over a specific commercial or government-owned ground station. The technique is RF band-agnostic and may be extended to higher bandwidth stations and SDRs. This may also include free-space optical communication, through both laser and omnidirectional LEDs, which can provide an attractive protocol for downlinking very large datasets over far fewer ground stations. In addition, this may be extended to lunar applications for such future concepts as LunaNet, whereby scheduling and cognitive technologies can assist in greatly improving Earth downlink capabilities with ground stations which will see greater competition for usage. Lastly, the NASA Communication Service Program (CSP), intended to eventually replace the NASA Tracking and Data Relay Satellite System (TDRSS) will also demonstrate the feasibility of commercially-provided satellite communication capabilities. All of these combined advances, including large advances in on-board computation on small platforms, will result in more remarkable data processing capability – yielding even more as of yet unknown discoveries.

Autonomy↗

Digitally Optimized Autonomous Robotic System for Hanford Waste Tank Handling [Slides]

Idaho National Laboratory (INL) is developing a robotic system and digital twin to perform monitoring, inspection, and mapping of underground tank pits at the Hanford Site, operated by the U.S. Department of Energy (USDOE). The Autonomous Pit Exploration System (APES) will consist of four primary components: an electric vehicle truck with a robotic system developed by INL to deploy payloads into the tanks through small diameter preexisting risers, a robotic arm developed by Florida International University (FIU) for the purposes of deploying a variety of payloads into the tank pit environment, and a small robotic COTS crawler platform for examining the bottom of the pits.

42 - ENGINEERING↗

Automated Airspace Management: Concept, Development, and Testing

For many decades, researchers at NASA Ames Research Center have worked to make the air-transportation system more efficient, predictable, and effective. Since about 2005 one important aspect of this research has been the development of an autonomous system for air-traffic control. This system, known as the Autoresolver, is designed to perform most of the roles that air-traffic controllers perform including ensuring separation between aircraft, creating routes around weather and other avoidance volumes, and sequencing and scheduling aircraft across points in space. The recent, rapid expansion of new aircraft operations and types, including urban air mobility aircraft and small unmanned aerial systems, have only increased the need for highly automated systems to control the predicted traffic demand. This talk will focus on the development of the Autoresolver - from concept to testing. It will also discuss the National Airspace (NAS) Digital Twin simulation platform, created to facilitate rapid testing and improvement of the algorithm and with the hope of proving the automation in a high-fidelity environment. An open question that will be discussed is how to ensure that the system-level emergent behavior of independently developed autonomous algorithms is what is desired.

autonomy↗

Machine Learning for Extravehicular Mobility Unit (EMU) Glove Inspections

The Extravehicular Mobility Unit (EMU) Glove Machine Learning Inspection project utilizes machine learning to expedite the inspection, analysis, and recommendation for continued use of space suit gloves post spacewalks. Today, ISS glove photos are individually reviewed by a team of experts to determine the conditions of space suit gloves. For this project the Microsoft Azure platform is used to perform Automated Machine Learning (AutoML) to detect issues with tagged images from previous Extravehicular Activities (EVA’s) to build a predictive model. The model analyzes a test image and deems the glove GO or NO-GO for additional EVA’s. The goal for this ML project is to decrease the time spent reviewing images by ground personnel and crewmembers in high frequency EVA locations such as the Moon and Mars. For destinations such as the Moon and Mars the goal is to give crew autonomy in determining glove conditions with limited support from Earth. This paper will outline the results to date and future work needed to expand the capability for in-situ recommendations.

EVA↗

Sensing and Sampling of Trace Contaminations by a Dexterous Hexrotor UAV at Nuclear Facilities - 18600

Safe and efficient cleanups are a priority for decontamination and decommissioning of nuclear facilities. The contaminations of byproducts and wastes in such nuclear facilities pose a serious problems while decommissioning, to both the operators and public. Sensing these contaminations and cleaning them is an essential part of the safety procedures. The contaminations might range from low-energy to high-energy byproducts. Sensing these byproducts would require contact based or non-contact based sensing, based on its energy levels. Byproducts such as americium, are low-energy which makes it difficult to sense and sample without contact. Therefore, the workers need to physically swab the surfaces to collect the samples of these contaminations. These tasks pose a great danger for the safety of the human workers which includes the risk to reach greater heights, exposure to the radiation and sampling the entire building. A robotic solution is much more desirable in these cases, where the worker can safely handle the contaminations from a safe area. Use of robotic technologies inside these hazardous environments ensures the safety and enhances the performance. The more suitable robotic solution for reaching great heights and covering large areas of nuclear facilities, are aerial vehicles. Multi-rotor unmanned aerial vehicle (UAV) are chosen for their ability to hover at a position and also fly around in confined spaces. Quadrotors are a common choice of multi-rotor UAVs both research and industry because of its ease to fly and commercial availability. For the applications during the cleanups we need the UAV to not only hover and fly in confined spaces, but also interact with the physical world. Despite of quadrotor's advantages, they are not a best suit as they can't interact with the physical world. The tasks involving physical interactions would require the UAV to apply arbitrary forces and torques in all six degrees of freedom (DOF). As quadrotors are under-actuated and non-holonomic in motion, they cannot exert all the required forces. At Collaborative Robotics Lab, Purdue University, we developed a novel multi-rotor UAV solution, Dexterous Hexrotor, which can exert arbitrary forces and torques in all six DOF, independently and instantaneously. This enables the UAV platform to quickly respond to the external disturbances and precisely hold its position during the mission. The Dexterous Hexrotor serves as a robotic tool for the workers to perform sensing and sampling during the cleanups. Workers can operate Dexterous Hexrotor manually and/or semi-autonomously with human intervention. Manual control requires the worker to fly the Dexterous Hexrotor using a remote control. So the workers should possess knowledge on flying the UAV and to perform physical interaction. A semiautonomous Dexterous Hexrotor requires human input to some extent and requires very less knowledge of flying. The autonomy is designed to operate in flight mode and sampling mode. In flight mode, Dexterous Hexrotor takes off from a 'safe' area, reaches the desired altitude, and fly autonomously towards a sampling point. This sampling point is the target position specified on the 2D reference map. This mode also includes navigation towards the sampling point, avoiding the obstacles in the constrained environment. After reaching a stopping point, Dexterous Hexrotor waits for the human input for a target location to swab and collect samples. The Dexterous Hexrotor is now in sampling mode and waits for the human input. The human operator selects the swabbing location through the live streaming video from onboard camera. Through visual servoing, aided by the map, the UAV will move closer towards the target position. It then transitions to the impact control scheme to perform physical interaction with the wall and collects samples. Once the sample is collected, it autonomously returns back to the takeoff position in 'safe' area for the analysis by mass spectrometry. In this paper, we majorly focus on the physical interaction strategy and the required components which enables the autonomy. Decommissioning of nuclear facilities requires decontamination inside the entire buildings. Decontamination of nuclear facilities involves sensing and sampling the huge buildings, long shafts, etc. Sampling the entire facility is not possible due to the limitation in Dexterous Hexrotor's flight time. But this can be achieved by using a swarm of Dexterous Hexrotors to cover larger areas. The onboard robotic arm can be designed based on the applications such as cleaning, applying sealants, etc. The modularity of the design allows us to switch components as per the requirements of the task. These kind of robotic solutions functioning as tools for the workers, aims to make the work environment safer and playful. (authors)

42 ENGINEERING↗

Cleated Print Surface for Fused Deposition Modeling

Fused Deposition Modeling (FDM) has become popular among Additive Manufacturing technologies due to its speed, geometric scalability, and low cost; however, the primitive nature of the FDM build surface fundamentally limits the utility of FDM in terms of reliability, autonomy, and material selection. Currently, FDM relies on adhesive forces between the first layer of a print and the build surface; depending on the materials involved, this adhesive bond may or may not be reliable. Thermal contraction between the build plate and build materials can break that bond, which causes warpage and delamination of the part from the build surface and subsequent failure of the part. Furthermore, with each print, the user must use tools or manual maneuvering to separate the printed part from the build surface as well as retexture or replace the used build surface. In this paper, we present a novel build platform that allows for a mechanical bond between the print and build surface by using dovetail-shaped features. The first layer of the print flows into the features and becomes mechanically captivated by the build platform. Once the print is completed, the platform is rolled or flexed open to release the part from the mechanical bond. This design not only lowers the risk of delamination during printing but also eliminates the need for a user to reset or replace the build surface between print jobs. The effectiveness of each geometry was determined by measuring the distance at the pinch point compared to the distance that the extrusion filled below the pinch point. The captivation ratio was measured to compare the different geometries tested and determine which direction of extrusion creates a better ratio.

42 ENGINEERING↗

Real time explosive hazard information sensing, processing, and communication for autonomous operation

Methods, computer readable media, and apparatuses provide robotic explosive hazard detection. A robot intelligence kernel (RIK) includes a dynamic autonomy structure with two or more autonomy levels between operator intervention and robot initiative A mine sensor and processing module (ESPM) operating separately from the RIK perceives environmental variables indicative of a mine using subsurface perceptors. The ESPM processes mine information to determine a likelihood of a presence of a mine. A robot can autonomously modify behavior responsive to an indication of a detected mine. The behavior is modified between detection of mines, detailed scanning and characterization of the mine, developing mine indication parameters, and resuming detection. Real time messages are passed between the RIK and the ESPM. A combination of ESPM bound messages and RIK bound messages cause the robot platform to switch between modes including a calibration mode, the mine detection mode, and the mine characterization mode.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Space-Based Reconfigurable Software Defined Radio Test Bed Aboard International Space Station

The National Aeronautical and Space Administration (NASA) recently launched a new software defined radio research test bed to the International Space Station. The test bed, sponsored by the Space Communications and Navigation (SCaN) Office within NASA is referred to as the SCaN Testbed. The SCaN Testbed is a highly capable communications system, composed of three software defined radios, integrated into a flight system, and mounted to the truss of the International Space Station. Software defined radios offer the future promise of in-flight reconfigurability, autonomy, and eventually cognitive operation. The adoption of software defined radios offers space missions a new way to develop and operate space transceivers for communications and navigation. Reconfigurable or software defined radios with communications and navigation functions implemented in software or VHDL (Very High Speed Hardware Description Language) provide the capability to change the functionality of the radio during development or after launch. The ability to change the operating characteristics of a radio through software once deployed to space offers the flexibility to adapt to new science opportunities, recover from anomalies within the science payload or communication system, and potentially reduce development cost and risk by adapting generic space platforms to meet specific mission requirements. The software defined radios on the SCaN Testbed are each compliant to NASA's Space Telecommunications Radio System (STRS) Architecture. The STRS Architecture is an open, non-proprietary architecture that defines interfaces for the connections between radio components. It provides an operating environment to abstract the communication waveform application from the underlying platform specific hardware such as digital-to-analog converters, analog-to-digital converters, oscillators, RF attenuators, automatic gain control circuits, FPGAs, general-purpose processors, etc. and the interconnections among different radio components.

Communications↗

Open Humans: A platform for participant-centered research and personal data exploration

Background: Many aspects of our lives are now digitized and connected to the internet. As a result, individuals are now creating and collecting more personal data than ever before. This offers an unprecedented chance for human-participant research ranging from the social sciences to precision medicine. With this potential wealth of data comes practical problems (e.g., how to merge data streams from various sources), as well as ethical problems (e.g., how best to balance risks and benefits when enabling personal data sharing by individuals). Results: To begin to address these problems in real time, we present Open Humans, a community-based platform that enables personal data collections across data streams, giving individuals more personal data access and control of sharing authorizations, and enabling academic research as well as patient-led projects. We showcase data streams that Open Humans combines (e.g., personal genetic data, wearable activity monitors, GPS location records, and continuous glucose monitor data), along with use cases of how the data facilitate various projects. Conclusions: Open Humans highlights how a community-centric ecosystem can be used to aggregate personal data from various sources, as well as how these data can be used by academic and citizen scientists through practical, iterative approaches to sharing that strive to balance considerations with participant autonomy, inclusion, and privacy.

59 BASIC BIOLOGICAL SCIENCES↗

Hazard Perception & Avoidance (HPA), Assured Vehicle Automation 1 Simulation (AVA-1h) Results Outbrief

In late 2022, the Human Autonomy Teaming Lab (NASA Ames Research Center) conducted a manned, human-in-the-loop (HITL) simulation. This HITL was the lab’s second Hazard Perception and Avoidance (HPA) technical work under NASA’s Advanced Air Mobility (AAM), Automated Flight and Contingency Management (AFCM) Sub-Project. The goals were to assess detect and avoid technology for manned, electric vertical takeoff and landing (eVTOL) aircraft. This simulation tested Resolution Advisory (RA) responses and return-to-course (RTC) maneuvers for the second version of the Airborne Collision Avoidance System’s (ACAS) rotary-wing (Xr) variant. This was conducted at the center's Vertical Motion Simulator (VMS), on a motion-based platform, and was configured to fly eVTOL aircraft while maneuvering for intruding traffic. Variables for this study included ACAS Xr modes (i.e., TA/RA and DAA) and phases of flight (i.e., Cruise, Hover, and Approach). The data collected included response times, losses of well clear, and pilots' noncompliances to alerts and guidance as well as subjective ratings like acceptability and perceived workload. Additional details and future anticipations are also discussed.

ACAS Xr↗

m:N ConOps/R&R Remote Simulation

This presentation details the experimental design of an investigation of small unmanned aircraft system (sUAS) operations involving multiple vehicle management by a remote operator. The study is part of an ongoing effort to explore multiple vehicle control by multiple operators, i.e., the control of N vehicles by m operators (m:N operations). For this effort, NASA and collaborators have developed prototypes of a concept of operations (ConOps), roles and responsibilities (R&R) for operators and supervisors, and a ground control station (GCS), including software displays and interfaces. Participants in this study acted as the pilot-in-command of twelve aircraft flying pre-approved routes in a simulation of a food delivery operation utilizing sUAS in the San Diego, CA area. Each participant experienced four experimental trials. Twice within the course of each trial, participants were responsible for responding to a sudden, unanticipated, and high-priority contingency: an airspace restriction for sUAS operations known as a UAS Volume Reservation (UVR). Upon issuance of a UVR, pilots were expected to reroute affected vehicles around the airspace. The level of automation (LoA) and workload of the flight rerouting task were varied. The LoA was manipulated by providing reroute suggestions ("auto" condition) for aircraft or by requiring pilots to manually reroute ("manual" condition) affected vehicles. Workload was varied as a function of the number of vehicles affected by the UVR contingencies: 2 vehicles ("low workload" condition) versus 4 vehicles ("high workload" condition). Additionally, some vehicles required pilots to adjust for terrain conflicts while avoiding the UVR region. Due to the COVID-19 pandemic, in-person data collection for this study was not possible. Researchers adapted to this circumstance through the development of remote data collection protocol. Participants were able to view adapted GCS displays using the Microsoft Teams teleconferencing platform and responded to events by using a verbal protocol developed for the experiment. Using this protocol, participants provided instructions for actions to a researcher, referred to as the surrogate, to carry out on their behalf. This presentation describes the experiment design, including special details for remote data collection via a subject-surrogate configuration, and concludes with planned data analysis and results to be presented at a later date.

multi-UAS↗

Automated, Unmanned Detection and Quantification of Fugitive Methane Emissions

Compressor stations used to move natural gas are one of the largest sources of fugitive methane emissions in the midstream sector, accounting for approximately 50% of all fugitive emissions (Zimmerle et al., 2015). This problem is most widespread at reciprocating compressors (Subramanian et al., 2015) where faulty seals are a key contributor to methane emissions (Johnson et al., 2015). As such, there is a significant need for a robust technology that could provide an early indication of an unexpected emission. Equally important, the technology needs to be able to account for biogenic versus anthropogenic sources of methane. One means of indirectly making this determination, is to leverage optical technologies that can autonomously pinpoint the source of such leaks. This presentation discusses recent work funded by the U.S. Department of Energy (DOE) National Energy Technology Laboratory (NETL), focused on the development of an innovative remote sensing technology that can reliably and autonomously detect fugitive methane emissions in near real-time, using computer vision and deep learning. The technology called the Smart Methane Leak Detection (SLED/M) system was initially developed to monitor facilities such as compressor stations in a stationary, pan-tilt-zoom configuration. The system has recently been adapted to monitor facilities from an unmanned aerial system (UAS). The speed and maneuverability of UAS platforms are attractive to leak detection and repair program operators, but introduce several challenges. Many existing methane detection algorithms rely on mostly static backgrounds becoming unusable with motion. In addition, top-down views of fugitive methane emissions present differently in Optical Gas Imagers (OGI) compared to looking across the plume. Our work has focused on overcoming these challenges, enhancing the operators ability to detect methane emissions, and pinpoint their sources. Another recent adaptation to SLED/M is the ability to quantify methane emissions using passive sensors (OGI, thermal camera), environmental conditions, plume modeling, and deep learning. SLED/M advances the state-of-the-art for methane emission detection and quantification by focusing on three key critical criteria for effective methane emission mitigation: (1) autonomy (no need for a human to be in the loop), (2) high reliability (low false alarm rates), and (3) real-time performance. Results from this work will be presented.

03 NATURAL GAS↗