Autonomous Freeflying Drones for Spacecraft Inspection
Explore the source record for details and available documents.
unmanned aerial vehicle (UAV)↗
SEARCH · Search NASA
Results for “Unmanned Autonomous Systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Vision guided landing of an an autonomous helicopter in hazardous terrain
Future robotic space missions will employ a precision soft-landing capability that will enable exploration of previously inaccessible sites that have strong scientific significance. To enable this capability, a fully autonomous onboard system that identifies and avoids hazardous features such as steep slopes and large rocks is required. Such a system will also provide greater functionality in unstructured terrain to unmanned aerial vehicles. This paper describes an algorithm for landing hazard avoidance based on images from a single moving camera. The core of the algorithm is an efficient application of structure from motion to generate a dense elevation map of the landing area. Hazards are then detected in this map and a safe landing site is selected. The algorithm has been implemented on an autonomous helicopter testbed and demonstrated four times resulting in the first autonomous landing of an unmanned helicopter in unknown and hazardous terrain.
Mars Landing↗
Oak Ridge National Laboratory Evaluation of Stream-Trained Models in Practice
The goal of this integration is to replicate the results from the original paper Autonomous Utility Pole Identification on different camera hardware and integrate the model into a live video stream provided by the unmanned aerial system (UAS) itself while in operation. This involves retraining the original model and validating its efficacy on multiple camera modules to select the most effective device for installation. Moreover, this integration requires writing software to handle the reception of a real-time streaming protocol stream from the UAS and run each frame through the model while allowing a user to monitor the camera feed.
97 MATHEMATICS AND COMPUTING↗
Change Detection Experiments Using Low Cost UAVs
This paper presents the progress in the development of a low-cost change-detection system. This system is being developed to provide users with the ability to use a low-cost unmanned aerial vehicle (UAV) and image processing system that can detect changes in specific fixed ground locations using video provided by an autonomous UAV. The results of field experiments conducted with the US Army at Ft. A.P.Hill are presented.
Logan, Michael J.↗
Spatial and Temporal Deconfliction of Trajectories in the Presence of Uncertainties
Demonstration of conflict-free movement for multi-agent teams in challenging scenarios is crucial in developing trust and trustworthiness in an autonomous transport system. Tolerance verification queries are explored as a mechanism to enforce spatial and temporal deconfliction for a cooperating team of Unmanned Aerial Systems (UAS) with prescribed heterogeneous path-following performance. Obstacles in the environment are modelled as set of polyhedra, whereas each vehicle’s trajectory is represented as a sequence of polynomial curves with C2 continuity, expressed in a Bernstein basis. Each vehicle is modelled as a point mass and a safety distance, informed by the geometry of the UAS and the worst-case path-following error. This defines a tube around the trajectories where each UAS is most likely to fly through. In addition, obstacles in the environment have an associated safety buffer around them to account for the uncertainty in their location and geometric description. The tolerance verification queries explored in this paper combine the safety distance information from each UAS and environmental hazard to compute trajectories that are contained within the safe configuration space. Tolerance verification is also compared with other proximity queries to determine the suitability of each method along the different steps of the trajectory generation algorithm. This paper analyzes the fitness and performance of three proximity queries – collision, tolerance verification, and distance computations – between polyhedral and polynomial curves to ensure deconfliction between obstacles and vehicles, but also between polynomial curves to guarantee safe separation among cooperating UAS.
trajectory generation↗
Harnessing Ocean Thermal Gradients Using Thermoelectric Based Submersibles for Ocean Power Applications
The urgent need for energy solutions in marine environments has accelerated the development of innovative technologies capable of leveraging natural resources for power generation. This study introduces a buoyancy-driven submersible system designed to harness ocean thermal gradients using thermoelectric generators (TEGs) and phase change materials (PCMs). The technology aims to provide autonomous power to offshore aquaculture farms, unmanned underwater vehicles (UUVs), offshore platform illumination, and ocean sensors, significantly reducing dependence on fossil fuels. Ocean thermal gradients, especially prevalent in mid-latitude regions, exhibit temperature differences between surface and deep waters ranging from 7 degrees Celsius to 30 degrees Celsius depending on seasonal variations. The proposed submersible technology utilizes TEGs to convert thermal energy from these gradients into electrical power, generating between 0.2 and 0.5 watts, while PCMs are employed to store and regulate this energy, ensuring a stable and continuous power supply. The buoyancy-driven mechanism of the submersible enhances its capability to navigate through varying depths, optimizing its exposure to different thermal gradients and maximizing energy harvesting. The performance of this submersible system is analyzed through detailed thermodynamic assessments and computational fluid dynamics (CFD) modeling focused on heat transfer. These analyzes consider real-world ocean temperature profiles and seek to refine the interaction between TEGs and PCMs to optimize energy extraction. The evaluation encompasses several key performance metrics, including power output and energy efficiency. Results confirm the potential of this innovative technology to provide a continuous and reliable power source for marine applications. By demonstrating the feasibility of using ocean thermal gradients for energy generation, this study contributes to the broader efforts of innovation in energy technologies for harsh, remote marine environments. The implementation of such promises is significant advancements in the autonomy of marine operations. The ongoing research will further investigate scalability ensuring that the system can be effectively adapted to various marine settings and operational demands.
16 TIDAL AND WAVE POWER↗
Pathfinder autonomous rendezvous and docking project
Capabilities are being developed and demonstrated to support manned and unmanned vehicle operations in lunar and planetary orbits. In this initial phase, primary emphasis is placed on definition of the system requirements for candidate Pathfinder mission applications and correlation of these system-level requirements with specific requirements. The FY-89 activities detailed are best characterized as foundation building. The majority of the efforts were dedicated to assessing the current state of the art, identifying desired elaborations and expansions to this level of development and charting a course that will realize the desired objectives in the future. Efforts are detailed across all work packages in developing those requirements and tools needed to test, refine, and validate basic autonomous rendezvous and docking elements.
Lamkin, Stephen↗
Simulation and Flight Test Capability for Testing Prototype Sense and Avoid System Elements
NASA Langley Research Center (LaRC) and The MITRE Corporation (MITRE) have developed, and successfully demonstrated, an integrated simulation-to-flight capability for evaluating sense and avoid (SAA) system elements. This integrated capability consists of a MITRE developed fast-time computer simulation for evaluating SAA algorithms, and a NASA LaRC surrogate unmanned aircraft system (UAS) equipped to support hardware and software in-the-loop evaluation of SAA system elements (e.g., algorithms, sensors, architecture, communications, autonomous systems), concepts, and procedures. The fast-time computer simulation subjects algorithms to simulated flight encounters/ conditions and generates a fitness report that records strengths, weaknesses, and overall performance. Reviewed algorithms (and their fitness report) are then transferred to NASA LaRC where additional (joint) airworthiness evaluations are performed on the candidate SAA system-element configurations, concepts, and/or procedures of interest; software and hardware components are integrated into the Surrogate UAS research systems; and flight safety and mission planning activities are completed. Onboard the Surrogate UAS, candidate SAA system element configurations, concepts, and/or procedures are subjected to flight evaluations and in-flight performance is monitored. The Surrogate UAS, which can be controlled remotely via generic Ground Station uplink or automatically via onboard systems, operates with a NASA Safety Pilot/Pilot in Command onboard to permit safe operations in mixed airspace with manned aircraft. An end-to-end demonstration of a typical application of the capability was performed in non-exclusionary airspace in October 2011; additional research, development, flight testing, and evaluation efforts using this integrated capability are planned throughout fiscal year 2012 and 2013.
Howell, Charles T.↗
Independent Configurable Architecture for Reliable Operation of Unmanned Systems with Distributed Onboard Services
This paper presents the development of ICAROUS-2 (Independent Configurable Architecture for Reliable Operation of Unmanned Systems with Distributed Onboard Services), the second generation of a software architecture that integrates several algorithms as distributed onboard services to enable robust autonomous UAS applications. In particular, the ICAROUS architecture defines a framework to perform detect and avoid, geofencing, path monitoring, path planning, and autonomous decision making to ensure safety and mission progress. Most of the core algorithms implemented in ICAROUS are formally verified using an interactive theorem prover. These algorithms are composed together using a plan execution engine, whose operational semantics is formally specified. A description of the integrated architecture, services currently available, and flight test results highlighting the capability of ICAROUS are presented.
Balachandran, Swee↗
Independent Configurable Architecture for Reliable Operation of Unmanned Systems with Distributed Onboard Services
This paper presents the development of ICAROUS-2 (Independent Configurable Architecture for Reliable Operation of Unmanned Systems with Distributed Onboard Services), the second generation of a software architecture that integrates several algorithms as distributed onboard services to enable robust autonomous UAS applications. In particular, the ICAROUS architecture defines a framework to perform detect and avoid, geofencing, path monitoring, path planning, and autonomous decision making to ensure safety and mission progress. Most of the core algorithms implemented in ICAROUS are formally verified using an interactive theorem prover. These algorithms are composed together using a plan execution engine, whose operational semantics is formally specified. A description of the integrated architecture, services currently available, and flight test results highlighting the capability of ICAROUS are presented.
Balachandran, Swee↗
Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned
The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.
Matthew P Vaughan↗
The Anatomy of Software Changes and Bugs in Autonomous Operating System
Cyberphysical systems with autonomous functions are complex pieces of software, consisting of many components, some of which implement autonomous functionality and some may use AI or machine learning algorithms. Software bugs in an autonomous system are of particular concern, as they can have catastrophic consequences. However, detailed studies based on empirical data are rare and therefore these bugs are not well understood. This paper aims to contribute towards filling that gap by investigating the software changes and bugs in Autonomy Operating System (AOS) for Unmanned Aircraft Systems (UAS), which consist of 26 components containing about 103,000 lines of code and having a total of 772 bugfixes. Based on the data extracted from the code repository and semi-structured interviews with the developers of AOS, we explore the differences among autonomous software components, components developed using Model-based Software Engineering, and reuse with respect to change proneness, fault proneness, distribution of bugfixes among AOS components and files of these components, and characteristics of bugs of different AOS components. Our results show that the autonomous components were significantly more change prone (measured in number of commits and code churn) and fault prone (measured in bugfixes per KLoC) than non-autonomous components. The distribution of the locations of bugfixes was skewed, both at component and file level (i.e., a small number of components / files contained the majority of bugs). These evidence-based findings provide important insights to researchers and practitioners alike and can be used to efficiently improve the quality and reliability of autonomous systems.
Katerina Goseva-Popstojanova↗
Single launch lunar habitat derived from an NSTS external tank
A concept for using the spent external tank from a National Space Transportation System (NSTS) to derive a lunar habitat is described. The external tank is carried into low Earth orbit where the oxygen tank-intertank subassembly is separated from the hydrogen tank, berthed to Space Station Freedom and the subassembly outfitted as a 12-person lunar habitat using extravehicular activity (EVA) and intravehicular activity (IVA). A single launch of the NSTS orbiter can place the external tank in LEO, provide orbiter astronauts for disassembly of the external tank, and transport the required subsystem hardware for outfitting the lunar habitat. An estimate of the astronauts' EVA and IVA is provided. The liquid oxygen intertank modifications utilize existing structures and openings for man access without compromising the structural integrity of the tank. The modifications include installation of living quarters, instrumentation, and an airlock. Feasibility studies of the following additional systems include micrometeoroid and radiation protection, thermal control, environmental control and life support, and propulsion. The converted lunar habitat is designed for unmanned transport and autonomous soft landing on the lunar surface without need for site preparation. Lunar regolith is used to fill the micrometeoroid shield volume for radiation protection using a conveyer. The lunar habitat concept is considered to be feasible by the year 2000 with the concurrent development of a space transfer vehicle and a lunar lander for crew changeover and resupply.
King, Charles B.↗
Autonomous Flight Rules Concept: User Implementation Costs and Strategies
The costs to implement Autonomous Flight Rules (AFR) were examined for estimates in acquisition, installation, training and operations. The user categories were airlines, fractional operators, general aviation and unmanned aircraft systems. Transition strategies to minimize costs while maximizing operational benefits were also analyzed. The primary cost category was found to be the avionics acquisition. Cost ranges for AFR equipment were given to reflect the uncertainty of the certification level for the equipment and the extent of existing compatible avionics in the aircraft to be modified.
Cotton, William B.↗
Playbook for UAS: UX of Goal-Oriented Planning & Execution
We are evaluating Playbook for CASAS (Connected Autonomous Smart Aerospace Systems), a tool designed to aid first responders in disaster relief efforts. We are adapting an existing tool, Playbook, to support a future unmanned aircraft system (UAS) swarm demonstration. Playbook for CASAS will be used to plan, edit, and monitor simulated UAS swarms, and we are interested in evaluating the user experience of this prototype as well as developing recommendations for future UAS interfaces. Allocation of roles and responsibilities between human-automation systems is key to promoting productive cooperation between users and automation. Future interfaces, however, must allow for adaptive management of the swarm not a constant split in human-automation control. Our early research indicates that when a single pilot is controlling swarms of robotic agents, such as UAS or ground rovers, operators require a higher level, goal-based interface with usability at its core. Along with that high-level control, users can leverage sensors within the swarm to be notified when lower level actions must be taken by the pilot. First responders working in disaster relief efforts require a high level of situational awareness (SA) and precise control at key moments within a mission. This balance in operator workload paired with SA can lead to improved safety and mission outcomes. Our research below outlines leverage points as well as the balance between human involvement and autonomy in UAS interfaces.
UAS↗
Flight Testing of In-Time Safety Assurance Technologies for UAS Operations
Ongoing research at NASA is driven by a strategic plan defined by the Aeronautics Research Mission Directorate and a vision for future In-Time Aviation Safety Management Systems (IASMS) as described by the National Academies. In both visions, system safety awareness and provision are expanded through increased access to relevant data; integrated analysis and predictive capabilities; improved real-time detection and alerting of domain-specific hazards; decision support, and in some cases, automated risk mitigation strategies. One primary research focus is to develop means by which more timely (i.e., “in-time”) actions may be taken to mitigate precursors, anomalies, or trends that are observed during operations. In this paper, we describe such means as a collection of Services, Functions, and Capabilities (SFCs) that are supported by an underlying information system. For example, an integrated risk assessment capability is envisioned that continuously monitors safety-related metrics and margins and recommends timely operational changes. Assessment functions and/or services can be based on data analytics and predictive models derived from heterogeneous data sets that span relevant indicator metrics and their time histories. Likewise, on-board functions can identify and reduce susceptibility to precursor conditions that have led (and can lead) to aircraft loss-of-control or out-of-control accidents. This paper summarizes development and testing of such an information system tailored to hazards anticipated for future highly autonomous flight missions near and over densely populated areas. Testing is accomplished via simulation and by using small, unmanned aircraft operating over a test range at NASA’s Langley Research Center. Flight plans and test scenarios are defined to emulate several use-cases, including package delivery; reconnaissance; fire management; and urban air taxi vertiport operations. Two test phases are summarized with Phase 1 occurring in (2019-2020) and Phase 2 ongoing (2021-present). Results focus on SFC performance, technology readiness level assessment, and requirements discovery/validation. Companion papers are cited throughout for additional details on the recent testing.
safety management↗
SIG: Multiple Views on Safety-Critical Automation: Aircraft, Autonomous Vehicles, Air Traffic Management and Satellite Ground Segments Perspectives
This SIG focuses on the engineering of automation in interactive critical systems. Automation has already been studied in a number of (sub-) disciplines and application fields: design, human factors, psychology, (software) engineering, aviation, health care, games. One distinguishing feature of the area we are focusing on is that in the field of interactive critical systems properties such as reliability, dependability, fault tolerance are as important as usability, user experience or overall acceptance issues. The SIG targets at two problem areas: first the engineering of the user interaction with (partly-) autonomous systems: how to design, build and assess autonomous behavior, especially in cases where there is a need to represent on the user interface both autonomous and interactive objects. An example of such integration is the representation of an unmanned aerial vehicle (UAV) (where no direct interaction is possible), together with aircrafts (that have to be instructed by an air traffic controller to avoid the UAV). Second the design and engineering of user interaction in general for autonomous objects/systems (for example a cruise control in a car or an autopilot in an aircraft). The goal of the SIG is to raise interest in the CHI community on the general aspects of automation and to identify a community of researchers and practitioners interested in those increasingly prominent issues of interfaces towards (semi)-autonomous systems. The expected audience should be interested in addressing the issues of integration of mainly unconnected research domains to formulate a new joint research agenda.
human-automation interaction↗
CID-720 aircraft high-environment flight instrumentation system
The high-environment flight instrumentation system was designed to acquire Langley's structural response data during the full scale transport-controlled impact demonstration test. There was only one opportunity for data acquisition. Thus, a high reliability and crashworthy design approach was implemented. The approach featured multi-level redundancy and a vigorous quality assurance testing program. Complying with an accelerated schedule, the instrumentation system was developed, tested and shipped within 18 months to Dryden Flight Research Facility. The flight instrumentation system consists of two autonomous data systems, DAS #1 and #2, and an excellent checkout subsystem. Each data system is partitioned into four pallets. The system was designed to operate on manned and unmanned flights. There are 176 data channels per data system. These channels are sequentially sampled and encoded into 1 megabit/sec pulse code modulation (PCM) data signal. To increase the probability of success, a special PCM distribution subsystem was developed. This subsystem distributes the PCM signal to two transmitters, one delay memory, and eight recorder tracks. The data on four of these trackes was digitally delayed approximately 300 msec to maximize data acquisition during impact. Therefore each data system's data is redundantly recorded onboard and on the ground. There are two time code generators. Parallel time from each is encoded into both data systems. Serial time from each is redundantly recorded on both onboard recorders. Instrumentation power is independent of aircraft power and self-contained.
Calloway, R. S.↗