Multi-View, Deep Learning, and Contextual Analysis: Promising Approaches for sUAS Land Cover Classification
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Abstract not provided.
Small unmanned aerial systems (sUAS) have the potential for a large array of highly-beneficial applications. These applications are too numerous to comprehensively list, but include search and rescue, fire spotting, precision agriculture, etc. to name a few. Typically sUAS vehicles weigh less than 55 lbs and will be performing flight operations in the National Air Space (NAS). Certain sUAS applications, such as package delivery, will include operations in the close proximity of the general public. The full benefit from sUAS is contingent upon the resolution of several technological areas in order to provide an acceptable level of risk for widespread sUAS operations. Operations of sUAS vehicles pose risks to people and property on the ground as well as manned aviation. Several of the more significant sUAS technological areas include, but are not limited to: autonomous sense and avoid and deconfliction of sUAS from other sUAS and manned aircraft, communications and interfaces between the vehicle and human operators, and the overall reliability of the sUAS and constituent subsystems. While all of the technological areas listed contribute significantly to the safe execution of the sUAS flight operations, contingency or emergency systems can greatly contribute to sUAS risk mitigations to manage situations where the vehicle is in distress. The Safe2Ditch (S2D) system is an autonomous crash management system for sUAS. Its function is to enable sUAS to execute emergency landings and avoid injuring people on the ground, damaging property, and lastly preserving the sUAS and payload. A sUAS flight test effort was performed to test the integration of sub-elements of the S2D system with a representative sUAS multi-rotor.
This Cognitive Task Analysis (CTA) study was designed to understand the capability of the m:N Tactical Operator (TO) interfaces developed by the Human-Autonomy Teaming Laboratory at NASA Ames to support operators responsible for simplified pilot operations of 100 independently operated small UAS (sUAS) in a constrained geographic area. The m:N sUAS TO interface includes a central Tactical Situation Display (TSD) digital map with moving icons reflecting the sUAS location and planned flight route. The interface also has two side panels. The left panel includes a tabular list of UAS assets and mission tasking, a list of recently viewed assets, and a list of events and alerts. The right panel includes a tabular list of UAS assets and their associated telemetry, text-based chat communication window, and a tabbed checklist window. This CTA was adapted from the incident-based applied cognitive task analysis (Militello & Hutton, 1998) and included demographics questions, scenario-based simulations, a task diagram and knowledge audit methods. In addition to examining the support provided by this m:N sUAS TO interface, this CTA study, conducted with aviation subject matter experts in analogous roles to the future tactical operator, was designed to illuminate and project likely cognitive requirements of the tactical operator. Interviewees participated in two scenario-based simulations using the m:N sUAS TO interfaces. In the first simulation, the interviewees supervised 12 sUAS operating in downtown San Diego, California transiting to and from a central sUAS Hive, restaurant locations, and customer drop off locations. Interviewees were asked to react to a UAS Volume Reservation (UVR) event with a two-phase impact on food delivery operations. In the second scenario, the interviewees supervised 100 sUAS operating in the same airspace and with the same mission. Interviewees used the interfaces to recognize and react to two sUAS air vehicle problems. After each scenario, we asked the interviewees a semi-structured list of questions to elicit their reflections about using the interfaces. Interviewees were confident in their ability to respond to two off-nominal situations in each simulation. Interviewees felt that, given high levels of automation on the sUAS, they would be able to manage the events without requiring additional support or handing off the sUAS to a colleague or supervisor in both the n=12 or n=100 sUAS settings. In the n=12 sUAS condition, interviewees used the center map to understand the asset location and progress along with mission tasking. An additional display window, Asset Telemetry, helped interviewees understand battery state and sUAS altitude. When the number of sUAS increased, interviewees altered their behavior. Rather than maintaining awareness of individual assets, interviewees appeared to become more reactive, managing exceptions. Interviewees reported that they spent less time looking at the nominal aircraft, and focused their attention primarily on the off-nominal aircraft. In addition, in the second simulation with n=100 sUAS, interviewees reported that they relied more on the side panels (Mission Timeline and Asset Telemetry) to gather information.
With many applications envisioned for small Unmanned Aircraft Systems (sUAS), and potentially millions of sUAS expected to be in operation in the future, the electromagnetic interference environment associated with the sUAS is of interest to understanding the potential performance impacts on the sUAS command and control communications link as well as the sUAS payload and payload links. As part of NASA's UAS Traffic Management (UTM) Project, flight experiments are planned to characterize the RF environment at altitudes up to 400 ft to better understand how UTM command and control links can be expected to perform. The flight experiments will use an RF channel sensing payload attached to an sUAS. In terms of the payload being capable of measuring relatively low level signals at altitude, electromagnetic interference (EMI) emanating from the sUAS vehicle itself could potentially complicate the measurement process. For this reason, NASA was interested in measuring the EMI performance of the sUAS planned for these flight experiments, a DJI model S1000. The S1000 was thus measured in a controlled EMI test chamber at the NASA Ames Research Center. The S1000 is a carbon fiber based platform with eight rotors. As such, the EMI test results represent potential performance of a number of similar sUAS types. sUAS platforms significantly different from the S1000 may also require EMI testing, and the method employed for NASA's S1000 EMI tests can be applied to other platforms. In this paper we describe the UTM project, the RF channel sensing payload, the EMI testing method and EMI test results for the S1000, and discuss the implications of these results.
With many applications envisioned for small Unmanned Aircraft Systems (sUAS), and potentially millions of sUAS expected to be in operation in the future, the electromagnetic interference environment associated with the sUAS is of interest to understanding the potential performance impacts on the sUAS command and control communications link as well as the sUAS payload and payload links. As part of NASAâ€"TM"s UAS Traffic Management (UTM) Project, flight experiments are planned to characterize the RF environment at altitudes up to 400 ft to better understand how UTM command and control links can be expected to perform. The flight experiments will use an RF channel sensing payload attached to an sUAS. In terms of the payload being capable of measuring relatively low level signals at altitude, electromagnetic interference (EMI) emanating from the sUAS vehicle itself could potentially complicate the measurement process. For this reason, NASA was interested in measuring the EMI performance of the sUAS planned for these flight experiments, a DJI model S1000. The S1000 was thus measured in a controlled EMI test chamber at the NASA Ames Research Center. The S1000 is a carbon fiber based platform with eight rotors. As such, the EMI test results represent potential performance of a number of similar sUAS types. sUAS platforms significantly different from the S1000 may also require EMI testing, and the method employed for NASAâ€"TM"s S1000 EMI tests can be applied to other platforms. In this paper we describe the UTM project, the RF channel sensing payload, the EMI testing method and EMI test results for the S1000, and discuss the implications of these results.
Small unmanned aerial systems (sUAS) have been studied and results indicate that there is a large array of highly-beneficial applications. These applications are too numerous to list, but include search and rescue, fire spotting, precision agriculture, etc. to name a few. Typically sUAS vehicles weigh less than 55 pounds and will be performing flight operations in the presence of manned aircraft and other sUAS. Certain sUAS applications, such as package delivery, will include operations in the close proximity of the general public. The full benefit from sUAS is contingent upon the resolution of several technological areas to enable free and widespread use of these vehicles. Technological areas in question include, but are not limited to: autonomous sense and avoid and deconfliction of sUAS from other sUAS and manned aircraft, communications and interfaces between the vehicle and human operators, and high-reliability autonomous systems. The NASA UAS Traffic Management (UTM) project is endeavoring to develop a traffic management system and concept of operations for these types of vehicles. An extensive sUAS flight test effort was performed to partially address vehicle-related technological areas and to shape an understanding of future developmental and test efforts for vehicles intended to use the UTM traffic management system. The flight testing described herein had the following objectives: 1) Install and test Dedicated Short Range Communications (DSRC) systems developed for the automotive industry for potential sense and avoid sUAS applications; 2) Evaluate the use of cellular 4G systems to provide vehicle control; 3) Obtain high-resolution video imagery in support of image-based optical detection sense and avoid systems; 4) Acquire data in fixed-wing flight to support validation and maturation of an autonomous range containment system known as Safeguard in fixed-wing flight. A total of 53 flights were performed over 12 operational days at Beaver Dam Airpark in Elberon, VA. This work was sponsored by the UTM project that is part of the Aviation Operations and Safety Program (AOSP) at NASA.
The P- and R-Area Reactor buildings, located at SRS near Aiken, SC, were in-situ decommissioned by grouting below-grade portions of the buildings and demolishing some above-grade structures to grade level. Other reactor building structures were left above-grade and sealed to prevent human or animal access. Because the above grade-structures are expected to continue in their present state for hundreds of years, the condition of the building roofs is critical to mitigate rainwater intrusion. For this reason, building roof areas were strengthened with high strength concrete to ensure the long-term integrity of the roof structure. Periodic inspections of the roof structures are required to ensure that the roofs are functioning properly and to identify damage areas. The traditional method of inspecting closed reactor buildings requires the use of a helicopter and photographer to generate photographs and videos for review. This method proved sufficient but lacked the resolution and clarity that is required for a thorough inspection of the building structure. Fortunately, the Savannah River National Laboratory (SRNL) has established a Small Unmanned Aircraft System (sUAS) program using commercially available and custom-built remote-controlled aircraft. EC and ACP contacted the SRNL program to evaluate whether the sUAS technology could be employed for periodic reactor building inspections. The sUAS can fly within a few meters of the reactor buildings and hover, allowing for a more thorough aerial inspection. The initial sUAS inspection of the P-Area Reactor building was completed in February 2018 and at the R-Area Reactor building in August 2018 and were successful in providing higher resolution photos and videos. The sUAS inspections also revealed that vegetation had begun to grow on the roofs that could potentially damage the structure integrity. SRNL partnered with Virginia Polytechnic Institute and State University to build a custom heavy lift sUAS that could be equipped with herbicides to remotely treat the vegetative growth. Herbicides were successfully applied to the R-Area Reactor building roof using the custom sUAS in September 2018. The use of unmanned aircraft systems at SRS to perform aerial inspections and herbicide treatment in otherwise inaccessible areas has proven to be an efficient and cost-effective technology that provides high value, increases knowledge of facility conditions, and provides for early detection of damage. Periodic inspections of the reactor building roofs using sUAS technology are performed safely, efficiently, and at a significant cost and schedule savings while reducing emissions, noise, and fossil fuel use. The use of sUAS equipment for building inspections and herbicide application at SRS is unique within the DOE complex. The goal of SRS is to apply this remote technology to other waste unit operations and maintenance activities in the future. (authors)
The projected use of small unmanned aerial systems (SUAS) in military operations will produce training requirements which go beyond current capabilities. The paper describes the development of prototype training procedures and accompanying research simulations to address this need. We initially constructed a testbed to develop simulation-based training for an SUAS operator equipped with a simulated vertical-lift and land SUAS. However, the required training will go beyond merely training an operator how to pilot an SUAS. In addition to tactics, techniques, and procedures for employment of SUASs, collective training methods must be trained. Moreover, the leader of a unit equipped with SUAS will need to learn how to plan missions which incorporate the SUAS, and take into account air space and frequency management considerations. The demands of the task require the leader to allocate personnel to the SUAS mission, communicate and coordinate with those personnel during the mission, and make use of the information provided. To help address these training issues, we expanded our research testbed to include a command and control node (C2 node), to enable communications between a leader and the SUAS operator. In addition, we added a virtual environment in which dismounted infantry missions can be conducted. This virtual environment provides the opportunity for interactions among human-controlled avatars and non-player characters (NPCs), plus authoring tools to construct scenarios. Using these NPCs, a collective exercise involving friendly, enemy, and civilian personnel can be conducted without the need for a human role-player for every entity. We will describe the results of our first experiment, which examined the ability of players to negotiate use of the C2 node and the virtual environment at the same time, in order to see if this is a feasible combination of tools for training development.
In the marine boundary layer, the exchange of momentum, heat, and moisture occurs between the atmosphere and ocean. Since it is too dangerous for a crewed aircraft to fly close to the ocean surface to directly obtain these measurements, a sUAS (small Uncrewed Aircraft System) is one of the only viable options. On 24 March 2023 a Black Swift Technologies S0 sUAS was deployed from the NOAA P-3 on a calm clear day off the west coast of Florida. For 23 min at the end of the mission, the sUAS flew 8 straight line legs with an average length of 2.15 km, at roughly 10 m above the ocean surface, with wind speeds between 3.0 and 4.5 m s −1 . For the first time over the open ocean using a sUAS, the 4-Hz wind and thermodynamic data was used to calculate surface momentum flux, sensible heat flux, and latent flux using both direct covariance methods and the bulk aerodynamic formulas. Since all the flux quantities can be found using both direct and indirect methods, we are able to calculate the exchange coefficients of momentum flux (C D ), latent heat flux (C E ), and sensible heat flux (C H ) with results that are generally in good agreement with previous studies over the same wind speed range. This study demonstrates the ability of sUAS to measure air-sea interactions. Future intention is to use sUAS to obtain similar measurements in high wind events such as hurricanes which could better help understand hurricane intensification and improve model physics.
The number of small Unmanned Aircraft System (sUAS) operating in the low-altitude of the National Airspace System (NAS) has been rapidly increasing in the past few years and this number is expected to grow in the future. However, aside from a few special cases, all sUAS must fly within visual line-of-sight (VLOS) of their operators and this limitation is blocking highly anticipated beyond visual line-of-sight (BVLOS) sUAS applications such as package delivery from practice. To enable routine low-altitude BVLOS operations, there needs to be a traffic management ecosystem that complements the FAA’s Air Traffic Management (ATM) system, which does not provide air traffic services under 400 feet above ground level (AGL). NASA has been pioneering research and development of this ecosystem under UAS Traffic Management (UTM) project since 2015 in a series of Technical Capability Levels (TCL) activities that are increasingly complex. In TCL1, completed in 2015, visual line-of-sight operations such as agriculture, firefighting, and infrastructure monitoring were addressed with a focus on geofencing and operations scheduling. Technologies and requirements needed for BVLOS operations in sparsely populated areas were examined in TCL2 in 2016, and those for operations over moderately populated areas in TCL3 in 2017 and 2018. TCL4 is building on the earlier TCLs and focuses on technologies and requirements for operations in higher-density urban areas for tasks such as newsgathering and package delivery and for managing large-scale contingencies. To coordinate and facilitate the incremental implementation of the UTM ecosystem in the NAS, a Research Transition Team (RTT) has been formed between the FAA, NASA, and industry. The RTT is divided into four subgroups, concept and use case development, data exchange and information architecture, sense and avoid, and communications and navigation (C&N). This paper focuses on C&N subgroup activities, in particular about the development of automated sUAS communications and navigation contingency management. The goal of this development is to prepare sUAS to display predictable behavior while handling C&N off-nominal events. It is expected that the adoption of the presented automated contingency management by the sUAS community will accommodate and inform rulemaking towards governing low-altitude BVLOS operations.
The number of small Unmanned Aircraft System (sUAS) operating in the low-altitude of the National Airspace System (NAS) has been rapidly increasing in the past few years and this number is expected to grow in the future. However, aside from a few special cases, all sUAS must fly within visual line-of-sight (VLOS) of their operators and this limitation is blocking highly anticipated beyond visual line-of-sight (BVLOS) sUAS applications such as package delivery from practice. To enable routine low-altitude BVLOS operations, there needs to be a traffic management ecosystem that complements the FAA’s Air Traffic Management (ATM) system, which does not provide air traffic services under 400 feet above ground level (AGL). NASA has been pioneering research and development of this ecosystem under UAS Traffic Management (UTM) project since 2015 in a series of Technical Capability Levels (TCL) activities that are increasingly complex. In TCL1, completed in 2015, visual line-of-sight operations such as agriculture, firefighting, and infrastructure monitoring were addressed with a focus on geofencing and operations scheduling. Technologies and requirements needed for BVLOS operations in sparsely populated areas were examined in TCL2 in 2016, and those for operations over moderately populated areas in TCL3 in 2017 and 2018. TCL4 is building on the earlier TCLs and focuses on technologies and requirements for operations in higher-density urban areas for tasks such as newsgathering and package delivery and for managing large-scale contingencies. To coordinate and facilitate the incremental implementation of the UTM ecosystem in the NAS, a Research Transition Team (RTT) has been formed between the FAA, NASA, and industry. The RTT is divided into four subgroups, concept and use case development, data exchange and information architecture, sense and avoid, and communications and navigation (C&N). This paper focuses on C&N subgroup activities, in particular about the development of automated sUAS communications and navigation contingency management. The goal of this development is to prepare sUAS to display predictable behavior while handling C&N off-nominal events. It is expected that the adoption of the presented automated contingency management by the sUAS community will accommodate and inform rulemaking towards governing low-altitude BVLOS operations.
Onboard far-field aircraft detection is needed for safe non-cooperative traffic mitigation in autonomous small Unmanned Aerial System (sUAS) operations. Machine vision systems, based on standard optics and visible light detectors, possess the ideal size, weight, and power (SWaP) requirements for sUAS. This work presents the design and analysis of a novel aircraft detection and tracking pipeline based on optical sensing alone. Key contributions of the work include a refined range inequality model based on sensing and detection with FAA well-clear separation assurance distances between aircraft in mind, a detector fusion method to maximize the benefit of two image detectors, and a comparative analysis of Linear Kalman-filtering and Extended Kalman-filtering to seek optimal tracking performance. The pipeline is evaluated offline against multiple intruder platforms, using two types of flight encounters: multirotor sUAS vs. fixed-wing sUAS and multirotor sUAS vs. general aviation(GA)plane. Analysis is restricted to the rate-limiting head-on and departing collision volume cases vertically separated for safety. Results indicate that it is feasible to use the proposed optical spatial-temporal tracking algorithm to provide adequate alerting time to prevent penetration of well-clear separation volumes for both sUAS and GA aircraft.
The Department of Energy Savannah River Operations Office Savannah River National Laboratory Unmanned Aircraft System Aviation Implementation Plan was written to provide guidance for the safe, efficient, and lawful operation of the SRNL small Unmanned Aircraft System (sUAS) Program. It shall be the intent of every sUAS remote pilot in command to make reasonable effort not to invade a person's reasonable expectation of privacy when operating the sUAS. SRS sUAS operations will be conducted in accordance all applicable Federal Aviation Administration (FAA), Department of Energy (DOE), and DOE-Savannah River Operations Office (DOE-SR) regulations, policies and procedures. All sUAS operations will be conducted in accordance with the applicable FAA issued DOE Certificate of Authorization (COA) and be approved by the applicable DOE-SR Flight Readiness Review Board (FRRB). The scope of this document is limited to remote pilots in command of sUAS's in support of the DOE, DOE-SR, or SRS missions, research & development (R&D) and national security strategic initiatives supported by SRNL, and other approved missions as required in the US National Airspace (NAS) as defined by the FAA.
Abstract Small uncrewed aircraft systems (sUAS) are regularly being used to conduct atmospheric research and are starting to be used as a data source for informing weather models through data assimilation. However, only a limited number of studies have been conducted to evaluate the performance of these systems and assess their ability to replicate measurements from more traditional sensors such as radiosondes and towers. In the current work, we use data collected in central Oklahoma over a 2-week period to offer insight into the performance of five different sUAS platforms and associated sensors in measuring key weather data. This includes data from three rotary-wing and two fixed-wing sUAS and included two commercially available systems and three university-developed research systems. Flight data were compared to regular radiosondes launched at the flight location, tower observations, and intercompared with data from other sUAS platforms. All platforms were shown to measure atmospheric state with reasonable accuracy, though there were some consistent biases detected for individual platforms. This information can be used to inform future studies using these platforms and is currently being used to provide estimated error covariances as required in support of assimilation of sUAS data into weather forecasting systems.
The new Federal Aviation Administration (FAA) Small Unmanned Aircraft rule (Part 107) marks the first national regulations for commercial operation of small unmanned aircraft systems (sUAS) under 55 pounds within the National Airspace System (NAS). Although sUAS flights may not be performed beyond visual line-of-sight or over non- participant structures and people, safety of sUAS operations must still be maintained and tracked at all times. Moreover, future safety-critical operation of sUAS (e.g., for package delivery) are already being conceived and tested. NASA's Unmanned Aircraft System Trac Management (UTM) concept aims to facilitate the safe use of low-altitude airspace for sUAS operations. This paper introduces the UTM Risk Assessment Framework (URAF) which was developed to provide real-time safety evaluation and tracking capability within the UTM concept. The URAF uses Bayesian Belief Networks (BBNs) to propagate off -nominal condition probabilities based on real-time component failure indicators. This information is then used to assess the risk to people on the ground by calculating the potential impact area and the effects of the impact. The visual representation of the expected area of impact and the nominal risk level can assist operators and controllers with dynamic trajectory planning and execution. The URAF was applied to a case study to illustrate the concept.
Recent proliferation of small Unmanned Aerial Systems (sUAS) applications requires onboard collision avoidance systems to mitigate the risk of collision with non-cooperative aircraft and manned aircraft, which may not see sUAS in time to perform an avoidance maneuver. An attractive avenue for onboard collision avoidance is the utilization of machine vision cameras due to their low size, weight and power (SWaP) requirements. In this paper, we characterize the range performance of a machine vision system developed in-house and mounted onto an sUAS. The technique was designed to estimate the performance of a sense-and-avoid system to ensure that the sensing components meet the well-clear requirements for the chosen platform and avoidance strategy. Experimental flight-test data was acquired from test-flights flown along multiple collision geometries for two intruders: a general Aviation (GA) aircraft and a fixed-wing sUAS. The ownship and both intruders were instrumented with inertial navigation systems (INS) recording position and attitude information. The range at first detection, 𝑹𝟎, was extracted from in-flight imagery of head-on collision course geometry synchronized with INS data from both aircraft and ground-truth values extracted from the raw imagery. This initial detection distance, 𝑹𝟎, scales with atmospheric attenuation. Therefore, under clear sky conditions, the derived 𝑹𝟎 value represents the upper bound on the detection range achievable by the test configuration of the detector. Results indicate that the maximum initial detection distance for a 4k resolution action camera fitted with a 41º Field of View (FOV) lens is 2.763 ± 0.037 km for a GA aircraft and 0.881 ± 0.061 km for a fixed-wing sUAS, respectively. The in results this study suggest that a vision-based detect and track system may be analyzed using the sensor characterization and contextualized within aircraft well-clear volumes.