Search NASA⌕ Search

Engineering topics

Corey Ippolito

Publications and source records attributed to Corey Ippolito.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Perception Testing in Fog for Autonomous Flight

As the path towards Urban Air Mobility (UAM) continues to take shape, there are outstanding technical challenges to achieving safe and effective air transportation operations under this new paradigm. To inform and guide technology development for UAM, NASA is investigating the current state-of-the-art in key technology areas including traffic management, detect-and-avoid, and autonomy. In support of this effort, a new perception testbed was developed at NASA Ames Research Center to collect data from an array of sensing systems representative of those that could be found on a future UAM vehicle. This testbed, featuring a Light-Detection-and-Ranging (LIDAR) instrument, a long-wave infrared sensor, and a visible spectrum camera was deployed for a multiday test campaign in the Fog Chamber at Sandia National Laboratories (SNL), in Albuquerque, New Mexico. During the test campaign, fog conditions were created for tests with targets including a human, a resolution chart, and a small unmanned aerial vehicle (sUAV). This paper describes in detail, the developed perception testbed, the experimental setup in the fog chamber, the resulting data, and presents an initial result from analysis of the data with the evaluation of methods to increase contrast through filtering techniques.

advanced air mobility↗
NASA NTRSDate not supplied

Hierarchical Mixture of Experts for Advanced Air Mobility Flight Phase Classification

Advanced Air Mobility (AAM) and Urban Air Mobility (UAM) operations will have numerous vehicles and aircraft flying in the airspace, which poses safety and security concerns. Commercial airlines utilize Air Traffic Management (ATM) and Air Traffic Control (ATC) for real-time monitoring, surveillance, traffic coordination, and rerouting to maintain safe and efficient flight patterns. Transferring ATM and ATC architectures to AAM/UAM will be difficult to implement since AAM/UAM aircraft fly at lower altitudes, have more static and dynamic obstacles, operate in highly dense environments, and have several more aircraft to monitor for a given volume of the national airspace (NAS). Automatic flight phase classification will enhance efficiencies of ATM/ATC-like architectures for AAM/UAM. Classifying the main flight phases (takeoff, climb, cruise, descent, and landing) provides insight to ensure safe operations, provide situational awareness of the NAS, and monitor flights in case there are any emergencies. Typical flight phase classification methods are all-or-nothing, which will not capture or accurately classify the transitions between flight phases. Utilizing hierarchical mixture of experts (HME) provides a flight phase classification solution that includes transitions between the flight phases by assigning weights based on ground-based distributed sensor readings from cameras and radar. Adding the transitions between flight phases increases the fidelity of flight phase classification and provides deeper insight for flight phase classification by leveraging distributed sensing concepts.

distributed sensing↗
NASA NTRSDate not supplied

Ground-Based Vision Tracker for Advanced Air Mobility and Urban Air Mobility

Advanced Air Mobility (AAM) Air Mobility and Urban Air Mobility (UAM) require aircraft surveillance and monitoring for safety and security. Persistent tracking of flying objects provides Air Traffic Control (ATC) and Air Traffic Management (ATM) continuous coverage and knowledge of the national airspace (NAS). Since there are numerous more AAM and UAM aircraft than commercial aircraft, it will be challenging to utilize the same ATC/ATM architectures. A first step in creating a similar ATC/ATM architecture for AAM/UAM will require ground-based and airborne-based sensors to provide monitoring, which will be difficult in urban environments due to GPS degradation. This paper proposes a vision-based tracking method with static cameras by utilizing image subtraction and blob detection, which avoids adding additional electromagnetic interferences in the environment with sensors such as radar. The ground-based vision tracker (GBVT) outputs the detected objects' azimuth and elevation angles from unmanned aerial system (UAS) flight tests. Future and ongoing work includes sending the detected objects' azimuth and elevation angles as inputs for an extended Kalman filter (EKF) to estimate the position and velocity of the detected object.

distributed sensing↗
NASA NTRSDate not supplied

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗
NASA NTRSDate not supplied

Visual and Inertial Datasets for an eVTOL Aircraft Approach and Landing Scenario

A National Aeronautics and Space Administration (NASA) project developing computer vision algorithms for autonomous flight is producing real-world datasets with cameras mounted on aircraft. In related domains, such as autonomous driving, open datasets are key to innovation and advancement in computer vision and autonomous perception for future Advanced Air Mobility (AAM) operations. Few vision datasets, however, are publicly available in the aviation context. This paper introduces preliminary datasets containing several examples of approach and landing scenarios. The platform aircraft include a multirotor small unmanned aerial system (sUAS) and a crewed helicopter as surrogates for future electric vertical take-off and landing (eVTOL) aircraft. The dataset provides video imagery with associated inertial navigation system-global positioning system (INS-GPS) position and attitude estimates and other sensors. Surveyed locations of the visual features of the landing area are included. This dataset is the first to be released in an ongoing effort to collect and share large, diverse datasets relevant to autonomous aviation; community critique that can inform and improve future flight campaigns is welcome.

Nelson Brown↗
NASA NTRSDate not supplied

Hierarchical Mixture of Experts for Advanced Air Mobility Flight Phase Classification

Advanced Air Mobility (AAM) and Urban Air Mobility (UAM) operations will have numerous vehicles and aircraft flying in the airspace, which poses safety and security concerns. Commercial airlines utilize Air Traffic Management (ATM) and Air Traffic Control (ATC) for real-time monitoring, surveillance, traffic coordination, and rerouting to maintain safe and efficient flight patterns. Transferring ATM and ATC architectures to AAM/UAM will be challenging to implement since AAM/UAM aircraft fly at lower altitudes, have more static and dynamic obstacles, operate in highly dense environments, and have several more aircraft to monitor for a given volume of the national airspace (NAS). Aircraft typically have the following flight phases: takeoff, climb, cruise, descent, and landing. Classifying these flight phases provides insight into ensuring safe operations, providing situational awareness of the NAS, and monitoring flights in emergencies. Automatic flight phase classification will enhance the efficiencies of ATM/ATC-like architectures for AAM/UAM, especially since numerous aircraft will be flying in highly dense urban environments. Typical flight phase classification methods are all-or-nothing, which will not capture or accurately classify the transitions between flight phases. Utilizing hierarchical mixture of experts (HME) provides a flight phase classification solution that includes transitions between the flight phases by assigning weights based on ground-based distributed sensor readings from cameras and radar. Adding the transitions between flight phases increases the fidelity of flight phase classification and provides deeper insight into flight phase classification by leveraging distributed sensing concepts. Simulation results and post-processed flight test results demonstrate the utility of HME for automatic and robust flight phase classification for real-time AAM operations.

distributed sensing↗
NASA NTRSDate not supplied

Ground-Based Vision Tracker for Advanced Air Mobility and Urban Air Mobility

Advanced Air Mobility (AAM) Air Mobility and Urban Air Mobility (UAM) require aircraft surveillance and monitoring for safety and security. Persistent tracking of flying objects provides Air Traffic Control (ATC) and Air Traffic Management (ATM) continuous coverage and knowledge of the national airspace system (NAS). Given the significant disparity in the number of AAM and UAM aircraft compared to commercial aircraft in the NAS, coupled with the dense AAM/UAM operations in urban environments, employing the existing ATC/ATM architectures poses considerable challenges. A first step in creating a similar ATC/ATM architecture for AAM/UAM will require ground-based and airborne-based sensors to provide monitoring, which will be difficult in urban environments due to GPS degradation. This paper proposes a vision-based tracking method with static cameras by utilizing image subtraction and blob detection, which avoids adding additional electromagnetic interferences in the environment with sensors such as radar. The ground-based vision tracker (GBVT) outputs the detected objects' azimuth and elevation angles from unmanned aerial system (UAS) flight tests. Future and ongoing work includes sending the detected objects' azimuth and elevation angles as inputs for an extended Kalman filter (EKF) to estimate the position and velocity of the detected object.

distributed sensing↗
NASA NTRSDate not supplied

Development and Field Test Results of Distributed Ground Sensor Fusion Based Object Tracking

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based RF and other sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage for some sensor types, but RF signals are challenging because of their nature. This paper includes the results from simulations as well as field tests to support the observations and conclusions.

sensor fusion↗
NASA NTRSDate not supplied

Flight Test Configuration of the Sensor Payload and the Ground Nodes in Distributed Sensing Frameworks

The realization of the Urban Air Mobility (UAM) vision, entailing the deployment of high-density autonomous flights over urban areas, necessitates methodologies transcending contemporary airborne sensing techniques. An instrumental innovation in this realm is the advent of distributed sensing. In this paradigm, environmental sensors function as active agents, engaging in the triad of sensing, processing, and communication either amongst themselves, with ground stations, or both. This concerted effort creates a dynamic and responsive "smart space," facilitating real-time autonomous control. NASA Ames Research Center is actively engaged in a series of comprehensive indoor and outdoor flight tests to garner requisite data and insights essential for the actualization of this ambitious vision. This paper delineates the holistic configuration of the flight payload and the distributed ground nodes pivotal to the NASA flight test campaign. Furthermore, it expounds upon the intricacies of the sensor node communication framework. The narrative extends to provide a detailed overview of the strategic placement of distributed sensors and a comprehensive account of the varied indoor and outdoor flight tests orchestrated in pursuit of UAM objectives.

urban air mobility↗
NASA NTRSDate not supplied

Experimental Testing of Data Fusion in A Distributed Ground-Based Sensing Network for Advanced Air Mobility

Advanced Air Mobility (AAM) is an active area of development which foresees the integration of autonomous uncrewed aircraft into the civil airspace for air transportation of people and cargo. Safe integration requires significant technological developments and extensive testing phases of sensing and surveillance strategies in dense airspace. Compared to well-assessed manned aviation systems scenarios, surveillance strategies in the AAM and small Uncrewed Aircraft Vehicles(UAVs) context need to detect smaller platforms flying at lower altitude against cluttered backgrounds in dense airspace. Fusion of data provided by a network of distributed sensing nodes is a powerful tool to enable detection and tracking in such complex conditions. This paper contributes to this research direction by proposing a surveillance strategy for the AAM environment based on sensor fusion of data acquired by distributed ground-based radars. Specifically, experimental data collected with two independent radars, observing the flight of two small UAVs, are used. Data fusion at tracking level is based on a leader-helper strategy where the leader radar uses the helper’s measurements to increase the lifespan of its generated tracks. This solution shows promising results with a 10%increase in track coverage with respect to the standalone leader radar tracking solution. The paper also proposes an interference removal processing method which is applied on the data collected by one of the two radars.

Federica Vitiello↗
NASA NTRSDate not supplied

Optimal Sensor Mobility Design for Target Tracking with Distributed Sensing, Communication and Computing Infrastructure

The paper presents an airborne target tracking approach with data fusion from distributed stationary and mobile sensor network transmitted through a wireless/wired communication network and using a distributed computing infrastructure. To obtain high quality measurements, sensor flight platforms' positions and orientations are optimized with respect to the available target's position and velocity estimates, and a formation control strategy is applied to derive desired trajectories for the flight platforms. As sensors move, the communication network topology switching is determined using the worst-case approach to handle uncertainties in the target's and sensors' positions, which alters communication delays for sensors' data transmission to computing centers. An optimal data migration algorithm is periodically applied to determine these communication delays for each sensor and the optimal location with minimum end-to-end latency for the target tracking algorithm execution, which is based on adaptive information fusion from multi-modal mobile and stationary sensors inside an Extended Kalman Filter framework. The approach is validated in a desktop simulation environment using synthetic sensor data generated for a simulated target's flight.

Distributed sensing↗
NASA NTRSDate not supplied

Flight Test Design and Implementation for Airspace Independent Surveillance Through a Distributed Ground Based Sensor Network

The paper presents a system architecture for distributed sensing, networking and computing, its hardware implementation, and execution of initial flight experiments to validate theoretical findings. It induces development of distributed sensing requirements, framework, and architecture, development of distributed ground node hardware prototypes, integration of all nodes and testing of baseline functionalities, integration of in-house developed perception, migration and tracking software packages, establishing flight scenario and flyable path for a selected UAS, flying the air vehicle along the path, recording sensors measurements, pre-processing them and transferring the resulting data to an optimal computing center. It also addresses the challenges related to pre-flight hardware calibration, clock synchronization, sensor registration and establishing a communication network. Sensors data processing results demonstrate the functionality of the presented distributed architecture and satisfactory performance of the applied technologies.

Target tracking↗
NASA NTRSDate not supplied

Flight Test Design and Implementation for Independent Surveillance of an Airspace Through a Distributed Ground Sensing Network

The paper presents a system architecture for distributed sensing, networking and computing, its hardware implementation, and execution of initial flight experiments to validate theoretical findings. It induces development of distributed sensing requirements, framework, and architecture, development of distributed ground node hardware prototypes, integration of all nodes and testing of baseline functionalities, integration of in-house developed perception, migration and tracking software packages, establishing flight scenario and flyable path for a selected UAS, flying the air vehicle along the path, recording sensors measurements, pre-processing them and transferring the resulting data to an optimal computing center. It also addresses the challenges related to pre-flight hardware calibration, clock synchronization, sensor registration and establishing a communication network. Sensors data processing results demonstrate the functionality of the presented distributed architecture and satisfactory performance of the applied technologies.

Distributed sensing↗
NASA NTRSDate not supplied

Flight Test Configuration of the Sensor Payload and the Ground Nodes in Distributed Sensing Frameworks

The realization of the Urban Air Mobility (UAM) vision, entailing the deployment of high-density autonomous flights over urban areas, necessitates methodologies transcending contemporary airborne sensing techniques. An instrumental innovation in this realm is the advent of distributed sensing. In this paradigm, environmental sensors function as active agents, engaging in the triad of sensing, processing, and communication either amongst themselves, with ground stations, or both. This concerted effort creates a dynamic and responsive "smart space," facilitating real-time autonomous control. NASA Ames Research Center is actively engaged in a series of comprehensive indoor and outdoor flight tests to garner requisite data and insights essential for the actualization of this ambitious vision. This paper delineates the holistic configuration of the flight payload and the distributed ground nodes pivotal to the NASA flight test campaign. Furthermore, it expounds upon the intricacies of the sensor node communication framework. The narrative extends to provide a detailed overview of the strategic placement of distributed sensors and a comprehensive account of the varied indoor and outdoor flight tests orchestrated in pursuit of UAM objectives.

urban air mobility↗
NASA NTRSDate not supplied

Optimal Communication Topology Determination and Sensor Selection for Independent Airspace Surveillance

The paper presents an approach to sensors selection and network topology determination for independent airspace surveillance with maximum outcome and minimum cost using ground based distributed sensing, computing and communication network infrastructure. The selection criteria includes minimum estimation error, maximum airspace coverage, minimum communication time and power consumption while guaranteeing the system observability and providing in-time quality information to a monitoring observer. The developed algorithm uses multi-objective optimization strategy taking into account trade-offs between conflicting objectives and relaxations for in time implementation. It is implemented utilizing graph theoretic tools. The approach is validated in a desktop simulation environment using synthetic sensors data generated for a simulated multi-vehicle flight scenario in the selected regional airspace.

Distributed sensing↗
NASA NTRSDate not supplied

Large-Scale Simulation of a Distributed Sensing Network Supporting Regional Urban Air Mobility Operations

Urban Air Mobility (UAM) is set to transform transportation in densely populated regions like the San Francisco Bay Area. This paper introduces an innovative simulation approach to explore large-scale UAM scenarios, emphasizing the use of distributed sensing to enhance operational efficiency and safety. The Revolutionary Vertical Lift Technology (RVLT) model is employed as the framework for simulating complex interactions among multiple vehicles within urban landscapes. Strategically deployed ground sensor nodes enable distributed sensing, enhancing situational awareness and operational effectiveness. By integrating empirical data and geographical realism, the simulations provide a systematic analysis of the feasibility, efficiency, and safety considerations associated with UAM deployment in urban environments. Factors such as air traffic density and infrastructural requirements are thoroughly examined, offering actionable insights for policymakers and industry stakeholders. This paper aims to refine the structure and scenarios for large-scale simulations based on distributed sensing, thereby contributing to the advancement of UAM operations.

UAM↗
NASA NTRSDate not supplied

Distributed Vision Sensing of Small Uncrewed Aircraft Systems in Urban Traffic Corridors

The NASA Advanced Air Mobility mission will enable widespread low altitude passenger travel, cargo delivery, and a variety of public services through the development of Uncrewed Aerial Systems (UAS) operations. Ensuring safe, autonomous operations in densely populated environments requires careful consideration towards hazards including other aircraft, infrastructure, and evolving weather. Small Uncrewed Aerial Systems (SUAS) present a unique hazard to UAS operations as they share airspace and may be readily operated in a non-cooperative fashion. This work investigates distributed sensing of SUAS traversing an air traffic corridor in an urban setting. This work develops a distributed vision detect and track strategy at NASA Langley Research Center. Three nodes, each with at least one global shutter camera, are distributed around a traffic corridor to surveil flight operations for two SUAS performing low altitude flight operations. Each node is equipped with a GPS and cellular modem to enable timestamping and remote control of acquisition. Node one faces a traffic roundabout with buildings in the background and achieves 99% surveillance coverage for two SUAS against building and tree backgrounds at ranges 50 to 130m. The second node points down Langley Boulevard with trees and buildings in the background and achieves 99% coverage at separation distances between 70 and 180m. The analysis for the second node is limited to ranges below 180m due to low contrast against dark, tree backgrounds. Finally, the third node points down Langley Boulevard from another perspective and achieves 99% coverage at ranges 60m to 200m against mostly building with a few sections of trees in the background.

Chester V Dolph↗