Distributed Visual Sensing and Fusion for Advanced Air Mobility

Abstract

Surveillance solutions for Advanced and Urban Air Mobility frameworks are a key factor to enable safe operations of highly automated aircraft in the civil airspace. To design solutions suitable for all types of aircraft, non-cooperative sensors can be used, though many challenges arise when the small dimensions of the vehicles and their proximity to the ground during low-altitude missions are considered. A distributed sensing concept can be efficiently applied to address these challenges by exploiting multiple sensors within a surveillance network. This paper proposes a strategy to fuse the information collected by three ground-fixed cameras within a network of multiple distributed sensors and is tested with during experimental flight tests. The solution exploits standalone tracking estimates of each camera within a fusion center that performs triangulation and three-dimensional tracking. This approach is tested in a scenario involving two small UAVs flying at low altitude. The paper deals with the challenges of associating the two objects from independent and unrelated tracks to achieve robust triangulation, which produces meter-level mean errors with respect to GNSS-based ground truth.