Search NASA⌕ Search

Engineering topics

Thomas Lombaerts

Publications and source records attributed to Thomas Lombaerts.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2025

Considerations for Optimal Sensor Placement for Higher Accuracy Object Localization for Urban Air Mobility

Previous research into object localization has shown that sensor placement and alignment plays an important role in achieving higher accuracy levels of the estimated location of a tracked Urban Air Mobility Vehicle. In general, a near-orthogonal intersection between the ground node observation vectors results in the highest accuracy due to a smaller overlapping uncertainty region between both. This applies to triangulation by means of ground node camera angle observations as well as trilateration by means of ground node distance measurements. However, this simple concept is not easily fulfilled with a network of a limited number of static ground nodes and a moving object to be localized. This case study performs sensitivity analyses and explores practical ways on how to achieve higher estimate accuracy levels in this context.

sensor placement↗
NASA NTRS2025

Demonstration of Data Processing and Fusion from Distributed Radars for AAM Surveillance

Advanced Air Mobility (AAM) is an active area of development which foresees the integration of autonomous uncrewed aircraft into the civil airspace for air transportation of people and cargo. Safe integration requires significant technological developments and extensive testing phases of sensing and surveillance strategies in dense airspace. Compared to well-assessed manned aviation systems scenarios, surveillance strategies in the AAM and small Uncrewed Aircraft Vehicles (UAVs) context need to detect smaller platforms flying at lower altitude against cluttered backgrounds in dense airspace. Fusion of data provided by a network of distributed sensing nodes is a powerful tool to enable detection and tracking in such complex conditions. This paper contributes to this research direction by proposing a surveillance strategy for the AAM environment based on sensor fusion of data acquired by distributed ground-based radars. Specifically, experimental data collected with three independent radars, observing the flight of two small UAVs, are used. Data fusion at tracking level is based on a leader-helper strategy where the leader radar uses the helper’s measurements to increase the lifespan of its generated tracks. This solution shows promising results with a 10% increase in track coverage with respect to the standalone leader radar tracking solution. The paper also proposes an interference removal processing method which is applied on the data collected by two of the radars.

Federica Vitiello↗
NASA NTRS2024

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight↗
NASA NTRS2023

Distributed Ground Sensor Fusion Based Object Tracking for Autonomous Advanced Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage. Dropouts of individual sensors affect the accuracy of the tracking results, which agrees with expectations for partial coverage, when full localization is not achievable anymore. Finally, a study is performed to identify which parameters have the largest impact on the fit error.

Autonomous↗
NASA NTRS2022

Vision-Based Precision Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft require perception systems for precision approach and landing systems (PALS) in urban, suburban, rural, and regional environments. The current state-of-the-art methods approved for automated approach and landing will be difficult to utilize in support of AAM operational concepts. However, there are technology and systems from other applications and lower-TRL research that use vision, IR, radar, and GPS methods to provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL to demonstrate a closed-loop baseline controller while adhering to the Federal Aviation Administration requirements and regulations. The coplanar algorithm determines pose estimation, which feeds into an Extended Kalman filter. Combining IMU with vision creates a sensor fusion navigation solution for GPS-denied environments. The state estimate leads to glideslope and localizer error computations, which will be pertinent for designing and deriving guidance laws and control laws for AAM PALS. The IMU and vision navigation solution provides promising simulation results for AAM PALS, and higher fidelity simulations will include computer graphics rendering and feature correspondence.

Evan Kawamura↗
NASA NTRS2020

A Modeling Approach for Handling Qualities and Controls Safety Analysis of Electric Air Taxi Vehicles

The combination of modern advances in electric propulsion, fly-by-wire controls, autonomy, and increasing demand for short range air taxi operations, is currently producing an outburst of vehicle designs more diverse than ever before. Advanced software tools are needed to support the rapid and safe introduction of any design into the airspace, including the safety of the deployed flight control system and vehicle handling qualities. This paper presents a methodology for building air taxi vehicle models with distributed electric propulsion for use in analyzing flight control system safety at the conceptual design level.The approach builds on existing software tools capable of outputting aeromechanics-based linear perturbation models for Vertical Take-off and Landing vehicles with multiple rotors. Rotor torque inputs are then converted into equivalent voltage control inputs, and the linear state and input dynamics matrices are modified to include electric motor dynamics with common parameters for direct-current electric motors. The linear perturbation dynamics are then stitched across multiple operating points into a quasi-Linear Parameter Varying model that covers the full flight envelope. A Model Predictive Controller is developed for use with the full envelope model, and a tradeoff analysis between handling quality and motor requirements is demonstrated using a six passenger NASA air taxi reference design.

Urban Air Mobility↗
NASA NTRSDate not supplied

Control Concepts for Simplified Vehicle Operations of a Quadrotor eVTOL Vehicle

Urban Air Mobility (UAM) is a future mode of transportation that will require revolutionary new vehicle concepts and operations. One of the many challenges that these vehicles face is a complex flight control task in a challenging urban environment and in different flight regimes such as hover, forward flight as well as the transitions between both, with a focus on a low workload and minimum required pilot training. This paper discusses the development and evaluation of simplified vehicle operations concepts using representative aircraft models, controls, inceptors and displays. These four aspects are inseparably interconnected. This simplified vehicle operations concept will be evaluated by performing relevant operations within a realistic urban environment. Handling quality evaluations will be performed using modified Mission Task Elements, or Handling Quality Task Elements. This paper focuses on the initial development of controls, inceptors and displays.

Thomas Lombaerts↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Localization Information Fusion for Autonomous Urban Air Mobility Operations

An adaptive method is developed to iteratively fuse the information provided by multiple sensors to enable autonomous urban air mobility type operations. First, noisy and bias corrupted IMU readings are processed as soon as they arrive using kinematic equations represented in the vehicle's body frame. To correct the systems drift resulting from the integration, an information content measure is introduced to decide on the environment. For the cluttered environment the information provided by environmental sensors is counted as reliable and the drift correction as accurate. For the open space, the GPS data is counted as reliable, and the drift correction is done based on the GPS readings. The measurement noise effects are minimize using Iterated Extended Kalman Filter framework. The algorithm is implemented in the in-house developed FlightDeckz simulation environment using an IMU model, simulated video recorded from a camera mounted on the vehicle (for the purpose of this study, outside scenery was generated with XPlane), which flies in an urban environment, and GPS data generated from the environment's digital map.

Onboard Perception↗
NASA NTRSDate not supplied

Training Airline Pilots for Improved Flight Path Monitoring: The Sensemaking Model Framework

The importance and benefit of improved monitoring is increasingly recognized. Improved training may be a valuable intervention. Our study (conducted 2019) assessed and trained airline First Officers on flight path monitoring skills. The exploratory study assessed monitoring pre-training in a simulator session that included monitoring challenges (8 or 7 events). A 1-hour interactive training followed, based on the Sensemaking Model of Monitoring; it presented concepts and examples using a slide deck, discussion, and simple activities. Post-training assessment used scenarios with analogous monitoring challenges (7 or 8 events) but a different setting. Performance showed significant and relatively consistent improvement. Training monitoring as sensemaking merits further investigation.

training↗
NASA NTRSDate not supplied

Estimation With Range Depended Sensor Model

This paper focuses on the improvement of object detection accuracy taking into account the sensor’s reading degradation as the relative range increases. The approach is based on the assumption that range measurement error depends on the actual range. Specifically, we model the measurement error as a proportional to the actual range term plus a zero-mean, Gaussian distributed, and uncorrelated process. The tracking problem is considered in a mixed continuous-discrete time domain, where the target dynamics is in continuous-time and the measurements are in discrete-time, which is an optimal choice in many tracking and navigation applications. We adopt a commonly used continuous time coordinate-uncoupled white-noise acceleration model for a point object to describe the target motion, and use Extended Kalman Filter (EKF) framework to estimate the target's state and the unknown proportionality coefficient.

Vahram Stepanyan↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Fusion Based Object Tracking for Autonomous Urban Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Urban Air Mobility and other emerging aviation markets. In order to enable this autonomy, systems must be able to build independently an accurate and detailed understanding of the own vehicle state as well as the surrounding environment, this includes detecting and avoiding moving objects in the sky, which can be cooperative (aircraft, UAM vehicles, etc.) as well as noncooperative (smaller drones, birds, ...). This paper focuses on the object tracking part that relies on adaptive multi-sensor fusion, taking into account specific properties and limitations of different sensor types. Results show the impact of dropouts of individual sensors on the accuracy of the tracking results for this adaptive sensor fusion approach.

sensor fusion↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Fusion Based Object Tracking for Autonomous Urban Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Urban Air Mobility and other emerging aviation markets. In order to enable this autonomy, systems must be able to build independently an accurate and detailed understanding of the own vehicle state as well as the surrounding environment, this includes detecting and avoiding moving objects in the sky, which can be cooperative (aircraft, UAM vehicles, etc.) as well as noncooperative (smaller drones, birds, ...). This paper focuses on the object tracking part that relies on adaptive multi-sensor fusion, taking into account specific properties and limitations of different sensor types. Results show the impact of dropouts of individual sensors on the accuracy of the tracking results for this adaptive sensor fusion approach.

object tracking↗
NASA NTRSDate not supplied

Ground to Air Testing of a Fused Optical-Radar Aircraft Detection and Tracking System

Onboard detection and tracking capability are integral to the sensing component in collision avoidance systems needed to safely operate autonomous urban air taxis and small Unmanned Aircraft Systems. Ground-based validation of detection and tracking systems is an important milestone towards the end goal of real-time collision avoidance using onboard sensors and algorithms. In this work, we evaluate three Extended Kalman Filter(EKF)based fusion trackers with radar and vision detection inputs, and compare them with baseline trackers for each sensor type. Performance is assessed using field collected data of ground to air test flights with the sensors co-located on a stable platform with an instrumented multirotor acting as the intruder performing a waypoint pattern at a distance of1.1km to 0.3km to simulate a head-on collision geometry. Fusing an image-based morphological detector with a radar detector using an EKF covered 74% of the ground truth position updates logged by the flight controller on the multirotor within 50 meters after accounting for alignment offsets while covering 15% more ground truth updates relative to radar only. Removing timestamps when the intruder aircraft is occluded by trees and only considering timestamps where the radar has an update, the EKF image-based morphological detector combined with the radar detector covered 90% of the of the ground truth position updates within 50metersand 97% within 100 meters.

Chester V Dolph↗
NASA NTRSDate not supplied

Estimation With Range Dependent Sensor Model

This paper focuses on the improvement of target tracking accuracy taking into account the sensor’s reading degradation as the relative range increases. The approach is based on the assumption that range measurement error depends on the actual range. Specifically, we model the measurement error as a proportional to the actual range term plus a zero-mean, Gaussian distributed, and uncorrelated process. We present two approaches to tracking a target with constant velocity model. The first approach uses Extended Kalman Filter (EKF) framework to estimate target's states and the unknown proportionality coefficient with linearization on the observation model on the predicted states at each time step. The second one uses a measurement conversion method to estimate the target's scaled by the unknown constant term states, which is shown to be unbiased. This conversion results in linear state and observation models, hence the standard Kalman filter can be applied. The actual target state is computed by application of back scaling with the estimate of unknown scale factor. We evaluate the approaches in desktop simulations.

Target tracking↗
NASA NTRSDate not supplied

Distributed Target Tracking With Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using dynamic information fusion from multi-modal sensors with geodiversity. First, the algorithm execution location is determined using an optimal data migration strategy, next the sensors information is dynamically fused at each estimation instance using validity flag for each sensor reading, finally the target estimation is updated based on the fused innovation vector. The approach is applied to synthetic data generated from the radar and camera models located on the ground for the simulated target flight in Reflection simulation environment.

Distributed sensing↗