Search NASA⌕ Search

Engineering topics

Vahram Stepanyan

Publications and source records attributed to Vahram Stepanyan.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2025

Considerations for Optimal Sensor Placement for Higher Accuracy Object Localization for Urban Air Mobility

Previous research into object localization has shown that sensor placement and alignment plays an important role in achieving higher accuracy levels of the estimated location of a tracked Urban Air Mobility Vehicle. In general, a near-orthogonal intersection between the ground node observation vectors results in the highest accuracy due to a smaller overlapping uncertainty region between both. This applies to triangulation by means of ground node camera angle observations as well as trilateration by means of ground node distance measurements. However, this simple concept is not easily fulfilled with a network of a limited number of static ground nodes and a moving object to be localized. This case study performs sensitivity analyses and explores practical ways on how to achieve higher estimate accuracy levels in this context.

sensor placement↗
NASA NTRS2024

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight↗
NASA NTRS2023

Distributed Ground Sensor Fusion Based Object Tracking for Autonomous Advanced Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage. Dropouts of individual sensors affect the accuracy of the tracking results, which agrees with expectations for partial coverage, when full localization is not achievable anymore. Finally, a study is performed to identify which parameters have the largest impact on the fit error.

Autonomous↗
NASA NTRS2021

An Approach to Reasoning Service Migration in Data and Reasoning Fabric (DRF) Implementation

In this paper we consider service migration problem for Data and Reasoning Fabric (DRF) enabled airspace operations assuming a fixed cloud/edge infrastructure with allocated computing, storage and power resources, where cloud/edge servers, and communication stations are in a wired connected network, while vehicles use a wireless network for communication. The objective is to automatically select the best location for the requested service execution, which achieves minimum cost while satisfying the user quality of service (QoS) and available resources constraints. To this end, estimates of the response time, consumed energy and total cost are defined for each potential compute location. A mixed-integer linear program is then formulated and solved to identify optimal compute locations given QoS constraints, network infrastructure limitations, with worst-case vehicle positioning. The approach is applied to trajectory re-planning use case to avoid a collision with an emergency vehicle in real time.

Air mobility↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Localization Information Fusion for Autonomous Urban Air Mobility Operations

An adaptive method is developed to iteratively fuse the information provided by multiple sensors to enable autonomous urban air mobility type operations. First, noisy and bias corrupted IMU readings are processed as soon as they arrive using kinematic equations represented in the vehicle's body frame. To correct the systems drift resulting from the integration, an information content measure is introduced to decide on the environment. For the cluttered environment the information provided by environmental sensors is counted as reliable and the drift correction as accurate. For the open space, the GPS data is counted as reliable, and the drift correction is done based on the GPS readings. The measurement noise effects are minimize using Iterated Extended Kalman Filter framework. The algorithm is implemented in the in-house developed FlightDeckz simulation environment using an IMU model, simulated video recorded from a camera mounted on the vehicle (for the purpose of this study, outside scenery was generated with XPlane), which flies in an urban environment, and GPS data generated from the environment's digital map.

Onboard Perception↗
NASA NTRSDate not supplied

Estimation With Range Depended Sensor Model

This paper focuses on the improvement of object detection accuracy taking into account the sensor’s reading degradation as the relative range increases. The approach is based on the assumption that range measurement error depends on the actual range. Specifically, we model the measurement error as a proportional to the actual range term plus a zero-mean, Gaussian distributed, and uncorrelated process. The tracking problem is considered in a mixed continuous-discrete time domain, where the target dynamics is in continuous-time and the measurements are in discrete-time, which is an optimal choice in many tracking and navigation applications. We adopt a commonly used continuous time coordinate-uncoupled white-noise acceleration model for a point object to describe the target motion, and use Extended Kalman Filter (EKF) framework to estimate the target's state and the unknown proportionality coefficient.

Vahram Stepanyan↗
NASA NTRSDate not supplied

An Approach to Reasoning Service Migration in Data and Reasoning Fabric (DRF) Implementation

In this paper we consider service placement problem for Data and Reasoning Fabric (DRF) enabled airspace operations assuming a fixed cloud/edge infrastructure with allocated computing, storage and power resources, where cloud/edge servers, and communication stations are in a wired connected network, while vehicles use a wireless network for communication. The objective is to automatically select the best location for the requested service execution, which achieves minimum cost while satisfying the user quality of service (QoS) and available resources constraints. To this end, we estimate for each potential location the response time, consumed energy and total cost; formulate an optimization problem for cost minimization given the users QoS constraints and network infrastructure limitations; and solve it using nonlinear programming tools. The approach is applied to trajectory re-planning use case to handle a no-fly zone contingency in real time.

Vahram Stepanyan↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Fusion Based Object Tracking for Autonomous Urban Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Urban Air Mobility and other emerging aviation markets. In order to enable this autonomy, systems must be able to build independently an accurate and detailed understanding of the own vehicle state as well as the surrounding environment, this includes detecting and avoiding moving objects in the sky, which can be cooperative (aircraft, UAM vehicles, etc.) as well as noncooperative (smaller drones, birds, ...). This paper focuses on the object tracking part that relies on adaptive multi-sensor fusion, taking into account specific properties and limitations of different sensor types. Results show the impact of dropouts of individual sensors on the accuracy of the tracking results for this adaptive sensor fusion approach.

sensor fusion↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Fusion Based Object Tracking for Autonomous Urban Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Urban Air Mobility and other emerging aviation markets. In order to enable this autonomy, systems must be able to build independently an accurate and detailed understanding of the own vehicle state as well as the surrounding environment, this includes detecting and avoiding moving objects in the sky, which can be cooperative (aircraft, UAM vehicles, etc.) as well as noncooperative (smaller drones, birds, ...). This paper focuses on the object tracking part that relies on adaptive multi-sensor fusion, taking into account specific properties and limitations of different sensor types. Results show the impact of dropouts of individual sensors on the accuracy of the tracking results for this adaptive sensor fusion approach.

object tracking↗
NASA NTRSDate not supplied

Ground to Air Testing of a Fused Optical-Radar Aircraft Detection and Tracking System

Onboard detection and tracking capability are integral to the sensing component in collision avoidance systems needed to safely operate autonomous urban air taxis and small Unmanned Aircraft Systems. Ground-based validation of detection and tracking systems is an important milestone towards the end goal of real-time collision avoidance using onboard sensors and algorithms. In this work, we evaluate three Extended Kalman Filter(EKF)based fusion trackers with radar and vision detection inputs, and compare them with baseline trackers for each sensor type. Performance is assessed using field collected data of ground to air test flights with the sensors co-located on a stable platform with an instrumented multirotor acting as the intruder performing a waypoint pattern at a distance of1.1km to 0.3km to simulate a head-on collision geometry. Fusing an image-based morphological detector with a radar detector using an EKF covered 74% of the ground truth position updates logged by the flight controller on the multirotor within 50 meters after accounting for alignment offsets while covering 15% more ground truth updates relative to radar only. Removing timestamps when the intruder aircraft is occluded by trees and only considering timestamps where the radar has an update, the EKF image-based morphological detector combined with the radar detector covered 90% of the of the ground truth position updates within 50metersand 97% within 100 meters.

Chester V Dolph↗
NASA NTRSDate not supplied

Estimation With Range Dependent Sensor Model

This paper focuses on the improvement of target tracking accuracy taking into account the sensor’s reading degradation as the relative range increases. The approach is based on the assumption that range measurement error depends on the actual range. Specifically, we model the measurement error as a proportional to the actual range term plus a zero-mean, Gaussian distributed, and uncorrelated process. We present two approaches to tracking a target with constant velocity model. The first approach uses Extended Kalman Filter (EKF) framework to estimate target's states and the unknown proportionality coefficient with linearization on the observation model on the predicted states at each time step. The second one uses a measurement conversion method to estimate the target's scaled by the unknown constant term states, which is shown to be unbiased. This conversion results in linear state and observation models, hence the standard Kalman filter can be applied. The actual target state is computed by application of back scaling with the estimate of unknown scale factor. We evaluate the approaches in desktop simulations.

Target tracking↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

NASA is conducting investigations into Advanced Air Mobility (AAM) concepts, aircraft, and operations. One of the most challenging scenarios for AAM will be enabling safe routine access into densely populated urban centers. To address challenges in the urban environment, a moderately high-fidelity simulation capability is needed to investigate AAM flight operations over a regional area for the development and evaluation of autonomy technologies. This paper describes a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (10's-100's of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to accurately simulate all phases of flight. Glass cockpit displays have been developed for monitoring aircraft operation over a detailed simulated urban environment. Simulation models have been integrated to simulate air and ground-based sensors, such as radar and LIDAR. The commercial X-Plane software package is used as a rendering engine to mimic vision-based sensors (such as onboard and ground-based cameras) at various times of day and in various weather conditions over a relatively detailed graphical model of the city. The paper presents a detailed illustration of the simulation and software architecture used for traffic over this urban region. This system is enabling the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward aircraft flight test evaluation.

Keerthana Kannan↗
NASA NTRSDate not supplied

Distributed Target Tracking With Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using dynamic information fusion from multi-modal sensors with geodiversity. First, the algorithm execution location is determined using an optimal data migration strategy, next the sensors information is dynamically fused at each estimation instance using validity flag for each sensor reading, finally the target estimation is updated based on the fused innovation vector. The approach is applied to synthetic data generated from the radar and camera models located on the ground for the simulated target flight in Reflection simulation environment.

Distributed sensing↗
NASA NTRSDate not supplied

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from Smart Spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs and mathematical formalisms to demonstrate operation. The proposed framework will be evaluated on a regional AAM flight scenario and will focus on two initial applications: (1) GPS-free navigation supporting precision approach and landing (PAL), and (2) surveillance and conformance monitoring of aircraft in vertiport airspaces. Such approaches show promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Structurally-Adaptive↗
NASA NTRSDate not supplied

Reasoning Service Exemplars for NASA’s Data and Reasoning Fabric

Future operations for Urban and Advanced Air Mobility are enabled by a distributed network of reliable and secured data and reasoning services referred to here as a fabric. In the aggregate, such a system must be all encompassing and mission agnostic, but specific use-cases are still needed to improve understanding and drive design paradigms. For this purpose, three reasoning service exemplars for Target Selection and Routing, Trajectory Generation, and Battery Health Management were developed and integrated into a specific NASA proposed data and reasoning fabric. These services were then used to build a mission reasoning application for lightning strike reconnaissance developed in collaboration with the Civil Air Patrol. Autonomous mission execution was then demonstrated using a multivehicle simulation platform with a full envelope 6 Degree-of-Freedom dynamics model for a concept electric Vertical Takeoff and Landing aircraft.

Autonomy↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

distributed sensing↗