Aditya Das | Search NASA

NASA NTRS2022

A 3D Simulation Platform for Decentralized Decision-Making in Advanced Air Mobility

This paper presents a general purpose, plug-and-play simulation platform for the use of future aviation stakeholders, such as urban airspace planners, air vehicle operators, ground operation managers, air traffic controllers and aviation researchers. The presented simulator platform is envisioned to serve as a toolkit to visualize, evaluate, and configure future advanced air mobility (AAM) operations. Highlighting features of this toolkit include a modular architecture that allows multiple smart unmanned aerial systems (UASs) to remotely connect to the simulation server and participate in decentralized decision-making scenario simulations. As an example of the decentralized decision-making scenario, an inter-agent negotiation-based conflict resolution use case is considered in this paper, where the UASs leverage the on-board/on-the-edge artificial intelligence (AI) capability to continually build situational awareness, and use this information to predict future conflicts and resolve them through machine-to-machine negotiation. As such operations are non-existent at scale currently, the presented simulation platform offers a viable and cost-effective alternative for assessing the efficacy of AAM research outcomes and challenges in future shared airspace usage. The simulation platform allows plug-n-play connectivity with AI and non-AI compute modules representing individual UAS’s flight control. Each module can interact with the simulation platform independently to communicate current and desired future states, situational awareness, and conflict resolution utilization costs for inter-agent negotiation. The simulation environment orchestrates realistic operational scenarios with spatiotemporal details, dynamic events, tactical conflict-resolution methods, interfaces for customizing air traffic control parameters, and information exchange uncertainties. In the future, this can serve as a community focused cloud simulation platform, incorporating multi-stakeholder airspace constraints from regulatory, government, city, and local agencies.

Aditya Das↗

NASA NTRSDate not supplied

AEGIS: Autonomous Entity Global Intelligence System for Urban Air Mobility

This paper presents a global intelligence system that synthesizes aerial vehicles’ real-time physical data, planned actions, and historical behavior into engineered data frames representing the collective state of the airspace and suitable for efficient machine learning consumption. These data frames are then learnt by a deep neural net to build a prediction model that estimates the expected evolution path of the current state, thereby identifying potential future conflicts. This approach lends itself to an automated early warning system that the aerial vehicles can implement onboard with a suitable edge computing module more efficiently and effectively than non-AI methods, and eventually take preventive or corrective measures towards self/collaborative resolution of the issues. Contrary to a centralized early warning system where all vehicles’ task-space eventually converges to a global optimum state, the presented distributed global intelligence system brings in a balance between local utility functions of each vehicle and the global operating framework. This contributes to effectively handle the potential massive scaling in urban air mobility in the near future.

Artificial Intelligence↗

NASA NTRSDate not supplied

A Data & Reasoning Fabric to Enable Advanced Air Mobility

A Data & Reasoning Fabric (DRF) is envisioned to enable the full potential of advanced air mobility by providing all data and reasoning where they are needed. The DRF marketplace is based on an open foundational ecosystem of data and reasoning exchange between the many systems that must seamlessly interplay to manage the envisioned highly complex and dense airspace operations. DRF activities will identify, test and - as needed - research and develop critical core technologies, and collaboratively test these technologies, open standards and architectures, and the integrated framework with end-users so as to deliver reference designs and development environments that catalyze broad private and public sector buy-in and self-sustaining development of it and associated standards.

Urban Air Mobility↗

NASA NTRSDate not supplied

Data & Reasoning Fabric Minimum Viable Product

A Data & Reasoning Fabric (DRF) is envisioned to enable the full potential of air mobility by providing all data and reasoning where they are needed. The DRF provides a marketplace based on an open foundational ecosystem of data and reasoning exchange between the many systems that must seamlessly interplay to manage the complex and dense airspace operations required to achieve advanced air mobility goals. The DRF marketplace is decentralized and will not be owned by any single party. To deliver reference designs and development environments that catalyze broad private and public sector buy-in and self-sustaining development of DRF and associated standards, DRF activities will collaboratively test these technologies, open standards and architectures, and an integrated framework with end-users.

DRF↗

NASA NTRSDate not supplied

Data & Reasoning Fabric Minimum Viable Product

A Data & Reasoning Fabric (DRF) is envisioned to enable the full potential of air mobility by providing all data and reasoning where they are needed. The DRF provides a marketplace based on an open foundational ecosystem of data and reasoning exchange between the many systems that must seamlessly interplay to manage the complex and dense airspace operations required to achieve advanced air mobility goals. The DRF marketplace is decentralized and will not be owned by any single party. To deliver reference designs and development environments that catalyze broad private and public sector buy-in and self-sustaining development of DRF and associated standards, DRF activities will collaboratively test these technologies, open standards and architectures, and an integrated framework with end-users. The DRF activity is developing a Minimum Viable Product (MVP) called the DRF Accelerator which will enable the rapid deployment of candidate data and reasoning services to test and evaluate the DRF core system functionality. The DRF Project is engaging with government and industry end-users and stakeholders, to: (1) assess the technical feasibility of the DRF Accelerator; (2) assess the likelihood of adoption, through shared test and evaluation; and (3) identify what data and services can be shared across DRF.

DRF↗

NASA NTRSDate not supplied

Feasibility Study of Distributed Decision-Making on the Edge for Urban Air Mobility

The Concept of Operations for Urban Air Mobility (UAM) put forward by FAA, NASA, and several industry stakeholders acknowledges the diversity and complexity in UAM operations and, thereby, envisions a federated architecture for UAM management. In this architecture, the decision-making is distributed to a set of service providers who collectively manage the shared airspace usage by different stakeholders. This notionally brings autonomy closer to the UAM businesses and encourages to explore the feasibility of decision making on the very edge, which is the topic of the presented research. This paper reports research conducted on the hypothesis based on which the residual compute capability onboard smart unmanned aerial systems (UASs) is utilized to build situational awareness and resolve conflicts by passive and active coordination among multiple UASs, thereby implementing a layer of distributed autonomy in UAM. Key features of the edge-computing approach involve inter-UAS information exchange, independent assessment of own flight and environmental conditions, and estimation of other UASs’ flight preferences, incorporating machine learning techniques in the last two. Parallel computing on portable graphics processing unit (GPU) enables the machine learning workflow on the edge. A custom-built 3D simulator is used to evaluate the efficacy of the distributed decision-making on the edge. Each edge node, representing a smart UAS, connects to the simulator from a remote location and independently controls the behavior of the corresponding virtual asset in the simulator, analogous to participants in an online multi-player game. The presented edge-computing-based distributed decision-making framework is envisioned to pave the way for collective mobility of autonomous air vehicles in the future shared airspace, while allowing the inclusion of the business preferences of the UAS operators within allowed regulatory limits.

Edge computing↗

NASA NTRSDate not supplied

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden C. Szeto↗

NASA NTRSDate not supplied

Classification of Notices to Airmen using Natural Language Processing

This paper establishes the feasibility of using Natural Language Processing (NLP) to classify NOTAMs or Notices to Airmen – a pilot messaging framework to gather real-time situational awareness. Present day air mobility operations heavily rely on NOTAMs. However, pilots often have difficulty interpreting NOTAMs due to the sheer volume of inapplicable messages and unclear abbreviations. Using NLP, the presented study analyzes the accuracy of classifying NOTAMs and, thereby, the efficiency of generating actionable interpretations in real time. To this effect, efficacies of four NLP neural network architectures were analyzed, including three Recurrent Neural Networks (RNNs) with GloVe, Word2Vec, and FastText word embeddings, and one trained Bi-Directional Encoder Representations from Transformers (BERT) model. The four neural networks were trained and evaluated on three open-source datasets of varying text lengths, vocabularies, and grammars, taken from e-commerce product descriptions, social media tweets, and unstructured descriptions for data and analytics services on open data marketplaces such as NASA’s Data and Reasoning Fabric (DRF) platform. This provided cross-analysis of each neural network architecture’s performance per text type. The best performing architecture, BERT, was then fine-tuned on a collection of open-source NOTAM data. Post-training, a real-time NOTAM classification service was implemented to draw inference on new NOTAMs using the trained model, which demonstrated close to 99% accuracy in classification. This modular classification service is envisioned to be integrated with a data and analytics delivery platform, such as the DRF, thus availing real-time contextualization of NOTAMs to air mobility clients, humans, and machines for enhanced decision making.

Aiden Szeto↗