Search NASA⌕ Search
Home/Archive/NASA NTRS

NASA NTRS · 20240014494

Towards Understanding Data Requirements for Developing Automatic Speech Recognition Systems for Air Traffic Control

Stephen S B Clarke·David Nielsen·Charles I Cutler·Aida Sharif Rohani·Krishna M Kalyanam
View original source ↗Export metadata ↓

Abstract

In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. Given the many applications focusing on transcribing air traffic control and management communication, this paper explores the training of OpenAI's Whisper model across multiple existing public and private air traffic control voice datasets in an effort to improve robustness. Combining roughly 60+ hours of various air traffic datasets, our goal is to train a unified Whisper model and expect an average word error rate reduction across testing datasets. Furthermore, this work aims to understand the data quantity requirements for achieving state-of-the art results by comprehensively training Whisper on varying dataset sizes. This work has the potential to improve automatic speech recognition performance across the domain, improve understanding of the quantity of data required by an aviation speech recognition system, and lastly provide metrics to compare and improve upon in future research.

Explore related subjects

ATCWhisperMLMachine LearningSTTSpeech-To-TextASRAutomatic Speech RecognitionAir Traffic ControlATCo

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Stephen S B Clarke, David Nielsen, Charles I Cutler, Aida Sharif Rohani, Krishna M Kalyanam. Towards Understanding Data Requirements for Developing Automatic Speech Recognition Systems for Air Traffic Control. https://ntrs.nasa.gov/citations/20240014494

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2013

How do Air Traffic Controllers Use Automation and Tools Differently During High Demand Situations?

In a human-in-the-loop simulation, two air traffic controllers managed identical airspace while burdened with higher than average workload, and while using advanced tools and automation designed to assist with scheduling aircraft on multiple arrival flows to a single meter fix. This paper compares the strategies employed by each controller, and investigates how the controllers' strategies change while managing their airspace under more normal workload conditions and a higher workload condition. Each controller engaged in different methods of maneuvering aircraft to arrive on schedule, and adapted their strategies to cope with the increased workload in different ways. Based on the conclusions three suggestions are made: that quickly providing air traffic controllers with recommendations and information to assist with maneuvering and scheduling aircraft when burdened with increased workload will improve the air traffic controller's effectiveness, that the tools should adapt to the strategy currently employed by a controller, and that training should emphasize which traffic management strategies are most effective given specific airspace demands.

ATC↗
NASA NTRSDate not supplied

Integrating Upper Class E Traffic Management (ETM) Operations into the National Airspace System: Use Cases and Research Questions

As new categories of vehicles are introduced in the National Airspace System, so too are novel concepts for a cooperative approach to traffic management environments. One of these new environments, Upper Class E Traffic Management (ETM), is expected to include a variety of high altitude, long endurance vehicles with a range of performance capabilities and mission profiles that operate in cooperative areas above 60,000 feet. In addition to developing the rules, architecture, and systems for operations within the ETM environment itself, it is also important to consider how ETM vehicles will integrate with traditional Air Traffic Management and interact with Air Traffic Control (ATC) as they traverse ATC-controlled airspace and transition in and out of cooperative ETM operating areas. As a first step toward future ETM demonstrations at the National Aeronautics and Space Administration (NASA) Ames Research Center’s Airspace Operations Laboratory, use cases with step-by-step procedures were developed to identify both nominal and off-nominal scenarios in which ETM operations will interact with ATC. As NASA prepares to develop a simulation platform to demonstrate ETM cooperative practices and ETM-ATC interactions, the procedures, ATC roles and responsibilities, data exchange requirements, and research questions that were identified as part of use case development will inform scenario and system architecture design. The upcoming simulation work will include initial prototype ETM-ATC coordination tools to support ATC controllers’ interactions with ETM operations. This paper will briefly discuss NASA’s upcoming ETM development work and then provide background on ETM-ATC interactions, describe each ETM-ATC interaction use case, and discuss open questions on concept, procedures, and assumptions.

ATC↗
NASA NTRSDate not supplied

Integrating Upper Class E Traffic Management (ETM) Operations into the National Airspace System: Use Cases and Research Questions

As new categories of vehicles are introduced in the National Airspace System, so too are novel concepts for a cooperative approach to traffic management environments. One of these new environments, Upper Class E Traffic Management (ETM), is expected to include a variety of high altitude, long endurance vehicles with a range of performance capabilities and mission profiles that operate in cooperative areas above 60,000 feet. In addition to developing the rules, architecture, and systems for operations within the ETM environment itself, it is also important to consider how ETM vehicles will integrate with traditional Air Traffic Management and interact with Air Traffic Control (ATC) as they traverse ATC-controlled airspace and transition in and out of cooperative ETM operating areas. As a first step toward future ETM demonstrations at the National Aeronautics and Space Administration (NASA) Ames Research Center’s Airspace Operations Laboratory, use cases with step-by-step procedures were developed to identify both nominal and off-nominal scenarios in which ETM operations will interact with ATC. As NASA prepares to develop a simulation platform to demonstrate ETM cooperative practices and ETM-ATC interactions, the procedures, ATC roles and responsibilities, data exchange requirements, and research questions that were identified as part of use case development will inform scenario and system architecture design. The upcoming simulation work will include initial prototype ETM-ATC coordination tools to support ATC controllers’ interactions with ETM operations. This paper will briefly discuss NASA’s upcoming ETM development work and then provide background on ETM-ATC interactions, describe each ETM-ATC interaction use case, and discuss open questions on concept, procedures, and assumptions.

ATC↗