Kulkarni, Deepak | Search NASA

NASA NTRS2020

Benefit Assessment of the Integrated Demand Management Concept for Multiple New York Metroplex Airports

Benefits of the Integrated Demand Management (IDM) concept were assessed utilizing a newly developed automated simulation capability called ‘Traffic Management Initiative Automated Simulation (TMIAutoSim).’ The IDM concept focuses on improving traffic flow management (TFM) by coordinating the FAA’s strategic Traffic Flow Management System (TFMS) with its more tactical Time-Based Flow Management (TBFM) system. The IDM concept leverages a new TFMS capability called Collaborative Trajectory Options Program (CTOP) to strategically pre-condition traffic demand flowing into a TBFM-managed arrival environment, where TBFM is responsible for tactically managing traffic by generating precise arrival schedules. The IDM concept was developed over a multi-year effort, focusing on solving New York metroplex airport arrival problems. TMIAutoSim closely mimics NASA’s high-fidelity simulation capabilities while enabling more data to be collected at higher speed. Using this new capability, the IDM concept was evaluated using realistic traffic across various weather scenarios. Six representative weather days were selected after clustering three months of historical data. For those selected six days, Newark Liberty International Airport (EWR) and LaGuardia Airport (LGA) arrival traffic scenarios were developed. For each selected day, the historical data were analyzed to accurately simulate actual operations and the weather impact of the day. The current day operations and the IDM concept operations were simulated for the same weather scenarios and the results were compared. The selected six days were categorized into two groups: ‘clear weather’ for days without Ground Delay Programs (GDP) and ‘convective weather’ for days with GDP and significant weather around New York metroplex airports. For the clear weather scenarios, IDM operations reduced last minute, unanticipated departure delays for short-haul flights within TBFM control boundaries with minimal to no impact on throughput and total delay. For the convective weather scenarios, IDM significantly reduced delays and increased throughput to the destination airports.

Traffic Management Initiative Automated Simulation↗

NASA NTRS2019

Models of Terminal Arrival Efficiency Rate

Terminal Arrival Efficiency Rate (TAER) is a measure of TRACON performance and the impact of Traffic Management Initiatives (TMI) within 100 miles of the airport. This measures not just the approach control performance, but also ARTCC performance to deliver traffic evenly. Identifying conditions that lead to low TAER can allow development of method to improve it. In this study, we developed linear and decision tree models of TAER.

Air Traffic Management↗

NASA NTRS2019

Impact of Slot Substitution on CTOP Performance

The Air Traffic Management community has made important progress in collaborative trajectory management through the introduction of an FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). A CTOP is also collaborative in that it permits airlines to provide a set of preferred reroute options (called a Trajectory Options Set or TOS) around an FCA. Airlines also specify a Relative Trajectory Cost (RTC) for each trajectory option that specifies cost of each route relative to the most preferred option. CTOP also airlines to do slot substitution. In this report, we discussed a specific scenario where airlines can reduce their delays by specifying relative slot cost as RTC and using subbing aggressively.

Air Traffic Management↗

NASA NTRS2018

Model of Collaborative Trajectory Options Program Performance

Adoption of Collaborative Trajectory Options Programs (CTOP) in airspace has been hampered by a lack of willingness of a majority of airlines to participate in CTOP as there is a lack of information about benefits of CTOP. At present, there are only selected airlines that are considering participating in CTOP. One open research question is how much benefit an airline get by making a decision to participate in CTOP. Another question is identifying situations in which CTOP is a better alternative to traditional TMIs. For effective use of CTOP, it would be useful to understand how different factors such as capacity and TOS participation influence CTOP performance. Therefore, it would be helpful to develop a model of CTOP performance in terms of these factors.

CTOP↗

NASA NTRS2018

Analysis of Impact of RTC Errors on CTOP Performance

Adoption of CTOPs in airspace has been hampered by a lack of willingness of a majority of airlines to participate in CTOP as there is significant cost in changing workflows and upgrading technology. No commercial vendors are currently offering TOS generation capability. Simpler, cheaper TOS generators may have more errors in RTC specification as compared to sophisticated TOS generators. This study investigates the impact of RTC errors on CTOP performance.

CTOP↗

NASA NTRS2018

Using an Automated Air Traffic Simulation Capability for a Parametric Study in Traffic Flow Management

Flight delays occur when demand for capacity-constrained airspace or airports exceeds predicted capacity. Demand for capacity-constrained airspace or airports can be controlled by a series of Traffic Management Initiatives (TMIs), which use departure and airborne delays, as well as pre-departure and airborne reroutes, to manage access to the constrained resources. Two systems exist in current and planned future operations to address imbalances between demand and capacity. The Collaborative Trajectory Options Program (CTOP) reduces demand to constrained resources by assigning strategic departure delay and pre-departure reroutes. Reroutes are selected from Trajectory Options Sets (TOSs) submitted by airlines. As flights approach the constrained resource, the Time-Based Flow Management System (TBFM) is used to assign tactical delay to satisfy constraints. This paper describes experiments performed to study the impact of varying levels of airline participation in CTOP via submission of TOSs on ground delay and flight time, and the impact of departure uncertainty on TBFM delays. Results suggest that as CTOP participation increases, average ground delays decrease for all airlines, but to the greatest extent for airlines participating in CTOP. A threshold in CTOP participation, which varies with the constraint capacity, is identified beyond which there is relatively little further reduction in average ground delays. Similarly, given the likely level of CTOP participation, the capacity reduction for which CTOP would be an appropriate TMI is also identified. Results also suggest that high average departure errors and high variability in departure error can make the prioritization of TBFM internal departures in TBFM metering and scheduling infeasible. Departure errors at current levels are, however, acceptable.

CTOP↗

NASA NTRS2018

Using an Automated Air Traffic Simulation Capability for a Parametric Study in Traffic Flow Management

Flight delays occur when demand for capacity-constrained airspace or airports exceeds predicted capacity. Demand for capacity-constrained airspace or airports can be controlled by a series of Traffic Management Initiatives (TMIs), which use departure and airborne delays, as well as pre-departure and airborne reroutes, to manage access to the constrained resources. Two systems exist in current and planned future operations to address imbalances between demand and capacity. The Collaborative Trajectory Options Program (CTOP) reduces demand to constrained resources by assigning strategic departure delay and pre-departure reroutes. Reroutes are selected from Trajectory Options Sets (TOSs) submitted by airlines. As flights approach the constrained resource, the Time-Based Flow Management System (TBFM) is used to assign tactical delay to satisfy constraints. This paper describes experiments performed to study the impact of varying levels of airline participation in CTOP via submission of TOSs on ground delay and flight time, and the impact of departure uncertainty on TBFM delays. Results suggest that as CTOP participation increases, average ground delays decrease for all airlines, but to the greatest extent for airlines participating in CTOP. A threshold in CTOP participation, which varies with the constraint capacity, is identified beyond which there is relatively little further reduction in average ground delays. Similarly, given the likely level of CTOP participation, the capacity reduction for which CTOP would be an appropriate TMI is also identified. Results also suggest that high average departure errors and high variability in departure error can make the prioritization of TBFM internal departures in TBFM metering and scheduling infeasible. Departure errors at current levels are, however, acceptable.

integrated demand management↗

NASA NTRS2017

Comparison of Selected Weather Translation Products

Weather is a primary contributor to the air traffic delays within the National Airspace System (NAS). At present, it is the individual decision makers who use weather information and assess its operational impact in creating effective air traffic management solutions. As a result, the estimation of the impact of forecast weather and the quality of ATM response relies on the skill and experience level of the decision maker. FAA Weather-ATM working groups have developed a Weather-ATM integration framework that consists of weather collection, weather translation, ATM impact conversion and ATM decision support. Some weather translation measures have been developed for hypothetical operations such as decentralized free flight, whereas others are meant to be relevant in current operations. This paper does comparative study of two different weather translation products relevant in current operations and finds that these products have strong correlation with each other. Given inaccuracies in prediction of weather, these differences would not be expected to be of significance in statistical study of a large number of decisions made with a look-ahead time of two hours or more.

Kulkarni, Deepak↗

NASA NTRS2017

Models of Sector Flows Under Local, Regional and Airport Weather Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

NASA NTRS2017

Models of Sector Aircraft Counts in the Presence of Local, Regional and Airport Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

NASA NTRS2017

Models of Weather Impact on Air Traffic

Flight delays have been a serious problem in the national airspace system costing about $30B per year. About 70 of the delays are attributed to weather and upto two thirds of these are avoidable. Better decision support tools would reduce these delays and improve air traffic management tools. Such tools would benefit from models of weather impacts on the airspace operations. This presentation discusses use of machine learning methods to mine various types of weather and traffic data to develop such models.

data mining↗

NASA NTRS2014

Analysis of Airport Ground Delay Program Decisions Using Data Mining Techniques

Air traffic service providers have to make decisions regarding changes to air traffic flow in the event of major weather disturbances and traffic congestions to maintain safety of the system. The behavior of the air traffic management system will be more predictable if consistent decisions are made under similar traffic and weather conditions. Consistency of deciding on control action depends on the weather and traffic conditions as well as accuracy in predicting these conditions. Weather parameters (defined in terms of forecast and actual weather and traffic conditions) on different days can be used to categorize days into days with little decision consistency, days with moderate decision consistency and days with high decision consistency. Four years of traffic, weather and ground delay program decisions data at major airports in the United States are used in the analysis. This paper examines performance of different data mining methods in the three regions of decision consistency. Not surprisingly, data mining methods have the best performance in the region of most decision consistency and have the poorest performance in the region of little decision consistency. In applications where data mining methods have differing performance in differing regions, it would be more useful to characterize the region specific performance instead of characterizing performance by a single parameter. Finally, the results show no significant variation in the performance of different data mining methods for this particular problem. The fact that different mining methods show no significant variation also provides further confidence in the results of data mining methods. Work in this abstract discusses initial results. This paper describes the results in terms of both forecast and actual environmental conditions and discusses how prediction errors impact decision consistency.

Kulkarni, Deepak↗

NASA NTRS2013

Data Mining for Understanding and Impriving Decision-Making Affecting Ground Delay Programs

The continuous growth in the demand for air transportation results in an imbalance between airspace capacity and traffic demand. The airspace capacity of a region depends on the ability of the system to maintain safe separation between aircraft in the region. In addition to growing demand, the airspace capacity is severely limited by convective weather. During such conditions, traffic managers at the FAA's Air Traffic Control System Command Center (ATCSCC) and dispatchers at various Airlines' Operations Center (AOC) collaborate to mitigate the demand-capacity imbalance caused by weather. The end result is the implementation of a set of Traffic Flow Management (TFM) initiatives such as ground delay programs, reroute advisories, flow metering, and ground stops. Data Mining is the automated process of analyzing large sets of data and then extracting patterns in the data. Data mining tools are capable of predicting behaviors and future trends, allowing an organization to benefit from past experience in making knowledge-driven decisions. The work reported in this paper is focused on ground delay programs. Data mining algorithms have the potential to develop associations between weather patterns and the corresponding ground delay program responses. If successful, they can be used to improve and standardize TFM decision resulting in better predictability of traffic flows on days with reliable weather forecasts. The approach here seeks to develop a set of data mining and machine learning models and apply them to historical archives of weather observations and forecasts and TFM initiatives to determine the extent to which the theory can predict and explain the observed traffic flow behaviors.

data mining↗

NASA NTRS2013

Learning Automation Update

This presentation provides a brief update on the national-level airport and airspace clustering work that is being conducted in support of the learning automation component of the EFICA RTT.

data mining↗

NASA NTRS2013

Data Mining for Understanding and Improving Decision-making Affecting Ground Delay Programs

The continuous growth in the demand for air transportation results in an imbalance between airspace capacity and traffic demand. The airspace capacity of a region depends on the ability of the system to maintain safe separation between aircraft in the region. In addition to growing demand, the airspace capacity is severely limited by convective weather. During such conditions, traffic managers at the FAA's Air Traffic Control System Command Center (ATCSCC) and dispatchers at various Airlines' Operations Center (AOC) collaborate to mitigate the demand-capacity imbalance caused by weather. The end result is the implementation of a set of Traffic Flow Management (TFM) initiatives such as ground delay programs, reroute advisories, flow metering, and ground stops. Data Mining is the automated process of analyzing large sets of data and then extracting patterns in the data. Data mining tools are capable of predicting behaviors and future trends, allowing an organization to benefit from past experience in making knowledge-driven decisions.

Weather↗

NASA NTRS2011

Modeling Weather Impact on Ground Delay Programs

Scheduled arriving aircraft demand may exceed airport arrival capacity when there is abnormal weather at an airport. In such situations, Federal Aviation Administration (FAA) institutes ground-delay programs (GDP) to delay flights before they depart from their originating airports. Efficient GDP planning depends on the accuracy of prediction of airport capacity and demand in the presence of uncertainties in weather forecast. This paper presents a study of the impact of dynamic airport surface weather on GDPs. Using the National Traffic Management Log, effect of weather conditions on the characteristics of GDP events at selected busy airports is investigated. Two machine learning methods are used to generate models that map the airport operational conditions and weather information to issued GDP parameters and results of validation tests are described.

Wang, Yao↗

NASA NTRS2011

Predictive Models of Duration of Ground Delay Programs in New York Area Airports

Initially planned GDP duration often turns out to be an underestimate or an overestimate of the actual GDP duration. This, in turn, results in avoidable airborne or ground delays in the system. Therefore, better models of actual duration have the potential of reducing delays in the system. The overall objective of this study is to develop such models based on logs of GDPs. In a previous report, we described descriptive models of Ground Delay Programs. These models were defined in terms of initial planned duration and in terms of categorical variables. These descriptive models are good at characterizing the historical errors in planned GDP durations. This paper focuses on developing predictive models of GDP duration. Traffic Management Initiatives (TMI) are logged by Air Traffic Control facilities with The National Traffic Management Log (NTML) which is a single system for automated recoding, coordination, and distribution of relevant information about TMIs throughout the National Airspace System. (Brickman, 2004 Yuditsky, 2007) We use 2008-2009 GDP data from the NTML database for the study reported in this paper. NTML information about a GDP includes the initial specification, possibly one or more revisions, and the cancellation. In the next section, we describe general characteristics of Ground Delay Programs. In the third section, we develop models of actual duration. In the fourth section, we compare predictive performance of these models. The final section is a conclusion.

Kulkarni, Deepak↗

NASA NTRS2007

System for Secure Integration of Aviation Data

The Aviation Data Integration System (ADIS) of Ames Research Center has been established to promote analysis of aviation data by airlines and other interested users for purposes of enhancing the quality (especially safety) of flight operations. The ADIS is a system of computer hardware and software for collecting, integrating, and disseminating aviation data pertaining to flights and specified flight events that involve one or more airline(s). The ADIS is secure in the sense that care is taken to ensure the integrity of sources of collected data and to verify the authorizations of requesters to receive data. Most importantly, the ADIS removes a disincentive to collection and exchange of useful data by providing for automatic removal of information that could be used to identify specific flights and crewmembers. Such information, denoted sensitive information, includes flight data (here signifying data collected by sensors aboard an aircraft during flight), weather data for a specified route on a specified date, date and time, and any other information traceable to a specific flight. The removal of information that could be used to perform such tracing is called "deidentification." Airlines are often reluctant to keep flight data in identifiable form because of concerns about loss of anonymity. Hence, one of the things needed to promote retention and analysis of aviation data is an automated means of de-identification of archived flight data to enable integration of flight data with non-flight aviation data while preserving anonymity. Preferably, such an automated means would enable end users of the data to continue to use pre-existing data-analysis software to identify anomalies in flight data without identifying a specific anomalous flight. It would then also be possible to perform statistical analyses of integrated data. These needs are satisfied by the ADIS, which enables an end user to request aviation data associated with de-identified flight data. The ADIS includes client software integrated with other software running on flight-operations quality-assurance (FOQA) computers for purposes of analyzing data to study specified types of events or exceedences (departures of flight parameters from normal ranges). In addition to ADIS client software, ADIS includes server hardware and software that provide services to the ADIS clients via the Internet (see figure). The ADIS server receives and integrates flight and non-flight data pertaining to flights from multiple sources. The server accepts data updates from authorized sources only and responds to requests from authorized users only. In order to satisfy security requirements established by the airlines, (1) an ADIS client must not be accessible from the Internet by an unauthorized user and (2) non-flight data as airport terminal information system (ATIS) and weather data must be displayed without any identifying flight information. ADIS hardware and software architecture as well as encryption and data display scheme are designed to meet these requirements. When a user requests one or more selected aviation data characteristics associated with an event (e.g., a collision, near miss, equipment malfunction, or exceedence), the ADIS client augments the request with date and time information from encrypted files and submits the augmented request to the server. Once the user s authorization has been verified, the server returns the requested information in de-identified form.

Kulkarni, Deepak↗