Search NASA⌕ Search

SEARCH · Search NASA

Results for “Coverage Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

104 records · Page 6

The HYDICE instrument design and its application to planetary instruments

The Hyperspectral Digital Imagery Collection Experiment (HYDICE) instrument represents a significant advance in the state of the art in hyperspectral sensors. It combines a higher signal-to-noise ratio (SNR) and significantly better spatial and spectral resolution and radio metric accuracy than systems flying on aircraft today. The need for 'clean' data, i.e., data free of sampling artifacts and excessive spatial or spectral noise, is a key driver behind the difficult combination of performance requirements laid out for HYDICE. Most of these involve the sensor optics and detector. This paper presents an optimized approach to those requirements, one that comprises push broom scanning, a single, mechanically cooled focal plane, a double-pass prism spectrometer, and an easily fabricated yet wide-field telescope. Central to the approach is a detector array that covers the entire spectrum from 0.4 to 2.5 microns. Among the major benefits conferred by such a design are optical and mechanical simplicity, low polarization sensitivity, and coverage of the entire spectrum without suffering the spectral gaps caused by beam splitters. The overall system minimizes interfaces to the C-141 aircraft on which it will be flown, can be calibrated on the ground and in flight to accuracies better than those required, and is designed for simple, push-button operation. Only unprocessed data are recorded during flight. A ground data processing station provides quick-look, calibration correction, and archiving capabilities, with a throughput better than the requirements. Overall performance of the system is expected to provide the solid database required to evaluate the potential of hyperspectral imagery in a wide variety of applications. HYDICE can be regarded as a test bed for future planetary instruments. The ability to spectrally image a wide field of view over multiple spectral octaves offers obvious advantages and is expected to maximize science return for the required cost and weight.

Basedow, R.↗

SPICE Module for the Satellite Orbit Analysis Program (SOAP)

A SPICE module for the Satellite Orbit Analysis Program (SOAP) precisely represents complex motion and maneuvers in an interactive, 3D animated environment with support for user-defined quantitative outputs. (SPICE stands for Spacecraft, Planet, Instrument, Camera-matrix, and Events). This module enables the SOAP software to exploit NASA mission ephemeris represented in the JPL Ancillary Information Facility (NAIF) SPICE formats. Ephemeris types supported include position, velocity, and orientation for spacecraft and planetary bodies including the Sun, planets, natural satellites, comets, and asteroids. Entire missions can now be imported into SOAP for 3D visualization, playback, and analysis. The SOAP analysis and display features can now leverage detailed mission files to offer the analyst both a numerically correct and aesthetically pleasing combination of results that can be varied to study many hypothetical scenarios. The software provides a modeling and simulation environment that can encompass a broad variety of problems using orbital prediction. For example, ground coverage analysis, communications analysis, power and thermal analysis, and 3D visualization that provide the user with insight into complex geometric relations are included. The SOAP SPICE module allows distributed science and engineering teams to share common mission models of known pedigree, which greatly reduces duplication of effort and the potential for error. The use of the software spans all phases of the space system lifecycle, from the study of future concepts to operations and anomaly analysis. It allows SOAP software to correctly position and orient all of the principal bodies of the Solar System within a single simulation session along with multiple spacecraft trajectories and the orientation of mission payloads. In addition to the 3D visualization, the user can define numeric variables and x-y plots to quantitatively assess metrics of interest.

Coggi, John↗

An AeroCom–AeroSat study: intercomparison of satellite AOD datasets for aerosol model evaluation

To better understand and characterize current uncertainties in the important observational constraint of climate models of aerosol optical depth (AOD), we evaluate and intercompare 14 satellite products, representing nine different retrieval algorithm families using observations from five different sensors on six different platforms. The satellite products (super-observations consisting of 1°×1° daily aggregated retrievals drawn from the years 2006, 2008 and 2010) are evaluated with AErosol RObotic NETwork (AERONET) and Maritime Aerosol Network (MAN) data. Results show that different products exhibit different regionally varying biases (both under- and overestimates) that may reach ±50 %, although a typical bias would be 15 %–25 % (depending on the product). In addition to these biases, the products exhibit random errors that can be 1.6 to 3 times as large. Most products show similar performance, although there are a few exceptions with either larger biases or larger random errors. The intercomparison of satellite products extends this analysis and provides spatial context to it. In particular, we show that aggregated satellite AOD agrees much better than the spatial coverage (often driven by cloud masks) within the 1°×1° grid cells. Up to ∼50 % of the difference between satellite AOD is attributed to cloud contamination. The diversity in AOD products shows clear spatial patterns and varies from 10 % (parts of the ocean) to 100 % (central Asia and Australia). More importantly, we show that the diversity may be used as an indication of AOD uncertainty, at least for the better performing products. This provides modellers with a global map of expected AOD uncertainty in satellite products, allows assessment of products away from AERONET sites, can provide guidance for future AERONET locations and offers suggestions for product improvements. We account for statistical and sampling noise in our analyses. Sampling noise, variations due to the evaluation of different subsets of the data, causes important changes in error metrics. The consequences of this noise term for product evaluation are discussed.

Aerosol↗

Orion Guidance and Control Ascent Abort Algorithm Design and Performance Results

During the ascent flight phase of NASA s Constellation Program, the Ares launch vehicle propels the Orion crew vehicle to an agreed to insertion target. If a failure occurs at any point in time during ascent then a system must be in place to abort the mission and return the crew to a safe landing with a high probability of success. To achieve continuous abort coverage one of two sets of effectors is used. Either the Launch Abort System (LAS), consisting of the Attitude Control Motor (ACM) and the Abort Motor (AM), or the Service Module (SM), consisting of SM Orion Main Engine (OME), Auxiliary (Aux) Jets, and Reaction Control System (RCS) jets, is used. The LAS effectors are used for aborts from liftoff through the first 30 seconds of second stage flight. The SM effectors are used from that point through Main Engine Cutoff (MECO). There are two distinct sets of Guidance and Control (G&C) algorithms that are designed to maximize the performance of these abort effectors. This paper will outline the necessary inputs to the G&C subsystem, the preliminary design of the G&C algorithms, the ability of the algorithms to predict what abort modes are achievable, and the resulting success of the abort system. Abort success will be measured against the Preliminary Design Review (PDR) abort performance metrics and overall performance will be reported. Finally, potential improvements to the G&C design will be discussed.

Proud, Ryan W.↗

Retrieval of Aerosol Optical Properties From GOCI-II Observations: Continuation of Long-Term Geostationary Aerosol Monitoring Over East Asia

Since the Geostationary Ocean Color Imager (GOCI) was successfully launched in 2010, the GOCI Yonsei aerosol retrieval (YAER) algorithm has been continuously updated to retrieve hourly aerosol optical properties. GOCI-II has 4 more channels including UV, finer spatial resolution (250 m), and daily full disk coverage as compared to GOCI, and was launched in February 2020, onboard the GEO-KOMPSAT-2B (GK-2B) satellite. In this study, we extended the YAER algorithm to GOCI-II data based on its improved performance in many aspects and present the first results of aerosol optical properties retrieved from GOCI-II data. Utilizing the overlapping period between the GOCI-II and GOCI in geostationary Earth orbit, we present GOCI-II aerosol retrievals for high aerosol-loading cases over East Asia and show that these have a consistent spatial distribution with those from GOCI. Furthermore, GOCI-II provides AOD at an even higher spatial resolution, revealing finer changes in aerosol concentrations. Validation results for one year data show that the GOCI-II AOD has a correlation coefficient of 0.83 and a ratio within the expected error (EE) of 59.4 % when compared with the aerosol robotic network (AERONET) data. We compared statistical metrics for the GOCI and GOCI-II AODs to assess the consistency between the two datasets. In addition, it was found that there is a strong correlation between the two datasets from the comparison of gridded GOCI and GOCI-II AOD products. It is expected that data from GOCI-II will continue long-term aerosol records with high accuracy that can be used to address air-quality issues over East Asia.

AOD↗

Cloud-Based Demodulation and Data Distribution of a Satellite Downlink

Ground station networks connected to the cloud allow space missions to have global communications coverage without operating their own infrastructure. In this work, we describe the communications architecture for the TechEdSat-13 mission, which performed the first in-space characterization of a neuromorphic processor. The mission utilizes a commercial provider for S-band downlinks. A suite of cloud services and open-source software such as GNU Radio are leveraged to demodulate signals received by an AWS ground station during passes with TechEdSat-13 and store recovered data. Once a pass is scheduled, the entire process takes place without human intervention. On-orbit results the past year of operations are presented, demonstrating the advantages of this approach over traditional operator-owned ground stations. Use of software-defined radio makes possible custom signal processing. The homogeneity of apertures and their interfaces to the cloud simplifies scaling across many sites. This abundance of candidate links lays the groundwork for intelligent scheduling agents to optimize pass selection across several factors, automatically recover from failed contacts, and gather metrics to learn from past performance.

cloud demodulation↗

Mars Science Laboratory: Entry, Descent, and Landing System Performance

In 2010, the Mars Science Laboratory (MSL) mission will pioneer the next generation of robotic Entry, Descent, and Landing (EDL) systems, by delivering the largest and most capable rover to date to the surface of Mars. To do so, MSL will fly a guided lifting entry at a lift-to-drag ratio in excess of that ever flown at Mars, deploy the largest parachute ever at Mars, and perform a novel Sky Crane maneuver. Through improved altitude capability, increased latitude coverage, and more accurate payload delivery, MSL is allowing the science community to consider the exploration of previously inaccessible regions of the planet. The MSL EDL system is a new EDL architecture based on Viking heritage technologies and designed to meet the challenges of landing increasing massive payloads on Mars. In accordance with level-1 requirements, the MSL EDL system is being designed to land an 850 kg rover to altitudes as high as 1 km above the Mars Orbiter Laser Altimeter defined areoid within 10 km of the desired landing site. Accordingly, MSL will enter the largest entry mass, fly the largest 70 degree sphere-cone aeroshell, generate the largest hypersonic lift-to-drag ratio, and deploy the largest Disk-Gap-Band supersonic parachute of any previous mission to Mars. Major EDL events include a hypersonic guided entry, supersonic parachute deploy and inflation, subsonic heatshield jettison, terminal descent sensor acquisition, powered descent initiation, sky crane terminal descent, rover touchdown detection, and descent stage flyaway. Key performance metrics, derived from level-1 requirements and tracked by the EDL design team to indicate performance capability and timeline margins, include altitude and range at parachute deploy, time on radar, and propellant use. The MSL EDL system, which will continue to develop over the next three years, will enable a notable extension in the advancement of Mars surface science by delivering more science capability than ever before to the surface of Mars. This paper describes the current MSL EDL system performance as predicted by end-to-end EDL simulations, highlights the sensitivity of this baseline performance to several key environmental assumptions, and discusses some of the challenges faced in delivering such an unprecedented rover payload to the surface of Mars.

Way, David W.↗

Mars Science Laboratory: Entry, Descent, and Landing System Performance

In 2010, the Mars Science Laboratory (MSL) mission will pioneer the next generation of robotic Entry, Descent, and Landing (EDL) systems, by delivering the largest and most capable rover to date to the surface of Mars. To do so, MSL will fly a guided lifting entry at a lift-to-drag ratio in excess of that ever flown at Mars, deploy the largest parachute ever at Mars, and perform a novel Sky Crane maneuver. Through improved altitude capability, increased latitude coverage, and more accurate payload delivery, MSL is allowing the science community to consider the exploration of previously inaccessible regions of the planet. The MSL EDL system is a new EDL architecture based on Viking heritage technologies and designed to meet the challenges of landing increasing massive payloads on Mars. In accordance with level-1 requirements, the MSL EDL system is being designed to land an 850 kg rover to altitudes as high as 1 km above the Mars Orbiter Laser Altimeter defined areoid within 10 km of the desired landing site. Accordingly, MSL will enter the largest entry mass, fly the largest 70 degree sphere-cone aeroshell, generate the largest hypersonic lift-to-drag ratio, and deploy the largest Disk-Gap-Band supersonic parachute of any previous mission to Mars. Major EDL events include a hypersonic guided entry, supersonic parachute deploy and inflation, subsonic heatshield jettison, terminal descent sensor acquisition, powered descent initiation, sky crane terminal descent, rover touchdown detection, and descent stage flyaway. Key performance metrics, derived from level-1 requirements and tracked by the EDL design team to indicate performance capability and timeline margins, include altitude and range at parachute deploy, time on radar, and propellant use. The MSL EDL system, which will continue to develop over the next three years, will enable a notable extension in the advancement of Mars surface science by delivering more science capability than ever before to the surface of Mars. This paper describes the current MSL EDL system performance as predicted by end-to-end EDL simulations, highlights the sensitivity of this baseline performance to several key environmental assumptions, and discusses some of the challenges faced in delivering such an unprecedented rover payload to the surface of Mars.

Way, David W.↗

Space Communications Responsive to Events Across Missions (SCREAM): An Investigation of Network Solutions for Transient Science Space Systems

Space Communications Responsive to Events Across Missions (SCREAM): An Investigation of Network Solutions for Transient Science Space Systems The National Academies have prioritized the pursuit of new scientific discoveries using diverse and temporally coordinated measurements from multiple ground and space-based observatories. Networked communications can enable such measurements by connecting individual observatories and allowing them to operate as a cohesive and purposefully designed system. Timely data flows across terrestrial and space communications networks are required to observe transient scientific events and processes. Currently, communications to space-based observatories experience large latencies due to manual service reservation and scheduling procedures, intermittent signal coverage, and network capacity constraints. If space communications network latencies could be reduced, new discoveries about dynamic scientific processes could be realized. However, science mission and network planners lack a systematic framework for defining, quantifying and evaluating timely space data flow implementation options for transient scientific observation scenarios involving multiple ground and space-based observatories. This dissertation presents a model-based systems engineering approach to investigate and develop network solutions to meet the needs of transient science space systems. First, a systematic investigation of the current transient science operations of the National Aeronautics and Space Administration’s (NASA) Tracking and Data Relay Satellite (TDRS) space data network and the Neil Gehrels Swift Observatory resulted in a formal architectural model for transient science space systems. Two methods individual missions may use to achieve timely network services were defined, quantitatively modeled, and experimentally compared. Next, the architectural model was extended to describe two alternative ways to achieve timely and autonomous space data flows to multiple space-based observatories within the context of a purposefully designed transient science observation scenario. A quantitative multipoint space data flow modeling method based in queueing theory was defined. General system suitability metrics for timeliness, throughput, and capacity were specified to support the evaluation of alternative network data flow implementations. A hypothetical design study was performed to demonstrate the multipoint data flow modeling method and to evaluate alternative data flow implementations using TDRS. The merits of a proposed future TDRS broadcast service to implement multipoint data flows were quantified and compared to expected outcomes using the as-built TDRS network. Then, the architectural model was extended to incorporate commercial network service providers. Quantitative models for Globalstar and Iridium short messaging data services were developed based on publicly available sources. Financial cost was added to the set of system suitability metrics. The hypothetical design study was extended to compare the relative suitability of the as-built TDRS network with the commercial Globalstar and Iridium networks. Finally, results from this research are being applied by NASA missions and network planners. In 2020, Swift implemented the first automated command pipeline, increasing its expected gravitational wave follow-up detection rate by greater than 400%. Current NASA technology initiatives informed by this research will enable future space-based observatories to become interoperable sensing devices connected by a diverse ecosystem of network service providers.

Christopher J. Roberts↗

Q4 – A CubeSat Mission to Demonstrate Omnidirectional Optical Communications

We are proposing a technology demonstration mission for JPL’s Inter-Satellite Optical Communicator (ISOC). The ISOC has the potential to enable up to 1 Gbps data rates over a distance up to 200 km in free space. Key features of the ISOC include full sky coverage and the ability to maintain multiple links simultaneously. The Q4 mission consists of (4) 6U CubeSats furnished with ISOCs to demonstrate high data rate communications among the spacecraft. More specifically, we seek to demonstrate the omnidirectionality of the ISOC by providing simultaneous optical links between one spacecraft and the other three. Q4 will be a demonstrator for small spacecraft swarm capabilities. Following a proposed deployment from the ISS, the CubeSats will utilize their onboard thrusters to enter their desired orbit. The orbit consists of one “leader” spacecraft in a circular orbit with a 400 km LEO altitude and three “follower” spacecraft in slightly elliptical orbits rotating azimuthally about the leader. The main mission will consist of three consecutive phases: First, the spacecraft will demonstrate pointing, acquisition, and tracking using newly developed protocols. Next, link establishment and different channel access methods (CDMA and TDMA) will be tested. Finally, Delay Tolerant Network protocols will be implemented to allow fast data sharing among the spacecraft. The distance between the communicating spacecraft will be increased as the mission progresses to characterize the link quality as a function of distance. All communications over the course of the mission will be recorded and analyzed on the ground using bit error rate as a metric for success. The current design for each the four Q4 CubeSats contains an XACT advanced ADCS system for precision beam pointing. Other components currently under consideration include MiPS cold gas thrusters for orbital maneuvering and gimbaled eHaWK 84W solar arrays. In this paper we present design considerations for the Q4 CubeSats, link budget calculations, results from preliminary mission analysis, and expected results.

Velazco, Jose E↗

Assessing Utility of Different Orbits for a Lunar PNT Constellation

"As the Artemis program establishes a long-term presence on the lunar surface, lunar surface users will need an accurate source of Position, Navigation, and Timing (PNT). Under the LunaNet framework, NASA has proposed the Lunar Navigation System (LNS), a constellation of satellites in lunar orbit which will broadcast LunaNet’s Augmented Forward Signal (AFS) [1] to the lunar surface. LNS will have the objective of providing user position accuracies of 10 m and timing accuracies of 10 microseconds on the lunar surface and up to 200 km above the surface. Several classes of orbits are possibilities for the LNS constellation, including circular orbits, eccentric orbits, and various families of 3-body orbits. Each of these orbit classes have both advantages and disadvantages in their utility as PNT constellations. In this study we examine a wide variety of potential LNS constellations and evaluate their performance against several metrics, including: a. Dilution of Precision (DOP) performance over the lunar service volume and the South Pole region, during both the constellation buildup and after the constellation is completed. b. Number of satellites required to achieve required DOP performance. c. Relative dynamics of LNS satellites with respect to surface users. d. Signal in space error (SISE) performance, assuming orbit determination that includes the Global Positioning System (GPS), crosslinks, and monitor sites on the surface of the moon. e. Constellation insertion, station keeping, and disposal costs. f. Specific Concept of Operations (CONOPS) and engineering challenges associated with establishing and operating the constellations. (E.g., frequent station keeping, variable signal strength, divergent CONOPS for different planes of the constellation.) The system’s performance is considered both independently and in combination with other proposed systems, such as NASA’s Lunar Communication Relay and Navigation System (LCRNS) and ESA’s Moonlight constellation. The study concludes that a 3-plane Walker constellation at 6 lunar radii (slightly higher than GPS’s 4.2 earth radii from a geometry perspective, but significantly closer in an absolute sense) is a good candidate for the LNS constellation, providing the user with good SISE and DOP performance, while not requiring excessive station keeping or complex CONOPS. However, other viable concepts exist and could be chosen if early South Pole coverage is a driving factor in the system design."

navigation↗

Soil Moisture Active and Passive (SMAP) White-Painted Expanded Polystyrene (EPS) Radome Survivability Test

NASA's SMAP Mission launched in January 2015 into a 685 km near-polar, sun-synchronous orbit. The SMAP instrument architecture incorporates an L-band radar and radiometer which share a common feedhorn and mesh reflector. The instrument rotates about the nadir axis at approximately 15 rpm, thereby providing a conically scanning wide swath antenna beam that is capable of achieving global coverage within three days. The radiometer and its associated electronics have tight thermal stability requirements in order to meet the required surface emittance measurement precision from space. Maintaining the thermal stabilities is quite challenging because the radiometer is located on a spinning platform that can either be in full sunlight or eclipse, and thus exposed to a highly transient environment. Stability requirements were met by integrating a light-weight Expanded Polystyrene (EPS) radome into the design to prevent solar illumination of the feed horn interior. The radome was painted white since the thermo-optical properties of bare sunlit EPS degrade rapidly over the three-year mission. Milling of the EPS and solvent within the white paint created cavities on the EPS surface which may introduce localized hot spots possibly violating the EPS glass transition temperature of 96degC and leading to structural integrity concerns. A three-day thermal test was conducted in a vacuum chamber to verify survivability of the radome during a simulated non-spin fault condition at end of mission. A portable solar simulator illuminated the test article and the beam irradiance was kept nearly constant during the entire 50 hour test, except during the first hour which simulated the expected 79degC on-orbit surface temperature of the radome. The test article survived based on the established pass criteria for three separate metrics: dimensional, optical property, and color. If any hot spots exist locally, they did not cause any observable permanent deformation when compared to pre- and post-test images. The test results increase confidence that there is a high probability that the radome will survive the worst-case scenario of a no-spin fault condition at the end of mission.

Mikhaylov, Rebecca↗

Benchmarking Computational Tools for Calling SNPs and Indels in Complex Microbial Populations

The NASA BioNutrients missions seek to understand the suitability of microorganisms for bioproduction during space flight. One topic of interest is the stability of microbial genomes during long-term ambient storage and subsequent rehydration and growth. To address these questions, samples from 8 species were flown to ISS for 5 years of desiccated storage at ambient temperature (Stasis Packs) and 2 species were packaged along with powdered media inside a bioreactor system to allow hydration and growth in microgravity (Production Packs). For both systems, Whole Genome Sequencing (WGS) of the DNA extracted from the returned samples and paired ground controls will be conducted to identify changes in genome stability due to time, storage conditions and growth in space. Across the technical replicates, ground controls, 10 timepoints, and multiple experimental conditions, ~300 samples have been selected for initial analysis with WGS sequencing to 100x coverage. A flexible and resource efficient mutation calling pipeline is needed to process this large dataset and allow for comparisons between species. Many bioinformatics tools for calling Indels and Single Nucleotide Variants (SNVs) are designed for use with pure isolates, where true variations from the reference genome are expected to dominate the reads aligning to the location of mutation. In contrast, DNA from the Stasis Pack (SP) samples was collected directly after recovery from desiccated storage and the Production Pack (PP) samples were collected after fermentation. In this context, reads with mutations are expected to be less frequent than reads that align with the reference genome, as each sample will include multiple lines of cells. Thus, BioNutrients samples are expected to be similar to samples from cancer cell or “pooled” sequencing approaches. In preparation for the analysis of the BioNutrients samples, we have tested three mutation calling tools (GATK for Microbes, BreSeq and DiscoSNP) designed for complex samples. A challenge of validating mutation identification pipelines is a lack of “Ground Truth” datasets, especially for complex samples. To compare these three tools, we sought to identify mutations in pre-existing WGS data collected from populations of Chlamydomonas reinhardtii that were exposed to UV mutagenesis and growth in LEO as part of the Space Algae-1 mission. Here we present a summary of these tools against the analysis originally conducted using the CRISP tool. Critical metrics are compared such as runtime, the number of SNPs, the number and size of Indels, and patterns of transversion and transitions identified by each tool are reported. By sharing these benchmarking results collected in support of the BioNutrients mission, we aim to guide others seeking to identify SNVs in similarly complex microbial samples.

Biology↗

A Machine Learning Approach to Improve Air Traffic Management Initiatives

Collaborating closely with commercial air carriers and related organizations, the Federal Aviation Administration(FAA) regulates air traffic and ensures the safety and efficiency of air operations. Air traffic controllers make strategic decisions, such as delaying, rerouting, or canceling flights, partly based on guidance provided by the FAA’s Air TrafficControl System Command Center (ATCSCC). The guidance includes, among other things, control measures known asTraffic Management Initiatives (TMIs) designed to enhance safety and improve operational efficiency. TMIs play a crucial role in managing the demand and capacity within the U.S. National Airspace System (NAS). Two major TMIs that are routinely used (primarily to mitigate the adverse effects of bad weather) are Ground Delay Programs (GDPs) andGround Stops (GSs). In a GDP, flights destined for airports facing thunderstorm activity experience delays at their origin airports. This proactive approach minimizes the risk of routing aircraft through hazardous weather conditions and also replaces (fuel burning) airborne delays with ground delays. In a GS, a temporary restriction is imposed on the departure or arrival of aircraft at a specific airport or within a designated airspace. Although other TMIs (e.g., miles-in-trail) are also implemented as part of (air) traffic flow management in the NAS, the focus of this work is on GDPs and GSs. Since TMIs, by design, lead to flight delays or cancellations, it is crucial to put in place the right set of parameters(e.g., scope and duration of the GDP). For example, when the end time of a GDP extends beyond what is necessary, it imposes unnecessary delays on departing flights. This situation could occur as a result of inaccurate prediction of the(required) duration of the GDP based on the weather forecast. On the other hand, if a GDP ends prematurely before the underlying capacity constraints are resolved at the destination airport, it may result in airborne holding. The delicate balance lies in matching the termination of the GDP precisely with the resolution of capacity constraints, avoiding both the imposition of unnecessary ground delays and the need for airborne holding due to premature program termination.Failing to specify the right parameters for TMIs also leads to flight delays, creating a significant obstacle in managing the increasing traffic volumes causing increased work load for the controllers. To address this issue, we propose the integration of Machine Learning (ML) models in the traffic flow management(TFM) pipeline. In current operations, decisions are made by human experts based on extensive training, historical patterns, available traffic and weather data. Since we have an abundance of data from past events that tell us the likely impact of various TMIs, by ingesting historical data, properly trained ML models can offer valuable insights and aid human decision-making. With the FAA increasingly exploring advanced analytics, ML emerges as a focal point for enhancing TFM within the National Airspace System (NAS). As a first step, this study aims to provide traffic controllers with decision-making support for the issuance and adjustment of TMIs. Data analytics and machine learning have been previously employed to address some of the challenges associated with TMIs. Numerous studies have concentrated on various facets of TMI issuance, exploring factors influencing TMI parameters, including arrival rate, airport capacity, and delay prediction. For example, using weather forecasts, several statistical methods were used to produce probabilistic capacity profiles which in conjunction with deterministic models provided insights into the GDP planning process [1–4]. The downside of using deterministic models is that they rely on fixed inputs and predetermined rules, which lack the ability to account for the inherent uncertainty and variability present in real-world scenarios. In a separate series of studies, researchers aimed to predict the occurrences of GDPs and GSs. The majority of these studies utilized various supervised learning methods, including Decision Trees, Naive Bayes, Support VectorMachines, and Random Forests to analyze the influence of weather conditions and arrival demand on TMI incidents[5–8]. However, these studies primarily focused on predicting the incidence of TMIs without explicitly addressing the scope of TMIs, including their duration and their geographical coverage. Furthermore, the emphasis of these studies was largely on GDPs, given their higher frequency and longer duration when compared to GSs. A limited number of studies focused on predicting the parameters of TMIs, specifically addressing their duration and extent. In one such study focusing on optimizing the TMI parameters at San Francisco International Airport (SFO),the authors utilized a probabilistic forecast of fog [9]. They simulated various capacity scenarios based on the (fog)burn-off forecasts, selecting GDP parameters that minimized airborne and overall ground delays. However, this approach exclusively emphasizes stratus (fog) burn-off as the primary determinant of GDP and GS, neglecting other influential factors like severe weather events, runway closures, lower capacity than traffic demand, and other important variables. Given the complexity of predicting the TMI and determining its scope, we seek a more holistic approach. We aim to consider all significant factors that could impact TMIs and their parameters. What sets this research apart is the fusion of all data sources relevant to the issuance and adjustment of TMIs and it represents the first comprehensive attempt to optimize TMIs in this manner. Since this comprehensive solution involves various aspects, we break down the problem into smaller components and input all parameters into a unified model called the “TMI Adjuster”. Figure 1 shows the overall framework and the list of datasets used in each model. The objective of the TMI Adjuster module is to deliver reliable, consistent and expedited recommendations for the progression, adjustment, and termination of TMIs. The ML solution entails developing a pipeline capable of predicting the necessity of a TMI (e.g., GS or GDP) along with its various parameters. For example, in the case of a GS, this includes the scope of the GS either in terms of distance from the destination airport or based on pre-defined airspace sectors. Here, scope refers to those regions and departing airports that are subject to the GS. In this paper, we concentrate on the issuance of GSs in the three major airports in the New York area — LaGuardia(LGA), John F. Kennedy International (JFK), and Newark Liberty International (EWR). We fuse traffic, weather and other relevant aviation data from years 2017 to 2019 to train and validate the ML models. In particular, we use the following datasets: •Terminal Aerodrome Forecast (TAF): meteorological forecasts specific to each airport, issued four times a day, covering predefined time periods. •TMI data: includes all GSs and GDPs along with their respective parameters. •Aviation System Performance Metrics (ASPM): includes traffic related data such as aircraft delays, arrival, and departure rates. •Notices to Airmen (NOTAMs): utilized to extract runway closure data and manage interdependencies between terminals in close proximity. •Flight cancellation data •Airspace Flow Programs (AFP): includes information on flight airborne holdings caused by TMIs. The data preprocessing entails transforming ASPM, TMI, AFP, NOTAMs, and weather data into an hourly format and consolidating all datasets by merging them based on date and time as the primary key. The TMI Adjuster framework comprises two parallel models: one dedicated to GS and a second model focused on GDP. As previously mentioned, our specific focus is on the GS model as a multi-classification problem. In this framework, each data point of the GS model input summarizes ten hours of data. Specifically, the data loader for the GS model generates the input and output of the model as follows: at a given time step, the input includes the actual traffic, weather, and TMI data from the two-hour window before the time step, alongside the weather forecast and scheduled traffic for the next 8 hours starting from the time step. Based on this information, the output of the GS model for each time interval consists of three dimensions. The first dimension represents a binary decision on whether there should be a GS in place for the next hour or not. The second dimension is related to the scope of the GS in the United States, and the third dimension is related to the scope of the GS in Canada (i.e., to determine if the GS impacts airports in Canada).One of the challenges with TMI modeling is the sparsity of TMI events, particularly regarding its scope. To address this challenge in the scope of the GS model output, we implement grouping. The GS scope for the US region is defined based on a list of centers that should be included when the GS is in place. With 20 centers in the US, we utilized historical data to group them into 4 categories. In particular, we summarized our historical data in a graph format where nodes represent centers, and link weights are defined based on the co-occurrence of centers in the scope parameter ofTMIs. By identified strongly connected components in this graph, we were able to partition the centers into four groups. We consider two model structures for the GS Model. Firstly, a hierarchical classification model [10], where the human decision-making for a GS is of hierarchical nature. The decision-maker first decides whether there is a need fora GS, and if the answer is yes, determines the scope. A hierarchical classification model organizes the problem into a class hierarchy, typically a tree or a Directed Acyclic Graph (DAG) structure, and considers the dependency of the decision in the previous step to the next component [10]. Here, we employ the local classifier per level approach, which involves training one multi-class classifier for each level of the class hierarchy. The second structure is the independent structure. In this setting, as the name suggests, we do not consider the dependency of the decisions in the different dimensions of the output of the model. Instead, for each dimension, we train a multi-class classifier independently. Table 1 summarizes GS model statistics for training, validation and testing. The table documents the effect of limiting data to the time steps when there was actually a TMI in place or when a TMI had just terminated. This resulted in a more balanced distribution of the GS class(GS positive class)versus “No GS”(GS negative class), which might help the training process. While JFK and LGA follow very similar distributions, with 40% and 42% GS positive class respectively, EWR has proportionally fewer GS incidents at 28%. Our subsequent phase involves evaluating the performance of both hierarchical structure and independent structure using different state-of-the-art multi-class classifier models such as Random Forest, Decision Trees, K-nearest Neighbors, and Logistic Regression and forecast the duration and scope of the GSs.

Farzan Masrour Shalmani↗