Search NASASearch

SEARCH · Search NASA

Results for “trajectory prediction uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

The Impact of Trajectory Prediction Uncertainty on Air Traffic Controller Performance and Acceptability

A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

trajectory prediction uncertainty

Controller Strategies for Automation Tool Use under Varying Levels of Trajectory Prediction Uncertainty

A human-in-the-loop simulation was conducted to examine the effects of varying levels of trajectory prediction uncertainty on air traffic controller workload and performance, as well as how strategies and the use of decision support tools change in response. This paper focuses on the strategies employed by two controllers from separate teams who worked in parallel but independently under identical conditions (airspace, arrival traffic, tools) with the goal of ensuring schedule conformance and safe separation for a dense arrival flow in en route airspace. Despite differences in strategy and methods, both controllers achieved high levels of schedule conformance and safe separation. Overall, results show that trajectory uncertainties introduced by wind and aircraft performance prediction errors do not affect the controllers' ability to manage traffic. Controller strategies were fairly robust to changes in error, though strategies were affected by the amount of delay to absorb (scheduled time of arrival minus estimated time of arrival). Using the results and observations, this paper proposes an ability to dynamically customize the display of information including delay time based on observed error to better accommodate different strategies and objectives.

Strategy

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.

Case Study: Influences of Uncertainties and Traffic Scenario Difficulties in a Human-in-the-Loop Simulation

This paper presents a case study of how factors such as wind prediction errors and metering delays can influence controller performance and workload in Human-In-The-Loop simulations. Retired air traffic controllers worked two arrival sectors adjacent to the terminal area. The main tasks were to provide safe air traffic operations and deliver the aircraft to the metering fix within +/- 25 seconds of the scheduled arrival time with the help of provided decision support tools. Analyses explore the potential impact of metering delays and system uncertainties on controller workload and performance. The results suggest that trajectory prediction uncertainties impact safety performance, while metering fix accuracy and workload appear subject to the scenario difficulty.

air traffic control

Strategic and Tactical Functions in an Autonomous Air Traffic Management System

This paper evaluates, by means of fast-time simulation, performance of a candidate system for autonomous air traffic management. Advancing towards autonomy in air traffic management may be necessary in order for new air vehicle types such as electric Vertical Take Off and Landing (eVTOL) to operate safely and efficiently in airspace shared with conventional traffic. To account for uncertain prediction, autonomous air traffic management was divided into two integrated and coordinated subsystems: strategic scheduling, performed at predeparture, and tactical conflict detection and resolution, performed throughout the flight. The conflict detection and resolution subsystem contained a second tactical scheduling function that applied to flights operating in the airspace near the destination airport. This paper compares and contrasts the two subsystems and uses fast-time simulation to demonstrate the comparisons. A scenario of 54 flights inbound to Newark Liberty International Airport was simulated multiple times with different parameters. The scenario was created using flight plans recorded from the National Airspace System on a low weather, average traffic day in April 2018. Whereas the routes were not changed, the departure times of the flights were modified to increase arrival rates at the Newark runway and arrival meter fixes. Results of the simulations showed that the autonomous air traffic management system was able to safely manage the traffic, even with prediction uncertainty. In addition, they showed the importance of including flight holding maneuvers, in addition to path stretching, in conflict detection and resolution and of coordinating strategic and tactical scheduling. Finally, a tradeoff between absorbing the delay calculated by strategic scheduling on the ground versus in the air showed that taking most of the delay on the ground is cost effective for a simple idealized cost function. However, taking a little of the delay in the air prevented throughput on the runway from dropping for short periods due to trajectory prediction uncertainty.

air traffic control

Strategic and Tactical Functions in an Autonomous Air Traffic Management System

This paper evaluates, by means of fast-time simulation, performance of a candidate system for autonomous air traffic management. Advancing towards autonomy in air traffic management may be necessary in order for new air vehicle types such as electric Vertical Take Off and Landing (eVTOL) to operate safely and efficiently in airspace shared with conventional traffic. To account for uncertain prediction, autonomous air traffic management was divided into two integrated and coordinated subsystems: strategic scheduling, performed at predeparture, and tactical conflict detection and resolution, performed throughout the flight. The conflict detection and resolution subsystem contained a second tactical scheduling function that applied to flights operating in the airspace near the destination airport. This paper compares and contrasts the two subsystems and uses fast-time simulation to demonstrate the comparisons. A scenario of 54 flights inbound to Newark Liberty International Airport was simulated multiple times with different parameters. The scenario was created using flight plans recorded from the National Airspace System on a low weather, average traffic day in April 2018. Whereas the routes were not changed, the departure times of the flights were modified to increase arrival rates at the Newark runway and arrival meter fixes. Results of the simulations showed that the autonomous air traffic management system was able to safely manage the traffic, even with prediction uncertainty. In addition, they showed the importance of including flight holding maneuvers, in addition to path stretching, in conflict detection and resolution and of coordinating strategic and tactical scheduling. Finally, a tradeoff between absorbing the delay calculated by strategic scheduling on the ground versus in the air showed that taking most of the delay on the ground is cost effective for a simple idealized cost function. However, taking a little of the delay in the air prevented throughput on the runway from dropping for short periods due to trajectory prediction uncertainty.

air traffic control

Design of a Multi-mode Flight Deck Decision Support System for Airborne Conflict Management

NASA Langley has developed a multi-mode decision support system for pilots operating in a Distributed Air-Ground Traffic Management (DAG-TM) environment. An Autonomous Operations Planner (AOP) assists pilots in performing separation assurance functions, including conflict detection, prevention, and resolution. Ongoing AOP design has been based on a comprehensive human factors analysis and evaluation results from previous human-in-the-loop experiments with airline pilot test subjects. AOP considers complex flight mode interactions and provides flight guidance to pilots consistent with the current aircraft control state. Pilots communicate goals to AOP by setting system preferences and actively probing potential trajectories for conflicts. To minimize training requirements and improve operational use, AOP design leverages existing alerting philosophies, displays, and crew interfaces common on commercial aircraft. Future work will consider trajectory prediction uncertainties, integration with the TCAS collision avoidance system, and will incorporate enhancements based on an upcoming air-ground coordination experiment.

Barhydt, Richard

The Effects of Speed Uncertainty on a Separation Assurance Algorithm

Trajectory prediction is central to separation assurance, because it is necessary to accurately predict where an aircraft will be in the future to avoid losses of separation. In any system in the field there will always be uncertainty associated with trajectory prediction. This uncertainty is a product of many different sources including wind prediction errors, pilot intent, surveillance errors, navigation errors and aircraft weight. The purpose of this study is to parametrically analyze the effects of aircraft speed errors on conflict detection and to analyze the performance of a conflict resolution algorithm when these speed errors are present. Results show that a speed error of +/- 10% of the cruise speed can result in about 30% of the conflicts not being detected ten minutes before the loss of separation. It can also result in 50% more resolutions being performed to maintain separation.

Lauderdale, Todd A.

Concept of Operations for Management by Trajectory

This document describes Management by Trajectory (MBT), a concept for future air traffic management (ATM) in which every flight operates in accordance with a four-dimensional trajectory (4DT) that is negotiated between the airspace user and the Federal Aviation Administration (FAA) to respect the airspace user's goals while complying with National Airspace System (NAS) constraints. In the present-day NAS, the ATM system attempts to predict the trajectory for each flight based on the approved flight plan and scheduled or controlled departure time. However, once the aircraft starts to move, controllers tactically manage the aircraft to implement traffic management restrictions, separate otherwise conflicting aircraft, and address arising NAS constraints. Tactical controller actions are not directly communicated to the automation systems or other stakeholders. Furthermore, the initial trajectory prediction does not anticipate these disruptions or how they will impact the flight. Consequently, and compounded by gaps in required data and models, trajectory predictions are less accurate than possible, which affects Traffic Flow Management (TFM) performance. A cornerstone of the MBT concept is that all air vehicles have, at all times, an assigned 4DT from their current state to their destination. These assigned trajectories consist of trajectory constraints and descriptions. Pilots and air traffic controllers, with the aid of automation, operate the aircraft to comply with the assigned trajectory, unless first negotiating a revision. Equipped aircraft have substantial responsibility for complying with the assigned trajectory without controller intervention. To maximize the operational flexibility available to the airspace user, the assigned trajectory only imposes trajectory constraints as required to achieve the ATM goals of NAS constraint compliance and aircraft separation. Trajectory descriptions are added to the assigned trajectory to ensure sufficient predictability. To further improve trajectory prediction accuracy, airspace users supplement the assigned trajectory by broadcasting intent information and updating it as necessary. Air vehicle intent is a more detailed description of the airspace user's plan for how the flight will fly the assigned trajectory. Air vehicle intent can change freely, without negotiation, as long as it remains in compliance with the assigned trajectory. Aircraft assigned trajectories, air vehicle intent, and predicted trajectories are shared, creating a common view among stakeholders. A NAS Constraint Service gathers and publishes information about all known NAS constraints, enabling airspace users to be informed participants in trajectory negotiation. Trajectory constraints in the assigned trajectory are mapped to NAS constraints to facilitate identifying which aircraft are affected when NAS constraints change. To support efficient trajectory negotiation, all aircraft provide current information about air vehicle capabilities. Assigned trajectories are constructed to satisfy all known NAS constraints, improving trajectory stability and predictability. Uncertainty and disruptions are handled by modifying the assigned trajectory as far in advance as possible. By proactively negotiating changes to the assigned trajectory, rather than relying on controller-selected tactical actions such as vectors to resolve traffic conflicts or implement miles-in-trail restrictions, MBT keeps aircraft on closed trajectories that are fully known to all stakeholders. Since reactive air traffic control actions cannot be predicted in advance, the downstream trajectory cannot be accurately predicted until they happen. Reliable trajectory predictions allow the system to identify needed modifications to trajectories further in advance, where they can be negotiated and communicated as amendments (i.e., additional or altered trajectory constraints) to the assigned trajectory. Decision Support Tools (DSTs) aid controllers in rapidly defining and communicating closed trajectories to the aircraft and support all stakeholders in trajectory negotiation. Anticipated MBT benefit mechanisms include more accurate trajectory predictions, improved ATM performance and robustness to off-nominal conditions, increased flexibility and operational efficiency, reduced impediments to emerging classes of airspace users accessing NAS resources, reduced environmental impacts, and enhanced safety.

ConOps

Adaptive Trajectory Prediction Algorithm for Climbing Flights

Aircraft climb trajectories are difficult to predict, and large errors in these predictions reduce the potential operational benefits of some advanced features for NextGen. The algorithm described in this paper improves climb trajectory prediction accuracy by adjusting trajectory predictions based on observed track data. It utilizes rate-of-climb and airspeed measurements derived from position data to dynamically adjust the aircraft weight modeled for trajectory predictions. In simulations with weight uncertainty, the algorithm is able to adapt to within 3 percent of the actual gross weight within two minutes of the initial adaptation. The root-mean-square of altitude errors for five-minute predictions was reduced by 73 percent. Conflict detection performance also improved, with a 15 percent reduction in missed alerts and a 10 percent reduction in false alerts. In a simulation with climb speed capture intent and weight uncertainty, the algorithm improved climb trajectory prediction accuracy by up to 30 percent and conflict detection performance, reducing missed and false alerts by up to 10 percent.

Seperation Assurance

Differing Air Traffic Controller Responses to Similar Trajectory Prediction Errors: An Interrupted Time-Series Analysis of Controller Behavior

A Human-In-The-Loop simulation was conducted in January of 2013 in the Airspace Operations Laboratory at NASAs Ames Research Center. The simulation airspace included two en route sectors feeding the northwest corner of Atlantas Terminal Radar Approach Control. The focus of this paper is on how uncertainties in the studys trajectory predictions impacted the controllers ability to perform their duties. Of particular interest is how the controllers interacted with the delay information displayed in the meter list and data block while managing the arrival flows. Due to wind forecasts with 20-knot over-predictions and 20-knot under-predictions, delay value computations included errors of similar magnitude, albeit in opposite directions. However, when performing their duties in the presence of these errors, did the controllers issue clearances of similar magnitude, albeit in opposite directions?

human-automation interaction

Predicting Li-Ion Battery Capacity Fade Using Early-Life Data and a Hybrid Data-Driven Gaussian Process-Bayesian Regression Approach

Accurately predicting Li-ion battery capacity trajectories using early-life data can dramatically improve battery-life understandings and be used to rapidly evaluate design/cost/performance trade-offs when developing new battery materials. Accurate early-life predictions enable researchers to quickly iterate over cell designs and material precursor properties without consistently cycling cells to failure. To this end, we present a toolbox that uses a combined Gaussian Process and Bayesian regression approach that capitalizes on signals other than just capacity (e.g., dQ/dV, voltage drops) to rapidly predict capacity-fade trajectories. The prediction tool uses Bayesian regression to fit functional forms, e.g., power law, sigmoids, etc., to predict capacity-fade dynamics. By fitting functional forms, the capacity fade can be interrogated at any point in the future, allowing for early cell-failure prediction. Additionally, Bayesian regression allows for accurate uncertainty estimates that account for cell-to-cell variability (aleatoric uncertainty) and the lack of observation data (epistemic uncertainty). By only using early cycle data to predict the capacity fade trajectory, uncertainty bounds at end-of-life can be extremely large. The large uncertainty bounds are further exacerbated because there is no systematic way to define the prior distribution of the functional forms' parameters. We improve our the predicted trajectory confidence interval of our predicted trajectory using two methods. First, we shows that a small amount of held-out cycling data is sufficientuse some train cells, that have been cycled to failure to derive information regarding the appropriate prior distributions for the functional forms' parameters of the functional form, effectively leading to data-driven priors.. We propose constructing the data-driven priors by first running a Bayesian regression starting with uninformed priors to generate intermediate cell-specific posterior parameter distributions. These posterior distributions are combined using a Ggaussian mixture model for each parameter to create the data-driven priors. These mixture models serve as the data-driven prior distributions for the parameters for. Second, we derive multiple features, e.g., C_dchg 0.5 DoD 0.5, log (|mean(dQ/dV_(w_3-w_0 ) (V)|), etc., from the train cellsheld-out cycling data, identify which the features are that best predicting capacity at early/mid-life cycles, and then create Ggaussian process regression models that are used for predicting capacity at early/mid-life cycles for the test cells (see blue dots with error bars in Fig 1b). Finally, these predicted data-points are used in addition to the actual early cycle data capacity fade to construct the Bayesian regression trajectory for the test cell s. Notably. We note that these two methods are complementary and can be combined with each other. We evaluate the performance of our proposed method on an testing open-source dataset from Iowa State University and Iowa Lakes Community College (ISU-ILCC). This dataset comprises of 251 nickel-manganese-cobalt/graphite Lithium-ion cells that are cycled under 63 different conditions. We compute the mean average percentage error (MAPE) and negative log predictive density (NLPD) to quantify the efficacy of our method. Our initial findings suggest that, when only few observations are available, for test cells, when using only Bayesian regression with uninformed priors, a power law functional provides the most accurate predictions. with very few data points. However, asHowever, a the number of data points increases, a twin sigmoidal function becomes more accurate as the number of observations further increases. We also find that using as little as 10% of the data set towards generating data-driven priors can lead to significant improvement in prediction accuracy when using early cycle data. Lastly, we found that augmenting early-cycle data with Gaussian process-predicted capacity data for Bayesian regression greatly improves the prediction accuracy. We will present a comprehensive comparison of our methods to other methods available in the literature and apply this method to additional battery datasets.

42 ENGINEERING

Differing Air Traffic Controller Responses to Similar Trajectory Prediction Errors

A Human-In-The-Loop simulation was conducted in January of 2013 in the Airspace Operations Laboratory at NASA's Ames Research Center. The simulation airspace included two en route sectors feeding the northwest corner of Atlanta's Terminal Radar Approach Control. The focus of this paper is on how uncertainties in the study's trajectory predictions impacted the controllers ability to perform their duties. Of particular interest is how the controllers interacted with the delay information displayed in the meter list and data block while managing the arrival flows. Due to wind forecasts with 30-knot over-predictions and 30-knot under-predictions, delay value computations included errors of similar magnitude, albeit in opposite directions. However, when performing their duties in the presence of these errors, did the controllers issue clearances of similar magnitude, albeit in opposite directions?

trajectory prediction uncertainty

Creation of a Rapid High-Fidelity Aerodynamics Module for a Multidisciplinary Design Environment

In the traditional aerospace vehicle design process, each successive design phase is accompanied by an increment in the modeling fidelity of the disciplinary analyses being performed. This trend follows a corresponding shrinking of the design space as more and more design decisions are locked in. The correlated increase in knowledge about the design and decrease in design freedom occurs partly because increases in modeling fidelity are usually accompanied by significant increases in the computational expense of performing the analyses. When running high fidelity analyses, it is not usually feasible to explore a large number of variations, and so design space exploration is reserved for conceptual design, and higher fidelity analyses are run only once a specific point design has been selected to carry forward. The designs produced by this traditional process have been recognized as being limited by the uncertainty that is present early on due to the use of lower fidelity analyses. For example, uncertainty in aerodynamics predictions produces uncertainty in trajectory optimization, which can impact overall vehicle sizing. This effect can become more significant when trajectories are being shaped by active constraints. For example, if an optimal trajectory is running up against a normal load factor constraint, inaccuracies in the aerodynamic coefficient predictions can cause a feasible trajectory to be considered infeasible, or vice versa. For this reason, a trade must always be performed between the desired fidelity and the resources available. Apart from this trade between fidelity and computational expense, it is very desirable to use higher fidelity analyses earlier in the design process. A large body of work has been performed to this end, led by efforts in the area of surrogate modeling. In surrogate modeling, an up-front investment is made by running a high fidelity code over a Design of Experiments (DOE); once completed, the DOE data is used to create a surrogate model, which captures the relationships between input variables and responses into regression equations. Depending on the dimensionality of the problem and the fidelity of the code for which a surrogate model is being created, the initial DOE can itself be computationally prohibitive to run. Cokriging, a modeling approach from the field of geostatistics, provides a desirable compromise between computational expense and fidelity. To do this, cokriging leverages a large body of data generated by a low fidelity analysis, combines it with a smaller set of data from a higher fidelity analysis, and creates a kriging surrogate model with prediction fidelity approaching that of the higher fidelity analysis. When integrated into a multidisciplinary environment, a disciplinary analysis module employing cokriging can raise the analysis fidelity without drastically impacting the expense of design iterations. This is demonstrated through the creation of an aerodynamics analysis module in NASA’s OpenMDAO framework. Aerodynamic analyses including Missile DATCOM, APAS, and USM3D are leveraged to create high fidelity aerodynamics decks for parametric vehicle geometries, which are created in NASA’s Vehicle Sketch Pad (VSP). Several trade studies are performed to examine the achieved level of model fidelity, and the overall impact to vehicle design is quantified.

Aerodynamic Properties

JUNO navigation for Jupiter orbit insertion

Juno arrived at Jupiter on 05 July 2016 UTC, achieving orbit with the execution of the Jupiter Orbit Insertion (JOI) maneuver. Thanks to a dynamically wellbehaved spacecraft, the delivery of Juno to JOI was done largely with only a maneuver to setup and Earth gravity assist (EGA), an EGA, an EGA clean-up maneuver, and a JOI targeting maneuver. During the last several weeks of the approach to JOI, the dominant uncertainties in the predicted trajectory were from the Jupiter barycenter ephemeris. In this paper, we discuss the maneuver and orbit determination (OD) strategy for successfully arriving at JOI, the the challenges of calculating a correction to the Jupiter barycenter ephemeris using only radiometric data types, and how the ephemeris estimates during approach to JOI compare to a post-JOI trajectory reconstruction.

Takahashi, Yu

Navigation Prediction Performance During OSIRIS-REx Proximity Operations at (101955) Bennu

The OSIRIS-REx (Origins, Spectral Interpretation, Resource Identification and Security–Regolith Explorer) Orbit Determination team performed covariance analyses prior to the commencement of proximity operations (ProxOps) at (101955) Bennu to determine the expected predicted trajectory performance in order to meet trajectory knowledge requirements throughout each phase of the mission. One of the primary requirements placed on the predicted trajectory performance was based on the performance during orbital phases leading up to the maneuver to initiate the Touch-and-Go (TAG) trajectory descent. Throughout ProxOps the nominal force models being used to predict the spacecraft trajectory were updated in an effort to improve the prediction performance. The most significant models that contributed to prediction performance were of solar radiation pressure, thermal reradiation of the spacecraft, predicted attitude errors, and desaturation maneuvers. Efforts were made throughout all of ProxOps to monitor, trend, predict, and update spacecraft modeling to improve the prediction performance. These efforts were vital to reduce the spacecraft knowledge errors necessary to achieve a TAG target smaller than pre-launch analysis allowed due to the rough terrain of Bennu. Increased precision in predicted trajectory errors allowed for refined uncertainties to be used for future phase planning throughout the mission. The navigation team successfully predicted the spacecraft trajectory throughout all of ProxOps achieving predicted trajectories errors less than originally analyzed.

Jason M. Leonard

Dynamics and Control of Quadcopter in Uncertain Environment

We consider problem of dynamics, control, and uncertainty quantification for quadcopter. We use the 6DOF model of quadcopter dynamics, linear quadratic regulator and linear quadratic Gaussian control of quadcopter in the presence of dynamical disturbances, measurement noise, hidden dynamical variables, dashing GPS signal, and wind gusts to predict quadcopter trajectory. We identify key sources of uncertainties and report on progress in development of a system that estimates the probability of safety-critical events using a set of algorithms based on the trajectory predictions.

uncertainty quantification

Conflict Probability Estimation for Free Flight

The safety and efficiency of free flight will benefit from automated conflict prediction and resolution advisories. Conflict prediction is based on trajectory prediction and is less certain the farther in advance the prediction, however. An estimate is therefore needed of the probability that a conflict will occur, given a pair of predicted trajectories and their levels of uncertainty. A method is developed in this paper to estimate that conflict probability. The trajectory prediction errors are modeled as normally distributed, and the two error covariances for an aircraft pair are combined into a single equivalent covariance of the relative position. A coordinate transformation is then used to derive an analytical solution. Numerical examples and Monte Carlo validation are presented.

Paielli, Russell A.