SEARCH · Search NASA

Results for “Performance Deviation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

All sources NASA NTRS DOE OSTI

DOE OSTI2012

Evaluation of the accuracy of 3DVH software estimates of dose to virtual ion chamber and film in composite IMRT QA

Purpose: A novel patient-specific intensity modulated radiation therapy (IMRT) QA system, 3DVH software and mapcheck 2, purports to be able to use diode array-measured beam doses and the patient's DICOM RT plan, structure set, and dose files to predict the delivered 3D dose distribution in the patient for comparison to the treatment planning system (TPS) calculated doses. In this study, the composite dose to an ion chamber and film in phantom predicted by the 3DVH and mapcheck 2 system is compared to the actual measured chamber and film doses. If validated in this context, then 3DVH can be used to perform an equivalent dose analysis as that obtained with film dosimetry and ion chamber-based composite IMRT QA. This is important for those losing their ability to perform film dosimetry for true composite IMRT QA and provides a measure of confidence in the accuracy of 3DVH 3D dose calculations which may replace phantom-based IMRT QA. Methods: The dosimetric results from 15 consecutive patient-specific IMRT QA tests performed by composite field irradiation of ion chamber and EDR2 film in a solid water phantom were compared to the predicted doses for those virtual detectors based on the calculated 3D dose by the 3DVH software using mapcheck 2 measured doses of each beam within each plan. For each of the 15 cases, immediately after performing the ion chamber plus film measurements, the mapcheck 2 was used to measure the dose for each beam of the plan. The dose to the volume of the virtual ion chamber and the dose distribution in the plane of the virtual film calculated by the 3DVH software was extracted. The ratio of the measured to 3DVH or eclipse-predicted ion chamber doses was calculated. The same plane in the phantom measured using film and calculated with eclipse was exported from 3DVH and the 2D gamma metric was used to compare the relationship between the film doses and the eclipse or 3DVH predicted planar doses. Also, the 3D gamma value was calculated in the 3DVH software which compares the eclipse dose to the 3DVH predicted dose distribution. For the 2D and 3D gamma metrics, 2% dose and 2 mm distance to agreement (DTA) were used. In addition, a simple dose difference was performed using either a 2% or 3% dose difference tolerance. Results: The mean ratio {+-} standard deviation of the measured vs 3DVH or vs eclipse-predicted dose to the ion chamber was 1.013 {+-} 0.015 and 1.003 {+-} 0.012, respectively. For 3DVH vs eclipse, the mean percentage of pixels failing the 3D gamma metric was 1.2% {+-} 1.4% while the failure rate for the 2D gamma metric was 1.1% {+-} 0.9%. When either 3DVH or eclipse was compared to EDR2 film, the gamma failure rate was 2.3% {+-} 2.0% and 1.6% {+-} 1.7%, respectively. Mean dose difference failures were 9%-27% {+-} 5%-15% for 2 or 3% dose difference tolerances, depending on the combination of systems tested. No statistically significant differences were found for any of the planar dosimetric comparisons. Conclusions: 3DVH + mapcheck 2 predicts the same absolute dose, the percent of pixels failing the gamma metric, and the percent of pixels failing 2% or 3% dose difference tolerance tests as one would have obtained had one made measurements in solid water phantom using an ion chamber and coronal film instead of a diode array. This is also a necessary although not sufficient condition for validation of the accuracy of 3DVH predictions of the 3D dose using beam-by-beam measurements.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2015

SU-E-P-11: Comparison of Image Quality and Radiation Dose Between Different Scanner System in Routine Abdomen CT

Purpose To evaluate image quality and radiation dose of routine abdomen computed tomography exam with the automatic current modulation technique (ATCM) performed in two different brand 64-slice CT scanners in our site. Materials and Methods A retrospective review of routine abdomen CT exam performed with two scanners; scanner A and scanner B in our site. To calculate standard deviation of the portal hepatic level with a region of interest of 12.5 mm x 12.5mm represented to the image noise. The radiation dose was obtained from CT DICOM image information. Using Computed tomography dose index volume (CTDIv) to represented CT radiation dose. The patient data in this study were with normal weight (about 65–75 Kg). Results The standard deviation of Scanner A was smaller than scanner B, the scanner A might with better image quality than scanner B. On the other hand, the radiation dose of scanner A was higher than scanner B(about higher 50–60%) with ATCM. Both of them, the radiation dose was under diagnostic reference level. Conclusion The ATCM systems in modern CT scanners can contribute a significant reduction in radiation dose to the patient. But the reduction by ATCM systems from different CT scanner manufacturers has slightly variation. Whatever CT scanner we use, it is necessary to find the acceptable threshold of image quality with the minimum possible radiation exposure to the patient in agreement with the ALARA principle.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

Advanced Simulation and Computing Fiscal Year 2016 Implementation Plan, Version 0

The Stockpile Stewardship Program (SSP) is an integrated technical program for maintaining the safety, surety, and reliability of the U.S. nuclear stockpile. The SSP uses nuclear test data, computational modeling and simulation, and experimental facilities to advance understanding of nuclear weapons. It includes stockpile surveillance, experimental research, development and engineering programs, and an appropriately scaled production capability to support stockpile requirements. This integrated national program requires the continued use of experimental facilities and programs, and the computational capabilities to support these programs. The purpose of this IP is to outline key work requirements to be performed and to control individual work activities within the scope of work. Contractors may not deviate from this plan without a revised WA or subsequent IP.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

CyBERT: Cybersecurity Claim Classification by Fine-Tuning the BERT Language Model

We introduce CyBERT, a cybersecurity feature claims classifier based on bidirectional encoder representations from transformers and a key component in our semi-automated cybersecurity vetting for industrial control systems (ICS). To train CyBERT, we created a corpus of labeled sequences from ICS device documentation collected across a wide range of vendors and devices. This corpus provides the foundation for fine-tuning BERT’s language model, including a prediction-guided relabeling process. We propose an approach to obtain optimal hyperparameters, including the learning rate, the number of dense layers, and their configuration, to increase the accuracy of our classifier. Fine-tuning all hyperparameters of the resulting model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original architecture to 94.4% obtained with CyBERT. Furthermore, we evaluated CyBERT for the impact of randomness in the initialization, training, and data-sampling phases. CyBERT demonstrated a standard deviation of ±0.6% during validation across 100 random seed values. Finally, we also compared the performance of CyBERT to other well-established language models including GPT2, ULMFiT, and ELMo, as well as neural network models such as CNN, LSTM, and BiLSTM. The results showed that CyBERT outperforms these models on the validation accuracy and the F1 score, validating CyBERT’s robustness and accuracy as a cybersecurity feature claims classifier.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1973

Investigation to develop a multistage forest sampling inventory system using ERTS-1 imagery

The author has identified the following significant results. Two strips of U-2 RC-10 images were analytically triangulated and adjusted. Control points and pass points were marked on glass plates made from B&W copy negatives of IR color transparencies. A wild PUG-3 and TA1/p monocomparator were used to mark and measure the points on the glass plates. Each plate was measured twice in the same orientation for a check on accuracy and operator error. The 22 photographs were adjusted to 41 ground control and tie points and the block adjustment was performed in a secant plane coordinate system to eliminate the effect of earth curvature. Standard deviations of the residuals of the control and tie points were 12.8 m, 10.8 m, and 4.5 m for the X, Y, and Z coordinates respectively. The 12.8 m and 10.8 m figures correspond to an identification accuracy of 0.1 mm on the U-2 RC-10 plates. The standard deviations of the residuals encountered in the ERTS-1 resectioning were: (1) 0.16 mm assuming uncorrected perspective geometry and (2) 0.12 mm when the polynomial adjustment was added in. These results indicate a reduction of 0.11 in the square error due to the polynomial adjustment.

Langley, P. G.↗

NASA NTRS1987

Low-cost FM oscillator for capacitance type of blade tip clearance measurement system

The frequency-modulated (FM) oscillator described is part of a blade tip clearance measurement system that meets the needs of a wide class of fans, compressors, and turbines. As a result of advancements in the technology of ultra-high-frequency operational amplifiers, the FM oscillator requires only a single low-cost integrated circuit. Its carrier frequency is 42.8 MHz when it is used with an integrated probe and connecting cable assembly consisting of a 0.81 cm diameter engine-mounted capacitance probe and a 61 cm long hermetically sealed coaxial cable. A complete circuit analysis is given, including amplifier negative resistance characteristics. An error analysis of environmentally induced effects is also derived, and an error-correcting technique is proposed. The oscillator can be calibrated in the static mode and has a negative peak frequency deviation of 400 kHz for a rotor blade thickness of 1.2 mm. High-temperature performance tests of the probe and 13 cm of the adjacent cable show good accuracy up to 600 C, the maximum permissible seal temperature. The major source of error is the residual FM oscillator noise, which produces a clearance error of + or - 10 microns at a clearance of 0.5 mm. The oscillator electronics accommodates the high rotor speeds associated with small engines, the signals from which may have frequency components as high as 1 MHz.

Barranger, John P.↗

NASA NTRS1991

Detection of reflector surface from near field phase measurements

The deviation of a reflector antenna surface from a perfect parabolic shape causes degradation of the performance of the antenna. The problem of determining the shape of the reflector surface in a reflector antenna using near field phase measurements is not a new one. A recent issue of the IEEE tansactions on Antennas and Propagation (June 1988) contained numerous descriptions of the use of these measurements: holographic reconstruction or inverse Fourier transform. Holographic reconstruction makes use of measurement of the far field of the reflector and then applies the Fourier transform relationship between the far field and the current distribution on the reflector surface. Inverse Fourier transformation uses the phase measurements to determine the far field pattern using the method of Kerns. After the far field pattern is established, an inverse Fourier transform is used to determine the phases in a plane between the reflector surface and the plane in which the near field measurements were taken. These calculations are time consuming since they involve a relatively large number of operations. A much faster method can be used to determine the position of the reflector. This method makes use of simple geometric optics to determine the path length of the ray from the feed to the reflector and from the reflector to the measurement point. For small physical objects and low frequencies, diffraction effects have a major effect on the error, and the algorithm provides incorrect results. It is believed that the effect is less noticeable for large distortions such as antenna warping, and more noticeable for small, localized distortions such as bumps and depressions such as might be caused by impact damage.

Ida, Nathan↗

NASA NTRS1989

Estimations of ABL fluxes and other turbulence parameters from Doppler lidar data

Techniques for extraction boundary layer parameters from measurements of a short-pulse CO2 Doppler lidar are described. The measurements are those collected during the First International Satellites Land Surface Climatology Project (ISLSCP) Field Experiment (FIFE). By continuously operating the lidar for about an hour, stable statistics of the radial velocities can be extracted. Assuming that the turbulence is horizontally homogeneous, the mean wind, its standard deviations, and the momentum fluxes were estimated. Spectral analysis of the radial velocities is also performed from which, by examining the amplitude of the power spectrum at the inertial range, the kinetic energy dissipation was deduced. Finally, using the statistical form of the Navier-Stokes equations, the surface heat flux is derived as the residual balance between the vertical gradient of the third moment of the vertical velocity and the kinetic energy dissipation. Combining many measurements would normally reduce the error provided that, it is unbiased and uncorrelated. The nature of some of the algorithms however, is such that, biased and correlated errors may be generated even though the raw measurements are not. Data processing procedures were developed that eliminate bias and minimize error correlation. Once bias and error correlations are accounted for, the large sample size is shown to reduce the errors substantially. The principal features of the derived turbulence statistics for two case studied are presented.

Gal-Chen, Tzvi↗

NASA NTRS1999

Bubble Generation in a Continuous Liquid Flow Under Reduced Gravity Conditions

The present work reports a study of bubble generation under reduced gravity conditions for both co-flow and cross-flow configurations. Experiments were performed aboard the DC-9 Reduced Gravity Aircraft at NASA Glenn Research Center, using an air-water system. Three different flow tube diameters were used: 1.27, 1.9, and 2.54 cm. Two different ratios of air injection nozzle to tube diameters were considered: 0.1 and 0.2. Gas and liquid volumetric flow rates were varied from 10 to 200 ml/s. It was experimentally observed that with increasing superficial liquid velocity, the bubbles generated decreased in size. The bubble diameter was shown to increase with increasing air injection nozzle diameters. As the tube diameter was increased, the size of the detached bubbles increased. Likewise, as the superficial liquid velocity was increased, the frequency of bubble formation increased and thus the time to detach forming bubbles decreased. Independent of the flow configuration (for either single nozzle or multiple nozzle gas injection), void fraction and hence flow regime transition can be controlled in a somewhat precise manner by solely varying the gas and liquid volumetric flow rates. On the other hand, it is observed that uniformity of bubble size can be controlled more accurately by using single nozzle gas injection than by using multiple port injection, since this latter system gives rise to unpredictable coalescence of adjacent bubbles. A theoretical model, based on an overall force balance, is employed to study single bubble generation in the dynamic and bubbly flow regime. Under conditions of reduced gravity, the gas momentum flux enhances bubble detachment; however, the surface tension forces at the nozzle tip inhibits bubble detachment. Liquid drag and inertia can act either as attaching or detaching force, depending on the relative velocity of the bubble with respect to the surrounding liquid. Predictions of the theoretical model compare well with performed experiments. However, at higher superficial,liquid velocities, the bubble neck length begins to significantly deviate from the value of the air injection nozzle diameter and thus the theory no longer predicts the experiment behavior. Effects of fluid properties, injection geometry and flow conditions on generated bubble size are investigated using the theoretical model. It is shown that bubble diameter is larger in a reduced gravity environment than in a normal gravity environment at similar flow condition and flow geometry.

Pais, Salvatore Cezar↗

NASA NTRS2005

A high performance frequency standard and distribution system for Cassini Ka-band experiment

This paper provides an overview and update of a specialized frequency reference system for the NASA Deep Space Network (DSN) to support Ka-band radio science experiments with the Cassini spacecraft, currently orbiting Saturn. Three major components, a Hydrogen Maser, Stabilized Fiber-optic Distribution Assembly (SFODA), and 10 Kelvin Cryocooled Sapphire Oscillator (10K CSO) and frequency-lock-loop, are integrated to achieve the very high performance, ground based frequency reference at a remote antenna site located 16 km from the hydrogen maser. Typical measured Allan Deviation is 1.6 -14 1 0a't 1 second and 1.7 x 10 -15 at 1000 seconds averaging intervals. Recently two 10K CSOs have been compared in situ while operating at the remote DSN site DSS-25. The CSO references were used operationally to downconvert the Ka band downlink received from the Cassini spacecraft in a series of occultation measurements performed over a 78 day period from March to June 2005.

sapphire↗

NASA NTRS2015

Objective Motion Cueing Criteria Investigation Based on Three Flight Tasks

This paper intends to help establish fidelity criteria to accompany the simulator motion system diagnostic test specified by the International Civil Aviation Organization. Twelve air- line transport pilots flew three tasks in the NASA Vertical Motion Simulator under four different motion conditions. The experiment used three different hexapod motion configurations, each with a different tradeoff between motion filter gain and break frequency, and one large motion configuration that utilized as much of the simulator's motion space as possible. The motion condition significantly affected: 1) pilot motion fidelity ratings, and sink rate and lateral deviation at touchdown for the approach and landing task, 2) pilot motion fidelity ratings, roll deviations, maximum pitch rate, and number of stick shaker activations in the stall task, and 3) heading deviation after an engine failure in the takeoff task. Significant differences in pilot-vehicle performance were used to define initial objective motion cueing criteria boundaries. These initial fidelity boundaries show promise but need refinement.

pilot training↗

NASA NTRS2018

Reliability of the Danish Aerospace Corporation Portable Pulmonary Function System

Metabolic gas analysis is a critical component of investigations that measure cardio-pulmonary exercise responses during and after long-duration spaceflight. The primary purpose of the current study was to determine the reliability and intra-subject repeatability of a metabolic gas analysis device, the Portable Pulmonary Function System (PPFS), designed for use on the International Space Station (ISS). The second objective of this study was to directly compare PPFS measurements of expired oxygen and carbon dioxide (FEO2 and FECO2) to values obtained from a well-validated clinical metabolic gas analysis system (ParvoMedics TrueOne (c) [PM]). Eight subjects performed four peak cycle tests to maximal exertion. The first test was used to prescribe work rates for the subsequent test sessions. Metabolic gas analysis for this test was performed by the PM, but samples of FEO2 and FECO2 also were simultaneously collected for analysis by the PPFS. Subjects then performed three additional peak cycle tests, consisting of three 5-min stages designed to elicit 25%, 50%, and 75% maximal oxygen consumption (VO2max) followed by stepwise increases of 25 W/min until subjects reached volitional exhaustion. Metabolic gas analysis was performed using the PPFS for these tests. Intraclass correlation coefficients (ICC), within-subject standard deviations (WS SD), and coefficients of variation (CV%) were calculated for the repeated exercise tests. Mixed model regression analysis was used to compare paired FEO2 and FECO2 values obtained from the PPFS and the PM during the initial test. The ICC values for oxygen consumption (VO2), carbon dioxide production (VCO2), and ventilation (VE) indicate that the PPFS is highly reliable (0.79 to 0.99) for all exercise levels tested; however, ICCs for respiratory exchange ratio (RER) were low ( 0.11 - 0.51), indicating poor agreement between trials during submaximal and maximal exercise. Overall, CVs ranged from 1.6% to 6.7% for all measurements, a finding consistent with reported values that were obtained using other metabolic gas analysis techniques. The PPFS and PM produced comparable FEO2 data; however, there was less agreement between measures of FECO2 obtained from the two devices, particularly at lower CO2 concentrations. The PPFS appears, in practically all respects, to yield highly reliable metabolic gas analysis data. Lower reliability of RER measurements reported in the literature and likely is not a function of the PPFS device. Further examination of PPFS CO2 data is warranted to better understand the limitations of these PPFS measurements. Overall, the PPFS when used for repeated measures of cardio-pulmonary exercise should provide accurate and reliable data for studies of human adaptation to spaceflight.

Portable Pulmonary Function System (PPFS)↗

NASA NTRS2018

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

DOE OSTI2014

Molecular self ordering and charge transport in layer by layer deposited poly (3,3‴-dialkylquarterthiophene) films formed by Langmuir-Schaefer technique

The performance of π-conjugated polymer based electronic devices is directly governed by the molecular morphology of polymer aggregation, the extent to which a molecule is electronically coupled (self ordered and interacted) to neighboring molecules, and orientation. The well electronic coupled and crystalline/ordered polymer films have the potential to enhance the charge transport properties up to a benchmark. However, there is insufficient knowledge about the direct formation of large area, oriented, crystalline, and smooth films. In this study, we have presented Langmuir Schaefer technique to obtain the large area, oriented, crystalline, and smooth film of Poly (3,3‴-dialkylquarterthiophene) (PQT-12) polymer. The effect of self ordering and orientation of PQT-12 polymer on optical, morphological, and charge transport properties has been investigated. The prepared films have been characterized by UV-vis spectroscopy, Raman spectroscopy, transmission electron microscopy (TEM), selected area diffractions pattern (SAED), and atomic force microscopy (AFM) techniques. UV-vis spectra, TEM, SAED, and AFM images of monolayer films reveal the formation of well ordered and electronically coupled polymer domains. Layer by layer deposited films reveal the change in the orientation, which is confirmed by Raman spectra. Electronic properties and layer dependent charge transport properties are investigated using sandwiched structure Al/PQT-12/ITO Schottky configuration with perpendicular to the deposited films. It is observed that the charge transport properties and device electronic parameters (ideality factor and turn on voltage) are significantly changing with increasing the number of PQT-12 layers. Our study also demonstrates the charge transport between polymer crystallites and cause of deviation of ideal behavior of organic Schottky diodes. It may be further explored for improving the performance of other organic and optoelectronic devices.

36 MATERIALS SCIENCE↗

DOE OSTI2024

The SRG/eROSITA All-Sky Survey: Dark Energy Survey year 3 weak gravitational lensing by eRASS1 selected galaxy clusters

Context. Number counts of galaxy clusters across redshift are a powerful cosmological probe if a precise and accurate reconstruction of the underlying mass distribution is performed – a challenge called mass calibration. With the advent of wide and deep photometric surveys, weak gravitational lensing (WL) by clusters has become the method of choice for this measurement. Aims. We measured and validated the WL signature in the shape of galaxies observed in the first three years of the Dark Energy Survey (DES Y3) caused by galaxy clusters and groups selected in the first all-sky survey performed by SRG (Spectrum Roentgen Gamma)/eROSITA (eRASS1). These data were then used to determine the scaling between the X-ray photon count rate of the clusters and their halo mass and redshift. Methods. We empirically determined the degree of cluster member contamination in our background source sample. The individual cluster shear profiles were then analyzed with a Bayesian population model that self-consistently accounts for the lens sample selection and contamination and includes marginalization over a host of instrumental and astrophysical systematics. To quantify the accuracy of the mass extraction of that model, we performed mass measurements on mock cluster catalogs with realistic synthetic shear profiles. This allowed us to establish that hydrodynamical modeling uncertainties at low lens redshifts (z < 0.6) are the dominant systematic limitation. At high lens redshift, the uncertainties of the sources’ photometric redshift calibration dominate. Results. With regard to the X-ray count rate to halo mass relation, we determined its amplitude, its mass trend, the redshift evolution of the mass trend, the deviation from self-similar redshift evolution, and the intrinsic scatter around this relation. Conclusions. The mass calibration analysis performed here sets the stage for a joint analysis with the number counts of eRASS1 clusters to constrain a host of cosmological parameters. We demonstrate that WL mass calibration of galaxy clusters can be performed successfully with source galaxies whose calibration was performed primarily for cosmic shear experiments, opening the way for the cluster cosmological exploitation of future optical and NIR surveys like Euclid and LSST.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1989

An empirically derived figure of merit for the quality of overall task performance

The need to develop an operationally relevant figure of merit for the quality of performance of a complex system such as an aircraft cockpit stems from a hypothesized dissociation between measures of performance and those of workload. Performance can be measured in terms of time, errors, or a combination of these. In most tasks performed by expert operators, errors are relatively rare and often corrected in time to avoid consequences. Moreover, perfect performance is seldom necessary to accomplish a particular task. Moreover, how well an expert performs a complex task consisting of a series of discrete cognitive tasks superimposed on a continuous task, such as flying an aircraft, does not depend on how well each discrete task is performed, but on their smooth sequencing. This makes the amount of time spent on each subtask of paramount importance in measuring overall performance, since smooth sequencing requires a minimum amount of time spent on each task. Quality consists in getting tasks done within a crucial time interval while maintaining acceptable continuous task performance. Thus, a figure of merit for overall quality of performance should be primarily a measure of time to perform discrete subtasks combined with a measure of basic vehicle control. Thus, the proposed figure of merit requires doing a task analysis on a series of performance, or runs, of a particular task, listing each discrete task and its associated time, and calculating the mean and standard deviation of these times, along with the mean and standard deviation of tracking error for the whole task. A set of simulator data on 30 runs of a landing task was obtained and a figure of merit will be calculated for each run. The figure of merit will be compared for voice and data link, so that the impact of this technology on total crew performance (not just communication performance) can be assessed. The effect of data link communication on other cockpit tasks will also be considered.

Lemay, Moira↗

NASA NTRS2017

Predicting the Operational Acceptability of Route Advisories

NASA envisions a future Air Traffic Management system that allows safe, efficient growth in global operations, enabled by increasing levels of automation and autonomy. In a safety-critical system, the introduction of increasing automation and autonomy has to be done in stages, making human-system integrated concepts critical in the foreseeable future. One example where this is relevant is for tools that generate more efficient flight routings or reroute advisories. If these routes are not operationally acceptable, they will be rejected by human operators, and the associated benefits will not be realized. Operational acceptance is therefore required to enable the increased efficiency and reduced workload benefits associated with these tools. In this paper, the authors develop a predictor of operational acceptability for reroute advisories. Such a capability has applications in tools that identify more efficient routings around weather and congestion and that better meet airline preferences. The capability is based on applying data mining techniques to flight plan amendment data reported by the Federal Aviation Administration and data on requested reroutes collected from a field trial of the NASA developed Dynamic Weather Routes tool, which advised efficient route changes to American Airlines dispatchers in 2014. 10-Fold cross validation was used for feature, model and parameter selection, while nested cross validation was used to validate the model. The model performed well in predicting controller acceptance or rejection of a route change as indicated by chosen performance metrics. Features identified as relevant to controller acceptance included the historical usage of the advised route, the location of the maneuver start point relative to the boundaries of the airspace sector containing the maneuver start (the maneuver start sector), the reroute deviation from the original flight plan, and the demand level in the maneuver start sector. A random forest with forty trees was the best performing of the five models evaluated in this paper.

route advisories↗

NASA NTRS2017

Predicting the Operational Acceptability of Route Advisories

operational acceptability↗