Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

The Mars Exploration Rover (MER) Transverse Impulse Rocket System (TIRS)

In a very short period of time the MER project successfully developed and tested a system, TIRS/DIMES, to improve the probability of success in the presence of large Martian winds. The successful development of TIRS/DIMES played a big role in the landing site selection process by enabling the landing of Spirit on Gusev crater, a site of very high scientific interest but with known high wind conditions. The performance of TIRS by Spirit at Gusev Crater was excellent. The velocity prediction error was small and Big TIRS was fired reducing the impact horizontal velocity from approximately 23 meters per second to approximately 11 meters per second, well within the airbag capabilities. The performance of TIRS by Opportunity at Meridiani was good. The velocity prediction error was rather large (approximately 6 meters per second, a less than 2 sigma value, but TIRS did not fire which was the correct action.

Transverse Impulse Rocket System (TIRS)↗
NASA NTRS1995

Descent advisor preliminary field test

A field test of the Descent Advisor (DA) automation tool was conducted at the Denver Air Route Traffic Control Center in September 1994. DA is being developed to assist Center controllers in the efficient management and control of arrival traffic. DA generates advisories, based on trajectory predictions, to achieve accurate meter-fix arrival times in a fuel efficient manner while assisting the controller with the prediction and resolution of potential conflicts. The test objectives were to evaluate the accuracy of DA trajectory predictions for conventional- and flight-management-system-equipped jet transports, to identify significant sources of trajectory prediction error, and to investigate procedural and training issues (both air and ground) associated with DA operations. Various commercial aircraft (97 flights total) and a Boeing 737-100 research aircraft participated in the test. Preliminary results from the primary test set of 24 commercial flights indicate a mean DA arrival time prediction error of 2.4 sec late with a standard deviation of 13.1 sec. This paper describes the field test and presents preliminary results for the commercial flights.

Green, Steven M.↗
NASA NTRS1995

Descent Advisor Preliminary Field Test

A field test of the Descent Advisor (DA) automation tool was conducted at the Denver Air Route Traffic Control Center in September 1994. DA is being developed to assist Center controllers in the efficient management and control of arrival traffic. DA generates advisories, based on trajectory predictions, to achieve accurate meter-fix arrival times in a fuel efficient manner while assisting the controller with the prediction and resolution of potential conflicts. The test objectives were: (1) to evaluate the accuracy of DA trajectory predictions for conventional and flight-management system equipped jet transports, (2) to identify significant sources of trajectory prediction error, and (3) to investigate procedural and training issues (both air and ground) associated with DA operations. Various commercial aircraft (97 flights total) and a Boeing 737-100 research aircraft participated in the test. Preliminary results from the primary test set of 24 commercial flights indicate a mean DA arrival time prediction error of 2.4 seconds late with a standard deviation of 13.1 seconds. This paper describes the field test and presents preliminary results for the commercial flights.

Green, Steven M.↗
NASA NTRS1981

Alterations of the climate of a primitive equation model produced by filtering approximations and subsequent tuning and stochastic forcing

A comparison is made of the simulated climates of nonlinear models based on the primitive equations (PE), balance equations (BE), and quasi-geostrophic (QG) equations. The models and numerical procedures are identical in all possible respects. The models are highly truncated spectral forms of Lorenz's (1960) energy preserving two-layer model. Two means of making use of the information contained in the (presumed known) short-term prediction error statistics are investigated. An unrealistically high level of thermal forcing is used so that the model climates are sufficiently different to allow any improvements due to the empirical methods to be observed. The general tuning problem is outlined and the QG model is tuned, using data obtained from a PE model run, to minimize the mean squared short term prediction error.

Hoffman, R. N.↗
NASA NTRS2008

Impact of Pilot Delay and Non-Responsiveness on the Safety Performance of Airborne Separation

Assessing the safety effects of prediction errors and uncertainty on automationsupported functions in the Next Generation Air Transportation System concept of operations is of foremost importance, particularly safety critical functions such as separation that involve human decision-making. Both ground-based and airborne, the automation of separation functions must be designed to account for, and mitigate the impact of, information uncertainty and varying human response. This paper describes an experiment that addresses the potential impact of operator delay when interacting with separation support systems. In this study, we evaluated an airborne separation capability operated by a simulated pilot. The experimental runs are part of the Safety Performance of Airborne Separation (SPAS) experiment suite that examines the safety implications of prediction errors and system uncertainties on airborne separation assistance systems. Pilot actions required by the airborne separation automation to resolve traffic conflicts were delayed within a wide range, varying from five to 240 seconds while a percentage of randomly selected pilots were programmed to completely miss the conflict alerts and therefore take no action. Results indicate that the strategicAirborne Separation Assistance System (ASAS) functions exercised in the experiment can sustain pilot response delays of up to 90 seconds and more, depending on the traffic density. However, when pilots or operators fail to respond to conflict alerts the safety effects are substantial, particularly at higher traffic densities.

Consiglio, Maria↗
NASA NTRS1984

Space Shuttle flight test results of the Cosmic Ray Upset Experiment

CRUX is the first engineering flight experiment designed to test for the incidence of upsets in microcircuits by energetic particles. Harris HM 6504 4K x 1 static CMOS RAM's were used as the test device types in a 1.3 megabit memory which flew on two Shuttle flights. Ground (cyclotron) test information led to a prediction of about one error every 1000 days. No errors were experienced in 10 days of flight. While data were not in conflict with the error prediction and do support it, quantitative validation of the modeling for upsets is not statistically possible. Follow-on hardware (CRUX III) incorporates five different state-of-the-art microcircuits, and is scheduled for flight in October 1984.

Adolphsen, J. W.↗
NASA NTRS2018

Realistic Covariance Generation for the GPM Spacecraft

A covariance realism process for NASA's Global Precipitation Measurement (GPM) spacecraft is detailed. The GPM spacecraft is in a low earth orbit, and performs collision avoidance maneuvers few times a year. Currently GPM is below the International Space Station (ISS). So, in addition to cataloged debris objects, GPM must contend with smallsat/cubesat objects that are deployed from the ISS. Both operational scenarios require complete knowledge of the expected GPM prediction errors as a function of time. In this study, we present a method for generating realistic predicted covariance that uses linear propagation of the covariance with the addition of process noise. Further analyses are presented for the process noise ''tuning'' that generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Different tuning strategies are considered and compared via a Goodness-of-Fit testing for the Gaussian properties of the scaled covariance. SpaceNav's realistic covariance generation approach takes into account the contribution of predicted maneuver errors in the increased propagation uncertainty. Corresponding maneuver uncertainty is injected into the state uncertainty, and is used within the collision avoidance process to determine the collision risk for close approach events that follow a maneuver. This is a critical step in the maneuver planning process that provides the satellite operator with an accurate quantification of the collision probability for planned maneuvers. Using this information, an informed decision can be made to proceed with a maneuver if the collision risk is acceptable. This approach is validated by Monte-Carlo simulations and results are presented.

spacecraft uncertainty propagation↗
NASA NTRS1990

The effect of horizontal resolution on systematic errors of the GLA forecast model

Systematic prediction errors of the Goddard Laboratory for Atmospheres (GLA) forecast system are reduced when the higher-resolution (2 x 2.5 deg) model version is used. Based on a budget analysis of the 200-mb eddy streamfunction, the improvement of stationary eddy forecasting is seen to be caused by the following mechanism: by increasing the horizontal spatial resolution of the forecast model, atmospheric diabatic heating over the three tropical continents is changed in a way that intensifies the planetary-scale divergent circulations associated with the three pairs of divergent-convergent centers over these continents. The intensified divergent circulation results in an enhancement of vorticity sources in the Northern Hemisphere. The additional vorticity is advected eastward by a stationary wave train along 30 deg N, thereby reducing systematic errors in the lower-resolution (4 x 5 deg) GLA model.

Chen, Tsing-Chang↗
NASA NTRS1993

An improved far field drag calculation method for nonlinear CFD codes

An improved method to calculate drag based on far field conditions is presented and demonstrated. The method is illustrated using two CFD codes, PARC and CFL3D, and examining their ability to preserve lift and drag coefficients along grid line defined integration paths. The flow fields were generated by solving the Euler equations for a NACA 0012 airfoil at a free stream Mach number of 0.8 and angle of attack of 1.25 degrees. In comparison to force coefficients obtained by surface pressure integration, neither code acceptably preserved both force coefficients throughout the near and far fields. An investigation into the relationship between numerical prediction error and calculated force coefficients revealed a direct connection between solution mass conservation error and force coefficients error. A method to correct the predicted force coefficients based on integrated mass conservation error is described and demonstrated. The corrected force coefficients for both codes are shown to be more accurate than the uncorrected values. The correction method is applicable to both two and three dimensions and is independent of the algorithm used to generate the flow field.

Sirbaugh, James R.↗
NASA NTRS2019

Casper-1, Part 6: Uncertainty Quantification, Factor Effects, and Outlier Analysis for an On-Board Airplane Trajectory Prediction Function

This report presents data analysis results for a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of onboard energy state and automation mode prediction functions for terminal area arrival and approach phases of flight over a wide range of conditions. In particular, the results include quantification of energy state (i.e., altitude and airspeed) prediction performance, models for prediction performance as a function of initial energy state (i.e., initial altitude, airspeed, and weight) and weather factors, and analysis of outlier prediction performance. Wind speed, wind direction, and wind gradient were found to be major factors in energy state prediction performance. Initial energy and gust intensity were also significant factors in airspeed prediction performance. Furthermore, the results suggest that errors in automation mode prediction may be a major contributor to outlier prediction performance.

Torres-Pomales, Wilfredo↗
NASA NTRS2016

Consistent Evaluation of ACOS-GOSAT, BESD-SCIAMACHY, CarbonTracker, and MACC Through Comparisons to TCCON

Consistent validation of satellite CO2 estimates is a prerequisite for using multiple satellite CO2 measurements for joint flux inversion, and for establishing an accurate long-term atmospheric CO2 data record. Harmonizing satellite CO2 measurements is particularly important since the differences in instruments, observing geometries, sampling strategies, etc. imbue different measurement characteristics in the various satellite CO2 data products. We focus on validating model and satellite observation attributes that impact flux estimates and CO2 assimilation, including accurate error estimates, correlated and random errors, overall biases, biases by season and latitude, the impact of coincidence criteria, validation of seasonal cycle phase and amplitude, yearly growth, and daily variability. We evaluate dry-air mole fraction (X(sub CO2)) for Greenhouse gases Observing SATellite (GOSAT) (Atmospheric CO2 Observations from Space, ACOS b3.5) and SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY) (Bremen Optimal Estimation DOAS, BESD v2.00.08) as well as the CarbonTracker (CT2013b) simulated CO2 mole fraction fields and the Monitoring Atmospheric Composition and Climate (MACC) CO2 inversion system (v13.1) and compare these to Total Carbon Column Observing Network (TCCON) observations (GGG2012/2014). We find standard deviations of 0.9, 0.9, 1.7, and 2.1 parts per million vs. TCCON for CT2013b, MACC, GOSAT, and SCIAMACHY, respectively, with the single observation errors 1.9 and 0.9 times the predicted errors for GOSAT and SCIAMACHY, respectively. We quantify how satellite error drops with data averaging by interpreting according to (error(sup 2) equals a(sup 2) plus b(sup 2) divided by n (with n being the number of observations averaged, a the systematic (correlated) errors, and b the random (uncorrelated) errors). a and b are estimated by satellites, coincidence criteria, and hemisphere. Biases at individual stations have year-to-year variability of 0.3 parts per million, with biases larger than the TCCON predicted bias uncertainty of 0.4 parts per million at many stations. We find that GOSAT and CT2013b under-predict the seasonal cycle amplitude in the Northern Hemisphere (NH) between 46 and 53 degrees North latitude, MACC over-predicts between 26 and 37 degrees North latitude, and CT2013b under-predicts the seasonal cycle amplitude in the Southern Hemisphere (SH). The seasonal cycle phase indicates whether a data set or model lags another data set in time. We find that the GOSAT measurements improve the seasonal cycle phase substantially over the prior while SCIAMACHY measurements improve the phase significantly for just two of seven sites. The models reproduce the measured seasonal cycle phase well except for at Lauder_125HR (CT2013b) and Darwin (MACC). We compare the variability within 1 day between TCCON and models in June-July-August; there is correlation between 0.2 and 0.8 in the NH, with models showing 10-50 percent the variability of TCCON at different stations and CT2013b showing more variability than MACC. This paper highlights findings that provide inputs to estimate flux errors in model assimilations, and places where models and satellites need further investigation, e.g., the SH for models and 45-67 degrees North latitude for GOSAT and CT2013b.

ACOS-GOSAT↗
NASA NTRS2007

Adaptive Modeling of the International Space Station Electrical Power System

Software simulations provide NASA engineers the ability to experiment with spacecraft systems in a computer-imitated environment. Engineers currently develop software models that encapsulate spacecraft system behavior. These models can be inaccurate due to invalid assumptions, erroneous operation, or system evolution. Increasing accuracy requires manual calibration and domain-specific knowledge. This thesis presents a method for automatically learning system models without any assumptions regarding system behavior. Data stream mining techniques are applied to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). We also explore a knowledge fusion approach that uses traditional engineered EPS models to supplement the learned models. We observed that these engineered EPS models provide useful background knowledge to reduce predictive error spikes when confronted with making predictions in situations that are quite different from the training scenarios used when learning the model. Evaluations using ISS sensor data and existing EPS models demonstrate the success of the adaptive approach. Our experimental results show that adaptive modeling provides reductions in model error anywhere from 80% to 96% over these existing models. Final discussions include impending use of adaptive modeling technology for ISS mission operations and the need for adaptive modeling in future NASA lunar and Martian exploration.

Thomas, Justin Ray↗
NASA NTRS2022

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Computational models of the Earth System are critical tools for modern scientific inquiry. Effortstoward evaluating and improving errors in representations of physical and chemical processes inthese large computational systems are commonly stymied by highly nonlinear and complexerror behavior. Recent work has shown that these errors can be effectively predicted usingmodern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previousstudies to apply an interpretable A.I. technique to not only predict model errors but also movetoward understanding the underlying reasons for successful error prediction. We use XGBoostclassification trees and SHapley Additive exPlanations (SHAP) analysis to explore the errors inthe prediction of lightning occurrence in the NASA GEOS model, a widely used Earth SystemModel. This explainable error prediction system can effectively predict the model error andindicates that the errors are strongly related to convective processes and the characteristics ofthe land surface.

Artificial intelligence↗
NASA NTRS1965

Beam-swinging facilities for the Goonhilly satellite-communication aerial

The mode of satellite tracking adopted at the Goonhilly earth station is to steer the aerial primarily by means of predicted data computed from the satellite orbital parameters and to superimpose, during the passage of the satellite, corrections to remove any prediction errors or aberrations due the transmission path. Predictions have proved to be highly accurate for satellites having a high mass to projected area ratio orbiting at altitudes at which air drag is very small; hence the corrections are small and infrequent.

COMMUNICATIONS SATELLITE↗
NASA NTRS2019

Quantifying the Storm Time Thermospheric Neutral Density Variations Using Model and Observations

Accurate determination of thermospheric neutral density holds crucial importance for satellited rag calculations. The problem is twofold and involves the correct estimation of the quiet time climatology and storm time variations. In this work, neutral density estimations from two empirical and threephysics based models of the ionosphere thermosphere are compared with the neutral densities along the Challenging MicroSatellite Payload satellite track for six geomagnetic storms. Storm time variations are extracted from neutral density by (1) subtracting the mean difference between model and observation (bias),(2) setting climatological variations to zero, and (3) multiplying model data with the quiet time ratio between the model and observation. Several metrics are employed to evaluate the model performances. We find that the removal of bias or climatology reveals actual performance of the model in simulating the storm time variations. When bias is removed, depending on event and model, storm time errors in neutral density can decrease by an amount of 113% or can increase by an amount of 12% with respect to error in models with quiet time bias. It is shown that using only average and maximum values of neutral density to determine the model performances can be misleading since a model can estimate the averages fairly well but may not capture the maximum value or vice versa. Since each of the metrics used for determining model performances provides different aspects of the error, among these, we suggest employing mean absolute error, prediction efficiency, and normalized root mean square error together as a standard set ofmetrics for the neutral density.

Eyiguler, E. Ceren Kalafatoglu↗
NASA NTRS2019

CASPEr: an Approach to Characterize the Performance of Onboard Airplane Energy State and Automation Mode Prediction Functions

The Commercial Aviation Safety Team (CAST) has identified a set of safety enhancements to mitigate the risks of loss of control in-flight (LOCI) accidents and incidents involving commercial transport airplanes. In support of this, NASA has been developing technologies intended to enhance flight crew awareness of airplane systems, attitude, and energy state. This report describes preliminary ideas for a methodology to assess the goodness of onboard airplane energy state and automation mode prediction functions. The methodology is intended to contribute to the goal of moving these prediction technologies to the readiness level required for transition to industry and reduce the technology certification risks. In addition, this report describes a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of these predictive functions over a wide range of operational conditions. The first exploratory version of this approach is described. The bulk of the report documents the initial results of tests to characterize the performance of an airplane trajectory prediction function. Future reports will give additional performance characterization results for this function and a complete description of the proposed methodology to assess such functions.

Torres-Pomales, Wilfredo↗