Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Accelerated Aging in Electrolytic Capacitors for Prognostics

The focus of this work is the analysis of different degradation phenomena based on thermal overstress and electrical overstress accelerated aging systems and the use of accelerated aging techniques for prognostics algorithm development. Results on thermal overstress and electrical overstress experiments are presented. In addition, preliminary results toward the development of physics-based degradation models are presented focusing on the electrolyte evaporation failure mechanism. An empirical degradation model based on percentage capacitance loss under electrical overstress is presented and used in: (i) a Bayesian-based implementation of model-based prognostics using a discrete Kalman filter for health state estimation, and (ii) a dynamic system representation of the degradation model for forecasting and remaining useful life (RUL) estimation. A leave-one-out validation methodology is used to assess the validity of the methodology under the small sample size constrain. The results observed on the RUL estimation are consistent through the validation tests comparing relative accuracy and prediction error. It has been observed that the inaccuracy of the model to represent the change in degradation behavior observed at the end of the test data is consistent throughout the validation tests, indicating the need of a more detailed degradation model or the use of an algorithm that could estimate model parameters on-line. Based on the observed degradation process under different stress intensity with rest periods, the need for more sophisticated degradation models is further supported. The current degradation model does not represent the capacitance recovery over rest periods following an accelerated aging stress period.

Celaya, Jose R.↗

Comparative Analysis of Upper Ocean Heat Content Variability from Ensemble Operational Ocean Analyses

Upper ocean heat content (HC) is one of the key indicators of climate variability on many time-scales extending from seasonal to interannual to long-term climate trends. For example, HC in the tropical Pacific provides information on thermocline anomalies that is critical for the longlead forecast skill of ENSO. Since HC variability is also associated with SST variability, a better understanding and monitoring of HC variability can help us understand and forecast SST variability associated with ENSO and other modes such as Indian Ocean Dipole (IOD), Pacific Decadal Oscillation (PDO), Tropical Atlantic Variability (TAV) and Atlantic Multidecadal Oscillation (AMO). An accurate ocean initialization of HC anomalies in coupled climate models could also contribute to skill in decadal climate prediction. Errors, and/or uncertainties, in the estimation of HC variability can be affected by many factors including uncertainties in surface forcings, ocean model biases, and deficiencies in data assimilation schemes. Changes in observing systems can also leave an imprint on the estimated variability. The availability of multiple operational ocean analyses (ORA) that are routinely produced by operational and research centers around the world provides an opportunity to assess uncertainties in HC analyses, to help identify gaps in observing systems as they impact the quality of ORAs and therefore climate model forecasts. A comparison of ORAs also gives an opportunity to identify deficiencies in data assimilation schemes, and can be used as a basis for development of real-time multi-model ensemble HC monitoring products. The OceanObs09 Conference called for an intercomparison of ORAs and use of ORAs for global ocean monitoring. As a follow up, we intercompared HC variations from ten ORAs -- two objective analyses based on in-situ data only and eight model analyses based on ocean data assimilation systems. The mean, annual cycle, interannual variability and longterm trend of HC have been analyzed

Xue, Yan↗

Indirect M-MRAC for Systems with Time Varying Parameters and Bounded Disturbances

The paper presents a prediction-identification model based adaptive control method for uncertain systems with time varying parameters in the presence of bounded external disturbances. The method guarantees desired tracking performance for the system s state and input signals. This is achieved by feeding back the state prediction error to the identification model. It is shown that the desired closed-loop properties are obtained with fast adaptation when the error feedback gain is selected proportional to the square root of the adaptation rate. The theoretical findings are confirmed via a simulation example.

Stepanyan, Vahram↗

Scatter-Reducing Sounding Filtration Using a Genetic Algorithm and Mean Monthly Standard Deviation

Retrieval algorithms like that used by the Orbiting Carbon Observatory (OCO)-2 mission generate massive quantities of data of varying quality and reliability. A computationally efficient, simple method of labeling problematic datapoints or predicting soundings that will fail is required for basic operation, given that only 6% of the retrieved data may be operationally processed. This method automatically obtains a filter designed to reduce scatter based on a small number of input features. Most machine-learning filter construction algorithms attempt to predict error in the CO2 value. By using a surrogate goal of Mean Monthly STDEV, the goal is to reduce the retrieved CO2 scatter rather than solving the harder problem of reducing CO2 error. This lends itself to improved interpretability and performance. This software reduces the scatter of retrieved CO2 values globally based on a minimum number of input features. It can be used as a prefilter to reduce the number of soundings requested, or as a post-filter to label data quality. The use of the MMS (Mean Monthly Standard deviation) provides a much cleaner, clearer filter than the standard ABS(CO2-truth) metrics previously employed by competitor methods. The software's main strength lies in a clearer (i.e., fewer features required) filter that more efficiently reduces scatter in retrieved CO2 rather than focusing on the more complex (and easily removed) bias issues.

Mandrake, Lukas↗

Controller Strategies for Automation Tool Use under Varying Levels of Trajectory Prediction Uncertainty

A human-in-the-loop simulation was conducted to examine the effects of varying levels of trajectory prediction uncertainty on air traffic controller workload and performance, as well as how strategies and the use of decision support tools change in response. This paper focuses on the strategies employed by two controllers from separate teams who worked in parallel but independently under identical conditions (airspace, arrival traffic, tools) with the goal of ensuring schedule conformance and safe separation for a dense arrival flow in en route airspace. Despite differences in strategy and methods, both controllers achieved high levels of schedule conformance and safe separation. Overall, results show that trajectory uncertainties introduced by wind and aircraft performance prediction errors do not affect the controllers' ability to manage traffic. Controller strategies were fairly robust to changes in error, though strategies were affected by the amount of delay to absorb (scheduled time of arrival minus estimated time of arrival). Using the results and observations, this paper proposes an ability to dynamically customize the display of information including delay time based on observed error to better accommodate different strategies and objectives.

Strategy↗

LightForce Photon-Pressure Collision Avoidance: Efficiency Assessment on an Entire Catalogue of Space Debris

The potential to perturb debris orbits using photon pressure from ground-based lasers has been confirmed by independent research teams. Two useful applications of this scheme are protecting space assets from impacts with debris and stabilizing the orbital debris environment, both relying on collision avoidance rather than de-orbiting debris. This paper presents the results of a new assessment method to analyze the efficiency of the concept for collision avoidance. Earlier research concluded that one ground based system consisting of a 10 kW class laser, directed by a 1.5 m telescope with adaptive optics, can prevent a significant fraction of debris-debris collisions in low Earth orbit. That research used in-track displacement to measure efficiency and restricted itself to an analysis of a limited number of objects. As orbit prediction error is dependent on debris object properties, a static displacement threshold should be complemented with another measure to assess the efficiency of the scheme. In this paper we present the results of an approach using probability of collision. Using a least-squares fitting method, we improve the quality of the original TLE catalogue in terms of state and co-state accuracy. We then calculate collision probabilities for all the objects in the catalogue. The conjunctions with the highest risk of collision are then engaged by a simulated network of laser ground stations. After those engagements, the perturbed orbits are used to re-assess the collision probability in a 20 minute window around the original conjunction. We then use different criteria to evaluate the utility of the laser-based collision avoidance scheme and assess the number of base-line ground stations needed to mitigate a significant number of high probability conjunctions. Finally, we also give an account how a laser ground station can be used for both orbit deflection and debris tracking.

laser↗

A Parameter Estimation Scheme for Multiscale Kalman Smoother (MKS) Algorithm Used in Precipitation Data Fusion

A new approach is presented in this paper to effectively obtain parameter estimations for the Multiscale Kalman Smoother (MKS) algorithm. This new approach has demonstrated promising potentials in deriving better data products based on data of different spatial scales and precisions. Our new approach employs a multi-objective (MO) parameter estimation scheme (called MO scheme hereafter), rather than using the conventional maximum likelihood scheme (called ML scheme) to estimate the MKS parameters. Unlike the ML scheme, the MO scheme is not simply built on strict statistical assumptions related to prediction errors and observation errors, rather, it directly associates the fused data of multiple scales with multiple objective functions in searching best parameter estimations for MKS through optimization. In the MO scheme, objective functions are defined to facilitate consistency among the fused data at multiscales and the input data at their original scales in terms of spatial patterns and magnitudes. The new approach is evaluated through a Monte Carlo experiment and a series of comparison analyses using synthetic precipitation data. Our results show that the MKS fused precipitation performs better using the MO scheme than that using the ML scheme. Particularly, improvements are significant compared to that using the ML scheme for the fused precipitation associated with fine spatial resolutions. This is mainly due to having more criteria and constraints involved in the MO scheme than those included in the ML scheme. The weakness of the original ML scheme that blindly puts more weights onto the data associated with finer resolutions is overcome in our new approach.

multiscale↗

Experiment Design for Complex VTOL Aircraft with Distributed Propulsion and Tilt Wing

Selected experimental results from a wind tunnel study of a subscale VTOL concept with distributed propulsion and tilt lifting surfaces are presented. The vehicle complexity and automated test facility were ideal for use with a randomized designed experiment. Design of Experiments and Response Surface Methods were invoked to produce run efficient, statistically rigorous regression models with minimized prediction error. Static tests were conducted at the NASA Langley 12-Foot Low-Speed Tunnel to model all six aerodynamic coefficients over a large flight envelope. This work supports investigations at NASA Langley in developing advanced configurations, simulations, and advanced control systems.

Murphy, Patrick C.↗

Statistical Analysis of Instantaneous Frequency Scaling Factor as Derived From Optical Disdrometer Measurements At KQ Bands

The rain rate data and statistics of a location are often used in conjunction with models to predict rain attenuation. However, the true attenuation is a function not only of rain rate, but also of the drop size distribution (DSD). Generally, models utilize an average drop size distribution (Laws and Parsons or Marshall and Palmer [1]). However, individual rain events may deviate from these models significantly if their DSD is not well approximated by the average. Therefore, characterizing the relationship between the DSD and attenuation is valuable in improving modeled predictions of rain attenuation statistics. The DSD may also be used to derive the instantaneous frequency scaling factor and thus validate frequency scaling models. Since June of 2014, NASA Glenn Research Center (GRC) and the Politecnico di Milano (POLIMI) have jointly conducted a propagation study in Milan, Italy utilizing the 20 and 40 GHz beacon signals of the Alphasat TDP#5 Aldo Paraboni payload. The Ka- and Q-band beacon receivers provide a direct measurement of the signal attenuation while concurrent weather instrumentation provides measurements of the atmospheric conditions at the receiver. Among these instruments is a Thies Clima Laser Precipitation Monitor (optical disdrometer) which yields droplet size distributions (DSD); this DSD information can be used to derive a scaling factor that scales the measured 20 GHz data to expected 40 GHz attenuation. Given the capability to both predict and directly observe 40 GHz attenuation, this site is uniquely situated to assess and characterize such predictions. Previous work using this data has examined the relationship between the measured drop-size distribution and the measured attenuation of the link [2]. The focus of this paper now turns to a deeper analysis of the scaling factor, including the prediction error as a function of attenuation level, correlation between the scaling factor and the rain rate, and the temporal variability of the drop size distribution both within a given rain event and across different varieties of rain events. Index Terms-drop size distribution, frequency scaling, propagation losses, radiowave propagation.

Radio Attenuation↗

Statistical Analysis of Instantaneous Frequency Scaling Factor as Derived From Optical Disdrometer Measurements At KQ Bands

The rain rate data and statistics of a location are often used in conjunction with models to predict rain attenuation. However, the true attenuation is a function not only of rain rate, but also of the drop size distribution (DSD). Generally, models utilize an average drop size distribution (Laws and Parsons or Marshall and Palmer. However, individual rain events may deviate from these models significantly if their DSD is not well approximated by the average. Therefore, characterizing the relationship between the DSD and attenuation is valuable in improving modeled predictions of rain attenuation statistics. The DSD may also be used to derive the instantaneous frequency scaling factor and thus validate frequency scaling models. Since June of 2014, NASA Glenn Research Center (GRC) and the Politecnico di Milano (POLIMI) have jointly conducted a propagation study in Milan, Italy utilizing the 20 and 40 GHz beacon signals of the Alphasat TDP#5 Aldo Paraboni payload. The Ka- and Q-band beacon receivers provide a direct measurement of the signal attenuation while concurrent weather instrumentation provides measurements of the atmospheric conditions at the receiver. Among these instruments is a Thies Clima Laser Precipitation Monitor (optical disdrometer) which yields droplet size distributions (DSD); this DSD information can be used to derive a scaling factor that scales the measured 20 GHz data to expected 40 GHz attenuation. Given the capability to both predict and directly observe 40 GHz attenuation, this site is uniquely situated to assess and characterize such predictions. Previous work using this data has examined the relationship between the measured drop-size distribution and the measured attenuation of the link]. The focus of this paper now turns to a deeper analysis of the scaling factor, including the prediction error as a function of attenuation level, correlation between the scaling factor and the rain rate, and the temporal variability of the drop size distribution both within a given rain event and across different varieties of rain events. Index Terms-drop size distribution, frequency scaling, propagation losses, radiowave propagation.

Statistics↗

Wall-Modeled Lattice Boltzmann and Navier-Stokes Approaches for Separated Flows

Lattice Boltzmann (LB) and hybrid Reynolds-averaged Navier-Stokes/large eddy simulation (RANS/LES) methods within the Launch Ascent and Vehicle Aerodynamics (LAVA) solver framework are applied to NASA's Revolutionary Computational Aerosciences (RCA) standard test cases for separated flows. A detailed comparison between the performance and accuracy of the two emerging numerical methodologies for turbulence resolving simulations, i.e. the LB and hybrid RANS/LES methods will be presented. This contribution addresses the RCA technical challenge to identify and down-select critical turbulence, transition, and numerical method technologies for 40% reduction in predictive error for standard turbulence separated flow test cases. Results for the 2D NASA wall-mounted hump and the axisymmetric transonic bump including time-averaged pressure coefficient, skin friction, and velocity pro les, as well as resolved and modeled Reynolds stresses for both numerical approaches will be presented and differences between LB and hybrid RANS/LES will be discussed.

Lattice Boltzmann↗

DSCOVR-EPIC MAIAC AOD - A Proxy for Understanding Aerosol Diurnal Patterns from Space

The Deep Space Climate Observatory (DSCOVR) spacecraft was launched on 11 February 2015 and in June 2015 achieved its orbit at the first Lagrange point (L1), 1.5 million km from Earth toward the sun. The Earth Polychromatic Imaging Camera (EPIC) onboard DSCOVR views the entire sunlit Earth from sunrise to sunset, every 1-2 hours, at scattering angles between 168.5° and 175.5° with 10 narrowband filters in the range of 317-779 nm. NASA Multiangle Implementation of Atmospheric Correction (MAIAC) algorithm, originally developed for MODIS, has been applied to EPIC data with an Aerosol Optical Depth (AOD) product at 440nm with a 10km spatial resolution. This high temporal resolution product is a unique dataset for investigating diurnal patterns in aerosols from space. Our work analyzed the capability of the satellite-borne data to capture the aerosol diurnal variation by associating it with AERONET AOD at 440nm data over the contiguous US. We validated the DSCOVR MAIAC AOD data over 100 AERONET stations during 2015-2018, and examined the contribution of the surface reflectance and relevant acquisition angles, derived by the MAIAC algorithm, to the predicted error. We used over 180,000 hourly DSCOVR-EPIC MAIAC AOD observations with collocated with AERONET AOD observations averaged over +-30 minutes from the satellite overpass time. The AERONET and DSCOVR AOD temporal patterns show that the diurnal variation is different across US AERONET sites, with higher diurnal variation in the DSCOVR dataset in general.

Sorek-Hamer, Meytar↗

Analysis of Airport Ground Delay Program Decisions Using Data Mining Techniques

Air traffic service providers have to make decisions regarding changes to air traffic flow in the event of major weather disturbances and traffic congestions to maintain safety of the system. The behavior of the air traffic management system will be more predictable if consistent decisions are made under similar traffic and weather conditions. Consistency of deciding on control action depends on the weather and traffic conditions as well as accuracy in predicting these conditions. Weather parameters (defined in terms of forecast and actual weather and traffic conditions) on different days can be used to categorize days into days with little decision consistency, days with moderate decision consistency and days with high decision consistency. Four years of traffic, weather and ground delay program decisions data at major airports in the United States are used in the analysis. This paper examines performance of different data mining methods in the three regions of decision consistency. Not surprisingly, data mining methods have the best performance in the region of most decision consistency and have the poorest performance in the region of little decision consistency. In applications where data mining methods have differing performance in differing regions, it would be more useful to characterize the region specific performance instead of characterizing performance by a single parameter. Finally, the results show no significant variation in the performance of different data mining methods for this particular problem. The fact that different mining methods show no significant variation also provides further confidence in the results of data mining methods. Work in this abstract discusses initial results. This paper describes the results in terms of both forecast and actual environmental conditions and discusses how prediction errors impact decision consistency.

Kulkarni, Deepak↗

Conflict Detection Using Variable Four-Dimensional Uncertainty Bounds to Control Missed Alerts

Decision-support tools for maintaining pairwise aircraft separation rely on conflict detection to alert the operator when the predicted trajectories of aircraft will result in a loss of separation. But aircraft frequently do not follow their predicted trajectories exactly. This can cause missed alerts and the failure of strategic separation procedures. We present a technique for modeling a bounded region of uncertainty around a four-dimensional predicted trajectory and an algorithm for detecting conflicts between trajectories modeled in this way that avoids missed alerts as long as the aircraft remain within the specified regions of uncertainty. In addition, we present an algorithm for detecting the intrusion of a trajectory modeled in this way into an area hazard modeled as a polygonal region. The size of the region of uncertainty can vary along the trajectory continually and independently in the along-path, cross-track, and vertical dimensions, providing an opportunity to reduce the likelihood of false alerts while protecting against typical prediction errors. The algorithm has been implemented in the Autonomous Operations Planner, a NASA Langley prototype decision support tool for airborne self-separation.

Karr, David A.↗

Preliminary Steps in Developing Rapid Aero Modeling Technology

The Rapid Aero Modeling (RAM) approach is a method to efficiently and automatically obtain aerodynamic models during testing, significantly saving time and resources. Motivation for this technology results from demand for experimental efficiency and model fidelity that has increased with growing aircraft complexity and aerodynamic nonlinearities. These issues are typical in the responses presented by a class of vehicles categorized as Urban Air Mobility aircraft where many features from both airplane and rotorcraft are present. For UAM configurations, with typically many more factors than conventional aircraft, traditional test methods can lead to increased costs and missed interactions. RAM guides the test to obtain high-fidelity, statistically rigorous aircraft models, and the approach is applicable to computational, ground, or flight-test experiments. It combines concepts from Design of Experiment theory and Aircraft System Identification theory that allow the user the freedom to choose, in advance of the test, a specific level of fidelity typically, in terms of prediction error. RAM only collects data required to meet the user-specified fidelity and fidelity is only limited by the facility and test article capabilities. An initial wind tunnel test to support development of RAM was conducted to assess potential metrics, algorithms, and procedures. This paper presents results from initial tests for the development of RAM technology and highlights some of the unique features of RAM applied toa conventional configuration during a ground-based, static, wind-tunnel test.

Patrick C Murphy↗

Rapid Aero Modeling for Urban Air Mobility Aircraft in Wind-Tunnel Tests

Rapid Aero Modeling (RAM) applied to wind tunnel testing, RAM-T, is an approach to efficiently and automatically obtain aerodynamic models during testing. The approach saves time and resources by responding to the demand for experimental efficiency and model fidelity. Motivation for this demand is more acute when investigating a class of vehicles categorized as Urban Air Mobility (UAM) aircraft where many features from both aircraft and rotorcraft are present. RAM-T provides a feedback loop around the test facility to guide the test toward high-fidelity, statistically rigorous aircraft models. The general RAM approach is applicable to computational or physical experiments. It combines concepts from design of experiment theory and aircraft system identification theory that allow the user the freedom to choose, in advance of the test, a specific level of fidelity in terms of prediction error. RAM only collects data required to meet the user-specified fidelity and fidelity is only limited by the facility and test article capabilities. This paper presents results from tests conducted for development of an automated RAM-T technology. The results highlight some of the unique features of RAM applied to eVTOL configurations.

Aerodynamics↗

Intent Modeling and Conflict Probability Calculation for Operations in Upper Class E Airspace

This work presents a probabilistic operational intent model for vehicles operating in upper Class E airspace. A hybrid method is developed to calculate the intent conflict probability leveraging and extending past works on probabilistic conflict computation. Simulation results verify that the probabilistic intent model can accurately encompass the uncertain positions of each vehicle type, that are a result of wind prediction errors and vehicle performance. A comparison with past methods showed that the proposed hybrid method captures the intent conflict probability with better accuracy, especially for a larger look-ahead horizon, and computational time is reasonable for real-time applications. An example is presented to illustrate the use of the intent conflict probability in strategic planning applications.

Air traffic management↗

Intent Modeling and Conflict Probability Calculation for Operations in Upper Class E Airspace

This work presents a probabilistic operational intent model for vehicles operating in upper Class E airspace. A hybrid method is developed to calculate the intent conflict probability leveraging and extending past works on probabilistic conflict computation. Simulation results verify that the probabilistic intent model can accurately encompass the uncertain positions of each vehicle type, that are a result of wind prediction errors and vehicle performance. A comparison with past methods showed that the proposed hybrid method captures the intent conflict probability with better accuracy, especially for a larger look-ahead horizon, and computational time is reasonable for real-time applications. An example is presented to illustrate the use of the intent conflict probability in strategic planning applications.

Air traffic management, operational intent, confli↗