Search NASA⌕ Search

SEARCH · Search NASA

Results for “model accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Evaluating model accuracy for model-based reasoning

Described here is an approach to automatically assessing the accuracy of various components of a model. In this approach, actual data from the operation of a target system is used to drive statistical measures to evaluate the prediction accuracy of various portions of the model. We describe how these statistical measures of model accuracy can be used in model-based reasoning for monitoring and design. We then describe the application of these techniques to the monitoring and design of the water recovery system of the Environmental Control and Life Support System (ECLSS) of Space Station Freedom.

Chien, Steve↗

Analytical model accuracy requirements for structural dynamic systems

A test/analysis correlation criterion for the analytical model accuracy requirement has been developed. It is based on the principle of equal errors from the model inaccuracy and the uncertainties of dynamic environments. The forcing functions are idealized to establish the base for uncertainty definition and the maximum allowable errors from these uncertainties are obtained. Then the model accuracy requirement is established by comparing the responses due to the model errors to those due to the forcing function uncertainties.

Chen, J.-C.↗

An analytically linearized helicopter model with improved modeling accuracy

An analytically linearized model for helicopter flight response including rotor blade dynamics and dynamic inflow, that was recently developed, was studied with the objective of increasing the understanding, the ease of use, and the accuracy of the model. The mathematical model is described along with a description of the UH-60A Black Hawk helicopter and flight test used to validate the model. To aid in utilization of the model for sensitivity analysis, a new, faster, and more efficient implementation of the model was developed. It is shown that several errors in the mathematical modeling of the system caused a reduction in accuracy. These errors in rotor force resolution, trim force and moment calculation, and rotor inertia terms were corrected along with improvements to the programming style and documentation. Use of a trim input file to drive the model is examined. Trim file errors in blade twist, control input phase angle, coning and lag angles, main and tail rotor pitch, and uniform induced velocity, were corrected. Finally, through direct comparison of the original and corrected model responses to flight test data, the effect of the corrections on overall model output is shown.

Jensen, Patrick T.↗

Influence of Molecular Simulation Model Accuracy on the Interfacial Properties of an Ionic Liquid: Overview of Recommended Practices

Increasing the energy storage capability of ionic liquid supercapacitors will require better understanding of ion-electrode interactions. We have probed the influence of these interactions on the structure and differential capacitance of of an ionic liquid ([EMIM][BF4]) at an ideal graphite interface as a function of model accuracy. Of note, differential capacitance is determined through newly derived and validated fluctuation formulas. In terms of model accuracy, we test electrostatic techniques, electrode charging techniques, and electrolyte interatomic potentials. For electrostatic summations, we employ high cost, high fidelity techniques as well as less expensive, approximate techniques for summation in slab geometry. For electrode charging, uniform, constant-charge and environmentally responsive, constant-potential conditions are employed. For the ionic liquid, constant charge and atomically polarizable models are employed. We comment on the role of model accuracy on the structure and energetics of the electric double layer as well as on the magnitude and shape of differential capacitance.

simulations↗

Dynamic Modeling Accuracy Dependence on Errors in Sensor Measurements, Mass Properties, and Aircraft Geometry

A nonlinear simulation of the NASA Generic Transport Model was used to investigate the effects of errors in sensor measurements, mass properties, and aircraft geometry on the accuracy of dynamic models identified from flight data. Measurements from a typical system identification maneuver were systematically and progressively deteriorated and then used to estimate stability and control derivatives within a Monte Carlo analysis. Based on the results, recommendations were provided for maximum allowable errors in sensor measurements, mass properties, and aircraft geometry to achieve desired levels of dynamic modeling accuracy. Results using other flight conditions, parameter estimation methods, and a full-scale F-16 nonlinear aircraft simulation were compared with these recommendations.

Grauer, Jared A.↗

Dependence of Dynamic Modeling Accuracy on Sensor Measurements, Mass Properties, and Aircraft Geometry

The NASA Generic Transport Model (GTM) nonlinear simulation was used to investigate the effects of errors in sensor measurements, mass properties, and aircraft geometry on the accuracy of identified parameters in mathematical models describing the flight dynamics and determined from flight data. Measurements from a typical flight condition and system identification maneuver were systematically and progressively deteriorated by introducing noise, resolution errors, and bias errors. The data were then used to estimate nondimensional stability and control derivatives within a Monte Carlo simulation. Based on these results, recommendations are provided for maximum allowable errors in sensor measurements, mass properties, and aircraft geometry to achieve desired levels of dynamic modeling accuracy. Results using additional flight conditions and parameter estimation methods, as well as a nonlinear flight simulation of the General Dynamics F-16 aircraft, were compared with these recommendations

Grauer, Jared A.↗

Satellite laser ranging and gravity field modeling accuracy

Gravitational field mismodeling procedures errors in the estimated orbital motion of near Earth satellites. This effect is studied using a linear perturbation approach following the analysis of Kaula. The perturbations in the orbital position as defined by either orbital elements or Cartesian components are determined. From these perturbations it is possible to ascertain the expected signal due to gravitational mismodeling that would be present in station-to-satellite laser ranging measurements. This expected signal has been estimated for the case of the Lageos satellite and using the predicted uncertainties of the GEM-T1 and GEM-T2 gravity field models. The results indicate that observable signal still exists in the laser range residuals given the current accuracy of the range measurements and the accuracy of the gravity field models.

Rosborough, George W.↗

Translation of Land Surface Model Accuracy and Uncertainty into Coupled Land-Atmosphere Prediction

Land-atmosphere (L-A) Interactions playa critical role in determining the diurnal evolution of both planetary boundary layer (PBL) and land surface heat and moisture budgets, as well as controlling feedbacks with clouds and precipitation that lead to the persistence of dry and wet regimes. Recent efforts to quantify the strength of L-A coupling in prediction models have produced diagnostics that integrate across both the land and PBL components of the system. In this study, we examine the impact of improved specification of land surface states, anomalies, and fluxes on coupled WRF forecasts during the summers of extreme dry (2006) and wet (2007) land surface conditions in the U.S. Southern Great Plains. The improved land initialization and surface flux parameterizations are obtained through the use of a new optimization and uncertainty estimation module in NASA's Land Information System (US-OPT/UE), whereby parameter sets are calibrated in the Noah land surface model and classified according to a land cover and soil type mapping of the observation sites to the full model domain. The impact of calibrated parameters on the a) spinup of the land surface used as initial conditions, and b) heat and moisture states and fluxes of the coupled WRF Simulations are then assessed in terms of ambient weather and land-atmosphere coupling along with measures of uncertainty propagation into the forecasts. In addition, the sensitivity of this approach to the period of calibration (dry, wet, average) is investigated. Finally, tradeoffs of computational tractability and scientific validity, and the potential for combining this approach with satellite remote sensing data are also discussed.

Santanello, Joseph A.↗

Comparative Accuracies of Models for Drag Prediction During Geomagnetically Disturbed Periods: A First Principles Model Versus Empirical Models

We examine the accuracy of density prediction by the first principles model Thermosphere Ionosphere Electrodynamics General Circulation Model (TIEGCM) developed by the National Center for Atmospheric Research and compare it to the accuracy of three empirical models: Jacchia 71, the Naval Research Laboratory Mass Spectrometer Incoherent Scatter Extended 2000 (NRLMSIS), Jacchia 1971, and Jacchia-Bowman 2008. Comparisons are made for three large storms: the October 2003 storm, the March 2013 storm, and the March 2015 storm. To evaluate the accuracy of these models we use tracking data for nine space objects in low Earth orbit. Additionally, we evaluate the accuracy of the TIEGCM and NRLMSIS with data from high precision accelerometers on the Challenging Minisatellite Payload (CHAMP) and Gravity field and Circulation Explorer (GOCE) satellites. The goal is to assess the use of a first principles model as a potential tool for forecasting satellite drag during large magnetic storms. For the storms considered, we found the TIEGCM, JB2008, and NRLMSIS models to be substantially more accurate than the Jacchia 71 model. The accuracies of the TIEGCM and JB2008 models were similar, but overall, the TIEGCM was more accurate. We found smaller differences for TIEGCM versus CHAMP than for NRLMIS for the Halloween Storm, and smaller differences than results published for JB2008 and the assimilative model HASDM. The empirical models are at present more practical for operational purposes, but the TIEGCM, developed as a research model, with a greater focus on operational use offers the potential for improved utility during stressing conditions.

R. L. Walterscheid↗

Method of discrete modeling and its application to estimation of TF30 engine variables

A method of discrete modeling is presented that effectively isolates steady state model accuracy from dynamic model accuracy. The steady state model may be generated from the engine design equations with any desired degree of accuracy. The dynamic model is generated by applying a step disturbance of a manipulated variable to an open loop engine simulation. The sampled response of the variable is combined with the steady state model's response to form a set of weighting factors. These weighting factors are then used to weight past values of the manipulated variable, thus forming the dynamic model. The method is used to estimate various TF30-P-3 engine variables. A dynamic trim function is developed to compensate for the dynamic nonlinearities of the variables as well as for inaccuracies in dynamic definition. The trim function is shown to be realted to the square root of the sum of the squares of the weighting factors obtained at various engine operating conditions. Finally, the estimation of variables without dynamic modeling is discussed.

Arpasi, D. J.↗

The accuracy of geopotential models

The accuracy of two recent geopotential models, GEM 7 and GEM 8, is evaluated and is found to be about 4.3 m with respect to the global geoid surface for GEM 7 and 3.9 m for GEM 8. The accuracies are root mean square values obtained by the use of 400 coefficients for GEM 7 and 706 coefficients for GEM 8. Independent observations used in the evaluation include 159 lumped coefficients from 35 resonant orbits, two sets of fields derived from optical-only and laser-only data, sets of zonal and resonant coefficients, and geoid undulations. The ratio of estimated commission to formal error in GEM 7 and GEM 8 ranges from 2 to 5. Several other recent geopotential models are examined.

Wagner, C. A.↗

Subpixel registration accuracy and modelling

An outline of methods for subpixel registration accuracy and modelling is presented. Consideration of the following questions is emphasized: how accurately can a LANDSAT image be registered to a reference image, how can subpixel accuracy be achieved, what factors affect registration accuracy, how should reference images be formed, and how can various algorithms be evaluated.

Kanal, L. N.↗

Thermal modelling of an AMTEC recirculating cell

A modeling program was developed to determine the impact of various design parameters on the operation of an AMTEC system. Temperature profiles generated by the modeling program were compared to actual experimental data to verify the model accuracy. The model was then extended to predict the impact of device design on operational performance. The effect of heat loss from the liquid sodium supply end was studied for this paper.

Suitor, J. W.↗

Flight assessment of the onboard propulsion system model for the Performance Seeking Control algorithm on an F-15 aircraft

Performance Seeking Control (PSC), an onboard, adaptive, real-time optimization algorithm, relies upon an onboard propulsion system model. Flight results illustrated propulsion system performance improvements as calculated by the model. These improvements were subject to uncertainty arising from modeling error. Thus to quantify uncertainty in the PSC performance improvements, modeling accuracy must be assessed. A flight test approach to verify PSC-predicted increases in thrust (FNP) and absolute levels of fan stall margin is developed and applied to flight test data. Application of the excess thrust technique shows that increases of FNP agree to within 3 percent of full-scale measurements for most conditions. Accuracy to these levels is significant because uncertainty bands may now be applied to the performance improvements provided by PSC. Assessment of PSC fan stall margin modeling accuracy was completed with analysis of in-flight stall tests. Results indicate that the model overestimates the stall margin by between 5 to 10 percent. Because PSC achieves performance gains by using available stall margin, this overestimation may represent performance improvements to be recovered with increased modeling accuracy. Assessment of thrust and stall margin modeling accuracy provides a critical piece for a comprehensive understanding of PSC's capabilities and limitations.

Orme, John S.↗

Improving Computational Efficiency of Prognostics Algorithms in Resource-Constrained Settings

The field of prognostics and health management provides quantitative methods for monitoring and predicting the health of physical systems. Prognostics algorithms are useful in that they can be employed to assess the current state of a system, propagate the system state throughout time, and predict potential anomalies or failures that may occur. However, effective prognosis can be challenging to achieve in resource-constrained settings due to computational limitations and high computational latency, leading to obsolete predictions. Thus, computationally efficient and accurate algorithms are necessary for some prognostics applications. In this work, we implement three new algorithmic approaches to prediction (sampling methods, variable prediction time step, variable prediction sample size) with the goal of improving computational efficiency while minimizing decrease in model accuracy. To quantitatively analyze our results, we examine a use-case of degradation of a Lithium-ion battery. Notably, through this work it was found that none of the sampling approaches had a significant impact on computational efficiency or model accuracy in predicting EOD of the battery. However, our results show that prediction accuracy is highly dependent on the time step used, and that an appropriate time step can optimize both model accuracy and simulation efficiency. Finally, implementing a variable sample size also affected prediction, and our results show that tuning both the magnitude and timing of the sample size adjustment in an application-specific manner may prove useful in some applications. Taken together, our findings highlight the challenge of performing prognostics in resource-constrained settings, and illustrate the potential of developing new prediction algorithms to improve computational efficiency of prognosis.

Prognostics↗