Search NASA⌕ Search

SEARCH · Search NASA

Results for “error models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Comparison of MERRA-2 and ECCO-V4 Ocean Surface Heat Fluxes: Consequences of Different Forcing Feedbacks on Ocean Circulation and Implications for Climate Data Assimilation

Forcing ocean models with reanalysis data is a common practice in ocean modeling. As part of this practice, prescribed atmospheric state variables and interactive ocean SST (Sea Surface Temperature) are used to calculate fluxes between the ocean and the atmosphere. When forcing an ocean model with reanalysis fields, errors in the reanalysis data, errors in the ocean model and errors in the forcing formulation will generate a different solution compared to other ocean reanalysis solutions (which also have their own errors). As a first step towards a consistent coupled ocean-atmosphere reanalysis, we compare surface heat fluxes from a state-of-the-art atmospheric reanalysis, the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), to heat fluxes from a state-of-the-art oceanic reanalysis, the Estimating the Circulation and Climate of the Ocean Version 4, Release 2 (ECCO-v4). Then, we investigate the errors associated with the MITgcm (Massachusetts Institute of Technology general circulation model) ocean model in its ECCO-v4 ocean reanalysis configuration (1992-2011) when it is forced with MERRA- 2 atmospheric reanalysis fields instead of with the ECCO-v4 adjoint optimized ERA-interim state variables. This is done by forcing ECCO-v4 ocean with and without feedbacks from MERRA-2 related to turbulent fluxes of heat and moisture and the outgoing long wave radiation. In addition, we introduce an intermediate forcing method that includes only the feedback from the interactive outgoing long wave radiation. The resulting ocean circulation is compared with ECCO-v4 reanalysis and in-situ observations. We show that, without feedbacks, imbalances in the energy and the hydrological cycles of MERRA-2 (which are directly related to the fact it was created without interactive ocean) result in considerable SST drifts and a large reduction in sea level. The bulk formulae and interactive outgoing long wave radiation, although providing air-sea feedbacks and reducing model-data misfit, strongly relax the ocean to observed SST and may result in unwanted features such as large change in the water budget. These features have implications in a desired forcing recipe to be used. The results strongly and unambiguously argue for next generation data assimilation climate studies to involve fully coupled systems.

MERRA-2↗

Modelling high data rate communication network access protocol

Modeling of high data rate communication systems is different from the low data rate systems. Three simulations were built during the development phase of Carrier Sensed Multiple Access/Ring Network (CSMA/RN) modeling. The first was a model using SIMCRIPT based upon the determination and processing of each event at each node. The second simulation was developed in C based upon isolating the distinct object that can be identified as the ring, the message, the node, and the set of critical events. The third model further identified the basic network functionality by creating a single object, the node which includes the set of critical events which occur at the node. The ring structure is implicit in the node structure. This model was also built in C. Each model is discussed and their features compared. It should be stated that the language used was mainly selected by the model developer because of his past familiarity. Further the models were not built with the intent to compare either structure or language but because the complexity of the problem and initial results contained obvious errors, so alternative models were built to isolate, determine, and correct programming and modeling errors. The CSMA/RN protocol is discussed in sufficient detail to understand modeling complexities. Each model is described along with its features and problems. The models are compared and concluding observations and remarks are presented.

Khanna, S.↗

The Crucial Role of Error Correlation for Uncertainty Modeling of CFD-Based Aerodynamics Increments

The Ares I ascent aerodynamics database for Design Cycle 3 (DAC-3) was built from wind-tunnel test results and CFD solutions. The wind tunnel results were used to build the baseline response surfaces for wind-tunnel Reynolds numbers at power-off conditions. The CFD solutions were used to build increments to account for Reynolds number effects. We calculate the validation errors for the primary CFD code results at wind tunnel Reynolds number power-off conditions and would like to be able to use those errors to predict the validation errors for the CFD increments. However, the validation errors are large compared to the increments. We suggest a way forward that is consistent with common practice in wind tunnel testing which is to assume that systematic errors in the measurement process and/or the environment will subtract out when increments are calculated, thus making increments more reliable with smaller uncertainty than absolute values of the aerodynamic coefficients. A similar practice has arisen for the use of CFD to generate aerodynamic database increments. The basis of this practice is the assumption of strong correlation of the systematic errors inherent in each of the results used to generate an increment. The assumption of strong correlation is the inferential link between the observed validation uncertainties at wind-tunnel Reynolds numbers and the uncertainties to be predicted for flight. In this paper, we suggest a way to estimate the correlation coefficient and demonstrate the approach using code-to-code differences that were obtained for quality control purposes during the Ares I CFD campaign. Finally, since we can expect the increments to be relatively small compared to the baseline response surface and to be typically of the order of the baseline uncertainty, we find that it is necessary to be able to show that the correlation coefficients are close to unity to avoid overinflating the overall database uncertainty with the addition of the increments.

Hemsch, Michael J.↗

Decomposition of the Mean Squared Error and NSE Performance Criteria: Implications for Improving Hydrological Modelling

The mean squared error (MSE) and the related normalization, the Nash-Sutcliffe efficiency (NSE), are the two criteria most widely used for calibration and evaluation of hydrological models with observed data. Here, we present a diagnostically interesting decomposition of NSE (and hence MSE), which facilitates analysis of the relative importance of its different components in the context of hydrological modelling, and show how model calibration problems can arise due to interactions among these components. The analysis is illustrated by calibrating a simple conceptual precipitation-runoff model to daily data for a number of Austrian basins having a broad range of hydro-meteorological characteristics. Evaluation of the results clearly demonstrates the problems that can be associated with any calibration based on the NSE (or MSE) criterion. While we propose and test an alternative criterion that can help to reduce model calibration problems, the primary purpose of this study is not to present an improved measure of model performance. Instead, we seek to show that there are systematic problems inherent with any optimization based on formulations related to the MSE. The analysis and results have implications to the manner in which we calibrate and evaluate environmental models; we discuss these and suggest possible ways forward that may move us towards an improved and diagnostically meaningful approach to model performance evaluation and identification.

Gupta, Hoshin V.↗

Methodology for Estimating Solar Potential on Multiple Building Rooftops for Photovoltaic Systems

In this paper, a methodology for estimating solar potential on multiple building rooftops is presented. The objective of this methodology is to estimate the daily or monthly solar radiation potential on individual buildings in a city/region using Light Detection and Ranging (LiDAR) data and a geographic information system (GIS) approach. Conceptually, the methodology is based on the upward-looking hemispherical viewshed algorithm, but applied using an area-based modeling approach. The methodology considers input parameters, such as surface orientation, shadowing effect, elevation, and atmospheric conditions, that influence solar intensity on the earth s surface. The methodology has been implemented for some 212,000 buildings in Knox County, Tennessee, USA. Based on the results obtained, the methodology seems to be adequate for estimating solar radiation on multiple building rooftops. The use of LiDAR data improves the radiation potential estimates in terms of the model predictive error and the spatial pattern of the model outputs. This methodology could help cities/regions interested in sustainable projects to quickly identify buildings with higher potentials for roof-mounted photovoltaic systems.

14 SOLAR ENERGY↗

Detection of digital FSK using a phase-locked loop

A theory is presented for the design of a digital FSK receiver which employs a phase-locked loop to set up the desired matched filter as the arriving signal frequency switches. The developed mathematical model makes it possible to establish the error probability performance of systems which employ a class of digital FM modulations. The noise mechanism which accounts for decision errors is modeled on the basis of the Meyr distribution and renewal Markov process theory.

Lindsey, W. C.↗

Explicit least squares system parameter identification for exact differential input/output models

The equation error for a class of systems modeled by input/output differential operator equations has the potential to be integrated exactly, given the input/output data on a finite time interval, thereby opening up the possibility of using an explicit least squares estimation technique for system parameter identification. The paper delineates the class of models for which this is possible and shows how the explicit least squares cost function can be obtained in a way that obviates dealing with unknown initial and boundary conditions. The approach is illustrated by two examples: a second order chemical kinetics model and a third order system of Lorenz equations.

Pearson, A. E.↗

Conflict Probability Estimation for Free Flight

The safety and efficiency of free flight will benefit from automated conflict prediction and resolution advisories. Conflict prediction is based on trajectory prediction and is less certain the farther in advance the prediction, however. An estimate is therefore needed of the probability that a conflict will occur, given a pair of predicted trajectories and their levels of uncertainty. A method is developed in this paper to estimate that conflict probability. The trajectory prediction errors are modeled as normally distributed, and the two error covariances for an aircraft pair are combined into a single equivalent covariance of the relative position. A coordinate transformation is then used to derive an analytical solution. Numerical examples and Monte Carlo validation are presented.

Paielli, Russell A.↗

Boosting with Averaged Weight Vectors

AdaBoost is a well-known ensemble learning algorithm that constructs its constituent or base models in sequence. A key step in AdaBoost is constructing a distribution over the training examples to create each base model. This distribution, represented as a vector, is constructed to be orthogonal to the vector of mistakes made by the previous base model in the sequence. The idea is to make the next base model's errors uncorrelated with those of the previous model. Some researchers have pointed out the intuition that it is probably better to construct a distribution that is orthogonal to the mistake vectors of all the previous base models, but that this is not always possible. We present an algorithm that attempts to come as close as possible to this goal in an efficient manner. We present experimental results demonstrating significant improvement over AdaBoost and the Totally Corrective boosting algorithm, which also attempts to satisfy this goal.

Oza, Nikunj C.↗

Methodology for Validation of Unsteady Pressure-Sensitive Paint Measurements using Pressure Transducers

Unsteady Pressure-Sensitive Paint (uPSP) technology provides simultaneously high-frequency and high-spatial resolution surface pressure fluctuation measurements. It has demonstrated value in wind tunnel test facilities to evaluate aerospace vehicle unsteady aerodynamics. The calibration of measurements from digital pixel counts into corresponding physical units relies on both lab-based and in-situ calibration steps, and its validation is both challenging and critical to adoption of the technology. We present a rigorous methodology for direct comparison of uPSP-derived surface pressure measurements to reference pressure transducer data based on a model of the camera-based measurement error, a model of the flow field pressure signal, and their propagation through the uPSP data reduction algorithm. The methodology is demonstrated on data collected in a small-scale, subsonic wind tunnel test as well as data collected from a Space Launch System unsteady aerodynamics characterization test at the NASA Ames Research Center Unitary Plan Wind Tunnel Complex.

Pressure-Sensitive Paint↗

Validating uPSP with Transducers

Unsteady Pressure-Sensitive Paint (uPSP) technology provides simultaneously high-frequency and high-spatial resolution surface pressure fluctuation measurements. It has demonstrated value in wind tunnel test facilities to evaluate aerospace vehicle unsteady aerodynamics. The calibration of measurements from digital pixel counts into corresponding physical units relies on both lab-based and in-situ calibration steps, and its validation is both challenging and critical to adoption of the technology. We present a rigorous methodology for direct comparison of uPSP-derived surface pressure measurements to reference pressure transducer data based on a model of the camera-based measurement error, a model of the flow field pressure signal, and their propagation through the uPSP data reduction algorithm. The methodology is demonstrated on data collected in a small-scale, subsonic wind tunnel test as well as data collected from a Space Launch System unsteady aerodynamics characterization test at the NASA Ames Research Center Unitary Plan Wind Tunnel Complex.

Pressure-Sensitive Paint↗

Comparison of plug flow and multi-node stratified tank modeling approaches regarding computational efficiency and accuracy

Residential water heaters contain water stratified by temperature-driven density differences. This implies that a water tank can reach a state in which the top and bottom sections have different temperatures, unless mixing happens. A high degree of thermal stratification can improve the efficiency of some water heaters, by saving the amount of energy required for the heat-up process. Studies of stratification became popular in the 1970s and it remains an active research topic today. The research has led to the development of different models and techniques to better predict and define a stratified tanks behavior. By comparing these models and techniques used previously to describe thermal stratification, the phenomenon could be better understood, exploited, and used to increase efficiency and thermal energy capacity in modern water tanks. From the existing models, we found the one-dimensional standard plug-flow and a multi node model to be appropriate for analyzing the processes of the heat up and cool-down in a water tank. These two models are based on energy balances. This work involved comparing the accuracy and computational effort needed to implement these models. To assess accuracy, we compared both types of existing models to experimental data (also collected in this work) which included a heat up process using an external heat pump. This external process included a layering process that has an eddy diffusivity at five times the rate of thermal diffusion. For this project, we implemented the models in MATLAB, the multi-paradigm numerical computing environment. We quantified model accuracy using the root mean squared error between modeled data and experimental data for six measured tank temperatures. Comparing the accuracy and the computational time taken to run the simulation provides a method to contrast the performance of each model and a way to rate it. The multi node model was run using from 6 to 96 spatial nodes; the plug flow model was run using 1 to 0.001 º C temperature bin sizes. Additionally, timesteps were varied from 4 to 236 s. The results quantify the tradeoff between accuracy and computational time, providing guidance for simulations to intelligently select the best model type and simulation parameters. This research can be used to validate the pre-existing models and possibly improve the modern water tank.

Bulnes, Fernando Karg↗

Characterizing the elements of Earth's radiative budget: Applying uncertainty quantification to the CESM

Understanding and characterizing sources of uncertainty in climate modeling is an important task. Because of the ever increasing sophistication and resolution of climate modeling it is increasing important to develop uncertainty quantification methods that minimize the computational cost that occurs when these methods are added to climate modeling. This research explores the application of sparse stochastic collocation with polynomial edge detection to characterize portions of the probability space associated with the Earth's radiative budget in the Community Earth System Model (CESM). Specifically, we develop surrogate models with error estimates for a range of acceptable input parameters that predict statistical values of the Earth's radiative budget as derived from the CESM simulation.

42 ENGINEERING↗

Integration of system identification and robust controller designs for flexible structures in space

A novel approach is developed using experimental data from the structural testing of a physical system to identify a reduced-order model and its error for a robust controller design. There are three steps involved in the approach. First, an approximately balanced model is identified using the eigensystem realization algorithm, which is an identification algorithm. Second, the model error is calculated and described in frequency domain in terms of the H(infinity) norm. Third, a pole-placement technique in combination with an H(infinity) control method is applied to design a controller for the system. A set of experimental data from an existing setup, namely the Mini-Mast system, is used to illustrate and verify the approach development in this paper.

Juang, Jer-Nan↗

Comparison of interlaminar damage modeling strategies for hybrid composite/aluminum laminates subjected to low-velocity impact

Low-velocity impact of hybrid metal-composite structures was investigated experimentally and computationally. Composite laminates consisting of 2D woven glass fiber reinforced polymer (GFRP) and carbon fiber reinforced polymer (CFRP) were joined with a 6061-T6 aluminum plate using an epoxy adhesive. Two variations of the structure were studied; one consisting of all plies oriented at 0° and one consisting of all plies oriented at 45°. A drop tower was used to impact structures at a range of energies, including energies above and below the threshold at which the aluminum layer was perforated. Numerical simulations were implemented using Sierra/SM, an in-house transient dynamics finite element code developed at Sandia National Laboratories. A Hosford plasticity model was used to describe the response of the aluminum layer. A newly implemented orthotropic continuum damage mechanics (CDM) constitutive model was used to represent the composite laminate. This 3D-CDM model was compared to a cohesive zone model (2D-CDM/CZM) to investigate efficacy of aluminum perforation energy prediction, delamination prediction, and computational cost. Accuracy of each model was evaluated using the experimental results. Each showed good agreement with the tests for both the force and velocity histories, as well as the observed damage mechanisms. The 2D-CDM/CZM model was marginally more accurate in capturing both the composite and aluminum behavior — this model averaged error percentages of -11.2% and 10.8% for residual velocity and peak force, respectively. Meanwhile, the 3D-CDM model predictions yielded average error percentages of -35.5% (velocity) and 22.6% (force). However, the 3D-CDM model generally resulted in a decreased computational cost; the average run time was 14% shorter than the 2D-CDM/CZM model and 3x as many timesteps per hour were computed using the same computational resources. In conclusion, new experimental data on the impact and perforation resistance of metal-composite laminates is presented in addition to numerical predictions of the impact behavior.

Carbon fiber↗

Probabilistic failure assessment with application to solid rocket motors

A quantitative methodology is being developed for assessment of risk of failure of solid rocket motors. This probabilistic methodology employs best available engineering models and available information in a stochastic framework. The framework accounts for incomplete knowledge of governing parameters, intrinsic variability, and failure model specification error. Earlier case studies have been conducted on several failure modes of the Space Shuttle Main Engine. Work in progress on application of this probabilistic approach to large solid rocket boosters such as the Advanced Solid Rocket Motor for the Space Shuttle is described. Failure due to debonding has been selected as the first case study for large solid rocket motors (SRMs) since it accounts for a significant number of historical SRM failures. Impact of incomplete knowledge of governing parameters and failure model specification errors is expected to be important.

Jan, Darrell L.↗

Parameter estimation for terrain modeling from gradient data

A method is developed for modeling terrain surfaces for use on an unmanned Martian roving vehicle. The modeling procedure employs a two-step process which uses gradient as well as height data in order to improve the accuracy of the model's gradient. Least square approximation is used in order to stochastically determine the parameters which describe the modeled surface. A complete error analysis of the modeling procedure is included which determines the effect of instrumental measurement errors on the model's accuracy. Computer simulation is used as a means of testing the entire modeling process which includes the acquisition of data points, the two-step modeling process and the error analysis. Finally, to illustrate the procedure, a numerical example is included.

Dangelo, K. R.↗