Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

High-precision radiometric tracking for planetary approach and encounter in the inner solar system

The benefits of improved radiometric tracking data have been studied for planetary approach within the inner Solar System using the Mars Rover Sample Return trajectory as a model. It was found that the benefit of improved data to approach and encounter navigation was highly dependent on the a priori uncertainties assumed for several non-estimated parameters, including those for frame-tie, Earth orientation, troposphere delay, and station locations. With these errors at their current levels, navigational performance was found to be insensitive to enhancements in data accuracy. However, when expected improvements in these errors are modeled, performance with current-accuracy data significantly improves, with substantial further improvements possible with enhancements in data accuracy.

Christensen, C. S.↗

A data-driven multiscale model for reactive wetting simulations

Here, we describe a data-driven, multiscale technique to model reactive wetting of a silver–aluminum alloy on a Kovar™ (Fe-Ni-Co alloy) surface. We employ molecular dynamics simulations to elucidate the dependence of surface tension and wetting angle on the drop’s composition and temperature. A design of computational experiments is used to efficiently generate training data of surface tension and wetting angle from a limited number of molecular dynamics simulations. The simulation results are used to parameterize models of the material’s wetting properties and compute the uncertainty in the models due to limited data. The data-driven models are incorporated into an engineering-scale (continuum) model of a silver–aluminum sessile drop on a Kovar™ substrate. Model predictions of the wetting angle are compared with experiments of pure silver spreading on Kovar™ to quantify the model-form errors introduced by the limited training data versus the simplifications inherent in the molecular dynamics simulations. The paper presents innovations in the determination of “convergence” of noisy MD simulations before they are used to extract the wetting angle and surface tension, and the construction of their models which approximate physio-chemical processes that are left unresolved by the engineering-scale model. Together, these constitute a multiscale approach that integrates molecular-scale information into continuum scale models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗

Satellite Constraints on the Latitudinal Distribution and Temperature Sensitivity of Wetland Methane Emissions

Wetland methane (CH4) emissions comprise about one-third of the global CH4 source. The latitudinal distribution and climate sensitivity of wetland CH4 fluxes are the key determinants of the global CH4-climate feedback. However, large differences exist between bottom-up estimates, informed by ground-based flux measurements, and top-down estimates derived from spaceborne total column CH4. Despite the extensive coverage of satellite CH4 concentration observations, challenges remain with using top-down estimates to test bottom-up models, mainly because of the uncertainties in the satellite retrievals, the model representation errors, the variable prior emissions, and the confounding role of the posterior error covariance structures. Here, we use satellite-based top-down CH4 flux estimates (2010–2012) to test and refine 42 bottom-up estimates of wetland emissions that use a range of hypothesized wetland extents and process controls. Our comparison between bottom-up models and satellite-based fluxes innovatively accounts for cross-correlations and spatial uncertainties typically found in top-down inverse estimates, such that only the information from satellite observations and the atmospheric transport model is kept as a constraint. We present a satellite-constrained wetland CH4 ensemble product derived from assembling the highest-performance bottom-up models, which estimates global wetland CH4 emissions of 148 (117–189, 5th–95th percentile) Tg CH4 yr−1. We find that tropical wetland emissions contribute 72% (63%–85%) to the global wetland total. We also find that a lower-than-expected temperature sensitivity agrees better with atmospheric CH4 measurements. Overall, our approach demonstrates the potential for using satellites to quantitatively refine bottom-up wetland CH4 emission estimates, their latitudinal distributions, and their sensitivity to climate.

wetland ch4↗

Modeling Pluto-Charon mutual eclipse events. I - First-order models

The present 'first order' analytical and numerical models of light curves due to mutual events between close planetary binaries, the effects of shadowing are included. Attention is given to the case of the Pluto-Charon system. The results of the analytical and numerical approaches agree to well within the expected light curve measurement error. The model predicts that the current mutual eclipse event series will end by November 1990.

Dunbar, R. Scott↗

Calibrating hypersonic turbulence flow models with the HIFiRE-1 experiment using data-driven machine-learned models.

In this paper we study the efficacy of combining machine-learning methods with projection-based model reduction techniques for creating data-driven surrogate models of computationally expensive, high-fidelity physics models. Such surrogate models are essential for many-query applications e.g., engineering design optimization and parameter estimation, where it is necessary to invoke the high-fidelity model sequentially, many times. Surrogate models are usually constructed for individual scalar quantities. However there are scenarios where a spatially varying field needs to be modeled as a function of the model’s input parameters. Here we develop a method to do so, using projections to represent spatial variability while a machine-learned model captures the dependence of the model’s response on the inputs. The method is demonstrated on modeling the heat flux and pressure on the surface of the HIFiRE-1 geometry in a Mach 7.16 turbulent flow. The surrogate model is then used to perform Bayesian estimation of freestream conditions and parameters of the SST (Shear Stress Transport) turbulence model embedded in the high-fidelity (Reynolds-Averaged Navier–Stokes) flow simulator, using shock-tunnel data. The paper provides the first-ever Bayesian calibration of a turbulence model for complex hypersonic turbulent flows. We find that the primary issues in estimating the SST model parameters are the limited information content of the heat flux and pressure measurements and the large model-form error encountered in a certain part of the flow.

42 ENGINEERING↗

Revenue prediction for integrated renewable energy and energy storage system using machine learning techniques

Revenue estimation for integrated renewable energy and energy storage systems is important to support plant owners or operators’ decisions in battery sizing selection that leads to maximized financial performances. A common approach to optimizing revenues of a hybrid hydro and energy storage system is using mixed-integer linear programming (MILP). Although MILP models can provide accurate production cost estimations, they are typically very computationally expensive. To provide a fast yet accurate first-step information to hydropower plant owners or operators who consider integrating energy storage systems, we propose an innovative approach to predicting optimal revenues of an integrated energy generation and storage system. In this study, we examined the performance of two prediction techniques: Generalized Additive Models (GAMs) and machine learning (ML) models developed based on artificial neural networks (ANN). Predictive equations and models are generated based on optimized solutions from a market participation optimization model, the Conventional Hydropower Energy and Environmental Resource System (CHEERS) model. The two predicting techniques reduce the computational time to evaluate annual revenue for one set of battery configurations from 3 h to 1 to 4 min per run while also being implementable with significantly less data. The model validation prediction errors of developed GAMs and ML models are generally below 5%; for model testing predictions, the ML models consistently outperform the regression equations in terms of root mean square errors. This new approach allows plant owners, operators, or potential investors to quickly access multiple battery configurations under different energy generation and market scenarios. This new revenue prediction method will therefore help reduce the barriers, and thereby promoting the deployment of battery hybridization with existing renewable energy sources.

13 HYDRO ENERGY↗

A simulation to study the feasibility of improving the temporal resolution of LAGEOS geodynamic solutions by using a sequential process noise filter

A key drawback to estimating geodetic and geodynamic parameters over time based on satellite laser ranging (SLR) observations is the inability to accurately model all the forces acting on the satellite. Errors associated with the observations and the measurement model can detract from the estimates as well. These 'model errors' corrupt the solutions obtained from the satellite orbit determination process. Dynamical models for satellite motion utilize known geophysical parameters to mathematically detail the forces acting on the satellite. However, these parameters, while estimated as constants, vary over time. These temporal variations must be accounted for in some fashion to maintain meaningful solutions. The primary goal of this study is to analyze the feasibility of using a sequential process noise filter for estimating geodynamic parameters over time from the Laser Geodynamics Satellite (LAGEOS) SLR data. This evaluation is achieved by first simulating a sequence of realistic LAGEOS laser ranging observations. These observations are generated using models with known temporal variations in several geodynamic parameters (along track drag and the J(sub 2), J(sub 3), J(sub 4), and J(sub 5) geopotential coefficients). A standard (non-stochastic) filter and a stochastic process noise filter are then utilized to estimate the model parameters from the simulated observations. The standard non-stochastic filter estimates these parameters as constants over consecutive fixed time intervals. Thus, the resulting solutions contain constant estimates of parameters that vary in time which limits the temporal resolution and accuracy of the solution. The stochastic process noise filter estimates these parameters as correlated process noise variables. As a result, the stochastic process noise filter has the potential to estimate the temporal variations more accurately since the constraint of estimating the parameters as constants is eliminated. A comparison of the temporal resolution of solutions obtained from standard sequential filtering methods and process noise sequential filtering methods shows that the accuracy is significantly improved using process noise. The results show that the positional accuracy of the orbit is improved as well. The temporal resolution of the resulting solutions are detailed, and conclusions drawn about the results. Benefits and drawbacks of using process noise filtering in this type of scenario are also identified.

Hartman, Brian Davis↗

Using regime analysis to identify the contribution of clouds to surface temperature errors in weather and climate models

Many global circulation models (GCMs) exhibit a persistent bias in the 2 m temperature over the midlatitude continents, present in short-range forecasts as well as long-term climate simulations. A number of hypotheses have been proposed, revolving around deficiencies in the soil–vegetation–atmosphere energy exchange, poorly resolved low-level boundary-layer clouds or misrepresentations of deep-convective storms. A common approach to evaluating model biases focuses on the model-mean state. However, this makes difficult an unambiguous interpretation of the origins of a bias, given that biases are the result of the superposition of impacts of clouds and land-surface deficiencies over multiple time steps. This article presents a new methodology to objectively detect the role of clouds in the creation of a surface warm bias. A unique feature of this study is its focus on temperature-error growth at the time-step level. It is shown that compositing the temperature-error growth by the coinciding bias in total downwelling radiation provides unambiguous evidence for the role that clouds play in the creation of the surface warm bias during certain portions of the day. Furthermore, the application of an objective cloud-regime classification allows for the detection of the specific cloud regimes that matter most for the creation of the bias. We applied this method to two state-of-the-art GCMs that exhibit a distinct warm bias over the Southern Great Plains of the USA. Our analysis highlights that, in one GCM, biases in deep-convective and low-level clouds contribute most to the temperature-error growth in the afternoon and evening respectively. In the second GCM, deep clouds persist too long in the evening, leading to a growth of the temperature bias. In conclusion, the reduction of the temperature bias in both models in the morning and the growth of the bias in the second GCM in the afternoon could not be assigned to a cloud issue, but are more likely caused by a land-surface deficiency.

54 ENVIRONMENTAL SCIENCES↗

Impact of non-Maxwellian electron velocity distribution functions on inferred plasma parameters in collective Thomson scattering

Optical collective Thomson scattering provides precise density and temperature measurements in numerous plasma-physics experiments. The accuracy of such measurements depends on the core assumption that the underlying electron distribution functions in under-dense laser-produced plasmas are Maxwellian. A statistically based, quantitative analysis of the errors in the measured electron density and temperature is presented when synthetic data calculated using a non-Maxwellian electron distribution function is fit assuming a Maxwellian electron distribution. Such analysis can lead to errors of up to 50% in temperature and 30% in density, in the specific case of super-Gaussian distributions characteristic of inverse bremsstrahlung heating. Furthermore including the proper family of non-Maxwellian electron distribution functions, as a fitting parameter, in Thomson-scattering analysis removes the model-dependent errors in the inferred parameters at a minimal cost to the statistical uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Computer Modeling and Simulation

Verification and validation of computer codes and models used in simulation are two aspects of the scientific practice of high importance and have recently been discussed by philosophers of science. While verification is predominantly associated with the correctness of the way a model is represented by a computer code or algorithm, validation more often refers to model’s relation to the real world and its intended use. It has been argued that because complex simulations are generally not transparent to a practitioner, the Duhem problem can arise for verification and validation due to their entanglement; such an entanglement makes it impossible to distinguish whether a coding error or model’s general inadequacy to its target should be blamed in the case of the model failure. I argue that in order to disentangle verification and validation, a clear distinction between computer modeling (construction of mathematical computer models of elementary processes) and simulation (construction of models of composite objects and processes by means of numerical experimenting with them) needs to be made. Holding on to that distinction, I propose to relate verification (based on theoretical strategies such as inferences) to modeling and validation, which shares the common epistemology with experimentation, to simulation. To explain reasons of their intermittent entanglement I propose a weberian ideal-typical model of modeling and simulation as roles in practice. I suggest an approach to alleviate the Duhem problem for verification and validation generally applicable in practice and based on differences in epistemic strategies and scopes

Pronskikh, V. S.↗

The impact of capillary heterogeneity on CO 2 flow and trapping across scales

Capillary heterogeneity has been identified over the last decade as a key control on subsurface CO 2 flow behavior during geological CO 2 sequestration. These heterogeneities can be formed in all sedimentary rocks, ranging from slight variations in the sand grain sizes to extensive sequences of interbedded sands, shales, and limestones. Capillary heterogeneity has been largely, although not entirely, overlooked in subsurface flow modeling because it is assumed to only directly influence fluid redistribution over scales of centimeters to meters. However, even small-scale fluid movements can result in dramatic impacts on the mobility and trapping of the CO 2 over kilometers. Therefore, neglecting capillary heterogeneity at multiple scales could potentially lead to errors in modeling and predicting field-scale plume migration. In this review paper, we aim to provide a consistent overview to (1) establish that capillary heterogeneity can have a major impact on CO 2 plume migration, (2) establish the respective length scales at which capillary heterogeneity matters, and (3) provide guidance for numerical modeling. This review covers pertinent literature and extracts key observations from the core to the field scales. Experimental studies have shown that millimeter-decimeter scale capillary heterogeneity can cause the so-called capillary heterogeneity trapping in addition to pore-scale residual trapping. Even at such a small scale, capillary heterogeneity can already lead to complex upscaled constitutive relationships, such as flow-rate dependent and anisotropic relative permeability, which affects field-scale CO 2 migration even when field-scale heterogeneities are present. Under gravity-dominated flow regimes, centimeter-meter scale capillary heterogeneity can entrap a significant amount of CO 2 at field scale, not just after imbibition but also during drainage. In certain cases, the presence of capillary heterogeneity can even completely stop the vertical movement of the CO 2 plume, hence greatly reducing leakage risks. At meter-kilometer scale, the influence of capillary heterogeneity is more pronounced and can hinder or redirect CO 2 migration in both lateral and vertical directions. The impact of capillary heterogeneity across multiple spatial scales poses a great challenge in modeling CO 2 migration at field scale, because it is practically impossible to build a field-scale earth model with grid blocks at millimeter scale. We recommend a hierarchical modeling approach to address this challenge. At field scale, earth models are built to capture geological features and heterogeneities in high but still practical grid resolutions. For each facies or rock type of the field-scale model, high- resolution meter-scale “conceptual” models are built with millimeter-scale grid blocks to capture representative fine-scale bedding geometries and heterogeneities in various environments of deposition, bridging the gap from subcore scale to the size of a field-scale simulation grid block. Upscaling is then used to preserve the smaller-scale flow dynamics of various rock types in field-scale simulations. Here, future work is needed to (1) refine, improve, and validate the hierarchical modeling approach; (2) build libraries of fine-scale bedding models for facies in various environments of deposition; (3) quantify multiscale capillary heterogeneity effects under subsurface uncertainties; (4) gain learning from different storage formations; and (5) establish best practices that balance accuracy and computational speed.

Capillary heterogeneity↗

Investigation of Cody–Lorentz and Tauc–Lorentz Models in Characterizing Dielectric Function of (HfO{sub 2}){sub x}(ZrO{sub 2}){sub 1–x} Mixed Thin Film

In the present study, Tauc–Lorentz and Urbach tail assisted Cody–Lorentz models were intuitively derived, explained, and employed to simulate the imaginary dielectric function of the atomic layer deposited (HfO{sub 2}){sub x}(ZrO{sub 2}){sub 1–x} in the energy range of 0.7–9.3 eV. A fitting procedure is carried out using the Levenberg–Marquardt method for minimizing mean square errors. Both models support the experimental data derived by vacuum ultraviolet spectroscopic ellipsometry. For a zirconium content of 60 and 75%, a weak absorption profile is observed in the visible region and elaborately explained by the Lorentz oscillator model. In order to calculate the band gap of different compositions, Cody plots and Tauc plots are presented. The results show that the Cody–Lorentz model is more accuracy due to its exponential absorption below the band gap energy and modified density of states.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An improved error assessment for the GEM-T1 gravitational model

Several tests were designed to determine the correct error variances for the GEM-T1 gravitational solution which was derived exclusively from satellite tracking data. The basic method employs both wholly independent and dependent subset data solutions and produces a full field coefficient by coefficient estimate of the model uncertainties. The GEM-T1 errors were further analyzed using a method based upon eigenvalue-eigenvector analysis which calibrates the entire covariance matrix. Dependent satellite and independent altimetric and surface gravity data sets, as well as independent satellite deep resonance information, confirm essentially the same error assessment.

Lerch, F. J.↗

A new class of energy based control laws for revolute robot arms - Tracking control, robustness enhancement and adaptive control

A class of joint-level control laws for all-revolute robot arms is introduced. The analysis is similar to the recently proposed energy Liapunov function approach except that the closed-loop potential function is shaped in accordance with the underlying joint space topology. By using energy Liapunov functions with the modified potential energy, a much simpler analysis can be used to show closed-loop global asymptotic stability and local exponential stability. When Coulomb and viscous friction and model parameter errors are present, a sliding-mode-like modification of the control law is proposed to add a robustness-enhancing outer loop. Adaptive control is also addressed within the same framework. A linear-in-the-parameters formulation is adopted, and globally asymptotically stable adaptive control laws are derived by replacing the model parameters in the nonadaptive control laws by their estimates.

Wen, John T.↗

Multimodel Ensembles of Wheat Growth: Many Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop model scan give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 2438 for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

model intercomparison↗

Planting data and wheat yield models

The author has identified the following significant results. A variable date starter model for spring wheat depending on temperature was more precise than a fixed date model. The same conclusions for fall-planted wheat were not reached. If the largest and smallest of eight temperatures were used to estimate daily maximum and minimum temperatures; respectively, a 1-4 F bias would be introduced into these extremes. For Kansas, a reduction of 0.5 bushels/acre in the root-mean-square-error between model and SRS yields was achieved by a six fold increase (7 to 42) in the density of weather stations. An additional reduction of 0.3 b/A was achieved by incorporating losses due to rusts in the model.

Feyerherm, A. M.↗

Multimodel Ensembles of Wheat Growth: More Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

wheat↗