Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Bayesian analysis of inflation: Parameter estimation for single field models

Future astrophysical data sets promise to strengthen constraints on models of inflation, and extracting these constraints requires methods and tools commensurate with the quality of the data. In this paper we describe ModeCode, a new, publicly available code that computes the primordial scalar and tensor power spectra for single-field inflationary models. ModeCode solves the inflationary mode equations numerically, avoiding the slow roll approximation. It is interfaced with CAMB and CosmoMC to compute cosmic microwave background angular power spectra and perform likelihood analysis and parameter estimation. ModeCode is easily extendable to additional models of inflation, and future updates will include Bayesian model comparison. Errors from ModeCode contribute negligibly to the error budget for analyses of data from Planck or other next generation experiments. We constrain representative single-field models ({phi}{sup n} with n=2/3, 1, 2, and 4, natural inflation, and 'hilltop' inflation) using current data, and provide forecasts for Planck. From current data, we obtain weak but nontrivial limits on the post-inflationary physics, which is a significant source of uncertainty in the predictions of inflationary models, while we find that Planck will dramatically improve these constraints. In particular, Planck will link the inflationary dynamics with the post-inflationary growth of the horizon, and thus begin to probe the ''primordial dark ages'' between TeV and grand unified theory scale energies.

79 ASTRONOMY AND ASTROPHYSICS↗

Impact of Limited Degree of Freedom Drag Coefficients on a Floating Offshore Wind Turbine Simulation

The worldwide effort to design and commission floating offshore wind turbines (FOWT) is motivating the need for reliable numerical models that adequately represent their physical behavior under realistic sea states. However, properly representing the hydrodynamic quadratic damping for FOWT remains uncertain, because of its dependency on the choice of drag coefficients (dimensionless or not). It is hypothesized that the limited degree of freedom (DoF) drag coefficient formulation that uses only translational drag coefficients causes mischaracterization of the rotational DoF drag, leading to underestimation of FOWT global loads, such as tower base fore-aft shear. To address these hydrodynamic modeling uncertainties, different quadratic drag models implemented in the open-source mid-fidelity simulation tool, OpenFAST, were investigated and compared with the experimental data from the Offshore Code Comparison Collaboration, Continued, with Correlation (OC5) project. The tower base fore-aft shear and up-wave mooring line tension were compared under an irregular wave loading condition to demonstrate the effects of the different damping models. Two types of hydrodynamic quadratic drag formulations were considered: (1) member-based dimensionless drag coefficients applied only at the translational DoF (namely limited-DoF drag model) and (2) quadratic drag matrix model (in dimensional form). Based on the results, the former consistently underestimated the 95th percentile peak loads and spectral responses when compared to the OC5 experimental data. In contrast, the drag matrix models reduced errors in estimates of the tower base shear peak load by 7–10% compared to the limited-DoF drag model. The underestimation in the tower base fore-aft shear was thus inferred be related to mischaracterization of the rotational pitch drag and the heave motion/drag by the limited-DoF model.

17 WIND ENERGY↗

An Observation‐Driven Approach to Improve Vegetation Phenology in a Global Land Surface Model

An empirical model calibration approach is presented that aims to approximate missing biosphere processes in a global land surface model without the need for substantial model structural changes. The strategy is implemented here using the NASA Catchment‐CN land surface model and Moderate Resolution Imaging Spectroradiometer (MODIS) observations of the fraction of absorbed photosynthetically active radiation (FPAR). Existing plant functional types (PFTs) of the Catchment‐CN model are divided into three subtypes, based on the bias between the model‐simulated and MODIS‐observed FPAR. Separate sets of vegetation parameters for each subtype are then calibrated at a small number of grid cells with homogeneous, single‐PFT land cover, using MODIS FPAR reference observations from 2003 to 2009. The effectiveness of the empirical approach at improving the realism of modeled vegetation dynamics is investigated with two global model simulations for the period 2010–2016, one using the newly calibrated parameter values and the other using the original values. Globally, the calibrated parameters reduce the root mean square error (RMSE) of the modeled FPAR with respect to MODIS by 0.029 (∼10%) on average. In some regions, substantially larger RMSE reductions are achieved. RMSE reductions are primarily driven by model bias reductions, with neutral effects on the temporal correlation skill. While the empirical approach is suitable for achieving consistent model improvements, it is shown to be sensitive to the characteristics of the model error, specifically a dominance of the bias component in the case of Catchment‐CN. Ultimately, more fundamental model structural changes may be required to achieve better improvements.

J. Kolassa↗

Integrated and spectral energetics of the GLAS general circulation model

Integrated and spectral error energetics of the GLAS General circulation model are compared with observations for periods in January 1975, 1976, and 1977. For two cases the model shows significant skill in predicting integrated energetics quantities out to two weeks, and for all three cases, the integrated monthly mean energetics show qualitative improvements over previous versions of the model in eddy kinetic energy and barotropic conversions. Fundamental difficulties remain with leakage of energy to the stratospheric level, particularly above strong initial jet streams associated in part with regions of steep terrain. The spectral error growth study represents the first comparison of general circulation model spectral energetics predictions with the corresponding observational spectra on a day by day basis. The major conclusion is that eddy kinetics energy can be correct while significant errors occur in the kinetic energy of wavenumber 3. Both the model and observations show evidence of single wavenumber dominance in eddy kinetic energy and the correlation of spectral kinetics and potential energy.

Tenenbaum, J.↗

Refinement and validation of two digital Microwave Landing System (MLS) theoretical models

Two digital microwave landing system theoretical models are considered which are generic models for the Doppler and scanning-beam frequency reference versions of the MLS. These models represent errors resulting from both system noise and discrete multipath. The data used for the validation effort were obtained from the Texas Instrument conventional scanning beam and the Hazeltine Doppler feasibility hardware versions of the MLS. Topics discussed include tape read software, time history plots, computation of power spectral density, smoothed power spectra, best-fit models, different equations for digital simulation, and discrete multipath errors.

Duff, W. G.↗

A GRAPHICS PROCESSING UNIT-ENABLED, HIGH-RESOLUTION COSMOLOGICAL MICROLENSING PARAMETER SURVEY

In the era of synoptic surveys, the number of known gravitationally lensed quasars is set to increase by over an order of magnitude. These new discoveries will enable a move from single-quasar studies to investigations of statistical samples, presenting new opportunities to test theoretical models for the structure of quasar accretion disks and broad emission line regions (BELRs). As one crucial step in preparing for this influx of new lensed systems, a large-scale exploration of microlensing convergence-shear parameter space is warranted, requiring the computation of O(10{sup 5}) high-resolution magnification maps. Based on properties of known lensed quasars, and expectations from accretion disk/BELR modeling, we identify regions of convergence-shear parameter space, map sizes, smooth matter fractions, and pixel resolutions that should be covered. We describe how the computationally time-consuming task of producing {approx}290,000 magnification maps with sufficient resolution (10,000{sup 2} pixel map{sup -1}) to probe scales from the inner edge of the accretion disk to the BELR can be achieved in {approx}400 days on a 100 teraflop s{sup -1} high-performance computing facility, where the processing performance is achieved with graphics processing units. We illustrate a use-case for the parameter survey by investigating the effects of varying the lens macro-model on accretion disk constraints in the lensed quasar Q2237+0305. We find that although all constraints are consistent within their current error bars, models with more densely packed microlenses tend to predict shallower accretion disk radial temperature profiles. With a large parameter survey such as the one described here, such systematics on microlensing measurements could be fully explored.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-F-BRD-07: Empirical Derivation of Site-Specific Margin Formulas

Purpose: To empirically derive margin formulas from existing clinical radiotherapy plans accounting for respiratory motion and setup uncertainties. Methods: We simulated realistic treatment scenarios, including respiratory motion and setup errors. Individual probability density functions (PDF) from respiratory data were used to simulate respiratory motion. Random (σ) and systematic (Σ) setup errors were modeled as Gaussian distributions. One-dimensional dose profiles were extracted from existing radiotherapy plans and convolved with respiratory PDFs and random error distributions to produce blurred dose profiles. Each blurred dose profile was then shifted 1000 times by randomly sampling the simulated systematic error distribution. Margins were determined from the distance between the simulated treatment and the original 95% isodose level. An equation was fit for each (σ, Σ) combination to derive margin formulas for 90% of the population receiving 95% dose. This methodology can be applied to different tumor sites. Here, dose profiles were extracted from partial breast 3DCRT plans in the anterior-posterior (AP) and superior-inferior (SI) directions. Respiratory motion data was from healthy volunteers, and a clinically relevant range of random and systematic setup errors (standard deviations 1 – 4 mm) was determined from the literature. Results: The PBI margin formulas in the AP and SI directions for 95% dose coverage for 90% of the population were very similar: M= 0.68σ + 1.54Σ and M= 0.72σ + 1.50Σ, respectively. Systematic setup errors had the largest influence on required margin size, whereas realistic respiratory amplitude had minimal impact. The derived formulas resulted in a smaller systematic component than commonly-used theoretical margin recipes. Conclusion: We have demonstrated a method to derive empirical margin formulas from existing patient radiotherapy plans, incorporating realistic respiratory motion and appropriate ranges of random and systematic error. Site-specific margin formulas may be better suited to patient populations than theoretically derived, ideal geometry general margin formulas.

60 APPLIED LIFE SCIENCES↗

The dynamics of error growth in a quasigeostrophic channel model

The objective of the paper is to determine the extent to which baroclinic instability contributes to the growth of errors in simple, yet realistic models of atmospheric flow. The model used here is a two-level quasi-geostrophic channel model. Results of two predictability experiments are reported. In one experiment, the initial condition perturbation was confined to the highest wavenumbers and had an energy of 1 percent of the climatological energy of the model for these scales. In the other experiment, perturbations were put only in the planetary wave and had the same strength relative to climatology as in the first experiment, leading to much larger absolute errors.

Straus, David M.↗

Impact of numerics on the predictive capabilities of reacting flow LES

Combustors in modern aerospace propulsion systems are highly optimized devices and further enhancements to their performance will require advanced predictive modeling techniques. The LES approach has potential to be such a technique, but demonstration of its true predictive capability remains a challenge. In this paper, a methodical study is performed to assess the impact of numerical error on the predictive capabilities of LES and to distinguish it from error arising from physical modeling. Four codes are employed to simulate the bluff body stabilized flame experiment of Volvo Flygmotor AB. The physical models (governing equations and sub-grid models) are kept identical between the codes so that the physical modeling error is the same. For the same reason, computational grids are also kept identical since the sub-grid models are grid dependent. Results indicate that all codes produce a very similar solution for the non-reacting flow in terms of large scale unsteady vortex shedding behavior, mean profiles and second order turbulence statistics, on a suitably refined grid. This solution is also very close to the experimentally observed behavior of the flow. In contrast, for the reacting case, solutions from the various codes exhibit significant differences when analyzed under the same metrics and with similar or even finer grid resolution than that used for the non-reacting case. These differences are large enough to change the macroscopic behavior of the flow, e.g. some codes predict symmetric vortex shedding while others predict asymmetric shedding and some codes show strong recirculation zones while others show stagnant regions behind the bluff body. It is also shown that none of the solutions truly predicts the experimentally observed flow. Given that the physical sub-grid models and computational grids are the same in all the simulations, the inconsistency between results points to a significant impact of numerical methods and, hence, numerical error. The need for mitigation of this impact is highlighted, along with the need for metrics detailing how LES should be applied to reacting flows. It is suggested that both of these issues should be the focus of future work.

Energy & Fuels↗

Rotorcraft system identification techniques for handling qualities and stability and control evaluation

An integrated approach to rotorcraft system identification is described. This approach consists of sequential application of (1) data filtering to estimate states of the system and sensor errors, (2) model structure estimation to isolate significant model effects, and (3) parameter identification to quantify the coefficient of the model. An input design algorithm is described which can be used to design control inputs which maximize parameter estimation accuracy. Details of each aspect of the rotorcraft identification approach are given. Examples of both simulated and actual flight data processing are given to illustrate each phase of processing. The procedure is shown to provide means of calibrating sensor errors in flight data, quantifying high order state variable models from the flight data, and consequently computing related stability and control design models.

Hall, W. E., Jr.↗

Magellan adaptive optics first-light observations of the exoplanet β PIC b. II. 3–5 μm direct imaging with MagAO+Clio, and the empirical bolometric luminosity of a self-luminous giant planet

Young giant exoplanets are a unique laboratory for understanding cool, low-gravity atmospheres. A quintessential example is the massive extrasolar planet β Pic b, which is 9 AU from and embedded in the debris disk of the young nearby A6V star β Pictoris. We observed the system with first light of the Magellan Adaptive Optics (MagAO) system. In Paper I we presented the first CCD detection of this planet with MagAO+VisAO. Here we present four MagAO+Clio images of β Pic b at 3.1 μm, 3.3 μm, L′, and M{sup ′}, including the first observation in the fundamental CH{sub 4} band. To remove systematic errors from the spectral energy distribution (SED), we re-calibrate the literature photometry and combine it with our own data, for a total of 22 independent measurements at 16 passbands from 0.99 to 4.8 μm. Atmosphere models demonstrate the planet is cloudy but are degenerate in effective temperature and radius. The measured SED now covers >80% of the planet’s energy, so we approach the bolometric luminosity empirically. We calculate the luminosity by extending the measured SED with a blackbody and integrating to find log(L{sub bol}/L{sub ⊙}) = −3.78±0.03. From our bolometric luminosity and an age of 23 ± 3 Myr, hot-start evolutionary tracks give a mass of 12.7 ± 0.3 M{sub Jup}, radius of 1.45 ± 0.02 R{sub Jup}, and T{sub eff} of 1708 ± 23 K (model-dependent errors not included). Our empirically determined luminosity is in agreement with values from atmospheric models (typically −3.8 dex), but brighter than values from the field-dwarf bolometric correction (typically −3.9 dex), illustrating the limitations in comparing young exoplanets to old brown dwarfs.

79 ASTRONOMY AND ASTROPHYSICS↗

A Dynamic Approach to Modeling Dependence Between Human Failure Events

In practice, most HRA methods use direct dependence from THERP—the notion that error be- gets error, and one human failure event (HFE) may increase the likelihood of subsequent HFEs. In this paper, we approach dependence from a simulation perspective in which the effects of human errors are dynamically modeled. There are three key concepts that play into this modeling: (1) Errors are driven by performance shaping factors (PSFs). In this context, the error propagation is not a result of the presence of an HFE yielding overall increases in subsequent HFEs. Rather, it is shared PSFs that cause dependence. (2) PSFs have qualities of lag and latency. These two qualities are not currently considered in HRA methods that use PSFs. Yet, to model the effects of PSFs, it is not simply a matter of identifying the discrete effects of a particular PSF on performance. The effects of PSFs must be considered temporally, as the PSFs will have a range of effects across the event sequence. (3) Finally, there is the concept of error spilling. When PSFs are activated, they not only have temporal effects but also lateral effects on other PSFs, leading to emergent errors. This paper presents the framework for tying together these dynamic dependence concepts.

dependence↗

Quantitative validation of carbon-fiber laminate low velocity impact simulations

Simulations of low velocity impact with a flat cylindrical indenter upon a carbon fiber fabric reinforced polymer laminate are rigorously validated. Comparison of the impact energy absorption between the model and experiment is used as the validation metric. Additionally, non-destructive evaluation, including ultrasonic scans and three-dimensional computed tomography, provide qualitative validation of the models. The simulations include delamination, matrix cracks and fiber breaks. An orthotropic damage and failure constitutive model, capable of predicting progressive damage and failure, is developed in conjunction and described. An ensemble of simulations incorporating model parameter uncertainties is used to predict a response distribution which is then compared to experimental output using appropriate statistical methods. Lastly, the model form errors are exposed and corrected for use in an additional blind validation analysis. The result is a quantifiable confidence in material characterization and model physics when simulating low velocity impact in structures of interest.

36 MATERIALS SCIENCE↗

The Terrestrial Planet Finder coronagraph dynamics error budget

The Terrestrial Planet Finder Coronagraph (TPF-C) demands extreme wave front control and stability to achieve its goal of detecting earth-like planets around nearby stars. We describe the performance models and error budget used to evaluate image plane contrast and derive engineering requirements for this challenging optical system.

coronagraph↗

Theoretical modeling of a bottom-raised oscillating surge wave energy converter structural loadings and power performances

Here, this study presents theoretical formulations to evaluate the fundamental parameters and performance characteristics of a bottom-raised oscillating surge wave energy converter (OSWEC) device. Employing a flat plate assumption and potential flow formulation in elliptical coordinates, closed-form equations for the added mass, radiation damping, and excitation forces/torques in the relevant pitch-pitch and surge-pitch directions of motion are developed and used to calculate the system's response amplitude operator and the forces and moments acting on the foundation. The model is benchmarked against numerical simulations using WAMIT and WEC-Sim, showcasing excellent agreement. The sensitivity of plate thickness on the analytical hydrodynamic solutions is investigated over several thickness-to-width ratios ranging from 1:80 to 1:10. The results show that as the thickness of the benchmark OSWEC increases, the deviation of the analytical hydrodynamic coefficients from the numerical solutions grows from 3% to 25%. Differences in the excitation forces and torques, however, are contained within 12%. While the flat plate assumption is a limitation of the proposed analytical model, the error is within a reasonable margin for use in the design space exploration phase before a higher-fidelity (and thus more computationally expensive) model is employed. A parametric study demonstrates the ability of the analytical model to quickly sweep over a domain of OSWEC dimensions, illustrating the analytical model's utility in the early phases of design.

13 HYDRO ENERGY↗

Characterizing Performance of Freshwater Wetland Methane Models Across Time Scales at FLUXNET-CH 4 Sites Using Wavelet Analyses

Process-based land surface models are important tools for estimating global wetland methane (CH 4 ) emissions and projecting their behavior across space and time. So far there are no performance assessments of model responses to drivers at multiple time scales. In this study, we apply wavelet analysis to identify the dominant time scales contributing to model uncertainty in the frequency domain. We evaluate seven wetland models at 23 eddy covariance tower sites. Our study first characterizes site-level patterns of freshwater wetland CH 4 fluxes (FCH 4 ) at different time scales. A Monte Carlo approach was developed to incorporate flux observation error to avoid misidentification of the time scales that dominate model error. Our results suggest that (a) significant model-observation disagreements are mainly at multi-day time scales (<15 days); (b) most of the models can capture the CH 4 variability at monthly and seasonal time scales (>32 days) for the boreal and Arctic tundra wetland sites but have significant bias in variability at seasonal time scales for temperate and tropical/subtropical sites; (c) model errors exhibit increasing power spectrum as time scale increases, indicating that biases at time scales <5 days could contribute to persistent systematic biases on longer time scales; and (d) differences in error pattern are related to model structure (e.g., proxy of CH 4 production). Our evaluation suggests the need to accurately replicate FCH 4 variability, especially at short time scales, in future wetland CH 4 model developments.

58 GEOSCIENCES↗

Impact of point spread function higher moments error on weak gravitational lensing – II. A comprehensive study

ABSTRACT Weak lensing is one of the most powerful probes for dark matter and dark energy science, although it faces increasing challenges in controlling systematic uncertainties as the statistical errors become smaller. The point spread function (PSF) needs to be precisely modeled to avoid systematic error on the weak lensing measurements. The weak lensing biases induced by errors in the PSF model second moments, i.e. its size and shape, are well-studied. However, Zhang et al. showed that errors in the higher moments of the PSF may also be a significant source of systematics for upcoming weak lensing surveys. Therefore, this work comprehensively investigate the modelling quality of PSF moments from the 3rd to 6th order, and propagate the PSFEx higher moments modelling error in the HSC survey data set to the weak lensing shear–shear correlation functions and their cosmological analyses. The overall multiplicative shear bias associated with errors in PSF higher moments can cause an ∼0.1σ shift on the cosmological parameters for LSST Y10, while the associated additive biases can induce 1σ uncertainties in cosmology parameter inference for LSST Y10, if not accounted. We compare the PSFEx model with PSF in Full FOV, and find similar performance in modelling the PSF higher moments. We conclude that PSF higher moment errors of the future PSF models should be reduced from those in current methods, otherwise needed to be explicitly modeled in the weak lensing analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Embedded Error Bayesian Calibration of Thermal Decomposition of Organic Materials

Organic materials are an attractive choice for structural components due to their light weight and versatility. However, because they decompose at low temperatures relative to tradiational materials they pose a safety risk due to fire and loss of structural integrity. To quantify this risk, analysts use chemical kinetics models to describe the material pyrolysis and oxidation using thermogravimetric analysis. This process requires the calibration of many model parameters to closely match experimental data. Previous efforts in this field have largely been limited to finding a single best-fit set of parameters even though the experimental data may be very noisy. Furthermore the chemical kinetics models are often simplified representations of the true de- composition process. The simplification induces model-form errors that the fitting process cannot capture. In this work we propose a methodology for calibrating decomposition models to thermogravimetric analysis data that accounts for uncertainty in the model-form and experimental data simultaneously. The methodology is applied to the decomposition of a carbon fiber epoxy composite with a three-stage reaction network and Arrhenius kinetics. The results show a good overlap between the model predictions and thermogravimetric analysis data. Uncertainty bounds capture devia- tions of the model from the data. The calibrated parameter distributions are also presented. In conclusion, the distributions may be used in forward propagation of uncertainty in models that leverage this material.

36 MATERIALS SCIENCE↗