Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

MultiPEM Toolbox: User Manual [Rev. 2]

This document explains use of the Multi-Phenomenology Explosion Monitoring (Multi PEM) Toolbox, a collection of R scripts for estimating the unknown device parameters of a new event with uncertainty quantification. The methodology and application used for illustration in this user manual are fully documented in a Los Alamos National Laboratory technical report hereafter designated “WPA” for reference. Additional details on the application are found in a recent journal article. Two assessment types are available: rapid and complete. Rapid assessments are conducted in two stages, as described in Section 2. In the first stage, calibration data are used to estimate forward and error model parameters (WPA, §5.1) and (if relevant) errors-in-variables yield values for calibration sources (WPA, §3, Equation (3)). In the second stage, new event data are used to estimate the unknown new event device parameters (WPA, §5.2) with uncertainty quantification. Two options for treating the inferred first stage parameters in second stage Bayesian analysis are available: fixing them at their maximum likelihood estimate (default), or multiple imputation. Multiple imputation involves utilizing several posterior samples (imputations) of the first stage parameters as fixed values in the second stage posterior sampling of the new event device parameters. Second stage sampling is conducted across imputations in parallel to improve computational efficiency. This method produces improved uncertainty quantification of the new event device parameters compared with the default treatment of the first stage parameters, at the expense of additional computation. Complete assessments are conducted in a single stage, as described in Section 3. Calibration and (if relevant) new event data are used simultaneously to estimate all forward model, error model, and (if relevant) new event device parameters with uncertainty quantification on the latter. As the name suggests, rapid assessments generally run substantially faster than complete assessments (even with multiple imputation), because the results of first stage analysis can be stored and incorporated into estimating a relatively low-dimensional space of new event device parameters whenever relevant new event data becomes available. On the other hand, complete assessments must be run on the full set of model and device parameters with calibration and new event data every time the latter becomes available.

97 MATHEMATICS AND COMPUTING↗

Sensitivity of Lower Stratospheric Assimilated Ozone on Error Covariance Modeling and Data Selection

Assimilated ozone is produced at the NASA/Goddard Data Assimilation Office by blending ozone retrieved from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) measurements into an off-line transport model. The current system tends to overestimate the amount of lower stratospheric ozone. This is a region where ozone plays a key role in the forcing of climate. A biased ozone field in this region will adversely impact calculations of the stratosphere-troposphere exchange and, when used as a first guess in retrievals, the values determined from satellite observations. Since these are all important applications of assimilated ozone products, effort is being directed towards reducing this bias. The SBUV ozone data have a coarse vertical resolution with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone in the lower stratosphere, and its vertical distribution in particular, are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Accordingly, the sensitivity of the assimilated lower stratospheric ozone fields to changes in the TOMS error-covariance modeling and the SBUV data selection has been investigated. The use of a spatially correlated TOMS error covariance model led to improvements in the product. However, withholding the SBUV/2 data for the layer between 63 and 126 hPa typically degraded the product, a result which vindicates the use of this layer ozone product, despite its known errors. These efforts to improve the lower stratospheric distribution will be extended to include a more advanced forecast error covariance model, and by assimilating ozone products from new instruments on Envisat and EOS Aura.

Stajner, Ivanka↗

Model-form Error Correction using Universal Differential Equations for an Agent-Based Model of Infectious Disease

This report demonstrates universal differential equations (UDEs) as an approach to bridge the gap between ordinary differential equations (ODE) models and agent-based models (ABMs). Using UDE models as surrogates for ABMs allows us to preserve the foundational ODE that represents global disease dynamics while coupling it with a neural network model to approximate functions for the local behaviors of the ABM.

59 BASIC BIOLOGICAL SCIENCES↗

Practical robustness measures in multivariable control system analysis

The robustness of the stability of multivariable linear time invariant feedback control systems with respect to model uncertainty is considered using frequency domain criteria. Available robustness tests are unified under a common framework based on the nature and structure of model errors. These results are derived using a multivariable version of Nyquist's stability theorem in which the minimum singular value of the return difference transfer matrix is shown to be the multivariable generalization of the distance to the critical point on a single input, single output Nyquist diagram. Using the return difference transfer matrix, a very general robustness theorem is presented from which all of the robustness tests dealing with specific model errors may be derived. The robustness tests that explicitly utilized model error structure are able to guarantee feedback system stability in the face of model errors of larger magnitude than those robustness tests that do not. The robustness of linear quadratic Gaussian control systems are analyzed.

Lehtomaki, N. A.↗

Determination of Barometric Altimeter Errors for the Orion Exploration Flight Test-1 Entry

The EFT-1 mission is the unmanned flight test for the upcoming Multi-Purpose Crew Vehicle (MPCV). During entry, the EFT-1 vehicle will trigger several Landing and Recovery System (LRS) events, such as parachute deployment, based on onboard altitude information. The primary altitude source is the filtered navigation solution updated with GPS measurement data. The vehicle also has three barometric altimeters that will be used to measure atmospheric pressure during entry. In the event that GPS data is not available during entry, the altitude derived from the barometric altimeter pressure will be used to trigger chute deployment for the drogues and main parachutes. Therefore it is important to understand the impact of error sources on the pressure measured by the barometric altimeters and on the altitude derived from that pressure. There are four primary error sources impacting the sensed pressure: sensor errors, Analog to Digital conversion errors, aerodynamic errors, and atmosphere modeling errors. This last error source is induced by the conversion from pressure to altitude in the vehicle flight software, which requires an atmosphere model such as the US Standard 1976 Atmosphere model. There are several secondary error sources as well, such as waves, tides, and latencies in data transmission. Typically, for error budget calculations it is assumed that all error sources are independent, normally distributed variables. Thus, the initial approach to developing the EFT-1 barometric altimeter altitude error budget was to create an itemized error budget under these assumptions. This budget was to be verified by simulation using high fidelity models of the vehicle hardware and software. The simulation barometric altimeter model includes hardware error sources and a data-driven model of the aerodynamic errors expected to impact the pressure in the midbay compartment in which the sensors are located. The aerodynamic model includes the pressure difference between the midbay compartment and the free stream pressure as a function of altitude, oscillations in sensed pressure due to wake effects, and an acoustics model capturing fluctuations in pressure due to motion of the passive vents separating the barometric altimeters from the outside of the vehicle.

Brown, Denise L.↗

Is There A Relationship Between Cornered-Hat Methods and A Residual Approach to Estimate System Uncertainty?

Recently a relationship has been established between a now traditional residual diagnostic used to estimate observation, background and analysis error covariances of interest to data assimilation and the three-cornered hat (3CH) method. An existing extension of the traditional residual diagnostic uses residuals from a fixed lag-1 Kalman smoother to retrieve system (model) error covariance. It is thus natural to ask if an additional relationship can be established between this extended residual method and some form of cornered--hat method. The answer might seem straightforward. Unlike in the standard residual estimation case, attempting to estimate model error amounts to estimating the statistics of a residual quantity itself. As shown in this presentation, in such cases the 3CH method becomes trivial: the sought out uncertainty can be derived directly from the covariance of the residual quantity at hand. In the particular case of estimating model error, one of the corners would have to be composed of vectors providing estimates of model error; these are not typically available in practice. Therefore, at first glance the present work finds no relationship between the lag-1 smoother residual diagnostic for system error estimation and cornered--hat methods. However, the work suggests that a two-tiered 3CH might be all that is necessary for system uncertainty to be obtained with 3CH.

Ricardo Todling↗

Accounting for erroneous model structures in biokinetic process models

In engineering practice, model-based design requires not only a good process-based model, but also a good description of stochastic disturbances and measurement errors to learn credible parameter values from observations. However, typical methods use Gaussian error models, which often cannot describe the complex temporal patterns of residuals. Consequently, this results in overconfidence in the identified parameters and, in turn, optimistic reactor designs. Here, we assess the strengths and weaknesses of a method to statistically describe these patterns with autocorrelated error models. This method produces increased widths of the credible prediction intervals following the inclusion of the bias term, in turn leading to more conservative design choices. However, we also show that the augmented error model is not a universal tool, as its application cannot guarantee the desired reliability of the resulting wastewater reactor design.

42 ENGINEERING↗

Direct numerical simulations in solid mechanics for quantifying the macroscale effects of microstructure and material model-form error

Two fundamental approximations in macroscale solid-mechanics modeling are (1) the assumption of scale separation in homogenization theory and (2) the use of a macroscopic plasticity material model that represents, in a mean sense, the multitude of inelastic processes occurring at the microscale. With the goal of quantifying the errors induced by these approximations on engineering quantities of interest, we perform a set of direct numerical simulations (DNS) in which polycrystalline microstructures are embedded throughout a macroscale structure. The largest simulations model over 50,000 grains. The microstructure is idealized using a randomly close-packed Voronoi tessellation in which each polyhedral Voronoi cell represents a grain. An face centered cubic crystal-plasticity model is used to model the mechanical response of each grain. The overall grain structure is equiaxed, and each grain is randomly oriented with no overall texture. The detailed results from the DNS simulations are compared to results obtained from conventional macroscale simulations that use homogeneous isotropic plasticity models. The macroscale plasticity models are calibrated using a representative volume element of the idealized microstructure. Furthermore, we envision that DNS modeling will be used to gain new insights into the mechanics of material deformation and failure.

36 MATERIALS SCIENCE↗

Model uncertainty in accelerator application simulations

Monte-Carlo nuclear reaction and transport codes are widely used to devise accelerator-based nuclear physics experiments; at the same time, many experiments are performed to validate the Monte-Carlo codes, which can be used for the design of full-scale nuclear power applications or the design of new benchmark experiments. Dedicated model benchmark studies investigate a broad range of nuclear reactions and quantities. Examples of these include isotope formation or secondary particle fluxes that result from the interactions of GeV-range hadrons with monoisotopic targets, which can be used to assess the respective systematic uncertainty of models. Such benchmark studies, as well as many nuclear application experiments and simulations carried out by various groups over the last few decades, enable us to draw methodological lessons. In this work, model uncertainty determined based on available experimental data allow us to identify the effects of practitioner expertise as well as the design of codes (user access to micro-scale parameters) on the range of uncertainties. We found that in cases when simulations are performed by code developers or users that are very experienced in performing simulations, the model to experiment quantity ratios generally agree with the limits determined by dedicated benchmark studies. In other cases, the ratios generally tend to be either smaller (underestimation of model error) or larger (overestimation of model error). A plausible explanation of the aforementioned effects is suggested.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A multiloop generalization of the circle criterion for stability margin analysis

In order to provide a theoretical tool suited for characterizing the stability margins of multiloop feedback systems, multiloop input-output stability results generalizing the circle stability criterion are considered. Generalized conic sectors with 'centers' and 'radii' determined by linear dynamical operators are employed to specify the stability margins as a frequency dependent convex set of modeling errors (including nonlinearities, gain variations and phase variations) which the system must be able to tolerate in each feedback loop without instability. The resulting stability criterion gives sufficient conditions for closed loop stability in the presence of frequency dependent modeling errors, even when the modeling errors occur simultaneously in all loops. The stability conditions yield an easily interpreted scalar measure of the amount by which a multiloop system exceeds, or falls short of, its stability margin specifications.

Safonov, M. G.↗

Decentralized Control of Sound Radiation Using Iterative Loop Recovery

A decentralized model-based control strategy is designed to reduce low-frequency sound radiation from periodically stiffened panels. While decentralized control systems tend to be scalable, performance can be limited due to modeling error introduced by the unmodeled interaction between neighboring control units. Since bounds on modeling error are not known in advance, it is difficult to ensure the decentralized control system will be robust without making the controller overly conservative. Therefore an iterative approach is suggested, which utilizes frequency-shaped loop recovery. The approach accounts for modeling error introduced by neighboring control loops, requires no communication between subsystems, and is relatively simple. The control strategy is evaluated numerically using a model of a stiffened aluminum panel that is representative of the sidewall of an aircraft. Simulations demonstrate that the iterative approach can achieve significant reductions in radiated sound power from the stiffened panel without destabilizing neighboring control units.

Schiller, Noah H.↗

A multiloop generalization of the circle criterion for stability margin analysis

In order to provide a theoretical tool well suited for use in characterizing the stability margins (e.g., gain and phase margins) of multiloop feedback systems, multiloop input-output stability results generalizing the circle stability criterion are considered. Generalized conic sectors with 'centers' and 'radii' determined by linear dynamical operators are employed to enable an engineer to specify the stability margins which he desires as a frequency-dependent convex set of modeling errors (including nonlinearities, gain variations, and phase variations) which the system must be able to tolerate in each feedback loop without instability. The resulting stability criterion gives sufficient conditions for closed-loop stability in the presence of such frequency-dependent modeling errors, even when the modeling errors occur simultaneously in all loops.

Safonov, M. G.↗

Interpolation Models and Error Bounds for Verifiable Scientific Machine Learning

This repository contains python scripts and numerical data accompanying the paper: "Leveraging Interpolation Models and Error Bounds for Verifiable Scientific Machine Learning," Tyler Chang, Andrew Gillette, Romit Maulik, 2024. The following subdirectories are included: - "interpolants" contains our interpolation scripts used for all studies - "experiments" contains scripts demonstrating our experiments with synthetic data - "airfoil" contains scripts demonstrating our experiments with the publicly available UIUC airfoil dataset. Further instructions are provided in READMEs within the sub-directories.

Gillette, Andrew↗

Verification and source-position error analysis of film reconstruction techniques used in the brachytherapy planning systems

A method was presented that employs standard linac QA tools to verify the accuracy of film reconstruction algorithms used in the brachytherapy planning system. Verification of reconstruction techniques is important as suggested in the ESTRO booklet 8: ''The institution should verify the full process of any reconstruction technique employed clinically.'' Error modeling was also performed to analyze seed-position errors. The ''isocentric beam checker'' device was used in this work. It has a two-dimensional array of steel balls embedded on its surface. The checker was placed on the simulator couch with its center ball coincident with the simulator isocenter, and one axis of its cross marks parallel to the axis of gantry rotation. The gantry of the simulator was rotated to make the checker behave like a three-dimensional array of balls. Three algorithms used in the ABACUS treatment planning system: orthogonal film, 2-films-with-variable-angle, and 3-films-with-variable-angle were tested. After exposing and digitizing the films, the position of each steel ball on the checker was reconstructed and compared to its true position, which can be accurately calculated. The results showed that the error is dependent on the object-isocenter distance, but not the magnification of the object. The averaged errors were less than 1 mm within the tolerance level defined by Roueet al. [''The EQUAL-ESTRO audit on geometric reconstruction techniques in brachytherapy,'' Radiother. Oncol. 78, 78-83 (2006)]. However, according to the error modeling, the theoretical error would be greater than 2 mm if the objects were located more than 20 cm away from the isocenter with a 0.5 deg. reading error of the gantry and collimator angles. Thus, in addition to carefully performing the QA of the gantry and collimator angle indicators, it is suggested that the patient, together with the applicators or seeds inside, should be placed close to the isocenter as much as possible. This method could be used to test the reconstruction techniques of any planning system, and the most suitable one can be chosen for clinical use.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A study of attitude control concepts for precision-pointing non-rigid spacecraft

Attitude control concepts for use onboard structurally nonrigid spacecraft that must be pointed with great precision are examined. The task of determining the eigenproperties of a system of linear time-invariant equations (in terms of hybrid coordinates) representing the attitude motion of a flexible spacecraft is discussed. Literal characteristics are developed for the associated eigenvalues and eigenvectors of the system. A method is presented for determining the poles and zeros of the transfer function describing the attitude dynamics of a flexible spacecraft characterized by hybrid coordinate equations. Alterations are made to linear regulator and observer theory to accommodate modeling errors. The results show that a model error vector, which evolves from an error system, can be added to a reduced system model, estimated by an observer, and used by the control law to render the system less sensitive to uncertain magnitudes and phase relations of truncated modes and external disturbance effects. A hybrid coordinate formulation using the provided assumed mode shapes, rather than incorporating the usual finite element approach is provided.

Likins, P. W.↗

Nonlinear and adaptive estimation in reentry.

The problem of real-time estimation of a lifting reentry vehicle trajectory of the shuttle orbiter type is considered. Simulations feature large position and velocity uncertainties at radar acquisition and realistic model errors in lift, drag and other model parameters. Radar tracking and accelerometer data are simulated. Significant nonlinearities are found to exist on spacecraft acquisition. An iterated nonlinear filter is shown to perform optimally during the radar acquisition phase. An adaptive filter is shown to track time-varying model errors, such as errors in the lift and drag coefficients, down to the noise level. Such real-time model tracking (identification) is frequently required for guidance and control implementation.

Jazwinski, A. H.↗

Forecasts of the 500 mb height using a dynamically oriented statistical model

The forecast skill of a simple dynamically inspired statistical model of the Northern Hemisphere 500 mb height field is evaluated in spectral and physical space for a variety of forecast lead times (1-32 days) and predictand averaging times (1-32 days). The model includes viscous damping, wave propagation, climatology and implicit stochastic forcing. The largest model skill was found for forecasts of the zonal flow and the largest waves. In general, the largest forecast skills were also associated with the largest forecast error, there being a slight geographic phase shift of the skill with respect to the error. Model skills for climate (time-averaged) forecasts are greater when using instantaneous rather than time averages to forecast time averages. Analysis of model errors suggests areas for improvement in representing forcing terms and model physics. However, the model error fields are largely 'white noise' which suggests that global forecast skills substantially larger than those obtained here are unlikely to be achieved by more sophisticated models.

Roads, J. O.↗

Optical linear algebra processors - Noise and error-source modeling

The modeling of system and component noise and error sources in optical linear algebra processors (OLAPs) are considered, with attention to the frequency-multiplexed OLAP. General expressions are obtained for the output produced as a function of various component errors and noise. A digital simulator for this model is discussed.

Casasent, D.↗