Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Validation of mathematical models for the prediction of organs-at-risk dosimetric metrics in high-dose-rate gynecologic interstitial brachytherapy

Purpose: Given the complicated nature of an interstitial gynecologic brachytherapy treatment plan, the use of a quantitative tool to evaluate the quality of the achieved metrics compared to clinical practice would be advantageous. For this purpose, predictive mathematical models to predict the D{sub 2cc} of rectum and bladder in interstitial gynecologic brachytherapy are discussed and validated.Methods: Previous plans were used to establish the relationship between D2cc and the overlapping volume of the organ at risk with the targeted area (C0) or a 1-cm expansion of the target area (C1). Three mathematical models were evaluated: D{sub 2cc}=α*C{sub 1}+β (LIN); D{sub 2cc}=α– exp(–β*C{sub 0}) (EXP); and a mixed approach (MIX), where both C{sub 0} and C{sub 1} were inputs of the model. The parameters of the models were optimized on a training set of patient data, and the predictive error of each model (predicted D{sub 2cc}− real D{sub 2cc}) was calculated on a validation set of patient data. The data of 20 patients were used to perform a K-fold cross validation analysis, with K = 2, 4, 6, 8, 10, and 20.Results: MIX was associated with the smallest mean prediction error <6.4% for an 18-patient training set; LIN had an error <8.5%; EXP had an error <8.3%. Best case scenario analysis shows that an error ≤5% can be achieved for a ten-patient training set with MIX, an error ≤7.4% for LIN, and an error ≤6.9% for EXP. The error decreases with the increase in training set size, with the most marked decrease observed for MIX.Conclusions: The MIX model can predict the D{sub 2cc} of the organs at risk with an error lower than 5% with a training set of ten patients or greater. The model can be used in the development of quality assurance tools to identify treatment plans with suboptimal sparing of the organs at risk. It can also be used to improve preplanning and in the development of real-time intraoperative planning tools.

61 RADIATION PROTECTION AND DOSIMETRY↗

Toward Predictive RANS and SRS Computations of Turbulent External Flows of Practical Interest

In this work, we investigate the main challenges to prediction of turbulent external flows of practical interest with Reynolds-Averaged Navier–Stokes equations (RANS) and Scale-Resolving Simulation (SRS) models. This represents a crucial step toward further developing and establishing these formulations so they can be confidently utilized in engineering problems without reference data. The study initiates by identifying the major challenges to prediction. A literature review is performed to illustrate their effects in RANS and SRS computations. Afterward, we evaluate the impact of the challenges to prediction by analyzing representative statistically steady and unsteady flows with prominent RANS and SRS methods. These include multiple turbulent viscosity and second-moment RANS closures, and hybrid and bridging SRS models. The results demonstrate the potential of the selected SRS models to predict engineering flows. Yet, they also show the importance of considering the challenges to prediction during the setup and conduction of numerical experiments. These can suppress the advantages of using SRS formulations. The data also indicate that only SRS models can confidently predict statistically unsteady flows. In contrast, the results demonstrate that mean-flow quantities of statistically steady flows can be efficiently calculated with RANS closures, especially second-moment closures. Among the selected SRS methods, bridging models reveal better suited for prediction due to their ability to prevent commutation errors and enable the robust evaluation of numerical and modeling errors. This last property allows the use of a new validation technique that does not require reference data.

42 ENGINEERING↗

A simple model based magnet sorting algorithm for planar hybrid undulators

Various magnet sorting strategies have been used to optimize undulator performance, ranging from intuitive pairing of high- and low-strength magnets, to full 3D FEM simulation with 3-axis Helmholtz coil magnet data. In the extreme, swapping magnets in a full field model to minimize trajectory wander and rms phase error can be time consuming. This paper presents a simpler approach, extending the field error signature concept to obtain trajectory displacement, kick angle and phase error signatures for each component of magnetization error from a Radia model of a short hybrid-PM undulator. We demonstrate that steering errors and phase errors are essentially decoupled and scalable from measured X, Y and Z components of magnetization. Then, for any given sequence of magnets, rms trajectory and phase errors are obtained from simple cumulative sums of the scaled displacements and phase errors. The cost function (a weighted sum of these errors) is then minimized by swapping magnets, using one's favorite optimization algorithm. This approach was applied recently at NSLS to a short in-vacuum undulator, which required no subsequent trajectory or phase shimming. Trajectory and phase signatures are also obtained for some mechanical errors, to guide 'virtual shimming' and specifying mechanical tolerances. Some simple inhomogeneities are modeled to assess their error contributions.

43 PARTICLE ACCELERATORS↗

Model-based approach to investigate equipment-induced error in pressure-waveform derived hemodynamic measurements

Advanced hemodynamic monitoring systems have provided less invasive methods for estimating pressure-derived measurements such as pressure-derived cardiac output (CO) measurements. These devices apply algorithms to arterial pressure waveforms recorded via pressure recording components that transmit the pressure signal to a pressure monitor. While standards have been developed for pressure monitoring equipment, it is unclear how the equipment-induced error can affect secondary measurements from pressure waveforms. We propose an approach for modelling different components of a pressure monitoring system and use this model-based approach to investigate the effect of different pressure recording configurations on pressure-derived hemodynamic measurements. The proposed model-based approach is a three-step process. (1) Modelling the response of pressure recording components using bench tests; (2) verifying the identified models through nonparametric equivalence tests; and (3) assessing the effects of pressure recording components on pressure-derived measurements. To delineate the application of this approach, we performed a series of model-based analyses to quantify the combined effect of a wide range of tubing configurations with various damping ratios and natural frequencies and monitors with different bandwidths on pressure waveforms and CO measurements by six pulse contour algorithms. Model-based results show the error in pressure-derived CO measurements because of tubing configurations with different natural frequencies and damping ratios. Tubing configurations with low natural frequencies (<23 Hz) altered characteristics of pressure waveforms in a way that affected the CO measurement, some by as much as 20%. Our method can serve as a tool to quantify the performance of pressure recording systems with different dynamic properties. In conclusion, this approach can be applied to investigate the effects of physiologic signal recording configurations on various pressure-derived hemodynamic measurements.

42 ENGINEERING↗

Modeling energy balance while correcting for measurement error via free knot splines

Measurements of energy balance components (energy intake, energy expenditure, changes in energy stores) are often plagued with measurement error. Doubly-labeled water can measure energy intake (EI) with negligible error, but is expensive and cumbersome. An alternative approach that is gaining popularity is to use the energy balance principle, by measuring energy expenditure (EE) and change in energy stores (ES) and then back-calculate EI. Gold standard methods for EE and ES exist and are known to give accurate measurements, albeit at a high cost. We propose a joint statistical model to assess the measurement error in cheaper, non-intrusive measures of EE and ES. We let the unknown true EE and ES for individuals be latent variables, and model them using a bivariate distribution. We try both a bivariate Normal as well as a Dirichlet Process Mixture Model, and compare the results via simulation. Our approach, is the first to account for the dependencies that exist in individuals’ daily EE and ES. We employ semiparametric regression with free knot splines for measurements with error, and linear components for error free covariates. We adopt a Bayesian approach to estimation and inference and use Reversible Jump Markov Chain Monte Carlo to generate draws from the posterior distribution. Based on the semiparameteric regression, we develop a calibration equation that adjusts a cheaper, less reliable estimate, closer to the true value. Along with this calibrated value, our method also gives credible intervals to assess uncertainty. A simulation study shows our calibration helps produce a more accurate estimate. Furthermore, our approach compares favorably in terms of prediction to other commonly used models.

60 APPLIED LIFE SCIENCES↗

Introduction to CAUSES: Description of weather and climate models and their near-surface temperature errors in 5-day hindcasts near the Southern Great Plains

We introduce the Clouds Above the United States and Errors at the Surface (CAUSES) project with its aim of better understanding the physical processes leading to warm screen-temperature biases over the American Midwest in many numerical models. In this first of four companion papers, 11 different models, from 9 institutes, perform a series of 5-day hindcasts, each initialised from reanalyses. After describing the common experimental protocol and detailing each model configuration, a gridded temperature data set is derived from observations and used to show that all the models have a warm bias over parts of the Midwest. Additionally, a strong diurnal cycle in the screen-temperature bias is found in most models. In some models the bias is largest around midday, while in others it is largest during the night. At the Department of Energy Atmospheric Radiation Measurement Southern Great Plains (SGP) site, the model biases are shown to extend several kilometers into the atmosphere. Finally, to provide context for the companion papers, in which observations from the SGP site are used to evaluate the different processes contributing to errors there, it is shown that there are numerous locations across the Midwest where the diurnal cycle of the error is highly correlated with the diurnal cycle of the error at SGP. This suggests that conclusions drawn from detailed evaluation of models using instruments located at SGP will be representative of errors that are prevalent over a larger spatial scale.

54 ENVIRONMENTAL SCIENCES↗

Performability modeling based on real data: A case study

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of apparent types of errors.

Hsueh, M. C.↗

Evaporation over global oceans derived from satellite data and AGCM

Evaporation over ocean at 100 km has been estimated using operational satellite data. Recent satellite results are compared to data obtained through atmospheric general circulation models (AGCMs). A large systematic error is found in AGCM data which is considered to be due to overestimation of atmospheric moisture. It is suggested that the discrepancy may be caused by errors in operational infrared sounder data assimilated into the model. The error may also be caused by interpolation of very sparse in situ data in areas of sharp gradients.

Liu, W. T.↗

Performability modeling based on real data: A casestudy

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model the system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of different types of errors.

Hsueh, M. C.↗

Parameter uncertainties for imperfect surrogate models in the low-noise regime

Abstract Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, this loss ignores model form error, or misspecification, meaning parameter uncertainties are significantly underestimated and vanish in the large data limit. As misspecification is the main source of uncertainty for surrogate models of low-noise calculations, such as those arising in atomistic simulation, predictive uncertainties are systematically underestimated. We analyze the true generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show that posterior parameter distributions must cover every training point to avoid a divergence in the generalization error and design a compatible ansatz which incurs minimal overhead for linear models. The approach is demonstrated on model problems before application to thousand-dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors in terms of parameter uncertainties, allowing this important source of uncertainty to be incorporated in multi-scale computational workflows.

Swinburne, Thomas D. (ORCID:0000000232554257)↗

An Investigation of Time Distributions for Task Primitives to Support the HUNTER Dynamic Human Reliability Analysis

As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.

99 GENERAL AND MISCELLANEOUS↗

Material Model Parameters Optimization in Liquid Mercury Target Dynamics Simulation With Machine Learning Surrogates

A pulsed spallation target is subjected to very short (∼0.7μs) but intense loads (23.3 kJ) from repeated proton pulses, which knock away neutrons from the mercury atoms’ nuclei for a wide range application in physics, engineering, medicine, petroleum exploration, biology, chemistry, etc. The effect of this pulsed loading on the stainless-steel target module which contains the flowing mercury target material is difficult to predict not only due to its short but intense explosive-like physical reaction, but also the nonlinear material behavior of the liquid mercury in the structure. Injecting small helium bubbles in the mercury has been an efficient method of mitigating the pressure wave at high power level stage. However, prediction of the resultant loading on the target is more difficult when helium gas is intentionally injected into the mercury. A 2-phase material model that incorporates the Rayleigh-Plesset (R-P) model is expected to address this complex multi-physics dynamics problem by including the bubble dynamics in the liquid mercury. A parameter sensitivity study was firstly employed to understand their impact on the simulation strains. The investigated parameters included E, μ, γ, σ, n, VFgas, and gas cumulative volume curve control parameters a and b. Verification and validation results from sparse polynomial expansions (SPE) method and directional Gaussian smoothing (DGS) optimization show that the surrogate model had training error of ∼7% and validation error of ∼15%, indicating that machine learning methods and surrogate models can help optimize the uncertain parameters in the complex 2-phase material model. This approach is expected to fill the knowledge gap between unknown liquid-gas mixture material model and measured vessel strain responses.

Lin, Lianshan↗

Practical considerations in aeroelastic design

The structural design process for large transport aircraft is described. Critical loads must be determined from a large number of load cases within the flight maneuver envelope. The structural design is also constrained by considerations of producibility, reliability, maintainability, durability, and damage tolerance, as well as impact dynamics and multiple constraints due to flutter and aeroelasticity. Aircraft aeroelastic design considerations in three distinct areas of product development (preliminary design, advanced design, and detailed design) are presented and contrasted. The present state of the art is challenged to solve the practical difficulties associated with design, analysis, and redesign within cost and schedule constraints. The current practice consists of largely independent engineering disciplines operating with unorganized data interfaces. The need is then demonstrated for a well-planned computerized aeroelastic structural design optimization system operating with a common interdisciplinary data base. This system must incorporate automated interfaces between modular programs. In each phase of the design process, a common finite-element model for static and dynamic optimization is required to reduce errors due to modeling discrepancies. As the design proceeds from the simple models in preliminary design to the more complex models in advanced and detailed design, a means of retrieving design data from the previous models must be established.

Rommel, B. A.↗

An analytically linearized helicopter model with improved modeling accuracy

An analytically linearized model for helicopter flight response including rotor blade dynamics and dynamic inflow, that was recently developed, was studied with the objective of increasing the understanding, the ease of use, and the accuracy of the model. The mathematical model is described along with a description of the UH-60A Black Hawk helicopter and flight test used to validate the model. To aid in utilization of the model for sensitivity analysis, a new, faster, and more efficient implementation of the model was developed. It is shown that several errors in the mathematical modeling of the system caused a reduction in accuracy. These errors in rotor force resolution, trim force and moment calculation, and rotor inertia terms were corrected along with improvements to the programming style and documentation. Use of a trim input file to drive the model is examined. Trim file errors in blade twist, control input phase angle, coning and lag angles, main and tail rotor pitch, and uniform induced velocity, were corrected. Finally, through direct comparison of the original and corrected model responses to flight test data, the effect of the corrections on overall model output is shown.

Jensen, Patrick T.↗

The Q{sub weak} Experiment at Jefferson Lab--A Search for New Physics at the TeV Scale

The Q{sub weak} collaboration will make the first precision determination of the proton's weak charge, Q{sub W}{sup P} = 1-4 sin{sup 2} {theta}{sub w}, from a measurement of the parity-violating asymmetry in elastic electron-proton scattering at very low momentum transfer. The results will determine the proton's weak charge with a 4% total error. The Standard Model makes a firm prediction of Q{sub W}{sup P}, based on the running of the weak mixing angle, sin{sup 2} {theta}{sub w}, from the Z{sup 0} pole down to low energies, corresponding to a 10{sigma} effect in this experiment. Any significant deviation of sin{sup 2} {theta}{sub w} from the Standard Model prediction at low Q{sup 2} would be a signal of new physics, wheras agreement would place new and significant constraints on possible Standard Model extensions at the TeV mass scale.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Decay curve analysis for data error quantification in time-domain induced polarization imaging

In recent years, the time-domain induced polarization (TDIP) imaging technique has emerged as a suitable method for the characterization and the monitoring of hydrogeologic and biogeochemical processes. However, one of the major challenges refers to the resolution of the electrical images. Hence, various studies have stressed the importance of data processing, error characterization, and the deployment of adequate inversion schemes. A widely accepted method to assess data error in electrical imaging relies on the analysis of the discrepancy between normal and reciprocal measurements. Nevertheless, the collection of reciprocals doubles the acquisition time and is only viable for a limited subset of commonly used electrode configurations (e.g., dipole-dipole [DD]). To overcome these limitations, we have developed a new methodology to quantify the data error in TDIP imaging, which is entirely based on the analysis of the recorded IP decay curve and does not require recollection of data (e.g., reciprocals). The first two steps of the methodology assess the general characteristics of the decay curves and the spatial consistency of the measurements for the detection and removal of outliers. In the third and fourth steps, we quantify the deviation of the measured decay curves from a smooth model for the estimation of random error of the total chargeability and transfer resistance measurement. The error models and imaging results obtained from this methodology - in the following referred to as "decay curve analysis" - are compared with those obtained following a conventional normal-reciprocal analysis revealing consistent results. As a result, we determine the applicability of our methodology with real field data collected at the floodplain scale (approximately 12 ha) using multiple gradient and DD configurations.

58 GEOSCIENCES↗

Optimal PMU design based on sampling model and sensitivity analysis

The precise measurements of the synchrophasor and frequency from phasor measurement units (PMUs) are widely used in power grid applications. With the improvement of the technique, applications always require stable dynamic performance and higher accuracy for the synchrophasor and frequency measurements, which is challenging for PMU development. To evaluate the contribution of PMU hardware to measurement accuracy, this paper proposes a general-purpose sampling model to analyze the measurement error. In the proposed sampling model, a strict mathematical derivation is derived, where its error is purely determined by the parameters of the PMU hardware. The sensitivity analysis is carried out by three methods, including mathematical analysis, computer simulation, and variance-based sensitivity analysis. Through the sensitivity analysis, this paper establishes the systematic formulation and the inclusion of synchrophasor, frequency, and ROCOF. Experimental results based on the real-world testbench involving distribution-level PMUs match the mathematical analysis conclusion, which verifies the correctness of the general-purpose sampling model. Furthermore, a strategy for the optimal PMU design is proposed, which could guide PMU design in the future.

42 ENGINEERING↗

Baryon acoustic oscillation theory and modelling systematics for the DESI 2024 results

This paper provides a comprehensive overview of how fitting of baryon acoustic oscillations (BAO) is carried out within the upcoming Dark Energy Spectroscopic Instrument’s (DESI) 2024 results using its DR1 data set, and the associated systematic error budget from theory and modelling of the BAO. We derive new results showing how non-linearities in the clustering of galaxies can cause potential biases in measurements of the isotropic (⁠α iso ⁠) and anisotropic (⁠α ap ) BAO distance scales, and how these can be effectively removed with an appropriate choice of reconstruction algorithm. We then demonstrate how theory leads to a clear choice for how to model the BAO and develop, implement, and validate a new model for the remaining smooth-broad-band (i.e. without BAO) component of the galaxy clustering. Finally, we explore the impact of all remaining modelling choices on the BAO constraints from DESI using a suite of high-precision simulations, arriving at a set of best practices for DESI BAO fits, and an associated theory and modelling systematic error. Overall, our results demonstrate the remarkable robustness of the BAO to all our modelling choices and motivate a combined theory and modelling systematic error contribution to the post-reconstruction DESI BAO measurements of no more than 0.1 per cent (0.2 per cent) for its isotropic (anisotropic) distance measurements. We expect the theory and best practices laid out to here to be applicable to other BAO experiments in the era of DESI and beyond.

79 ASTRONOMY AND ASTROPHYSICS↗