Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

A practical field guide to thermoelectrics: Fundamentals, synthesis, and characterization

The study of thermoelectric materials spans condensed matter physics, materials science and engineering, and solid-state chemistry. The diversity of the participants and the inherent complexity of the topic mean that it is difficult, if not impossible, for a researcher to be fluent in all aspects of the field. This review, which grew out of a one-week summer school for graduate students, aims to provide an introduction and practical guidance for selected conceptual, synthetic, and characterization approaches and to craft a common umbrella of language, theory, and experimental practice for those engaged in the field of thermoelectric materials. This review does not attempt to cover all major aspects of thermoelectric materials research or review state-of-the-art thermoelectric materials. Rather, the topics discussed herein reflect the expertise and experience of the authors. We begin by discussing a universal approach to modeling electronic transport using Landauer theory. The core sections of the review are focused on bulk inorganic materials and include a discussion of effective strategies for powder and single crystal synthesis, the use of national synchrotron sources to characterize crystalline materials, error analysis, and modeling of transport data using an effective mass model, and characterization of phonon behavior using inelastic neutron scattering and ultrasonic speed of sound measurements. The final core section discusses the challenges faced when synthesizing carbon-based samples and the measuring or interpretation of their transport properties. We conclude this review with a brief discussion of some of the grand challenges and opportunities that remain to be addressed in the study of thermoelectrics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evaluation of a multi-scale WRF-CAM5 simulation during the 2010 East Asian Summer Monsoon

The Weather Research and Forecasting model with Chemistry (WRF-Chem) with the physics package of the Community Atmosphere Model Version 5 (CAM5) has been applied at multiple scales over Eastern China (EC) and the Yangtze River Delta (YRD) to evaluate how increased horizontal resolution with physics designed for a coarser resolution climate model impacts aerosols and clouds, and the resulting precipitation characteristics and performance during the 2010 East Asian Summer Monsoon (EASM). Despite large underpredictions in surface aerosol concentrations and aerosol optical depth, there is good spatial agreement with surface observations of chemical predictions, and increasing spatial resolution tends to improve performance. Model bias and normalized root mean square values for precipitation predictions are relatively small, but there are significant differences when comparing modeled and observed probability density functions for precipitation in EC and YRD. Increasing model horizontal resolution tends to reduce model bias and error for precipitation predictions. The surface and column aerosol loading is maximized between about 32N and 42N in early to mid-May during the 2010 EASM, and then shifts north while decreasing in magnitude during July and August. Changing model resolution moderately changes the spatiotemporal relationships between aerosols, cloud properties, and precipitation during the EASM, thus demonstrating the importance of model grid resolution in simulating EASM circulation and rainfall patterns over EC and the YRD. Results from this work demonstrate the capability and limitations in the aerosol, cloud, and precipitation representation of WRF-CAM5 for regional-scale applications down to relatively fine horizontal resolutions. Further WRF-CAM5 model development and application in this area is needed.

Campbell, Patrick↗

Generalization error guaranteed auto-encoder-based nonlinear model reduction for operator learning

Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from empirical data, which is challenging due to the infinite or high dimensionality of data. An integral component in addressing this challenge is model reduction, which reduces both the data dimensionality and problem size. In this paper, we utilize low-dimensional nonlinear structures in model reduction by investigating Auto-Encoder-based Neural Network (AENet). AENet first learns the latent variables of the input data and then learns the transformation from these latent variables to corresponding output data. Our numerical experiments validate the ability of AENet to accurately learn the solution operator of nonlinear partial differential equations. Furthermore, we establish a mathematical and statistical estimation theory that analyzes the generalization error of AENet. Finally, our theoretical framework shows that the sample complexity of training AENet is intricately tied to the intrinsic dimension of the modeled process, while also demonstrating the robustness of AENet to noise.

Auto-encoder↗

Closing in on Hydrologic Predictive Accuracy: Combining the Strengths of High-Fidelity and Physics-Agnostic Models

Applications of process-based models (PBM) for predictions are confounded by multiple uncertainties and computational burdens, resulting in appreciable errors. A novel modeling framework combining a high-fidelity PBM with surrogate and machine learning (ML) models is developed to tackle these challenges and applied for streamflow prediction. A surrogate model permits high computational efficiency of a PBM solution at a minimum loss of its accuracy. A novel probabilistic ML model partitions the PBM-surrogate prediction errors into reducible and irreducible types, quantifying their distributions that arise due to both explicitly perceived uncertainties (such as parametric) or those that are entirely hidden to the modeler (not included or unexpected). Using this approach, we demonstrate a substantial improvement of streamflow predictive accuracy for a case study urbanized watershed. Such a framework provides an efficient solution combining the strengths of high-fidelity and physics-agnostic models for a wide range of prediction problems in geosciences.

58 GEOSCIENCES↗

Benchmarking quantum logic operations relative to thresholds for fault tolerance

Contemporary methods for benchmarking noisy quantum processors typically measure average error rates or process infidelities. However, thresholds for fault-tolerant quantum error correction are given in terms of worst-case error rates—defined via the diamond norm—which can differ from average error rates by orders of magnitude. One method for resolving this discrepancy is to randomize the physical implementation of quantum gates, using techniques like randomized compiling (RC). In this work, we use gate set tomography to perform precision characterization of a set of two-qubit logic gates to study RC on a superconducting quantum processor. We find that, under RC, gate errors are accurately described by a stochastic Pauli noise model without coherent errors, and that spatially correlated coherent errors and non-Markovian errors are strongly suppressed. We further show that the average and worst-case error rates are equal for randomly compiled gates, and measure a maximum worst-case error of 0.0197(3) for our gate set. Our results show that randomized benchmarks are a viable route to both verifying that a quantum processor’s error rates are below a fault-tolerance threshold, and to bounding the failure rates of near-term algorithms, if—and only if—gates are implemented via randomization methods which tailor noise.

97 MATHEMATICS AND COMPUTING↗

TU-F-17A-03: An Analytical Respiratory Perturbation Model for Lung Motion Prediction

Purpose: Breathing irregularity is common, causing unreliable prediction in tumor motion for correlation-based surrogates. Both tidal volume (TV) and breathing pattern (BP=ΔVthorax/TV, where TV=ΔVthorax+ΔVabdomen) affect lung motion in anterior-posterior and superior-inferior directions. We developed a novel respiratory motion perturbation (RMP) model in analytical form to account for changes in TV and BP in motion prediction from simulation to treatment. Methods: The RMP model is an analytical function of patient-specific anatomic and physiologic parameters. It contains a base-motion trajectory d(x,y,z) derived from a 4-dimensional computed tomography (4DCT) at simulation and a perturbation term Δd(ΔTV,ΔBP) accounting for deviation at treatment from simulation. The perturbation is dependent on tumor-specific location and patient-specific anatomy. Eleven patients with simulation and treatment 4DCT images were used to assess the RMP method in motion prediction from 4DCT1 to 4DCT2, and vice versa. For each patient, ten motion trajectories of corresponding points in the lower lobes were measured in both 4DCTs: one served as the base-motion trajectory and the other as the ground truth for comparison. In total, 220 motion trajectory predictions were assessed. The motion discrepancy between two 4DCTs for each patient served as a control. An established 5D motion model was used for comparison. Results: The average absolute error of RMP model prediction in superior-inferior direction is 1.6±1.8 mm, similar to 1.7±1.6 mm from the 5D model (p=0.98). Some uncertainty is associated with limited spatial resolution (2.5mm slice thickness) and temporal resolution (10-phases). Non-corrected motion discrepancy between two 4DCTs is 2.6±2.7mm, with the maximum of ±20mm, and correction is necessary (p=0.01). Conclusion: The analytical motion model predicts lung motion with accuracy similar to the 5D model. The analytical model is based on physical relationships, requires no training, and therefore is potentially more resilient to breathing irregularities. On-going investigation introduces airflow into the RMP model for improvement. This research is in part supported by NIH (U54CA137788/132378). AY would like to thank MSKCC summer medical student research program supported by National Cancer Institute and hosted by Department of Medical Physics at MSKCC.

60 APPLIED LIFE SCIENCES↗

Fusion RF Modeling Machine Learning (FusionML_RF) v1.0

FusionML_RF consists of multiple codes and trained machine learning (ML) models that perform low-cost output modeling from the Genray-CQL3D. Three machine learning techniques (multilayer perceptron, random forest, and Gaussian process) provide fast surrogate models for lower hybrid current drive (LHCD) simulations. For example, completing a single GENRAY/CQL3D simulation without radial diffusion of fast electrons requires several minutes of wall-clock time. On the other hand, these ML models achieve ~ms of inference time with high accuracy across the input parameter space. This software collection consists of multiple components. (1) codes that use ML methods and precomputed Genray-CQL3D simulation output to build regression models that enable approximate computations of Genray-CLQ3D outputs from arbitrary but physically meaningful input parameters (surrogate modeling); (2) three trained models created by the team, using a database of 16,000+ GENRAY/CQL3D simulations, to study the performance of ML models for surrogate modeling; (3) codes that load the trained models and simulation data, and then compute mean squared error between the models' predictions and the ground truth of simulation output data. This collection is being made available in conjunction with a scientific publication about the work to promote reusability and provide an artifact of the scientific work.

Bai, Zhe↗

Adaptive Determination of the Optimal Exchange Location in Wall-Modeled Large-Eddy Simulation

Wall-modeled large-eddy simulation introduces a modeling interface (or exchange location) separating the wall-modeled layer from the rest of the domain. The current state-of-the-art is to rely on user expertise when choosing where to place this modeling interface, whether this choice is tied to the grid or not. This paper presents a postprocessing algorithm that determines the exchange location systematically. The algorithm is based on a model for the error in the predicted wall shear stress and a model for the computational cost, and then finds the exchange location that minimizes a combination of the two. Here, the algorithm is tested both a priori and a posteriori using an equilibrium wall model for the flow over a wall-mounted hump, a boundary layer in an adverse pressure gradient, and a shock/boundary-layer interaction. The algorithm produces exchange locations that mostly agree with what an experienced user would suggest, with thinner wall-modeled layers in nonequilibrium flow regions and thicker wall-modeled layers where the boundary layer is closer to equilibrium. This suggests that the algorithm should be useful in simulations of realistic and highly complex geometries.

42 ENGINEERING↗

Validation of mathematical models for the prediction of organs-at-risk dosimetric metrics in high-dose-rate gynecologic interstitial brachytherapy

Purpose: Given the complicated nature of an interstitial gynecologic brachytherapy treatment plan, the use of a quantitative tool to evaluate the quality of the achieved metrics compared to clinical practice would be advantageous. For this purpose, predictive mathematical models to predict the D{sub 2cc} of rectum and bladder in interstitial gynecologic brachytherapy are discussed and validated.Methods: Previous plans were used to establish the relationship between D2cc and the overlapping volume of the organ at risk with the targeted area (C0) or a 1-cm expansion of the target area (C1). Three mathematical models were evaluated: D{sub 2cc}=α*C{sub 1}+β (LIN); D{sub 2cc}=α– exp(–β*C{sub 0}) (EXP); and a mixed approach (MIX), where both C{sub 0} and C{sub 1} were inputs of the model. The parameters of the models were optimized on a training set of patient data, and the predictive error of each model (predicted D{sub 2cc}− real D{sub 2cc}) was calculated on a validation set of patient data. The data of 20 patients were used to perform a K-fold cross validation analysis, with K = 2, 4, 6, 8, 10, and 20.Results: MIX was associated with the smallest mean prediction error <6.4% for an 18-patient training set; LIN had an error <8.5%; EXP had an error <8.3%. Best case scenario analysis shows that an error ≤5% can be achieved for a ten-patient training set with MIX, an error ≤7.4% for LIN, and an error ≤6.9% for EXP. The error decreases with the increase in training set size, with the most marked decrease observed for MIX.Conclusions: The MIX model can predict the D{sub 2cc} of the organs at risk with an error lower than 5% with a training set of ten patients or greater. The model can be used in the development of quality assurance tools to identify treatment plans with suboptimal sparing of the organs at risk. It can also be used to improve preplanning and in the development of real-time intraoperative planning tools.

61 RADIATION PROTECTION AND DOSIMETRY↗

Toward Predictive RANS and SRS Computations of Turbulent External Flows of Practical Interest

In this work, we investigate the main challenges to prediction of turbulent external flows of practical interest with Reynolds-Averaged Navier–Stokes equations (RANS) and Scale-Resolving Simulation (SRS) models. This represents a crucial step toward further developing and establishing these formulations so they can be confidently utilized in engineering problems without reference data. The study initiates by identifying the major challenges to prediction. A literature review is performed to illustrate their effects in RANS and SRS computations. Afterward, we evaluate the impact of the challenges to prediction by analyzing representative statistically steady and unsteady flows with prominent RANS and SRS methods. These include multiple turbulent viscosity and second-moment RANS closures, and hybrid and bridging SRS models. The results demonstrate the potential of the selected SRS models to predict engineering flows. Yet, they also show the importance of considering the challenges to prediction during the setup and conduction of numerical experiments. These can suppress the advantages of using SRS formulations. The data also indicate that only SRS models can confidently predict statistically unsteady flows. In contrast, the results demonstrate that mean-flow quantities of statistically steady flows can be efficiently calculated with RANS closures, especially second-moment closures. Among the selected SRS methods, bridging models reveal better suited for prediction due to their ability to prevent commutation errors and enable the robust evaluation of numerical and modeling errors. This last property allows the use of a new validation technique that does not require reference data.

42 ENGINEERING↗

A simple model based magnet sorting algorithm for planar hybrid undulators

Various magnet sorting strategies have been used to optimize undulator performance, ranging from intuitive pairing of high- and low-strength magnets, to full 3D FEM simulation with 3-axis Helmholtz coil magnet data. In the extreme, swapping magnets in a full field model to minimize trajectory wander and rms phase error can be time consuming. This paper presents a simpler approach, extending the field error signature concept to obtain trajectory displacement, kick angle and phase error signatures for each component of magnetization error from a Radia model of a short hybrid-PM undulator. We demonstrate that steering errors and phase errors are essentially decoupled and scalable from measured X, Y and Z components of magnetization. Then, for any given sequence of magnets, rms trajectory and phase errors are obtained from simple cumulative sums of the scaled displacements and phase errors. The cost function (a weighted sum of these errors) is then minimized by swapping magnets, using one's favorite optimization algorithm. This approach was applied recently at NSLS to a short in-vacuum undulator, which required no subsequent trajectory or phase shimming. Trajectory and phase signatures are also obtained for some mechanical errors, to guide 'virtual shimming' and specifying mechanical tolerances. Some simple inhomogeneities are modeled to assess their error contributions.

43 PARTICLE ACCELERATORS↗

Model-based approach to investigate equipment-induced error in pressure-waveform derived hemodynamic measurements

Advanced hemodynamic monitoring systems have provided less invasive methods for estimating pressure-derived measurements such as pressure-derived cardiac output (CO) measurements. These devices apply algorithms to arterial pressure waveforms recorded via pressure recording components that transmit the pressure signal to a pressure monitor. While standards have been developed for pressure monitoring equipment, it is unclear how the equipment-induced error can affect secondary measurements from pressure waveforms. We propose an approach for modelling different components of a pressure monitoring system and use this model-based approach to investigate the effect of different pressure recording configurations on pressure-derived hemodynamic measurements. The proposed model-based approach is a three-step process. (1) Modelling the response of pressure recording components using bench tests; (2) verifying the identified models through nonparametric equivalence tests; and (3) assessing the effects of pressure recording components on pressure-derived measurements. To delineate the application of this approach, we performed a series of model-based analyses to quantify the combined effect of a wide range of tubing configurations with various damping ratios and natural frequencies and monitors with different bandwidths on pressure waveforms and CO measurements by six pulse contour algorithms. Model-based results show the error in pressure-derived CO measurements because of tubing configurations with different natural frequencies and damping ratios. Tubing configurations with low natural frequencies (<23 Hz) altered characteristics of pressure waveforms in a way that affected the CO measurement, some by as much as 20%. Our method can serve as a tool to quantify the performance of pressure recording systems with different dynamic properties. In conclusion, this approach can be applied to investigate the effects of physiologic signal recording configurations on various pressure-derived hemodynamic measurements.

42 ENGINEERING↗

Modeling energy balance while correcting for measurement error via free knot splines

Measurements of energy balance components (energy intake, energy expenditure, changes in energy stores) are often plagued with measurement error. Doubly-labeled water can measure energy intake (EI) with negligible error, but is expensive and cumbersome. An alternative approach that is gaining popularity is to use the energy balance principle, by measuring energy expenditure (EE) and change in energy stores (ES) and then back-calculate EI. Gold standard methods for EE and ES exist and are known to give accurate measurements, albeit at a high cost. We propose a joint statistical model to assess the measurement error in cheaper, non-intrusive measures of EE and ES. We let the unknown true EE and ES for individuals be latent variables, and model them using a bivariate distribution. We try both a bivariate Normal as well as a Dirichlet Process Mixture Model, and compare the results via simulation. Our approach, is the first to account for the dependencies that exist in individuals’ daily EE and ES. We employ semiparametric regression with free knot splines for measurements with error, and linear components for error free covariates. We adopt a Bayesian approach to estimation and inference and use Reversible Jump Markov Chain Monte Carlo to generate draws from the posterior distribution. Based on the semiparameteric regression, we develop a calibration equation that adjusts a cheaper, less reliable estimate, closer to the true value. Along with this calibrated value, our method also gives credible intervals to assess uncertainty. A simulation study shows our calibration helps produce a more accurate estimate. Furthermore, our approach compares favorably in terms of prediction to other commonly used models.

60 APPLIED LIFE SCIENCES↗

Introduction to CAUSES: Description of weather and climate models and their near-surface temperature errors in 5-day hindcasts near the Southern Great Plains

We introduce the Clouds Above the United States and Errors at the Surface (CAUSES) project with its aim of better understanding the physical processes leading to warm screen-temperature biases over the American Midwest in many numerical models. In this first of four companion papers, 11 different models, from 9 institutes, perform a series of 5-day hindcasts, each initialised from reanalyses. After describing the common experimental protocol and detailing each model configuration, a gridded temperature data set is derived from observations and used to show that all the models have a warm bias over parts of the Midwest. Additionally, a strong diurnal cycle in the screen-temperature bias is found in most models. In some models the bias is largest around midday, while in others it is largest during the night. At the Department of Energy Atmospheric Radiation Measurement Southern Great Plains (SGP) site, the model biases are shown to extend several kilometers into the atmosphere. Finally, to provide context for the companion papers, in which observations from the SGP site are used to evaluate the different processes contributing to errors there, it is shown that there are numerous locations across the Midwest where the diurnal cycle of the error is highly correlated with the diurnal cycle of the error at SGP. This suggests that conclusions drawn from detailed evaluation of models using instruments located at SGP will be representative of errors that are prevalent over a larger spatial scale.

54 ENVIRONMENTAL SCIENCES↗

Parameter uncertainties for imperfect surrogate models in the low-noise regime

Abstract Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, this loss ignores model form error, or misspecification, meaning parameter uncertainties are significantly underestimated and vanish in the large data limit. As misspecification is the main source of uncertainty for surrogate models of low-noise calculations, such as those arising in atomistic simulation, predictive uncertainties are systematically underestimated. We analyze the true generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show that posterior parameter distributions must cover every training point to avoid a divergence in the generalization error and design a compatible ansatz which incurs minimal overhead for linear models. The approach is demonstrated on model problems before application to thousand-dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors in terms of parameter uncertainties, allowing this important source of uncertainty to be incorporated in multi-scale computational workflows.

Swinburne, Thomas D. (ORCID:0000000232554257)↗

An Investigation of Time Distributions for Task Primitives to Support the HUNTER Dynamic Human Reliability Analysis

As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.

99 GENERAL AND MISCELLANEOUS↗

Material Model Parameters Optimization in Liquid Mercury Target Dynamics Simulation With Machine Learning Surrogates

A pulsed spallation target is subjected to very short (∼0.7μs) but intense loads (23.3 kJ) from repeated proton pulses, which knock away neutrons from the mercury atoms’ nuclei for a wide range application in physics, engineering, medicine, petroleum exploration, biology, chemistry, etc. The effect of this pulsed loading on the stainless-steel target module which contains the flowing mercury target material is difficult to predict not only due to its short but intense explosive-like physical reaction, but also the nonlinear material behavior of the liquid mercury in the structure. Injecting small helium bubbles in the mercury has been an efficient method of mitigating the pressure wave at high power level stage. However, prediction of the resultant loading on the target is more difficult when helium gas is intentionally injected into the mercury. A 2-phase material model that incorporates the Rayleigh-Plesset (R-P) model is expected to address this complex multi-physics dynamics problem by including the bubble dynamics in the liquid mercury. A parameter sensitivity study was firstly employed to understand their impact on the simulation strains. The investigated parameters included E, μ, γ, σ, n, VFgas, and gas cumulative volume curve control parameters a and b. Verification and validation results from sparse polynomial expansions (SPE) method and directional Gaussian smoothing (DGS) optimization show that the surrogate model had training error of ∼7% and validation error of ∼15%, indicating that machine learning methods and surrogate models can help optimize the uncertain parameters in the complex 2-phase material model. This approach is expected to fill the knowledge gap between unknown liquid-gas mixture material model and measured vessel strain responses.

Lin, Lianshan↗

The Q{sub weak} Experiment at Jefferson Lab--A Search for New Physics at the TeV Scale

The Q{sub weak} collaboration will make the first precision determination of the proton's weak charge, Q{sub W}{sup P} = 1-4 sin{sup 2} {theta}{sub w}, from a measurement of the parity-violating asymmetry in elastic electron-proton scattering at very low momentum transfer. The results will determine the proton's weak charge with a 4% total error. The Standard Model makes a firm prediction of Q{sub W}{sup P}, based on the running of the weak mixing angle, sin{sup 2} {theta}{sub w}, from the Z{sup 0} pole down to low energies, corresponding to a 10{sigma} effect in this experiment. Any significant deviation of sin{sup 2} {theta}{sub w} from the Standard Model prediction at low Q{sup 2} would be a signal of new physics, wheras agreement would place new and significant constraints on possible Standard Model extensions at the TeV mass scale.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗