Search NASA⌕ Search

SEARCH · Search NASA

Results for “error models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Resolving discrepancies in bang-time predictions for indirect-drive ICF experiments on the NIF: Insights from the Build-A-Hohlraum campaign

This study investigated discrepancies between measured and simulated x-ray drive in Indirect-Drive Inertial Confinement Fusion (ID-ICF) hohlraums at the National Ignition Facility. Despite advances in radiation-hydrodynamic simulations, a consistent “drive deficit” remains. Experimentally measured ID-ICF capsule bang-times are systematically 400–700 ps later than simulations predict. The Build-A-Hohlraum (BAH) campaign explored potential causes for this discrepancy by systematically varying hohlraum features, including laser entrance hole (LEH) windows, capsules, and gas fills. Overall, the agreement between simulated and experimental x-ray drive was found to be largely unaffected by these changes. The data allow us to exclude some hypotheses put forward to potentially explain the discrepancy. Errors in the local thermodynamic equilibrium (LTE) atomic modeling, errors in the modeling of LEH closure, and errors due to a lack of plasma species mix physics in simulations are shown to be inconsistent with our measurements. Instead, the data support the hypothesis that errors in NLTE emission modeling are a significant contributor to the discrepancy. X-ray emission in the 2–4 keV range is found to be approximately 30% lower than in simulations. This is accompanied by higher than predicted electron temperatures in the gold bubble region, pointing to errors in non-LTE modeling. Introducing an opacity multiplier of 0.87 on energy groups above 1.8 keV improves agreement with experimental data, reducing the bang-time discrepancy from 300 to 100 ps. These results underscore the need for refined NLTE opacity models to enhance the predictive power of hohlraum simulations.

Band emission↗

Initialized Earth system prediction from subseasonal to decadal timescales

Initialized Earth system predictions are made by starting a numerical prediction model in a state as consistent as possible to observations, and running it forward in time for up to ten years. Skillful predictions at time slices from subseasonal to seasonal (S2S), seasonal to interannual (S2I) and seasonal to decadal (S2D) offer information useful for various stakeholders, from agriculture to water resource management, and human and infrastructure safety. In this Review, we examine the processes influencing predictability, and discuss estimates of skill across S2S, S2I and S2D timescales. There are encouraging signs that skillful predictions can be made: at S2S timescales, there has been some skill in predicting the Madden-Julian Oscillation and North Atlantic Oscillation; at S2I in predicting the El Niño-Southern Oscillation; and at S2D, in predicting variability in North Atlantic sea surface temperatures. However, challenges remain, and future work must prioritise reducing model error, more effectively communicating forecasts to users, and increasing process and mechanistic understanding that could increase predictive skill and, in turn, confidence. As numerical models progress towards Earth system models, initialized predictions are expanding to include prediction of sea-ice, air pollution, terrestrial and ocean biochemistry which can bring clear benefit to society and various stakeholders.

climate prediction↗

Simulation of Wingtip Vortex Flows with Reynolds-Averaged Navier–Stokes and Scale-Resolving Simulation Methods

The simulation of wingtip vortex flows is reported on with Reynolds-averaged Navier–Stokes (RANS) equations and scale-resolving simulation (SRS) models. These range from turbulent viscosity and Reynolds-stress model (RSM) RANS closures, to hybrid and bridging SRS methods. The aim of the study was threefold: assess the relevance of replicating the experimental flow conditions, evaluate the numerical requisites of each mathematical model, and determine their modeling accuracy in prediction of a representative wingtip vortex flow. The selected problem is the flow around a NACA 0012 wing at 10 deg of angle of attack and Reynolds number of 4.60×10 6 . The results confirm the relevance of reproducing the experimental flow conditions, in particular at the inlet boundary where the flow is not uniform. For this reason, the evaluation of modeling errors using the available measurements requires the specification of the experimental inlet conditions. On the other hand, the quantification of the modeling error indicates that solely RANS–RSM can achieve an accurate representation of the flow dynamics. Whereas the well-recognized limitations of turbulent viscosity RANS closures to deal with solid-body rotation lead to the overprediction of turbulence and consequent rapid diffusion of the wingtip vortex, the predictive use of SRS methods may reveal excessively complex and demanding.

42 ENGINEERING↗

Molecular radiotherapy: The NUKFIT software for calculating the time-integrated activity coefficient

Purpose: Calculation of the time-integrated activity coefficient (residence time) is a crucial step in dosimetry for molecular radiotherapy. However, available software is deficient in that it is either not tailored for the use in molecular radiotherapy and/or does not include all required estimation methods. The aim of this work was therefore the development and programming of an algorithm which allows for an objective and reproducible determination of the time-integrated activity coefficient and its standard error.Methods: The algorithm includes the selection of a set of fitting functions from predefined sums of exponentials and the choice of an error model for the used data. To estimate the values of the adjustable parameters an objective function, depending on the data, the parameters of the error model, the fitting function and (if required and available) Bayesian information, is minimized. To increase reproducibility and user-friendliness the starting values are automatically determined using a combination of curve stripping and random search. Visual inspection, the coefficient of determination, the standard error of the fitted parameters, and the correlation matrix are provided to evaluate the quality of the fit. The functions which are most supported by the data are determined using the corrected Akaike information criterion. The time-integrated activity coefficient is estimated by analytically integrating the fitted functions. Its standard error is determined assuming Gaussian error propagation. The software was implemented using MATLAB.Results: To validate the proper implementation of the objective function and the fit functions, the results of NUKFIT and SAAM numerical, a commercially available software tool, were compared. The automatic search for starting values was successfully tested for reproducibility. The quality criteria applied in conjunction with the Akaike information criterion allowed the selection of suitable functions. Function fit parameters and their standard error estimated by using SAAM numerical and NUKFIT showed differences of <1%. The differences for the time-integrated activity coefficients were also <1% (standard error between 0.4% and 3%). In general, the application of the software is user-friendly and the results are mathematically correct and reproducible. An application of NUKFIT is presented for three different clinical examples.Conclusions: The software tool with its underlying methodology can be employed to objectively and reproducibly estimate the time integrated activity coefficient and its standard error for most time activity data in molecular radiotherapy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Comprehensive Modeling of Temperature-Dependent Degradation Mechanisms in Lithium Iron Phosphate Batteries

For reliable lifetime predictions of lithium-ion batteries, models for cell degradation are required. A comprehensive semi-empirical model based on a reduced set of internal cell parameters and physically justified degradation functions for the capacity loss is developed and presented for a commercial lithium iron phosphate/graphite cell. One calendar and several cycle aging effects are modeled separately. Emphasis is placed on the varying degradation at different temperatures. Degradation mechanisms for cycle aging at high and low temperatures as well as the increased cycling degradation at high state of charge are calculated separately. For parameterization, a lifetime test study is conducted including storage and cycle tests. Additionally, the model is validated through a dynamic current profile based on real-world application in a stationary energy storage system revealing the accuracy. Tests for validation are continued for up to 114 days after the longest parametrization tests. In conclusion, the model error for the cell capacity loss in the application-based tests is at the end of testing below 1% of the original cell capacity and the maximum relative model error is below 21%.

25 ENERGY STORAGE↗

Statistical Modeling of CTV Motion and Deformation for IMRT of Early-Stage Rectal Cancer

Purpose: To derive and validate a statistical model of motion and deformation for the clinical target volume (CTV) of early-stage rectal cancer patients. Methods and Materials: For 16 patients, 4 to 5 magnetic resonance images (MRI) were acquired before each fraction was administered. The CTV was delineated on each MRI. Using a leave-one-out methodology, we constructed a population-based principal component analysis (PCA) model of the CTV motion and deformation of 15 patients, and we tested the model on the left-out patient. The modeling error was calculated as the amount of the CTV motion-deformation of the left-out-patient that could not be explained by the PCA model. Next, the PCA model was used to construct a PCA target volume (PCA-TV) by accumulating motion-deformations simulated by the model. A PCA planning target volume (PTV) was generated by expanding the PCA-TV by uniform margins. The PCA-PTV was compared with uniform and nonuniform CTV-to-PTV margins. To allow comparison, geometric margins were determined to ensure adequate coverage, and the volume difference between the PTV and the daily CTV (CTV-to-PTV volume) was calculated. Results: The modeling error ranged from 0.9 ± 0.5 to 2.9 ± 2.1 mm, corresponding to a reduction of the CTV motion-deformation between 6% and 60% (average, 23% ± 11%). The reduction correlated with the magnitude of the CTV motion-deformation (P<.001, R=0.66). The PCA-TV and the CTV required 2-mm and 7-mm uniform margins, respectively. The nonuniform CTV-to-PTV margins were 4 mm in the left, right, inferior, superior, and posterior directions and 8 mm in the anterior direction. Compared to uniform and nonuniform CTV-to-PTV margins, the PCA-based PTV significantly decreased (P<.001) the average CTV-to-PTV volume by 128 ± 20 mL (49% ± 4%) and by 35 ± 6 mL (20% ± 3.5%), respectively. Conclusions: The CTV motion-deformation of a new patient can be explained by a population-based PCA model. A PCA model-generated PTV significantly improved sparing of organs at risk compared to uniform and nonuniform CTV-to-PTV margins.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Assessment of Model Hub Height Wind Speed Performance Using DOE Lidar Buoy Data

As the offshore wind industry continues to gain momentum both in the U.S. and globally, reanalysis products remain essential tools for the lifecycle of a wind farm. From project siting and production estimates to determining construction and maintenance windows, reanalysis products play an important role. These regional and global long-term models also serve as inputs to higher resolution models. With such wide-ranging impacts on the offshore wind industry, the need for validation of reanalysis products is strong, particularly at typical turbine hub heights. Pacific Northwest National Laboratory (PNNL) operates two AXYS WindSentinelTM buoys for the U.S. Department of Energy (DOE) in order to collect meteorological and oceanographic data, including hub height wind speed, in areas of interest for offshore wind development. This work uses DOE buoy observations off the coasts of New Jersey and Virginia to evaluate the performance of Modern Era Retrospective Analysis for Research and Applications-2 (MERRA-2), the North American Regional Reanalysis (NARR), the European Center for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5th generation (ERA5), and the National Oceanic and Atmospheric Administration (NOAA) assimilation system Rapid Refresh (RAP). Biases and degrees of correspondence are determined for each reanalysis product in order to provide insights on the performance and uncertainty for long-term wind resource characterization. With the baseline metrics determined, this work proceeds with an investigation into the sources of large deviations between the modeled and observed hub height wind speeds during the East Coast lidar buoy deployments. Consistent sources of reanalysis model error include stably stratified flow conditions, high wind shear, flow parallel to the coastline, and tropical and winter storms. For the near shore New Jersey location, offshore winds (i.e. blowing from land to water) tend to be associated with model overestimation of observed hub height wind speed, while winds parallel to the coastline are correlated with model underestimation of wind speed. Similarly, near the Virginia buoy, during southerly winds (parallel to the coastline) models underestimate the observed wind speed due to coastal upwelling. Reanalysis model wind speeds underestimate the hub height winds with increasing stable atmospheric stratification. Reanalysis model biases are seen when the observed wind speeds approach or exceed typical turbine cut-out speeds (around 20 m s-1). Large model errors during winter and tropical storm events, high wind speed events, and ramp events are often the result of wind speed timing and magnitude offsets. Overall, ERA5 provides the most successful representation of observed offshore hub height wind speeds at the U.S. East Coast buoy locations and is therefore best suited as an input boundary condition for model case studies. ERA5 performs well for a variety of atmospheric phenomena, including storms and sea breezes, however RAP, the next most successful reanalysis model, performs best in capturing the frequency of ramp events.

17 WIND ENERGY↗

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗

Error quantification of the Arrhenius blending rule for viscosity of hydrocarbon mixtures

Six hundred and seventy-five measurements of dynamic viscosity and density have been used to assess the prediction error of the Arrhenius blending rule for kinematic viscosity of hydrocarbon mixtures. Major trends within the data show that mixture complexity–binary to hundreds of components—and temperature are more important determinants of prediction error than differences in molecular size or hydrogen saturation between the components of the mixtures. Over the range evaluated, no correlation between prediction error and mole fractions was observed, suggesting the log of viscosity truly is linear in mole fraction, as indicated by the Arrhenius blending rule. Mixture complexity and temperature also impact molar volume and its prediction. However, a linear regression between the two model errors explains less than 20% of the observed variation, indicating that mixture viscosity and/or molar volume are not linear with respect to temperature and/or mixture complexity. Extensive discussion of the intermolecular forces and the geometric arrangement of molecules and vacancies in liquids, which ultimately determines its viscosity, is brought into context with the implicit approximations behind the Arrhenius blending rule. The complexity of this physics is not compatible with a simple algebraic correction to the model. However, sufficient data is now available to determine confidence intervals around the prediction of fuel viscosity based on its component mole fractions and viscosities. At -40°C, when all identified components are pure molecules the modeling error is 13.2% of the predicted (nominal) viscosity times the root mean square of the component mole fractions.

10 SYNTHETIC FUELS↗

Analyzing rotational bands in odd-mass nuclei using effective field theory and Bayesian methods

We recently developed an Effective Field Theory (EFT) for rotational bands in odd-mass nuclei. Here we use EFT expressions to perform a Bayesian analysis of data on the rotational energy levels of 99 Tc, 155,157 Gd, 159 Dy, 167,169 Er, 167,169 Tm, 183 W, 235 U and 239 Pu. The error model in our Bayesian analysis includes both experimental and EFT truncation uncertainties. It also accounts for the fact that low-energy constants (LECs) at even and odd orders are expected to have different sizes. We use Markov Chain Monte Carlo (MCMC) sampling to explore the joint posterior of the EFT and error-model parameters and show both the LECs and the breakdown scale can be reliably determined. We extract the LECs up to fourth order in the EFT and find that, provided we correctly account for EFT truncation errors in our likelihood, results for lower-order LECs are stable as we go to higher orders. LEC results are also stable with respect to the addition of higher-energy data. We extract the expansion parameter for all the nuclei listed above and find a clear correlation between the extracted and the expected value of the inverse breakdown scale, W, based on the single-particle and vibrational energy scales. However, the W that actually determines the convergence of the EFT expansion is markedly smaller than would be naively expected based on those scales.

EFT↗

Inverse model based error detection in beamline optics

Optics tuning in transfer lines and LINACs can be challenging due to the fact that multiple combinations of machine settings can lead to the same diagnostic output. Moreover, the lack of a periodic solution can limit the ability to infer optics in the same way as rings from BPM signals. Model based approaches are often used to assist with the optics tuning in combination with optimization or parameter estimation. Here we have developed a novel approach using machine learning inverse models trained on a known configuration to detect variations in quadrupole settings without explicitly including them in the model. This paper shows a comparison of neural network models and linear models on both a simulation based study and experimental studies conducted at the AGS to RHIC transfer line at Brookhaven National Lab.

43 PARTICLE ACCELERATORS↗

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗

Hybrid approach for estimating dynamic states of synchronous generators

Accurate and robust estimation of dynamic states is essential for monitoring and controlling a power grid. To achieve higher accuracy and robustness, this paper proposes a hybrid estimation approach to estimate the dynamic states of synchronous generators using multiple models, classified into a set of local models and a wide-area model. The proposed estimation approach, first, estimates dynamic states using the extended Kalman filter (EKF) based on a local model and a wide-area model. Then, at each time step, probability indexes, which quantify the likelihood of both local and wide-area models, are determined using hypothesis testing based on measurements innovations. Finally, using the weighted fix approach, the states estimated from the local and wide-area models are combined based on their probability indexes. Simulation studies using the two-area four-machine system shows that the proposed approach can improve estimation accuracy and increase robustness against model errors.

Akhlaghi, Shahrokh↗

Bayesian calibration of the Community Land Model using surrogates

We present results from the Bayesian calibration of hydrological parameters of the Community Land Model (CLM), which is often used in climate simulations and Earth system models. A statistical inverse problem is formulated for three hydrological parameters, conditional on observations of latent heat surface fluxes over 48 months. Our calibration method uses polynomial and Gaussian process surrogates of the CLM, and solves the parameter estimation problem using a Markov chain Monte Carlo sampler. Posterior probability densities for the parameters are developed for two sites with different soil and vegetation covers. Our method also allows us to examine the structural error in CLM under two error models. We find that surrogate models can be created for CLM in most cases. The posterior distributions are more predictive than the default parameter values in CLM. Climatologically averaging the observations does not modify the parameters' distributions significantly. The structural error model reveals a correlation time-scale which can be used to identify the physical process that could be contributing to it. While the calibrated CLM has a higher predictive skill, the calibration is under-dispersive.

54 ENVIRONMENTAL SCIENCES↗

A cloud computing approach to massively-parallel distributed stochastic optimization with application to geomechanical reservoir characterization

Many search strategies used to optimize parameters during hydrologic model calibration are inherently limited in that simulations must be performed sequentially in order for the algorithm to converge. As a result, the overall time required to reach a solution increases linearly with the number of steps necessary. In contrast, sampling strategies that attempt to approximate the posterior distribution of the parameters do not require the model simulations to be run in sequence and therefore invite the use of a massively parallel approach across heterogeneous computing environments. We apply a cloud computing methodology to this problem where a head node running on Amazon Web Services continuously produces candidate models that are distributed to arbitrary compute environments to run the simulation, in our case Clemson’s Palmetto cluster computer. Thus the time required to obtain a sufficient number of samples to produce an adequate approximation of the posterior distribution of the parameters is limited by the number of available compute sites. Monte Carlo sampling of the posterior space would be duplicative and inefficient, thus we combine Latin hypercube methods with genetic algorithms to ensure that no large regions of the parameter space are left unexplored, and that high probability regions are investigated thoroughly. We independently assess the fit to different types of data sets without the need to construct a single objective function. Sets of Pareto optimal models are particularly valuable when the quality and information content of data is poorly known or conceptual model errors exist in our simulation. We illustrate our approach for a problem where in situ strain data are used to calibrate the parameters of an oil reservoir in the Avant oil field in Oklahoma. We use well injection and shut-in to stress a deep (500m) confined formation, and observe the geomechanical response using borehole strainmeters installed in the shallow subsurface (30m). These data were then used to calibrate the poroelastic properties of the reservoir and caprock along with the geometry of an elliptic channel associated with the formation. Using our approach we are able to identify issues with model error as well as substantial tradeoffs that occur within the parameters.

inversion, stochastic, geomechanics, poroelastic, ↗

Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier–Stokes simulations: A data-driven, physics-informed Bayesian approach

Despite their well-known limitations, Reynolds-Averaged Navier–Stokes (RANS) models are still the workhorse tools for turbulent flow simulations in today's engineering analysis, design and optimization. While the predictive capability of RANS models depends on many factors, for many practical flows the turbulence models are by far the largest source of uncertainty. As RANS models are used in the design and safety evaluation of many mission-critical systems such as airplanes and nuclear power plants, quantifying their model-form uncertainties has significant implications in enabling risk-informed decision-making. In this work we develop a data-driven, physics-informed Bayesian framework for quantifying model-form uncertainties in RANS simulations. Uncertainties are introduced directly to the Reynolds stresses and are represented with compact parameterization accounting for empirical prior knowledge and physical constraints (e.g., realizability, smoothness, and symmetry). An iterative ensemble Kalman method is used to assimilate the prior knowledge and observation data in a Bayesian framework, and to propagate them to posterior distributions of velocities and other Quantities of Interest (QoIs). We use two representative cases, the flow over periodic hills and the flow in a square duct, to evaluate the performance of the proposed framework. Both cases are challenging for standard RANS turbulence models. Simulation results suggest that, even with very sparse observations, the obtained posterior mean velocities and other QoIs have significantly better agreement with the benchmark data compared to the baseline results. At most locations the posterior distribution adequately captures the true model error within the developed model form uncertainty bounds. The framework is a major improvement over existing black-box, physics-neutral methods for model-form uncertainty quantification, where prior knowledge and details of the models are not exploited. This approach has potential implications in many fields in which the governing equations are well understood but the model uncertainty comes from unresolved physical processes. - Highlights: • Proposed a physics–informed framework to quantify uncertainty in RANS simulations. • Framework incorporates physical prior knowledge and observation data. • Based on a rigorous Bayesian framework yet fully utilizes physical model. • Applicable for many complex physical systems beyond turbulent flows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DQ Solutions of a Vibrating Membrane Model: An Error Analysis

In order to investigate the possible application of the quadrature rules to a problem in the three-dimensional space-time domain, an error analysis is here performed. Some considerations about the error function confirm the conditional stability of the method and the necessity of a suitable distribution to contain the errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗