SEARCH · Search NASA

Results for “numerical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

All sources NASA NTRS DOE OSTI

NASA NTRS2019

Multilevel Monte Carlo Estimation of Unbiased Expectation via Sample Reuse and the Low Variance Estimation of Asymptotic Rates

A new variant of the multilevel Monte Carlo estimator [5, 3, 9, 12] is presented for the estimation of expectation statistics that utilizes sample reuse in specified levels, explicitly removes approximation error bias associated with numerically computed output quantities of interest that have an asymptotic limit behavior, and permits a low variance estimate of the asymptotic rate of convergence to that limit. In addition, it is shown that this new multilevel Monte Carlo variant can yield a computational cost savings. A review of Monte Carlo and multilevel Monte Carlo estimators is presented that includes analysis of expected value, expected mean squared error, and the calculation of optimized multilevel sample size parameters. The multilevel Monte Carlo estimator produces estimates of expectation for numerically approximated output quantities of interest that are biased by approximation error. When the quantity of interest can be modeled as the asymptotic limit of numerically approximated output quantities of interest, it is theoretically possible to remove this approximation error bias in the multilevel Monte Carlo estimator. In actual implementations, however, this procedure is unreliable due to statistical variability and inaccuracy in estimating the needed asymptotic limit. Analysis and numerical experiment show that the proposed variant of the multilevel Monte Carlo method greatly reduces (in some cases eliminates) the statistical variability in this limit estimation.

Barth, Timothy↗

DOE OSTI2016

Analysis of the effects of mismatched errors on coherent beam combining based on a self-imaging waveguide

A theoretical model of coherent beam combining (CBC) based on a self-imaging waveguide (SIW) is built and the effects of mismatched errors on SIW-based CBC are simulated and analysed numerically. With the combination of the theoretical model and the finite difference beam propagation method, two main categories of errors, assembly and nonassembly errors, are numerically studied to investigate their effect on the beam quality by using the M{sup 2} factor. The optimisation of the SIW and error control principle of the system is briefly discussed. The generalised methodology offers a good reference for investigating waveguide-based high-power coherent combining of fibre lasers in a comprehensive way. (lasers and laser beams)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS2008

Problems Associated with Grid Convergence of Functionals

The current use of functionals to evaluate order-of-convergence of a numerical scheme can lead to incorrect values. The problem comes about because of interplay between the errors from the evaluation of the functional, e.g., quadrature error, and from the numerical scheme discretization. Alternative procedures for deducing the order-property of a scheme are presented. The problem is studied within the context of the inviscid supersonic flow over a blunt body; however, the problem and solutions presented are not unique to this example.

Salas, Manuel D.↗

NASA NTRS2009

On Problems Associated with Grid Convergence of Functionals

The current use of functionals to evaluate order-of-convergence of a numerical scheme can lead to incorrect values. The problem comes about because of interplay between the errors from the evaluation of the functional, e.g., quadrature error, and from the numerical scheme discretization. Alternative procedures for deducing the order property of a scheme are presented. The problems are studied within the context of the inviscid supersonic flow over a blunt body; however, the problems and solutions presented are not unique to this example.

Salas, Manuael D.↗

NASA NTRS1990

Simulated forecast error and climate drift resulting from the omission of the upper stratosphere in numerical models

Using an NCAR community climate model, Version I, the forecast error growth and the climate drift resulting from the omission of the upper stratosphere are investigated. In the experiment, the control simulation is a seasonal integration of a medium horizontal general circulation model with 30 levels extending from the surface to the upper mesosphere, while the main experiment uses an identical model, except that only the bottom 15 levels (below 10 mb) are retained. It is shown that both random and systematic errors develop rapidly in the lower stratosphere with some local propagation into the troposphere in the 10-30-day time range. The random growth rate in the troposphere in the case of the altered upper boundary was found to be slightly faster than that for the initial-condition uncertainty alone. However, this is not likely to make a significant impact in operational forecast models, because the initial-condition uncertainty is very large.

Boville, Byron A.↗

DOE OSTI2024

Predicting ptychography probe positions using single-shot phase retrieval neural network

Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of 10 2 pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.

47 OTHER INSTRUMENTATION↗

DOE OSTI2018

Impact of numerical choices on water conservation in the E3SM Atmosphere Model version 1 (EAMv1)

Abstract. The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1∘ horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model becomes negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors in early V1 versions decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in V1 results in a very thin model layer at the Earth's surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for V1.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2017

Impact of numerical choices on water conservation in the E3SM Atmosphere Model Version 1 (EAM V1)

The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations for sea level rise projection. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1° horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model is negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in the new model results in a very thin model layer at the Earth’s surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for this model.

Zhang, Kai↗

NASA NTRS1989

A least-squares finite element method for incompressible Navier-Stokes problem

Most finite element schemes for solving the Navier-Stokes equations can be categorized into the Galerkin mixed method and the penalty method. The mixed method leads to a saddle-point problem. In order to guarantee the existence of a solution, the combination of velocity and pressure interpolations requires satisfaction of the Ladyzhenskaya Babuska Brezzi (LBB) consistency condition which precludes the use of equal order interpolations and many seemingly natural pairs of velocity and pressure elements. In a previous paper a least-squares finite element method based on the first order velocity-pressure-vorticity formulation for the Stokes problem was proposed. This method leads to a minimization problem. The choice of combination of elements is thus not subject to the LBB condition. The numerical experiments exhibit the optimal rate of convergence for all variables with equal order interpolations. A theoretical error analysis supports the numerical results. In this paper the least-squares finite element method is extended to solving the incompressible Navier-Stokes problem.

Jiang, Bonan↗

NASA NTRSDate not supplied

A New Approach for a Wider Class of Entropy Split Methods for Compressible Gas Dynamics and MHD

The high order entropy split methods of Sjögreen & Yee [1, 2] by entropy splitting of the compressible Euler (inviscid) flux derivatives for a thermally-perfect gas are based on Harten’s entropy function [3, 4, 5]. Their derivation takes advantage of the homogeneity property of Euler flux, symmetrizable Euler flux derivatives and energy-norm stability in conjunction with high order classical spatial central, DRP (dispersion relation-preserving) [6, 7, 8] or Padé (compact) spatial discretizations [9] with summation-by-parts (SBP) operators [10]. Our entropy split methods have been proven entropy conserving and stable [1, 11, 12]. Our proofs do not rely on a two-point numerical flux, but rather only a linear difference operator is required to derive these methods. To extend the entropy split method for the MHD, we used the Godunov symmetrizable non-conservative MHD form [12, 13, 14]. These high order entropy split methods not only preserve certain physical properties of the chosen governing equations but are also known to either improve numerical stability, and/or minimize aliasing errors in long time integration of turbulent flow computations without the aid of added numerical dissipation. In our previous published work, extensive error norm comparison with grid refinement was performed to show the high accuracy performance of these methods. These studies also showed how well the entropy split methods conserve the entropy, momentum and mass, and preserve the kinetic energy for long time integration of the various flows [1, 2, 12, 13, 14]. The objective of the present work is to use a new approach to obtain a wider class of entropy split methods consisting of a two-point numerical flux portion and a non-conservative portion in such a way that the homogeneity property of the compressible Euler flux is not required. For high order classical spatial central, DRP (dispersion relation-preserving) or Padé (compact) spatial discretizations, this new approach can be proven to be entropy conservative with conservative spatial dsicretizations while at the same time allowing a wider class of symmetrizable inviscid flux derivatives. We also use this generalization to derive an entropy split scheme that is entropy conserving for the equations of MHD without the homogeneity property using the Godunov symmetrizable ideal MHD formulation [15].

High Order Physical Preserving Methods↗

NASA NTRSDate not supplied

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗

NASA NTRS1980

Simulation studies of a model of high-density metallic hydrogen

Upper bounds for the ground-state energies of liquid and solid phases of metallic hydrogen and metallic deuterium have been calculated with variational methods and Monte Carlo techniques. At four densities (0.8, 1.2, 1.36, and 1.488) crystalline phases are clearly preferred in the sense that the energy difference, when compared to the liquid, is in excess of the errors inherent in the numerical procedures. At a fifth density (1.6), the energy differences between solid and liquid phases are smaller than these errors.

Mon, K. K.↗

DOE OSTI2021

Gravitational Self-force Errors of Poisson Solvers on Adaptively Refined Meshes

An error in the gravitational force that the source of gravity induces on itself (a self-force error) violates both the conservation of linear momentum and the conservation of energy. If such errors are present in a self-gravitating system and are not sufficiently random to average out, the obtained numerical solution will become progressively more unphysical with time: the system will acquire or lose momentum and energy due to numerical effects. In this paper, we demonstrate how self-force errors can arise in the case where self-gravity is solved on an adaptively refined mesh when the refinement is nonuniform. Here, we provide the analytical expression for the self-force error and numerical examples that demonstrate such self-force errors in idealized settings. We also show how these errors can be corrected to an arbitrary order by straightforward addition of correction terms at the refinement boundaries.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2015

Numerical integration for ab initio many-electron self energy calculations within the GW approximation

We present a numerical integration scheme for evaluating the convolution of a Green's function with a screened Coulomb potential on the real axis in the GW approximation of the self energy. Our scheme takes the zero broadening limit in Green's function first, replaces the numerator of the integrand with a piecewise polynomial approximation, and performs principal value integration on subintervals analytically. We give the error bound of our numerical integration scheme and show by numerical examples that it is more reliable and accurate than the standard quadrature rules such as the composite trapezoidal rule. We also discuss the benefit of using different self energy expressions to perform the numerical convolution at different frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2015

Convergence of statistical moments of particle density time series in scrape-off layer plasmas

Particle density fluctuations in the scrape-off layer of magnetically confined plasmas, as measured by gas-puff imaging or Langmuir probes, are modeled as the realization of a stochastic process in which a superposition of pulses with a fixed shape, an exponential distribution of waiting times, and amplitudes represents the radial motion of blob-like structures. With an analytic formulation of the process at hand, we derive expressions for the mean squared error on estimators of sample mean and sample variance as a function of sample length, sampling frequency, and the parameters of the stochastic process. Employing that the probability distribution function of a particularly relevant stochastic process is given by the gamma distribution, we derive estimators for sample skewness and kurtosis and expressions for the mean squared error on these estimators. Numerically, generated synthetic time series are used to verify the proposed estimators, the sample length dependency of their mean squared errors, and their performance. We find that estimators for sample skewness and kurtosis based on the gamma distribution are more precise and more accurate than common estimators based on the method of moments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

ReMU: regional minimal updating for model-based derivative-free optimization

Derivative-free optimization (DFO) problems are optimization problems where derivative information is unavailable or extremely difficult to obtain. Model-based DFO solvers have been applied extensively in scientific computing. Powell's NEWUOA (2004) [Powell, The NEWUOA software for unconstrained optimization without derivatives, in Large-Scale Nonlinear Optimization, Nonconvex Optimization and its Applications Vol. 83, G. Di Pillo and M. Roma, eds., Springer, 2006, pp. 255–297] and Wild's POUNDerS (2014) [Wild, Solving derivative-free nonlinear least squares problems with POUNDERS, in Advances and Trends in Optimization with Engineering Applications, T. Terlaky, M.F. Anjos, and S. Ahmed, eds., SIAM, 2017, pp. 529–540] explore the numerical power of the minimal norm Hessian (MNH) model for DFO and contributed to the open discussion on building better models with fewer data to achieve faster numerical convergence. Another decade later, we propose the regional minimal updating (ReMU) models, and extend the previous models into a broader class, including the H 2 norm models [Xie and Yuan, Least H 2 norm updating of quadratic interpolation models for derivative-free trust-region algorithms, IMA J. Numer. Anal. 46 (2025), pp. 21–50]. This paper shows motivation behind ReMU models, computational details, theoretical and numerical results on particular extreme points and the barycentre of ReMU's weight coefficient region, and the associated KKT matrix error and distance. Novel metrics, such as the truncated Newton step error, are proposed to numerically understand the new models' properties. A new algorithmic strategy, based on iteratively adjusting the ReMU model type, is also proposed, and shows numerical advantages by combining and switching between the barycentric model and the classic least Frobenius norm model in an online fashion.

derivative-free trust-region methods↗

NASA NTRS1993

Errors In Graphical Analysis Of Computed Flows

Report discusses sources of error in graphical display and analysis of flow fields simulated numerically by computers. Sources of error explored by examples of graphical techniques and errors they introduce in depiction of flow fields computed from Reynolds-averaged Navier-Stokes equations. Specific graphical techniques examined: contouring, plotting arrows on pictures to represent three-dimensional vectors, and particle tracing.

Buning, Pieter↗

NASA NTRS2016

Exploiting Measurement Uncertainty Estimation in Evaluation of GOES-R ABI Image Navigation Accuracy Using Image Registration Techniques

In evaluating GOES-R Advanced Baseline Imager (ABI) image navigation quality, upsampled sub-images of ABI images are translated against downsampled Landsat 8 images of localized, high contrast earth scenes to determine the translations in the East-West and North-South directions that provide maximum correlation. The native Landsat resolution is much finer than that of ABI, and Landsat navigation accuracy is much better than ABI required navigation accuracy and expected performance. Therefore, Landsat images are considered to provide ground truth for comparison with ABI images, and the translations of ABI sub-images that produce maximum correlation with Landsat localized images are interpreted as ABI navigation errors. The measured local navigation errors from registration of numerous sub-images with the Landsat images are averaged to provide a statistically reliable measurement of the overall navigation error of the ABI image. The dispersion of the local navigation errors is also of great interest, since ABI navigation requirements are specified as bounds on the 99.73rd percentile of the magnitudes of per pixel navigation errors. However, the measurement uncertainty inherent in the use of image registration techniques tends to broaden the dispersion in measured local navigation errors, masking the true navigation performance of the ABI system. We have devised a novel and simple method for estimating the magnitude of the measurement uncertainty in registration error for any pair of images of the same earth scene. We use these measurement uncertainty estimates to filter out the higher quality measurements of local navigation error for inclusion in statistics. In so doing, we substantially reduce the dispersion in measured local navigation errors, thereby better approximating the true navigation performance of the ABI system.

navigation performance↗