Search NASA⌕ Search

SEARCH · Search NASA

Results for “computable error estimate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

hsrl (01)

High-spectral-resolution lidar (HSRL) systems collect data about clouds and aerosols. These systems provide vertical profiles of optical depth, backscatter cross-section, depolarization, and backscatter phase function. All HSRL measurements are absolutely calibrated by reference to molecular scattering, which is measured at each point in the lidar profile. Like the Raman lidar, but unlike simple backscatter lidars such as the micropulse lidar, the HSRL can measure backscatter cross-sections and optical depths without prior assumptions about the scattering properties of the atmosphere. The depolarization observations also allow robust discrimination between ice and water clouds. In addition, rigorous error estimates can be computed for all measurements. A very narrow, angular field of view reduces multiple scattering contributions. The small field of view, coupled with a narrow optical bandwidth, nearly eliminates noise due to scattered sunlight. ARM operates two HSRL systems, one at the Barrow, North Slope of Alaska (NSA) site and the other in the second ARM Mobile Facility (AMF2), which is deployed at various locations on field campaigns.

54 ENVIRONMENTAL SCIENCES↗

hsrl (00)

High-spectral-resolution lidar (HSRL) systems collect data about clouds and aerosols. These systems provide vertical profiles of optical depth, backscatter cross-section, depolarization, and backscatter phase function. All HSRL measurements are absolutely calibrated by reference to molecular scattering, which is measured at each point in the lidar profile. Like the Raman lidar, but unlike simple backscatter lidars such as the micropulse lidar, the HSRL can measure backscatter cross-sections and optical depths without prior assumptions about the scattering properties of the atmosphere. The depolarization observations also allow robust discrimination between ice and water clouds. In addition, rigorous error estimates can be computed for all measurements. A very narrow, angular field of view reduces multiple scattering contributions. The small field of view, coupled with a narrow optical bandwidth, nearly eliminates noise due to scattered sunlight. ARM operates two HSRL systems, one at the Barrow, North Slope of Alaska (NSA) site and the other in the second ARM Mobile Facility (AMF2), which is deployed at various locations on field campaigns.

54 ENVIRONMENTAL SCIENCES↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗

Transport error estimation using residual Monte Carlo

The residual Monte Carlo (RMC) method is also known in the literature as sequential Monte Carlo and reduced-source Monte Carlo. Given a Monte Carlo method for solving a linear equation and an approximate solution to that system, the residual method enables use of essentially the same Monte Carlo algorithm to directly compute the additive error or “defect” associated with the approximate solution. As the size of the defect decreases relative to the size of the solution, the residual Monte Carlo method becomes increasingly efficient relative to the standard Monte Carlo (SMC) method. Here we present a new RMC algorithm for evaluating the space-angle error in S n radiation transport solutions, and provide computational examples demonstrating that it can be far more efficient than SMC for this purpose. Herein we also describe a particular pitfall that must be avoided if RMC is to be efficient, and explain why the performance of RMC can significantly differ between different transport problems and different quantities of interest for the same problem.

97 MATHEMATICS AND COMPUTING↗

Linearization errors in discrete goal-oriented error estimation

This paper is concerned with goal-oriented a posteriori error estimation for nonlinear functionals in the context of nonlinear variational problems solved with continuous Galerkin finite element discretizations. A two-level, or discrete, adjoint-based approach for error estimation is considered. The traditional method to derive an error estimate in this context requires linearizing both the nonlinear variational form and the nonlinear functional of interest which introduces linearization errors into the error estimate. In this paper, we investigate these linearization errors. In particular, we develop a novel discrete goal-oriented error estimate that accounts for traditionally neglected nonlinear terms at the expense of greater computational cost. We demonstrate how this error estimate can be used to drive mesh adaptivity. Here, we show that accounting for linearization errors in the error estimate can improve its effectivity for several nonlinear model problems and quantities of interest. We also demonstrate that an adaptive strategy based on the newly proposed estimate can lead to more accurate approximations of the nonlinear functional with fewer degrees of freedom when compared to uniform refinement and traditional adjoint-based approaches.

42 ENGINEERING↗

A posteriori error estimates for finite volume approximations of elliptic equations on general surfaces

In this paper, we present a residual-based a posteriori error estimate for the finite volume discretization of steady convection– diffusion–reaction equations defined on surfaces in R3, which are often implicitly represented as level sets of smooth functions. Reliability and efficiency of the proposed a posteriori error estimator are rigorously proved. Numerical experiments are also conducted to verify the theoretical results and demonstrate the robustness of the error estimator.

97 MATHEMATICS AND COMPUTING↗

An energy-stable time-integrator for phase-field models

Here, we introduce a provably energy-stable time-integration method for general classes of phase-field models with polynomial potentials. We demonstrate how Taylor series expansions of the nonlinear terms present in the partial differential equations of these models can lead to expressions that guarantee energy-stability implicitly, which are second-order accurate in time. The spatial discretization relies on a mixed finite element formulation and isogeometric analysis. We also propose an adaptive time-stepping discretization that relies on a first-order backward approximation to give an error-estimator. This error estimator is accurate, robust, and does not require the computation of extra solutions to estimate the error. This methodology can be applied to any second-order accurate time-integration scheme. We present numerical examples in two and three spatial dimensions, which confirm the stability and robustness of the method. The implementation of the numerical schemes is done in PetIGA, a high-performance isogeometric analysis framework.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

ESTIMATION UNCERTAINTY IN THE DETERMINATION OF THE MASTER CURVE REFERENCE TEMPERATURE

The Master Curve Reference Temperature, T0, characterizes the fracture performance of structural steels in the ductile-to-brittle transition region. For a given material, this reference temperature is estimated via fracture toughness testing. A methodology is presented to compute the standard error of an estimated T0 value from a finite sample of toughness data, in a unified manner for both single temperature and multiple temperature test methods. Using the asymptotic properties of maximum likelihood estimators, closed-form expressions for the standard error of the estimate of T0 are presented for both test methods. This methodology includes statistically rigorous treatment of censored data, which represents an advance over the current ASTM E1921 methodology. Through Monte Carlo simulations of realistic single temperature and multiple temperature test plans, the recommended likelihood-based procedure is shown to provide better statistical performance than the methods in the ASTM E1921 standard.

36 MATERIALS SCIENCE↗

A data-driven framework for error estimation and mesh-model optimization in system-level thermal-hydraulic simulation

We report over the past decades, several computer codes have been developed for simulation and analysis of thermal-hydraulics and system response in nuclear reactors under operating, abnormal transient, and accident conditions. However, simulation errors and uncertainties still inevitably exist even while these codes have been extensively assessed and used. In this work, a data-driven framework (Optimal Mesh/Model Information System, OMIS) is formulated and demonstrated to estimate simulation error and suggest optimal selection of computational mesh size (i.e., nodalization) and constitutive correlations (e.g., wall functions and turbulence models) for low-fidelity, coarse-mesh thermal-hydraulic simulation, in order to achieve accuracy comparable to that of high-fidelity simulation. Using results from high-fidelity simulations and experimental data with many fast-running low-fidelity simulations, an error database is built and used to train a machine learning model that can determine the relationship between local simulation error and local physical features. This machine learning model is then used to generate insight and help correct low-fidelity simulations for similar physical conditions. The OMIS framework is designed as a modularized six-step procedure and accomplished with state-of-the-art methods and algorithms. A mixed-convection case study was performed to illustrate the entire framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Successive Procedure for Solution Verification Based on User Needs

This paper discusses a revised solution verification procedure for computational fluid dynamics simulations to estimate the uncertainties in the quantities of interest based on discretization error models. This proposed procedure builds upon current procedures described in ASME V&V 20 but provides more guidance in determining the necessary number of mesh levels to build reliable discretization error models. Such guidance is particularly useful for practicing engineers without prior experience in solution verification. The key features of this proposed solution verification procedure are the ability to determine the need for additional mesh levels iteratively and the seamless treatment for underdetermined, exact, and overdetermined solutions of the power series approximation to the discretization error models. This study applies the proposed procedure to a set of synthetic examples to demonstrate the revised procedure’s clarity in determining the number of mesh solutions required for a reliable estimate of the discretization error in computational fluid dynamics settings. Additionally, this proposed procedure prevents a potential pathway in the current procedure in ASME V&V 20 that may lead to unreasonably small discretization errors.

Weinmeister, Justin↗

Exploration of efficient reduced-order modeling and a posteriori error estimation

Efficient algorithms are considered for the computation of a reduced-order model based on the proper orthogonal decomposition methodology for the solution of parameterized elliptic partial differential equations. The method relies on partitioning the parameter space into subdomains based on the properties of the solution space and then forming a reduced basis for each of the subdomains. This yields more efficient offline and online stages for the proper orthogonal decomposition method. We extend these ideas for inexpensive adjoint based a posteriori error estimation of both the expensive finite element method solutions and the reduced-order model solutions, for a single and multiple quantities of interest. Finally, various numerical results indicate the efficacy of the approach.

42 ENGINEERING↗

Variability in Automated Responses of Commercial Buildings and Industrial Facilities to Dynamic Electricity Prices

Changes in the electricity consumption of commercial buildings and industrial facilities (C&I facilities) during Demand Response (DR) events are usually estimated using counterfactual baseline models. Model error makes it difficult to precisely quantify these changes in consumption and understand if C&I facilities exhibit event-to-event variability in their response to DR signals. This paper seeks to understand baseline model error and DR variability in C&I facilities facing dynamic electricity prices. Using a regression-based baseline model, we present a method to compute the error associated with estimates of several DR parameters. We also develop a metric to determine how much observed DR variability results from baseline model error rather than real variability in response. We analyze 38 C&I facilities participating in an automated DR program and find that DR parameter errors are large. Though some facilities exhibit real DR variability, most observed variability results from baseline model error. Therefore, facilities with variable DR parameters may actually respond consistently from event to event. Consequently, in DR programs in which repeatability is valued, individual buildings may be performing better than previously thought. In some cases, however, aggregations of C&I facilities exhibit real DR variability, which could create challenges for power system operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Adaptive Hybridizable Discontinuous Galerkin discretization of the Grad–Shafranov equation by extension from polygonal subdomains

In this work, we propose a high-order adaptive numerical solver for the semilinear elliptic boundary value problem modeling magnetic plasma equilibrium in axisymmetric confinement devices. In the fixed boundary case, the equation is posed on curved domains with piecewise smooth curved boundaries that may present corners. The solution method we present is based on the hybridizable discontinuous Galerkin method and sidesteps the need for geometry-conforming triangulations thanks to a transfer technique that allows to approximate the solution using only a polygonal subset as computational domain. Moreover, the solver features automatic mesh refinement driven by a residual-based a posteriori error estimator. As the mesh is locally refined, the computational domain is automatically updated in order to always maintain the distance between the actual boundary and the computational boundary of the order of the local mesh diameter. Numerical evidence is presented of the suitability of the estimator as an approximate error measure for physically relevant equilibria with pressure pedestals, internal transport barriers, and current holes on realistic geometries.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhancing adaptive sparse grid approximations and improving refinement strategies using adjoint-based a posteriori error estimates

In this paper we present an algorithm for adaptive sparse grid approximations of quantities of interest computed from discretized partial differential equations. We use adjoint-based a posteriori error estimates of the physical discretization error and the interpolation error in the sparse grid to enhance the sparse grid approximation and to drive adaptivity of the sparse grid. Utilizing these error estimates provides significantly more accurate functional values for random samples of the sparse grid approximation. We also demonstrate that alternative refinement strategies based upon a posteriori error estimates can lead to further increases in accuracy in the approximation over traditional hierarchical surplus based strategies. Throughout this paper we also provide and test a framework for balancing the physical discretization error with the stochastic interpolation error of the enhanced sparse grid approximation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multi-Physics Surrogate Modeling with Dimensionality Reduction

This summary provides a new algorithm to construct surrogate models for multi-physics, nonlinear, high dimensional models which typically suffer from the curse of dimensionality. To deal with the high computational cost and difficult error estimation, we employ recent advances in reduced order modeling (ROM) techniques to do an error-preserving reduction for the number of influential model parameters, followed by a conventional surrogate construction process. To implement ROM for a multiphysics model, a range finding algorithm (RFA) is used to identify a linear transformation in which the number of influential parameters can be minimized and the errors resulting from the non-influential parameters can be upper-bounded. The proposed algorithm is applied to the MAMMOTH coupled code system developed at the Idaho National Laboratory. In particular, we investigate the reducibility of Rattlesnake and BISON codes and their multi-physics coupling. The most important result of this work is that the reduction obtained with coupled physics is more significant than that with individual physics models. This summary explores the application of ROM techniques on multi-physics coupling codes system. Concise methodology is provided and selected numerical results are provided to show that coupling system provides additional reduction at interfaces. Future work could be invested to determine the optimum surrogate model format. (authors)

97 MATHEMATICS AND COMPUTING↗

Numerical analysis of a thermal contact problem with adhesion

In this paper, we study a class of dynamic thermal problems involving a frictional normal compliance adhesive contact model and a non-clamped condition for visco-elastic materials. The variational formulation of the problem leads to a general system defined by a second-order quasi-variational evolution inequality on the displacement field coupled with the two first-order evolution equations describing the evolution of the temperature and adhesion. We establish an existence and uniqueness result of the solution on displacement, temperature and adhesion. Then we provide a fully discrete numerical scheme of approximation and derive an error estimate. Finally, various numerical computations are included.

97 MATHEMATICS AND COMPUTING↗