Search NASA⌕ Search

SEARCH · Search NASA

Results for “Error estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Improved Methodology for Surface and Atmospheric Soundings, Error Estimates, and Quality Control Procedures: the AIRS Science Team Version-6 Retrieval Algorithm

The AIRS Science Team Version-6 AIRS/AMSU retrieval algorithm is now operational at the Goddard DISC. AIRS Version-6 level-2 products are generated near real-time at the Goddard DISC and all level-2 and level-3 products are available starting from September 2002. This paper describes some of the significant improvements in retrieval methodology contained in the Version-6 retrieval algorithm compared to that previously used in Version-5. In particular, the AIRS Science Team made major improvements with regard to the algorithms used to 1) derive surface skin temperature and surface spectral emissivity; 2) generate the initial state used to start the cloud clearing and retrieval procedures; and 3) derive error estimates and use them for Quality Control. Significant improvements have also been made in the generation of cloud parameters. In addition to the basic AIRS/AMSU mode, Version-6 also operates in an AIRS Only (AO) mode which produces results almost as good as those of the full AIRS/AMSU mode. This paper also demonstrates the improvements of some AIRS Version-6 and Version-6 AO products compared to those obtained using Version-5.

Quality Control↗

Error estimation for ORION baseline vector determination

Effects of error sources on Operational Radio Interferometry Observing Network (ORION) baseline vector determination are studied. Partial derivatives of delay observations with respect to each error source are formulated. Covariance analysis is performed to estimate the contribution of each error source to baseline vector error. System design parameters such as antenna sizes, system temperatures and provision for dual frequency operation are discussed.

Wu, S. C.↗

Stability and error estimation for Component Adaptive Grid methods

Component adaptive grid (CAG) methods for solving hyperbolic partial differential equations (PDE's) are discussed in this paper. Applying recent stability results for a class of numerical methods on uniform grids. The convergence of these methods for linear problems on component adaptive grids is established here. Furthermore, the computational error can be estimated on CAG's using the stability results. Using these estimates, the error can be controlled on CAG's. Thus, the solution can be computed efficiently on CAG's within a given error tolerance. Computational results for time dependent linear problems in one and two space dimensions are presented.

Oliger, Joseph↗

A data-driven framework for error estimation and mesh-model optimization in system-level thermal-hydraulic simulation

We report over the past decades, several computer codes have been developed for simulation and analysis of thermal-hydraulics and system response in nuclear reactors under operating, abnormal transient, and accident conditions. However, simulation errors and uncertainties still inevitably exist even while these codes have been extensively assessed and used. In this work, a data-driven framework (Optimal Mesh/Model Information System, OMIS) is formulated and demonstrated to estimate simulation error and suggest optimal selection of computational mesh size (i.e., nodalization) and constitutive correlations (e.g., wall functions and turbulence models) for low-fidelity, coarse-mesh thermal-hydraulic simulation, in order to achieve accuracy comparable to that of high-fidelity simulation. Using results from high-fidelity simulations and experimental data with many fast-running low-fidelity simulations, an error database is built and used to train a machine learning model that can determine the relationship between local simulation error and local physical features. This machine learning model is then used to generate insight and help correct low-fidelity simulations for similar physical conditions. The OMIS framework is designed as a modularized six-step procedure and accomplished with state-of-the-art methods and algorithms. A mixed-convection case study was performed to illustrate the entire framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Use of three-cornered hat error estimates in MERRA-2 to guide an improved reanalysis-Part 1

The three-cornered hat (3CH) method estimates the uncertainties of three different co-located model or observational data sets (Anthes and Rieckh, 2018; Sjoberg et al., 2021). Rieckh et al. (2021) used the 3CH method to compare the random error statistics of different global forecast and reanalysis models, as well as radio occultation (RO) and radiosonde observations. That study showed that the MERRA-2 reanalysis, while having smaller errors in the stratosphere than its predecessor MERRA, had larger errors in the troposphere than many of the other data sets analyzed. The MERRA-2 errors were particularly large in the tropics. In a collaborative effort between UCAR’s COSMIC (Constellation Observing System for Meteorology, Ionosphere and Meteorology) program and NASA’s Global Modeling and Assimilation Office (GMAO), we carried out further 3CH error diagnostics to help isolate the causes of these larger errors and help guide the development of an improved reanalysis. This presentation summarizes random error statistics associated with MERRA-2, ECMWF’s ERA5 reanalysis, and COSMIC-2 (C2) RO observations. We compute 3CH error variance estimates of refractivity, as well as temperature and specific humidity using UCAR’s COSMIC Data Analysis and Archive Center (CDAAC) improved 1D-variational (1D-Var) retrieval (wetPf2) over 15 latitude bands from 45S to 45N. The 1D-Var retrievals of specific humidity and temperature for C2 use NCEP’s Global Forecast System (GFS) as the background. Anthes et al. (2021) showed that it gives accurate estimates of temperature and specific humidity in the tropics and subtropics, even in the challenging environment of intense Hurricane Dorian (2019). This presentation confirms the previous results that MERRA-2 has significantly larger errors in the tropics and subtropics than either C2 or ERA5. Its errors are larger between 30S and 30N compared to 30-45 N-S latitudes, and are also larger over land compared to oceans. Most of the MERRA-2 refractivity errors come from specific humidity, except over land below 3 km where temperature errors are large. These results suggest that moist convection and atmospheric boundary layer physics in MERRA-2 may be responsible for a significant part of the higher uncertainties. These results are being used to guide GMAO in developing an improved next-generation reanalysis, as shown in a companion presentation submitted to this conference (El Akkraoui et al., 2021), which extends this study and describes improvements to MERRA-2 leading to the next GMAO reanalysis.

Jeremiah Sjoberg↗

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗

Formal Estimation of Errors in Computed Absolute Interaction Energies of Protein-Ligand Complexes

A largely unsolved problem in computational biochemistry is the accurate prediction of binding affinities of small ligands to protein receptors. We present a detailed analysis of the systematic and random errors present in computational methods through the use of error probability density functions, specifically for computed interaction energies between chemical fragments comprising a protein-ligand complex. An HIV-II protease crystal structure with a bound ligand (indinavir) was chosen as a model protein-ligand complex. The complex was decomposed into 21 interacting fragment pairs, which were studied using a number of computational methods. The chemically accurate complete basis set coupled cluster theory (CCSD(T)/CBS) interaction energies were used as reference values to generate our error estimates. In our analysis, we observed significant systematic and random errors in most methods, which was surprising, especially for parametrized classical and semiempirical quantum mechanical calculations. After propagating these fragment-based error estimates over the entire protein-ligand complex, our total error estimates for many methods are large compared to the experimentally determined free energy of binding. Thus, we conclude that statistical error analysis is a necessary addition to any scoring function attempting to produce reliable binding affinity predictions.

Chemistry↗

Transport error estimation using residual Monte Carlo

The residual Monte Carlo (RMC) method is also known in the literature as sequential Monte Carlo and reduced-source Monte Carlo. Given a Monte Carlo method for solving a linear equation and an approximate solution to that system, the residual method enables use of essentially the same Monte Carlo algorithm to directly compute the additive error or “defect” associated with the approximate solution. As the size of the defect decreases relative to the size of the solution, the residual Monte Carlo method becomes increasingly efficient relative to the standard Monte Carlo (SMC) method. Here we present a new RMC algorithm for evaluating the space-angle error in S n radiation transport solutions, and provide computational examples demonstrating that it can be far more efficient than SMC for this purpose. Herein we also describe a particular pitfall that must be avoided if RMC is to be efficient, and explain why the performance of RMC can significantly differ between different transport problems and different quantities of interest for the same problem.

97 MATHEMATICS AND COMPUTING↗

Laser Doppler anemometer measurements using nonorthogonal velocity components - Error estimates

Laser Doppler anemometers (LDAs) that are arranged to measure nonorthogonal velocity components (from which orthogonal components are computed through transformation equations) are more susceptible to calibration and sampling errors than are systems with uncoupled channels. In this paper uncertainty methods and estimation theory are used to evaluate, respectively, the systematic and statistical errors that are present when such devices are applied to the measurement of mean velocities in turbulent flows. Statistical errors are estimated for two-channel LDA data that are either correlated or uncorrelated. For uncorrelated data the directional uncertainty of the measured velocity vector is considered for applications where mean streamline patterns are desired.

Orloff, K. L.↗

TU-AB-202-03: Prediction of PET Transfer Uncertainty by DIR Error Estimating Software, AUTODIRECT

Purpose: Deformable image registration (DIR) is a powerful tool, but DIR errors can adversely affect its clinical applications. To estimate voxel-specific DIR uncertainty, a software tool, called AUTODIRECT (automated DIR evaluation of confidence tool), has been developed and validated. This work tests the ability of this software to predict uncertainty for the transfer of standard uptake values (SUV) from positron-emission tomography (PET) with DIR. Methods: Virtual phantoms are used for this study. Each phantom has a planning computed tomography (CT) image and a diagnostic PET-CT image set. A deformation was digitally applied to the diagnostic CT to create the planning CT image and establish a known deformation between the images. One lung and three rectum patient datasets were employed to create the virtual phantoms. Both of these sites have difficult deformation scenarios associated with them, which can affect DIR accuracy (lung tissue sliding and changes in rectal filling). The virtual phantoms were created to simulate these scenarios by introducing discontinuities in the deformation field at the lung rectum border. The DIR algorithm from Plastimatch software was applied to these phantoms. The SUV mapping errors from the DIR were then compared to that predicted by AUTODIRECT. Results: The SUV error distributions closely followed the AUTODIRECT predicted error distribution for the 4 test cases. The minimum and maximum PET SUVs were produced from AUTODIRECT at 95% confidence interval before applying gradient-based SUV segmentation for each of these volumes. Notably, 93.5% of the target volume warped by the true deformation was included within the AUTODIRECT-predicted maximum SUV volume after the segmentation, while 78.9% of the target volume was within the target volume warped by Plastimatch. Conclusion: The AUTODIRECT framework is able to predict PET transfer uncertainty caused by DIR, which enables an understanding of the associated target volume uncertainty.

60 APPLIED LIFE SCIENCES↗

An error estimation procedure for plate bending elements

Procedures for identifying and eliminating errors inherent in individual finite elements and those due to the discretization of the continuum are presented. The elemental errors are identified through the use of an element formulation procedure based on physically interpretable strain gradient interpolation functions. The use of physically interpretable notation allows these errors to be eliminated using rational arguments. The discretization errors are identified by comparing the finite-element solution with a smoothed superconvergent solution. The errors thus identified are used to guide an adaptive mesh refinement procedure which produces improved results.

Dow, John O.↗

Contaminant point source localization error estimates as functions of data quantity and model quality

We develop empirically-grounded error envelopes for localization of a point contamination release event in the saturated zone of a previously uncharacterized heterogeneous aquifer into which a number of plume-intercepting wells have been drilled. We assume that flow direction in the aquifer is known exactly and velocity is known to within a factor of two of our best guess from well observations prior to source identification. Other aquifer and source parameters must be estimated by interpretation of well breakthrough data via the advection-dispersion equation. We employ high performance computing to generate numerous random realizations of aquifer parameters and well locations, simulate well breakthrough data, and then employ unsupervised machine optimization techniques to estimate the most likely spatial (or space-time) location of the source. Tabulating the accuracy of these estimates from the multiple realizations, we relate the size of 90% and 95% confidence envelopes to the data quantity (number of wells) and model quality (fidelity of ADE interpretation model to actual concentrations in a heterogeneous aquifer with channelized flow). We find that for purely spatial localization of the contaminant source, increased data quantities can make up for reduced model quality. For space-time localization, we find similar qualitative behavior, but significantly degraded spatial localization reliability and less improvement from extra data collection. Since the space-time source localization problem is much more challenging, we also tried a multiple-initial-guess optimization strategy. Furthermore, this greatly enhanced performance, but gains from additional data collection remained limited.

54 ENVIRONMENTAL SCIENCES↗

Validation and Expected Error Estimation of Suomi-NNP VIIRS Aerosol Optical Thickness and Angstrom Exponent with AERONET

The new-generation polar-orbiting operational environmental sensor, the Visible Infrared Imaging Radiometer Suite (VIIRS) on board the Suomi National Polar-orbiting Partnership (S-NPP) satellite, provides critical daily global aerosol observations. As older satellite sensors age out, the VIIRS aerosol product will become the primary observational source for global assessments of aerosol emission and transport, aerosol meteorological and climatic effects, air quality monitoring, and public health. To prove their validity and to assess their maturity level, the VIIRS aerosol products were compared to the spatiotemporally matched Aerosol Robotic Network (AERONET)measurements. Over land, the VIIRS aerosol optical thickness (AOT) environmental data record (EDR) exhibits an overall global bias against AERONET of 0.0008 with root-mean-square error(RMSE) of the biases as 0.12. Over ocean, the mean bias of VIIRS AOT EDR is 0.02 with RMSE of the biases as 0.06.The mean bias of VIIRS Ocean Angstrom Exponent (AE) EDR is 0.12 with RMSE of the biases as 0.57. The matchups between each product and its AERONET counterpart allow estimates of expected error in each case. Increased uncertainty in the VIIRS AOT and AE products is linked to specific regions, seasons, surface characteristics, and aerosol types, suggesting opportunity for future modifications as understanding of algorithm assumptions improves. Based on the assessment, the VIIRS AOT EDR over land reached Validated maturity beginning 23 January 2013; the AOT EDR and AE EDR over ocean reached Validated maturity beginning 2 May 2012, excluding the processing error period 15 October to 27 November 2012. These findings demonstrate the integrity and usefulness of the VIIRS aerosol products that will transition from S-NPP to future polar-orbiting environmental satellites in the decades to come and become the standard global aerosol data set as the previous generations missions come to an end.

Huang, Jingfeng↗

Mars gravitational field estimation error

The error covariance matrices associated with a weighted least-squares differential correction process have been analyzed for accuracy in determining the gravitational coefficients through degree and order five in the Mars gravitational potential junction. The results are presented in terms of standard deviations for the assumed estimated parameters. The covariance matrices were calculated by assuming Doppler tracking data from a Mars orbiter, a priori statistics for the estimated parameters, and model error uncertainties for tracking-station locations, the Mars ephemeris, the astronomical unit, the Mars gravitational constant (G sub M), and the gravitational coefficients of degrees six and seven. Model errors were treated by using the concept of consider parameters.

Compton, H. R.↗