Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

A statistical study of the differential very long baseline interferometry delay rate error budget

The delta differential one-way Doppler (delta-DOD) error budget is assessed by analyzing 12 years of dual-frequency Deep Space Network very long baseline interferometry data. A typical delta-DOD observation is outlined, and the Magellan error budget along with tropospheric effects are considered. Formation of quasar-quasar observables, RMS delta-DOD residual, angular source separation and time separation between observations are discussed, along with elevation angle and atmospheric pathlength dependence, solar-plasma and ionospheric effects. It is concluded that the weak dependence of the delta-DOD error on angular source separation can mean that quasars with larger angular separation from a spacecraft may be used as navigation reference with little increase in the delta-DOD error. It is also indicated that the delta-DOD errors are dominated by wet troposphere fluctuations, and the results of numerical integrations for the single-station RMS delay rate at different elevation angles are presented.

Edwards, Charles D.↗
NASA NTRS1980

Composite model of a 3-D image

This paper presents a composite model of a moving (3-D) image especially useful for the sequential image processing and encoding. A non-linear predictor based on the composite model is described. The performance of this predictor is used as a measure of the validity of the model for a real image source. The minimization of a total mean square prediction error provides an inequality which determines a condition for the profitable use of the composite model and can serve as a decision device for the selection of the number of subsources within the model. The paper also describes statistical properties of the prediction error and contains results of computer simulation of two non-linear predictors in the case of perfect classification between subsources.

Dukhovich, I. J.↗
NASA NTRS2017

A Non-Intrusive Algorithm for Sensitivity Analysis of Chaotic Flow Simulations

We demonstrate a novel algorithm for computing the sensitivity of statistics in chaotic flow simulations to parameter perturbations. The algorithm is non-intrusive but requires exposing an interface. Based on the principle of shadowing in dynamical systems, this algorithm is designed to reduce the effect of the sampling error in computing sensitivity of statistics in chaotic simulations. We compare the effectiveness of this method to that of the conventional finite difference method.

Blonigan, Patrick J.↗
DOE OSTI2026

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗
NASA NTRS1988

Modeling and measurement of error propagation in a multimodule computing system

An error propagation model has been developed for multimodule computing systems in which the main parameters are the distribution functions of error propagation times. A digraph model is used to represent a multimodule computing system, and error propagation in the system is modeled by general distributions of error propagation times between all pairs of modules. Two algorithms are developed to compute systematically and efficiently the distributions of error propagation times. Experiments are also conducted to measure the distributions of error propagation times with the fault-tolerant microprocessor (FTMP). Statistical analysis of experimental data shows that the error propagation times in FTMP do not follow a well-known distribution, thus justifying the use of general distributions in the present model.

Shin, Kang G.↗
NASA NTRS1985

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗
NASA NTRSDate not supplied

Is There A Relationship Between Cornered-Hat Methods and A Residual Approach to Estimate System Uncertainty?

Recently a relationship has been established between a now traditional residual diagnostic used to estimate observation, background and analysis error covariances of interest to data assimilation and the three-cornered hat (3CH) method. An existing extension of the traditional residual diagnostic uses residuals from a fixed lag-1 Kalman smoother to retrieve system (model) error covariance. It is thus natural to ask if an additional relationship can be established between this extended residual method and some form of cornered--hat method. The answer might seem straightforward. Unlike in the standard residual estimation case, attempting to estimate model error amounts to estimating the statistics of a residual quantity itself. As shown in this presentation, in such cases the 3CH method becomes trivial: the sought out uncertainty can be derived directly from the covariance of the residual quantity at hand. In the particular case of estimating model error, one of the corners would have to be composed of vectors providing estimates of model error; these are not typically available in practice. Therefore, at first glance the present work finds no relationship between the lag-1 smoother residual diagnostic for system error estimation and cornered--hat methods. However, the work suggests that a two-tiered 3CH might be all that is necessary for system uncertainty to be obtained with 3CH.

Ricardo Todling↗
DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS1991

Evaluating the design of satellite scanning radiometers for earth radiation budget measurements with system simulations. Part 1: Instantaneous estimates

A set of system simulations was performed to evaluate candidate scanner configurations to fly as a part of the Earth Radiation Budget Instrument (ERBI) on the polar platforms during the 1990's. The simulation is considered of instantaneous sampling (without diurnal averaging) of the longwave and shortwave fluxes at the top of the atmosphere (TOA). After measurement and subsequent inversion to the TOA, the measured fluxes were compared to the reference fluxes for 2.5 deg lat/long resolution targets. The reference fluxes at this resolution are obtained by integrating over the 25 x 25 = 625 grid elements in each target. The differences between each of these two resultant spatially averaged sets of target measurements (errors) are taken and then statistically summarized. Five instruments are considered: (1) the Conically Scanning Radiometer (CSR); (2) the ERBE Cross Track Scanner; (3) the Nimbus-7 Biaxial Scanner; (4) the Clouds and Earth's Radiant Energy System Instrument (CERES-1); and (5) the Active Cavity Array (ACA). Identical studies of instantaneous error were completed for many days, two seasons, and several satellite equator crossing longitudes. The longwave flux errors were found to have the same space and time characteristics as for the shortwave fluxes, but the errors are only about 25 pct. of the shortwave errors.

Stowe, Larry↗
DOE OSTI2026

Shuttling Majorana zero modes in disordered and noisy topological superconductors

The braiding of Majorana zero modes (MZMs) forms the fundamental building block for topological quantum computation. Braiding protocols which involve the physical exchange of MZMs are typically envisioned on a network of topological superconducting wires. An important component of these protocols is the transport of MZMs, which can be performed by using electric gates to locally tune sections of the wire between topologically trivial and nontrivial phases. In this work, we numerically simulate this transport by tuning a single section of a superconducting wire which contains either disorder (uncorrelated and correlated) or noise. We focus on the impact of these additional effects on the diabatic error, which describes unwanted transitions between the ground state and excited states. We show that the behavior of the average diabatic error is predominantly controlled by the statistics of the minimum bulk energy gap which is suppressed in the presence of disorder. The increase in diabatic error can be several orders of magnitude and is most deleterious when the disorder correlation length is a finite fraction of the transport distance and negligible when these lengths are far apart. In the presence of noise, the diabatic error is significantly enhanced due to optical transitions which depend on the minimum bulk energy gap as well as the frequency modes present in the noise. The results presented here serve to further characterize the diabatic error in disordered and noisy settings, which are important considerations in practical implementations of physical braiding schemes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS2018

Combined Error and Uncertainty Estimates for CFD Problems

Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?

Posteriori↗
NASA NTRS1988

Statistical corrections to the NMC medium range 700 mb height forecasts

This paper examines four statistical procedures for correcting the NMC medium-range forecast (MRF) errors in the 700-mb heights over the Northern Hemisphere. The tests were designed to include normal operational constraints, such as frequent changes in the forecast model and the lack of long-term forecast histories on which to base estimates of systematic errors and climate drifts. It was found that the two statistical procedures which provided a substantial reduction in mean square error were a procedure based on simple regression correction at each grid point and one based on lagged-average correction with one day lag at each grid point.

Schemm, Jae-Kyung E.↗
NASA NTRS1974

Impact of scintillation of transionospheric communications

Analyses of AGC analog data from the Small Astronomy Satellite (SAS) at VHF (136 MHz) have shown amplitude fluctuations in the signals received at several equatorial tracking sites operated by NASA. Coincident digital telemetry data, transmitted from SAS at 1 kbps, has also been analyzed. Errors in data are shown to increase markedly for nighttime satellite passes around the periods of the two equinoxes as compared to the errors observed during other periods. This paper establishes the qualitative and quantitative correlations between the ionospheric scintillation phenomenon and the occurrence of errors. Strong time and geographic cause and effect relationships are established by determining the statistical correlation between scintillation indices and bit error rates.

Blank, H. A.↗
NASA NTRS1996

Global and Local Distortion Inference During Embedded Zerotree Wavelet Decompression

This paper presents algorithms for inferring global and spatially local estimates of the squared-error distortion measures for the Embedded Zerotree Wavelet (EZW) image compression algorithm. All distortion estimates are obtained at the decoder without significantly compromising EZW's rate-distortion performance. Two methods are given for propagating distortion estimates from the wavelet domain to the spatial domain, thus giving individual estimates of distortion for each pixel of the decompressed image. These local distortion estimates seem to provide only slight improvement in the statistical characterization of EZW compression error relative to the global measure, unless actual squared errors are propagated. However, they provide qualitative information about the asymptotic nature of the error that may be helpful in wavelet filter selection for low bit rate applications.

Huber, A. Kris↗
NASA NTRS1990

The beam filling error in the Nimbus 5 electronically scanning microwave radiometer observations of Global Atlantic Tropical Experiment rainfall

A comparison of rain rates retrieved from the Nimbus 5 electronically scanning microwave radiometer brightness temperatures and observed from shipboard radars during the Global Atlantic Tropical Experiment (GATE) phase I shows that the beam filling error is the major source of discrepancy between the two. When averaged over a large scene (the GATE radar array, 400 km in diameter), the beam filling error is quite stable, being 50 percent of the observed rain rate. This suggests the simple procedure of multiplying retrieved rain rates by 2 (correction factor). A statistical model of the beam filling error is developed by envisioning an idealized instrument field-of-view that encompasses an entire gamma distribution of rain rates. A modeled correction factor near 2 is found for rain rate and temperature characteristics consistent with GATE conditions. The statistical model also suggests that the correction factor varies from 1.5 to 2.5 for suppressed to enhanced tropical convective regimes, and decreases to 1.5 as the freezing level and average depth of the rain column decreases to 2.5 km.

Short, David A.↗
NASA NTRS1990

Automatic recognition of intermittent failures - An experimental study of field data

A methodology is proposed for recognizing the symptoms of persistent problems in large systems. The system error rate is used to identify the error states among which relationships may exist. Statistical techniques are used to validate and quantify the strength of the relationship among these error states. As input, the approach takes the raw error logs containing a single entry for each error that is detected as an isolated event. As output, it produces a list of symptoms that characterize persistent errors. Thus, given a failure, it is determined whether the failure is an intermittent manifestation of a common fault or whether it is an isolated (transient) incident. The technique is shown to work on two CYBER systems and an IBM 3081 multiprocessor system. Comparisons to real failure/repair information obtained from field engineers show that, in about 85 percent of the cases, the error symptoms recognized by this approach correspond to real problems. The remaining 15 percent of the cases, although not directly supported by field data, are confirmed as being valid problems.

Iyer, Ravishankar K.↗
NASA NTRS2015

In Flight Calibration of the Magnetospheric Multiscale Mission Fast Plasma Investigation

The Fast Plasma Investigation (FPI) on the Magnetospheric Multiscale mission (MMS) combines data from eight spectrometers, each with four deflection states, into a single map of the sky. Any systematic discontinuity, artifact, noise source, etc. present in this map may be incorrectly interpreted as legitimate data and incorrect conclusions reached. For this reason it is desirable to have all spectrometers return the same output for a given input, and for this output to be low in noise sources or other errors. While many missions use statistical analyses of data to calibrate instruments in flight, this process is difficult with FPI for two reasons: 1. Only a small fraction of high resolution data is downloaded to the ground due to bandwidth limitations and 2: The data that is downloaded is, by definition, scientifically interesting and therefore not ideal for calibration. FPI uses a suite of new tools to calibrate in flight. A new method for detection system ground calibration has been developed involving sweeping the detection threshold to fully define the pulse height distribution. This method has now been extended for use in flight as a means to calibrate MCP voltage and threshold (together forming the operating point) of the Dual Electron Spectrometers (DES) and Dual Ion Spectrometers (DIS). A method of comparing higher energy data (which has low fractional voltage error) to lower energy data (which has a higher fractional voltage error) will be used to calibrate the high voltage outputs. Finally, a comparison of pitch angle distributions will be used to find remaining discrepancies among sensors.

Detection-system↗
NASA NTRS2015

In Flight Calibration of the Magnetospheric Multiscale Mission Fast Plasma Investigation

The Fast Plasma Investigation (FPI) on the Magnetospheric Multiscale mission (MMS) combines data from eight spectrometers, each with four deflection states, into a single map of the sky. Any systematic discontinuity, artifact, noise source, etc. present in this map may be incorrectly interpreted as legitimate data and incorrect conclusions reached. For this reason it is desirable to have all spectrometers return the same output for a given input, and for this output to be low in noise sources or other errors. While many missions use statistical analyses of data to calibrate instruments in flight, this process is insufficient with FPI for two reasons: 1. Only a small fraction of high resolution data is downloaded to the ground due to bandwidth limitations and 2: The data that is downloaded is, by definition, scientifically interesting and therefore not ideal for calibration. FPI uses a suite of new tools to calibrate in flight. A new method for detection system ground calibration has been developed involving sweeping the detection threshold to fully define the pulse height distribution. This method has now been extended for use in flight as a means to calibrate MCP voltage and threshold (together forming the operating point) of the Dual Electron Spectrometers (DES) and Dual Ion Spectrometers (DIS). A method of comparing higher energy data (which has low fractional voltage error) to lower energy data (which has a higher fractional voltage error) will be used to calibrate the high voltage outputs. Finally, a comparison of pitch angle distributions will be used to find remaining discrepancies among sensors.

Heliophysics↗