Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Topological color codes on Union Jack lattices: a stable implementation of the whole Clifford group

We study the error threshold of topological color codes on Union Jack lattices that allow for the full implementation of the whole Clifford group of quantum gates. After mapping the error-correction process onto a statistical mechanical random three-body Ising model on a Union Jack lattice, we compute its phase diagram in the temperature-disorder plane using Monte Carlo simulations. Surprisingly, topological color codes on Union Jack lattices have a similar error stability to color codes on triangular lattices, as well as to the Kitaev toric code. The enhanced computational capabilities of the topological color codes on Union Jack lattices with respect to triangular lattices and the toric code combined with the inherent robustness of this implementation show good prospects for future stable quantum computer implementations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Non-Intrusive Algorithm for Sensitivity Analysis of Chaotic Flow Simulations

We demonstrate a novel algorithm for computing the sensitivity of statistics in chaotic flow simulations to parameter perturbations. The algorithm is non-intrusive but requires exposing an interface. Based on the principle of shadowing in dynamical systems, this algorithm is designed to reduce the effect of the sampling error in computing sensitivity of statistics in chaotic simulations. We compare the effectiveness of this method to that of the conventional finite difference method.

Blonigan, Patrick J.↗

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗

Modeling and measurement of error propagation in a multimodule computing system

An error propagation model has been developed for multimodule computing systems in which the main parameters are the distribution functions of error propagation times. A digraph model is used to represent a multimodule computing system, and error propagation in the system is modeled by general distributions of error propagation times between all pairs of modules. Two algorithms are developed to compute systematically and efficiently the distributions of error propagation times. Experiments are also conducted to measure the distributions of error propagation times with the fault-tolerant microprocessor (FTMP). Statistical analysis of experimental data shows that the error propagation times in FTMP do not follow a well-known distribution, thus justifying the use of general distributions in the present model.

Shin, Kang G.↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

Is There A Relationship Between Cornered-Hat Methods and A Residual Approach to Estimate System Uncertainty?

Recently a relationship has been established between a now traditional residual diagnostic used to estimate observation, background and analysis error covariances of interest to data assimilation and the three-cornered hat (3CH) method. An existing extension of the traditional residual diagnostic uses residuals from a fixed lag-1 Kalman smoother to retrieve system (model) error covariance. It is thus natural to ask if an additional relationship can be established between this extended residual method and some form of cornered--hat method. The answer might seem straightforward. Unlike in the standard residual estimation case, attempting to estimate model error amounts to estimating the statistics of a residual quantity itself. As shown in this presentation, in such cases the 3CH method becomes trivial: the sought out uncertainty can be derived directly from the covariance of the residual quantity at hand. In the particular case of estimating model error, one of the corners would have to be composed of vectors providing estimates of model error; these are not typically available in practice. Therefore, at first glance the present work finds no relationship between the lag-1 smoother residual diagnostic for system error estimation and cornered--hat methods. However, the work suggests that a two-tiered 3CH might be all that is necessary for system uncertainty to be obtained with 3CH.

Ricardo Todling↗

Deep nonparametric estimation of intrinsic data structures by chart autoencoders: Generalization error and robustness

Autoencoders have demonstrated remarkable success in learning low-dimensional latent features of high-dimensional data across various applications. Assuming that data are sampled near a low-dimensional manifold, we employ chart autoencoders, which encode data into low-dimensional latent features on a collection of charts, preserving the topology and geometry of the data manifold. Our paper establishes statistical guarantees on the generalization error of chart autoencoders, and we demonstrate their denoising capabilities by considering n noisy training samples, along with their noise-free counterparts, on a d-dimensional manifold. By training autoencoders, we show that chart autoencoders can effectively denoise the input data with normal noise. We prove that, under proper network architectures, chart autoencoders achieve a squared generalization error in the order of n–$\frac{2}{d+2}$log 4 n, which depends on the intrinsic dimension of the manifold and only weakly depends on the ambient dimension and noise level. We further extend our theory on data with noise containing both normal and tangential components, where chart autoencoders still exhibit a denoising effect for the normal component. As a special case, our theory also applies to classical autoencoders, as long as the data manifold has a global parametrization. Furthermore, our results provide a solid theoretical foundation for the effectiveness of autoencoders, which is further validated through several numerical experiments.

97 MATHEMATICS AND COMPUTING↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Adaptation of the CVT algorithm for catheter optimization in high dose rate brachytherapy

Purpose: An innovative, simple, and fast method to optimize the number and position of catheters is presented for prostate and breast high dose rate (HDR) brachytherapy, both for arbitrary templates or template-free implants (such as robotic templates).Methods: Eight clinical cases were chosen randomly from a bank of patients, previously treated in our clinic to test our method. The 2D Centroidal Voronoi Tessellations (CVT) algorithm was adapted to distribute catheters uniformly in space, within the maximum external contour of the planning target volume. The catheters optimization procedure includes the inverse planning simulated annealing algorithm (IPSA). Complete treatment plans can then be generated from the algorithm for different number of catheters. The best plan is chosen from different dosimetry criteria and will automatically provide the number of catheters and their positions. After the CVT algorithm parameters were optimized for speed and dosimetric results, it was validated against prostate clinical cases, using clinically relevant dose parameters. The robustness to implantation error was also evaluated. Finally, the efficiency of the method was tested in breast interstitial HDR brachytherapy cases.Results: The effect of the number and locations of the catheters on prostate cancer patients was studied. Treatment plans with a better or equivalent dose distributions could be obtained with fewer catheters. A better or equal prostate V100 was obtained down to 12 catheters. Plans with nine or less catheters would not be clinically acceptable in terms of prostate V100 and D90. Implantation errors up to 3 mm were acceptable since no statistical difference was found when compared to 0 mm error (p > 0.05). No significant difference in dosimetric indices was observed for the different combination of parameters within the CVT algorithm. A linear relation was found between the number of random points and the optimization time of the CVT algorithm. Because the computation time decrease with the number of points and that no effects were observed on the dosimetric indices when varying the number of sampling points and the number of iterations, they were respectively fixed to 2500 and to 100. The computation time to obtain ten complete treatments plans ranging from 9 to 18 catheters, with the corresponding dosimetric indices, was 90 s. However, 93% of the computation time is used by a research version of IPSA. For the breast, on average, the Radiation Therapy Oncology Group recommendations would be satisfied down to 12 catheters. Plans with nine or less catheters would not be clinically acceptable in terms of V100, dose homogeneity index, and D90.Conclusions: The authors have devised a simple, fast and efficient method to optimize the number and position of catheters in interstitial HDR brachytherapy. The method was shown to be robust for both prostate and breast HDR brachytherapy. More importantly, the computation time of the algorithm is acceptable for clinical use. Ultimately, this catheter optimization algorithm could be coupled with a 3D ultrasound system to allow real-time guidance and planning in HDR brachytherapy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Evaluating the design of satellite scanning radiometers for earth radiation budget measurements with system simulations. Part 1: Instantaneous estimates

A set of system simulations was performed to evaluate candidate scanner configurations to fly as a part of the Earth Radiation Budget Instrument (ERBI) on the polar platforms during the 1990's. The simulation is considered of instantaneous sampling (without diurnal averaging) of the longwave and shortwave fluxes at the top of the atmosphere (TOA). After measurement and subsequent inversion to the TOA, the measured fluxes were compared to the reference fluxes for 2.5 deg lat/long resolution targets. The reference fluxes at this resolution are obtained by integrating over the 25 x 25 = 625 grid elements in each target. The differences between each of these two resultant spatially averaged sets of target measurements (errors) are taken and then statistically summarized. Five instruments are considered: (1) the Conically Scanning Radiometer (CSR); (2) the ERBE Cross Track Scanner; (3) the Nimbus-7 Biaxial Scanner; (4) the Clouds and Earth's Radiant Energy System Instrument (CERES-1); and (5) the Active Cavity Array (ACA). Identical studies of instantaneous error were completed for many days, two seasons, and several satellite equator crossing longitudes. The longwave flux errors were found to have the same space and time characteristics as for the shortwave fluxes, but the errors are only about 25 pct. of the shortwave errors.

Stowe, Larry↗

Shuttling Majorana zero modes in disordered and noisy topological superconductors

The braiding of Majorana zero modes (MZMs) forms the fundamental building block for topological quantum computation. Braiding protocols which involve the physical exchange of MZMs are typically envisioned on a network of topological superconducting wires. An important component of these protocols is the transport of MZMs, which can be performed by using electric gates to locally tune sections of the wire between topologically trivial and nontrivial phases. In this work, we numerically simulate this transport by tuning a single section of a superconducting wire which contains either disorder (uncorrelated and correlated) or noise. We focus on the impact of these additional effects on the diabatic error, which describes unwanted transitions between the ground state and excited states. We show that the behavior of the average diabatic error is predominantly controlled by the statistics of the minimum bulk energy gap which is suppressed in the presence of disorder. The increase in diabatic error can be several orders of magnitude and is most deleterious when the disorder correlation length is a finite fraction of the transport distance and negligible when these lengths are far apart. In the presence of noise, the diabatic error is significantly enhanced due to optical transitions which depend on the minimum bulk energy gap as well as the frequency modes present in the noise. The results presented here serve to further characterize the diabatic error in disordered and noisy settings, which are important considerations in practical implementations of physical braiding schemes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Using Neutrinos as a Probe of the High-x{sub Bj} Region

Neutrino scattering experiments have been studying the DIS region, including high-x{sub Bj}, for over 40 years. From the Gargamelle experiments in the early 70's, through the subsequent bubble chamber and electronic detector experiments neutrino scattering experiments have steadily accumulated increasing statistics and minimized their systematic errors. Recent completed studies of high-x{sub Bj} with neutrinos are from the the NuTeV experiment off Fe in the TeVatron neutrino beam and both the CHORUS experiment off Pb and the NOMAD experiment off C/Al in the CERN neutrino beam. The significant factor here is that all recent high-statistics neutrino experiments have been off high-A nucleus targets. The unknown nuclear effects mask the high-x{sub Bj} behavior of the bare neutrino-nucleon interaction. In order to address this problem, current on-going studies have shifted to the Main Injector based NuMI facility at Fermilab and the MINER{nu}A experiment. This experiment is a collaboration of elementary-particle and nuclear physicists planning to measure absolute exclusive and inclusive cross-sections and nuclear effects in {nu}- A interactions as well as a systematic study of the resonance-DIS transition region and DIS with an emphasis on the extraction of high-xBj parton distribution functions. The MINER{nu}A experiment also plans to propose the use of a liquid hydrogen target to go after a measurement of d/u quarks at high-x{sub Bj}.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine Learning Reveals the State of Intermittent Frictional Dynamics in a Sheared Granular Fault

Seismogenic plate boundaries are posited to behave in a similar manner to a densely packed granular medium, where fault and block systems rapidly rearrange the distribution of forces within themselves, as particles do in slowly sheared granular systems. Machine learning is used to show that statistical features of velocity signals from individual particles in a simulated sheared granular fault contain information regarding the instantaneous global state of intermittent frictional stick-slip dynamics. We demonstrate that combining features built from the signals of more particles can improve the accuracy of the global model and discuss the physical basis behind the decrease in error. We show that the statistical features such as median and higher moments of the signals that represent the particle displacement in the direction of shearing are among the best predictive features. We demonstrate here novel insights into the applications of machine learning in studying frictional processes occurring in geophysical systems.

58 GEOSCIENCES↗

Short-Term Load Forecasting Error Distributions and Implications for Renewable Integration Studies: Preprint

Load forecasting in the day-ahead timescale is a critical aspect of power system operations that is used in the unit commitment process. It is also an important factor in renewable energy integration studies, where the combination of load and wind or solar forecasting techniques create the net load uncertainty that must be managed by the economic dispatch process or with suitable reserves. An understanding of that load forecasting errors that may be expected in this process can lead to better decisions about the amount of reserves necessary to compensate errors. In this work, we performed a statistical analysis of the day-ahead (and two-day-ahead) load forecasting errors observed in two independent system operators for a one-year period. Comparisons were made with the normal distribution commonly assumed in power system operation simulations used for renewable power integration studies. Further analysis identified time periods when the load is more likely to be under- or overforecast.

17 WIND ENERGY↗

Combined Error and Uncertainty Estimates for CFD Problems

Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?

Posteriori↗

Statistical corrections to the NMC medium range 700 mb height forecasts

This paper examines four statistical procedures for correcting the NMC medium-range forecast (MRF) errors in the 700-mb heights over the Northern Hemisphere. The tests were designed to include normal operational constraints, such as frequent changes in the forecast model and the lack of long-term forecast histories on which to base estimates of systematic errors and climate drifts. It was found that the two statistical procedures which provided a substantial reduction in mean square error were a procedure based on simple regression correction at each grid point and one based on lagged-average correction with one day lag at each grid point.

Schemm, Jae-Kyung E.↗

Quantitative analysis of the correlations in the Boltzmann-Grad limit for hard spheres

In this contribution I consider the problem of the validity of the Boltzmann equation for a system of hard spheres in the Boltzmann-Grad limit. I briefly review the results available nowadays with a particular emphasis on the celebrated Lanford’s validity theorem. Finally I present some recent results, obtained in collaboration with S. Simonella, concerning a quantitative analysis of the propagation of chaos. More precisely we introduce a quantity (the correlation error) measuring how close a j-particle rescaled correlation function at time t (sufficiently small) is far from the full statistical independence. Roughly speaking, a correlation error of order k, measures (in the context of the BBKGY hierarchy) the event in which k tagged particles form a recolliding group.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Impact of scintillation of transionospheric communications

Analyses of AGC analog data from the Small Astronomy Satellite (SAS) at VHF (136 MHz) have shown amplitude fluctuations in the signals received at several equatorial tracking sites operated by NASA. Coincident digital telemetry data, transmitted from SAS at 1 kbps, has also been analyzed. Errors in data are shown to increase markedly for nighttime satellite passes around the periods of the two equinoxes as compared to the errors observed during other periods. This paper establishes the qualitative and quantitative correlations between the ionospheric scintillation phenomenon and the occurrence of errors. Strong time and geographic cause and effect relationships are established by determining the statistical correlation between scintillation indices and bit error rates.

Blank, H. A.↗