Distribution of Wind Power Forecasting Errors from Operational Systems (Presentation)
This presentation offers new data and statistical analysis of wind power forecasting errors in operational systems.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation offers new data and statistical analysis of wind power forecasting errors in operational systems.
We present a weak-lensing analysis of the z approx = 1.4 galaxy cluster XMMU J2235.3 - 2557, based on deep Advanced Camera for Surveys images. Despite the observational challenge set by the high redshift of the lens, we detect a substantial lensing signal at the approx>8sigma level. This clear detection is enabled in part by the high mass of the cluster, which is verified by our both parametric and non-parametric estimation of the cluster mass. Assuming that the cluster follows a Navarro-Frenk-White mass profile, we estimate that the projected mass of the cluster within r = 1 Mpc is (8.5 +- 1.7) x 10{sup 14} M {sub sun}, where the error bar includes the statistical uncertainty of the shear profile, the effect of possible interloping background structures, the scatter in concentration parameter, and the error in our estimation of the mean redshift of the background galaxies. The high X-ray temperature 8.6{sup +1.3} {sub -1.2} keV of the cluster recently measured with Chandra is consistent with this high lensing mass. When we adopt the 1sigma lower limit as a mass threshold and use the cosmological parameters favored by the Wilkinson Microwave Anisotropy Probe 5-year (WMAP5) result, the expected number of similarly massive clusters at z approx> 1.4 in the 11 square degree survey is N approx 5 x 10{sup -3}. Therefore, the discovery of the cluster within the survey volume is a rare event with a probability approx<1% and may open new scenarios in our current understanding of cluster formation within the standard cosmological model.
We present a Bayesian method to cross-match 5,827,988 high proper-motion Gaia sources (μ > 40 mas yr{sup −1}) to various photometric surveys: Two Micron All Sky Survey, AllWISE data release from the Wide-field Infrared Explorer (WISE) mission, Galaxy Evolution Explorer, Radial Velocity Experiment, Sloan Digital Sky Survey, and Panoramic Survey Telescope and Rapid Response System (Pan-STARRS). To efficiently associate these objects across catalogs, we develop a technique that compares the multidimensional distribution of all sources in the vicinity of each Gaia star to a reference distribution of random field stars obtained by extracting all sources in a region on the sky displaced 2′. This offset preserves the local field stellar density and magnitude distribution, allowing us to characterize the frequency of chance alignments. The resulting catalog with Bayesian probabilities >95% has a marginally higher match rate than current internal Gaia data release 2 (DR2) matches for most catalogs. However, a significant improvement is found with Pan-STARRS, where ∼99.8% of the sample within the Pan-STARRS footprint is recovered, as compared to a low ∼20.8% in Gaia DR2. Using these results, we train a Gaussian process regressor to calibrate two photometric metallicity relationships. For dwarfs of 3500 < T{sub eff} < 5280 K, we use metallicity values of 4378 stars from the Apache Point Observatory Galactic Evolution Experiment and Hejazi et al. to calibrate the relationship, producing results with a 1σ precision of 0.12 dex and few systematic errors. We then indirectly infer the metallicity of 4018 stars with 2850 < T{sub eff} < 3500 K, which are wide companions of primaries whose metallicities are estimated with our first regressor, to produce a relationship with a 1σ precision of 0.21 dex and significant systematic errors. Additional work is needed to better remove unresolved binaries from this second sample to reduce these systematic errors.
Purpose: The most common metric for comparing measured to calculated dose, such as for pretreatment quality assurance of intensity-modulated photon fields, is a pass rate (%) generated using percent difference (%Diff), distance-to-agreement (DTA), or some combination of the two (e.g., gamma evaluation). For many dosimeters, the grid of analyzed points corresponds to an array with a low areal density of point detectors. In these cases, the pass rates for any given comparison criteria are not absolute but exhibit statistical variability that is a function, in part, on the detector sampling geometry. In this work, the authors analyze the statistics of various methods commonly used to calculate pass rates and propose methods for establishing confidence intervals for pass rates obtained with low-density arrays. Methods: Dose planes were acquired for 25 prostate and 79 head and neck intensity-modulated fields via diode array and electronic portal imaging device (EPID), and matching calculated dose planes were created via a commercial treatment planning system. Pass rates for each dose plane pair (both centered to the beam central axis) were calculated with several common comparison methods: %Diff/DTA composite analysis and gamma evaluation, using absolute dose comparison with both local and global normalization. Specialized software was designed to selectively sample the measured EPID response (very high data density) down to discrete points to simulate low-density measurements. The software was used to realign the simulated detector grid at many simulated positions with respect to the beam central axis, thereby altering the low-density sampled grid. Simulations were repeated with 100 positional iterations using a 1 detector/cm{sup 2} uniform grid, a 2 detector/cm{sup 2} uniform grid, and similar random detector grids. For each simulation, %/DTA composite pass rates were calculated with various %Diff/DTA criteria and for both local and global %Diff normalization techniques. Results: For the prostate and head/neck cases studied, the pass rates obtained with gamma analysis of high density dose planes were 2%-5% higher than respective %/DTA composite analysis on average (ranging as high as 11%), depending on tolerances and normalization. Meanwhile, the pass rates obtained via local normalization were 2%-12% lower than with global maximum normalization on average (ranging as high as 27%), depending on tolerances and calculation method. Repositioning of simulated low-density sampled grids leads to a distribution of possible pass rates for each measured/calculated dose plane pair. These distributions can be predicted using a binomial distribution in order to establish confidence intervals that depend largely on the sampling density and the observed pass rate (i.e., the degree of difference between measured and calculated dose). These results can be extended to apply to 3D arrays of detectors, as well. Conclusions: Dose plane QA analysis can be greatly affected by choice of calculation metric and user-defined parameters, and so all pass rates should be reported with a complete description of calculation method. Pass rates for low-density arrays are subject to statistical uncertainty (vs. the high-density pass rate), but these sampling errors can be modeled using statistical confidence intervals derived from the sampled pass rate and detector density. Thus, pass rates for low-density array measurements should be accompanied by a confidence interval indicating the uncertainty of each pass rate.
Here, we present a full Λ CDM analysis of the BOSS DR12 dataset, including information from the power spectrum multipoles, the real-space power spectrum, the reconstructed power spectrum and the bispectrum monopole. This is the first analysis to feature a complete treatment of the galaxy bispectrum, including a consistent theoretical model and without large-scale cuts. Unlike previous works, the statistics are measured using window-free estimators: this greatly reduces computational costs by removing the need to window-convolve the theory model. Our pipeline is tested using a suite of high-resolution mocks and shown to be robust and precise, with systematic errors far below the statistical thresholds. Inclusion of the bispectrum yields consistent parameter constraints and shrinks the σ 8 posterior by 13% to reach < 5 % precision; less conservative analysis choices would reduce the error bars further. Our constraints are broadly consistent with Planck: in particular, we find H 0 = 69.6$^{+1.1}_{–1.3}$ km s –1 Mpc –1 , σ 8 = 0.692$^{+0.035}_{–0.041}$ and n s = 0.870$^{+0.067}_{–0.064}$, including a BBN prior on the baryon density. When n s is set by Planck, we find H 0 = 68.31$^{+0.83}_{–0.86}$ km s –1 Mpc –1 and σ 8 = 0.722$^{+0.032}_{–0.036}$. Our S 8 posterior, 0.751 ± 0.039, is consistent with weak lensing studies, but lower than Planck. Constraints on the higher-order bias parameters are significantly strengthened from the inclusion of the bispectrum, and we find no evidence for deviation from the dark matter halo bias relations. These results represent the most complete full-shape analysis of BOSS DR12 to-date, and the corresponding spectra will enable a variety of beyond-Λ CDM analyses, probing phenomena such as the neutrino mass and primordial non-Gaussianity.
In this paper, we present a systematic approach for characterization and reconstruction of statistically optimal representative unit cells of polydisperse particulate composites. Microtomography is used to gather rich three-dimensional data of a packed glass bead system. First-, second-, and third-order probability functions are used to characterize the morphology of the material, and the parallel augmented simulated annealing algorithm is employed for reconstruction of the statistically equivalent medium. Both the fully resolved probability spectrum and the geometrically exact particle shapes are considered in this study, rendering the optimization problem multidimensional with a highly complex objective function. A ten-phase particulate composite composed of packed glass beads in a cylindrical specimen is investigated, and a unit cell is reconstructed on massively parallel computers. Further, rigorous error analysis of the statistical descriptors (probability functions) is presented and a detailed comparison between statistics of the voxel-derived pack and the representative cell is made.
The muon anomaly aµ is one of the most precise quantity known in physics experimentally and theoretically. The high level of accuracy permits to use the measurement of aµ as a test of the Standard Model comparing with the theoretical calculation. After the impressive result obtained at Brookhaven National Laboratory in 2001 with a total accuracy of 0.54 ppm, a new experiment E989 is under construction at Fermilab, motivated by the diff of aexp SM µ − aµ ∼ 3σ. The purpose of the E989 experiment is a fourfold reduction of the error, with a goal of 0.14 ppm, improving both the systematic and statistical uncertainty. With the use of the Fermilab beam complex a statistic of × 21 with respect to BNL will be reached in almost 2 years of data taking improving the statistical uncertainty to 0.1 ppm. Improvement on the systematic error involves the measurement technique of ωa and ωp, the anomalous precession frequency of the muon and the Larmor precession frequency of the proton respectively. The measurement of ωp involves the magnetic field measurement and improvements on this sector related to the uniformity of the field should reduce the systematic uncertainty with respect to BNL from 170 ppb to 70 ppb. A reduction from 180 ppb to 70 ppb is also required for the measurement of ωa; new DAQ, a faster electronics and new detectors and calibration system will be implemented with respect to E821 to reach this goal. In particular the laser calibration system will reduce the systematic error due to gain fl of the photodetectors from 0.12 to 0.02 ppm. The 0.02 ppm limit on systematic requires a system with a stability of 10−4 on short time scale (700 µs) while on longer time scale the stability is at the percent level. The 10−4 stability level required is almost an order of magnitude better than the existing laser calibration system in particle physics, making the calibration system a very challenging item. In addition to the high level of stability a particular environment, due to the presence of a 14 m diameter storage ring, a highly uniform magnetic field and the detector distribution around the storage ring, set specific guidelines and constraints. This thesis will focus on the final design of the Laser Calibration System developed for the E989 experiment. Chapter 1 introduces the subject of the anomalous magnetic moment of the muon; chapter 2 presents previous measurement of g-2, while chapter 3 discusses the Standard Model prediction and possible new physics scenario. Chapter 4 describes the E989 experiment. In this chapter will be described the experimental technique and also will be presented the experimental apparatus focusing on the improvements necessary to reduce the statistical and systematic errors. The main item of the thesis is discussed in the last two chapters: chapter 5 is focused on the Laser Calibration system while chapter 6 describes the Test Beam performed at the Beam Test Facility of Laboratori Nazionali di Frascati from the 29th February to the 7th March as a final test for the full calibrations system. An introduction explain the physics motivation of the system and the diff t devices implemented. In the final chapter the setup used will be described and some of the results obtained will be presented.
This paper studies the use of several type of curve fitting method to smooth the global solar radiation data. After the data have been fitted by using curve fitting method, the mathematical model of global solar radiation will be developed. The error measurement was calculated by using goodness-fit statistics such as root mean square error (RMSE) and the value of R{sup 2}. The best fitting methods will be used as a starting point for the construction of mathematical modeling of solar radiation received in Universiti Teknologi PETRONAS (UTP) Malaysia. Numerical results indicated that Gaussian fitting and sine fitting (both with two terms) gives better results as compare with the other fitting methods.
Environmental heterogeneity, an important influence on organisms and ecological processes, can be quantified by the variance of an environmental characteristic over all locations within a study extent. However on landscapes with autocorrelation and gradient patterns, estimating this variance from a sample of locations may lead to errors that cannot be corrected with statistical techniques. We analytically derived the relative expected sampling error of sample designs on landscapes with particular gradient pattern and autocorrelation features. We applied this closed-form approach to temperature observations from an existing study. The expected heterogeneity differed, both in magnitude and direction, amongst sample designs over the study site's likely range of autocorrelation and gradient features. We conducted a simulation study to understand the effects of (i) landscape variability and (ii) design variability on an average sampling error. On 10 000 simulated landscapes with varying gradient and autocorrelation features, we compared estimates of variance from a variety of structured and random sample designs. While gradient patterns and autocorrelation cause large errors for some designs, others yield near-zero average sampling error. Sample location spacing is a key factor in sample design performance. Random designs have larger range of possible sampling errors than structured designs due to the potential for sample arrangements that over- and under-sample certain areas of the landscape. Furthermore, when implementing a new sample design to quantify environmental heterogeneity via variance, we recommend using a simple structured design with appropriate sample spacing. For existing designs, we recommend calculating the relative expected sampling error via our analytical derivation.
Environmental samples contain a vast array of organic compounds with diverse elemental compositions and heteroatom content. Molecular formula assignments of ultrahigh resolution mass spectra (HRMS) hold promise for elucidating the molecular composition of these compounds. However, the need to account for an assortment of heteroatoms increases the uncertainty associated with individual assignments – and ultimately the ecological, biological, and biogeochemical insights gleaned from the assignments. To address this challenge, we introduce a formula assignment strategy that leverages HRMS data sets to improve assignment confidence, filter false assignments, and mitigate bias in assignment routines. The strategy, implemented using CoreMS, first identifies the highest confidence assignment for a recurring ion in a data set by assessing the mass accuracy and isotopologue similarity of all assignments to the ion across the data set. The second component of the strategy examines the consistency of mass errors for an assigned ion throughout a data set and flags formulas with statistically unlikely deviations in mass error. Here, we illustrate the application and utility of the strategy by comparing its results against documented misassignment patterns within a set of oceanographic samples that were measured with 21 T Fourier Transform Ion Cyclotron Resonance Mass Spectrometry. Because the efficacy of our strategy improves with data set size, it is particularly useful for enhancing assignment confidence in large HRMS data sets common in studies of environmental systems.
An in situ counted ion implantation experiment improving the error on the number of ions required to form a single optically active silicon vacancy (SiV) defect in diamond 7-fold compared to timed implantation is presented. Here, traditional timed implantation relies on a beam current measurement followed by implantation with a preset pulse duration. It is dominated by Poisson statistics, resulting in large errors for low ion numbers. Instead, our in situ detection, measuring the ion number arriving at the substrate, results in a 2-fold improvement of the error on the ion number required to generate a single SiV compared to timed implantation. Through postimplantation analysis, the error is improved 7-fold compared to timed implantation. SiVs are detected by photoluminescence spectroscopy, and the yield of 2.98% is calculated through the photoluminescence count rate. Hanbury–Brown–Twiss interferometry is performed on locations potentially hosting single-photon emitters, confirming that 82% of the locations exhibit single photon emission statistics.
We present observational constraints on the nature of dark energy using the Supernova Legacy Survey three-year sample (SNLS3) of Guy et al. and Conley et al. We use the 472 Type Ia supernovae (SNe Ia) in this sample, accounting for recently discovered correlations between SN Ia luminosity and host galaxy properties, and include the effects of all identified systematic uncertainties directly in the cosmological fits. Combining the SNLS3 data with the full WMAP7 power spectrum, the Sloan Digital Sky Survey luminous red galaxy power spectrum, and a prior on the Hubble constant H{sub 0} from SHOES, in a flat universe we find {Omega}{sub m} = 0.269 {+-} 0.015 and w = -1.061{sup +0.069}{sub -} 0{sub .068} (where the uncertainties include all statistical and SN Ia systematic errors)-a 6.5% measure of the dark energy equation-of-state parameter w. The statistical and systematic uncertainties are approximately equal, with the systematic uncertainties dominated by the photometric calibration of the SN Ia fluxes-without these calibration effects, systematics contribute only a {approx}2% error in w. When relaxing the assumption of flatness, we find {Omega}{sub m} = 0.271 {+-} 0.015, {Omega}{sub k} = -0.002 {+-} 0.006, and w = -1.069{sup +0.091}{sub -0.092}. Parameterizing the time evolution of w as w(a) = w{sub 0} + w{sub a} (1 - a) gives w{sub 0} = -0.905 {+-} 0.196, w{sub a} = -0.984{sup +1.094}{sub -1.097} in a flat universe. All of our results are consistent with a flat, w = -1 universe. The size of the SNLS3 sample allows various tests to be performed with the SNe segregated according to their light curve and host galaxy properties. We find that the cosmological constraints derived from these different subsamples are consistent. There is evidence that the coefficient, {beta}, relating SN Ia luminosity and color, varies with host parameters at >4{sigma} significance (in addition to the known SN luminosity-host relation); however, this has only a small effect on the cosmological results and is currently a subdominant systematic.
The current generation of large galaxy surveys will test the cosmological model by combining multiple types of observational probes. Realising the statistical promise of these new datasets requires rigorous attention to all aspects of analysis including cosmological measurements, modelling, covariance and parameter likelihood. In this paper we present the results of an end-to-end simulation study designed to test the analysis pipeline for the combination of the Dark Energy Spectroscopic Instrument (DESI) Year 1 galaxy redshift dataset and separate weak gravitational lensing information from the Kilo-Degree Survey, Dark Energy Survey and Hyper-Suprime-Cam Survey. Our analysis employs the 3x2-pt correlation functions including cosmic shear and galaxy-galaxy lensing, together with the projected correlation function of the spectroscopic DESI lenses. We build realistic simulations of these datasets including galaxy halo occupation distributions, photometric redshift errors, weights, multiplicative shear calibration biases and magnification. We calculate the analytical covariance of these correlation functions including the Gaussian, noise and super-sample contributions, and show that our covariance determination agrees with estimates based on the ensemble of simulations. We use a Bayesian inference platform to demonstrate that we can recover the fiducial cosmological parameters of the simulation within the statistical error margin of the experiment, investigating the sensitivity to scale cuts. This study is the first in a sequence of papers in which we present and validate the large-scale 3x2-pt cosmological analysis of DESI-Y1.
A common problem in astrophysics is determining how bright a source could be and still not be detected in an observation. Despite the simplicity with which the problem can be stated, the solution involves complicated statistical issues that require careful analysis. In contrast to the more familiar confidence bound, this concept has never been formally analyzed, leading to a great variety of often ad hoc solutions. Here we formulate and describe the problem in a self-consistent manner. Detection significance is usually defined by the acceptable proportion of false positives (background fluctuations that are claimed as detections, or Type I error), and we invoke the complementary concept of false negatives (real sources that go undetected, or Type II error), based on the statistical power of a test, to compute an upper limit to the detectable source intensity. To determine the minimum intensity that a source must have for it to be detected, we first define a detection threshold and then compute the probabilities of detecting sources of various intensities at the given threshold. The intensity that corresponds to the specified Type II error probability defines that minimum intensity and is identified as the upper limit. Thus, an upper limit is a characteristic of the detection procedure rather than the strength of any particular source. It should not be confused with confidence intervals or other estimates of source intensity. This is particularly important given the large number of catalogs that are being generated from increasingly sensitive surveys. We discuss, with examples, the differences between these upper limits and confidence bounds. Both measures are useful quantities that should be reported in order to extract the most science from catalogs, though they answer different statistical questions: an upper bound describes an inference range on the source intensity, while an upper limit calibrates the detection process. We provide a recipe for computing upper limits that applies to all detection algorithms.
Abstract This work considers the use of classifiers in a downstream aggregation task estimating class proportions, such as estimating the percentage of reviews for a movie with positive sentiment. We derive the bias and variance of the class proportion estimator when taking classification error into account to determine how to best trade off different error types when tuning a classifier for these tasks. Additionally, we propose a method for constructing confidence intervals that correctly adjusts for classification error when estimating these statistics. We conduct experiments on four document classification tasks comparing our methods to prior approaches across classifier thresholds, sample sizes, and label distributions. Prior approaches have focused on providing the most accurate point estimate while this work focuses on the creation of correct confidence intervals that appropriately account for classifier error. Compared to the prior approaches, our methods provide lower error and more accurate confidence intervals.
Purpose: To estimate the radiobiological parameters that describe the doseresponse relations of xerostomia and disgeusia from head and neck cancer radiotherapy. To identify the organs that are best correlated with the manifestation of those clinical endpoints. Finally, to evaluate the goodnessof- fit by comparing the model predictions against the actual clinical results. Methods: In this study, 349 head and neck cancer patients were included. For each patient the dose volume histograms (DVH) of parotids (separate and combined), mandible, submandibular glands (separate and combined) and salivary glands were calculated. The follow-up of those patients was recorded at different times after the completion of the treatment (7 weeks, 3, 7, 12, 18 and 24 months). Acute and late xerostomia and acute disgeusia were the clinical endpoints examined. A maximum likelihood fitting was performed to calculate the best estimates of the parameters used by the relative seriality model. The statistical methods of the error distribution, the receiver operating characteristic (ROC) curve, the Pearson's test and the Akaike's information criterion were utilized to assess the goodness-of-fit and the agreement between the pattern of the radiobiological predictions with that of the clinical records. Results: The estimated values of the radiobiological parameters of salivary glands are D50 = 25.2 Gy, γ = 0.52, s = 0.001. The statistical analysis confirmed the clinical validity of those parameters (area under the ROC curve = 0.65 and AIC = 38.3). Conclusion: The analysis proved that the treatment outcome pattern of the patient material can be reproduced by the relative seriality model and the estimated radiobiological parameters. Salivary glands were found to have strong volume dependence (low relative seriality). Diminishing the biologically effective uniform dose to salivary glands below 30 Gy may significantly reduce the risk of complications to the patients irradiated for prostate cancer.
The recently developed 'data set diagonalization' method is applied to measure compatibility of the data sets that are used to determine parton distribution functions. Discrepancies among the experiments are found to be somewhat larger than is predicted by propagating the published experimental errors according to Gaussian statistics. The results support a tolerance criterion of {Delta}{chi}{sup 2{approx_equal}}10 to estimate the 90% confidence range for parton distribution function uncertainties. No basis is found in the data sets for the larger {Delta}{chi}{sup 2} values that are in current use, though it may be necessary to retain those larger values until improved methods can be developed to take account of systematic errors in applying the theory, including the effect of parametrization dependence. The data set diagonalization method also measures how much influence each experiment has on the global fit and identifies experiments that show significant tension with respect to the others. The method is used to explore the contribution from muon scattering experiments, which are found to exhibit the largest discrepancies in the current fit.
Free electrons in the interstellar medium cause frequency-dependent delays in pulse arrival times due to both scattering and dispersion. Multi-frequency measurements are used to estimate and remove dispersion delays. In this paper, we focus on the effect of any non-simultaneity of multi-frequency observations on dispersive delay estimation and removal. Interstellar density variations combined with changes in the line of sight from pulsar and observer motions cause dispersion measure (DM) variations with an approximately power-law power spectrum, augmented in some cases by linear trends. We simulate time series, estimate the magnitude and statistical properties of timing errors that result from non-simultaneous observations, and derive prescriptions for data acquisition that are needed in order to achieve a specified timing precision. For nearby, highly stable pulsars, measurements need to be simultaneous to within about one day in order for the timing error from asynchronous DM correction to be less than about 10 ns. We discuss how timing precision improves when increasing the number of dual-frequency observations used in DM estimation for a given epoch. For a Kolmogorov wavenumber spectrum, we find about a factor of two improvement in precision timing when increasing from two to three observations but diminishing returns thereafter.