Search NASASearch

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Deciphering baryonic feedback with galaxy clusters

Abstract Upcoming cosmic shear analyses will precisely measure the cosmic matter distribution at low redshifts. At these redshifts, the matter distribution is affected by galaxy formation physics, primarily baryonic feedback from star formation and active galactic nuclei. Employing measurements from theMagneticumandIllustrisTNGsimulations and a dark matter + baryon (DMB) halo model, this paper demonstrates that Sunyaev-Zel'dovich (SZ) effect observations of galaxy clusters, whose masses have been calibrated using weak gravitational lensing, can constrain the baryonic impact on cosmic shear with statistical and systematic errors subdominant to the measurement errors of DES-Y3 and LSST-Y1, with systematic errors on S 8 and Ω m reaching 10% and 50% of the statistical errors, respectively. For LSST-Y6 and Roman surveys, these systematic errors increase to 150% and 100% of the statistical errors, indicating the necessity for further model developments for future surveys. We further dissect the contributions from different scales and halos with different masses to cosmic shear, highlighting the dominant role of SZ clusters at scales critical for cosmic shear analyses. These findings suggest a promising avenue for future joint analyses of Cosmic Microwave Background (CMB) and lensing surveys.

Astronomy & Astrophysics

Cross-scale covariance for material property prediction

A simulation can stand its ground against an experiment only if its prediction uncertainty is known. The unknown accuracy of interatomic potentials (IPs) is a major source of prediction uncertainty, severely limiting the use of large-scale classical atomistic simulations in a wide range of scientific and engineering applications. Here we explore covariance between predictions of metal plasticity, from 178 large-scale (~10 8 atoms) molecular dynamics (MD) simulations, and a variety of indicator properties computed at small-scales (≤10 2 atoms). All simulations use the same 178 IPs. In a manner similar to statistical studies in public health, we analyze correlations of strength with indicators, identify the best predictor properties, and build a cross-scale “strength-on-predictors” regression model. This model is then used to estimate regression error over the statistical pool of IPs. Small-scale predictors found to be highly covariant with strength are computed using expensive quantum-accurate calculations and used to predict flow strength, within the statistical error bounds established in our study.

36 MATERIALS SCIENCE

Redshift evolution and covariances for joint lensing and clustering studies with DESI Y1

ABSTRACT Galaxy–galaxy lensing (GGL) and clustering measurements from the Dark Energy Spectroscopic Instrument Year 1 (DESI Y1) data set promise to yield unprecedented combined-probe tests of cosmology and the galaxy–halo connection. In such analyses, it is essential to identify and characterize all relevant statistical and systematic errors. We forecast the covariances of DESI Y1 GGL + clustering measurements and the systematic bias due to redshift evolution in the lens samples. Focusing on the projected clustering and GGL correlations, we compute a Gaussian analytical covariance, using a suite of N-body and lognormal simulations to characterize the effect of the survey footprint. Using the DESI one percent survey data, we measure the evolution of galaxy bias parameters for the DESI luminous red galaxy (LRG) and bright galaxy survey (BGS) samples. We find mild evolution in the LRGs in $0.4 < z < 0.8$, subdominant to the expected statistical errors. For BGS, we find less evolution for brighter absolute magnitude cuts, at the cost of reduced sample size. We find that for a redshift bin width $\Delta z = 0.1$, evolution effects on DESI Y1 GGL is negligible across all scales, all fiducial selection cuts, all fiducial redshift bins. Galaxy clustering is more sensitive to evolution due to the bias squared scaling. Nevertheless the redshift evolution effect is insignificant for clustering above the 1-halo scale of $0.1h^{-1}$ Mpc. For studies that wish to reliably access smaller scales, additional treatment of redshift evolution is likely needed. This study serves as a reference for GGL and clustering studies using the DESI Y1 sample.

79 ASTRONOMY AND ASTROPHYSICS

Enhancing ZFP: A Statistical Approach to Understanding and Reducing Error Bias in a Lossy Floating-Point Compression Algorithm

The amount of data generated and gathered in scientific simulations and data collection applications is continuously growing, putting mounting pressure on storage and bandwidth concerns. A means of reducing such issues is data compression; but, lossless data compression is typically ineffective when applied to floating-point data. Thus, users tend to apply a lossy data compressor, which allows for small deviations from the original data. It is essential to understand how the error from lossy compression impacts the accuracy of the data analytics. Thus, we must analyze not only the compression properties but the error as well. In this paper, we provide a statistical analysis of the error caused by ZFP compression, a state-of-the-art, lossy compression algorithm explicitly designed for floating-point data. We show that the error is indeed biased and propose simple modifications to the algorithm to neutralize the bias and further reduce the resulting error.

97 MATHEMATICS AND COMPUTING

Hadronic light-by-light contribution to the muon anomaly from lattice QCD with infinite volume QED at physical pion mass

The hadronic light-by-light scattering contribution to the muon anomalous magnetic moment, (g–2)⁢/2, is computed in the infinite volume QED framework with lattice QCD. We report $a^{HLbL}_μ$ = 12.47⁢(1.15)⁢(0.95) ×10 –10 where the first error is statistical and the second systematic. The result is mainly based on the 2+1 flavor Möbius domain wall fermion ensemble with inverse lattice spacing a –1 = 1.73 GeV, lattice size L = 5.5 fm, and m π = 139 MeV, generated by the RBC-UKQCD collaborations. The leading systematic error of this result comes from the lattice discretization. This result is consistent with previous determinations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Asymmetric errors

We present a procedure for handling asymmetric errors. Many results in particle physics are presented as values with different positive and negative errors, and there is no consistent procedure for handling them. We consider the difference between errors quoted, using pdfs and using likelihoods, and the difference between the rms spread of a measurement and the 68% central confidence region. We provide a comprehensive analysis of the possibilities, and software tools to enable their use.

Asymmetric

Partial wave analysis of 𝑒 + ⁢𝑒 − → 𝜋 + ⁢𝜋 − ⁢𝐽/𝜓 and cross section measurement of 𝑒 + ⁢𝑒 − → 𝜋 ± ⁢𝑍 𝑐 ⁢(3900) ∓ from 4.1271 to 4.3583 GeV

Based on 12.0 fb −1 of 𝑒 + ⁢𝑒 − collision data samples collected by the BESIII detector at center-of-mass energies from 4.1271 to 4.3583 GeV, a partial wave analysis is performed for the process 𝑒 + ⁢𝑒 − → 𝜋 + ⁢𝜋 − ⁢𝐽/𝜓. The cross sections for the subprocesses 𝑒 + ⁢𝑒 − → 𝜋 + ⁢𝑍 𝑐 ⁢(3900) − + c.c. → 𝜋 + ⁢𝜋 − ⁢𝐽/𝜓, 𝑓 0 ⁡(980)⁢(→ 𝜋 + ⁢𝜋 − )⁢𝐽/𝜓, and (𝜋 + ⁢𝜋 − ) S−wave⁢ 𝐽/𝜓 are measured for the first time. The mass and width of the 𝑍 𝑐 ⁢(3900) ± are determined to be 3884.6 ± 0.7 ± 3.3 MeV/𝑐 2 and 37.2 ± 1.3 ± 6.6 MeV, respectively. The first errors are statistical and the second systematic. The final state (𝜋 + ⁢𝜋 − ) S−wave ⁢𝐽/𝜓 dominates the process 𝑒 + ⁢𝑒 − → 𝜋 + ⁢𝜋 − ⁢𝐽/𝜓. By analyzing the cross sections of 𝜋 ±⁢ 𝑍 𝑐 ⁢(3900) ∓ and 𝑓 0 ⁡(980)⁢𝐽/𝜓, 𝑌⁡(4220) has been observed. Its mass and width are determined to be 4225.7 ± 4.1 ± 3.4 MeV/𝑐 2 and 57.5 ± 9.4 ± 12.1 MeV, respectively.

lepton colliders

Robust Design Under Uncertainty in Quantum Error Mitigation

Error mitigation techniques are crucial to achieving near-term quantum advantage. Classical postprocessing of quantum computation outcomes is a popular approach for error mitigation, which includes methods, such as zero noise extrapolation, virtual distillation, and learning-based error mitigation. However, these techniques have limitations due to the propagation of uncertainty resulting from the finite shot number of a quantum measurement. In this work, we introduce general and unbiased methods for quantifying the uncertainty and error of error-mitigated observables based on the strategic sampling of error mitigation outcomes. We then extend our approach to demonstrate the optimization of performance and robustness of error mitigation under uncertainty. To illustrate our methods, we apply them to zero noise extrapolation and Clifford date regression in the ground state of the XY model simulated using depolarizing and International Business Machines Corporation (IBM) Toronto noise models, respectively. In particular, we optimize the choice of noise levels and the allocation of shots for zero noise extrapolation and the distribution of the training circuits for Clifford data regression. While our methods are readily applicable to any postprocessing-based error mitigation approach, in practice they must not be prohibitively expensive—even though they perform optimizations of the error mitigation hyperparameters requiring sampling of a statistical distribution of error mitigation outcomes. By leveraging surrogate-based optimization, we show that our methods can efficiently perform optimal design for a zero noise extrapolation implementation. We then further demonstrate the transferability of learned zero noise extrapolation hyperparameters to other similar circuits.

97 MATHEMATICS AND COMPUTING

Taylor approximation variance reduction for approximation errors in PDE-constrained Bayesian inverse problems

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a computationally cheaper alternative to the accurate parameter-to-observable mappings and/or may ignore additional unknowns or sources of uncertainty. The Bayesian approximation error (BAE) approach provides a means to account for the induced uncertainties and approximation errors, i.e. the errors between the accurate parameter-to-observable mapping and the surrogate. The statistics of these errors are, however, in general unknown a priori, and are thus calculated using Monte Carlo sampling. Although the sampling is typically carried out offline, i.e. before considering the data, the process can still represent a computational bottleneck. In this work, we develop a scalable computational approach for reducing the costs associated with the sampling stage of the BAE approach. Specifically, we consider the Taylor expansion of the accurate and surrogate forward models with respect to the uncertain parameter fields either as a control variate for variance reduction or as a means to directly and efficiently approximate the mean and covariance of the approximation errors. We propose efficient methods for evaluating the expressions for the mean and covariance of the Taylor approximations based on linear(-ized) PDE solves. Furthermore, the proposed approach is independent of the dimension of the uncertain parameter, depending instead on the intrinsic dimension of the data, ensuring scalability to high-dimensional problems. The potential benefits of the proposed approach are demonstrated for two high-dimensional inverse problems governed by PDE examples, namely for the estimation of a distributed Robin boundary coefficient in a linear diffusion problem, and for a coefficient estimation problem governed by a nonlinear diffusion problem.

Bayesian approximation error

Unsupervised anomaly detection in MeV ultrafast electron diffraction

MeV ultrafast electron diffraction (MUED) is a pump-probe technique used to study the dynamic structural evolution of materials. An ultrashort laser pulse triggers structural changes, which are then probed by an ultrashort relativistic electron beam. To overcome low signal-to-noise ratios, diffraction patterns are averaged over thousands of shots. However, shot-to-shot instabilities in the electron beam can distort individual patterns, introducing uncertainty. Improving MUED accuracy requires detecting and removing these anomalous patterns from large datasets. In this work, we developed a fully unsupervised methodology for the detection of anomalous diffraction patterns. Using a convolutional autoencoder, we calculate the reconstruction mean squared error of the diffraction patterns. Based on the statistical analysis of this error, we provide the user an estimation of the probability that the pattern is normal, which also allows a posterior visual inspection of the images that are difficult to classify. This method has been trained with only 100 diffraction patterns and tested on 1521 patterns, resulting in a false positive rate between 0.2% and 0.4%, with a training time of 10 s per image and a test time of about 1 s per image. Here, the proposed methodology can also be applied to other diffraction techniques in which large datasets are collected that include faulty images due to instrumental instabilities.

43 PARTICLE ACCELERATORS

Physical-mass calculation of ρ ( 770 ) and K * ( 892 ) resonance parameters via π π and K π scattering amplitudes from lattice QCD

We present our study of the ρ ( 770 ) and K * ( 892 ) resonances from lattice quantum chromodynamics (QCD) employing domain-wall fermions at physical quark masses. We determine the finite-volume energy spectrum in various momentum frames and obtain phase-shift parametrizations via the Lüscher formalism and as a final step the complex resonance poles of the π π and K π elastic scattering amplitudes via an analytical continuation of the models. By sampling a large number of representative sets of underlying energy-level fits, we also assign a systematic uncertainty to our final results. This is a significant extension to data-driven analysis methods that have been used in lattice QCD to date, due to the two-step nature of the formalism. Our final pole positions, M + i Γ / 2 , with all statistical and systematic errors exposed, are M K * = 893 ( 2 ) ( 8 ) ( 54 ) ( 2 ) MeV and Γ K * = 51 ( 2 ) ( 11 ) ( 3 ) ( 0 ) MeV for the K * ( 892 ) resonance and M ρ = 796 ( 5 ) ( 15 ) ( 48 ) ( 2 ) MeV and Γ ρ = 192 ( 10 ) ( 28 ) ( 12 ) ( 0 ) MeV for the ρ ( 770 ) resonance. The four differently grouped sources of uncertainties are, in the order of occurrence: statistical, data-driven systematic, an estimation of systematic effects beyond our computation (dominated by the fact that we employ a single lattice spacing), and the error from the scale-setting uncertainty on our ensemble. Published by the American Physical Society 2025

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Impact of classical statistics on thermal conductivity predictions of BAs and diamond using machine learning molecular dynamics

Machine learning interatomic potentials (MLIPs) have greatly enhanced molecular dynamics (MD) simulations, achieving near-first-principles accuracy in thermal conductivity studies. In this work, we reveal that this accuracy, observed in BAs and diamond at sub-Debye temperatures, stems from an accidental error cancelation: classical statistics overestimates specific heat while underestimating phonon lifetimes, balancing out in thermal conductivity predictions. However, this balance is disrupted when isotopes are introduced, leading MLIP-based MD to significantly underpredict thermal conductivity compared to experiments and quantum statistics-based Boltzmann transport equation. This discrepancy arises not from classical statistics affecting phonon–isotope scattering rates but from its impact on the interplay between phonon–isotope and phonon–phonon scattering in the normal scattering-dominated BAs and diamond. In conclusion, this work underscores the limitations of MLIP-based MD for thermal conductivity studies at sub-Debye temperatures.

36 MATERIALS SCIENCE

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods

Designing ITER motional Stark effect line shift (MSE-LS) spectrometers

As a part of ITER beam aided diagnostics, the design of Motional Stark Effect (MSE) diagnostic observing the emission from the Balmer-α line is underway. The physics of Stark splitting shows that the Stark manifold is polarization dependent, and the energy splitting results in a line shift proportional to the electric field. Due to the challenges of maintaining the calibration of the plasma facing mirrors in ITER, the conventional MSE polarimetry measurement technique is replaced with a spectral approach that is deemed more favorable in the ITER environment. The MSE line shift (LS) diagnostic is designed to quantify the Lorentz electric field magnitude by measuring the Stark manifold using visible spectroscopy. In the presence of large magnetic fields and high energy heating beams of 1 MeV, the expected Stark splitting is much larger than in typical devices. The MSE-LS design has unique challenges requiring careful consideration and modeling of its viewing geometry and photon budget. The MSE-LS approach on ITER is promising but has stringent demands on the allowable errors for the statistical and systematic fitting uncertainties. In this study, a full system model and numerical simulations of data for each sightline are completed. For a range of optical transmission fractions, photon noise analysis is conducted to determine the statistical uncertainties. This provides guidance on the spectrometer throughput, dispersion at the detector, optics, and other design choices. A conceptual design of a high throughput spectrometer with a volume phase transmission grating is presented.

Instruments & Instrumentation

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS

On the use of Graphs for Test Sequence Selection

This report demonstrates that applying graph theory techniques provides a way to obtain sufficient statistics in finding errors when testing complex state machines. It discusses how to define the tests, then demonstrates how to automatically generate test suites that diversify test cases, subject to constraints. If included within a continuous integration approach, these constructs provide an unbiased means to systematically check for errors within the latest controller software release.

97 MATHEMATICS AND COMPUTING

Partnership Center for High-Fidelity Boundary Plasma Simulation (Final Report)

Within the Partnership Center for High-Fidelity Boundary Plasma Simulation (HBPS), work at UT-Austin was aimed at improved verification, validation, and uncertainty quantification (VVUQ) for edge plasma simulations and on performing gyrokinetics simulations of pedestal instabilities and turbulence in order to expand foundational understanding of pedestal transport. Regarding VVUQ, the accomplishments can be summarized as follows. First, it was shown that the Moment Preserving Constrained Resampling technique, when applied periodically in particle-in-cell simulations in the XGC code, can dramatically improve the accuracy of the simulation at essentially equivalent computational cost. Second, a technique for estimating model correlations, which are required to solve the model selection and sample allocation problem in multifidelity UQ techniques, without sampling the highest fidelity, most computationally expensive model, was developed and demonstrated. Third, previously developed methods for estimating statistical and discretization errors were applied to numerical methods relevant to edge plasma simulations, namely in particle-in-cell-based approaches, and shown to work. Finally, benchmark studies for comparing gyrokinetic codes were developed and performed, leading to reasonable agreement between four commonly used codes. Regarding physics studies, gyrokinetic simulations to investigate microtearing modes in the DIII-D pedestal were performed using the GENE code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY