Search NASA⌕ Search

SEARCH · Search NASA

Results for “Covariance and correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Structure in the event-by-event energy-dependent neutron-$γ$ multiplicity correlations in 252 Cf(sf)

The emission of neutrons and γ rays by fission fragments reveal important information about the properties of fragments immediately following scission. The initial fragment properties, correlations between fragments, and emission competition give rise to correlations in neutron-γ emission. Recent theoretical and experimental advances have been proposed to explain the mechanism of angular momentum generation in fission, which would result in observable signature in neutron-γ emission correlations. In this paper, we present a novel analysis method of neutrons and γ rays emitted by fission fragments that allows us to discern structure in the observed correlations. We have analyzed data collected on 252 Cf (sf) at the Chi-Nu array at the Los Alamos Neutron Science Center. Through our analysis of the energy-differential neutron-γ multiplicity covariance, we have observed enhanced neutron-γ correlations, corresponding to rotational band γ-ray transitions, at γ-ray energies of 0.7 and 1.2 MeV. To shed light on the origin of this structure, we compare the experimental data with the predictions of three model calculations. The origin of the observed correlation structure is understood in terms of a positive spin-energy correlation in the generation of angular momentum in fission.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

(U) A General-Purpose Code for Correlated Sampling Using Batch Statistics with MCNP6 for Fixed-Source Problems

Correlated sampling can be used to reduce the uncertainty of a difference of tallies by taking advantage of the negative covariance term in the sandwich formula. Booth first showed how correlated sampling can be applied with batch statistics using MCNP’s tally fluctuation chart (TFC) to reduce the uncertainty of a difference of tallies in fixed-source problems. Booth presented a problem in which a 1273% uncertainty in a difference was reduced to 8% by accounting for correlations. Researchers He and Su recently studied correlated sampling using the TFC in MCNP version 5. They determined that the code did not print enough digits in the TFC tally means for accurate batch statistics in some cases. After modifying the source code, they concluded that “correlated sampling can yield a standard deviation of about one magnitude smaller than that predicted by the direct, un-correlated simulation when the changes in system response are small (say about 1%), which is equivalent to saving in CPU time by a factor of 100. Such saving [sic] becomes less significant as the change in system response becomes larger.” He and Su provided the formulas needed to apply batch statistics to compute the correlated uncertainty of a difference of tallies. In this report, we follow up on their work by providing the formulas needed to apply batch statistics to compute the correlated uncertainty of a ratio of tallies and of a difference of two tallies divided by a third tally. We extend these formulas to differences and ratios of ratios. These formulas are applied to reduce the uncertainty associated with calculating a relative sensitivity. He and Su did not investigate the accuracy of their correlated sampling uncertainty estimates. We use their test problems and evaluate the accuracy of the uncertainty estimates by comparing with results obtained from random sampling, and, in simple cases, with theoretical values of the “exact” uncertainties. We find that the uncertainties obtained from batch statistics are accurate as long as at least 100 batches are used. We present a new computer code, COSUBS (COrrelated Sampling Using Batch Statistics), that reads MCNP6 TFCs and applies correlated sampling using batch statistics for the tally combinations that the user specifies. COSUBS is a very general tool that compares all TFCs for a base case and one or two perturbed cases. It computes uncertainties for ratios if given only a base case. This report is organized as follows. The equations to apply batch statistics to the difference of random tallies are reviewed in Sec. II. Section III presents the equations for applying batch statistics to a ratio of random tallies; this is useful for computing relative sensitivities using a one-sided finite difference and the relative sensitivity using the differential operator method. Section IV presents the equations for applying batch statistics to a difference of two random tallies divided by a third; this is useful for computing a relative sensitivities using a central difference. Section V presents the equations for applying batch statistics to a difference of two ratios with four random tallies. Section VI presents the equations for applying batch statistics to a one-sided finite difference estimate of the relative sensitivity of a ratio (this uses four random tallies). Section VII presents the equations for applying batch statistics to a central difference estimate of the relative sensitivity of a ratio (this uses six random tallies). Section VIII presents the equations for applying batch statistics to a sum of random tallies. Section IX discusses how to apply batch statistics using MCNP6. Section X presents COSUBS, describing its command-line options and logic. Sections XI through XVI present numerical results for various test problems. Section XVII is a summary and conclusions. Appendix A derives the theoretical Monte Carlo tally variance given certain assumptions; these variances are used to verify the batch statistics for some of the problems. Appendix B lists the MCNP6 input for the unperturbed example problem. Appendix C presents modifications made to MCNP6.3 to support this work.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts between experiments, such as fuel, which creates a strong correlation in their errors. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts, such as fuel, which create a strong correlation in their uncertainties. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. Without covariances, χ 2 per degree of freedom was calculated as 2.203 and with covariances it was 1.179. The difference shows that omitting covariance information may cause overly pessimistic bias quantifications. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Applying a Template of Expected Uncertainties to Updating 239 Pu(n,f) Cross-section Covariances in the Neutron Data Standards Database

Templates of uncertainties expected in specific measurement types were recently developed. One aim of these templates is to help evaluators in identifying (1) missing or suspiciously low uncertainties and (2) missing correlations between uncertainties of the same and different experiments, when estimating covariances for experimental data employed in their evaluations. These templates also provide realistic estimates of standard deviations and correlations for a particular uncertainty source and measurement type that can be used by evaluators in situations where they are not supplied by the experimenters. This information allows for a more comprehensive uncertainty analysis across all measurements considered in an evaluation and, thus, more realistic evaluated covariances. Here, in this work, we extend a template that is applicable to uncertainties expected in neutron-induced fission, (n,f), cross-section measurements. It is applied to improving covariances of 239 Pu(n,f) cross-section measurements in the database underlying the Neutron Data Standards evaluations. This particular example was chosen since this evaluation is primarily based on experimental information. Also, some uncertainties of individual 239 Pu(n,f) cross-section experiments in this database were suspected to be underestimated. The evaluated uncertainties obtained after updating the covariances in the database by means of the template indeed do increase compared to their original values. Even more importantly, the evaluated mean values change noticeably. These modified cross sections impact application calculations significantly, as is demonstrated by employing them in simulations of the effective neutron multiplication factor for a few selected critical assemblies. However, this updated evaluated 239 Pu(n,f) cross section should not be interpreted as the final one that should replace values of the current Neutron Data Standards project. Evaluations for the Neutron Data Standards of the 239 Pu(n,f) cross section must be linked to many other observables included in the associated database, most notably to cross sections for 235 U(n,f), but also to those for 10 B(n, α ), 6 Li(n,t), 238 U(n,f), and 238 U(n, γ ), because of included measurements of the 239 Pu(n,f) cross section that appear as ratios to these reactions. Some of these other reactions are correlated to further observables in the database. Hence, updating uncertainties of data sets of any of these observables can potentially impact the 239 Pu(n,f) cross section. Uncertainties for all measurements of these linked physical observables have to be updated before a comprehensive evaluation of the 239 Pu(n,f) cross section and its corresponding uncertainties can be provided.

239Pu Neutron-induced fission cross-section↗
DOE OSTI2022

Clustering with general photo- z uncertainties: application to Baryon Acoustic Oscillations

ABSTRACT Photometric data can be analysed using the 3D correlation function ξp to extract cosmological information via e.g. measurement of the Baryon Acoustic Oscillations (BAO). Previous studies modeled ξp assuming a Gaussian photo-z approximation. In this work we improve the modeling by incorporating realistic photo-z distribution. We show that the position of the BAO scale in ξp is determined by the photo-z distribution and the Jacobian of the transformation. The latter diverges at the transverse scale of the separation s⊥, and it explains why ξp traces the underlying correlation function at s⊥, rather than s, when the photo-z uncertainty σz/(1+ z) ≳ 0.02. We also obtain the Gaussian covariance for ξp. Due to photo-z mixing, the covariance of ξp shows strong off-diagonal elements. The high correlation of the data causes some issues to the data fitting. None the less, we find that either it can be solved by suppressing the largest eigenvalues of the covariance or it is not directly related to the BAO. We test our BAO fitting pipeline using a set of mock catalogs. The data set is dedicated for Dark Energy Survey Year 3 (DES Y3) BAO analyses and includes realistic photo-z distributions. The theory template is in good agreement with mock measurement. Based on the DES Y3 mocks, ξp statistic is forecast to constrain the BAO shift parameter α to be 1.001 ± 0.023, which is well consistent with the corresponding constraint derived from the angular correlation function measurements. Thus, ξp offers a competitive alternative for the photometric data analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

The DESI-Lensing Mock Challenge: large-scale cosmological analysis of 3x2-pt statistics

The current generation of large galaxy surveys will test the cosmological model by combining multiple types of observational probes. Realising the statistical promise of these new datasets requires rigorous attention to all aspects of analysis including cosmological measurements, modelling, covariance and parameter likelihood. In this paper we present the results of an end-to-end simulation study designed to test the analysis pipeline for the combination of the Dark Energy Spectroscopic Instrument (DESI) Year 1 galaxy redshift dataset and separate weak gravitational lensing information from the Kilo-Degree Survey, Dark Energy Survey and Hyper-Suprime-Cam Survey. Our analysis employs the 3x2-pt correlation functions including cosmic shear and galaxy-galaxy lensing, together with the projected correlation function of the spectroscopic DESI lenses. We build realistic simulations of these datasets including galaxy halo occupation distributions, photometric redshift errors, weights, multiplicative shear calibration biases and magnification. We calculate the analytical covariance of these correlation functions including the Gaussian, noise and super-sample contributions, and show that our covariance determination agrees with estimates based on the ensemble of simulations. We use a Bayesian inference platform to demonstrate that we can recover the fiducial cosmological parameters of the simulation within the statistical error margin of the experiment, investigating the sensitivity to scale cuts. This study is the first in a sequence of papers in which we present and validate the large-scale 3x2-pt cosmological analysis of DESI-Y1.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches

Abstract In complex systems with multiple variables monitored at high‐frequency, variables are not only temporally autocorrelated, but they may also be nonlinearly related or exhibit nonstationarity as the inputs or operation changes. One approach to handling such variables is to detrend them prior to monitoring and then apply control charts that assume independence and stationarity to the residuals. Monitoring controlled systems is even more challenging because the control strategy seeks to maintain variables at prespecified mean levels, and to compensate, correlations among variables may change, making monitoring the covariance essential. In this paper, a vector autoregressive model (VAR) is compared with a multivariate random forest (MRF) and a neural network (NN) for detrending multivariate time series prior to monitoring the covariance of the residuals using a multivariate exponentially weighted moving average (MEWMA) control chart. Machine learning models have an advantage when the data's structure is unknown or may change. We design a novel simulation study with nonlinear, nonstationary, and autocorrelated data to compare the different detrending models and subsequent covariance monitoring. The machine learning models have superior performance for nonlinear and strongly autocorrelated data and similar performance for linear data. An illustration with data from a reverse osmosis process is given.

Weix, Derek↗
DOE OSTI2020

Super-CMB fluctuations and the Hubble tension

We study the covariance in the angular power spectrum estimates of CMB fluctuations when the primordial fluctuations are non-Gaussian. The non-Gaussian covariance comes from a nonzero connected four-point correlation function -- or the trispectrum in Fourier space -- and can be large when long-wavelength (super-CMB) modes are strongly coupled to short-wavelength modes. The effect of such non-Gaussian covariance can be modeled through additional freedom in the theoretical CMB angular power spectrum and can lead to different inferred values of the standard cosmological parameters relative to those in ΛCDM. Taking the collapsed limit of the primordial trispectrum in the quasi-single field inflation model as an example, we study how the six standard ΛCDM parameters shift when two additional parameters describing the trispectrum are allowed. The reduced statistical significance of the Hubble tension in the extended model allows us to combine the {\it Planck} temperature data and the type Ia supernovae data from Panstarrs with the distance-ladder measurement of the Hubble constant. Here, this combination of data shows strong evidence for a primordial trispectrum-induced non-Gaussian covariance, with a likelihood improvement of Δχ 2 ≈ –15 (with two additional parameters) relative to ΛCDM.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Covariance Shaping Over Riemannian Manifolds for Massive MIMO Communication

Acquiring accurate instantaneous channel state information (CSI) is a challenging aspect of massive multi-input multi-output (MIMO) communication. Utilizing statistical information, such as channel covariance matrix, to design statistical beamforming vectors is robust when compared to instantaneous CSI. In this paper, we propose a novel MIMO covariance shaping scheme over Riemannian manifolds. It serves as an effective statistical beamforming solution to a number of close proximity user equipment (UE) that are undergoing substantial channel correlation. Proposed algorithm exploits the Hermitian positive definite nature of covariance matrices lying over Riemannian manifold. We introduce Wasserstein distance function as a Riemannian metric to measure distances between channel covariance matrices. Furthermore, K-means clustering technique is utilized to effectively identify the optimal shape of effective optimal covariance matrices. Our findings suggest that maximizing the geodesic distance between covariance matrices ultimately leads to a corresponding increase in the network throughput, as determined by the beamforming vector used to shape the covariance matrices. Simulation results validate that the proposed solution converges faster than Euclidean-based state-of-the-art, while maintaining the same computational complexity. Finally, the sum rate performance asymptotically achieves full capacity for two-UE case and more than 96% of the upper bound exhaustive search benchmark for multi-UE scenario.

42 ENGINEERING↗
DOE OSTI2025

Aspects of propagator sparsening in lattice QCD

In lattice field theory, field sparsening aims to replace quantum fields, or objects constructed from them, with approximations that preserve the appropriate symmetries and maintain many aspects of the physics that the fields determine. For example, an effective sparsening of a quark propagator provides an efficient map from a quark propagator on a fine lattice geometry to a quark propagator defined on a coarser geometry in order to reduce storage and computational costs of subsequent calculational stages while maintaining long-distance correlations and corresponding low-energy physical information. Previous studies have focused on decimating lattice sites or randomly sampling lattice sites to reduce the size of the propagator and subsequent costs of Wick contractions. Here, we extend the study of sparsening to incorporate covariant averaging of spatial sites and examine the effects on two-point and three-point correlation functions involving various hadrons. We find that sparsening is most effective in reproducing the unsparsened versions of these correlation functions when weighted covariant-averaging is sequentially applied many times.

Lattice QCD↗
DOE OSTI2021

Noise and error analysis and optimization in particle-based kinetic plasma simulations

In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constant density, p(x), still with continuous x, we analyze the total error in the density estimation and discuss it in terms of bias-variance optimization (BVO). For some characteristic length l, determined by the density and its second derivative, and kernel width h, having too few particles within h leads to too much variance; for h that is large relative to l, there is too much smoothing of the density. The optimum between these two limits is found by BVO. For kernels of the same width, it is shown that this optimum (minimum) is weakly sensitive to the kernel shape. Next, we repeat the analysis for x discretized on a grid. In this case the charge deposition rule is determined by a particle shape. An important property to be respected in the discrete system is the exact preservation of total charge on the grid; this property is necessary to ensure that the electric field is equal at both ends, consistent with periodic boundary conditions. We find that if the particle shapes satisfy a partition of unity property, the particle charge deposited on the grid is conserved exactly. Further, if the particle shape is expressed as the convolution of a kernel with another kernel that satisfies the partition of unity, then the particle shape obeys the partition of unity. This property holds for kernels of arbitrary width, including widths that are not integer multiples of the grid spacing. Furthermore, we show results relaxing the approximations used to do BVO optimization analytically, by doing numerical computations of the total error as a function of the kernel width, on a grid in x. The comparison between numerical and analytical results shows good agreement over a range of particle shapes. We discuss the practical implications of our results, including the criteria for design and implementation of computationally efficient particle shapes that take advantage of the developed theory.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

A Stochastic Covariance Shrinkage Approach in Ensemble Transform Kalman Filtering

The Ensemble Kalman Filters (EnKF) employ a Monte-Carlo approach to represent covariance information, and are affected by sampling errors in operational settings where the number of model realizations is much smaller than the model state dimension. To alleviate the effects of these errors EnKF relies on model-specific heuristics such as covariance localization, which takes advantage of the spatial locality of correlations among the model variables. This work proposes an approach to alleviate sampling errors that utilizes a locally averaged-in-time dynamics of the model, described in terms of a climatological covariance of the dynamical system. We use this covariance as the target matrix in covariance shrinkage methods, and develop a stochastic covariance shrinkage approach where synthetic ensemble members are drawn to enrich both the ensemble subspace and the ensemble transformation. We additionally provide for a way in which this methodology can be localized similar to the state-of-the-art LETKF method, and that for a certain model setup, our methodology significantly outperforms it.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

The Correlation of Mesoscale Humidity Anomalies With Mesoscale Organization of Marine Stratocumulus From Observations Over the ARM Eastern North Atlantic Site

The structure of mesoscale cellular organization in marine cloud-topped boundary layers is found to be well characterized by using a novel compositing approach based on mesoscale variations in the column water vapor path (WVP). The approach is applied to ground-based observations from the Atmospheric Radiation Measurement (ARM) Eastern North Atlantic site. Based on a set of satellite and ground-based observational criteria, 381 hr of closed-cell and 227 hr of open-cell cases were selected from late 2015 to early 2018. Strong correlations are found between mesoscale-filtered cloud properties and WVP for both closed-cell and open-cell regimes. In the moist atmospheric columns, the clouds are thicker with higher tops and lower bases, and stronger precipitation compared to that in the dry columns. Overall, cloud properties of open and closed cells covary similarly with mesoscale moisture perturbations, except that the correlation of liquid water path with WVP is much weaker for open cells. The relations of subcloud properties with WVP are also examined. In the moist columns, surface equivalent potential temperature and relative humidity are higher than in the dry columns. A marginally negative correlation between mesoscale-filtered subcloud turbulence eddy dissipation rate and WVP is found for closed cells. These results are consistent with the conceptual model of closed cellular mesoscale circulations of Zhou and Bretherton (2019).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Imaging Three-Dimensional Molecular Structure and Dynamics with Multiparticle Covariance and Cumulant Coulomb Explosion Analysis

Coulomb explosion imaging (CEI) provides a direct means of imaging molecular geometry by correlating fragment ion momenta following the fragmentation of a molecular polycation. Here, we demonstrate the use of three-body covariance and four-body cumulant analysis to extract three-dimensional (3D) structural information from the X-ray-induced Coulomb explosion of tert-butyl iodide (C4H9I). Site-selective ionization at the iodine 4d edge with intense femtosecond soft X-ray pulses from an X-ray free-electron laser (XFEL) enables rapid charge buildup and molecular breakup. By correlating ionic fragments in the molecular frame, we isolate complete dissociation channels and reveal subtle structural changes, such as umbrella-type motion of the branched alkyl chain, during the ionization process. Comparison with point-charge simulations of the Coulomb explosion shows close agreement, validating the approach. Furthermore, these results establish covariance/cumulant mapping as a powerful strategy for imaging complex three-dimensional molecular structures and point the way toward time-resolved CEI using both XFEL and tabletop sources for capturing ultrafast structural dynamics.

Imaging↗
DOE OSTI2022

CoLoRe: fast cosmological realisations over large volumes with multiple tracers

We present CoLoRe, a public software package to efficiently generate synthetic realisations of multiple cosmological surveys.CoLoRe can simulate the growth of structure with different degrees of accuracy, with the current implementation supporting lognormal fields, first, and second order Lagrangian perturbation theory.CoLoRe simulates the density field on an all-sky light-cone up to a desired maximum redshift, and uses it to generate multiple 2D and 3D maps: galaxy positions and velocities, lensing (shear, magnification, convergence), integrated Sachs-Wolfe effect, line intensity mapping, and line of sight skewers for simulations of the Lyman-α forest. We test the accuracy of the simulated maps against analytical theoretical predictions, and showcase its performance with a multi-survey simulation including DESI galaxies and quasars, LSST galaxies and lensing, and SKA intensity mapping and radio galaxies. We expect CoLoRe to be particularly useful in studies aiming to characterise the impact of systematics in multi-experiment analyses, quantify the covariance between different datasets, and test cross-correlation pipelines for near-future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Indra: a public computationally accessible suite of cosmological N -body simulations

ABSTRACT Indra is a suite of large-volume cosmological N-body simulations with the goal of providing excellent statistics of the large-scale features of the distribution of dark matter. Each of the 384 simulations is computed with the same cosmological parameters and different initial phases, with 10243 dark matter particles in a box of length 1 h−1 Gpc, 64 snapshots of particle data and halo catalogues, and 505 time-steps of the Fourier modes of the density field, amounting to almost a petabyte of data. All of the Indra data are immediately available for analysis via the SciServer science platform, which provides interactive and batch computing modes, personal data storage, and other hosted data sets such as the Millennium simulations and many astronomical surveys. We present the Indra simulations, describe the data products and how to access them, and measure ensemble averages, variances, and covariances of the matter power spectrum, the matter correlation function, and the halo mass function to demonstrate the types of computations that Indra enables. We hope that Indra will be both a resource for large-scale structure research and a demonstration of how to make very large data sets public and computationally accessible.

Falck, Bridget↗
DOE OSTI2025

Bootstrap-determined p values in lattice QCD

We present a general method to determine the probability that stochastic Monte Carlo data, in particular those generated in a lattice QCD calculation, would have been obtained were that data drawn from the distribution predicted by a given theoretical hypothesis. Such a probability, or p -value, is often used as an important heuristic measure of the validity of that hypothesis. The proposed method offers the benefit that it remains usable in cases where the standard Hotelling T 2 methods based on the conventional χ 2 statistic do not apply, such as for uncorrelated fits. Specifically, we analyze q 2 , defined as the correlated χ 2 statistic obtained using an arbitrary covariance matrix estimator, and show how to use the bootstrap as a data-driven method to determine the expected distribution of q 2 for a given hypothesis with minimal assumptions. This distribution can then be used to determine the p -value for a fit to the data. We also describe a bootstrap approach for quantifying the impact upon this p -value of estimating population parameters from a single ensemble of N samples. The overall method is accurate up to a 1 / N bias which we do not attempt to quantify. Published by the American Physical Society 2025

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗