Cosmology from HSC Y1 weak lensing data with combined higher-order statistics and simulation-based inference
Not Available
Novaes, Camila P. (ORCID:0000000258453649)↗
SEARCH · Search NASA
Results for “ordered statistics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Detection of the significant impact of source clustering on higher order statistics with DES Year 3 weak gravitational lensing data
We measure the impact of source galaxy clustering on higher order summary statistics of weak gravitational lensing data. By comparing simulated data with galaxies that either trace or do not trace the underlying density field, we show that this effect can exceed measurement uncertainties for common higher order statistics for certain analysis choices. We evaluate the impact on different weak lensing observables, finding that third moments and wavelet phase harmonics are more affected than peak count statistics. Using Dark Energy Survey (DES) Year 3 (Y3) data, we construct null tests for the source-clustering-free case, finding a p-value of p = 4 × 10 −3 (2.6σ) using third-order map moments and p = 3 × 10 −11 (6.5σ) using wavelet phase harmonics. The impact of source clustering on cosmological inference can be either included in the model or minimized through ad hoc procedures (e.g. scale cuts). We verify that the procedures adopted in existing DES Y3 cosmological analyses were sufficient to render this effect negligible. Failing to account for source clustering can significantly impact cosmological inference from higher order gravitational lensing statistics, e.g. higher order N-point functions, wavelet-moment observables, and deep learning or field-level summary statistics of weak lensing maps.
79 ASTRONOMY AND ASTROPHYSICS↗
Map-level baryonification: unified treatment of weak lensing two-point and higher-order statistics
Precision cosmology benefits from extracting maximal information from cosmic structures, motivating the use of higher-order statistics (HOS) at small spatial scales. However, predicting how baryonic processes modify matter statistics at these scales has been challenging. The baryonic correction model (BCM) addresses this by modifying dark-matter-only simulations to mimic baryonic effects, providing a flexible, simulation-based framework for predicting both two-point and HOS. We show that a 3-parameter version of the BCM can jointly fit weak lensing maps' two-point statistics, wavelet phase harmonics coefficients, scattering coefficients, and the third and fourth moments to within 2% accuracy across all scales ℓ < 2000 and tomographic bins for a DES-Y3-like redshift distribution ( z ≲ 2), using the FLAMINGO simulations. These results demonstrate the viability of BCM-assisted, simulation-based weak lensing inference of two-point and HOS, paving the way for robust cosmological constraints that fully exploit non-Gaussian information on small spatial scales.
79 ASTRONOMY AND ASTROPHYSICS↗
Reconstruction of neutron multiplicity distributions from low-order statistical information
Not provided.
Instruments & Instrumentation↗
Cosmological parameters from the joint analysis of density split and second order statistics: An emulator based on the halo occupation distribution
Not Available
Burger, Pierre A. (ORCID:0000000186376305)↗
A road map to cosmological parameter analysis with third-order shear statistics: III. Efficient estimation of third-order shear correlation functions and an application to the KiDS-1000 data
Context. Third-order lensing statistics contain a wealth of cosmological information that is not captured by second-order statistics. However, the computational effort it takes to estimate such statistics in forthcoming stage IV surveys is prohibitively expensive. Aims. We derive and validate an efficient estimation procedure for the three-point correlation function (3PCF) of polar fields such as weak lensing shear. We then use our approach to measure the shear 3PCF and the third-order aperture mass statistics on the KiDS-1000 survey. Methods We constructed an efficient estimator for third-order shear statistics that builds on the multipole decomposition of the 3PCF. We then validated our estimator on mock ellipticity catalogs obtained from N -body simulations. Finally, we applied our estimator to the KiDS-1000 data and presented a measurement of the third-order aperture statistics in a tomographic setup. Results. Our estimator provides a speedup of a factor of ∼100–1000 compared to the state-of-the-art estimation procedures. It is also able to provide accurate measurements for squeezed and folded triangle configurations without additional computational effort. We report a significant detection of tomographic third-order aperture mass statistics in the KiDS-1000 data (S/N = 6.69). Conclusions. Our estimator will make it computationally feasible to measure third-order shear statistics in forthcoming stage IV surveys. Furthermore, it can be used to construct empirical covariance matrices for such statistics.
Astronomy & Astrophysics↗
KiDS-1000 cosmology: Combined second- and third-order shear statistics
Aims.In this work, we perform the first cosmological parameter analysis of the fourth release of Kilo Degree Survey (KiDS-1000) data with second- and third-order shear statistics. This paper builds on a series of studies aimed at describing the roadmap to third-order shear statistics. Methods.We derived and tested a combined model of the second-order shear statistic, namely, the COSEBIs and the third-order aperture mass statistics 〈ℳ ap 3 〉 in a tomographic set-up. We validated our pipeline withN-body mock simulations of the KiDS-1000 data release. To model the second- and third-order statistics, we used the latest version of HMCODE2020 for the power spectrum and BIHALOFITfor the bispectrum. Furthermore, we used an analytic description to model intrinsic alignments and hydro-dynamical simulations to model the effect of baryonic feedback processes. Lastly, we decreased the dimension of the data vector significantly by considering only equal smoothing radii for the 〈ℳ ap 3 〉 part of the data vector. This makes it possible to carry out a data analysis of the KiDS-1000 data release using a combined analysis of COSEBIs and third-order shear statistics. Results.We first validated the accuracy of our modelling by analysing a noise-free mock data vector, assuming the KiDS-1000 error budget, finding a shift in the maximum of the posterior distribution of the matter density parameter, ΔΩ m < 0.02 σ Ω m , and of the structure growth parameter, ΔS 8 < 0.05 σ S 8 . Lastly, we performed the first KiDS-1000 cosmological analysis using a combined analysis of second- and third-order shear statistics, where we constrained Ω m = 0.248 −0.055 +0.062 andS 8 = σ 8 √(Ω m /0.3 )= 0.772 ± 0.022. The geometric average on the errors of Ω m andS 8 of the combined statistics decreases, compared to the second-order statistic, by a factor of 2.2.
Astronomy & Astrophysics↗
Dark Energy Survey Year 3 Results: Cosmological constraints from second- and third-order shear statistics
Here, we present a cosmological analysis of the third-order aperture mass statistic using Dark Energy Survey Year 3 (DES Y3) data. We perform a complete tomographic measurement of the three-point correlation function of the Y3 weak lensing shape catalog with the four fiducial source redshift bins. Building upon our companion methodology paper, we apply a pipeline that combines the two-point function ξ ± with the mass aperture skewness statistic ⟨ M ap 3 ⟩ , which is an efficient compression of the full shear three-point function. We use a suite of simulated shear maps to obtain a joint covariance matrix. By jointly analyzing ξ ± and ⟨ M ap 3 ⟩ measured from DES Y3 data with a Λ CDM model, we find S 8 = 0.780 ± 0.015 and Ω m = 0.26 6 - 0.040 + 0.039 , yielding 111% of figure-of-merit improvement in the Ω m - S 8 plane relative to ξ ± alone, consistent with expectations from simulated likelihood analyses. With a w CDM model, we find S 8 = 0.74 9 - 0.026 + 0.027 and w 0 = - 1.39 ± 0.31 , which gives an improvement of 22% on the joint S 8 - w 0 constraint. Our results are consistent with w 0 = - 1 . Our new constraints are compared to CMB data from the Planck satellite, and we find that with the inclusion of ⟨ M ap 3 ⟩ the existing tension between the datasets is at the level of 2.3 σ . We show that the third-order statistic enables us to self-calibrate the mean photometric redshift uncertainty parameter of the highest redshift bin with little degradation in the figure of merit. Our results demonstrate the constraining power of higher-order lensing statistics and establish ⟨ M ap 3 ⟩ as a practical observable for joint analyses in current and future surveys.
Gomes, R. C. H. [University of Pennsylvania] (ORCI↗
Cosmology with second- and third-order shear statistics for the Dark Energy Survey: Methods and simulated analysis
We present a new pipeline designed for the robust inference of cosmological parameters using both second- and third-order shear statistics. We build a theoretical model for rapid evaluation of three-point correlations using our fastnc code and integrate it into the cosmosis framework. We measure the two-point functions 𝜉 ± and the full configuration-dependent three-point shear correlation functions across all auto- and cross-redshift bins. We compress the three-point functions into the mass aperture statistic ⟨ℳ$^{3}_{ap}$⟩ for a set of 796 simulated shear maps designed to model the Dark Energy Survey Year 3 data. We estimate from it the full covariance matrix and model the effects of intrinsic alignments, shear calibration biases and photometric redshift uncertainties. We apply scale cuts to minimize the contamination from the baryonic signal as modeled through hydrodynamical simulations. We find a significant improvement of 83% on the figure of merit in the Ω m − 𝑆 8 plane when we add the ⟨ℳ$^{3}_{ap}$⟩ data to 𝜉 ± . Here, we present our findings for all relevant cosmological and systematic uncertainty parameters and discuss the complementarity of third-order and second-order statistics.
79 ASTRONOMY AND ASTROPHYSICS↗
Precise cosmological constraints from BOSS galaxy clustering with a simulation-based emulator of the wavelet scattering transform
For this study, we perform a reanalysis of the BOSS CMASS DR12 galaxy dataset using a simulation-based emulator for the wavelet scattering transform (WST) coefficients. Moving beyond our previous works, which laid the foundation for the first galaxy clustering application of this estimator, we construct a neural net-based emulator for the cosmological dependence of the WST coefficients and the 2-point correlation function multipoles, trained from the state-of-the-art suite of abacussummit simulations combined with a flexible halo occupation distribution (HOD) galaxy model. In order to confirm the accuracy of our pipeline, we subject it to a series of thorough internal and external mock parameter recovery tests, before applying it to reanalyze the CMASS observations in the redshift range 0.46 < z < 0.57. We find that a joint WST+2-point correlation function likelihood analysis allows us to obtain marginalized 1σ errors on the Λ CDM parameters that are tighter by a factor of 2.5–6, compared to the 2-point correlation function, and by a factor of 1.4–2.5 compared to the WST-only results. This corresponds to a competitive 0.9%, 2.3% and 1% level of determination for parameters ω c , σ 8 &n s , respectively, and also to a 0.7% and 2.5% constraint on derived parameters h and ƒ(z)σ 8 (z), in agreement with the Planck 2018 results. Our results reaffirm the constraining power of the WST and highlight the exciting prospect of employing higher-order statistics in order to fully exploit the power of upcoming stage-IV spectroscopic observations.
79 ASTRONOMY AND ASTROPHYSICS↗
Labeling sequential data from noisy annotations
Crowdsourcing algorithms often work under the assumption that the data samples are independent. Recent work has shown that data dependence, such as temporal correlations in sequential data, can be leveraged to improve the label quality. Existing methods that exploit this special structure rely on third-order statistics of the annotator outputs to ensure the identifiability of key latent parameters, which are costly to acquire. This work proposes an approach for integrating crowdsourced annotations under the Dawid-Skene/Hidden Markov Model (DS-HMM) for sequential data based on second-order statistics, which naturally enjoys a lower sample complexity. An effective algorithm is proposed to tackle the challenging optimization problem associated with the proposed estimator. Numerical experiments showcase the effectiveness of the data labeling paradigm.
Marrinan, Timothy P.↗
Advanced Turbulence Models for Large-Scale Atmospheric Boundary Layer Flows
We present high-fidelity large-eddy-simulation (LES) modeling approaches for the turbulent atmospheric boundary layer (ABL) flows. Wind energy is a prime example of an application driven by ABL. Generation of electrical energy from farms of wind turbines at night in the stable ABL is a particularly interesting situation. In this report, we consider the well-known GEWEX (Global Energy and Water Cycle Experiment) Atmospheric Boundary Layer Study (GABLS) stably stratified benchmark LES case. We use a high-order spectral element code Nek5000/RS, which is supported under the DOE's Exascale Computing Project (ECP) Center for Efficient Exascale Discretizations (CEED) project, targeting application simulations on various acceleration-device based exascale computing platforms. In our earlier ANL report, we demonstrated our newly developed subgrid-scale (SGS) models based on high-pass filter (HPF), mean-field eddy viscosity (MFEV), and Smagorinsky (SMG) with no-slip and traction boundary conditions, provided with low-order statistics, convergence and turbulent structure analysis. In this report, we extend the range of our SGS modeling approaches in the context of the mean-field eddy viscosity (MFEV), to include the solution of an SGS turbulent kinetic energy equation (TKE). We demonstrate the model fidelity of Nek5000/RS in comparison to that of AMR-Wind, a block-structured second-order finite-volume code with adaptive-mesh-refinement capabilities, with which we studied scaling performance for both codes in comparison on DOE's leadership computing platforms.
17 WIND ENERGY↗
Impact of baryonic feedback on HSC-Y1 weak lensing non-Gaussian statistics
Baryonic feedback is a major systematic in weak lensing cosmology. Its most studied effect is the suppression of the lensing power spectrum, a second-order statistic, on small scales. Motivated by the growing interest in statistics beyond the second order, we investigate the effect of baryons on lensing non-Gaussian statistics and the resulting biases in the matter clustering amplitude S 8 = σ 8 Ω m / 0.3 . We focus on the Subaru Hyper Suprime-Cam Year 1 (HSC-Y1) data which, with its high source number density, closely resembles those expected from the upcoming Euclid and Rubin Legacy Survey of Space and Time. We study four non-Gaussian statistics of convergence maps—peak counts, minimum counts, the probability distribution function, and the scattering transform coefficients—in addition to the usual power spectrum. We first estimate the biases in S 8 using mock observations built from the IllustrisTNG and BAHAMAS hydrodynamical simulations and theoretical models built from dark-matter-only simulations. We find up to 1 σ bias in S 8 when the smallest scales (2 arcmin) and the highest feedback level are considered. We then analyze the HSC-Y1 data and compare the S 8 obtained for each statistic with different smoothing scales or scale cuts. As we expect that baryons mostly affect the small scales, comparing the results obtained from including and excluding small scales can indicate the level of impact from baryons. With HSC data, we find only minor ( ≤ 0.5 σ ) differences in S 8 for all statistics, even when considering very small scales (2 arcmin). Our results suggest that the effect of baryons is insignificant at the level of HSC-Y1 down to 2 arcmin for all statistics examined here, or it is canceled by other scale-dependent systematics.
79 ASTRONOMY AND ASTROPHYSICS↗
Quasar Identification Using Multivariate Probability Density Estimated from Nonparametric Conditional Probabilities
Nonparametric estimation for a probability density function that describes multivariate data has typically been addressed by kernel density estimation (KDE). A novel density estimator recently developed by Farmer and Jacobs offers an alternative high-throughput automated approach to univariate nonparametric density estimation based on maximum entropy and order statistics, improving accuracy over univariate KDE. This article presents an extension of the single variable case to multiple variables. The univariate estimator is used to recursively calculate a product array of one-dimensional conditional probabilities. In combination with interpolation methods, a complete joint probability density estimate is generated for multiple variables. Good accuracy and speed performance in synthetic data are demonstrated by a numerical study using known distributions over a range of sample sizes from 100 to 10 6 for two to six variables. Performance in terms of speed and accuracy is compared to KDE. The multivariate density estimate developed here tends to perform better as the number of samples and/or variables increases. As an example application, measurements are analyzed over five filters of photometric data from the Sloan Digital Sky Survey Data Release 17. The multivariate estimation is used to form the basis for a binary classifier that distinguishes quasars from galaxies and stars with up to 94% accuracy.
79 ASTRONOMY AND ASTROPHYSICS↗
Cosmological constraints from the Subaru Hyper Suprime-Cam year 1 shear catalogue lensing convergence probability distribution function
Here we utilize the probability distribution function (PDF) of normalized convergence maps reconstructed from the Subaru Hyper Suprime-Cam (HSC) year 1 shear catalogue, in combination with the power spectrum, to measure the matter clustering amplitude S 8 = σ 8 $\sqrt {Ω_{m}/0.3}$. The large-scale structure’s statistical properties are incompletely described by the traditional two-point statistics, motivating our investigation of the PDF—a complementary higher-order statistic. By defining the PDF over the standard-deviation-normalized convergence map, we are able to isolate the non-Gaussian information. We use tailored simulations to compress the data vector and construct a likelihood approximation. We mitigate the impact of survey and astrophysical systematics with cuts on smoothing scales, redshift bins, and data vectors. We find S 8 = $0.860^{+0.066}_{–0.109}$ from the PDF alone and S 8 = 0.798$^{+0.029}_{–0.042}$ from the combination of the PDF and power spectrum (68% confidential level (CL)). The PDF improves the power-spectrum-only constraint by about 10%.
79 ASTRONOMY AND ASTROPHYSICS↗
Stochastic Modeling of the Joint Neutron Number-Cumulative Fission Fragment Kinetic Energy Deposition Distribution and its Statistical Moments [Slides]
We investigate the joint distribution of the neutron number and cumulative fission-fragment kinetic energy (FKE) deposition, with a specific focus on low-order statistical moments: the mean, variance, and correlation. Starting from a point-kinetic framework, we derive a forward Master equation (FME) for the joint distribution and develop the corresponding moment equations.
42 ENGINEERING↗
On the statistical theory of self-gravitating collisionless dark matter flow: Scale and redshift variation of velocity and density distributions
The statistics of velocity and density fields are crucial for cosmic structure formation and evolution. Here, this paper extends our previous work on the two-point second-order statistics for the velocity field [Phys. Fluids 35, 077105 (2023)] to one-point probability distributions for both density and velocity fields. The scale and redshift variation of density and velocity distributions are studied by a halo-based non-projection approach. First, all particles are divided into halo and out-of-halo particles so that the redshift variation can be studied via generalized kurtosis of distributions for halo and out-of-halo particles, respectively. Second, without projecting particle fields onto a structured grid, the scale variation is analyzed by identifying all particle pairs on different scales $r$. We demonstrate that: (i) Delaunay tessellation can be used to reconstruct the density field. The density correlation, spectrum, and dispersion functions were obtained, modeled, and compared with the N-body simulation; (ii) the velocity distributions are symmetric on both small and large scales and are non-symmetric with a negative skewness on intermediate scales due to the inverse energy cascade on small scales with a constant rate $\varepsilon_u$; (iii) On small scales, the even order moments of pairwise velocity $\Delta u_L$ follow a two-thirds law $\propto{(-\varepsilon_ur)}^{2/3}$, while the odd order moments follow a linear scaling $\langle(\Delta u_L)^{2n+1}\rangle=(2n+1)\langle(\Delta u_L)^{2n}\rangle\langle\Delta u_L\rangle\propto{r}$; (iv) The scale variation of the velocity distributions was studied for longitudinal velocities $u_L$ or $u_L^{'}$, pairwise velocity (velocity difference) $\Delta u_L$=$u_L^{'}$-$u_L$ and velocity sum $\Sigma u_L$=$u^{'}_L$+$u_L$. Fully developed velocity fields are never Gaussian on any scale, despite that they can initially be Gaussian; (v) On small scales, $u_L$ and $\Sigma u_L$ can be modeled by a $X$ distribution to maximize the entropy of the system. The distribution of $\Delta u_L$ can be different; (vi) On large scales, $\Delta u_L$ and $\Sigma u_L$ can be modeled by a logistic or a $X$ distribution, while $u_L$ has a different distribution; (vii) the redshift variation of the velocity distributions follows the evolution of the $X$ distribution involving a shape parameter $\alpha(z)$ decreasing with time.
79 ASTRONOMY AND ASTROPHYSICS↗
A novel statistical methodology for quantifying the spatial arrangements of axons in peripheral nerves
A thorough understanding of the neuroanatomy of peripheral nerves is required for a better insight into their function and the development of neuromodulation tools and strategies. In biophysical modeling, it is commonly assumed that the complex spatial arrangement of myelinated and unmyelinated axons in peripheral nerves is random, however, in reality the axonal organization is inhomogeneous and anisotropic. Present quantitative neuroanatomy methods analyze peripheral nerves in terms of the number of axons and the morphometric characteristics of the axons, such as area and diameter. In this study, we employed spatial statistics and point process models to describe the spatial arrangement of axons and Sinkhorn distances to compute the similarities between these arrangements (in terms of first- and second-order statistics) in various vagus and pelvic nerve cross-sections. We utilized high-resolution transmission electron microscopy (TEM) images that have been segmented using a custom-built high-throughput deep learning system based on a highly modified U-Net architecture. Our findings show a novel and innovative approach to quantifying similarities between spatial point patterns using metrics derived from the solution to the optimal transport problem. We also present a generalizable pipeline for quantitative analysis of peripheral nerve architecture. Our data demonstrate differences between male- and female-originating samples and similarities between the pelvic and abdominal vagus nerves.
59 BASIC BIOLOGICAL SCIENCES↗