Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: statistical, methods: data analysis, surveys”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Probabilistic Cosmological Mass Mapping from Weak Lensing Shear

We infer gravitational lensing shear and convergence fields from galaxy ellipticity catalogs under a spatial process prior for the lensing potential. We demonstrate the performance of our algorithm with simulated Gaussian-distributed cosmological lensing shear maps and a reconstruction of the mass distribution of the merging galaxy cluster Abell 781 using galaxy ellipticities measured with the Deep Lens Survey. Given interim posterior samples of lensing shear or convergence fields on the sky, we describe an algorithm to infer cosmological parameters via lens field marginalization. In the most general formulation of our algorithm we make no assumptions about weak shear or Gaussian-distributed shape noise or shears. Because we require solutions and matrix determinants of a linear system of dimension that scales with the number of galaxies, we expect our algorithm to require parallel high-performance computing resources for application to ongoing wide field lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements

Galaxy clustering measurements are a key probe of the matter density field in the Universe. With the era of precision cosmology upon us, surveys rely on precise measurements of the clustering signal for meaningful cosmological analysis. However, the presence of systematic contaminants can bias the observed galaxy number density, and thereby bias the galaxy two-point statistics. As the statistical uncertainties get smaller, correcting for these systematic contaminants becomes increasingly important for unbiased cosmological analysis. We present and validate a new method for understanding and mitigating both additive and multiplicative systematics in galaxy clustering measurements (two-point function) by joint inference of contaminants in the galaxy overdensity field (one-point function) using a maximum-likelihood estimator (MLE). We test this methodology with Kilo-Degree Survey-like mock galaxy catalogues and synthetic systematic template maps. We estimate the cosmological impact of such mitigation by quantifying uncertainties and possible biases in the inferred relationship between the observed and the true galaxy clustering signal. Our method robustly corrects the clustering signal to the sub-percent level and reduces numerous additive and multiplicative systematics from 1.5σ to less than 0.1σ for the scenarios we tested. In addition, we provide an empirical approach to identifying the functional form (additive, multiplicative, or other) by which specific systematics contaminate the galaxy number density. Even though this approach is tested and geared towards systematics contaminating the galaxy number density, the methods can be extended to systematics mitigation for other two-point correlation measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Towards a Real-time Transient Classification Engine

Temporal sampling does more than add another axis to the vector of observables. Instead, under the recognition that how objects change (and move) in time speaks directly to the physics underlying astronomical phenomena, next-generation wide-field synoptic surveys are poised to revolutionize our understanding of just about anything that goes bump in the night (which is just about everything at some level). Still, even the most ambitious surveys will require targeted spectroscopic follow-up to fill in the physical details of newly discovered transients. We are now building a new system intended to ingest and classify transient phenomena in near real-time from high-throughput imaging data streams. Described herein, the Transient Classification Project at Berkeley will be making use of classification techniques operating on"features" extracted from time series and contextual (static) information. We also highlight the need for a community adoption of a standard representation of astronomical time series data (i.e.,"VOTimeseries").

79 ASTRONOMY AND ASTROPHYSICS↗

A steep slope and small scatter for the high-mass end of the L–σ relation at z ~ 0.55

We measure the intrinsic relation between velocity dispersion (σ) and luminosity (L) for massive, luminous red galaxies at redshift z ~ 0.55. Here, we achieve unprecedented precision by using a sample of 600 000 galaxies with spectra from the Baryon Oscillation Spectroscopic Survey of the third Sloan Digital Sky Survey (SDSS-III), covering a range of stellar masses M* ≳ 10 11 M ⊙ . We deconvolve the effects of photometric errors, limited spectroscopic signal-to-noise ratio, and red–blue galaxy confusion using a novel hierarchical Bayesian formalism that is generally applicable to any combination of photometric and spectroscopic observables. For an L–σ relation of the form L ∝ σ β , we find β = 7.8 ± 1.1 for σ corrected to the effective radius, and a very small intrinsic scatter of s = 0.047 ± 0.004 in log10σ at fixed L. No significant redshift evolution is found for these parameters. The evolution of the zero-point within the redshift range considered is consistent with the passive evolution of a galaxy population that formed at redshift z = 2–3, assuming single stellar populations. An analysis of previously reported results seems to indicate that the passively evolved high-mass L–σ relation at z ~ 0.55 is consistent with the one measured at z = 0.1. Finally, our results, in combination with those presented in the LF work of Montero-Dorta et al., provide a detailed description of the high-mass end of the red sequence (RS) at z ~ 0.55. This characterization, in the light of previous literature, suggest that the high-mass RS distribution corresponds to the ‘core’ elliptical population.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Counterpart identification and classification for eRASS1 and characterisation of the active galactic nuclei content

Context. Accurately accounting for the Active Galactic Nucleus (AGN) phase in galaxy evolution requires a large, clean AGN sample. This is now possible with SRG/eROSITA, which completed its first all-sky X-ray survey (eRASS1) on June 12, 2020. The public Data Release 1 (DR1, Jan 31, 2024) includes 930,203 sources from the western Galactic hemisphere. Aims. The data enable the selection of a large AGN sample and the discovery of rare sources. However, scientific return depends on accurate characterisation of the X-ray emitters, requiring high-quality multi-wavelength data. This paper presents the identification and classification of optical and infrared counterparts to eRASS1 sources. Methods. Counterparts to eRASS1 X-ray point sources were identified using Gaia DR3, CatWISE2020, and Legacy Survey DR10 (LS10) with the Bayesian NWAY algorithm and trained priors. Sources were classified as Galactic or extragalactic via a machine-learning model combining optical/IR and X-ray properties, trained on a reference sample. For extragalactic LS10 sources, photometric redshifts were computed using CIRCLEZ. Results. Within the LS10 footprint, all 656,614 eROSITA/DR1 sources have at least one possible optical counterpart; ∼570 000 are extragalactic and likely AGN. Half are new detections compared to AllWISE, Gaia, and Quaia AGN catalogues. Gaia and CatWISE2020 counterparts are less reliable, due to the survey’s shallowness and the limited amount of features available to assess the probability of being an X-ray emitter. In the Galactic plane, where the overdensity of stellar sources also increases the chance of associations, using conservative reliability cuts, we identified approximately 18 000 Gaia and 55 000 CatWISE2020 extragalactic sources. Conclusions. We have released three high-quality counterpart catalogues – plus the training and validation sets – as a benchmark for the field. These datasets have many applications, but in particular, they empower researchers to build AGN samples tailored for completeness and purity, accelerating the hunt for the Universe’s most energetic engines.

X-rays: general↗

VarIabiLity seLection of AstrophysIcal sources iN PTF (VILLAIN): I. Structure function fits to 71 million objects

Light-curve variability is well-suited to characterizing objects in surveys with high cadence and a long baseline. This is especially relevant in view of the large datasets to be produced by the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). We aim to determine variability parameters for objects in the Palomar Transient Factory (PTF) and explore differences between quasars (QSOs), stars, and galaxies. We relate variability and colour information in preparation for future surveys. We fit joint likelihoods to structure functions (SFs) of 71 million PTF light curves with a Markov chain Monte Carlo method. For each object, we assume a power-law SF and extract two parameters: the amplitude on timescales of one year, A, and a power-law index, γ. With these parameters and colours in the optical (Pan-STARRS1) and mid-infrared (WISE), we identify regions of parameter space dominated by different types of spectroscopically confirmed objects from SDSS. Candidate QSOs, stars, and galaxies are selected to show their parameter distributions. QSOs show high-amplitude variations in the R band, and the highest γ values. Galaxies have a broader range of amplitudes and their variability shows relatively little dependency on timescale. With variability and colours, we achieve a photometric selection purity of 99.3% for QSOs. Even though hard cuts in monochromatic variability alone are not as effective as seven-band magnitude cuts, variability is useful in characterizing object subclasses. Through variability, we also find QSOs that were erroneously classified as stars in the SDSS. We discuss perspectives and computational solutions in view of the upcoming LSST.

79 ASTRONOMY AND ASTROPHYSICS↗

The Photometric LSST Astronomical Time-series Classification Challenge PLAsTiCC: Selection of a Performance Metric for Classification Probabilities Balancing Diverse Science Goals

Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of the underlying physical processes from which they arise. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional type estimation procedures are inappropriate. Probabilistic classification is more appropriate for such data but is incompatible with the traditional metrics used on deterministic classifications. Furthermore, large survey collaborations like LSST intend to use the resulting classification probabilities for diverse science objectives, indicating a need for a metric that balances a variety of goals. We describe the process used to develop an optimal performance metric for an open classification challenge that seeks to identify probabilistic classifiers that can serve many scientific interests. The Photometric LSST Astronomical Time-series Classification Challenge (PLASTICC) aims to identify promising techniques for obtaining classification probabilities of transient and variable objects by engaging a broader community beyond astronomy. Using mock classification probability submissions emulating realistically complex archetypes of those anticipated of PLASTICC, we compare the sensitivity of two metrics of classification probabilities under various weighting schemes, finding that both yield results that are qualitatively consistent with intuitive notions of classification performance. We thus choose as a metric for PLASTICC a weighted modification of the cross-entropy because it can be meaningfully interpreted in terms of information content. Finally, we propose extensions of our methodology to ever more complex challenge goals and suggest some guiding principles for approaching the choice of a metric of probabilistic data products.

79 ASTRONOMY AND ASTROPHYSICS↗

DES science portal: Computing photometric redshifts

We present the Dark Energy Survey (DES) Science Portal, an integratedweb-based data interface designed to facilitate scientific analysis. Wedemonstrate how the Portal can provide a reliable environment to accesscomplete data sets, provide validation algorithms and metrics in the case ofmultiple methods and training configurations, and maintain the provenancebetween the different steps of a complex calculation, while ensuringreproducibility of the results. We use the estimation of DES photometricredshifts (photo-$z$s) as an example. A significant challenge facingphotometric surveys for cosmological purposes, such as DES, is the need toproduce reliable redshift estimates. The choice between competing algorithmsand configurations and the maintenance of an up-to-date spectroscopic databaseto build training sets, for example, are complex tasks when dealing with largeamounts of data that are regularly updated and constantly growing. We show howthe DES Science Portal can be used to train and validate several photo-$z$algorithms using the DES first year (Y1A1) data. The photo-$z$s estimated inthe Portal are used to feed the creation of catalogs for scientific workflows.While the DES collaboration is still developing techniques to obtain precisephoto-$z$s, having a structured framework like the one presented here iscritical for the systematic vetting of DES algorithmic improvements and theconsistent production of photo-$z$s in future DES releases.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A computationally efficient approach for calculating galaxytwo-point correlations

We developed a modification to the calculation of the two-point correlation function commonly used in the analysis of large-scale structure in cosmology. An estimator of the two-point correlation function is constructed by contrasting the observed distribution of galaxies with that of a uniformly populated random catalogue. The assumption that the distribution of random galaxies in redshift is independent of angular position allows us to replace pair-wise combinatorics with fast integration over probability maps. The new method significantly reduces the computation time while simultaneously increasing the precision of the calculation. Also, it only requires cosmological parameters at the last and least computationally expensive stage, which allows for faster exploration of the parameter space.

79 ASTRONOMY AND ASTROPHYSICS↗

No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey

Accurate statistical measurement with large imaging surveys has traditionally required throwing away a sizable fraction of the data. This is because most measurements have relied on selecting nearly complete samples, where variations in the composition of the galaxy population with seeing, depth, or other survey characteristics are small. Here, we introduce a new measurement method that aims to minimize this wastage, allowing precision measurement for any class of detectable stars or galaxies. Moreover, our proposal was implemented in BALROG, software which embeds fake objects in real imaging to accurately characterize measurement biases. We demonstrate this technique with an angular clustering measurement using Dark Energy Survey (DES) data. We first show that recovery of our injected galaxies depends on a variety of survey characteristics in the same way as the real data. We then construct a flux-limited sample of the faintest galaxies in DES, chosen specifically for their sensitivity to depth and seeing variations. Using the synthetic galaxies as randoms in the Landy–Szalay estimator suppresses the effects of variable survey selection by at least two orders of magnitude. With this correction, our measured angular clustering is found to be in excellent agreement with that of a matched sample from much deeper, higher resolution space-based Cosmological Evolution Survey (COSMOS) imaging; over angular scales of 0$_.^°$004 < θ < 0$_.^°$2, we find a best-fitting scaling amplitude between the DES and COSMOS measurements of 1.00 ± 0.09. We expect this methodology to be broadly useful for extending measurements’ statistical reach in a variety of upcoming imaging surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD inclue Principal Components Analysis (PCA) and regression. Usually these applications arise on data that has far more rows than columns, so-called "tall/skinny" matrices. In the big data analytics context, this may take the form of hundreds of millions to billions of rows with only a few hundred columns. There is a need, therefore, for fast, accurate, and scalable tall/skinny SVD implementations which can fully utilize modern computing resources. To that end, we present a survey of three different algorithms for computing the SVD for these kinds of tall/skinny data layouts using MPI for communication. We contextualize these with common big data analytics techniques. Finally, we present both CPU and GPU timing results from the Summit supercomputer, and discuss possible alternative approaches.

Schmidt, Drew↗

Phase 2: Updated Geothermal Play Fairway Analysis of the Tularosa Basin, New Mexico

Play fairway analysis (PFA) methodologies, both deterministic and stochastic, are being applied for medium to low enthalpy geothermal resources in the Tularosa Basin, in south-central New Mexico. These PFA methods use datasets representative of heat, groundwater and fault-fracture related permeability to locate areas with the lowest risk of geothermal energy development. Our Phase 1 PFAs predicted several plays throughout the study area, with a range of certainty and risk, based upon legacy data. In Phase 2, new data were collected for high priority plays and integrated into the PFAs to enhance certainty and further reduce risk. Field geology, gravity surveys and alluvial fan geomorphology supplemented the understanding of geologic structure and potential permeability, while additional well sampling, geothermometry and temperature logging provided valuable information about heat in the subsurface. In order to statistically compare and contrast the layers of evidence in the Tularosa Basin with the broader Great Basin, a probabilistic Weights of Evidence analysis was conducted in parallel with the inclusive and deterministic petroleum industry logic PFA. Both methods yielded 3 similar plays, while Weights of Evidence identified 2 additional plays. A sixth play was inferred around the NASA-Aerospace Data Facility Southwest site, north-east of Las Cruces, based on a promising shallow temperature survey, geothermometers, and structural interpretations of geophysical data. Here, the White Sands Missile Range main cantonment (headquarters) play is now given high priority, along with McGregor Range, Fort Bliss, due to the discovery of relatively high geothermometer values.

15 GEOTHERMAL ENERGY↗

Combining cosmic shear data with correlated photo-z uncertainties: constraints from DESY1 and HSC-DR1

An accurate calibration of the source redshift distribution p(z) is a key aspect in the analysis of cosmic shear data. This, one way or another, requires the use of spectroscopic or high-quality photometric samples. However, the difficulty to obtain colour-complete spectroscopic samples matching the depth of weak lensing catalogs means that the analyses of different cosmic shear datasets often use the same samples for redshift calibration. This introduces a source of statistical and systematic uncertainty that is highly correlated across different weak lensing datasets, and which must be accurately characterised and propagated in order to obtain robust cosmological constraints from their combination. In this paper we introduce a method to quantify and propagate the uncertainties on the source redshift distribution in two different surveys sharing the same calibrating sample. The method is based on an approximate analytical marginalisation of the p(z) statistical uncertainties and the correlated marginalisation of residual systematics. We apply this method to the combined analysis of cosmic shear data from the DESY1 data release and the HSC-DR1 data, using the COSMOS 30-band catalog as a common redshift calibration sample. We find that, although there is significant correlation in the uncertainties on the redshift distributions of both samples, this does not change the final constraints on cosmological parameters significantly. The same is true also for the impact of residual systematic uncertainties from the errors in the COSMOS 30-band photometric redshifts. Additionally, we show that these effects will still be negligible in Stage-IV datasets. Finally, the combination of DESY1 and HSC-DR1 allows us to constrain the "clumpiness" parameter to S 8 = ${0.768}_{-0.017}^{+0.021}$. This corresponds to a ~√(2) improvement in uncertainties with respect to either DES or HSC alone.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of semi-analytical, semi-empirical covariance matrices for two-point correlation function for early DESI data

ABSTRACT We present an extended validation of semi-analytical, semi-empirical covariance matrices for the two-point correlation function (2PCF) on simulated catalogs representative of luminous red galaxies (LRGs) data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). We run the pipeline on multiple effective Zel’dovich (EZ) mock galaxy catalogs with the corresponding cuts applied and compare the results with the mock sample covariance to assess the accuracy and its fluctuations. We propose an extension of the previously developed formalism for catalogs processed with standard reconstruction algorithms. We consider methods for comparing covariance matrices in detail, highlighting their interpretation and statistical properties caused by sample variance, in particular, non-trivial expectation values of certain metrics even when the external covariance estimate is perfect. With improved mocks and validation techniques, we confirm a good agreement between our predictions and sample covariance. This allows one to generate covariance matrices for comparable data sets without the need to create numerous mock galaxy catalogs with matching clustering, only requiring 2PCF measurements from the data itself. The code used in this paper is publicly available at https://github.com/oliverphilcox/RascalC.

79 ASTRONOMY AND ASTROPHYSICS↗

Synthesizing exoplanet demographics from radial velocity and microlensing surveys. I. Methodology

Motivated by the order of magnitude difference in the frequency of giant planets orbiting M dwarfs inferred by microlensing and radial velocity (RV) surveys, we present a method for comparing the statistical constraints on exoplanet demographics inferred from these methods. We first derive the mapping from the observable parameters of a microlensing-detected planet to those of an analogous planet orbiting an RV-monitored star. Using this mapping, we predict the distribution of RV observables for the planet population inferred from microlensing surveys, taking care to adopt reasonable priors for, and properly marginalize over, the unknown physical parameters of microlensing-detected systems. Finally, we use simple estimates of the detection limits for a fiducial RV survey to predict the number and properties of analogs of the microlensing planet population such an RV survey should detect. We find that RV and microlensing surveys have some overlap, specifically for super-Jupiter mass planets (m{sub p} ≳ 1 M {sub Jup}) with periods between ∼3-10 yr. However, the steeply falling planetary mass function inferred from microlensing implies that, in this region of overlap, RV surveys should infer a much smaller frequency than the overall giant planet frequency (m{sub p} ≳ 0.1 M {sub Jup}) inferred by microlensing. Our analysis demonstrates that it is possible to statistically compare and synthesize data sets from multiple exoplanet detection techniques in order to infer exoplanet demographics over wider regions of parameter space than are accessible to individual methods. In a companion paper, we apply our methodology to several representative microlensing and RV surveys to derive the frequency of planets around M dwarfs with orbits of ≲ 30 yr.

79 ASTRONOMY AND ASTROPHYSICS↗

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗

The maximum extent of the filaments and sheets in the cosmic web: an analysis of the SDSS DR17

Filaments and sheets are striking visual patterns in cosmic web. The maximum extent of these large-scale structures are difficult to determine due to their structural variety and complexity. We construct a volume-limited sample of galaxies in a cubic region from the SDSS, divide it into smaller subcubes and shuffle them around. We quantify the average filamentarity and planarity in the 3D galaxy distribution as a function of the density threshold and compare them with those from the shuffled realizations of the original data. The analysis is repeated for different shuffling lengths by varying the size of the subcubes. The average filamentarity and planarity in the shuffled data show a significant reduction when the shuffling scales are smaller than the maximum size of the genuine filaments and sheets. We observe a statistically significant reduction in these statistical measures even at a shuffling scale of $\sim 130 \, {{\, \rm Mpc}}$, indicating that the filaments and sheets in three dimensions can extend up to this length scale. They may extend to somewhat larger length scales that are missed by our analysis due to the limited size of the SDSS data cube. We expect to determine these length scales by applying this method to deeper and larger surveys in future.

79 ASTRONOMY AND ASTROPHYSICS↗

The DESI N -body Simulation Project – II. Suppressing sample variance with fast simulations

ABSTRACT Dark Energy Spectroscopic Instrument (DESI) will construct a large and precise three-dimensional map of our Universe. The survey effective volume reaches $\sim 20\, h^{-3}\, \mathrm{Gpc}^{3}$. It is a great challenge to prepare high-resolution simulations with a much larger volume for validating the DESI analysis pipelines. AbacusSummit is a suite of high-resolution dark-matter-only simulations designed for this purpose, with $200\, h^{-3}\, \mathrm{Gpc}^{3}$ (10 times DESI volume) for the base cosmology. However, further efforts need to be done to provide a more precise analysis of the data and to cover also other cosmologies. Recently, the CARPool method was proposed to use paired accurate and approximate simulations to achieve high statistical precision with a limited number of high-resolution simulations. Relying on this technique, we propose to use fast quasi-N-body solvers combined with accurate simulations to produce accurate summary statistics. This enables us to obtain 100 times smaller variance than the expected DESI statistical variance at the scales we are interested in, e.g. $k \lt 0.3\, h\, \mathrm{Mpc}^{-1}$ for the halo power spectrum. In addition, it can significantly suppress the sample variance of the halo bispectrum. We further generalize the method for other cosmologies with only one realization in AbacusSummit suite to extend the effective volume ∼20 times. In summary, our proposed strategy of combining high-fidelity simulations with fast approximate gravity solvers and a series of variance suppression techniques sets the path for a robust cosmological analysis of galaxy survey data.

cosmology: theory↗