Search NASA⌕ Search

SEARCH · Search NASA

Results for “Methods:data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

CIRCLEZ : Reliable photometric redshifts for active galactic nuclei computed solely using photometry from Legacy Survey Imaging for DESI

Photometric redshifts for galaxies hosting an accreting supermassive black hole in their center, known as active galactic nuclei (AGNs), are notoriously challenging. At present, they are most optimally computed via spectral energy distribution (SED) fittings, assuming that deep photometry for many wavelengths is available. However, for AGNs detected from all-sky surveys, the photometry is limited and provided by a range of instruments and studies. This makes the task of homogenizing the data challenging, presenting a dramatic drawback for the millions of AGNs that wide surveys such as SRG/eROSITA are poised to detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGNs using only one dataset that covers a large area: the tenth data release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures over the footprint of the eROSITA-DE survey, which avoids issues related to the cross-calibration of surveys. We present the results from CIRCLEZ, a machine-learning algorithm based on a fully connected neural network. CIRCLEZ is built on a training sample of 14 000 X-ray-detected AGNs and utilizes multi-aperture photometry, mapping the light distribution of the sources. The accuracy (σNMAD) and the fraction of outliers (η) reached in a test sample of 2913 AGNs are equal to 0.067 and 11.6%, respectively. The results are comparable to (or even better than) what was previously obtained for the same field, but with much less effort in this instance. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching a comparable accuracy as in eFEDS when limiting the magnitude of the counterparts to the depth of LS10. The method can be applied to fainter samples of AGNs using deeper optical data from future surveys (for example, LSST, Euclid), granting LS10-like information on the light distribution beyond the morphological type. Along with this paper, we have released an updated version of the photometric redshifts (including errors and probability distribution functions) for eROSITA/eFEDS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Counterpart identification and classification for eRASS1 and characterisation of the active galactic nuclei content

Context. Accurately accounting for the Active Galactic Nucleus (AGN) phase in galaxy evolution requires a large, clean AGN sample. This is now possible with SRG/eROSITA, which completed its first all-sky X-ray survey (eRASS1) on June 12, 2020. The public Data Release 1 (DR1, Jan 31, 2024) includes 930,203 sources from the western Galactic hemisphere. Aims. The data enable the selection of a large AGN sample and the discovery of rare sources. However, scientific return depends on accurate characterisation of the X-ray emitters, requiring high-quality multi-wavelength data. This paper presents the identification and classification of optical and infrared counterparts to eRASS1 sources. Methods. Counterparts to eRASS1 X-ray point sources were identified using Gaia DR3, CatWISE2020, and Legacy Survey DR10 (LS10) with the Bayesian NWAY algorithm and trained priors. Sources were classified as Galactic or extragalactic via a machine-learning model combining optical/IR and X-ray properties, trained on a reference sample. For extragalactic LS10 sources, photometric redshifts were computed using CIRCLEZ. Results. Within the LS10 footprint, all 656,614 eROSITA/DR1 sources have at least one possible optical counterpart; ∼570 000 are extragalactic and likely AGN. Half are new detections compared to AllWISE, Gaia, and Quaia AGN catalogues. Gaia and CatWISE2020 counterparts are less reliable, due to the survey’s shallowness and the limited amount of features available to assess the probability of being an X-ray emitter. In the Galactic plane, where the overdensity of stellar sources also increases the chance of associations, using conservative reliability cuts, we identified approximately 18 000 Gaia and 55 000 CatWISE2020 extragalactic sources. Conclusions. We have released three high-quality counterpart catalogues – plus the training and validation sets – as a benchmark for the field. These datasets have many applications, but in particular, they empower researchers to build AGN samples tailored for completeness and purity, accelerating the hunt for the Universe’s most energetic engines.

X-rays: general↗
DOE OSTI2025

An accurate measurement of the spectral resolution of the JWST Near Infrared Spectrograph

The spectral resolution (R ≡ λ/Δλ) of spectroscopic data is crucial information for accurate kinematic measurements. In this letter we present a robust measurement of the spectral resolution of the JWST Near Infrared Spectrograph (NIRSpec) in fixed slit (FS) and integral field spectroscopy (IFS) modes. Due to the similarity of the utilized slit dimension in the FS mode to that of the shutters in the multi-object spectroscopy (MOS) mode, our resolution measurements in the FS mode can also be used for the MOS mode in principle. We modeled H and He lines of the planetary nebula SMP LMC 58 using a Gaussian line spread function (LSF) to estimate the wavelength-dependent resolution for multiple disperser and filter combinations. We corrected for the intrinsic width of the planetary nebula’s H and He lines due to its expansion velocity by measuring it from a higher-resolution X-shooter spectrum. We find that NIRSpec’s in-flight spectral resolutions exceed the pre-launch estimates provided in the JWST User Documentation by 11–53% in the FS mode and by 1–24% in the IFS mode across the covered wavelengths. We recover the expected trend that the resolution increases with the wavelength within a configuration. The robust and accurate LSFs presented in this letter will enable high-accuracy kinematic measurements using NIRSpec for applications in cosmology and galaxy evolution.

methods: data analysis↗
DOE OSTI2024

Model independent approach for calculating galaxy rotation curves for low S/N MaNGA galaxies

Internal kinematics of galaxies, traced through the stellar rotation curve or two dimensional velocity map, carry important information on galactic structure and dark matter. With upcoming surveys, the velocity map may play a key role in the development of kinematic lensing as an astrophysical probe. Here, we improve techniques for extracting velocity information from integral field spectroscopy at low signal-to-noise (S/N), without a template, and demonstrate substantial advantages over the standard Penalized PiXel-Fitting method (pPXF) approach. Robust rotation curves can be derived down to S/N ≈ 2 using our method.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Is flat fielding safe for precision CCD astronomy?

The ambitious goals of precision cosmology with wide-field optical surveys such as the Dark Energy Survey (DES) and the Large Synoptic Survey Telescope (LSST) demand precision CCD astronomy as their foundation. This in turn requires an understanding of previously uncharacterized sources of systematic error in CCD sensors, many of which manifest themselves as static effective variations in pixel area. Such variation renders a critical assumption behind the traditional procedure of flat fielding—that a sensor's pixels comprise a uniform grid—invalid. In this work, we present a method to infer a curl-free model of a sensor's underlying pixel grid from flat-field images, incorporating the superposition of all electrostatic sensor effects—both known and unknown—present in flat-field data. We use these pixel grid models to estimate the overall impact of sensor systematics on photometry, astrometry, and PSF shape measurements in a representative sensor from the Dark Energy Camera (DECam) and a prototype LSST sensor. Applying the method to DECam data recovers known significant sensor effects for which corrections are currently being developed within DES. For an LSST prototype CCD with pixel-response non-uniformity (PRNU) of 0.4%, we find the impact of "improper" flat fielding on these observables is negligible in nominal .7'' seeing conditions. Furthermore, these errors scale linearly with the PRNU, so for future LSST production sensors, which may have larger PRNU, our method provides a way to assess whether pixel-level calibration beyond flat fielding will be required.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

PyCBC Inference: A Python-based Parameter Estimation Toolkit for Compact Binary Coalescence Signals

We introduce new modules in the open-source PyCBC gravitational-wave astronomy toolkit that implement Bayesian inference for compact-object binary mergers. We review the Bayesian inference methods implemented and describe the structure of the modules. Here, we demonstrate that the PyCBC Inference modules produce unbiased estimates of the parameters of a simulated population of binary black hole mergers. We show that the parameters' posterior distributions obtained using our new code agree well with the published estimates for binary black holes in the first Advanced LIGO–Virgo observing run.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

DeepSZ: identification of Sunyaev–Zel’dovich galaxy clusters using deep learning

Galaxy clusters identified via the Sunyaev–Zel’dovich (SZ) effect are a key ingredient in multiwavelength cluster cosmology. In this paper, we present and compare three methods of cluster identification: the standard matched filter (MF) method in SZ cluster finding, a convolutional neural networks (CNN), and a ‘combined’ identifier. We apply the methods to simulated millimeter maps for several observing frequencies for a survey similar to SPT-3G, the third-generation camera for the South Pole Telescope. The MF requires image pre-processing to remove point sources and a model for the noise, while the CNN requires very little pre-processing of images. Additionally, the CNN requires tuning of hyperparameters in the model and takes cut-out images of the sky as input, identifying the cut-out as cluster-containing or not. We compare differences in purity and completeness. The MF signal-to-noise ratio depends on both mass and redshift. Our CNN, trained for a given mass threshold, captures a different set of clusters than the MF, some with signal-to-noise-ratio below the MF detection threshold. However, the CNN tends to mis-classify cut-out whose clusters are located near the edge of the cut-out, which can be mitigated with staggered cut-out. We leverage the complementarity of the two methods, combining the scores from each method for identification. The purity and completeness are both 0.61 for MF, and 0.59 and 0.61 for CNN. The combined method yields 0.60 and 0.77, a significant increase for completeness with a modest decrease in purity. We advocate for combined methods that increase the confidence of many low signal-to-noise clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Uncertainty quantification of the virial black hole mass with conformal prediction

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an indirect method using the single-epoch virial black hole mass estimation is used for objects at high redshifts. However, this method is subjected to biases and uncertainties as it is reliant on the scaling relation from a small sample of local active galactic nuclei. In this study, we propose the application of conformalized quantile regression (CQR) to quantify the uncertainties of the black hole predictions in a machine learning setting. We compare CQR with various prediction interval techniques and demonstrated that CQR can provide a more useful prediction interval indicator. In contrast to baseline approaches for prediction interval estimation, we show that the CQR method provides prediction intervals that adjust to the black hole mass and its related properties. That is it yields a tighter constraint on the prediction interval (hence more certain) for a larger black hole mass, and accordingly, bright and broad spectral line width source. Using a combination of neural network model and CQR framework, the recovered virial black hole mass predictions and uncertainties are comparable to those measured from the Sloan Digital Sky Survey. The code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

On the impact of the galaxy window function on cosmological parameter estimation

One important source of systematics in galaxy redshift surveys comes from the estimation of the galaxy window function. Up until now, the impact of the uncertainty in estimating the galaxy window function on parameter inference has not been properly studied. In this paper, we show that the uncertainty and the bias in estimating the galaxy window function will be salient for ongoing and next-generation galaxy surveys using a simulation-based approach. With a specific case study of cross-correlating emission-line galaxies from the DESI Legacy Imaging Surveys and the Planck cosmic microwave background lensing map, we show that neural network-based regression approaches to modelling the window function are superior in comparison to linear regression-based models. Here, we additionally show that the definition of the galaxy overdensity estimator can impact the overall signal-to-noise of observed power spectra. Finally, we show that the additive biases coming from the window functions can significantly bias the modes of the inferred parameters and also degrade their precision. Thus, a careful understanding of the window functions will be essential to conduct cosmological experiments.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Decoding the age–chemical structure of the Milky Way disc: an application of copulas and elicitable maps

In the Milky Way, the distribution of stars in the [α/Fe] versus [Fe/H] and [Fe/H] versus age planes holds essential information about the history of star formation, accretion, and dynamical evolution of the Galactic disc. We investigate these planes by applying novel statistical methods called copulas and elicitable maps to the ages and abundances of red giants in the Apache Point Observatory Galactic Evolution Experiment survey. We find that the high- and low-α disc stars have a clean separation in copula space and use this to provide an automated separation of the α sequences using a purely statistical approach. This separation reveals that the high-α disc ends at the same [α/Fe] and age at high [Fe/H] as the low-[Fe/H] start of the low-α disc, thus supporting a sequential formation scenario for the high- and low-α discs. We then combine copulas with elicitable maps to precisely obtain the correlation between stellar age τ and metallicity [Fe/H] conditional on Galactocentric radius R and height z in the range 0 < R < 20 kpc and |z| < 2 kpc. The resulting trends in the age–metallicity correlation with radius, height, and [α/Fe] demonstrate a ≈0 correlation wherever kinematically cold orbits dominate, while the naively expected negative correlation is present where kinematically hot orbits dominate. This is consistent with the effects of spiral-driven radial migration, which must be strong enough to completely flatten the age–metallicity structure of the low-α disc.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Emission line predictions for mock galaxy catalogues: a new differentiable and empirical mapping from DESI

ABSTRACT We present a simple, differentiable method for predicting emission line strengths from rest-frame optical continua using an empirically determined mapping. Extensive work has been done to develop mock galaxy catalogues that include robust predictions for galaxy photometry, but reliably predicting the strengths of emission lines has remained challenging. Our new mapping is a simple neural network implemented using the JAX Python automatic differentiation library. It is trained on Dark Energy Spectroscopic Instrument Early Release data to predict the equivalent widths (EWs) of the eight brightest optical emission lines (including H α, H β, [O ii], and [O iii]) from a galaxy’s rest-frame optical continuum. The predicted EW distributions are consistent with the observed ones when noise is accounted for, and we find Spearman’s rank correlation coefficient ρs > 0.87 between predictions and observations for most lines. Using a non-linear dimensionality reduction technique, we show that this is true for galaxies across the full range of observed spectral energy distributions. In addition, we find that adding measurement uncertainties to the predicted line strengths is essential for reproducing the distribution of observed line-ratios in the BPT diagram. Our trained network can easily be incorporated into a differentiable stellar population synthesis pipeline without hindering differentiability or scalability with GPUs. A synthetic catalogue generated with such a pipeline can be used to characterize and account for biases in the spectroscopic training sets used for training and calibration of photo-z’s, improving the modelling of systematic incompleteness for the Rubin Observatory LSST and other surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Validating sequential Monte Carlo for gravitational-wave inference

Nested sampling (NS) is the preferred stochastic sampling algorithm for gravitational-wave inference for compact binary coalescences. It can handle the complex nature of the gravitational-wave likelihood surface and provides an estimate of the Bayesian model evidence. However, there is another class of algorithms that meets the same requirements, but has not been used for gravitational-wave analyses: sequential Monte Carlo (SMC), an extension of importance sampling that maps samples from an initial density to a target density via a series of intermediate densities. In this work, we validate a type of SMC algorithm, called persistent sampling (PS), for gravitational-wave inference. We consider a range of different scenarios including binary black holes and binary neutron stars and real and simulated data and show that PS produces results that are consistent with NS whilst being, on average, 2 times more efficient and 2.74 times faster. This demonstrates that PS is a viable alternative to NS that should be considered for future gravitational-wave analyses.

black hole mergers↗
DOE OSTI2016

No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey

Accurate statistical measurement with large imaging surveys has traditionally required throwing away a sizable fraction of the data. This is because most measurements have relied on selecting nearly complete samples, where variations in the composition of the galaxy population with seeing, depth, or other survey characteristics are small. Here, we introduce a new measurement method that aims to minimize this wastage, allowing precision measurement for any class of detectable stars or galaxies. Moreover, our proposal was implemented in BALROG, software which embeds fake objects in real imaging to accurately characterize measurement biases. We demonstrate this technique with an angular clustering measurement using Dark Energy Survey (DES) data. We first show that recovery of our injected galaxies depends on a variety of survey characteristics in the same way as the real data. We then construct a flux-limited sample of the faintest galaxies in DES, chosen specifically for their sensitivity to depth and seeing variations. Using the synthetic galaxies as randoms in the Landy–Szalay estimator suppresses the effects of variable survey selection by at least two orders of magnitude. With this correction, our measured angular clustering is found to be in excellent agreement with that of a matched sample from much deeper, higher resolution space-based Cosmological Evolution Survey (COSMOS) imaging; over angular scales of 0$_.^°$004 < θ < 0$_.^°$2, we find a best-fitting scaling amplitude between the DES and COSMOS measurements of 1.00 ± 0.09. We expect this methodology to be broadly useful for extending measurements’ statistical reach in a variety of upcoming imaging surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

The weirdest SDSS galaxies: results from an outlier detection algorithm

How can we discover objects we did not know existed within the large data sets that now abound in astronomy? In this paper, we present an outlier detection algorithm that we developed, based on an unsupervised Random Forest. We test the algorithm on more than two million galaxy spectra from the Sloan Digital Sky Survey and examine the 400 galaxies with the highest outlier score. We find objects which have extreme emission line ratios and abnormally strong absorption lines, objects with unusual continua, including extremely reddened galaxies. We find galaxy–galaxy gravitational lenses, double-peaked emission line galaxies and close galaxy pairs. We find galaxies with high ionization lines, galaxies that host supernovae and galaxies with unusual gas kinematics. Only a fraction of the outliers we find were reported by previous studies that used specific and tailored algorithms to find a single class of unusual objects. Our algorithm is general and detects all of these classes, and many more, regardless of what makes them peculiar. Lastly, it can be executed on imaging, time series and other spectroscopic data, operates well with thousands of features, is not sensitive to missing values and is easily parallelizable.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Constraining the dark energy equation of state using Bayes theorem and the Kullback–Leibler divergence

Data-driven model-independent reconstructions of the dark energy equation of state w(z) are presented using Planck 2015 era CMB, BAO, SNIa and Lyman-α data. These reconstructions identify the w(z) behaviour supported by the data and show a bifurcation of the equation of state posterior in the range 1.5 < z < 3. Although the concordance ΛCDM model is consistent with the data at all redshifts in one of the bifurcated spaces, in the other a supernegative equation of state (also known as ‘phantom dark energy’) is identified within the 1.5σ confidence intervals of the posterior distribution. In order to identify the power of different datasets in constraining the dark energy equation of state, we use a novel formulation of the Kullback–Leibler divergence. Moreover, this formalism quantifies the information the data add when moving from priors to posteriors for each possible dataset combination. The SNIa and BAO datasets are shown to provide much more constraining power in comparison to the Lyman-α datasets. Furthermore, SNIa and BAO constrain most strongly around redshift range 0.1 - 0.5, whilst the Lyman-α data constrains weakly over a broader range. We do not attribute the supernegative favouring to any particular dataset, and note that the ΛCDM model was favoured at more than 2 log-units in Bayes factors over all the models tested despite the weakly preferred w(z) structure in the data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Survey geometry and the internal consistency of recent cosmic shear measurements

We explore the impact of an update to the typical approximation for the shape noise term in the analytic covariance matrix for cosmic shear experiments that assumes the absence of survey boundary and mask effects. We present an exact expression for the number of galaxy pairs in this term based on the survey mask, which leads to more than a factor of three increase in the shape noise on the largest measured scales for the Kilo-Degree Survey (KiDS-450) real-space cosmic shear data. We compare the result of this analytic expression to several alternative methods for measuring the shape noise from the data and find excellent agreement. This update to the covariance resolves any internal model tension evidenced by the previously large cosmological best-fitting χ 2 for the KiDS-450 cosmic shear data. The best-fitting χ 2 is reduced from 161 to 121 for 118 degrees of freedom. We also apply a correction to how the multiplicative shear calibration uncertainty is included in the covariance. This change shifts the inferred amplitude of the correlation function to higher values. In conclusion, we find that this improves agreement of the KiDS-450 cosmic shear results with Dark Energy Survey Year 1 and Planck results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Survey geometry and the internal consistency of recent cosmic shear measurements

Here, we explore the impact of an update to the typical approximation for the shape noise term in the analytic covariance matrix for cosmic shear experiments that assumes the absence of survey boundary and mask effects. We present an exact expression for the number of galaxy pairs in this term based on the the survey mask, which leads to more than a factor of three increase in the shape noise on the largest measured scales for the Kilo-Degree Survey (KIDS-450) real-space cosmic shear data. We compare the result of this analytic expression to several alternative methods for measuring the shape noise from the data and find excellent agreement. This update to the covariance resolves any internal model tension evidenced by the previously large cosmological best-fit $\chi^2$ for the KiDS-450 cosmic shear data. The best-fit $\chi^2$ is reduced from 161 to 121 for 118 degrees of freedom. We also apply a correction to how the multiplicative shear calibration uncertainty is included in the covariance. This change, along with a previously known update to the reported effective angular values of the data vector, jointly shift the inferred amplitude of the correlation function to higher values. Lastly, we find that this improves agreement of the KiDS-450 cosmic shear results with Dark Energy Survey Year 1 and Planck results.

79 ASTRONOMY AND ASTROPHYSICS↗