Search NASA⌕ Search

SEARCH · Search NASA

Results for “mock”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

The HalfDome multi-survey cosmological simulations: N-body simulations

Upcoming cosmological surveys have the potential to reach groundbreaking discoveries on multiple fronts, including the neutrino mass, dark energy, and inflation. Most of the key science goals require the joint analysis of datasets from multiple surveys to break parameter degeneracies and calibrate systematics. To realize such analyses, a large set of mock simulations that realistically model correlated observables is required. In this paper we present the N-body component of the HalfDome cosmological simulations, designed for the joint analysis of Stage-IV cosmological surveys, such as Rubin LSST, Euclid, SPHEREx, Roman, DESI, PFS, Simons Observatory, CMB-S4, and LiteBIRD. Our 300TB initial data release includes full-sky lightcones and halo catalogs between z = 0–4 for 11 fixed cosmology realizations, as well as an additional run with local primordial non-Gaussianity (f NL = 20). The simulations evolve 61443 particles in a 3.75 h -1 Gpc box, reaching a minimum halo mass of ∼6 × 1012 h -1 M ⊙ and maximum scale of k ∼ h Mpc-1. Our data is publicly available: instructions to access the data and plans for future data releases can be found at https://halfdomesims.github.io.

Bayer, Adrian E↗
DOE OSTI2025

Light in the dark forest. Part I. An efficient optimal estimator for 3D Lyman-alpha forest power spectrum

The highly anisotropic nature of the Lyman-alpha (Lyα) forest data introduces a complex survey window function that complicates the measurement of the three-dimensional power spectrum ( P 3D ). In this paper, we present the first fully optimal estimator for P 3D , which exactly deconvolves the survey window function and marginalizes contaminated modes that distort the power spectrum. Our approach adapts optimal estimator techniques developed for the 2D cosmic microwave background data to the 3D case. To achieve computational feasibility, we employ the conjugate gradient method and implement the P 3 M formalism to handle large-scale and small-scale operations separately and efficiently. We validate our estimator using Monte Carlo mocks and Gaussian simulations, demonstrating its accuracy and computational efficiency. We confirm that mode marginalization eliminates distortions arising from quasar continuum errors and delivers robust power spectrum estimation, though it also inflates errors at large scales. This first implementation works in the flat-sky case; we discuss the remaining steps needed to generalize it to the curved-sky case. This formalism offers a foundation for the Lyα forest P 3D measurements and a new path toward cosmological constraints from the Lyα forest data.

Lyman alpha forest↗
DOE OSTI2025

Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis

We analyze the robustness of the DESI 2024 cosmological inference from the full shape of the galaxy power spectrum to uncertainties in the Halo Occupation Distribution (HOD) model of the galaxy-halo connection and the choice of priors on nuisance parameters. We assess variations in the recovered cosmological parameters across a range of mocks populated with different HOD models and find that shifts are often greater than 20% of the expected statistical uncertainties from the DESI data. We encapsulate the effect of such shifts in terms of a systematic covariance term, C HOD , and an additional diagonal contribution quantifying the impact of our choice of nuisance parameter priors on the ability of the effective field theory (EFT) model to correctly recover the cosmological parameters of the simulations. These two covariance contributions are designed to be added to the usual covariance term, C stat , describing the statistical uncertainty in the power spectrum measurement, in order to fairly represent these sources of systematic uncertainty. This novel approach should be more general and robust to the choice of model or additional external datasets used in cosmological fits than the alternative approach of adding systematic uncertainties to the recovered marginalised parameter posteriors. We compare the approaches within the context of a fixed ΛCDM model and demonstrate that our method gives conservative estimates of the systematic uncertainty that nevertheless have little impact on the final posteriors obtained from DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

The effects of continuum fitting on Lyman-α forest correlations

Correlations of fluctuations of the flux in Lyman-α forests of high-redshift quasars have been observed by the Baryonic Acoustic Oscillation Spectroscopy Survey (BOSS) and the Dark Energy Spectroscopy Instrument (DESI) survey where they have revealed the effects of baryon acoustic oscillations (BAO). In order to fit the correlation functions to a physical model and thereby constrain cosmological parameters, it is necessary to take into account the effects of fitting the observed spectra to a template about which the fluctuations are measured. In this paper we use mock spectra to test the distortion matrix technique that has been used since the final BOSS data release to appropriately distort the models. We show that while percent-level effects on the derived forest bias parameters may be present, the technique works sufficiently well that the determination of the BAO peak position is not affected at the percent level. We introduce modifications in the technique used by DESI that were not in the original applications and suggest further possibilities for improvements.

Lyman alpha forest↗
DOE OSTI2025

Modeling of the high column density systems in the Lyman-Alpha forest

The Lyman-α forests observed in the spectra of high-redshift quasars can be used as a tracer of the cosmological matter density to study baryon acoustic oscillations (BAO) and the Alcock-Paczynski effect. Extraction of cosmological information from these studies requires modeling of the forest correlations. While the models depend most importantly on the bias parameters of the intergalactic medium (IGM), they also depend on the numbers and characteristics of high-column-density systems (HCDs) ranging from Lyman-limit systems with column densities log N HI /1cm -2 > 17 to damped Lyman-α systems (DLAs) with log N HI /1cm -2 > 20.2. These HCDs introduce broad damped absorption characteristic of a Voigt profile. Consequently they imprint a component on the power spectrum whose modes in the radial direction are suppressed, leading to a scale-dependent bias. Using mock data sets of known HCD content, we test a model that describes this effect in terms of the distribution of column densities of HCDs, the Fourier transforms of their Voigt profiles and the bias of the halos containing the HCDs. Our results show that this physically well-motivated model describes the effects of HCDs with an accuracy comparable to that of the ad-hoc models used in published forest analyses. We also discuss the problems of applying the model to real data, where the HCD content and their bias is uncertain.

Lyman alpha forest↗
DOE OSTI2026

Combined tracer analysis for DESI 2024 BAO

This paper demonstrates how the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) and future baryon acoustic oscillations (BAO) analyses can optimally combine overlapping tracers (galaxies of distinct types) in the same redshift range. We make a unified catalog of Luminous Red Galaxies (LRGs) and Emission Line Galaxies (ELGs) in the redshift range 0.8 < z < 1.1 and investigate the impact on the BAO constraints. DESI DR1 contains ∼ 30% of the final DESI LRG sample and less than 25% of the final ELG sample, and the combination of LRGs and ELGs increases the number density and reduces the shot noise. We developed a pipeline to merge the overlapping tracers using galaxy bias as an approximately optimal weight and tested the pipeline on a suite of Abacus simulations, calibrated on the final version of the DESI Early Data Release. When applying our pipeline to the DESI DR1 catalog, we find an improvement in the BAO constraints of 11% for α iso and ∼ 7.0% for α AP consistent with our findings in mock catalogs. Our analysis was integrated into the DESI DR1 BAO analysis to produce theLRG+ELG result in the 0.8 < z < 1.1 redshift bin, which provided the most precise BAO measurement from DESI DR1 with a 0.86% constraint on the BAO distance scale and a 9.1σ detection of the isotropic BAO feature.

baryon acoustic oscillations↗
DOE OSTI2026

Extensive analysis of reconstruction algorithms for DESI 2024 baryon acoustic oscillations

Reconstruction of the baryon acoustic oscillation (BAO) signal has been a standard procedure in BAO analyses over the past decade and has helped to improve the BAO parameter precision by a factor of ∼2 on average. The Dark Energy Spectroscopic Instrument (DESI) BAO analysis for the first year (DR1) data uses the “standard” reconstruction framework, in which the displacement field is estimated from the observed density field by solving the linearized continuity equation in redshift space, and galaxy and random positions are shifted in order to partially remove non-linearities. There are several approaches to solving for the displacement field in real survey data, including the multigrid (MG), iterative Fast Fourier Transform (iFFT), and iterative Fast Fourier Transform particle (iFFTP) algorithms. In this work, we analyze these algorithms and compare them with various metrics including two-point statistics and the displacement itself using realistic DESI mocks. We focus on three representative DESI samples, the emission line galaxies (ELG), quasars (QSO), and the bright galaxy sample (BGS), which cover the extreme redshifts and number densities, and potential wide-angle effects. We conclude that the MG and iFFT algorithms agree within 0.4% in post-reconstruction power spectrum on BAO scales with the RecSym convention, which does not remove large-scale redshift space distortions (RSDs), in all three tracers. The RecSym convention appears to be less sensitive to displacement errors than the RecIso convention, which attempts to remove large-scale RSDs. However, iFFTP deviates from the first two; thus, we recommend against using iFFTP without further development. In addition, we provide the optimal settings for reconstruction for five years of DESI observation. The analyses presented in this work pave the way for DESI DR1 analysis as well as future BAO analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Constraining primordial non-Gaussianity from DESI DR1 quasars and Planck PR4 CMB lensing

We present the first measurement of local-type primordial non-Gaussianity from the cross-correlation between 1.2 million spectroscopically confirmed quasars from the first data release (DR1) of the Dark Energy Spectroscopic Instrument (DESI) and the Planck PR4 CMB lensing reconstructions. The analysis is performed in three tomographic redshift bins covering 0.8 < z < 3.5, covering a sky fraction of ∼20%. We adopt a catalog-based pseudo-C ℓ estimator and apply linear imaging weights validated on noiseless mocks. Compared to previous analyses using photometric quasar samples, our results benefit from the high purity of the DESI spectroscopic sample, the reduced noise of PR4 lensing, and the absence of excess large-scale power in the spectroscopic quasar auto-correlation. Fitting simultaneously for the non-Gaussianity parameter f NL and the linear bias amplitude in each redshift bin, we obtain f NL = 2 +28 -34 for a response parameter p = 1.6, and f NL = 6 +20 -24 for p = 1.0. These results improve the constraints on f NL by ∼35% compared to the previous analysis based on the Legacy Imaging Survey DR9. Additionally, we derive an optimal weighting scheme to maximize the constraining power. In this case, and assuming p = 1.6, we obtain f NL = 19 +25 -31 . Our results demonstrate the statistical power of DESI quasars for probing inflationary physics, and highlight the promise of future DESI data releases.

cosmological parameters from CMBR↗
DOE OSTI2026

Cosmological analysis of the DESI DR1 Lyα 1D power spectrum

We present the cosmological analysis of the one-dimensional Lyman-α flux power spectrum from the first data release of the Dark Energy Spectroscopic Instrument (DESI). We capture the dependence of the signal on cosmology and intergalactic medium physics using an emulator trained on a cosmological suite of hydrodynamical simulations, and we correct its predictions for the impact of astrophysical contaminants and systematics, many of these not considered in previous analyses. We employ this framework to constrain the amplitude and logarithmic slope of the linear matter power spectrum at k ★ = 0.009 km -1 s and redshift z = 3, obtaining Δ 2 ★ = 0.379 ± 0.032 and n ★ = -2.309 ± 0.019 https://github.com/igmhub/cobaya_lya_p1d. The robustness of these constraints is validated through the analysis of mocks and a large number of alternative data analysis variations, with cosmological parameters kept blinded throughout the validation process. We then combine our results with constraints from DESI BAO and temperature, polarization, and lensing measurements from Planck, ACT, and SPT-3G to set constraints on ΛCDM extensions. While our measurements do not significantly tighten the limits on the sum of neutrino masses from the combination of these probes, they sharpen the constraints on the effective number of relativistic species, N eff = 3.02 ± 0.10, the running of the spectral index, α s = 0.0014 ± 0.0041, and the running of the running, β s = -0.0006 ± 0.0048, by a factor of 1.18, 1.27, and 1.90, respectively. We conclude by outlining the improvements needed to fully reach the level of confidence implied by these uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

DeepAstroUDA: semi-supervised universal domain adaptation for cross-survey galaxy morphology classification and anomaly detection

Abstract Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features. Therefore, such methods do not generalize well across multiple datasets. We present a universal domain adaptation method, DeepAstroUDA , as an approach to overcome this challenge. This algorithm performs semi-supervised domain adaptation (DA) and can be applied to datasets with different data distributions and class overlaps. Non-overlapping classes can be present in any of the two datasets (the labeled source domain, or the unlabeled target domain), and the method can even be used in the presence of unknown classes. We apply our method to three examples of galaxy morphology classification tasks of different complexities (three-class and ten-class problems), with anomaly detection: (1) datasets created after different numbers of observing years from a single survey (Legacy Survey of Space and Time mock data of one and ten years of observations); (2) data from different surveys (Sloan Digital Sky Survey (SDSS) and DECaLS); and (3) data from observing fields with different depths within one survey (wide field and Stripe 82 deep field of SDSS). For the first time, we demonstrate the successful use of DA between very discrepant observational datasets. DeepAstroUDA is capable of bridging the gap between two astronomical surveys, increasing classification accuracy in both domains (up to 40 % on the unlabeled data), and making model performance consistent across datasets. Furthermore, our method also performs well as an anomaly detection algorithm and successfully clusters unknown class samples even in the unlabeled target dataset.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Reference-free structural variant detection in microbiomes via long-read co-assembly graphs

Motivation: The study of bacterial genome dynamics is vital for understanding the mechanisms underlying microbial adaptation, growth, and their impact on host phenotype. Structural variants (SVs), genomic alterations of 50 base pairs or more, play a pivotal role in driving evolutionary processes and maintaining genomic heterogeneity within bacterial populations. While SV detection in isolate genomes is relatively straightforward, metagenomes present broader challenges due to the absence of clear reference genomes and the presence of mixed strains. In response, our proposed method rhea, forgoes reference genomes and metagenome-assembled genomes (MAGs) by encompassing all metagenomic samples in a series (time or other metric) into a single co-assembly graph. The log fold change in graph coverage between successive samples is then calculated to call SVs that are thriving or declining. Results: We show rhea to outperform existing methods for SV and horizontal gene transfer (HGT) detection in two simulated mock metagenomes, particularly as the simulated reads diverge from reference genomes and an increase in strain diversity is incorporated. We additionally demonstrate use cases for rhea on series metagenomic data of environmental and fermented food microbiomes to detect specific sequence alterations between successive time and temperature samples, suggesting host advantage. Our approach leverages previous work in assembly graph structural and coverage patterns to provide versatility in studying SVs across diverse and poorly characterized microbial communities for more comprehensive insights into microbial gene flux.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Improving galaxy clustering measurements with deep learning: analysis of the DECaLS DR7 data

ABSTRACT Robust measurements of cosmological parameters from galaxy surveys rely on our understanding of systematic effects that impact the observed galaxy density field. In this paper, we present, validate, and implement the idea of adopting the systematics mitigation method of artificial neural networks for modelling the relationship between the target galaxy density field and various observational realities including but not limited to Galactic extinction, seeing, and stellar density. Our method by construction allows a wide class of models and alleviates overtraining by performing k-fold cross-validation and dimensionality reduction via backward feature elimination. By permuting the choice of the training, validation, and test sets, we construct a selection mask for the entire footprint. We apply our method on the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Emission Line Galaxies (ELGs) selection from the Dark Energy Camera Legacy Survey (DECaLS) Data Release 7 and show that the spurious large-scale contamination due to imaging systematics can be significantly reduced by up-weighting the observed galaxy density using the selection mask from the neural network and that our method is more effective than the conventional linear and quadratic polynomial functions. We perform extensive analyses on simulated mock data sets with and without systematic effects. Our analyses indicate that our methodology is more robust to overfitting compared to the conventional methods. This method can be utilized in the catalogue generation of future spectroscopic galaxy surveys such as eBOSS and Dark Energy Spectroscopic Instrument (DESI) to better mitigate observational systematics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Generating synthetic cosmological data with GalSampler

As part of the effort to meet the needs of the Large Synoptic Survey Telescope Dark Energy Science Collaboration (LSST DESC) for accurate, realistically complex mock galaxy catalogues, in this work we have developed galsampler, an open-source python package that assists in generating large volumes of synthetic cosmological data. The key idea behind galsampler is to recast hydrodynamical simulations and semi-analytic models as physically motivated galaxy libraries. galsampler populates a new, larger volume halo catalogue with galaxies drawn from the baseline library; by using weighted sampling guided by empirical modelling techniques, galsampler inherits statistical accuracy from the empirical model and physically motivated complexity from the baseline library. We have recently used galsampler to produce the cosmoDC 2 extragalactic catalogue made for the LSST DESC Data Challenge 2 . Using cosmoDC 2 as a guiding example, we outline how galsampler can continue to support ongoing and near-future galaxy surveys such as the Dark Energy Survey, the Dark Energy Spectroscopic Instrument, WFIRST, and Euclid.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Including massive neutrinos in thermal Sunyaev Zeldovich power spectrum and cluster counts analyses

We consistently include the effect of massive neutrinos in the thermal Sunyaev Zeldovich (SZ) power spectrum and cluster counts analyses, highlighting subtle dependencies on the total neutrino mass and data combination. In particular, we find that using the transfer functions for cold dark matter (CDM) + baryons in the computation of the halo mass function, instead of the transfer functions including neutrino perturbations, as prescribed in recent work, yields an ≈0.25 percent downward shift of the σ 8 constraint from tSZ power spectrum data, with a fiducial neutrino mass Σm ν = 0.06 eV. In ΛCDM, with an X-ray mass bias corresponding to the expected hydrostatic mass bias, i.e. (1 - b) ≃ 0.8, our constraints from Planck SZ data are consistent with the latest results from SPT, DES-Y1, and KiDS+VIKING-450. In νΛCDM, our joint analyses of Planck SZ with Planck 2015 primary CMB yield a small improvement on the total neutrino mass bound compared to the Planck 2015 primary CMB constraint, as well as (1 - b) = 0.64 ± 0.04 (68 percent CL). For forecasts, we find that competitive neutrino mass measurements using cosmic variance limited SZ power spectrum require masking the heaviest clusters and probing the small-scale SZ power spectrum up to ℓ max ≈ 10 4 . Although this is challenging, we find that SZ power spectrum can realistically be used to tightly constrain intracluster medium properties: we forecast a 2 percent determination of the X-ray mass bias by combining CMB-S4 and our mock SZ power spectrum with ℓ max = 10 3 .

Astronomy & Astrophysics↗
DOE OSTI2020

A study on the statistical significance of mutual information between morphology of a galaxy and its large-scale environment

ABSTRACT A non-zero mutual information between morphology of a galaxy and its large-scale environment is known to exist in Sloan Digital Sky Survey (SDSS) upto a few tens of Mpc. It is important to test the statistical significance of these mutual information if any. We propose three different methods to test the statistical significance of these non-zero mutual information and apply them to SDSS and Millennium run simulation. We randomize the morphological information of SDSS galaxies without affecting their spatial distribution and compare the mutual information in the original and randomized data sets. We also divide the galaxy distribution into smaller subcubes and randomly shuffle them many times keeping the morphological information of galaxies intact. We compare the mutual information in the original SDSS data and its shuffled realizations for different shuffling lengths. Using a t-test, we find that a small but statistically significant (at $99.9{{\ \rm per\ cent}}$ confidence level) mutual information between morphology and environment exists upto the entire length-scale probed. We also conduct another experiment using mock data sets from a semi-analytic galaxy catalogue where we assign morphology to galaxies in a controlled manner based on the density at their locations. The experiment clearly demonstrates that mutual information can effectively capture the physical correlations between morphology and environment. Our analysis suggests that physical association between morphology and environment may extend to much larger length-scales than currently believed, and the information theoretic framework presented here can serve as a sensitive and useful probe of the assembly bias and large-scale environmental dependence of galaxy properties.

Sarkar, Suman↗
DOE OSTI2020

The completed SDSS-IV extended baryon oscillation spectroscopic survey: pairwise-inverse probability and angular correction for fibre collisions in clustering measurements

ABSTRACT The completed extended Baryon Oscillation Spectroscopic Survey (eBOSS) catalogues contain redshifts of 344 080 quasars at 0.8 < z < 2.2, 174 816 luminous red galaxies between 0.6 < z < 1.0, and 173 736 emission-line galaxies over 0.6 < z < 1.1 in order to constrain the expansion history of the Universe and the growth rate of structure through clustering measurements. Mechanical limitations of the fibre-fed spectrograph on the Sloan telescope prevent two fibres being placed closer than 62 arcsec in a single pass of the instrument. These ‘fibre collisions’ strongly correlate with the intrinsic clustering of targets and can bias measurements of the two-point correlation function resulting in a systematic error on the inferred values of the cosmological parameters. We combine the new techniques of pairwise-inverse probability and the angular upweighting (PIP+ANG) to correct the clustering measurements for the effect of fibre collisions. Using mock catalogues, we show that our corrections provide unbiased measurements, within data precision, of both the projected $\rm {\mathit{ w}_p}\left(\mathit{ r}_p\right)$ and the redshift-space multipole ξ(ℓ = 0, 2, 4)(s) correlation functions down to $0.1\, h^{-1}{\rm Mpc}$, regardless of the tracer type. We apply the corrections to the eBOSS DR16 catalogues. We find that, on scales $s\gtrsim 20\, h^{-1}{\rm Mpc}$ for ξℓ, as used to make baryon acoustic oscillation and large-scale redshift-space distortion measurements, approximate methods such as nearest-neighbour upweighting are sufficiently accurate given the statistical errors of the data. Using the PIP method, for the first time for a spectroscopic program of the Sloan Digital Sky Survey, we are able to successfully access the one-halo term in the clustering measurements down to $\sim 0.1\, h^{-1}{\rm Mpc}$ scales. Our results will therefore allow studies that use the small-scale clustering to strengthen the constraints on both cosmological parameters and the halo occupation distribution models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Comparison of stellar populations in simulated and real post-starburst galaxies in MaNGA

ABSTRACT Recent integral field spectroscopic (IFS) surveys have revealed radial gradients in the optical spectral indices of post-starburst (PSB) galaxies, which can be used to constrain their formation histories. We study the spectral indices of post-processed mock IFS datacubes of binary merger simulations, carefully matched to the properties of the MaNGA IFS survey, with a variety of black hole (BH) feedback models, progenitor galaxies, orbits, and mass ratios. Based on our simulation sample, we find that only major mergers on prograde–prograde or retrograde–prograde orbits in combination with a mechanical BH feedback model can form galaxies with weak enough ongoing star formation, and therefore absent H α emission, to be selected by traditional PSB selection methods. We find strong fluctuations in nebular emission line strengths, even within the PSB phase, suggesting that H α selected PSBs are only a subsample of the underlying population. The global PSB population can be more robustly identified using stellar continuum-based approaches. The difficulty in reproducing the very young PSBs in simulations potentially indicates that new sub-resolution star formation recipes are required to properly model the process of star formation quenching. In our simulations, we find that the starburst peaks at the same time at all radii, but is stronger and more prolonged in the inner regions. This results in a strong time evolution in the radial gradients of the spectral indices that can be used to estimate the age of the starburst without reliance on detailed star formation histories from spectral synthesis models.

Zheng, Yirui↗
DOE OSTI2020

Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced forLarge Synoptic Survey Telescope The Rubin Observatory Legacy Survey of Space and Time (lsst) Dark Energy Science Collaboration (desc). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. Additionally, we report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.

79 ASTRONOMY AND ASTROPHYSICS↗