Engineering topics

Zou, H. (ORCID:0000000266843997)

Publications and source records attributed to Zou, H. (ORCID:0000000266843997).

At least 19 records

DOE OSTI2026

Probing the limits of cosmological information from the Lyman- α forest 2-point correlation functions

The standard cosmological analysis with the Lyα forest relies on a continuum fitting procedure that suppresses information on large scales and distorts the three-dimensional correlation function on all scales. In this work, we present the first cosmological forecasts without continuum fitting distortion in the Lyα forest, focusing on the recovery of large-scale information. Using idealized synthetic data, we compare the constraining power of the full shape of the Lyα forest auto-correlation and its cross-correlation with quasars using the baseline continuum fitting analysis versus the true continuum. We find that knowledge of the true continuum enables a ∼ 10% reduction in uncertainties on the Alcock-Paczyński (AP) parameter and the matter density, Ω m . We also explore the impact of large-scale information by extending the analysis up to separations of 240 h -1 Mpc along and across the line of sight. The combination of these analysis choices can recover significant large-scale information, yielding up to a ∼ 15% improvement in AP constraints. This improvement is analogous to extending the Lyα forest survey area by ∼ 40%.

Lyman alpha forest↗

DOE OSTI2026

Inference of the linear matter power spectrum at z = 0 using DESI DR1 Full-Shape data

Measurements of galaxy distributions at large cosmic distances capture clustering from the past. In this study, we use a cosmological model to translate these observations into the present-day galaxy distribution. Specifically, we reconstruct the 3D linear matter power spectrum at redshift z = 0 using Dark Energy Spectroscopic Instrument (DESI) Year 1 (DR1) galaxy clustering data and Cosmic Microwave Background (CMB) observations, assuming the ΛCDM model, and compare it to the result assuming the w 0 w a CDM model. Building on previous state-of-the-art methods, we apply Effective Field Theory (EFT) modelling of the galaxy power spectrum to account for small-scale effects in the 2-point statistics of galaxy data. Implementation of the EFT approach improves the modelling of the galaxy power spectrum, providing a more robust consistency test of the assumed cosmological model. By casting both CMB and galaxy clustering observations, spanning distinct redshift regimes, into k-space, we can identify discrepancies between the datasets of different redshifts, which would indicate potential inaccuracies in the assumed expansion history. While previous studies have shown consistency with ΛCDM, this work extends the analysis with higher-quality data to further test the expansion histories of both ΛCDM and w 0 w a CDM. Our findings show that both ΛCDM and w 0 w a CDM provide consistent fits to the linear matter power spectrum recovered from DESI DR1 data.

cosmological parameters from LSS↗

DOE OSTI2026

Combined tracer analysis for DESI 2024 BAO

This paper demonstrates how the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) and future baryon acoustic oscillations (BAO) analyses can optimally combine overlapping tracers (galaxies of distinct types) in the same redshift range. We make a unified catalog of Luminous Red Galaxies (LRGs) and Emission Line Galaxies (ELGs) in the redshift range 0.8 < z < 1.1 and investigate the impact on the BAO constraints. DESI DR1 contains ∼ 30% of the final DESI LRG sample and less than 25% of the final ELG sample, and the combination of LRGs and ELGs increases the number density and reduces the shot noise. We developed a pipeline to merge the overlapping tracers using galaxy bias as an approximately optimal weight and tested the pipeline on a suite of Abacus simulations, calibrated on the final version of the DESI Early Data Release. When applying our pipeline to the DESI DR1 catalog, we find an improvement in the BAO constraints of 11% for α iso and ∼ 7.0% for α AP consistent with our findings in mock catalogs. Our analysis was integrated into the DESI DR1 BAO analysis to produce theLRG+ELG result in the 0.8 < z < 1.1 redshift bin, which provided the most precise BAO measurement from DESI DR1 with a 0.86% constraint on the BAO distance scale and a 9.1σ detection of the isotropic BAO feature.

baryon acoustic oscillations↗

DOE OSTI2026

DESI DR1 Ly α 1D power spectrum: Validation of estimators

The Data Release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI) is the largest sample to date for small-scale Lyα forest cosmology, accessed through its one-dimensional power spectrum (P 1D ). The Lyα forest P 1D is extracted from quasar spectra that are highly inhomogeneous (both in wavelength and between quasars) in noise properties due to intrinsic properties of the quasar, atmospheric and astrophysical contamination, and also sensitive to low-level details of the spectral extraction pipeline. We employ two estimators in DR1 analysis to measure P 1D : the optimal estimator and the fast Fourier transform (FFT) estimator. To ensure robustness of our DR1 measurements, we validate these two power spectrum and covariance matrix estimation methodologies against the challenging aspects of the data. First, using a set of 20 synthetic 1D realizations of DR1, we derive the masking bias corrections needed for the FFT estimator and the continuum fitting bias needed for both estimators. We demonstrate that both estimators, including their covariances, are unbiased with these corrections using the Kolmogorov-Smirnov test. Second, we substantially extend our previous suite of CCD image simulations to include 675,000 quasars, allowing us to accurately quantify the pipeline's performance. This set of simulations reveals biases at the highest k values, corresponding to a resolution error of a few percent. We base the resolution systematics error budget of DR1 P 1D on these values, but do not derive corrections from them since the simulation fidelity is insufficient for precise corrections.

Lyman alpha forest↗

DOE OSTI2026

DESI Strong Lens Foundry. III. Keck Spectroscopy for Strong Lenses Discovered Using Residual Neural Networks

We present spectroscopic data of strong lenses and their source galaxies using the Keck Near-Infrared Echellette Spectrometer (NIRES) and the Dark Energy Spectroscopic Instrument (DESI), providing redshifts necessary for nearly all strong-lensing applications with these systems, especially the extraction of physical parameters from lensing modeling. These strong lenses were found in the DESI Legacy Imaging Surveys using residual neural networks and followed up by our Hubble Space Telescope program, with all systems displaying unambiguous lensed arcs. With NIRES, we target eight lensed sources at redshifts difficult to measure in the optical range and determine the source redshifts for six, between z s = 1.675 and 3.332. DESI observed one of the remaining source redshifts, as well as an additional source redshift within the six systems. The two systems with nondetections by NIRES were observed for a considerably shorter 600 s at high airmass. Combining NIRES infrared spectroscopy with optical spectroscopy from our DESI Strong Lensing Secondary Target Program, these results provide the complete lens and source redshifts for six systems, a resource for refining automated strong lens searches in future deep- and wide-field imaging surveys and addressing a range of questions in astrophysics and cosmology.

Agarwal, Shrihan [University of Chicago, IL (Unite↗

DOE OSTI2026

The DESI DR1 peculiar velocity survey: growth rate measurements from the maximum likelihood fields method

We present the constraint on the growth rate of structure from the combination of DESI DR1 BGS sample, Fundamental Plane, and Tully-Fisher peculiar velocity catalogues using the maximum likelihood fields method. The combined catalogue contains 415,523 galaxy redshifts and 76,616 peculiar velocity measurements. To handle the large amount of data in the DESI DR1 peculiar velocity catalogue, we significantly improve the computational efficiency by rewriting the algorithm with JAX. After removing outliers and Tully-Fisher galaxies that are affected by systematics, we find fσ 8 = 0.483 -0.043 +0.080 (stat) ± 0.018(sys), consistent within 1σ with the power spectrum and correlation function analysis using the same dataset. Combining all three measurements with appropriate correlations, the consensus measurement is fσ 8 (z eff = 0.07) = 0.450±0.055, consistent with Planck +ΛCDM cosmology (fσ 8 = 0.449±0.008). Combining with the high redshift growth rate of structure measurements from DESI ShapeFit, the constraint on the growth index is γ = 0.58±0.11, consistent with GR.

cosmic flows↗

DOE OSTI2026

H 0 without the sound horizon (or supernovae): A 2% measurement in DESI DR1

The sound horizon scale rs is a key source of information for measurements of H 0 from early-time data, and is therefore a common target of new physics proposed to solve the Hubble tension. We present a sub-2% measurement of the Hubble constant that is independent of this scale, using data from the first data release of the Dark Energy Spectroscopic Instrument (DESI DR1). Building on previous work, we remove dependency on the sound horizon size using a heuristic rescaling procedure at the power spectrum level. A key innovation is the inclusion of uncalibrated (agnostic to r s ) post-reconstruction BAO measurements from DESI DR1, as well as using the CMB acoustic scale θ* as a high-redshift anchor. Uncalibrated type-Ia supernovae are often included as an independent source of Ω m information; here we demonstrate the robustness of our results by additionally considering two supernova-independent alternative datasets. We find somewhat higher values of H 0 relative to our previous work: 69.2 +1.3 -1.4 , 70.3 +1.4 -1.2 , and 69.6 +1.3 -1.8 km s -1 Mpc -1 respectively when including measurements from i) Planck/ACT CMB lensing × unWISE galaxies, ii) the DES Year 3 6×2pt analysis, and iii) Planck/ACT CMB lensing + the DES Year 5 supernova analysis. These remarkably consistent constraints achieve better than 2% precision; they are among the most stringent sound horizon-independent measurements from LSS to date, and provide a powerful avenue for probing the origin of the Hubble tension.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

DESI EDR: Calibrating the Tully–Fisher Relationship with the DESI Peculiar Velocity Survey

We calibrate the Tully–Fisher relation (TFR) with data from the DESI Peculiar Velocity (PV) Survey taken during the Survey Validation (SV) period of the DESI galaxy redshift survey. Placing spectroscopic fibers on the centers and major axes of spatially extended spiral galaxies identified in the 2020 Siena Galaxy Atlas using the DESI Legacy Surveys, we measure the rotational velocities at 0.33R 26 for 1155 (1128 + 27 dwarf) spiral galaxies observed during SV. Using 39 spiral galaxies observed in the Coma cluster, we find a slope for the TFR of −8.32 ± 0.15 AB mag in the r band, with a scatter about the TFR of 1.12 ± 0.03 AB mag. We calibrate the zero-point of the TFR using galaxies with independent distances measured using type Ia supernovae (SNe Ia) via the cosmological distance ladder. From the SN Ia distances, we measure a zero-point of $-19.21^{+0.30}_{-0.31}$ AB mag in the r band. We produce a public catalog of the distances to these 1128 spiral galaxies observed during DESI SV as part of the DESI PV Survey with our calibrated TFR. This is, to our knowledge, the first catalog of TFR distances produced with velocities measured at a single point in the disk.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

A Unified Photometric Redshift Calibration for Weak Lensing Surveys Using the Dark Energy Spectroscopic Instrument

The effective redshift distribution n(z) of galaxies is a critical component in the study of weak gravitational lensing. Here, we introduce a new method for determining n(z) for weak lensing surveys based on high-quality redshifts and neural-network-based importance weights. Additionally, we present the first unified photometric redshift calibration of the three leading stage-III weak lensing surveys, the Dark Energy Survey (DES), the Hyper Suprime-Cam (HSC) survey, and the Kilo-Degree Survey (KiDS), with state-of-the-art spectroscopic data from the Dark Energy Spectroscopic Instrument (DESI). We verify our method using a new, data-driven approach and obtain n(z) constraints with statistical uncertainties of the order of $σ_z$ ~ 0.01 and smaller. Our analysis is largely independent of previous photometric redshift calibrations and, thus, provides an important cross-check in light of recent cosmological tensions. Overall, we find excellent agreement with previously published results on the DES Y3 and HSC Y1 data sets, while there are some differences on the mean redshift with respect to the previously published KiDS-1000 results. We attribute the latter to mismatches in photometric noise properties in the COSMOS field compared to the wider KiDS self-organizing map-gold catalog. At the same time, the new n(z) estimates for KiDS do not significantly change estimates of cosmic structure growth from cosmic shear. Finally, we discuss how our method can be applied to future weak lensing calibrations with DESI data.

Lange, J. U. [American Univ., Washington, DC (Unit↗

DOE OSTI2026

DESI Strong Lens Foundry. I. HST Observations and Modeling with GIGA-Lens

We present the Dark Energy Spectroscopic Instrument (DESI) Strong Lens Foundry. We discovered ∼3500 new strong gravitational lens candidates in the DESI Legacy Imaging Surveys using residual neural networks (ResNet). We observed a subset (51) of our candidates using the Hubble Space Telescope (HST). Except for one ambiguous case, we have confirmed 50 of the 51 candidates to be strong lenses. We also briefly describe spectroscopic follow-up observations by DESI and Keck NIRES programs. From this very rich data set, a number of studies will be carried out, including evaluating the quality of the ResNet search candidates and lens modeling. In this paper, we present our initial effort in these directions. In particular, as a demonstration, we present the lens model for DESI-165.4754−06.0423, with imaging data from HST, and lens and source redshifts from DESI and Keck NIRES, respectively. In this effort, we have applied a fully forward-modeling Bayesian approach (GIGA-Lens), using multiple GPUs, to a strong lens with HST data, and achieved statistical convergence.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

A New Way to Discover Strong Gravitational Lenses: Pairwise Spectroscopic Search from DESI DR1

We present a new method to search for strong gravitational-lensing systems by pairing spectra that are close together on the sky in a spectroscopic survey. We visually inspect 26,621 spectra in the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 that are selected in this way. We further inspect the 11,848 images corresponding to these spectra in the DESI Legacy Imaging Surveys Data Release 10, and obtain 2046 conventional strong gravitational lens candidates, of which 1906 are new. This constitutes the largest sample of lens candidates identified to date in spectroscopic data. Besides the conventional candidates, we identify a new class of systems that we term “dimple lenses.” These systems have a low-mass foreground galaxy as a lens, typically smaller in angular extent and fainter compared with the lensed background source galaxy, producing subtle surface brightness indentations in the latter. We report the discovery of 318 of these “dimple lens” candidates. We suspect that these represent dwarf galaxy lensing. With follow-up observations, they could offer a new avenue to test the cold dark matter model by probing their mass profiles, stellar mass–halo mass relation, and halo mass function for M Halo ≲ 10 13 M ⊙ . Thus, in total, we report 2164 new lens candidates. Our method demonstrates the power of pairwise spectroscopic analysis and provides a pathway complementary to imaging-based and single-spectrum lens searches.

Hsu, Yuan-Ming 許淵明 [National Taiwan University, Ta↗

DOE OSTI2026

Cosmological neutrino mass: a frequentist overview in light of DESI

We derive constraints on the neutrino mass using a variety of recent cosmological datasets, including DESI BAO, the full-shape analysis of the DESI matter power spectrum and the one-dimensional power spectrum of the Lyman-α forest (P1D) from eBOSS quasars as well as the cosmic microwave background (CMB). The constraints are obtained in the frequentist formalism by constructing profile likelihoods and applying the Feldman-Cousins prescription to compute confidence intervals. This method avoids potential prior and volume effects that may arise in a comparable Bayesian analysis. Parabolic fits to the profiles allow one to distinguish changes in the upper limits from variations in the constraining power σ of the different data combinations. We find that all profiles in the ΛCDM model are cut off by the ∑m ν ≥ 0 bound, meaning that the corresponding parabolas reach their minimum in the unphysical sector. The most stringent 95% C.L. upper limit is obtained by the combination of DESI DR2 BAO, Planck PR4 and CMB lensing at 53 meV, below the minimum of 59 meV set by the normal ordering. The corresponding constraining power σ is 43 meV, which highlights the importance of the cut-off by negative values in the determination of the upper limit. Extending ΛCDM to non-zero curvature and w 0 w a CDM relaxes the constraints past 59 meV again, but only w 0 w a CDM exhibits profiles with a minimum at a positive value. Additionally, we extend the formalism to constrain the lightest neutrino mass. For DESI DR2 BAO, Planck PR4 and CMB lensing, we find confidence limits at 20 and 19 meV for normal and inverted ordering, respectively. Using a combination of DESI DR1 full-shape, BBN and eBOSS Lyman-α P1D, we successfully constrain the neutrino mass independently of the CMB. This combination yields m l ≤ 97 and 98 meV in the normal and inverted orderings, and total neutrino mass ∑m ν ≤ 285 meV (95% C.L.). The addition of DESI full-shape or Lyman-α P1D to CMB and DESI BAO results in small but noticeable improvement of the constraining power of the data. Lyman-α free-streaming measurements especially improve the constraint. Since they are based on eBOSS data, this sets a promising precedent for upcoming DESI data.

Frequentist statistics↗

DOE OSTI2026

The Compilation and Validation of the Spectroscopic Redshift Catalogs for the DESI-COSMOS and DESI-XMM-LSS Fields

Over several dedicated programs that include targets beyond the main cosmological samples, the Dark Energy Spectroscopic Instrument collected spectra for 304,970 unique objects in two fields centered on the COSMOS and XMM-LSS fields. In this work, we develop spectroscopic redshift robustness criteria for those spectra, validate these criteria using visual inspection, and provide two custom value-added catalogs with our redshift characterizations. With these criteria, we reliably classify 212,935 galaxies below z < 1.6, 9713 quasars, and 35,222 stars. The resulting catalogs achieve a redshift purity exceeding 99.4% across all galaxy samples. As a critical element in characterizing the selection function, we provide the description of 70 different algorithms that were used to select these targets from imaging data. To facilitate joint imaging/spectroscopic analyses, we provide row-matched photometry from the Dark Energy Camera, Hyper-Suprime Cam, and public COSMOS2020 photometric catalogs. Finally, we demonstrate example applications of these large catalogs to photometric redshift estimation, cluster finding, and completeness studies.

Ratajczak, J. [Univ. of Utah, Salt Lake City, UT (↗

DOE OSTI2025

The Lyman- α forest from LBGs: First 3D correlation measurement with DESI and prospects for cosmology

The Lyman-α (Lyα) forest is a key tracer of large-scale structure at redshifts z > 2, traditionally studied using the spectra of luminous but relatively rare quasars. In this work, we explore the viability of using the fainter yet significantly more abundant Lyman Break Galaxies (LBGs) as alternative background sources for Lyα forest studies. We analyze 4,151 Lyα forest skewers extracted from LBG spectra obtained in the DESI pilot surveys conducted in the COSMOS and XMM-LSS fields. From this dataset, we present the first measurement of the Lyα forest auto-correlation function derived exclusively from LBG spectra, probing comoving separations up to 48 h -1 Mpc at an effective redshift of z eff = 2.70. The measured LBG Lyα forest auto-correlation is consistent with that derived from DESI DR2 quasar Lyα forest spectra at a comparable redshift, validating the use of LBGs as reliable background sources for Lyα forest analyses. In addition, we measure the cross-correlation between the LBG Lyα forest and the positions of 13,362 galaxies, demonstrating that this observable serves as a sensitive diagnostic for assessing the precision and accuracy of galaxy redshift estimates, and for identifying and correcting systematic offsets. Finally, using both synthetic LBG spectra and Fisher matrix forecasts, we show that a future wide-area survey covering ∼5,000 deg 2 , targeting 1,000 LBGs per square degree at signal-to-noise levels comparable to our sample, could enable LBG-based Lyα forest baryon acoustic oscillation (BAO) measurements with expected uncertainties of σ α ISO = 0.4% (isotropic) and σ α AP = 1.3% (Alcock-Paczynski). This performance is further enhanced when combining the BAO analysis with a Lyα forest Full Shape (FS) approach, yielding a predicted uncertainty of σ α ISO FS = 0.6%. These results open a new avenue for precision cosmology at high redshift using the Lyα forest in dense LBG samples.

Lyman alpha forest↗

DOE OSTI2025

DESI Spectroscopy of HETDEX Emission-line Candidates. I. Line Discrimination Validation

The Hobby–Eberly Dark Energy Experiment (HETDEX) is an untargeted spectroscopic galaxy survey that uses Lyα-emitting galaxies (LAEs) as tracers of 1.9 < z < 3.5 large-scale structure. Most detections consist of a single emission line, whose identity is inferred via a Bayesian analysis of ancillary data. To determine the accuracy of these line identifications, HETDEX detections were observed with the Dark Energy Spectroscopic Instrument (DESI). In two DESI pointings, high-confidence spectroscopic redshifts are obtained for 1157 sources, including 982 LAEs. The DESI spectra are used to evaluate the accuracy of the HETDEX object classifications and tune the methodology to achieve the HETDEX science requirement of ≲2% contamination of the LAE sample by low-redshift emission-line galaxies, while still assigning 96% of the true Lyα emission sample with the correct spectroscopic redshift. We compare emission-line measurements between the two experiments assuming a simple Gaussian line fitting model. Fitted values for the central wavelength of the emission line, the measured line flux, and line widths are consistent between the surveys within uncertainties. Derived spectroscopic redshifts, from the two classification pipelines, when both agree as an LAE classification, are consistent to within $\langle$Δz/(1 + z)$\rangle$ = 6.9 × 10 −5 with an rms scatter of 3.3 × 10 −4 . Data are available at https://data.desi.lbl.gov/desi/public/dr1/vac/dr1/hetdex.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

A joint analysis of 3D clustering and galaxy × CMB-lensing cross-correlations with DESI DR1 galaxies

The spectroscopic data from DESI Data Release 1 (DR1) galaxies enables the analysis of 3D clustering by fitting galaxy power spectra and reconstructed correlation functions in redshift space. Given low measurements of the amplitude of structure from cosmic shear at z ∼ 1, redshift space distortions (RSD) + Baryon Acoustic Oscillation (BAO) signals from DESI galaxies combined with weak lensing can break degeneracies and provide a tight alternative constraint on the z ∼ 1 amplitude of structure. In this paper we perform joint analyses that combine full-shape + post-reconstruction information from the DESI DR1 BGS and LRG samples along with angular cross-correlations with Planck PR4 and ACT DR6 CMB lensing maps. We show that adding galaxy-lensing cross-correlations tightens clustering amplitude constraints, improving σ 8 uncertainties by 30% over RSD+BAO alone. We also include angular galaxy-galaxy and galaxy-lensing spectra using photometric samples from the DESI Legacy Survey to further improve constraints. Our headline results are σ 8 = 0.803 ± 0.017, Ω m = 0.3037 ± 0.0069, and S 8 = 0.808 ± 0.017. Given DESI's preference for higher σ 8 compared to lower values from BOSS, we perform a catalog-level comparison of LRG samples from both surveys. We test sensitivity to dark energy assumptions by relaxing our ΛCDM prior and allowing for evolving dark energy via the w 0 - w a parameterization. We find our S 8 constraints to be relatively unchanged despite a 3.5σ tension with the cosmological constant model when combining with the Union3 supernova likelihood. Finally we test general relativity (GR) by allowing the gravitational slip parameter (γ) to vary, and find γ = 1.17 ± 0.11 in mild (∼ 1.5σ) tension with the GR value of 1.0.

cosmological parameters from LSS↗

DOE OSTI2025

A Comprehensive Characterization of Galaxy-cool CGM Connections at z < 0.4 with DESI Year 1 Data

We investigate the relationships between the cool circumgalactic medium (CGM), traced by Ca II absorption lines, and galaxy properties at z < 0.4 using ∼900,000 galaxy–quasar pairs within 200 kpc from the Year 1 data of the Dark Energy Spectroscopic Instrument (DESI). This large data set enables us to obtain composite spectra with sensitivity reaching to the mÅ level and to explore the Ca II absorption as a function of stellar mass, star formation rate (SFR), redshift, and galaxy types, including active galactic nuclei (AGNs). Our results show a positive correlation between the absorption strength and stellar mass of star-forming galaxies with $\langle$$W$$^{Ca II}_{0}$$\rangle$ α $M$$^{0.5}_{*}$ over 3 orders of magnitude in stellar mass from ∼10 8 to 10 11 M ⊙ , while such a mass dependence is weaker for quiescent galaxies. At a fixed mass, Ca II absorption is stronger around star-forming galaxies than quiescent ones especially within impact parameters <30 kpc. Among star-forming galaxies, the Ca II absorption further correlates with SFR, following ∝SFR 0.3 . However, in contrast to the results at higher redshifts, stronger absorption is not preferentially observed along the minor axis of star-forming galaxies, indicating a possible redshift evolution of CGM dynamics resulting from galactic feedback. Moreover, no significant difference between the properties of the cool gas around AGNs and galaxies is detected. Finally, we measure the absorption profiles with respect to the virial radius of dark matter halos and show that the total Ca II mass in the CGM is comparable to the Ca mass in the ISM of galaxies.

Circumgalactic medium↗

DOE OSTI2025

Using active learning to improve quasar identification for the DESI spectra processing pipeline

The Dark Energy Spectroscopic Instrument (DESI) survey uses an automatic spectral classification pipeline to classify spectra. QuasarNET is a convolutional neural network used as part of this pipeline originally trained using data from the Baryon Oscillation Spectroscopic Survey (BOSS). In this paper we implement an active learning algorithm to optimally select spectra to use for training a new version of the QuasarNET weights file using only DESI data, with the goal of improving classification accuracy. This active learning algorithm includes a novel outlier rejection step using a Self-Organizing Map to ensure we label spectra representative of the larger quasar sample observed in DESI. We perform two iterations of the active learning pipeline, assembling a final dataset of 5600 labeled spectra, a small subset of the approximately 1.3 million quasar targets in DESI's Data Release 1. When splitting the spectra into training and validation subsets we achieve similar performance to the previously trained weights file in completeness and purity calculated on the validation dataset but do so with less than one tenth of the amount of training data. The new weights also more consistently classify objects in the same way when used on unlabeled data compared to the old weights file. In the process of improving QuasarNET's classification accuracy we discovered a systemic error in QuasarNET's redshift estimation and used our findings to improve our understanding of QuasarNET's redshifts.

Machine learning↗