Search NASA⌕ Search

SEARCH · Search NASA

Results for “outliers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

FY12 End of Year Report for NEPP DDR2 Reliability

This document reports the status of the NEPP Double Data Rate 2 (DDR2) Reliability effort for FY2012. The task expanded the focus of evaluating reliability effects targeted for device examination. FY11 work highlighted the need to test many more parts and to examine more operating conditions, in order to provide useful recommendations for NASA users of these devices. In order to develop these approaches, it is necessary to develop test capability that can identify reliability outliers. To do this we must test many devices to ensure outliers are in the sample, and we must develop characterization capability to measure many different parameters. For FY12 we increased capability for reliability characterization and sample size. We increased sample size by moving from loose devices to DIMMs with an approximate reduction of 20 to 50 times in terms of per DUT cost. By increasing sample size we have improved our ability to characterize devices that may be considered reliability outliers. This report provides an update on the effort to improve DDR2 testing capability. Although focused on DDR2, the methods being used can be extended to DDR and DDR3 with relative ease.

temperature stress↗
DOE OSTI2025

TropiRoot 1.0: Database of tropical root characteristics across environments

Tropical ecosystems contain the world's largest biodiversity of vascular plants. Yet, our understanding of tropical functional diversity and its contribution to global diversity patterns is constrained by data availability. This discrepancy underscores an urgent need to bridge data gaps by incorporating comprehensive tropical root data into global datasets. Here, we provide a database of tropical root characteristics. This new database, TropiRoot 1.0, will be instrumental in evaluating an array of hypotheses pertaining to root functional ecology and plant biogeography, both within the tropics and relative to other global biomes. The data compilation was conducted by the TropiRoot Initiative, in partnership with the Fine-Root Ecology Database (FRED) and the Global Root Trait (GRooT) database, Colorado State University (CSU) and the Smithsonian Tropical Research Institute (STRI). Literature search and data extraction were conducted between 2020 and 2024. Literature was identified using Web of Science, Scopus, and complemented using the expert knowledge of members of TropiRoot. To provide broad environmental and geographical distributions, literature searches included root characteristics (traits) across global change drivers, natural gradients, and from different continents. We adopted FRED standardized data columns and streamlined the format to enhance accessibility for data extraction across various user groups. This optimized framework resulted in a smaller, yet comprehensive datasheet. To make the database compatible with other global root trait initiatives, column identification was standardized following the codes provided by FRED. These efforts culminated in data extracted from 104 new sources, resulting in more than 8000 rows of data (either species or community data). Most of the data in TropiRoot 1.0 include root characteristics such as root biomass, morphology, root dynamics, mass fraction, architecture, anatomy, physiology, and root chemistry. This initiative represents a 30% increase in the currently available data for tropical roots in FRED. TropiRoot 1.0 contains root characteristics from 25 different countries, where seven are located in Asia, six in South America, five in Central America and the Caribbean, four in Africa, two in North America, and 1 in Oceania. Due to the volume of data, when ancillary data were available, including soil data, these data were either extracted and included in the database or its availability was recorded in an additional column. Multiple contributors checked the entries for outliers during the collation process to ensure data quality. For text-based observations, we examined all cells to ensure that their content relates to their specific categories. For numerical observations, we ordered each numerical value from least to greatest and plotted the values, checking apparent outliers against the data in their respective sources and correcting or removing incorrect or impossible values. Some data (soil and aboveground) have different columns for the same variable presented in different units, including originally published units, but root characteristics data had units converted to match those reported in FRED. By filling a gap from global databases, TropiRoot 1.0 expands our knowledge of otherwise so far underrepresented regions and our ability to assess global trends. This advancement can be used to improve tropical forest representation in vegetation models. The data are freely available and should be cited when used.

FRED↗
DOE OSTI2025

Comparison of removal and spatial mark‐resight models for estimating wild pig density

Density estimation is critical to effectively manage invasive species and elucidate areas of highest concern. For wild pigs (Sus scrofa), the ability to estimate density is complicated because of their variable home range sizes and social structure. Common methods for estimating density (e.g., mark-recapture) may be unsuitable in management applications because additional data needs to be collected before and after management. Removal models offer a suitable alternative to estimate density changes following management and can be applied broadly across areas where management of wild pigs is ongoing. We collected wild pig removal and camera trap data from 25 private properties ranging in size from approximately 0.5 km 2 to 95 km 2 across 3 ecoregions in South Carolina, USA, from 2020–2023. We compared factors affecting consistency and precision of property-level density estimates between removal and spatial mark-resight (SMR) models. In general, excluding 1 large outlier, density estimates from removal models were between 0.60 and 15.85 wild pigs/km 2 (median = 5.34) with a median coefficient of variation (CV) of 0.76 and 95% confidence intervals for the CV between 0.70 and 0.94. Similarly, excluding 1 large outlier, density estimates from SMR were between 0.22 and 30.97 wild pigs/km 2 (median = 5.48) with a median CV of 0.39 and 95% confidence intervals for the CV between 0.38 and 1.20. We found the precision of removal models was affected primarily by the number of wild pigs dispatched in the removal period (3 months) and the ecoregion in which they were removed. None of the covariates, including the number of recaptures (a corresponding measure of sample size), influenced precision of the SMR models, although recaptures did influence the density estimates. At the individual property level, density estimates from our 2 estimators were dissimilar from each other in approximately 80% of instances, although none of the covariates we examined influenced dissimilarity. Our results provide unique insight into how sample size affects density estimates using 2 common methods and into novel SMR models that incorporate both marked and unmarked detections. In addition, the density estimates in this study can be used as a reference for wild pig densities in common land cover types throughout the southeastern United States.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Subsampling and DNA pooling can increase gains through genomic selection in switchgrass

Genomic selection (GS) can accelerate breeding cycles in perennial crops such as the bioenergy grass switchgrass (Panicum virgatum L.). The sequencing costs of GS can be reduced by pooling DNA samples in the training population (TP), only sequencing TP phenotypic outliers, or pooling candidate population (CP) samples. These strategies were simulated for two traits (spring vigor and anthesis date) in three breeding populations. Sequencing only the outlier 50% of the TP phenotype distribution resulted in a penalty of <5% of the predictive ability, measured using cross-validation. Predictive ability also decreased when sequencing progressively fewer TP DNA pools, but TPs constructed from only two phenotypically contrasting DNA samples retained a mean of >80% predictive ability relative to individual TP sequencing. Novel group testing methods allowed greater than one CP individual to be screened per sequenced DNA sample but resulted in a predictive ability penalty. To determine the impact of reduced sequencing, genetic gain was calculated for seven GS scenarios with variable sequencing budgets. Reduced TP sequencing and most CP pooling methods were superior to individual sequence-based GS when sequencing resources were restricted (2,000 DNA samples per 5-yr cycle). Only one scenario was superior to individual sequencing when sequencing budgets were large (8,000 DNA samples per 5-yr cycle). This study highlights multiple routes for reduced sequencing costs in GS.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Robust and optimal alignment of high-dimensional data using maximum likelihood estimation through a random sample consensus framework

Abstract Correcting spatial orientations of groups of high-dimensional data sets such that they are all in a consistent coordinate system is often a time-consuming and error-prone process. Automation of this process can be accomplished by using Generalized Procrustes Analysis to estimate the relative orientations among a population of high-dimensional data sets. A least squares Procrustes solution is applied through a maximum likelihood estimation and random sample consensus framework for robustness. The likelihood model is comprised of a mixture distribution where inliers are modeled using t -distribution and outliers from a uniform distribution. Applications will focus on a synthetic data set that emulates triaxial acceleration data and also real shock data from a population of triaxial accelerometers. Outliers represent either non-rigid body responses, environmental noise, and/or sensor and data acquisition issues. The intended application for the methodology is to robustly automate the rotation of populations of experimentally collected triaxial accelerometer data sets to a single global coordinate system.

LOSAC↗
DOE OSTI2021

Photometric redshifts for the S-PLUS Survey: Is machine learning up to the task?

The Southern Photometric Local Universe Survey (S-PLUS) is a novel project that aims to map the Southern Hemisphere using a twelve filter system, comprising five broad-band SDSS-like filters and seven narrow-band filters optimized for important stellar features in the local universe. In this paper we use the photometry and morphological information from the first S-PLUS data release (S-PLUS DR1) cross-matched to unWISE data and spectroscopic redshifts from Sloan Digital Sky Survey DR15. We explore three different machine learning methods (Gaussian Processes with GPz and two Deep Learning models made with TensorFlow) and compare them with the currently used template-fitting method in the S-PLUS DR1 to address whether machine learning methods can take advantage of the twelve filter system for photometric redshift prediction. Using tests for accuracy for both single-point estimates such as the calculation of the scatter, bias, and outlier fraction, and probability distribution functions (PDFs) such as the Probability Integral Transform (PIT), the Continuous Ranked Probability Score (CRPS) and the Odds distribution, we conclude that a deep-learning method using a combination of a Bayesian Neural Network and a Mixture Density Network offers the most accurate photometric redshifts for the current test sample. In conclusion, it achieves single-point photometric redshifts with scatter (σ NMAD ) of 0.023, normalized bias of -0.001, and outlier fraction of 0.64% for galaxies with r_auto magnitudes between 16 and 21.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Emerging contact force heterogeneity in ordered soft granular media

Under external perturbations, inter-particle forces in disordered granular media are well known to form a heterogeneous distribution with filamentary patterns. Better understanding these forces and the distribution is important for predicting the collective behavior of granular media, the media second only to water as the most manipulated material in global industry. However, studies in this regard so far have been largely confined to granular media exhibiting only geometric heterogeneity, leaving the dimension of mechanical heterogeneity a rather uncharted area. In this work, through a FEM contact mechanics model, we show that a heterogeneous inter-particle force distribution can also emerge from the dimension of mechanical heterogeneity alone. Specifically, we numerically study inter-particle forces in packing of mechanically heterogeneous disks arranged over either a square or a hexagonal lattice and under quasi-static isotropic compression. Our results show that, at the system scale, a hexagonal packing exhibit a more heterogeneous inter-particle force distribution than a square packing does; At the particle scale, for both packing lattices, preliminary analysis shows the consistent coexistence of outliers (i.e., softer disks sustaining larger forces while stiffer disks sustaining smaller forces) in comparison to their homogeneous counterparts, which implies the existence of nonlocal effect. Further analysis on the portion of outliers and on spatial contact force correlations suggest that the hexagonal packing shows more pronounced nonlocal effect over the square packing under small mechanical heterogeneity. However, such trend is reversed when assemblies becomes more mechanically heterogeneous. Lastly, we confirm that, in the absence of particle reorganization events, contact friction merely plays the role of packing stabilization while its variation has little effect on inter-particle forces and their distribution.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Evaluating 239 Pu(n,f) cross sections via machine learning using experimental data, covariances, and measurement features

In this paper, the neutron-induced 239 Pu fission cross section, 239 Pu(n,f), is evaluated from 1–20 MeV using experimental data and associated covariances while also considering information on the measurement, termed features here. For instance, methods to determine the background, sample backing material, or impurities in the sample, are explicitly taken into account in the evaluation process. To this end, outliers in the experimental data are identified with a modified version of the Hybrid Robust Support Vector Machine. In a second step, two machine learning methods (logistic regression with elastic net regularization and random forest regression with SHAP feature importance metric) are used to highlight measurement features that are common among many of the outlying data points. Based on this analysis, penalty uncertainties are added to the experimental covariances of outlying data points that have outlier measurement features and are put through the generalized-least-squares evaluation. The resulting evaluated mean values and covariances differ distinctly from those data evaluated without the penalty uncertainties. These results highlight that certain measurement features should be more closely examined.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Bio-Oil Impact on Water Diffusion and Durability of Bitumen: Influence of Aging and Salinity

Bio-oils derived from inexpensive biomass offer environmentally friendly options for modifying bitumen for improved durability or rejuvenating aged material, although their impact on bitumen moisture resistance can be mixed. A better understanding of water diffusion into bitumen and its interactions with bio-oil compounds would aid the development of effective bio-oils. In this study, the effect of water exposure on bio-oil-modified bitumen blends was examined by de-wetting contact angle measurements and differential FTIR spectroscopy. The bio-oils improved the anti-stripping behavior of the bitumen but also increased water absorption which could weaken cohesive strength. Short-term thermal aging increased water diffusion for all bitumen blends including the control, probably due to the presence of more oxidized compounds. Negative peaks of alkanes and polar groups in the differential FTIR data suggest the co-diffusion of surfactant molecules towards the bitumen-water interface. Basic pH increased de-wetting of some bitumen blends from silica, possibly by attacking the silica surface itself. The presence of salt in solution altered the bitumen surface composition through the formation of salt complexes with bitumen or bio-oil compounds. In particular, the formation of calcium-carboxylate complexes appeared to greatly improve anti-stripping effects of bio-oils. Water diffusion into most of the bitumen blends was insensitive to pH or salt concentration except for a few notable outliers. Identifying the compounds responsible for increasing or decreasing water diffusion in these outlier cases would be valuable developing future bio-oil formations that avoid or promote those compounds.

Hung, Albert M.↗
DOE OSTI2023

Large Local Currents in a Lithium-Ion Battery during Rest after Fast Charging

Increasing electric vehicle (EV) adoption requires lithium-ion batteries that can be charged quickly and safely. Some EV batteries have caught on fire despite being neither charged nor discharged. While the lithium that plates on graphite during fast charging affects battery safety, so do the internal ionic currents that can occur when the battery is at rest after charging. These currents are difficult to quantify; the external current that can readily be measured is zero. Here we study a graphite electrode at rest after 6C fast charging using operando X-ray microtomography. We quantify spatially resolved current density distributions that originate at plated lithium and end in underlithiated graphite particles. The average current densities decrease from 1.5 to 0.5 mA cm -2 in about 20 min after charging is stopped. Surprisingly, the range of the stripping current density is independent of time, with outliers above 20 mA cm -2 . In conclusion, the persistence of outliers provides a clue as to the origin of catastrophic failure in batteries at rest.

25 ENERGY STORAGE↗
DOE OSTI2023

A group finder algorithm optimised for the study of local galaxy environments

Context. The majority of galaxy group catalogues available in the literature use the popular friends-of-friends algorithm which links galaxies using a linking length. One potential drawback to this approach is that clusters of points can be linked with thin bridges which may not be desirable. In order to study galaxy groups, it is important to obtain realistic group structures. Aim. Here, in this study, we present a new simple group finder algorithm, TD-ENCLOSER, that finds the group that encloses a target galaxy of interest. Methods. TD-ENCLOSER is based on the kernel density estimation method which treats each galaxy, represented by a zero-dimensional particle, as a two-dimensional circular Gaussian. The algorithm assigns galaxies to peaks in the density field in order of density in descending order (‘top down’) so that galaxy groups ‘grow’ around the density peaks. Outliers in under-dense regions are prevented from joining groups by a specified hard threshold, while outliers at the group edges are clipped below a soft (blurred) interior density level. Results. The group assignments are largely insensitive to all free parameter variations apart from the hard density threshold and the kernel standard deviation, although this is a known feature of density-based group finder algorithms and it operates with a computing speed that increases linearly with the size of the input sample. In preparation for a companion paper, we also present a simple algorithm to select unique representative groups when duplicates occur. Conclusions. TD-ENCLOSER is tested on a mock galaxy catalogue using a smoothing scale of 0.3 Mpc and is found to be able to recover the input group distribution with sufficient accuracy to be applied to observed galaxy distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

SN 2020bqj: A Type Ibn supernova with a long-lasting peak plateau

We report type Ibn supernovae (SNe Ibn) are a rare class of stripped envelope supernovae interacting with a helium-rich circumstellar medium (CSM). The majority of the SNe Ibn reported in the literature display a surprising homogeneity in their fast-evolving lightcurves and are typically found in actively starforming spiral galaxies. We present the discovery and the study of SN 2020bqj (ZTF20aalrqbu), a SN Ibn with a long-duration peak plateau lasting 40 days and hosted by a faint low-mass galaxy. We aim to explain its peculiar properties using an extensive photometric and spectroscopic data set. We compare the photometric and spectral evolution of SN 2020bqj with regular SNe Ibn from the literature, as well as with other outliers in the SN Ibn subclass. We fit the bolometric and multi-band lightcurves with powering mechanism models such as radioactive decay and CSM interaction. We also model the host galaxy of SN 2020bqj. The risetime, peak magnitude and spectral features of SN 2020bqj are consistent with those of most SNe Ibn, but the SN is a clear outlier in the subclass based on its bright, long-lasting peak plateau and the low mass of its faint host galaxy. We show through modeling that the lightcurve of SN 2020bqj can be powered predominantly by shock heating from the interaction of the SN ejecta and a dense CSM, combined with radioactive decay. The peculiar Type Ibn SN 2011hw is a close analog to SN 2020bqj in terms of lightcurve and spectral evolution, suggesting a similar progenitor and CSM scenario. In this scenario a very massive progenitor star in the transitional phase between a luminous blue variable and a compact Wolf-Rayet star undergoes core-collapse, embedded in a dense helium-rich CSM with an elevated opacity compared to normal SNe Ibn, due to the presence of residual hydrogen. This scenario is consistent with the observed properties of SN 2020bqj and the modeling results. SN 2020bqj is a compelling example of a transitional SN Ibn/IIn based on not only its spectral features, but also its lightcurve, host galaxy properties and the inferred progenitor properties. The strong similarity with SN 2011hw suggests this subclass may be the result of a progenitor in a stellar evolution phase that is distinct from those of progenitors of regular SNe Ibn.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

3D radiation, density, and MHD structures following neon shattered pellet injection into stable DIII-D Super H-mode discharges

Six nominally repeat neon shattered pellet injection (SPI) shutdowns of stable DIII-D Super H-modes are studied to understand the 3D properties of the radiation and impurity transport. The radiation efficiency and radiation peaking determine whether first wall melting is expected following disruption mitigation in ITER. Previous studies make use of axisymmetric approximations to infer radiation efficiencies, but validating the high efficiency required by ITER necessitates improved accuracy, and this work contributes by exploring the 3D radiation and density structures that will inform forward modeling. When the neon shatter plume produced by the SPI reaches the plasma edge, m/n = 3/1 and 2/1 island O-points are observed to align with the injection trajectory in five out of six cases, suggesting that the injected material seeds the island O-points. Field aligned neon structures emitting Ne-I line radiation drift at 1 km/s in the ion diamagnetic drift direction during the pre-TQ, tracking the motion of the m/n = 2/1 island O-point. Neon fragments penetrate to the q = 2 surface by the time of the TQ. Techniques to constrain the 3D emissivity are explored, and one method constrains a 3D flux tube that is consistent with the radiation data, and when mapped to the interferometers, intersects the lasers that measure the highest density. The resulting structure derived from the radiation measurements exists near the 2/1 island X-point. In five repeatable discharges, the peak of the radiation in the toroidal direction exists in a 120° toroidal sector where the injection occurs, in contrast with the outlier discharge where the toroidal peak exists in the complementary 240° toroidal sector far from the injector, and where a 50% lower density rise is observed. In conclusion, the n = 1 phase behavior is markedly different in the outlier discharge, suggesting a possible dependence of the radiation structure and the assimilation efficiency on MHD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Wasserstein normalized autoencoder for anomaly detection

A novel anomaly detection algorithm is presented. The Wasserstein normalized autoencoder (WNAE) is a normalized probabilistic model that minimizes the Wasserstein distance between the learned probability distribution—a Boltzmann distribution where the energy is the reconstruction error of the autoencoder (AE)—and the distribution of the training data. This algorithm has been developed and applied to the identification of semivisible jets—conical sprays of visible standard model (SM) particles and invisible dark matter states—with the CMS experiment at the CERN LHC. Trained on jets of particles from simulated SM processes, the WNAE is shown to learn the probability distribution of the input data in a fully unsupervised fashion, such that it effectively identifies new physics jets as anomalies. The model exhibits stable, convergent training and recovers strong classification performance for a wide range of signals against the selected background process, for which a standard AE fails because of outlier reconstruction. In addition, the model improves upon standard normalized autoencoders while remaining fully agnostic to the signal. The WNAE directly tackles the problem of outlier reconstruction, a common failure mode of autoencoders in anomaly detection tasks.

Hayrapetyan, Aram [Yerevan Phys. Inst.]↗
DOE OSTI2021

Anomaly detection in the Zwicky Transient Facility DR3

We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of three stages: feature extraction, search of outliers with machine learning algorithms, and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million objects. A set of four automatic learning algorithms was used to identify 277 outliers, which were subsequently scrutinized by an expert. From these, 188 (68 per cent) were found to be bogus light curves – including effects from the image subtraction pipeline as well as overlapping between a star and a known asteroid, 66 (24 per cent) were previously reported sources whereas 23 (8 per cent) correspond to non-catalogued objects, with the two latter cases of potential scientific interest (e.g. one spectroscopically confirmed RS Canum Venaticorum star, four supernovae candidates, one red dwarf flare). Moreover, using results from the expert analysis, we were able to identify a simple bi-dimensional relation that can be used to aid filtering potentially bogus light curves in future studies. We provide a complete list of objects with potential scientific application so they can be further scrutinised by the community. These results confirm the importance of combining automatic machine learning algorithms with domain knowledge in the construction of recommendation systems for astronomy. Our code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The PAU Survey: narrow-band photometric redshifts using Gaussian processes

Here, we study the performance of the hybrid template machine learning photometric redshift (photo- z ) algorithm delight , which uses Gaussian processes, on a subset of the early data release of the Physics of the Accelerating Universe Survey (PAUS). We calibrate the fluxes of the 40 PAUS narrow bands with six broad-band fluxes ( uBVriz ) in the Cosmic Evolution Survey (COSMOS) field using three different methods, including a new method that utilizes the correlation between the apparent size and overall flux of the galaxy. We use a rich set of empirically derived galaxy spectral templates as guides to train the Gaussian process, and we show that our results are competitive with other standard photometric redshift algorithms. delight achieves a photo- z 68th percentile error of σ 68 = 0.0081(1 + z ) without any quality cut for galaxies with i auto < 22.5 as compared to 0.0089(1 + z ) and 0.0202(1 + z ) for the bpz and annz 2 codes, respectively. delight is also shown to produce more accurate probability distribution functions for individual redshift estimates than bpz and annz 2. Common photo- z outliers of delight and bcnz 2 (previously applied to PAUS) are found to be primarily caused by outliers in the narrow-band fluxes, with a small number of cases potentially indicating spectroscopic redshift failures in the reference sample. In the process, we introduce performance metrics derived from the results of bcnz 2 and delight , allowing us to achieve a photo- z quality of σ 68 < 0.0035(1 + z ) at a magnitude of i auto < 22.5 while keeping 50 per cent objects of the galaxy sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Optimizing the shape of photometric redshift distributions with clustering cross-correlations

We present an optimization method for the assignment of photometric galaxies to a chosen set of redshift bins. This is achieved by combining simulated annealing, an optimization algorithm inspired by solid-state physics, with an unsupervised machine learning method, a self-organizing map (SOM) of the observed colours of galaxies. Starting with a sample of galaxies that is divided into redshift bins based on a photometric redshift point estimate, the simulated annealing algorithm repeatedly reassigns SOM-selected subsamples of galaxies, which are close in colour, to alternative redshift bins. We optimize the clustering cross-correlation signal between photometric galaxies and a reference sample of galaxies with well-calibrated redshifts. Depending on the effect on the clustering signal, the reassignment is either accepted or rejected. By dynamically increasing the resolution of the SOM, the algorithm eventually converges to a solution that minimizes the number of mismatched galaxies in each tomographic redshift bin and thus improves the compactness of their corresponding redshift distribution. This method is demonstrated on the synthetic Legacy Survey of Space and Time cosmoDC2 catalogue. We find a significant decrease in the fraction of catastrophic outliers in the redshift distribution in all tomographic bins, most notably in the highest redshift bin with a decrease in the outlier fraction from 57 percent to 16 percent.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Identifying Anomalous DESI Galaxy Spectra with a Variational Autoencoder

The tens of millions of spectra being captured by the Dark Energy Spectroscopic Instrument (DESI) provide tremendous discovery potential. In this work we show how Machine Learning, in particular Variational Autoencoders (VAE), can detect anomalies in a sample of approximately 200,000 DESI spectra comprising galaxies, quasars and stars. We demonstrate that the VAE can compress the dimensionality of a spectrum by a factor of 100, while still retaining enough information to accurately reconstruct spectral features. We then detect anomalous spectra as those with high reconstruction error and those which are isolated in the VAE latent representation. The anomalies identified fall into two categories: spectra with artefacts and spectra with unique physical features. Awareness of the former can help to improve the DESI spectroscopic pipeline; whilst the latter can lead to the identification of new and unusual objects. To further curate the list of outliers, we use the Astronomaly package which employs Active Learning to provide personalised outlier recommendations for visual inspection. In this work we also explore the VAE latent space, finding that different object classes and subclasses are separated despite being unlabelled. We demonstrate the interpretability of this latent space by identifying tracks within it that correspond to various spectral characteristics. For example, we find tracks that correspond to increasing star formation and increase in broad emission lines along the Balmer series. In upcoming work we hope to apply the methods presented here to search for both systematics and astrophysically interesting objects in much larger datasets of DESI spectra.

Nicolaou, C. [University Coll. London] (ORCID:0000↗