Search NASA⌕ Search

SEARCH · Search NASA

Results for “selective classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Completion design improvement using a deep convolutional network

Maximizing stimulated natural and hydraulic fracture network is one of the primary hydraulic fracturing concerns for economic production from a horizontal shale gas well. Geomechanical facies and preexisting fractures in each stage are identified based on similarities in formation characteristics to optimize the locations of perforation clusters. This often requires analyzing large volumes of drilling, Logging While Drilling (LWD) and Measurement While Drilling (MWD) data. In this paper, we develop a methodology that calculates the mechanical specific energy (MSE) using real-time drill string acceleration signals directly from its definition. High resolution vibration signals have been collected using a tri-axial accerlometer, which was an auxiliary tool included in acoustic borehole imager. This technique provides a cost-efficient solution for engineered completion design. Furthermore, we adopt deep Convolutional Neural Network (CNN) with signal processing to build a data pipeline that effectively extracts patterns from dynamic acceleration signals for rock lateral MSE classification. First, we apply discrete wavelet transform and Short-Time Fourier Transform (STFT) for signal denoising and pattern recognition. Then we construct an image dataset using multi-scale image fusion at pixel level from 3 sensor channels, including axial, lateral acceleration spectrograms and zero-padded revolutions per minute (RPM). The resulted RGB image dataset includes 4,000 images of 5 MSE ranges with various rock strength conditions. Our results demonstrate that the proposed deep learning model can achieve more than 90% classification accuracy. The deep learning results, as a reference source, were applied in selected Marcellus Shale Energy and Environmental Lab (MSEEL) wells engineered completion located in the Marcellus shale gas site.

03 NATURAL GAS↗

Merger Signatures are Common, but not Universal, in Massive, Recently Quenched Galaxies at z ~ 0.7

We present visual classifications of merger-induced tidal disturbances in 143 M* ~ 10 11 M ⊙ post-starburst galaxies at z ~ 0.7 identified in the $SQuIGG\vec{L}E$ Sample. This sample spectroscopically selects galaxies from the Sloan Digital Sky Survey that have stopped their primary epoch of star formation within the past ~500 Myr. Visual classifications are performed on Hyper Suprime-Cam imaging. We compare to a control sample of mass- and redshift-matched star-forming and quiescent galaxies from the Large Early Galaxy Census and find that post-starburst galaxies are more likely to be classified as disturbed than either category. This corresponds to a factor of $3.6$$^{+2.9}_{-1.3}$ times the disturbance rate of older quiescent galaxies and $2.1$$^{+1.9}_{-.73}$ times the disturbance rate of star-forming galaxies. Assuming tidal features persist for ≲500 Myr, this suggests merging is coincident with quenching in a significant fraction of these post-starbursts. Galaxies with tidal disturbances are younger on average than undisturbed post-starburst galaxies in our sample, suggesting tidal features from a major merger may have faded over time. This may be exacerbated by the fact that, on average, the undisturbed subset is fainter, rendering low-surface-brightness tidal features harder to identify. However, the presence of 10 young (≲150 Myr since quenching) undisturbed galaxies suggests that major mergers are not the only fast physical mechanism that shut down the primary epoch of star formation in massive galaxies at intermediate redshift.

79 ASTRONOMY AND ASTROPHYSICS↗

Forest structure and solar-induced fluorescence across intact and degraded forests in the Amazon

Tropical forest degradation (e.g., anthropogenic disturbances such as selective logging and fires) alters forest structure and function and influences the forest's carbon sink. In this study, we explored structure-function relationships across a variety of degradation levels in the southern Brazilian Amazon by 1) investigating how forest structural properties vary as a function of degradation history using airborne lidar data; 2) assessing the effects of degradation on solar-induced chlorophyll fluorescence (SIF) seasonality using TROPOMI data; and 3) quantifying the contribution of structural variables to SIF using multiple regression models with stepwise selection of lidar metrics. Forest degradation history was obtained through Landsat time-series classification. We found that fire, logging, and time since disturbance were major determinants of forest structure, and that forests affected by fires experienced larger variability in leaf area index (LAI), canopy height and vertical structure relative to logged and intact forests. Moreover, only recently burned forests showed significantly depressed SIF during the dry season compared to intact forests. Canopy height and the vertical distribution of foliage were the best predictors of SIF. Unexpectedly, we found that wet-season SIF was higher in active regenerating forests (~ 4 years after fires or logging) compared with intact forests, despite lower LAI. Furthermore, our findings help to elucidate the mechanisms of carbon accumulation in anthropogenically disturbed tropical forests and indicate that they can capture large amounts of carbon while recovering.

54 ENVIRONMENTAL SCIENCES↗

JGI-Trichoderma v1.0

There is a series of Python and bash scripts to parse genomics datasets used to evaluate the coevolution of gene families and the feature importance of gene families using an SVM classifier. - Cover analysis: takes a list of single-copy genes in a set of genomes, aligns and builds the gene trees to determine if two gene families have a signature of covariation with one another. It parses the files to run phykit cover script described here: https://jlsteenwyk.com/PhyKIT/usage/index.html - SVM-classifier: This Python script is an SVM-based genomic classifier designed for biological data analysis. It combines machine learning with feature selection to identify important genomic markers and classify biological samples. Core Functionality: The script uses Support Vector Machines from scikit-learn to classify genomic data, incorporating SelectKBest for automated feature selection and leave-one-out cross-validation for performance assessment. It operates in multiple modes: feature ranking, optimal combination discovery, and sample prediction. Primary Applications: Genomic sample classification and biomarker discovery Feature importance analysis in high-dimensional biological datasets Prediction of sample categories based on genomic profiles Research applications requiring robust classification of biological data Key Advantages: High-dimensional handling: SVMs excel with genomic data's typical high feature-to-sample ratios Integrated feature selection: Reduces noise and computational overhead while identifying key markers Probability estimation: Provides confidence scores essential for biological interpretation Validation robustness: Leave-one-out cross-validation ensures reliable performance metrics Operational flexibility: Multiple analysis modes support different research phases from exploration to prediction

Stecca Steindorff, Andrei [Lawrence Berkeley Natio↗

Multi-discipline resource inventory of soils, vegetation and geology

The author has identified the following significant results. Computer classification of natural vegetation, in the vicinity of Big Summit Prairie, Crook County, Oregon was carried out using MSS digital data. Impure training sets, representing eleven vegetation types plus water, were selected from within the area to be classified. Close correlations were visually observed between vegetation types mapped from the large scale photographs and the computer classification of the ERTS data (Frame 1021-18151, 13 August 1972).

Simonson, G. H.↗

Selection of the Australian indicator region

Each Australian state was examined for the availability of LANDSAT data, area, yield, and production characteristics, statistics, crop calendars, and other ancillary data. Agrophysical conditions that could influence labeling and classification accuracies were identified in connection with the highest producing states as determined from available Australian crop statistics. Based primarily on these production statistics, Western Australia and New South Wales were selected as the wheat indicator region for Australia. The general characteristics of wheat in the indicator region, with potential problems anticipated for proportion estimation are considered. The varieties of wheat, the diseases and pests common to New South Wales, and the wheat growing regions of both states are examined.

Reed, C. R.↗

Enhancing and Archiving the APS Catalog of the POSS I

We have worked on two different projects: 1) Archiving the APS Catalog of the POSS I for distribution to NASA's NED at IPAC, SIMBAD in France, and individual astronomers and 2) The automated morphological classification of galaxies. We have completed archiving the Catalog into easily readable binary files. The database together with the software to read it has been distributed on DVD's to the national and international data centers and to individual astronomers. The archived Catalog contains more than 89 million objects in 632 fields in the first epoch Palomar Observatory Sky Survey. Additional image parameters not available in the original on-line version are also included in the archived version. The archived Catalog is also available and can be queried at the APS web site (URL: http://aps.umn.edu) which has been improved with a much faster and more efficient querying system. The Catalog can be downloaded as binary datafiles with the source code for reading it. It is also being integrated into the SkyQuery system which includes the Sloan Digital Sky Survey, 2MASS, and the FIRST radio sky survey. We experimented with different classification algorithms to automate the morphological classification of galaxies. This is an especially difficult problem because there are not only a large number of attributes or parameters and measurement uncertainties, but also the added complication of human disagreement about the adopted types. To solve this problem we used 837 galaxy images from nine POSS I fields at the North Galactic Pole classified by two independent astronomers for which they agree on the morphological types. The initial goal was to separate the galaxies into the three broad classes relevant to issues of large scale structure and galaxy formation and evolution: early (ellipticals and lenticulars), spirals, and late (irregulars) with an accuracy or success rate that rivals the best astronomer classifiers. We also needed to identify a set of parameters derived from the digitized images that separate the galaxies by type. The human eye can easily recognize complicated patterns in images such as spiral arms which can be spotty, blotchy affairs that are difficult for automated techniques. A galaxy image can potentially be described by hundreds of parameters, all of which may have some relation to the morphological type. In the set of initial experiments we used 624 such parameters, in two colors, blue and red. These parameters include the surface brightness and color measured at different radii, ratios of these parameters at different radii, concentration indices, Fourier transforms and wavelet decomposition coefficients. We experimented with three different classes of classification algorithms; decision trees, k-nearest neighbors, and support vector machines (SVM). A range of experiments were conducted and we eventually narrowed the parameters to 23 selected parameters. SVM consistently outperformed the other algorithms with both sets of features. By combining the results from the different algorithms in a weighted scheme we achieved an overall classification success of 86%.

Humphreys, Roberta M.↗

Reward Driven Workflows for Unsupervised Explainable Analysis of Phases and Ferroic Variants From Atomically Resolved Imaging Data

Rapid progress in aberration corrected electron microscopy necessitates development of robust methods for the identification of phases, ferroic variants, and other pertinent aspects of materials structure from imaging data. While unsupervised methods for clustering and classification are widely used for these tasks, their performance can be sensitive to hyperparameter selection in the analysis workflow. In this study, the effects of descriptors and hyperparameters are explored on the capability of unsupervised ML methods to distill local structural information, exemplified by the discovery of polarization and lattice distortion in Sm − dopped BiFeO 3 (BFO) thin films. It is demonstrated that a reward-driven approach can be used to optimize these key hyperparameters across the full workflow, where rewards are designed to reflect domain wall continuity and straightness, ensuring that the analysis aligns with the material's physical behavior. This approach allows the discovery of local descriptors that are best aligned with the specific physical behavior, providing insight into the fundamental physics of materials. The reward driven workflow is further extended to disentangle structural factors of variation via an optimized variational autoencoder (VAE). Lastly, the importance of well-defined rewards is explored as a quantifiable measure of the success of the workflow.

Barakati, Kamyar [University of Tennessee, Knoxvil↗

Scenario Storyline Discovery for Planning in Multi‐Actor Human‐Natural Systems Confronting Change

Scenarios have emerged as valuable tools in managing complex human-natural systems, but the traditional approach of limiting focus on a small number of predetermined scenarios can inadvertently miss consequential dynamics, extremes, and diverse stakeholder impacts. Exploratory modeling approaches have been developed to address these issues by exploring a wide range of possible futures and identifying those that yield consequential vulnerabilities. However, vulnerabilities are typically identified based on aggregate robustness measures that do not take full advantage of the richness of the underlying dynamics in the large ensembles of model simulations and can make it hard to identify key dynamics and/or storylines that can guide planning or further analyses. This study introduces the FRamework for Narrative Storylines and Impact Classification (FRNSIC; pronounced “forensic”): a scenario discovery framework that addresses these challenges by organizing and investigating consequential scenarios using hierarchical classification of diverse outcomes across actors, sectors, and scales, while also aiding in the selection of scenario storylines, based on system dynamics that drive consequential outcomes. We present an application of this framework to the Upper Colorado River Basin, focusing on decadal droughts and their water scarcity implications for the basin's diverse users and its obligations to downstream states through Lake Powell. We show how FRNSIC can explore alternative sets of impact metrics and drought dynamics and use them to identify drought scenario storylines, that can be used to inform future adaptation planning.

54 ENVIRONMENTAL SCIENCES↗

Quenching in the Right Place at the Right Time: Tracing the Shared History of Starbursts, Active Galactic Nuclei, and Poststarburst Galaxies Using Their Structures and Multiscale Environments

This work uses multiscale environments and the structures of galaxies in the Sloan Digital Sky Survey as consistency checks on the evolution from starburst to quiescence at redshift z < 0.2. The environmental indicators include fixed-aperture mass overdensities (δ xMpc , x ϵ {0.5, 1, 2, 4, 8} h –1 Mpc), k-nearest neighbor distances, the tidal parameter, halo mass (M h ), and satellite/central classification. The residuals of the specific star formation rates (Δ SSFRs) are used to select starbursts (ΔSSFR > 0.6 dex, N ≈ 8600). Quenched poststarbursts (QPSBs) are selected using Hα < 3 Å emission and Hδ A > 4 Å absorption (N ≈ 750). The environments of starbursts and QPSBs are compared with those of active galactic nuclei (AGNs) and inactive galaxies of varying ΔSSFR. The environments of starbursts, AGNs, and QPSBs are unlike the environments of most quiescent galaxies (QGs). About 70%–90% of starbursts, AGNs with Hδ A > 4 Å, and QPSBs are centrals; ~80%–90% have M h < 10 13 M ⊙ , and only ~2%–4% have M h > 10 14 M ⊙ or live in clusters. Their M h and satellite fractions are also different from those of QGs. All QPSBs are matched to some SFGs, starbursts, AGNs, and QGs of similar M $\star$ , environments, concentration indices, and velocity dispersions. A significant fraction (~20%–30%) of starbursts cannot be matched to QPSBs or QGs. The implications are that: (1) some starbursts do not quench rapidly; (2) the satellite-quenching mechanisms operating in high-density environments cannot account for most QPSBs; (3) the evolution from starbursts to QPSBs to QGs is not the dominant path at z < 0.2; and (4) starbursts are not mainly triggered by tidal interactions.

79 ASTRONOMY AND ASTROPHYSICS↗

Public water supply infrastructure extensification and diversification in surface waters is insufficient to meet future demands in Texas

The data were developed to evaluate the capacity of existing and potential new surface water supply infrastructure to meet projected public water demands across districts in Texas under multiple future socioeconomic and climate scenarios. The database integrates hydrologic, water quality, infrastructure, energy, cost, demographic, and demand-projection information for candidate surface water supply locations. Candidate sites include stream reaches, waterbodies, reservoir surplus locations, and potential new reservoir sites. Water availability is characterized using historical and projected flow conditions, while site suitability is evaluated using five indicators: Water Availability Index (WAI), Water Quality Index (WQI), Energy Requirement Index (ERI), Water Treatment Cost (WTC), and Water Infrastructure Cost (WIC). The datasets include statewide candidate-site information, district-level demand projections under Shared Socioeconomic Pathways (SSPs), runoff-based allocation constraints, climate-stress metrics, and optimization outputs evaluating alternative infrastructure planning strategies. Optimization results compare Business-as-Usual (BAU) and All Surface Water (AllSW) demand-management approaches under both scaled and fixed cost-cap strategies. Associated validation datasets provide district-level feasibility assessments, infrastructure selection outcomes, cost-cap utilization, demand satisfaction metrics, and constraint diagnostics. Additional datasets quantify projected changes in storage and flow conditions as well as water availability stress for both existing and newly selected intake locations under the SSP5 scenario for mid-century and late-century climate conditions. Together, these datasets support assessment of the extent to which surface-water infrastructure expansion and diversification strategies can satisfy future public water demands while accounting for hydrologic, economic, and planning constraints across Texas. Dataset(s) Description Dataset_preoptimization.xlsx Comprehensive pre-optimization dataset containing candidate water-supply sites and associated hydrologic, water-quality, infrastructure, climate, demographic, runoff, and demand-projection variables used as inputs to the optimization analyses. Includes variable descriptions and the full statewide candidate-site database. District_level_site_selection.zip - Compressed archive containing all SSP-specific district-level optimization result files MESIO_ssp1_results.xlsx District-level site selection results for SSP1 (MESIO). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. MESID_ssp2_results.xlsx District-level site selection results for SSP2 (MESID). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. LCMRD_ssp3_results.xlsx District-level site selection results for SSP3 (LCMRD). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. IRDev-Low_ssp4l_results.xlsx District-level site selection results for SSP4-Low (IRDev-Low). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. IRDev-High_ssp4h_results.xlsx District-level site selection results for SSP4-High (IRDev-High). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. RSIM_ssp5_results.xlsx District-level site selection results for SSP5 (RSIM). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. tx_hydrological_stress.xlsx Hydrological stress dataset for existing and newly selected intake locations. Includes projected mid-century and late-century changes, gain/loss classifications, planning strategy information, and accompanying variable descriptions. Also includes water-stress metrics derived from historical and projected low-flow conditions.

Okoye, Perpetua I. (ORCID:0000000215545033)↗

Selective radiant temperature mapping using a layered classifier

A method of measuring temperatures of selected ground-cover types using remotely sensed multispectral scanner data and a layered classification approach is described. A brief review of radiation theory is presented to show that for the wavelength bands and temperature ranges involved in remote sensing applications, a linear calibration function can be satisfactorily utilized. An example of the application of the layered classifier for temperature mapping of water is shown.

Bartolucci, L. A.↗

Interaction of the terrestrial and atmospheric hydrological cycles in the context of the North American southwest summer monsoon

Work under this grant has used information on precipitation and water vapor fluxes in the area of the Mexican Monsoon to analyze the regional precipitation climatology, to understand the nature of water vapor transport during the monsoon using model and observational data, and to analyze the ability of the TRMM remote sensing algorithm to characterize precipitation. An algorithm for estimating daily surface rain volumes from hourly GOES infrared images was developed and compared to radar data. Estimates were usually within a factor of two, but different linear relations between satellite reflectances and rainfall rate were obtained for each day, storm type and storm development stage. This result suggests that using TRMM sensors to calibrate other satellite IR will need to be a complex process taking into account all three of the above factors. Another study, this one of the space-time variability of the Mexican Monsoon, indicate that TRMM will have a difficult time, over the course of its expected three year lifetime, identifying the diurnal cycle of precipitation over monsoon region. Even when considering monthly rainfalls, projected satellite estimates of August rainfall show a root mean square error of 38 percent. A related examination of spatial variability of mean monthly rainfall using a novel method for removing the effects of elevation from gridded gauge data, show wide variation from a satellite-based rainfall estimates for the same time and space resolution. One issue addressed by our research, relating to the basic character of the monsoon circulation, is the determination of the source region for moisture. The monthly maps produced from our study of monsoon variability show the presence of two rainfall maxima in the analysis normalized to sea level, one in south-central Arizona associated with the Mexican monsoon maximum and one in southeastern New Mexico associated with the Gulf of Mexico. From the point of view of vertically-integrated fluxes and flux divergence of water vapor from ECMWF data, most moisture at upper levels arrives from the Gulf of Mexico, while low level moisture comes from the northern Gulf of California. Composites of ECMWF analyses for wet and dry periods (classified by rain gauge data) show that both regimes show low level moisture arriving from northern and central Gulf of California. Above 700 MB, moisture comes from both source regions and the Sierra Madre Occidental. During wet periods a longer fetch through the moist air mass above western Mexico results in a greater moisture flux into the Sonoran Desert region, while there is less moisture from the Gulf of Mexico both above and below 700 mb. Work on the grant subcontract at the University of Colorado concentrated on the development of a technique useful to TRMM combining visible, infrared and passive microwave data for measuring precipitation. Two established techniques using either visible or infrared data applied over the US Southwest correlated with gauges at the 0.58 to 0.70 level. The application of some established passive microwave techniques were less successful for a variety of reason, including problems in both the gauge and satellite data quality, sampling problems and weaknesses inherent in the algorithms themselves. A more promising solution for accurate rainfall estimation was explored using visible and infrared data to perform a cloud classification, which when combined with information about the background (e.g. Iand/ocean), was used to select the most appropriate microwave algorithm from a suite of possibilities.

Dickinson, Robert E.↗

A scale space feature based registration technique for fusion of satellite imagery

Feature based registration is one of the most reliable methods to register multi-sensor images (both active and passive imagery) since features are often more reliable than intensity or radiometric values. The only situation where a feature based approach will fail is when the scene is completely homogenous or densely textural in which case a combination of feature and intensity based methods may yield better results. In this paper, we present some preliminary results of testing our scale space feature based registration technique, a modified version of feature based method developed earlier for classification of multi-sensor imagery. The proposed approach removes the sensitivity in parameter selection experienced in the earlier version as explained later.

Raghavan, Srini↗

Toward The Development of Hailstorm Climatologies Derived From Reanalyses and Infared/Passive Microwave Satellite Imagers

Geostationary satellite imagers, such as those of the Geostationary Operational Environmental Satellite (GOES) and Meteosat series, provide both historical and near-real-time observations of cloud top patterns that are commonly associated with severe convection. Environmental conditions favorable for severe weather are thought to be represented well by reanalyses. Predicting exactly where convection and costly storm hazards like hail will occur using models or satellite imagery alone, however, is extremely challenging. The multivariate combination of satellite-observed cloud patterns with reanalysis environmental parameters, linked to United States Next Generation Weather Radar- (NEXRAD-) estimated Maximum Expected Size of Hail (MESH) using a deep neural network (DNN), enables estimation of potentially severe hail likelihood for any observed storm cell. These estimates are specifically designed to make hail likelihood distinctions based on satellite-indicated points of deep convection within environments favorable for storm development. We seek an approach that can be used to estimate climatological hailstorm frequency and risk throughout the historical satellite data record. This presentation demonstrates that statistical distributions of convective parameters from satellite and reanalysis show separation between non-severe/severe hailstorm classes for predictors including overshooting cloud top temperature and area characteristics, convective available potential energy, vertical wind shear, 500 hPa temperature, mid-level lapse rate, precipitable water, and convective inhibition. These complex, multivariate predictor relationships are exploited within a DNN to produce a hail likelihood metric with a critical success index of 0.504 and Heidke skill score of 0.403, which is exceptional among recent analogous hail studies. Furthermore, applications of the DNN to select case studies demonstrate good qualitative agreement between hail likelihood and MESH. These hail classifications are aggregated across an 11-year GOES-12/13 image database to derive a hail frequency and severity climatology, which denotes the Central Plains, the Midwest, and northwestern Mexico as being the most hail-prone regions within the domain studied. Opportunities for training and applying DNN-based hailstorm predictions to recently developed GOES-8/10/12/13/16 and Meteosat Second Generation convective storm detection and characterization climatologies over South America and South Africa, respectively, will also be presented.

Kristopher Bedka↗

Batch Active Learning for Multispectral and Hyperspectral Image Segmentation Using Similarity Graphs

Abstract Graph learning, when used as a semi-supervised learning (SSL) method, performs well for classification tasks with a low label rate. We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi- or hyperspectral image segmentation. Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification. This work builds on recent advances in the design of novel active learning acquisition functions (e.g., the Model Change approach in arXiv:2110.07739) while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods. In addition to improvements in the accuracy, our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.

97 MATHEMATICS AND COMPUTING↗

Stratification and sample selection for multicrop experiments

The author has identified the following significant results. A stratification was performed and sample segments were selected for an initial investigation of multicrop problems in order to support development and evaluation of procedures for using LACIE and other technologies for the classification of corn and soybeans, to identify factors likely to affect classification performance, and to evaluate problems encountered and techniques which are applicable to the crop estimation problem in foreign countries. Two types of samples, low density and high density, supporting these requirements were selected as research data set for an initial evaluation of technical issues. Looking at the geographic location of the strata, the system appears to be logical and the various segments seem to represent different conditions. This result is supportive not only of the variables and the methodology employed in the stratification, but also of the validity of the data sets employed.

Landgrebe, D. A.↗

Using active learning to improve quasar identification for the DESI spectra processing pipeline

The Dark Energy Spectroscopic Instrument (DESI) survey uses an automatic spectral classification pipeline to classify spectra. QuasarNET is a convolutional neural network used as part of this pipeline originally trained using data from the Baryon Oscillation Spectroscopic Survey (BOSS). In this paper we implement an active learning algorithm to optimally select spectra to use for training a new version of the QuasarNET weights file using only DESI data, with the goal of improving classification accuracy. This active learning algorithm includes a novel outlier rejection step using a Self-Organizing Map to ensure we label spectra representative of the larger quasar sample observed in DESI. We perform two iterations of the active learning pipeline, assembling a final dataset of 5600 labeled spectra, a small subset of the approximately 1.3 million quasar targets in DESI's Data Release 1. When splitting the spectra into training and validation subsets we achieve similar performance to the previously trained weights file in completeness and purity calculated on the validation dataset but do so with less than one tenth of the amount of training data. The new weights also more consistently classify objects in the same way when used on unlabeled data compared to the old weights file. In the process of improving QuasarNET's classification accuracy we discovered a systemic error in QuasarNET's redshift estimation and used our findings to improve our understanding of QuasarNET's redshifts.

Machine learning↗