Search NASA⌕ Search

SEARCH · Search NASA

Results for “False Discovery Rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

29 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

iPHoP: An integrated machine learning framework to maximize host prediction for metagenome-derived viruses of archaea and bacteria

The extraordinary diversity of viruses infecting bacteria and archaea is now primarily studied through metagenomics. While metagenomes enable high-throughput exploration of the viral sequence space, metagenome-derived sequences lack key information compared to isolated viruses, in particular host association. Different computational approaches are available to predict the host(s) of uncultivated viruses based on their genome sequences, but thus far individual approaches are limited either in precision or in recall, i.e., for a number of viruses they yield erroneous predictions or no prediction at all. Here, we describe iPHoP, a two-step framework that integrates multiple methods to reliably predict host taxonomy at the genus rank for a broad range of viruses infecting bacteria and archaea, while retaining a low false discovery rate. Based on a large dataset of metagenome-derived virus genomes from the IMG/VR database, we illustrate how iPHoP can provide extensive host prediction and guide further characterization of uncultivated viruses.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Elastic Changepoint Detection for Globally-indexed Functional Time Series Data with Climate Applications

Changepoint detection is a vital tool in the application of climate data analysis. Numerous types of climate observation data are most properly represented by functional time series, implying a need for accurate changepoint detection methods applicable to functional time series data. Such data taken at a global scale often contain both spatial heterogeneity and dependence as well as phase (time) misalignment. In this report, we present methods which can detect spatially-dependent changepoints while allowing different estimates of change time and change strength depending on location. Additionally, we provide extensions to this spatially-predicted model which controls for phase variability among observations. Our methods provide the ability to detect a single change, or control for epidemic changes (where a “return-to-normal” change is more likely to be detected than the initial change). We showcase results analyzing the June 1991 eruption of Mt. Pinatubo, where our methods demonstrate the ability to accurately detect both single and epidemic changepoints even in the presence of strong seasonal variability. We find that our spatially-predicted model improves the detection of relevant changepoints versus methods which do not take spatial information into account, and we find that controlling for phase variability helps to control the false discovery rate during the detection process.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A Comprehensive Urine Proteome Database Generated From Patients With Various Renal Conditions and Prostate Cancer

Urine proteins can serve as viable biomarkers for diagnosing and monitoring various diseases. A comprehensive urine proteome database, generated from a variety of urine samples with different disease conditions, can serve as a reference resource for facilitating discovery of potential urine protein biomarkers. Herein, we present a urine proteome database generated from multiple datasets using 2D LC-MS/MS proteome profiling of urine samples from healthy individuals (HI), renal transplant patients with acute rejection (AR) and stable graft (STA), patients with non-specific proteinuria (NS), and patients with prostate cancer (PC). A total of ~28,000 unique peptides spanning ~2,200 unique proteins were identified with a false discovery rate of <0.5% at the protein level. Over one third of the annotated proteins were plasma membrane proteins and another one third were extracellular proteins according to gene ontology analysis. Ingenuity Pathway Analysis of these proteins revealed 349 potential biomarkers in the literature-curated database. Forty-three percentage of all known cluster of differentiation (CD) proteins were identified in the various human urine samples. Interestingly, following comparisons with five recently published urine proteome profiling studies, which applied similar approaches, there are still ~400 proteins which are unique to this current study. These may represent potential disease-associated proteins. Among them, several proteins such as serpin B3, renin receptor, and periostin have been reported as pathological markers for renal failure and prostate cancer, respectively. Taken together, our data should provide valuable information for future discovery and validation studies of urine protein biomarkers for various diseases.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Dynamic Reconfiguration of Switchgrass Proteomes in Response to Rust ( Puccinia novopanici ) Infection

Switchgrass (Panicum virgatum L.) can be infected by the rust pathogen (Puccinia novopanici) and results in lowering biomass yields and quality. Label-free quantitative proteomics was conducted on leaf extracts harvested from non-infected and infected plants from a susceptible cultivar (Summer) at 7, 11, and 18 days after inoculation (DAI) to follow the progression of disease and evaluate any plant compensatory mechanisms to infection. Some pustules were evident at 7 DAI, and their numbers increased with time. However, fungal DNA loads did not appreciably change over the course of this experiment in the infected plants. In total, 3830 proteins were identified at 1% false discovery rate, with 3632 mapped to the switchgrass proteome and 198 proteins mapped to different Puccinia proteomes. Across all comparisons, 1825 differentially accumulated switchgrass proteins were identified and subjected to a STRING analysis using Arabidopsis (A. thaliana L.) orthologs to deduce switchgrass cellular pathways impacted by rust infection. Proteins associated with plastid functions and primary metabolism were diminished in infected Summer plants at all harvest dates, whereas proteins associated with immunity, chaperone functions, and phenylpropanoid biosynthesis were significantly enriched. At 18 DAI, 1105 and 151 proteins were significantly enriched or diminished, respectively. Many of the enriched proteins were associated with mitigation of cellular stress and defense.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Impact of Porcine Arterivirus, Influenza B, and Their Coinfection on Antiviral Response in the Porcine Lung

Interferon (IFN) cytokines induce an autonomous antiviral state in cells of the infected site to restrict virus spreading and critically regulate overall antiviral response. The antiviral state leads to host protection through expression of hundreds of IFN-stimulated genes that restrict viral infection through multiple mechanisms, for example, directly in viral genome degradation and indirectly through cellular metabolic inhibition. Young pigs were split into four treatment groups: control, porcine reproductive and respiratory syndrome virus (PRRSV, also known as porcine arterivirus) infected, influenza B virus (IBV) infected, and IBV/PRRSV coinfection. Lung tissue was collected at 3, 5, and 7 days post infection (dpi) for control, PRRSV and IBV/PRRSV coinfection, and at 3 and 5 dpi for IBV. Transcriptomic analysis, using usegalaxy.org tools, was performed against the S.scrofa 11.1 reference genome. Differentially expressed gene (DEG) analysis was carried out using DeSeq2 based on the model treatment + dpi + treatment:dpi + E. Downstream analysis examined the interaction of DEG at each dpi for over-enriched gene ontology (G.O.) terms and pathways. Comparisons of the infected groups vs. the controls yielded a total of (n = 1412) DEGs for the PRRSV group and (n = 1578) for the IBV/PRRSV group across all timepoints. The IBV group had (n = 64) total DEGs across 3 and 5 dpi. Expression data were considered statistically significant based on false discovery rate (FDR) ⫹ 0.1. Venn diagram comparisons of the DEGs across dpi showed that groups shared only 16 DEGs at 3 dpi, no DEGs were shared at 5 dpi, and for 7 dpi, only the PRRSV and IBV/PRRSV groups were compared and shared a total of 43 DEGs. Across the comparisons, differential expression was observed in antiviral genes such as IRF1, MX1, and OAS2. The IBV and IBV/PRRSV groups showed higher expression of antiviral genes at earlier dpi than the PRRSV group. Additionally, downregulated genes from the comparisons clustered around Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways effecting lung development and cellular integrity. Early expression of host IFN and antiviral genes may lead to viral RNA degradation, and assembly and transcription inhibition in the IBV infections. In comparison, expression of antiviral genes in the PRRSV group decreased across time. The decrease may explain why PRRSV infections persist, while IBV clears. Moreover, all infected groups showed prolonged upregulation in neutrophil degranulation pathway activity, possibly exacerbating symptomatic lung lesion pathology seen in these respiratory infections.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

A Step-Down Test Procedure for Wavelet Shrinkage Using Bootstrapping

Wavelet thresholding (or shrinkage) attempts to remove the noises existing in the signals while preserving inherent pattern characteristics in the reconstruction of true signals. For data-denoising purpose, we present a new wavelet thresholding procedure which employs the step-down testing idea of identifying active contrasts in unreplicated fractional factorial experiments. The proposed method employs bootstrapping methods to a step-down test for thresholding wavelet coefficients. By introducing the concept of a false discovery error rate in testing wavelet coefficients, we shrink the wavelet coefficients with p -values higher than the error rate. The error rate controls the expected proportion of wrongly accepted coefficients among chosen wavelet coefficients. Bootstrap samples are used to approximate the p -value for computational efficiency. We also present some guidelines for selecting the values of hyper-parameters which affect the performance in the step-down thresholding procedure. Based on some common testing signals and an air-conditioner sounds example, the comparison of our proposed procedure with other thresholding methods in the literature is performed. The analytical results show that the proposed procedure has a potential in data-denoising and data-reduction in a variety of signal reconstruction applications.

42 ENGINEERING↗
DOE OSTI2025

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗
DOE OSTI2023

MArVD2: a machine learning enhanced tool to discriminate between archaeal and bacterial viruses in viral datasets

Abstract Our knowledge of viral sequence space has exploded with advancing sequencing technologies and large-scale sampling and analytical efforts. Though archaea are important and abundant prokaryotes in many systems, our knowledge of archaeal viruses outside of extreme environments is limited. This largely stems from the lack of a robust, high-throughput, and systematic way to distinguish between bacterial and archaeal viruses in datasets of curated viruses. Here we upgrade our prior text-based tool (MArVD) via training and testing a random forest machine learning algorithm against a newly curated dataset of archaeal viruses. After optimization, MArVD2 presented a significant improvement over its predecessor in terms of scalability, usability, and flexibility, and will allow user-defined custom training datasets as archaeal virus discovery progresses. Benchmarking showed that a model trained with viral sequences from the hypersaline, marine, and hot spring environments correctly classified 85% of the archaeal viruses with a false detection rate below 2% using a random forest prediction threshold of 80% in a separate benchmarking dataset from the same habitats.

Vik, Dean (ORCID:000000027546899X)↗
DOE OSTI2020

Kilonova Luminosity Function Constraints Based on Zwicky Transient Facility Searches for 13 Neutron Star Merger Triggers during O3

We present a systematic search for optical counterparts to 13 gravitational wave (GW) triggers involving at least one neutron star during LIGO/Virgo's third observing run (O3). We searched binary neutron star (BNS) and neutron star black hole (NSBH) merger localizations with the Zwicky Transient Facility (ZTF) and undertook follow-up with the Global Relay of Observatories Watching Transients Happen (GROWTH) collaboration. The GW triggers had a median localization area of 4480 deg 2 , a median distance of 267 Mpc, and false-alarm rates ranging from 1.5 to 10 -25 yr -1 . The ZTF coverage in the g and r bands had a median enclosed probability of 39%, median depth of 20.8 mag, and median time lag between merger and the start of observations of 1.5 hr. The O3 follow-up by the GROWTH team comprised 340 UltraViolet/Optical/InfraRed (UVOIR) photometric points, 64 OIR spectra, and three radio images using 17 different telescopes. We find no promising kilonovae (radioactivity-powered counterparts), and we show how to convert the upper limits to constrain the underlying kilonova luminosity function. Initially, we assume that all GW triggers are bona fide astrophysical events regardless of false-alarm rate and that kilonovae accompanying BNS and NSBH mergers are drawn from a common population; later, we relax these assumptions. Assuming that all kilonovae are at least as luminous as the discovery magnitude of GW170817 (-16.1 mag), we calculate that our joint probability of detecting zero kilonovae is only 4.2%. If we assume that all kilonovae are brighter than-16.6 mag (the extrapolated peak magnitude of GW170817) and fade at a rate of 1 mag day -1 (similar to GW170817), the joint probability of zero detections is 7%. If we separate the NSBH and BNS populations based on the online classifications, the joint probability of zero detections, assuming all kilonovae are brighter than -16.6 mag, is 9.7% for NSBH and 7.9% for BNS mergers. Moreover, no more than <57% (<89%) of putative kilonovae could be brighter than -16.6 mag assuming flat evolution (fading by 1 mag day -1 ) at the 90% confidence level. If we further take into account the online terrestrial probability for each GW trigger, we find that no more than <68% of putative kilonovae could be brighter than -16.6 mag. Comparing to model grids, we find that some kilonovae must have M ej < 0.03 M ⊙ , X lan > 10 -4 , or φ > 30° to be consistent with our limits. We look forward to searches in the fourth GW observing run; even 17 neutron star mergers with only 50% coverage to a depth of-16 mag would constrain the maximum fraction of bright kilonovae to <25%.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Discovering faint and high apparent motion rate near-Earth asteroids using a deep learning program

ABSTRACT Although many near-Earth objects have been found by ground-based telescopes, some fast-moving ones, especially those near detection limits, have been missed by observatories. We developed a convolutional neural network for detecting faint fast-moving near-Earth objects. It was trained with artificial streaks generated from simulations and was able to find these asteroid streaks with an accuracy of 98.7 per cent and a false positive rate of 0.02 per cent on simulated data. This program was used to search image data from the Zwicky Transient Facility (ZTF) in four nights in 2019, and it identified six previously undiscovered asteroids. The visual magnitudes of our detections range from ∼19.0 to 20.3 and motion rates range from ∼6.8 to 24 deg d−1, which is very faint compared to other ZTF detections moving at similar motion rates. Our asteroids are also ∼1–51 m diameter in size and ∼5–60 lunar distances away at close approach, assuming their albedo values follow the albedo distribution function of known asteroids. The use of a purely simulated data set to train our model enables the program to gain sensitivity in detecting faint and fast-moving objects while still being able to recover nearly all discoveries made by previously designed neural networks which used real detections to train neural networks. Our approach can be adopted by any observatory for detecting fast-moving asteroid streaks.

Wang, Franklin (ORCID:0000000344887355)↗
DOE OSTI2023

Impact of genotype‐calling methodologies on genome‐wide association and genomic prediction in polyploids

Abstract Discovery and analysis of genetic variants underlying agriculturally important traits are key to molecular breeding of crops. Reduced representation approaches have provided cost‐efficient genotyping using next‐generation sequencing. However, accurate genotype calling from next‐generation sequencing data is challenging, particularly in polyploid species due to their genome complexity. Recently developed Bayesian statistical methods implemented in available software packages, polyRAD, EBG, and updog, incorporate error rates and population parameters to accurately estimate allelic dosage across any ploidy. We used empirical and simulated data to evaluate the three Bayesian algorithms and demonstrated their impact on the power of genome‐wide association study (GWAS) analysis and the accuracy of genomic prediction. We further incorporated uncertainty in allelic dosage estimation by testing continuous genotype calls and comparing their performance to discrete genotypes in GWAS and genomic prediction. We tested the genotype‐calling methods using data from two autotetraploid species, Miscanthus sacchariflorus and Vaccinium corymbosum , and performed GWAS and genomic prediction. In the empirical study, the tested Bayesian genotype‐calling algorithms differed in their downstream effects on GWAS and genomic prediction, with some showing advantages over others. Through subsequent simulation studies, we observed that at low read depth, polyRAD was advantageous in its effect on GWAS power and limit of false positives. Additionally, we found that continuous genotypes increased the accuracy of genomic prediction, by reducing genotyping error, particularly at low sequencing depth. Our results indicate that by using the Bayesian algorithm implemented in polyRAD and continuous genotypes, we can accurately and cost‐efficiently implement GWAS and genomic prediction in polyploid crops.

59 BASIC BIOLOGICAL SCIENCES↗