Search NASA⌕ Search

Engineering topics

Keich, Uri

Publications and source records attributed to Keich, Uri.

Target–decoy false discovery rate estimation using Crema

Assigning statistical confidence estimates to discoveries produced by a tandem mass spectrometry proteomics experiment is critical to enabling principled interpretation of the results and assessing the cost/benefit ratio of experimental follow-up. The most common technique for computing such estimates is to use target-decoy competition (TDC), in which observed spectra are searched against a database of real (target) peptides and a database of shuffled or reversed (decoy) peptides. TDC procedures for estimating the false discovery rate (FDR) at a given score threshold have been developed for application at the level of spectra, peptides, or proteins. Although these techniques are relatively straightforward to implement, it is common in the literature to skip over the implementation details or even to make mistakes in how the TDC procedures are applied in practice. Here we present Crema, an open-source Python tool that implements several TDC methods of spectrum-, peptide- and protein-level FDR estimation. Crema is compatible with a variety of existing database search tools and provides a straightforward way to obtain robust FDR estimates.

59 BASIC BIOLOGICAL SCIENCES↗

Improving Peptide-Level Mass Spectrometry Analysis via Double Competition

A critical statistical task in the analysis of shotgun proteomics data involves controlling the false discovery rate (FDR) among the reported set of discoveries. This task is most commonly solved at the peptide-spectrum match (PSM) level by using target-decoy competition (TDC), in which a set of observed spectra are searched against a database containing a mixture of real (target) and decoy peptides. The PSM-level procedure can be adapted to the peptide level by selecting the top-scoring PSM per peptide prior to FDR estimation. Here, we investigate both PSM-level and peptide-level FDR control methods and come to two conclusions. First, although the TDC procedure is provably correct under certain assumptions, we observe that one of these assumptions - that incorrect PSMs are independent of one another - is frequently violated. Hence, we empirically demonstrate that TDC-based PSM-level FDR estimates can be liberally biased. Further, we propose that researchers avoid PSM-level results and instead focus on peptide-level analysis. Second, we investigate three ways to carry out peptide level TDC and show that the most common method ("PSM-only") offers the lowest statistical power in practice. The most powerful method, peptide-level FDR with PSM competition ("PSM-and-peptide"), carries out competition first at the PSM level and then again at the peptide level. In our experiments, this approach yields an average increase of 17% more discovered peptides at a1% FDR threshold relative to the PSM-only method.

59 BASIC BIOLOGICAL SCIENCES↗