NovoBench:蛋白质组学中基于深度学习的从头肽测序方法基准测试
NovoBench: Benchmarking Deep Learning-based De Novo Peptide Sequencing Methods in Proteomics
AI总结:
针对从头肽测序领域缺乏统一评估基准、评价指标单一的问题,研究提出首个统一基准NovoBench,集成多种主流方法并补充多维度评估指标,通过大规模研究得出启发式发现以推动领域发展。
摘要:
串联质谱在推动蛋白质组学发展中发挥了关键作用,可实现生物组织中蛋白质组成的高通量分析。目前已有许多深度学习方法被开发用于从头(de novo)肽测序任务,即根据观测到的质谱预测肽序列。然而,两大关键挑战严重阻碍了这一重要任务的进一步发展。首先,由于评估数据集尚未达成共识,不同研究论文中的实验结果往往不具备可比性,导致比较不公平。其次,现有方法通常局限于氨基酸水平或肽水平的精确率和召回率指标。在本研究中,我们提出了首个用于从头肽测序的统一基准NovoBench,它包含多样化的质谱数据、集成的模型以及全面的评估指标。近期表现出色的方法,包括DeepNovo、PointNovo、Casanovo、InstaNovo、AdaNovo和π-HelixNovo,均被集成到我们的框架中。除了氨基酸水平和肽水平的精确率与召回率,我们还从翻译后修饰(PTMs)识别能力、效率,以及对肽长度、噪声峰和缺失碎片比例的鲁棒性方面评估模型性能,这些都是重要的影响因素却很少被考虑。借助该基准,我们对现有方法开展了大规模研究,报告了诸多具有启发性的发现,为未来发展开辟了新的可能。
英文摘要:
Tandem mass spectrometry has played a pivotal role in advancing proteomics, enabling the high-throughput analysis of protein composition in biological tissues. Many deep learning methods have been developed for \emph{de novo} peptide sequencing task, i.e., predicting the peptide sequence for the observed mass spectrum. However, two key challenges seriously hinder the further advancement of this important task. Firstly, since there is no consensus for the evaluation datasets, the empirical results in different research papers are often not comparable, leading to unfair comparison. Secondly, the current methods are usually limited to amino acid-level or peptide-level precision and recall metrics. In this work, we present the first unified benchmark NovoBench for \emph{de novo} peptide sequencing, which comprises diverse mass spectrum data, integrated models, and comprehensive evaluation metrics. Recent impressive methods, including DeepNovo, PointNovo, Casanovo, InstaNovo, AdaNovo and $π$-HelixNovo are integrated into our framework. In addition to amino acid-level and peptide-level precision and recall, we evaluate the models' performance in terms of identifying post-tranlational modifications (PTMs), efficiency and robustness to peptide length, noise peaks and missing fragment ratio, which are important influencing factors while seldom be considered. Leveraging this benchmark, we conduct a large-scale study of current methods, report many insightful findings that open up new possibilities for future development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。