arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.14746q-bio.GNcs.LGq-bio.QM
收藏

解读自然的语言:一种基于变压器的语言模型用于蛋白质中致病性突变预测

Deciphering the Language of Nature: A transformer-based language model for deleterious mutations in proteins

Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children’s Hospital of Philadelphia(费城儿童医院雷蒙德·G·佩雷尔曼细胞与分子治疗中心);Palisades Charter High School(帕利塞德特许高中);Massachusetts Institute of Technology(麻省理工学院);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)

Theodore Jiang, Li Fang, Kai Wang

AI总结:

本文提出MutFormer,一种基于transformer的模型,用于预测蛋白质错义突变的致病性,通过结合自注意力和卷积层,提升对氨基酸突变依赖性的建模能力。

摘要:

各种机器学习模型,包括深度神经网络模型,已经开发出来以预测错义(非同义)突变的致病性。然而,当前最先进的状态可能仍然可以从更复杂的自适应机器学习方法中获益,以重新审视生物问题。自然语言处理领域最近的进展表明,transformer模型——一种深度神经网络——在建模具有上下文依赖性的序列信息方面特别强大。在本研究中,我们介绍了MutFormer,一种基于transformer的模型,用于预测致病性错义突变,它使用来自人类基因组的参考和突变蛋白质序列作为主要特征。MutFormer利用自注意力层和卷积层的组合来学习蛋白质序列中氨基酸突变之间的长程和短程依赖性。在本研究中,我们首先在参考蛋白质序列和由于常见遗传变异而产生的突变蛋白质序列上预训练MutFormer。接着,我们检查了不同的微调方法,以成功将该模型应用于错义突变的致病性预测。最后,我们评估了MutFormer在多个测试数据集上的性能。我们发现,MutFormer在多种现有工具上表现相似或有所提高,包括那些使用传统机器学习方法的工具。我们得出结论,MutFormer成功地考虑了之前研究中未探索的序列特征,有可能补充现有的计算预测或实验生成的功能评分,以改善我们对疾病变异的理解。

英文摘要:

Various machine-learning models, including deep neural network models, have already been developed to predict deleteriousness of missense (non-synonymous) mutations. Potential improvements to the current state of the art, however, may still benefit from a fresh look at the biological problem using more sophisticated self-adaptive machine-learning approaches. Recent advances in the natural language processing field show transformer models-a type of deep neural network-to be particularly powerful at modeling sequence information with context dependence. In this study, we introduce MutFormer, a transformer-based model for the prediction of deleterious missense mutations, which uses reference and mutated protein sequences from the human genome as the primary features. MutFormer takes advantage of a combination of self-attention layers and convolutional layers to learn both long-range and short-range dependencies between amino acid mutations in a protein sequence. In this study, we first pre-trained MutFormer on reference protein sequences and mutated protein sequences resulting from common genetic variants observed in human populations. We next examined different fine-tuning methods to successfully apply the model to deleteriousness prediction of missense mutations. Finally, we evaluated MutFormer's performance on multiple testing data sets. We found that MutFormer showed similar or improved performance over a variety of existing tools, including those that used conventional machine-learning approaches. We conclude that MutFormer successfully considers sequence features that are not explored in previous studies and could potentially complement existing computational predictions or empirically generated functional scores to improve our understanding of disease variants.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑