PatchProt:使用蛋白质基础模型预测疏水斑块
PatchProt: Hydrophobic patch prediction using protein foundation models
AI总结:
本研究利用参数高效微调ESM-2蛋白质基础模型,结合多任务学习,开发了PatchProt模型,用于准确预测蛋白质疏水斑块,并在二级结构和表面可及性预测等任务上超越现有方法。
摘要:
蛋白质表面的疏水斑块在蛋白质-蛋白质和蛋白质-配体相互作用中发挥重要的功能作用。大的疏水表面也参与聚集性疾病的进展。从蛋白质序列预测暴露的疏水斑块已被证明是一项困难的任务。微调基础模型允许使用更小的数据集使模型适应新任务的特定细微差别。此外,多任务深度学习为弥补数据缺口提供了一种有前景的解决方案,同时其性能优于单任务方法。在本研究中,我们利用了最近发布的领先大型语言模型ESM-2。通过利用最近开发的参数高效微调方法,实现了对ESM-2的高效微调。这种方法能够在不使用过多参数且无需包含计算成本高昂的多序列分析的情况下,对模型层进行全面训练。我们探索了局部(残基)和全局(蛋白质)水平上的几个相关任务,以改善模型的表示。因此,我们微调后的ESM-2模型PatchProt不仅能预测疏水斑块面积,而且在预测主要任务(包括二级结构和表面可及性预测)方面优于现有方法。重要的是,我们的分析表明,包含相关的局部任务可以改善对更困难的全局任务的预测。这项研究为基于序列的蛋白质性质预测设立了新标准,并突显了通过在相关任务上训练来微调基础模型以丰富模型表示的巨大潜力。
英文摘要:
Hydrophobic patches on protein surfaces play important functional roles in protein-protein and protein-ligand interactions. Large hydrophobic surfaces are also involved in the progression of aggregation diseases. Predicting exposed hydrophobic patches from a protein sequence has been shown to be a difficult task. Fine-tuning foundation models allows for adapting a model to the specific nuances of a new task using a much smaller dataset. Additionally, multi-task deep learning offers a promising solution for addressing data gaps, simultaneously outperforming single-task methods. In this study, we harnessed a recently released leading large language model ESM-2. Efficient fine-tuning of ESM-2 was achieved by leveraging a recently developed parameter-efficient fine-tuning method. This approach enabled comprehensive training of model layers without excessive parameters and without the need to include a computationally expensive multiple sequence analysis. We explored several related tasks, at local (residue) and global (protein) levels, to improve the representation of the model. As a result, our fine-tuned ESM-2 model, PatchProt, cannot only predict hydrophobic patch areas but also outperforms existing methods at predicting primary tasks, including secondary structure and surface accessibility predictions. Importantly, our analysis shows that including related local tasks can improve predictions on more difficult global tasks. This research sets a new standard for sequence-based protein property prediction and highlights the remarkable potential of fine-tuning foundation models enriching the model representation by training over related tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。