arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.16901q-bio.GNcs.AIcs.LG
收藏

FGBERT:面向宏基因组学的功能驱动预训练基因语言模型

FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomics

Westlake University(西湖大学);Zhejiang University(浙江大学);National University of Defense Technology(国防科技大学)

ChenRui Duan, Zelin Zang, Yongjie Xu, Hang He, Zihan Liu, Siyuan Li, Zijia Song, Ju-Sheng Zheng, Stan Z. Li

AI总结:

本文提出功能驱动的宏基因组预训练模型FGBERT,以蛋白质基因表示为分词器,结合掩码基因建模和三元组对比学习,在超1亿序列上预训练,显著提升多层级宏基因组分析性能。

摘要:

宏基因组数据由混合的多物种基因组组成,广泛存在于海洋和土壤等多种环境中,对人类健康和生态功能具有重要影响。然而,当前研究依赖于K-mer方法,这限制了其对结构和功能相关基因上下文的捕获能力。此外,这些方法难以编码具有生物学意义的基因,也无法解决宏基因组数据中固有的一对多和多对一关系。为克服这些挑战,我们提出了FGBERT,这是一种新颖的宏基因组预训练模型,采用基于蛋白质的基因表示作为具有上下文感知和结构相关性的分词器。FGBERT融合了掩码基因建模(MGM)以增强对基因间上下文关系的理解,并采用三元组增强宏基因组对比学习(TMC)来阐明基因序列与功能之间的关系。在超过1亿条宏基因组序列上进行预训练后,FGBERT在四个层次的宏基因组数据集上展现出卓越性能,涵盖基因、功能、细菌和环境层次,输入序列规模从1k到213k不等。对ATP合酶和基因操纵子的案例研究凸显了FGBERT在功能识别方面的能力及其在宏基因组研究中的生物学相关性。

英文摘要:

Metagenomic data, comprising mixed multi-species genomes, are prevalent in diverse environments like oceans and soils, significantly impacting human health and ecological functions. However, current research relies on K-mer, which limits the capture of structurally and functionally relevant gene contexts. Moreover, these approaches struggle with encoding biologically meaningful genes and fail to address the One-to-Many and Many-to-One relationships inherent in metagenomic data. To overcome these challenges, we introduce FGBERT, a novel metagenomic pre-trained model that employs a protein-based gene representation as a context-aware and structure-relevant tokenizer. FGBERT incorporates Masked Gene Modeling (MGM) to enhance the understanding of inter-gene contextual relationships and Triplet Enhanced Metagenomic Contrastive Learning (TMC) to elucidate gene sequence-function relationships. Pre-trained on over 100 million metagenomic sequences, FGBERT demonstrates superior performance on metagenomic datasets at four levels, spanning gene, functional, bacterial, and environmental levels and ranging from 1k to 213k input sequences. Case studies of ATP Synthase and Gene Operons highlight FGBERT's capability for functional recognition and its biological relevance in metagenomic research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑