arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09825cs.CLcs.AI
收藏

GP-GPT:用于基因-表型映射的大型语言模型

GP-GPT: Large Language Model for Gene-Phenotype Mapping

Department of Computer Science and Engineering, The University of Texas at Arlington(计算机科学与工程系,德克萨斯理工大学 Arlington 分校);School of Computing, University of Georgia(计算学院,佐治亚大学);Department of Computer Science, Indiana University Indianapolis(计算机科学系,印第安纳大学 Indianapolis 分校);Department of Radiology, Massachusetts General Hospital and Harvard Medical School(放射科,麻省总医院和哈佛医学院);Department of Statistics, University of Georgia(统计系,佐治亚大学);Department of Epidemiology & Biostatistics, University of Georgia(流行病学与生物统计学系,佐治亚大学);Department of Environmental Health Science, University of Georgia(环境流行病学系,佐治亚大学)

Yanjun Lyu, Zihao Wu, Lu Zhang, Jing Zhang, Yiwei Li, Wei Ruan, Zhengliang Liu, Zeyu Zhang, Xiang Li, Rongjie Liu, Chao Huang, Wentao Li, Tianming Liu, Dajiang Zhu

AI总结:

GP-GPT是一种专为基因-表型映射设计的大型语言模型,通过在基因组和医学遗传学领域进行微调,实现了对遗传信息的高效检索和分析,并在多个任务中超越了现有最先进的LLMs。

摘要:

预训练的大型语言模型(LLMs)由于在自然语言处理中的成功,在生物医学领域引起了越来越多的关注。然而,复杂性状和多源基因组数据的异质性在将这些模型适应生物信息学和生物医学领域时提出了重大挑战。为了解决这些挑战,我们提出了GP-GPT,这是首个专门用于遗传-表型知识表示和基因组关系分析的大型语言模型。我们的模型在由超过300万术语组成的综合性语料库上进行了两阶段的微调,这些术语来自多个大规模验证数据集和科学出版物。GP-GPT在准确检索医学遗传信息和执行常见的基因组分析任务,如基因组信息检索和关系确定方面表现出色。在领域特定任务上的比较实验表明,GP-GPT在Llama2、Llama3和GPT-4等最先进的LLMs上表现更优。这些结果突显了GP-GPT在增强遗传疾病关系研究和促进基因组和医学遗传学领域准确高效分析方面的潜力。我们的研究还展示了GP-GPT中生物因子实体表示的细微变化,这表明LLMs在推进基因-表型研究方面的应用机会。

英文摘要:

Pre-trained large language models(LLMs) have attracted increasing attention in biomedical domains due to their success in natural language processing. However, the complex traits and heterogeneity of multi-sources genomics data pose significant challenges when adapting these models to the bioinformatics and biomedical field. To address these challenges, we present GP-GPT, the first specialized large language model for genetic-phenotype knowledge representation and genomics relation analysis. Our model is fine-tuned in two stages on a comprehensive corpus composed of over 3,000,000 terms in genomics, proteomics, and medical genetics, derived from multiple large-scale validated datasets and scientific publications. GP-GPT demonstrates proficiency in accurately retrieving medical genetics information and performing common genomics analysis tasks, such as genomics information retrieval and relationship determination. Comparative experiments across domain-specific tasks reveal that GP-GPT outperforms state-of-the-art LLMs, including Llama2, Llama3 and GPT-4. These results highlight GP-GPT's potential to enhance genetic disease relation research and facilitate accurate and efficient analysis in the fields of genomics and medical genetics. Our investigation demonstrated the subtle changes of bio-factor entities' representations in the GP-GPT, which suggested the opportunities for the application of LLMs to advancing gene-phenotype research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑