arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.01464cs.AIcs.CL
收藏

ProtRLSearch: 一种基于大语言模型的多轮多模态蛋白质搜索代理,通过强化学习进行训练

ProtRLSearch: A Multi-Round Multimodal Protein Search Agent with Large Language Models Trained via Reinforcement Learning

University of Chinese Academy of Sciences(中国科学院大学);Hangzhou Institute for Advanced Study(杭州高等研究院);Shenzhen Institutes of Advanced Technology(深圳先进技术研究所);Institute of Information Engineering(信息工程研究所);Johns Hopkins University(约翰霍普金斯大学);Henan University(河南大学)

Congying Liu, Taihao Li, Ming Huang, Xingyuan Wei, Peipei Liu, Yiqing Shen, Yanxu Mao, Tiehan Cui

AI总结:

ProtRLSearch通过强化学习训练,利用多模态输入提升蛋白质搜索的准确性和效率,解决传统方法在多模态整合和搜索过程约束上的不足。

摘要:

医疗环境中出现的蛋白质分析任务往往需要在蛋白质序列约束下进行准确推理,涉及疾病相关变异的功能解释、蛋白质层面的临床研究分析以及类似场景。为解决此类任务,引入了搜索代理来搜索与蛋白质相关的信息,为蛋白质中心推理中的疾病相关变异分析和蛋白质功能推理提供支持。然而,此类搜索代理大多局限于单轮、仅文本模态的搜索,这阻止了蛋白质序列模态作为多模态输入被纳入搜索决策过程。同时,其依赖于仅关注最终答案的强化学习(RL)监督,导致缺乏搜索过程的约束,使得关键词选择和推理方向的偏差难以及时识别和纠正。为解决这些限制,我们提出了ProtRLSearch,一种通过多维奖励基于强化学习训练的多轮蛋白质搜索代理,在实时搜索过程中联合利用蛋白质序列和文本作为多模态输入以生成高质量报告。为了评估模型在现实蛋白质查询设置中整合蛋白质序列信息和基于文本的多模态输入的能力,我们构建了ProtMCQs,一个包含3000个多选题(MCQs)的基准测试,按三个难度级别组织。该基准测试评估了从受序列约束的蛋白质功能和表型变化推理到综合蛋白质推理(整合多维序列特征与信号通路和调控网络)的蛋白质查询任务。

英文摘要:

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical research, and similar scenarios. To address such tasks, search agents are introduced to search protein-related information, providing support for disease-related variant analysis and protein function reasoning in protein-centric inference. However, such search agents are mostly limited to single-round, text-only modality search, which prevents the protein sequence modality from being incorporated as a multimodal input into the search decision-making process. Meanwhile, their reliance on reinforcement learning (RL) supervision that focuses solely on the final answer results in a lack of search process constraints, making deviations in keyword selection and reasoning directions difficult to identify and correct in a timely manner. To address these limitations, we propose ProtRLSearch, a multi-round protein search agent trained with multi-dimensional reward based RL, which jointly leverages protein sequence and text as multimodal inputs during real-time search to produce high quality reports. To evaluate the ability of models to integrate protein sequence information and text-based multimodal inputs in realistic protein query settings, we construct ProtMCQs, a benchmark of 3,000 multiple choice questions (MCQs) organized into three difficulty levels. The benchmark evaluates protein query tasks that range from sequence constrained reasoning about protein function and phenotype changes to comprehensive protein reasoning that integrates multi-dimensional sequence features with signal pathways and regulatory networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑