arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.03323cs.CL

通过合成的分步监督增强代理文本图检索

Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise Supervision

Institute for AI Industry Research (AIR), Tsinghua University(人工智能产业研究院(AIR),清华大学);Peking University(北京大学);School of Information, Renmin University of China(中国人民大学信息学院);Harbin Institute of Technology(哈尔滨工业大学);North China Electric Power University(华北电力大学);GDS Holdings Limited(GDS控股有限公司)

Ge Chang, Jinbo Su, Jiacheng Liu, Pengfei Yang, Yuhao Shang, Huiwen Zheng, Hongli Ma, Yan Liang, Yuanchun Li, Yunxin Liu

AI总结:

本文提出一种基于LLM的文本图检索框架,通过合成分步监督优化检索过程,提升复杂图基问答任务的准确性和F1分数。

摘要:

将文本图整合进大型语言模型(LLMs)对于复杂图基问答任务具有潜力。然而,检索具有信息性且紧凑的子图以适应LLM上下文是关键瓶颈。现有检索器常 struggles,依赖于浅层嵌入相似性或成本高昂的交互策略,需要过多监督。为解决这些问题,我们引入了一个代理文本图推理框架,其特征是通过合成分步监督训练的LLM基于检索器。而不是依赖最终答案奖励,通常产生稀疏且不稳定的信号,我们通过评估每一步与离线提取的黄金子图进行优化。我们的方法通过专门的数据合成管道提炼黄金子图,形成密集奖励,从而实现一个两阶段训练方案,有效学习交互图探索策略。基于在三个常见数据集上的广泛实验,与七个强大的基线相比,我们的方法在准确率上平均提高了15.6%,F1分数提高了17.2%。在更复杂的多跳推理任务中,优势更高。

英文摘要:

Integrating textual graphs into Large Language Models (LLMs) is promising for complex graph-based QA. However, a key bottleneck is retrieving informative yet compact subgraphs that fit the LLM context. Existing retrievers often struggle, relying either on shallow embedding similarity or costly interactive policies that require excessive supervision. To address these challenges, we introduce an agentic textual graph reasoning framework featuring an LLM-based retriever trained with synthetic stepwise supervision. Rather than relying on final answer rewards which often yield sparse and unstable signals, we optimize the retriever by evaluating each step against offline-extracted golden subgraphs. Our approach distills golden subgraphs via a specialized data synthesis pipeline to formulate dense rewards, facilitating a two-stage training scheme that effectively learns the interactive graph exploration policy. Based on extensive experiments on three common datasets in comparison with seven strong baselines, our approach achieves an average improvement of 15.6% in accuracy and 17.2% in F1 score. The advantage is even higher in more complicated multi-hop reasoning tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑