arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.22151cs.IR
收藏

新颖性感知的智能检索:通过结构化多步推理比较研究贡献

Novelty-Aware Agentic Retrieval: Comparing Research Contributions Through Structured Multi-Step Reasoning

University of South Dakota(南达科他大学)

Shou-Tzu Han

AI总结:

提出新颖性感知研究智能体,通过结构化多步推理增强RAG,实现论文间重叠、差异及问题-方法缺失的对比分析,在100篇论文语料上支持五种结构化比较能力。

摘要:

科学文献搜索是一项信息检索(IR)任务,其中排序列表是不够的:进入新领域的研究人员不仅需要知道哪些论文相关,还需要了解它们如何关联、重叠、差异以及哪些问题-方法组合缺失。标准的检索增强生成(RAG)独立地总结文档,丢弃了这种比较信号。我们提出了新颖性感知研究智能体,一种原型智能检索系统,通过六个类型化合约组件在RAG流水线上分层结构化多步推理:查询分析、ReAct风格的检索循环、相关性排序、模式引导的贡献提取、三遍比较智能体和答案生成。除了返回相关论文外,它还生成结构化比较产物:每篇论文的贡献记录、论文级重叠以及问题×方法缺口矩阵。在100篇论文的语料上,该系统支持五种结构化比较能力,而标准RAG基线不支持任何一项,同时保持查询敏感性:在三个主要查询中,没有一篇论文出现在所有三个前5集合中(平均成对Jaccard为0.12),扩展的七个查询评估在十个查询上保持该模式(平均Jaccard为0.115,29篇检索论文中有18篇是查询独有的)。在作者分配的分级相关性下,排序器在主要查询上达到平均Precision@5为1.000和nDCG@5为0.752,优于BM25、密集检索和混合检索;在十个查询上,Precision@5未饱和为0.980,nDCG@5为0.739。模式合规性在主要查询上为86.7%,在十查询集上为84.0%,验证20个采样的空缺口矩阵单元格得到缺口精度为0.600。我们讨论了智能检索中的延迟-结构权衡,并指出语料规模、作者分配的标签和有限的独立评估是主要局限性。

英文摘要:

Scientific literature search is an information retrieval (IR) task in which ranked lists are insufficient: a researcher entering a new area needs to know not only which papers are relevant, but how they relate, where they overlap, how they differ, and what problem-method combinations are absent. Standard retrieval-augmented generation (RAG) summarizes documents independently, discarding this comparative signal. We present the Novelty-Aware Research Agent, a prototype agentic retrieval system that layers structured multi-step reasoning on a RAG pipeline through six typed-contract components: query analysis, a ReAct-style retrieval loop, relevance ranking, schema-guided contribution extraction, a three-pass comparison agent, and answer generation. Beyond returning relevant papers, it produces structured comparison artifacts: per-paper contribution records, paper-level overlaps, and a problem x method gap matrix. On a 100-paper corpus, the system supports five structured comparison capabilities that a standard RAG baseline supports none of, while remaining query-sensitive: across three main queries no paper appears in all three top-5 sets (mean pairwise Jaccard 0.12), and an extended seven-query evaluation holds the pattern across ten queries (mean Jaccard 0.115, 18 of 29 retrieved papers query-exclusive). Under author-assigned graded relevance the ranker attains mean Precision@5 1.000 and nDCG@5 0.752 on the main queries, ahead of BM25, dense, and hybrid retrieval; over ten queries Precision@5 is non-saturated at 0.980 with nDCG@5 0.739. Schema compliance is 86.7% on the main queries and 84.0% over the ten-query set, and validating 20 sampled empty gap-matrix cells yields a gap precision of 0.600. We discuss the latency-structure trade-off in agentic retrieval and identify corpus scale, author-assigned labels, and limited independent evaluation as the main limitations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑