arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.12793cs.IR
收藏

信息检索中有序表截短的学习

Learning to Truncate Ranked Lists for Information Retrieval

Chen Wu, Ruqing Zhang, Jiafeng Guo, Yixing Fan, Yanyan Lan, Xueqi Cheng

摘要:

排序列表截断在各种专业信息检索应用(例如专利检索或法律检索)中是至关重要的。其目标是根据用户定义的目标动态确定返回文档的数量,以达到结果的整体效用和用户努力之间的平衡。现有的方法将此任务描述为一个序贯决策问题,并将预定义的损失作为代理目标,存在局部决策和非直接优化的局限性。在这项工作中,我们提出了一个全球性的决策为基础的截断模型AttnCut,直接优化用户定义的目标排名列表截断。具体来说,我们采取成功的Transformer架构,以捕获的整体依赖性的排名列表中的截断决策,并采用奖励增强最大似然(RAML)直接优化。我们考虑两种类型的用户定义的目标,这是实际使用。一个是广泛采用的指标,如F1作为一个平衡的目标,另一个是最好的F1在一些最小的召回限制,代表了一个典型的目标,在专业搜索。Robust04和MQ2007数据集的实证结果证明了我们的方法与最先进的基线相比的有效性。

英文摘要:

Ranked list truncation is of critical importance in a variety of professional information retrieval applications such as patent search or legal search. The goal is to dynamically determine the number of returned documents according to some user-defined objectives, in order to reach a balance between the overall utility of the results and user efforts. Existing methods formulate this task as a sequential decision problem and take some pre-defined loss as a proxy objective, which suffers from the limitation of local decision and non-direct optimization. In this work, we propose a global decision based truncation model named AttnCut, which directly optimizes user-defined objectives for the ranked list truncation. Specifically, we take the successful transformer architecture to capture the global dependency within the ranked list for truncation decision, and employ the reward augmented maximum likelihood (RAML) for direct optimization. We consider two types of user-defined objectives which are of practical usage. One is the widely adopted metric such as F1 which acts as a balanced objective, and the other is the best F1 under some minimal recall constraint which represents a typical objective in professional search. Empirical results over the Robust04 and MQ2007 datasets demonstrate the effectiveness of our approach as compared with the state-of-the-art baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑