arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.07573cs.IRcs.CL
收藏

用于长文档匹配的子主题感知视图采样与时间聚合

Subtopic-aware View Sampling and Temporal Aggregation for Long-form Document Matching

School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院)

Youchao Zhou, Heyan Huang, Zhijing Wu, Yuhang Liu, Xinglin Wang

AI总结:

本文提出一种用于长文档匹配的新框架,通过子主题感知视图采样捕获异构匹配信号,并采用时间聚合方法逐步整合多视图,有效提升了新闻查重与法律案例检索等任务的性能。

摘要:

长文档匹配旨在判断两篇文档之间的相关性,并已应用于多种场景。大多数现有工作利用层次模型或长上下文模型来处理文档,这实现了粗略理解但可能忽略细节。一些研究人员构建了包含对齐文档子主题相似句子的文档视图,以专注于详细匹配信号。然而,长文档通常包含多个子主题。来自多个主题的匹配信号是异构的。仅考虑同源对齐的子主题可能不够具有代表性,并可能导致有偏建模。在本文中,我们引入了一个新框架来建模具有代表性的匹配信号。首先,我们提出通过文档对的子主题捕获各种匹配信号。接下来,我们基于子主题构建多个文档视图,以覆盖异构且有价值的细节。然而,现有的空间聚合方法(如注意力机制)同时整合所有这些视图,难以整合异构信息。相反,我们提出了时间聚合方法,随着训练的进行逐步有效地整合不同视图。实验结果表明,我们的学习框架在多个文档匹配任务上是有效的,包括新闻查重和法律案例检索。

英文摘要:

Long-form document matching aims to judge the relevance between two documents and has been applied to various scenarios. Most existing works utilize hierarchical or long context models to process documents, which achieve coarse understanding but may ignore details. Some researchers construct a document view with similar sentences about aligned document subtopics to focus on detailed matching signals. However, a long document generally contains multiple subtopics. The matching signals are heterogeneous from multiple topics. Considering only the homologous aligned subtopics may not be representative enough and may cause biased modeling. In this paper, we introduce a new framework to model representative matching signals. First, we propose to capture various matching signals through subtopics of document pairs. Next, We construct multiple document views based on subtopics to cover heterogeneous and valuable details. However, existing spatial aggregation methods like attention, which integrate all these views simultaneously, are hard to integrate heterogeneous information. Instead, we propose temporal aggregation, which effectively integrates different views gradually as the training progresses. Experimental results show that our learning framework is effective on several document-matching tasks, including news duplication and legal case retrieval.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑