Long-form document matching aims to judge the relevance between two documents and has been applied to various scenarios. Most existing works utilize hierarchical or long context models to process documents, which achieve coarse understanding but may ignore details. Some researchers construct a document view with similar sentences about aligned document subtopics to focus on detailed matching signals. However, a long document generally contains multiple subtopics. The matching signals are heterogeneous from multiple topics. Considering only the homologous aligned subtopics may not be representative enough and may cause biased modeling. In this paper, we introduce a new framework to model representative matching signals. First, we propose to capture various matching signals through subtopics of document pairs. Next, We construct multiple document views based on subtopics to cover heterogeneous and valuable details. However, existing spatial aggregation methods like attention, which integrate all these views simultaneously, are hard to integrate heterogeneous information. Instead, we propose temporal aggregation, which effectively integrates different views gradually as the training progresses. Experimental results show that our learning framework is effective on several document-matching tasks, including news duplication and legal case retrieval.
DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
Georgetown University(乔治城大学)
大多数神经信息检索(Neu-IR)模型基于术语级匹配来获得查询到文档排序分数。受经典术语分布可视化方法TileBars的启发,本文提出了一种新的Neu-IR模型,该模型在子主题和更高级别上处理查询到文档的匹配。我们的系统首先将文档拆分为主题片段,“可视化”查询和片段之间的匹配,然后将交互矩阵馈送到Neu-IR模型DeepTileBars中,以获得最终的排名分数。DeepTileBars对文档主题层次结构中不同粒度的相关性信号进行建模。它更好地捕捉文档的话语结构,从而匹配模式。虽然它的设计和实现是轻量级的,但DeepTileBars在基准数据集上的表现优于其他最先进的Neu-IR模型,包括文本检索会议(TREC)2010-2012 Web Tracks和LETOR 4.0。
RaKUn: Rank-based Keyword extraction via Unsupervised learning and Meta vertex aggregation
Jožef Stefan International Postgraduate School(约瑟夫·斯特凡国际研究生院);Jožef Stefan Institute(约瑟夫·斯特凡研究所);Usher Institute, Medical School, University of Edinburgh(爱丁堡大学医学院厄舍研究所)
A Survey of Long-Document Retrieval in the PLM and LLM Era
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Center for Information and Language Processing (CIS), LMU Munich(慕尼黑大学信息与语言处理中心);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
AI-Assisted Authoring for Transparent, Data-Driven Documents
University of Salerno(萨勒诺大学);University of Bristol(布里斯托大学);Manchester Metropolitan University(曼彻斯特 Metropolitan 大学);The Alan Turing Institute(艾伦·图灵研究所);University of Kent(肯特大学);University of Cambridge(剑桥大学);University of Bath(巴斯大学);University College London(伦敦大学学院)