arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2012.11685cs.IRcs.AIcs.CLcs.LG
收藏

用于有效、高效和暴露感知信息检索的神经方法

Neural Methods for Effective, Efficient, and Exposure-Aware Information Retrieval

University College London(伦敦大学学院)

Bhaskar Mitra

摘要:

具有深度架构的神经网络在计算机视觉、语音识别和自然语言处理方面表现出显著的性能改进。然而,信息检索(IR)中的挑战不同于这些其他应用领域。IR的一种常见形式涉及对文档(或短段落)进行排名,以响应基于关键字的查询。有效的信息检索系统必须处理查询-文档词汇不匹配问题,通过建模不同查询和文档术语之间的关系以及它们如何表示相关性。当查询包含在训练过程中看不到的罕见术语(如人名或产品型号)时,模型还应考虑词汇匹配,以避免检索语义相关但不相关的结果。在许多现实生活中的IR任务中,检索涉及非常大的集合--例如商业Web搜索引擎的文档索引--包含数十亿个文档。有效的IR方法应该利用专门的IR数据结构(如倒排索引),以便有效地从大型集合中进行检索。给定信息需求,IR系统还通过决定信息伪影是否应该被显示以及它应该被定位在哪里以及其他结果来调解信息伪影接收多少曝光。曝光感知IR系统可以针对除相关性之外的附加目标进行优化,诸如针对所检索的项目和内容发布者的曝光的对等性。在这篇论文中,我们提出了新的神经架构和方法的具体需求和挑战的IR任务的动机。

英文摘要:

Neural networks with deep architectures have demonstrated significant performance improvements in computer vision, speech recognition, and natural language processing. The challenges in information retrieval (IR), however, are different from these other application areas. A common form of IR involves ranking of documents--or short passages--in response to keyword-based queries. Effective IR systems must deal with query-document vocabulary mismatch problem, by modeling relationships between different query and document terms and how they indicate relevance. Models should also consider lexical matches when the query contains rare terms--such as a person's name or a product model number--not seen during training, and to avoid retrieving semantically related but irrelevant results. In many real-life IR tasks, the retrieval involves extremely large collections--such as the document index of a commercial Web search engine--containing billions of documents. Efficient IR methods should take advantage of specialized IR data structures, such as inverted index, to efficiently retrieve from large collections. Given an information need, the IR system also mediates how much exposure an information artifact receives by deciding whether it should be displayed, and where it should be positioned, among other results. Exposure-aware IR systems may optimize for additional objectives, besides relevance, such as parity of exposure for retrieved items and content publishers. In this thesis, we present novel neural architectures and methods motivated by the specific needs and challenges of IR tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑