arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2201.09651cs.CLcs.IR
收藏

伪像检索:知识库访问的NLP模型综述

Artefact Retrieval: Overview of NLP Models with Knowledge Base Access

Saarland University(萨尔大学)

Vilém Zouhar, Marius Mosbach, Debanjali Biswas, Dietrich Klakow

摘要:

许多NLP模型通过访问知识库来获得性能。大量研究致力于设计和改进访问知识库并将其纳入模型的方式,从而产生了一些机制和管道。尽管提出的机制多种多样,但这些系统的设计有其模式。在本文中,我们系统地描述了人工制品(从知识库检索的项目)的类型学,检索机制和这些人工制品融合到模型中的方式。这进一步使我们能够发现尚未尝试过的设计决策组合。大部分的重点是给语言模型,虽然我们也展示了如何问答,事实检查和知识对话模型适合这个系统以及。拥有一个可以描述特定模型架构的抽象模型也有助于在多个NLP任务之间传输这些架构。

英文摘要:

Many NLP models gain performance by having access to a knowledge base. A lot of research has been devoted to devising and improving the way the knowledge base is accessed and incorporated into the model, resulting in a number of mechanisms and pipelines. Despite the diversity of proposed mechanisms, there are patterns in the designs of such systems. In this paper, we systematically describe the typology of artefacts (items retrieved from a knowledge base), retrieval mechanisms and the way these artefacts are fused into the model. This further allows us to uncover combinations of design decisions that had not yet been tried. Most of the focus is given to language models, though we also show how question answering, fact-checking and knowledgable dialogue models fit into this system as well. Having an abstract model which can describe the architecture of specific models also helps with transferring these architectures between multiple NLP tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑