arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2203.10053cs.CL
收藏

RELIC:检索文学主张的证据

RELIC: Retrieving Evidence for Literary Claims

University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Smith College(史密斯学院)

Katherine Thai, Yapei Chang, Kalpesh Krishna, Mohit Iyyer

摘要:

人文学者通常会为他们对文学作品的主张提供证据(例如,(小说)以作品中的引语的形式。我们收集了一个大规模的数据集(RELiC)的78 K文学引文和周围的批评分析,并使用它来制定文学证据检索的新任务,其中模型被赋予了一个摘录的文学分析周围的一个掩蔽的报价,并要求检索引用的段落从一组的所有通道中的工作。解决这个检索任务需要深入了解复杂的文学和语言现象,这证明了具有挑战性的方法,压倒性地依赖于词汇和语义相似性匹配。我们为此任务实现了一个基于RoberTa的密集通道检索器,其性能优于现有的预训练信息检索基线;然而,人类领域专家的实验和分析表明,我们的密集检索器还有很大的改进空间。

英文摘要:

Humanities scholars commonly provide evidence for claims that they make about a work of literature (e.g., a novel) in the form of quotations from the work. We collect a large-scale dataset (RELiC) of 78K literary quotations and surrounding critical analysis and use it to formulate the novel task of literary evidence retrieval, in which models are given an excerpt of literary analysis surrounding a masked quotation and asked to retrieve the quoted passage from the set of all passages in the work. Solving this retrieval task requires a deep understanding of complex literary and linguistic phenomena, which proves challenging to methods that overwhelmingly rely on lexical and semantic similarity matching. We implement a RoBERTa-based dense passage retriever for this task that outperforms existing pretrained information retrieval baselines; however, experiments and analysis by human domain experts indicate that there is substantial room for improvement over our dense retriever.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑