arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2104.07567cs.CLcs.AI
收藏

提取增强减少对话中的幻觉

Retrieval Augmentation Reduces Hallucination in Conversation

Facebook AI Research(脸书人工智能研究院)

Kurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela, Jason Weston

摘要:

尽管显示出越来越像人类的对话能力,但最先进的对话模型通常遭受事实不正确和知识幻觉(Roller等人,2020年)。在这项工作中,我们探索了神经检索环内架构的使用-最近显示在开放域QA中是有效的(Lewis等人,2020 b年; Izacard和Grave,2020年)-对于以知识为基础的对话,这是一项更具挑战性的任务,因为它需要基于复杂的多轮对话上下文进行查询,并生成会话连贯的响应。我们研究了具有多个组件的各种类型的架构-检索器,排名器和编码器-解码器-其目标是在保持会话能力的同时最大化知识能力。我们证明了我们最好的模型在两个以知识为基础的会话任务上获得了最先进的性能。这些模型具有开放域会话能力,有效地推广到不在训练数据内的场景,并且通过人工评估验证,大大减少了最先进的聊天机器人中众所周知的知识幻觉问题。

英文摘要:

Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of neural-retrieval-in-the-loop architectures - recently shown to be effective in open-domain QA (Lewis et al., 2020b; Izacard and Grave, 2020) - for knowledge-grounded dialogue, a task that is arguably more challenging as it requires querying based on complex multi-turn dialogue context and generating conversationally coherent responses. We study various types of architectures with multiple components - retrievers, rankers, and encoder-decoders - with the goal of maximizing knowledgeability while retaining conversational ability. We demonstrate that our best models obtain state-of-the-art performance on two knowledge-grounded conversational tasks. The models exhibit open-domain conversational capabilities, generalize effectively to scenarios not within the training data, and, as verified by human evaluations, substantially reduce the well-known problem of knowledge hallucination in state-of-the-art chatbots.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑