利用自然语言推理改进新领域对话中的人物画像抽取
Using Natural Language Inference to Improve Persona Extraction from Dialogue in a New Domain
AI总结:
本文针对人物画像抽取模型在新领域(如奇幻场景 LIGHT)中质量下降且人工标注成本高的问题,提出基于对话自然语言推理的 NLI 重排序方法,以更低的人工标注成本获得更高质量的结构化人物画像。
摘要:
尽管像 PersonaChat 这样有价值的数据集为训练基于人物画像的对话智能体提供了基础,但它们在对话和叙事场景上缺乏多样性,主要存在于“现实”世界中。为了开发具有独特人物画像的对话智能体,模型被训练在给定特定人物画像的情况下进行对话,但手工编写这些人物画像可能非常耗时,因此存在从现有的特定角色对话中自动抽取人物画像信息的方法。然而,这些人物画像抽取模型同样是在源自 PersonaChat 的数据集上训练的,难以从不发生在现实世界中的对话场景(例如以奇幻为重点的数据集 LIGHT)中提供高质量的人物画像信息。为训练特定场景的模型而创建新数据是人力密集型的,因此成本高得令人望而却步。为了解决这两个问题,我们引入了一种自然语言推理方法,用于事后将已训练的人物画像抽取模型适配到新场景。我们从对话自然语言推理(NLI)的文献中获得启发,设计了 NLI 重排序方法,以从对话中抽取结构化的人物画像信息。与现有的人物画像抽取模型相比,我们的方法返回更高质量的抽取人物画像,并且需要更少的人工标注。
英文摘要:
While valuable datasets such as PersonaChat provide a foundation for training persona-grounded dialogue agents, they lack diversity in conversational and narrative settings, primarily existing in the "real" world. To develop dialogue agents with unique personas, models are trained to converse given a specific persona, but hand-crafting these persona can be time-consuming, thus methods exist to automatically extract persona information from existing character-specific dialogue. However, these persona-extraction models are also trained on datasets derived from PersonaChat and struggle to provide high-quality persona information from conversational settings that do not take place in the real world, such as the fantasy-focused dataset, LIGHT. Creating new data to train models on a specific setting is human-intensive, thus prohibitively expensive. To address both these issues, we introduce a natural language inference method for post-hoc adapting a trained persona extraction model to a new setting. We draw inspiration from the literature of dialog natural language inference (NLI), and devise NLI-reranking methods to extract structured persona information from dialogue. Compared to existing persona extraction models, our method returns higher-quality extracted persona and requires less human annotation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。