arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03703cs.CLcs.LG
收藏

利用自动响应分割从无标注文档合成对话

Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation

Amazon(亚马逊)

Fanyou Wu, Weijie Xu, Chandan K. Reddy, Srinivasan H. Sengamedu

AI总结:

本文提出一种基于自动响应分割的对话合成方法,从无标注文档生成高质量训练数据,并在OR-QuAC基准上提升了ConvQA检索系统性能。

摘要:

在本研究中,我们应对训练数据不足且成本高昂这一阻碍对话式问答(ConvQA)系统发展的挑战。企业拥有大量多样的内部文档。相较于依赖搜索引擎,为人们理解这些文档创建对话系统是一种更具吸引力的方法。本文提出了一种稳健的对话合成方法。我们针对对话任务学习数据分割,而不是在句子边界处进行分割。通过机器评估和人工评估,我们提出的方法生成的合成数据集在质量上优于WikiDialog。通过将我们的补全数据用于ConvQA检索系统预训练,我们观察到在OR-QuAC基准上的性能有显著提升。

英文摘要:

In this study, we tackle the challenge of inadequate and costly training data that has hindered the development of conversational question answering (ConvQA) systems. Enterprises have a large corpus of diverse internal documents. Instead of relying on a searching engine, a more compelling approach for people to comprehend these documents is to create a dialogue system. In this paper, we propose a robust dialog synthesising method. We learn the segmentation of data for the dialog task instead of using segmenting at sentence boundaries. The synthetic dataset generated by our proposed method achieves superior quality when compared to WikiDialog, as assessed through machine and human evaluations. By employing our inpainted data for ConvQA retrieval system pre-training, we observed a notable improvement in performance across OR-QuAC benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑