arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.05271cs.CLcs.AIcs.CY
收藏

DeliData:一个用于多方问题解决中协商讨论的数据集

DeliData: A dataset for deliberation in multi-party problem solving

University of Cambridge(剑桥大学);University of Sheffield(谢菲尔德大学)

Georgi Karadzhov, Tom Stafford, Andreas Vlachos

AI总结:

本文提出了首个公开的多方问题解决协商讨论数据集DeliData,包含500组对话和14k条标注话语,并基于该数据集开发与评估了两种协商话语生成方法。

摘要:

群体协商讨论使人们能够协作并解决问题,但由于资源缺乏,这一领域的研究不足。为此,我们引入了首个公开可用的数据集,其中包含关于解决一项成熟认知任务的协作对话,由500组对话和14k条话语组成。在这些对话中,64%的群体成员能够找到比他们单独识别时更好的解决方案,而在最终解决方案为正确答案的群体中,有43.8%的群体没有任何参与者独自正确解决了该任务。此外,我们提出了一种新颖的标注模式,用于捕捉协商讨论线索,并发布了全部标注有该模式的14k条话语。最后,我们使用所提出的数据集来开发和评估两种生成协商讨论话语的方法。数据收集平台、数据集和标注语料库可在https://delibot.xyz公开获取。

英文摘要:

Group deliberation enables people to collaborate and solve problems, however, it is understudied due to a lack of resources. To this end, we introduce the first publicly available dataset containing collaborative conversations on solving a well-established cognitive task, consisting of 500 group dialogues and 14k utterances. In 64% of these conversations, the group members are able to find a better solution than they had identified individually, and in 43.8% of the groups who had a correct answer as their final solution, none of the participants had solved the task correctly by themselves. Furthermore, we propose a novel annotation schema that captures deliberation cues and release all 14k utterances annotated with it. Finally, we use the proposed dataset to develop and evaluate two methods for generating deliberation utterances. The data collection platform, dataset and annotated corpus are publicly available at https://delibot.xyz.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑