arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.11145cs.CL
收藏

对话立场检测的挑战数据集与有效模型

A Challenge Dataset and Effective Models for Conversational Stance Detection

Shenzhen University(深圳大学);Shenzhen Technology University(深圳技术大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))

Fuqiang Niu, Min Yang, Ang Li, Baoquan Zhang, Xiaojiang Peng, Bowen Zhang

AI总结:

本文提出多轮对话立场检测数据集MT-CSD及全局-局部注意力网络GLAN,解决多方讨论建模难题,最先进方法准确率仅50.47%,凸显挑战并促进跨领域研究。

摘要:

以往的立场检测研究通常集中于评估单个实例中的立场,因此在有效建模关于同一特定主题的多方讨论方面存在局限,而此类讨论在真实社交媒体互动中自然发生。这一限制主要源于缺乏真实复制社交媒体语境的数据集,阻碍了对话立场检测的研究进展。本文引入了一个新的多轮对话立场检测数据集(称为MT-CSD),涵盖多个对话立场检测目标。为从这一具有挑战性的数据集中推导立场,我们提出全局-局部注意力网络(GLAN),以处理对话数据中固有的长程和短程依赖关系。值得注意的是,即使以GLAN为代表的最先进立场检测方法,准确率也仅为50.47%,凸显了对话立场检测的持续挑战。此外,MT-CSD数据集可作为促进跨领域立场检测发展的宝贵资源,其中分类器从不同但相关的目标进行适配。我们相信MT-CSD将推动立场检测研究的现实应用。源代码、数据和模型见https://github.com/nfq729/MT-CSD。

英文摘要:

Previous stance detection studies typically concentrate on evaluating stances within individual instances, thereby exhibiting limitations in effectively modeling multi-party discussions concerning the same specific topic, as naturally transpire in authentic social media interactions. This constraint arises primarily due to the scarcity of datasets that authentically replicate real social media contexts, hindering the research progress of conversational stance detection. In this paper, we introduce a new multi-turn conversation stance detection dataset (called \textbf{MT-CSD}), which encompasses multiple targets for conversational stance detection. To derive stances from this challenging dataset, we propose a global-local attention network (\textbf{GLAN}) to address both long and short-range dependencies inherent in conversational data. Notably, even state-of-the-art stance detection methods, exemplified by GLAN, exhibit an accuracy of only 50.47\%, highlighting the persistent challenges in conversational stance detection. Furthermore, our MT-CSD dataset serves as a valuable resource to catalyze advancements in cross-domain stance detection, where a classifier is adapted from a different yet related target. We believe that MT-CSD will contribute to advancing real-world applications of stance detection research. Our source code, data, and models are available at \url{https://github.com/nfq729/MT-CSD}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑