arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.06265cs.CL
收藏

AgoraSpeech:从人类与AI视角构建的多标注政治话语综合数据集

AgoraSpeech: A multi-annotated comprehensive dataset of political discourse through the lens of humans and AI

Aristotle University of Thessaloniki(亚里士多德塞萨洛尼基大学);incubator for Media Education and Development (iMEdD)(媒体教育与发展孵化器(iMEdD))
Pavlos Sermpezis, Stelios Karamanidis, Eva Paraschou, Ilias Dimitriadis, Sofia Yfantidou, Filitsa-Ioanna Kouskouveli, Thanasis Troboukis, Kelly Kiki, Antonis Ga… 展开作者

Pavlos Sermpezis, Stelios Karamanidis, Eva Paraschou, Ilias Dimitriadis, Sofia Yfantidou, Filitsa-Ioanna Kouskouveli, Thanasis Troboukis, Kelly Kiki, Antonis Galanopoulos, Athena Vakali

AI总结:

针对高质量标注政治话语数据集稀缺的问题,本文提出收录2023年希腊选举六政党171篇演讲的AgoraSpeech数据集,采用ChatGPT生成加人在环验证的两步标注覆盖六项NLP任务,可用于多领域研究与模型基准测试、微调。

摘要:

政治话语数据集对于获取政治洞见、分析传播策略或社会科学现象具有重要意义。尽管已有大量政治话语语料库,但全面、高质量的标注数据集仍十分稀缺,这主要是因为对修辞策略和意识形态语境进行精细化标注需要投入大量人力,且涉及多学科知识与专业能力。本文提出AgoraSpeech数据集,这是一个经过精心整理的高质量数据集,收录了2023年希腊全国选举期间六个政党的171篇政治演讲。该数据集包含针对六项自然语言处理(NLP)任务的逐段标注,分别为文本分类、主题识别、情感分析、命名实体识别、极化检测和民粹主义检测。标注采用两步流程:先由ChatGPT生成初始标注,再通过全面的人在环验证完成校准。该数据集最初用于一项案例研究,为选举前阶段的形势分析提供洞见;但其具备通用应用价值,既可为政治与社会科学家、记者、数据科学家提供丰富的信息来源,也可用于NLP模型与大语言模型(LLMs)的基准测试和微调。

英文摘要:

Political discourse datasets are important for gaining political insights, analyzing communication strategies or social science phenomena. Although numerous political discourse corpora exist, comprehensive, high-quality, annotated datasets are scarce. This is largely due to the substantial manual effort, multidisciplinarity, and expertise required for the nuanced annotation of rhetorical strategies and ideological contexts. In this paper, we present AgoraSpeech, a meticulously curated, high-quality dataset of 171 political speeches from six parties during the Greek national elections in 2023. The dataset includes annotations (per paragraph) for six natural language processing (NLP) tasks: text classification, topic identification, sentiment analysis, named entity recognition, polarization and populism detection. A two-step annotation was employed, starting with ChatGPT-generated annotations and followed by exhaustive human-in-the-loop validation. The dataset was initially used in a case study to provide insights during the pre-election period. However, it has general applicability by serving as a rich source of information for political and social scientists, journalists, or data scientists, while it can be used for benchmarking and fine-tuning NLP and large language models (LLMs).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑