arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.04313cs.CL
收藏

KoMultiText:用于真实在线服务中偏见言论分类的大规模韩语文本数据集

KoMultiText: Large-Scale Korean Text Dataset for Classifying Biased Speech in Real-World Online Services

Kyunghee University(庆熙大学);Hongik University(弘益大学);Catholic University(天主教大学);Dankook University(檀国大学);POSTECH(浦项科技大学)

Dasol Choi, Jooyoung Song, Eunsun Lee, Jinwoo Seo, Heejune Park, Dongbin Na

AI总结:

本文介绍KoMultiText,一个从韩国SNS平台收集的大规模韩语文本数据集,包含偏好、亵渎和九种偏见标注,利用BERT模型实现多任务分类,超越人类水平,助力在线社区健康。

摘要:

随着在线服务的增长,对先进文本分类算法(如情感分析和偏见文本检测)的需求日益明显。在线服务的匿名性常常导致偏见和有害语言的存在,对维护在线社区的健康构成挑战。这一现象在韩国尤为突出,在那里大规模仇恨言论检测算法尚未得到广泛探索。在本文中,我们介绍了“KoMultiText”,一个从韩国知名SNS平台收集的全面的、大规模的新数据集。我们提出的数据集提供了包括(1)偏好,(2)亵渎,以及(3)九种偏见类型的文本样本标注,支持多任务学习以同时分类用户生成文本。利用最先进的基于BERT的语言模型,我们的方法在各种分类任务中超越了人类水平的准确性,这通过多种指标衡量。除了学术贡献外,我们的工作可以为现实世界的仇恨言论和偏见缓解提供实用解决方案,直接促进在线社区健康的改善。我们的工作为未来旨在提高在线话语质量和促进社会福祉的研究提供了坚实的基础。所有源代码和数据集均可公开访问:https://github.com/Dasol-Choi/KoMultiText。

英文摘要:

With the growth of online services, the need for advanced text classification algorithms, such as sentiment analysis and biased text detection, has become increasingly evident. The anonymous nature of online services often leads to the presence of biased and harmful language, posing challenges to maintaining the health of online communities. This phenomenon is especially relevant in South Korea, where large-scale hate speech detection algorithms have not yet been broadly explored. In this paper, we introduce "KoMultiText", a new comprehensive, large-scale dataset collected from a well-known South Korean SNS platform. Our proposed dataset provides annotations including (1) Preferences, (2) Profanities, and (3) Nine types of Bias for the text samples, enabling multi-task learning for simultaneous classification of user-generated texts. Leveraging state-of-the-art BERT-based language models, our approach surpasses human-level accuracy across diverse classification tasks, as measured by various metrics. Beyond academic contributions, our work can provide practical solutions for real-world hate speech and bias mitigation, contributing directly to the improvement of online community health. Our work provides a robust foundation for future research aiming to improve the quality of online discourse and foster societal well-being. All source codes and datasets are publicly accessible at https://github.com/Dasol-Choi/KoMultiText.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑