利用弱监督生成印度尼西亚语保护数据集
Utilizing Weak Supervision To Generate Indonesian Conservation Dataset
AI总结:
本文利用弱监督和标注函数从保护新闻文本构建印尼语NLP数据集,涵盖多类与情感分类,并用预训练模型进行基线实验,公开数据集与标注函数以促进研究。
摘要:
为应对加速NLP发展的日益增长需求,弱监督已成为一种快速、大规模创建数据集的有前景的方法。通过利用标注函数,弱监督允许从业者通过创建产生软标注数据集的学习标签模型来快速生成数据集。本文旨在展示如何利用这种方法从保护新闻文本中构建印度尼西亚语NLP数据集。我们构建了两种类型的数据集:多类分类和情感分类。然后,我们使用各种预训练语言模型提供基线实验。这些基线结果展示了情感分类59.79%的准确率和55.72%的F1分数,多类分类66.87%的宏F1分数、71.5%的微F1分数和83.67%的ROC-AUC。此外,我们发布了本工作中使用的数据集和标注函数,供进一步研究和探索。
英文摘要:
Weak supervision has emerged as a promising approach for rapid and large-scale dataset creation in response to the increasing demand for accelerated NLP development. By leveraging labeling functions, weak supervision allows practitioners to generate datasets quickly by creating learned label models that produce soft-labeled datasets. This paper aims to show how such an approach can be utilized to build an Indonesian NLP dataset from conservation news text. We construct two types of datasets: multi-class classification and sentiment classification. We then provide baseline experiments using various pretrained language models. These baseline results demonstrate test performances of 59.79% accuracy and 55.72% F1-score for sentiment classification, 66.87% F1-score-macro, 71.5% F1-score-micro, and 83.67% ROC-AUC for multi-class classification. Additionally, we release the datasets and labeling functions used in this work for further research and exploration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。