arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.00540cs.CL
收藏

基于支配集的主动学习文本分类及其在在线社交媒体中的应用

Dominant Set-based Active Learning for Text Classification and its Application to Online Social Media

University of Central Florida(中佛罗里达大学)

Toktam A. Oghaz, Ivan Garibay

摘要:

在线社交媒体中自然语言处理(NLP)的最新进展显然归功于大规模数据集。然而,标记、存储和处理大量文本数据点,例如,推特仍然具有挑战性。最重要的是,在仇恨言论检测等应用中,标记包含攻击性内容的足够大的数据集可能会对人类注释者造成精神和情感上的负担。因此,能够最好地利用显著较少标记的数据点的NLP方法引起了极大的兴趣。在本文中,我们提出了一种新的基于池的主动学习方法,可以用于训练的大型未标记语料库的最小注释成本。为此,我们建议在特征空间中找到局部聚类的主导集合。这些集合表示数据中最大的内聚结构。然后,选择不属于任何主导集合的样本用于训练模型,因为它们表示局部聚类的边界并且分类更具挑战性。我们所提出的方法没有任何参数可调,使其独立于样本集,它可以达到与完整训练数据大致相同的分类精度,数据点显着减少。此外,我们的方法实现了更高的性能相比,最先进的主动学习策略。此外,我们提出的算法是能够将传统的主动学习分数,如不确定性为基础的分数,到其选择标准。我们证明了我们的方法在不同的数据集上使用不同的神经网络架构的有效性。

英文摘要:

Recent advances in natural language processing (NLP) in online social media are evidently owed to large-scale datasets. However, labeling, storing, and processing a large number of textual data points, e.g., tweets, has remained challenging. On top of that, in applications such as hate speech detection, labeling a sufficiently large dataset containing offensive content can be mentally and emotionally taxing for human annotators. Thus, NLP methods that can make the best use of significantly less labeled data points are of great interest. In this paper, we present a novel pool-based active learning method that can be used for the training of large unlabeled corpus with minimum annotation cost. For that, we propose to find the dominant sets of local clusters in the feature space. These sets represent maximally cohesive structures in the data. Then, the samples that do not belong to any of the dominant sets are selected to be used to train the model, as they represent the boundaries of the local clusters and are more challenging to classify. Our proposed method does not have any parameters to be tuned, making it dataset-independent, and it can approximately achieve the same classification accuracy as full training data, with significantly fewer data points. Additionally, our method achieves a higher performance in comparison to the state-of-the-art active learning strategies. Furthermore, our proposed algorithm is able to incorporate conventional active learning scores, such as uncertainty-based scores, into its selection criteria. We show the effectiveness of our method on different datasets and using different neural network architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑