arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.02114cs.CL
收藏

文本分类中迁移学习方法的偏差检测

Detecting Bias in Transfer Learning Approaches for Text Classification

Yale University(耶鲁大学)

Irene Li

摘要:

分类是机器学习中的一项基本任务,在自然语言处理(NLP)和计算机视觉(CV)领域中起着至关重要的作用。在监督学习设置中,分类任务总是需要标签。特别是对于深度神经模型,需要大量高质量的标记数据进行训练。然而,当一个新的域名出现时,通常很难或昂贵地获得标签。迁移学习可以是将知识从源域转移到目标域的一种选择。一个挑战是,这两个域可以是不同的,无论是在特征分布,或类分布的性质的样本。在这项工作中,我们评估了一些现有的迁移学习方法检测不平衡类的偏见,包括传统和深度模型。此外,我们提出了一种方法来弥补差距的领域类不平衡的问题。

英文摘要:

Classification is an essential and fundamental task in machine learning, playing a cardinal role in the field of natural language processing (NLP) and computer vision (CV). In a supervised learning setting, labels are always needed for the classification task. Especially for deep neural models, a large amount of high-quality labeled data are required for training. However, when a new domain comes out, it is usually hard or expensive to acquire the labels. Transfer learning could be an option to transfer the knowledge from a source domain to a target domain. A challenge is that these two domains can be different, either on the feature distribution, or the class distribution for the nature of the samples. In this work, we evaluate some existing transfer learning approaches on detecting the bias of imbalanced classes including traditional and deep models. Besides, we propose an approach to bridge the gap of the domain class imbalance issue.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑