arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.11205cs.CL
收藏

EPiDA:一个面向高性能文本分类的简易插件式数据增强框架

EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification

Fudan University(复旦大学);Alibaba Group(阿里巴巴集团);Tongji University(同济大学)

Minyi Zhao, Lu Zhang, Yi Xu, Jiandong Ding, Jihong Guan, Shuigeng Zhou

摘要:

最近的工作经验表明,数据增强(DA)在NLP任务中的有效性,特别是对于那些遭受数据稀缺。直觉上,鉴于生成的数据的大小,其多样性和质量对于目标任务的性能至关重要。然而,据我们所知,大多数现有的方法只考虑了多样性或增强数据的质量,因此不能充分挖掘DA的NLP的潜力。在本文中,我们提出了一个简单的插件数据增强框架EPiDA,以支持有效的文本分类。EPiDA采用两种机制:相对熵最大化(REM)和条件熵最小化(CEM)来控制数据生成,其中REM被设计为增强增强数据的多样性,而CEM被利用来确保它们的语义一致性。EPiDA可以支持有效和连续的数据生成,以进行有效的分类器训练。大量的实验表明,EPiDA优于现有的SOTA方法在大多数情况下,虽然没有使用任何代理网络或预先训练的生成网络,它与各种DA算法和分类模型。代码可在https://github.com/zhaominyiz/EPiDA上获得。

英文摘要:

Recent works have empirically shown the effectiveness of data augmentation (DA) in NLP tasks, especially for those suffering from data scarcity. Intuitively, given the size of generated data, their diversity and quality are crucial to the performance of targeted tasks. However, to the best of our knowledge, most existing methods consider only either the diversity or the quality of augmented data, thus cannot fully mine the potential of DA for NLP. In this paper, we present an easy and plug-in data augmentation framework EPiDA to support effective text classification. EPiDA employs two mechanisms: relative entropy maximization (REM) and conditional entropy minimization (CEM) to control data generation, where REM is designed to enhance the diversity of augmented data while CEM is exploited to ensure their semantic consistency. EPiDA can support efficient and continuous data generation for effective classifier training. Extensive experiments show that EPiDA outperforms existing SOTA methods in most cases, though not using any agent networks or pre-trained generation networks, and it works well with various DA algorithms and classification models. Code is available at https://github.com/zhaominyiz/EPiDA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑