arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.12784cs.CLcs.AIcs.LG
收藏

STA:一种改进文本分类的自控制文本增强算法

STA: Self-controlled Text Augmentation for Improving Text Classifications

University College Dublin(都柏林大学);Huawei Ireland Research Centre(华为爱尔兰研究中心)

Congcong Wang, Gonzalo Fiz Pontiveros, Steven Derby, Tri Kurniawan Wijaya

摘要:

尽管最近在机器学习方面取得了进展,但许多任务仍然涉及在低数据状态下工作,这可能使解决自然语言问题变得困难。最近,在自然语言处理(NLP)领域出现了许多文本增强技术,这些技术可以用新的示例来丰富训练数据,尽管它们并非没有警告。例如,简单的基于规则的探试法是有效的,但缺乏相对于原始文本的语义内容和句法结构的变化。另一方面,更复杂的深度学习方法可能会导致文本内在含义的极端变化,并将不必要的噪声引入训练数据中。为了更可靠地控制增强示例的质量,我们引入了一种最先进的自控文本增强(STA)方法。我们的方法严格控制的生成过程中,通过引入一个自我检查的过程,以确保生成的例子保留原始文本的语义内容。多个基准测试数据集上的实验结果表明,STA大大优于现有的国家的最先进的技术,而定性分析表明,生成的例子都是词汇多样性和语义可靠。

英文摘要:

Despite recent advancements in Machine Learning, many tasks still involve working in low-data regimes which can make solving natural language problems difficult. Recently, a number of text augmentation techniques have emerged in the field of Natural Language Processing (NLP) which can enrich the training data with new examples, though they are not without their caveats. For instance, simple rule-based heuristic methods are effective, but lack variation in semantic content and syntactic structure with respect to the original text. On the other hand, more complex deep learning approaches can cause extreme shifts in the intrinsic meaning of the text and introduce unwanted noise into the training data. To more reliably control the quality of the augmented examples, we introduce a state-of-the-art approach for Self-Controlled Text Augmentation (STA). Our approach tightly controls the generation process by introducing a self-checking procedure to ensure that generated examples retain the semantic content of the original text. Experimental results on multiple benchmarking datasets demonstrate that STA substantially outperforms existing state-of-the-art techniques, whilst qualitative analysis reveals that the generated examples are both lexically diverse and semantically reliable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑