arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.01854cs.CLcs.LG
收藏

基于数据增强的Hypernymy检测

Data Augmentation for Hypernymy Detection

Rasa(Rasa公司);University of Sussex(萨塞克斯大学)

Thomas Kober, Julie Weeds, Lorenzo Bertolini, David Weir

摘要:

上位关系的自动检测是自然语言处理中的一个具有挑战性的问题。高质量训练数据的有限可用性通常阻碍了使用分布式表示的最先进的监督方法的成功应用。我们已经开发了两种新的数据增强技术,从现有的生成新的训练样本。首先,我们结合上位词及物性和交叉修饰语-名词组合的语言学原则来生成额外的向量对,例如“小狗-狗”或“小狗-动物”,可以假设它们之间存在上位关系。其次,我们使用生成对抗网络(GANs)来生成向量对,也可以假设这些向量对的上位关系。此外,我们提出了两个互补的策略,利用语言资源,如WordNet扩展现有的数据集。使用3个不同的数据集的上位检测和2个不同的向量空间的评估,我们证明了所提出的自动数据增强和数据集扩展策略大大提高了分类器的性能。

英文摘要:

The automatic detection of hypernymy relationships represents a challenging problem in NLP. The successful application of state-of-the-art supervised approaches using distributed representations has generally been impeded by the limited availability of high quality training data. We have developed two novel data augmentation techniques which generate new training examples from existing ones. First, we combine the linguistic principles of hypernym transitivity and intersective modifier-noun composition to generate additional pairs of vectors, such as "small dog - dog" or "small dog - animal", for which a hypernymy relationship can be assumed. Second, we use generative adversarial networks (GANs) to generate pairs of vectors for which the hypernymy relation can also be assumed. We furthermore present two complementary strategies for extending an existing dataset by leveraging linguistic resources such as WordNet. Using an evaluation across 3 different datasets for hypernymy detection and 2 different vector spaces, we demonstrate that both of the proposed automatic data augmentation and dataset extension strategies substantially improve classifier performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑