arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1806.07914cs.CL
收藏

多语言意图分类的多层集成技术

Multi-Layer Ensembling Techniques for Multilingual Intent Classification

CloudMinds Technology Inc(达闼科技有限公司)

Charles Costello, Ruixi Lin, Vishwas Mruthyunjaya, Bettina Bolla, Charles Jankowski

摘要:

在本文中,我们确定多层集成如何提高多语言意图分类的性能。我们开发了一种新的多层集成方法,集成不同的模型初始化和不同的模型架构。我们还引入了一个新的银行领域数据集,并将结果与标准ATIS数据集和中国SMP2017数据集进行比较,以确定多语言和多领域背景下的集成性能。我们在所有三个数据集上进行了集成实验,并得出结论,集成提供了显着的性能提高,多层集成是一种无风险的方式来提高意图分类的性能。我们还发现,一个简单的模型可以达到执行更复杂的国家的最先进的模型。我们在ATIS、Banking和SMP上的最佳F1分数分别为97.54%、91.79%和93.55%,与ATIS上的最新水平和SMP2017竞赛的最佳提交作品相当。我们实现的总体集成性能提高分别为0.23%、1.96%和4.04%F1.

英文摘要:

In this paper we determine how multi-layer ensembling improves performance on multilingual intent classification. We develop a novel multi-layer ensembling approach that ensembles both different model initializations and different model architectures. We also introduce a new banking domain dataset and compare results against the standard ATIS dataset and the Chinese SMP2017 dataset to determine ensembling performance in multilingual and multi-domain contexts. We run ensemble experiments across all three datasets, and conclude that ensembling provides significant performance increases, and that multi-layer ensembling is a no-risk way to improve performance on intent classification. We also find that a diverse ensemble of simple models can reach perform comparable to much more sophisticated state-of-the-art models. Our best F 1 scores on ATIS, Banking, and SMP are 97.54%, 91.79%, and 93.55% respectively, which compare well with the state-of-the-art on ATIS and best submission to the SMP2017 competition. The total ensembling performance increases we achieve are 0.23%, 1.96%, and 4.04% F 1 respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑