arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1801.07288cs.CL
收藏

基于随机森林的连体神经网络检测重复问题对

Siamese Neural Networks with Random Forest for detecting duplicate question pairs

Indian Institute of Technology Guwahati(印度理工学院古瓦哈提分校)

Ameya Godbole, Aman Dalmia, Sunil Kumar Sahu

摘要:

确定两个给定的问题是否语义相似是一个相当具有挑战性的任务,因为问题可以采用不同的结构和形式。在本文中,我们使用门控递归单元(GRU)结合其他高度使用的机器学习算法,如随机森林,Adaboost和SVM,在Quora发布的数据集上进行相似性预测任务,由大约40万个标记问题对组成。我们通过使用双向GRU与随机森林分类器的暹罗适应获得了最佳结果,这使我们在Kaggle上举办的Quora Question Pairs竞赛中跻身前24%。

英文摘要:

Determining whether two given questions are semantically similar is a fairly challenging task given the different structures and forms that the questions can take. In this paper, we use Gated Recurrent Units(GRU) in combination with other highly used machine learning algorithms like Random Forest, Adaboost and SVM for the similarity prediction task on a dataset released by Quora, consisting of about 400k labeled question pairs. We got the best result by using the Siamese adaptation of a Bidirectional GRU with a Random Forest classifier, which landed us among the top 24% in the competition Quora Question Pairs hosted on Kaggle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑