arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.00145cs.CLcs.LG
收藏

基于语料库的释义检测实验与综述

Corpus-Based Paraphrase Detection Experiments and Review

University of Zagreb(萨格勒布大学);University of Rijeka(里耶卡大学)

Tedo Vrbanec, Ana Mestrovic

摘要:

意译检测是重要的一些应用程序,包括剽窃检测,作者归属,问答,文本摘要,文本挖掘等在本文中,我们给出了各种类型的基于语料库的模型,特别是深度学习(DL)模型的性能概述,与任务的意译检测。我们报告了八个模型(LSI,TF-IDF,Word 2 Vec,Doc 2 Vec,GloVe,FastText,ELMO和USE)在三个不同的公共可用语料库上评估的结果:Microsoft Research Paraphrase Corpus,Clough和Stevenson以及Webis Crowd Paraphrase Corpus 2011。通过大量的实验,我们决定了最合适的文本预处理方法:超参数,子模型选择-如果它们存在(例如,Skipgram vs. CBOW)、距离度量和语义相似性/释义检测阈值。我们的研究结果和其他使用深度学习模型的研究人员的研究结果表明,深度学习模型与传统的最先进的方法相比非常具有竞争力,并且具有进一步开发的潜力。

英文摘要:

Paraphrase detection is important for a number of applications, including plagiarism detection, authorship attribution, question answering, text summarization, text mining in general, etc. In this paper, we give a performance overview of various types of corpus-based models, especially deep learning (DL) models, with the task of paraphrase detection. We report the results of eight models (LSI, TF-IDF, Word2Vec, Doc2Vec, GloVe, FastText, ELMO, and USE) evaluated on three different public available corpora: Microsoft Research Paraphrase Corpus, Clough and Stevenson and Webis Crowd Paraphrase Corpus 2011. Through a great number of experiments, we decided on the most appropriate approaches for text pre-processing: hyper-parameters, sub-model selection-where they exist (e.g., Skipgram vs. CBOW), distance measures, and semantic similarity/paraphrase detection threshold. Our findings and those of other researchers who have used deep learning models show that DL models are very competitive with traditional state-of-the-art approaches and have potential that should be further developed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑