arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0912.3959cs.OH
收藏

基于Web的跨语言剽窃检测

Web Based Cross Language Plagiarism Detection

Chow Kok Kent, Naomie Salim

摘要:

随着互联网为我们提供了各种翻译工具,帮助我们跨越语言和文化的边界,跨语言剽窃,也被称为翻译剽窃必然会出现。尤其是在学术作品中,这样的问题必然会影响到学生的作品,包括作业和论文的质量。在本文中,我们提出了一种新的方法来检测跨语言剽窃。我们的基于Web的跨语言剽窃检测系统是专门调整,通过实施不同的技术和工具,以协助检测过程中检测翻译剽窃。Google翻译API用作我们的翻译工具,Google搜索API用于我们的信息检索流程。我们的系统还集成了指纹匹配技术,这是一种广泛使用的剽窃检测技术。在一般情况下,我们提出的系统是由翻译输入文件从马来语到英语,其次是删除停用词和词干词,识别语料库中的类似文件,比较类似的模式,最后总结的结果。在剽窃检测过程中,使用三个最低频率的4克指纹匹配来实现核心比较阶段。在K-gram指纹匹配技术中,虽然K的值可以是任意的,但K = 4被认为是一个理想的选择。这是因为较小的K值(即,K = 1、2或3),不能很好地区分句子。另一方面,K的值越大(即,K = 5,6,7...等),更好地区分一个句子中的单词和另一个句子中的单词。

英文摘要:

As the Internet help us cross language and cultural border by providing different types of translation tools, cross language plagiarism, also known as translation plagiarism are bound to arise. Especially among the academic works, such issue will definitely affect the student's works including the quality of their assignments and paper works. In this paper, we propose a new approach in detecting cross language plagiarism. Our web based cross language plagiarism detection system is specially tuned to detect translation plagiarism by implementing different techniques and tools to assist the detection process. Google Translate API is used as our translation tool and Google Search API, which is used in our information retrieval process. Our system is also integrated with the fingerprint matching technique, which is a widely used plagiarism detection technique. In general, our proposed system is started by translating the input documents from Malay to English, followed by removal of stop words and stemming words, identification of similar documents in corpus, comparison of similar pattern and finally summary of the result. Three least-frequent 4-grams fingerprint matching is used to implement the core comparison phase during the plagiarism detection process. In K-gram fingerprint matching technique, although any value of K can be considered, yet K = 4 was stated as an ideal choice. This is because smaller values of K (i.e., K = 1, 2, or 3), do not provide good discrimination between sentences. On the other hand, the larger the values of K (i.e., K = 5, 6, 7...etc), the better discrimination of words in one sentence from words in another.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑