arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.09404cs.CLcs.IR
收藏

阿拉伯语网络双文本语料库AQA-Webcorp的初步研究

A Preliminary Study for Building an Arabic Corpus of Pair Questions-Texts from the Web: AQA-Webcorp

Faculty of Economics and Management, Sfax, Tunisia(斯法克斯经济与管理学院);Aix-Marseille University, Marseille, France(艾克斯-马赛大学)

Wided Bakari, Patrice Bellot, Mahmoud Neji

摘要:

随着电子媒体的发展和Web上阿拉伯语数据的异构性,为机器翻译、信息检索、问答等自然语言处理的某些应用建立一个干净的语料库的想法越来越迫切。在这份手稿中,我们试图创建和发展我们自己的语料库对的问题文本。这样的结构将为我们的实验步骤提供一个更好的基础。因此,我们试图通过阿拉伯语的方法来模拟这一宪法,因为它可以从网络上恢复文本,这些文本可以被证明是我们事实问题的答案。为了做到这一点,我们必须开发一个java脚本,它可以从给定的查询中提取一个html页面列表。然后清理这些网页的程度有一个数据库的文本和语料库的对的问题文本。此外,我们给出了我们的建议方法的初步结果。本文还介绍了阿拉伯语语料库建设方面的一些研究。

英文摘要:

With the development of electronic media and the heterogeneity of Arabic data on the Web, the idea of building a clean corpus for certain applications of natural language processing, including machine translation, information retrieval, question answer, become more and more pressing. In this manuscript, we seek to create and develop our own corpus of pair's questions-texts. This constitution then will provide a better base for our experimentation step. Thus, we try to model this constitution by a method for Arabic insofar as it recovers texts from the web that could prove to be answers to our factual questions. To do this, we had to develop a java script that can extract from a given query a list of html pages. Then clean these pages to the extent of having a data base of texts and a corpus of pair's question-texts. In addition, we give preliminary results of our proposal method. Some investigations for the construction of Arabic corpus are also presented in this document.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑